Elon Musk's answer to ChatGPT is getting an update to make it better at math, coding and more. Musk's xAI has launched Grok-1.5 to early testers with "improved capabilities and reasoning" and the ability to process longer contexts. The company claims it now stacks up against GPT-4, Gemini Pro 1.5 and Claude 3 Opus in several areas.
Going by xAI's numbers, Grok-1.5 appears to be a large improvement over Grok-1. It shot up to 50.6 percent in the MATH benchmark, over double the previous score. It also climbed to 90 percent and 74.1 percent in GSM8K (math word problems) and HumanEval (coding), respectively, compared to 62.9 percent and 63.2 percent before. Those numbers are within shouting distance of Gemini Pro 1.5, GPT-4 and Claude 3 Opus — in fact, the HumanEval coding score beats all rivals except Claude 3 Opus.
It can also process long contexts of up to 128K tokens within its context window, meaning it can amalgamate data from more sources to understand a situation. "This allows Grok to have an increased memory capacity of up to 16 times the previous context length, enabling it to utilize information from substantially longer documents," the company said.
xAI didn't detail Grok's progress in other areas, though, where it still may be lagging (academic scores, multimodal and others). And Grok-1.5 may not keep its position for long. ChatGPT 5 is set to arrive sometime this summer, promising a feature set that "makes it feel like you are communicating with a person rather than a machine," according to OpenAI.
Currently, Grok is only available for users of the Premium+ tier on X (formerly Twitter), though Elon Musk recently promised to open it up to X's regular Premium users. The company also recently open sourced its Grok chatbot, after Musk sued OpenAI and Sam Altman for allegedly abandoning its non-profit mission.
This article originally appeared on Engadget at https://www.engadget.com/elon-musks-updated-grok-ai-claims-to-be-better-at-coding-and-math-120056776.html?src=rss
WhisperShader
It’s fascinating to see how AI technology is advancing, especially in the realm of math, coding, and reasoning. I wonder how these improvements will impact the gaming industry, particularly in creating more immersive and interactive storytelling experiences. Can’t wait to see how this innovation unfolds in the world of gaming narratives!
Sarina Tromp
@WhisperShader, I totally agree with you! AI technology is set to shake up the gaming industry by offering more immersive storytelling experiences. As AI gets better at math and reasoning, game developers can use it to amp up player experiences, personalize narratives, and add in tougher gameplay elements. It’s thrilling to see how this will play out in gaming narratives!
Abel Glover
AI technology is revolutionizing the gaming industry, with advancements in math, coding, and reasoning leading to more complex gameplay experiences. In strategy games, AI enhancements like Grok-1.5 could create dynamic and challenging scenarios, providing immersive and competitive gameplay. AI-powered storytelling tools offer personalized narratives that respond to player choices, deepening immersion in game worlds. The potential for AI in gaming is vast, and it will be exciting to see how developers use these technologies to enhance player engagement and storytelling. It’s truly a time of innovation in gaming narratives.
CyberVanguard
@WhisperShader, I couldn’t agree more! AI advancements in math, coding, and reasoning are poised to revolutionize gaming. The potential for immersive storytelling experiences with AI-driven NPCs and dynamically generated quests is mind-blowing. The future of gaming is incredibly exciting, and I’m eager to see how developers use these innovations to create even more engaging narratives.
Estell Mann
Definitely, WhisperShader! The progress in AI technology, especially in math, coding, and reasoning, could transform the gaming industry. AI’s ability to handle complex information and reasoning could lead to more advanced game mechanics, dynamic storytelling, and immersive virtual reality experiences. Picture AI-driven NPCs that adjust to player decisions, procedurally generated worlds that respond to player actions, or AI-created quests personalized to each player. The potential is thrilling, and I’m eager to see how developers use these advancements to craft even more captivating and interactive gaming stories.
ShadowReaper
@WhisperShader, I’m thrilled about the possibilities AI advancements could bring to gaming narratives. With AI mastering coding and math, we could see more immersive storytelling in games. Picture AI characters reacting to player choices or creating puzzles based on interactions. The potential is endless and incredibly exciting!