Announcing Grok-1.5 with improved reasoning and long context capabilities
xAI has announced Grok-1.5, an upgraded large language model featuring enhanced reasoning capabilities and support for a context window of up to 128,000 tokens.
2 min read·Wednesday, 4 November
Abstract visual representation of xAI's Grok-1.5 release.
xAI has officially introduced Grok-1.5, an updated version of its large language model—computer programs designed to process and generate human-like text by predicting the next word. This new iteration brings significant improvements in reasoning and the ability to process much longer text inputs.
Needle In A Haystack benchmark evaluation results showing retrieval accuracy up to 128k tokens. · Source ↗
Long context capabilities
One of the primary upgrades in Grok-1.5 is its expanded capacity for handling longer and more complex prompts. As a model's context window—the total amount of text it can look at and remember at one time—expands, maintaining instruction-following capabilities can be challenging.
To test this, the development team used the Needle In A Haystack evaluation, a benchmark test that measures a model's ability to locate a specific piece of information buried within a large volume of text. Grok-1.5 demonstrated strong retrieval capabilities for embedded text within contexts of up to 128K tokens in length, achieving perfect retrieval results.
Custom infrastructure
Training cutting-edge large language models requires massive graphics processing unit clusters. Grok-1.5 was built using a custom distributed training framework based on JAX, Rust, and Kubernetes. This stack allows the team to prototype ideas and train new architectures efficiently.
A major hurdle when training models on large compute clusters is maintaining reliability and uptime. The team implemented a custom training orchestrator designed to automatically detect problematic nodes and remove them from the job. Additionally, they optimized checkpointing, data loading, and training job restarts to minimize downtime during failures.
Availability
Grok-1.5 will soon be made available to early testers as the team prepares for a gradual rollout to a wider audience over the coming days.
The Ultimate 2026 Free AI API Engine: Top 10 Provider Blueprints & Setup GuideFree guide
Comments