xAI releases base model weights for Grok-1

The artificial intelligence research organization xAI has released the base model weights and network architecture for Grok-1, its large language model. This release makes the foundational components of the system available to the public under an open-source license.

Grok-1 is a 314-billion-parameter Mixture-of-Experts model — an architecture that routes each incoming token to specialized sub-networks to improve efficiency. Specifically, the system activates 25 percent of its total weights for any given token.