A company blog post explains that this open release includes the \u201cbase model weights and network architecture\u201d of the \u201c314 billion parameter Mixture-of-Experts model, Grok-1.\u201d It continues saying the model is from a checkpoint last October and hasn\u2019t undergone fine-tuning \u201cfor any specific application, such as dialogue.\u201d <\/p>\n<\/div>\n
\n
As VentureBeat<\/em> notes, it\u2019s being released under the Apache 2.0 license that enables commercial use but doesn\u2019t include the data used to train it or connections to X for real-time data. xAI said in a November 2023 post that the LLM Grok was \u201cdeveloped over the last four months\u201d and is targeted for uses around coding generation, creative writing, and answering questions.\u00a0<\/p>\n<\/div>\n\n
After Musk bought Twitter (now X), the code behind its algorithms was eventually released, and Musk has openly criticized companies that don\u2019t open-source their AI model. That includes OpenAI, which he helped found but is now suing, alleging the company breached an original founding agreement that it would be open source.\u00a0<\/p>\n<\/div>\n
\n
Companies have released open-source or limited open-source models to get feedback from other researchers on how to improve them. While there are many fully open-source AI foundation models like Mistral and Falcon, the most widely used models are either closed-sourced or offer a limited open license. Meta\u2019s Llama 2, for example, gives its research away for free but makes customers with 700 million daily users pay a fee and won\u2019t let developers iterate on top of Llama 2.\u00a0<\/p>\n<\/div>\n