xAI completed training of its 1.5 trillion parameter Grok V9 foundation model, which Elon Musk described as a major upgrade over the 0.5 trillion parameter Grok V8 now running as version 4.3
Public release expected in three to four weeks after fine-tuning.
#341Bill Yuchen Lin@BILLYUCHENLIN🚀🔜
Elon Musk@elonmuskWe are improving the 0.5T Grok foundation model V8 (public version 4.3) every few days. The 1.5T V9 just finished training (incorrectly called pre-training) and is a major upgrade. Next, we are adding the Cursor data in supplemental training (others call this mid-training), then SFT and RL. About 3 or 4 weeks to release. This will be a banger.
#517Andrew Curran@ANDREWCURRAN_The new 1.5T version of Grok arrives in June. Lately, I use 4.3 increasingly for research, search, and sourcing news. I like it. It thinks differently.
Elon doesn't mention it in this post, but he also has big 6T and 10T variants in training.
Elon Musk@elonmuskWe are improving the 0.5T Grok foundation model V8 (public version 4.3) every few days. The 1.5T V9 just finished training (incorrectly called pre-training) and is a major upgrade. Next, we are adding the Cursor data in supplemental training (others call this mid-training), then SFT and RL. About 3 or 4 weeks to release. This will be a banger.
#517Andrew Curran@ANDREWCURRAN_The new 1.5T version of Grok arrives in June. Lately, I use 4.3 increasingly for research, search, and sourcing news. I like it. It runs in a team of four, and it thinks differently.
Elon doesn't mention it in this post, but he also has big 6T and 10T variants in training.
Elon Musk@elonmuskWe are improving the 0.5T Grok foundation model V8 (public version 4.3) every few days. The 1.5T V9 just finished training (incorrectly called pre-training) and is a major upgrade. Next, we are adding the Cursor data in supplemental training (others call this mid-training), then SFT and RL. About 3 or 4 weeks to release. This will be a banger.
@elonmusk @orcdev oh fuck yes 🔥🔥
Elon Musk@elonmuskWe are improving the 0.5T Grok foundation model V8 (public version 4.3) every few days. The 1.5T V9 just finished training (incorrectly called pre-training) and is a major upgrade. Next, we are adding the Cursor data in supplemental training (others call this mid-training), then SFT and RL. About 3 or 4 weeks to release. This will be a banger.
@elonmusk @brivael @orcdev 🚀
Elon Musk@elonmuskWe are improving the 0.5T Grok foundation model V8 (public version 4.3) every few days. The 1.5T V9 just finished training (incorrectly called pre-training) and is a major upgrade. Next, we are adding the Cursor data in supplemental training (others call this mid-training), then SFT and RL. About 3 or 4 weeks to release. This will be a banger.
@elonmusk @orcdev any ETA?
Elon Musk@elonmuskWe are improving the 0.5T Grok foundation model V8 (public version 4.3) every few days. The 1.5T V9 just finished training (incorrectly called pre-training) and is a major upgrade. Next, we are adding the Cursor data in supplemental training (others call this mid-training), then SFT and RL. About 3 or 4 weeks to release. This will be a banger.