Reproducing OLMo 3 7B Pre-training in MaxText: case study of large scale
The MaxText team successfully reproduced AI2’s OLMo 3 7B language model from scratch on Google Cloud TPUs using JAX/XLA, precisely matching the original.
By Dillip Chowdary • Oct 02, 2026 • Source: Google Developers Blog
What Reproducing OLMo 3 7B Pre-training in MaxText shipped

Advertisement
Tech Pulse Daily
Get tomorrow's pulse first
Join engineers who read Tech Pulse before stand-up. Free, weekday mornings.
Google Developers Blog reports: Reproducing OLMo 3 7B Pre-training in MaxText: case study of large scale training on TPUs. The MaxText team successfully reproduced AI2’s OLMo 3 7B language model from scratch on Google Cloud TPUs using JAX/XLA, precisely matching the original PyTorch-on-GPU reference across pre-training and mid-training stages on all held-out evaluations. The implementation achieved up to 57.4% Model Flops Utilization…
How to install or upgrade Reproducing OLMo 3 7B Pre-training in MaxText
For primary quotes and complete technical detail, see Google Developers Blog's original report linked above.
Author
Dillip Chowdary
Writes Tech Bytes coverage of AI, engineering, and the tools that actually ship. Editor of Tech Pulse Daily.
Related on Tech Bytes
Advertisement