Reproducing OLMo 3 7B on TPUs reveals hidden data loader bugs
A Google case study reproduces AI2's OLMo 3 model on TPUs, matching performance metrics while uncovering critical data sharding errors that masked memorization as improvement.
Results for “tpu”
Daily coverage of AI, developer tools and infrastructure. Each story explains what happened and why it matters, with a link to the original source.
Google demonstrates autonomous LLM fine-tuning loops on TPUs
Google Developers Blog details autofinetune, an agent-driven system that automates hyperparameter tuning for SFT and RL post-training on Cloud TPUs.
Optimizing long-context embedding inference on Cloud TPU with vLLM
Google details how native TPU support in vLLM enables elastic scaling and high-precision embedding inference for Qwen3 models.
Optimizing HeyGen's Avatar IV diffusion model for Google Cloud TPUs
HeyGen and Google Cloud engineers detail how they ported the Avatar IV video generation pipeline to Trillium v6e TPUs, achieving a 1.86x speedup through kernel optimization and parallelism strategies.
