Optimizing long-context embedding inference on Cloud TPU with vLLM
Google details how native TPU support in vLLM enables elastic scaling and high-precision embedding inference for Qwen3 models.
Results for “google cloud”
Daily coverage of AI, developer tools and infrastructure. Each story explains what happened and why it matters, with a link to the original source.
Optimizing HeyGen's Avatar IV diffusion model for Google Cloud TPUs
HeyGen and Google Cloud engineers detail how they ported the Avatar IV video generation pipeline to Trillium v6e TPUs, achieving a 1.86x speedup through kernel optimization and parallelism strategies.
