Agents1 min read
HeyGen x Google Cloud: Bringing Avatar IV to TPUs
HeyGen ported their 18B+ parameter Avatar IV video generation model to Google Cloud's Trillium (v6e) TPUs via torchax and XLA, utilizing FSDP and Ulysses sequence parallelism across an eight-chip mesh. To achieve a 1.86x speedup for real...
From Google AI developers blog
