AI Reports · Amazon · 2026-10-19 · Blog / commentary
How Deepgram optimized voice AI at scale with AWS Trainium
Deepgram worked with the AWS Forward Deployed Engineering team to port its Nova-3 speech-to-text model to AWS Trainium2 for offline batch inference. The work covered the AWS Neuron stack, kernel-level tuning, and a data-parallel Rust runtime. On Deepgram's batch workloads, the Trainium2 setup processed 11–70 percent more audio per dollar than its previous compute options.