AI Reports · Amazon · 2026-10-22 · Blog / commentary
Write your own training loop — without managing GPUs — with Amazon SageMaker training session APIs

Amazon SageMaker AI training session APIs let developers write their own LLM training loop (SFT, RL, or custom objectives) in a Python script while the service runs the GPUs. Operations like forward_backward(), optim_step(), and sample() become SageMaker API calls against a live, stateful session, so the model stays loaded on the GPUs across steps. The post introduces the programming model and three SDK clients, then walks through a GRPO loop on GSM8K and a reinforcement learning workload on competitive programming.