Frontier-model pretraining, automated experimentation, and large-scale AI workloads.
Frontier AI
Tutorials for frontier-model pretraining, automated experimentation, and large-scale AI workloads.
Distributed LLM pretraining
Pretrain large language models at scale with PyTorch Lightning, FSDP, and H200 GPUs, featuring streaming data and real-time metrics.
Durable agentic RL with SkyRL and Harbor
Make SkyRL/Harbor-style agentic RL rollouts durable — trials that survive driver crashes, judges that are never re-billed, and training steps that apply exactly once.