Fine-tune LLMs twice as fast with 70% less VRAM, so even a single GPU can train.
Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
- Category
- 🏋️ Training, Fine-Tuning & MLOps
- Repository
- microsoft/Megatron-DeepSpeed
- Stars
- ★ 2,266
- Forks
- 367
- Last updated
- 2025-08-14
- Visits
- 0
Similar projects
Unified, efficient fine-tuning of 100+ LLMs with a no-code web UI, the most popular fine-tuning tool in China.
A unified AI compute engine for distributed training, tuning, inference and serving.
机器学习与 GenAI 生命周期管理平台，含追踪与评测。
🧠 Train a 64M-parameter LLM from scratch in just 2h!
微软的深度学习优化库，让分布式训练与推理简单高效。