Fine-tune LLMs twice as fast with 70% less VRAM, so even a single GPU can train.
Megatron-LM
NVIDIA 的大规模 Transformer 训练框架。
- Category
- 🏋️ Training, Fine-Tuning & MLOps
- Repository
- NVIDIA/Megatron-LM
- Stars
- ★ 18,178
- Forks
- 4,633
- Language
- Python
- Last updated
- 2026-10-17
- Visits
- 0
Large-scale training
Similar projects
Unified, efficient fine-tuning of 100+ LLMs with a no-code web UI, the most popular fine-tuning tool in China.
A unified AI compute engine for distributed training, tuning, inference and serving.
机器学习与 GenAI 生命周期管理平台，含追踪与评测。
🧠 Train a 64M-parameter LLM from scratch in just 2h!
微软的深度学习优化库，让分布式训练与推理简单高效。