Fine-tune LLMs twice as fast with 70% less VRAM, so even a single GPU can train.
Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
- Category
- 🏋️ Training, Fine-Tuning & MLOps
- Repository
- MakazhanAlpamys/Soup
- Stars
- ★ 9,232
- Forks
- 1,506
- Last updated
- 2026-10-16
- Visits
- 0
LLMLocal deployment
Similar projects
Unified, efficient fine-tuning of 100+ LLMs with a no-code web UI, the most popular fine-tuning tool in China.
A unified AI compute engine for distributed training, tuning, inference and serving.
机器学习与 GenAI 生命周期管理平台，含追踪与评测。
🧠 Train a 64M-parameter LLM from scratch in just 2h!
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.