轻松在任意设备上做分布式训练与混合精度。
🏋️ Training, Fine-Tuning & MLOps
Fine-tuning, distributed training, reinforcement learning and experiment tracking
All 1045🧠 Large Language Models 24🤖 AI Agents 162🧩 App Development Platforms 22📚 RAG & Knowledge Bases 48💬 Chat UIs & Clients 40🖥️ Local Inference & Deployment 88👨💻 AI Coding 97🛠️ Frameworks & SDKs 47🔌 MCP & Tool Ecosystem 36🎨 Image Generation 26🎬 Video Generation 17🎙️ Speech & Audio 45👁️ Computer Vision 26📄 Document Parsing & Scraping 25🗄️ Vector Databases 25🏋️ Training, Fine-Tuning & MLOps 71🧪 Evaluation, Observability & Safety 79🚪 API Gateways & Proxies 12🔎 Search & Deep Research 15⚙️ Deep Learning Libraries 58🏷️ Data & Annotation 32🔬 Industry & Science AI 34⚡ Productivity Tools 16
Containers for machine learning
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
魔搭社区的模型即服务平台开源库。
构建、部署与扩展 AI 应用和模型服务的统一框架。
slime is an LLM training framework for RL Scaling.
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
The Open Source Feature Store for AI/ML
A repository of models, textual inversions, and more
自动化机器学习实验追踪、编排与部署平台。
Efficient Triton Kernels for LLM Training
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
A Cloud Native Batch System (Project under CNCF)
Democratizing Reinforcement Learning for LLMs
PyTorch 原生的大模型后训练库。
A PyTorch native platform for training generative AI models
Robust recipes to align language models with human and AI preferences
可移植、可复现的 MLOps 流水线框架。
RLinf: Reinforcement Learning Infrastructure for Embodied and Agentic AI