轻松在任意设备上做分布式训练与混合精度。
🏋️ 学習・ファインチューニングと MLOps
ファインチューニング、分散学習、強化学習、実験管理
Containers for machine learning
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
魔搭社区的模型即服务平台开源库。
构建、部署与扩展 AI 应用和模型服务的统一框架。
slime is an LLM training framework for RL Scaling.
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)
The Open Source Feature Store for AI/ML
A repository of models, textual inversions, and more
自动化机器学习实验追踪、编排与部署平台。
Efficient Triton Kernels for LLM Training
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
A Cloud Native Batch System (Project under CNCF)
Democratizing Reinforcement Learning for LLMs
PyTorch 原生的大模型后训练库。
A PyTorch native platform for training generative AI models
Robust recipes to align language models with human and AI preferences
可移植、可复现的 MLOps 流水线框架。
RLinf: Reinforcement Learning Infrastructure for Embodied and Agentic AI