EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL
🏋️ Entrenamiento, ajuste fino y MLOps
Ajuste fino, entrenamiento distribuido, aprendizaje por refuerzo y seguimiento de experimentos
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
An Engine-Agnostic Deep Learning Framework in Java
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
Pre-trained Deep Learning models and demos (high quality and extremely fast)
Machine Learning Pipelines for Kubeflow
The official CLI and Python client for the Hugging Face Hub.
AI Infra / AI Orchestration / AI Control Plane
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory util
Open-source pipeline for rewriting AI-generated text into natural human prose. Need it in your app? Try the Lynote Humanizer API → lynote.ai/ai-humanizer-api
Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch and TensorFlow.
Minimalistic large language model 3D-parallelism training
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.
Ongoing research training transformer language models at scale, including: BERT & GPT-2
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
Scalable toolkit for efficient model reinforcement
KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
A Data Streaming Library for Efficient Neural Network Training
An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.
Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
Python package for LLM compression
Data search & enrichment library for Machine Learning → Easily find and add relevant features to your ML & AI pipeline from hundreds of public and premium external data sources, including open & commercial LLMs