Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
AI Open Source
Hand-picked AI open-source projects on GitHub worth following: LLMs, agents, RAG, local deployment, image and speech… 1055 projects so far.
Looking for projects you can deploy for free on Cloudflare, Vercel, Netlify and more? See Free Deploy Picks
All 1055🧠 Large Language Models 26🤖 AI Agents 166🧩 App Development Platforms 23📚 RAG & Knowledge Bases 46💬 Chat UIs & Clients 42🖥️ Local Inference & Deployment 87👨💻 AI Coding 98🛠️ Frameworks & SDKs 48🔌 MCP & Tool Ecosystem 35🎨 Image Generation 25🎬 Video Generation 17🎙️ Speech & Audio 43👁️ Computer Vision 28📄 Document Parsing & Scraping 25🗄️ Vector Databases 25🏋️ Training, Fine-Tuning & MLOps 76🧪 Evaluation, Observability & Safety 82🚪 API Gateways & Proxies 12🔎 Search & Deep Research 15⚙️ Deep Learning Libraries 57🏷️ Data & Annotation 32🔬 Industry & Science AI 35⚡ Productivity Tools 12
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.
FlashInfer: Kernel Library for LLM Serving
AI2 的完全开放语言模型，连训练数据、代码与日志一并开源。
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Efficient Triton Kernels for LLM Training
Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.
Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google
非线智能 NoneLinear - ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型， 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M
AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.
基于深度学习的文档文字识别库。
Turn long-horizon goals into verifiable results. A local-first control plane and research workbench for agents and teams, across sessions and runtimes.
🐬DeepChat - A smart assistant that connects powerful AI to your personal world
A flexible, high-performance serving system for machine learning models
Framework for evaluating and improving agents
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
按语义智能路由请求到合适模型的 Mixture-of-Models 路由器。
开源 LLM 可观测平台，一行代码接入监控与缓存。
Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.
HelixDB is an OLTP graph database with native vector and full-text search built in Rust on Object Storage.
an ambient intelligence library
A scikit-learn compatible neural network library that wraps PyTorch
Chronos: Pretrained Models for Time Series Forecasting