[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while mai
AI Open Source
Hand-picked AI open-source projects on GitHub worth following: LLMs, agents, RAG, local deployment, image and speech… 1047 projects so far.
Looking for projects you can deploy for free on Cloudflare, Vercel, Netlify and more? See Free Deploy Picks
All 1047🧠 Large Language Models 26🤖 AI Agents 164🧩 App Development Platforms 23📚 RAG & Knowledge Bases 46💬 Chat UIs & Clients 41🖥️ Local Inference & Deployment 87👨💻 AI Coding 99🛠️ Frameworks & SDKs 47🔌 MCP & Tool Ecosystem 34🎨 Image Generation 25🎬 Video Generation 17🎙️ Speech & Audio 44👁️ Computer Vision 28📄 Document Parsing & Scraping 24🗄️ Vector Databases 25🏋️ Training, Fine-Tuning & MLOps 75🧪 Evaluation, Observability & Safety 81🚪 API Gateways & Proxies 12🔎 Search & Deep Research 15⚙️ Deep Learning Libraries 56🏷️ Data & Annotation 31🔬 Industry & Science AI 34⚡ Productivity Tools 13
Readymade evaluators for your LLM apps
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observabi
NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.
a self-hosted webui for 30+ generative ai
An autoML framework & toolkit for machine learning on graphs.
Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with
The nnsight package enables interpreting and manipulating the internals of deep learned models.
Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments
A security scanner for your LLM agentic workflows
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
Active learning for systematic reviews
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applic
Kubernetes AI Toolchain Operator