[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while mai
Proyectos de IA de código abierto
Proyectos de IA de código abierto de GitHub que merece la pena seguir: LLM, agentes, RAG, despliegue local, imagen y voz… 1047 proyectos hasta ahora.
¿Buscas proyectos que puedas desplegar gratis en Cloudflare, Vercel, Netlify y más? Mira Despliegue gratuito: selección
Todo 1047🧠 Modelos de lenguaje 26🤖 Agentes de IA 164🧩 Plataformas de desarrollo de apps 23📚 RAG y bases de conocimiento 46💬 Interfaces de chat y clientes 41🖥️ Inferencia y despliegue local 87👨💻 Programación con IA 99🛠️ Frameworks y SDK 47🔌 MCP y ecosistema de herramientas 34🎨 Generación de imágenes 25🎬 Generación de vídeo 17🎙️ Voz y audio 44👁️ Visión por computador 28📄 Análisis de documentos y scraping 24🗄️ Bases de datos vectoriales 25🏋️ Entrenamiento, ajuste fino y MLOps 75🧪 Evaluación, observabilidad y seguridad 81🚪 Pasarelas y proxies de API 12🔎 Búsqueda e investigación profunda 15⚙️ Bibliotecas de aprendizaje profundo 56🏷️ Datos y anotación 31🔬 IA para industria y ciencia 34⚡ Herramientas de productividad 13
Readymade evaluators for your LLM apps
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observabi
NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.
a self-hosted webui for 30+ generative ai
An autoML framework & toolkit for machine learning on graphs.
Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with
The nnsight package enables interpreting and manipulating the internals of deep learned models.
Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments
A security scanner for your LLM agentic workflows
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
Active learning for systematic reviews
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applic
Kubernetes AI Toolchain Operator