[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while mai
Projetos de IA de código aberto
Projetos de IA de código aberto do GitHub que vale a pena acompanhar: LLMs, agentes, RAG, implantação local, imagem e voz… 1047 projetos até agora.
Procura projetos que possam ser implantados de graça na Cloudflare, Vercel, Netlify e mais? Veja Deploy gratuito: seleção
Todos 1047🧠 Grandes modelos de linguagem 26🤖 Agentes de IA 164🧩 Plataformas de desenvolvimento de apps 23📚 RAG e bases de conhecimento 46💬 Interfaces de chat e clientes 41🖥️ Inferência e implantação local 87👨💻 Programação com IA 99🛠️ Frameworks e SDKs 47🔌 MCP e ecossistema de ferramentas 34🎨 Geração de imagens 25🎬 Geração de vídeo 17🎙️ Voz e áudio 44👁️ Visão computacional 28📄 Análise de documentos e scraping 24🗄️ Bancos de dados vetoriais 25🏋️ Treinamento, ajuste fino e MLOps 75🧪 Avaliação, observabilidade e segurança 81🚪 Gateways e proxies de API 12🔎 Busca e pesquisa profunda 15⚙️ Bibliotecas de deep learning 56🏷️ Dados e anotação 31🔬 IA para indústria e ciência 34⚡ Ferramentas de produtividade 13
Readymade evaluators for your LLM apps
🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observabi
NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.
a self-hosted webui for 30+ generative ai
An autoML framework & toolkit for machine learning on graphs.
Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.
Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with
The nnsight package enables interpreting and manipulating the internals of deep learned models.
Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments
A security scanner for your LLM agentic workflows
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
Active learning for systematic reviews
RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applic
Kubernetes AI Toolchain Operator