AI ओपन सोर्स प्रोजेक्ट

MInference

[NeurIPS'24 Spotlight, ICLR'25, ICML'25] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while mai

OpenEvals

Readymade evaluators for your LLM apps

RAGLite (Superlinear)

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

GPT-RAG (Azure)

Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observabi

NVTabular

NVTabular is a feature engineering and preprocessing library for tabular data designed to quickly and easily manipulate terabyte scale datasets used to train deep learning based recommender systems.

biniou

a self-hosted webui for 30+ generative ai

AutoGL

An autoML framework & toolkit for machine learning on graphs.

Weights & Biases Weave

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.

Darkmoon

Open-source autonomous AI penetration testing. 50 specialist agents across web, API, cloud, Active Directory, Kubernetes, CI/CD and AI/LLM (OWASP LLM Top 10). Runs on a local LLM behind a Privacy Gateway. Integrates with

nnsight

The nnsight package enables interpreting and manipulating the internals of deep learned models.

skrl

Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments

Agentic Radar

A security scanner for your LLM agentic workflows

Swiss Army Llama

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

ASReview

Active learning for systematic reviews

RAFT

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applic

Kaito

Kubernetes AI Toolchain Operator