🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models
🧪 评测·观测·安全
模型评测、提示词测试、可观测性与护栏红队
全部 1047🧠 大语言模型 25🤖 AI 智能体 164🧩 应用开发平台 23📚 RAG 与知识库 46💬 聊天界面与客户端 42🖥️ 本地推理与部署 87👨💻 AI 编程 97🛠️ 开发框架与 SDK 48🔌 MCP 与工具生态 36🎨 图像生成 26🎬 视频生成 18🎙️ 语音与音频 44👁️ 计算机视觉 26📄 文档解析与抓取 24🗄️ 向量数据库 25🏋️ 训练微调与 MLOps 76🧪 评测·观测·安全 80🚪 API 网关与代理 12🔎 搜索与深度研究 13⚙️ 深度学习基础库 54🏷️ 数据与标注 31🔬 行业与科研 AI 36⚡ 效率工具 14
LLM 交互安全工具包，检测提示注入与敏感信息。
PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.
Templates and workflow for generating PRDs, Tech Designs, and MVP and more using LLMs for AI IDEs
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).
An open-source visual programming environment for battle-testing prompts to LLMs.
DeepTeam is a framework to red team LLMs and AI agents.
Open-source, self-hosted AI penetration testing framework: maps your attack surface into a graph, autonomously exploits it from a Kali sandbox with human approval gates, and opens PRs that fix what it finds. MCP both way
Inspect: A framework for large language model evaluations
[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.
Self-learning agent browser
Hugging Face 的轻量 LLM 评测工具箱。
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app
A Python package to assess and improve fairness of machine learning models.
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.
Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower develo
Interpretability and explainability of data and machine learning models
MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering
Reference implementations of MLPerf® inference benchmarks
🌎💪 BrowserGym, a Gym environment for web task automation