🧪 मूल्यांकन, ऑब्ज़र्वेबिलिटी और सुरक्षा

Shapash

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

LLM Guard

The LLM interactive security toolkit detects clues injected with sensitive information.

PentestAgent (GH05TCREW)

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

Vibe-Coding Prompt Template

Templates and workflow for generating PRDs, Tech Designs, and MVP and more using LLMs for AI IDEs

RedAmon

Open-source, self-hosted AI penetration testing framework: maps your attack surface into a graph, autonomously exploits it from a Kali sandbox with human approval gates, and opens PRs that fix what it finds. MCP both way

Prompttools

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

ChainForge

An open-source visual programming environment for battle-testing prompts to LLMs.

Inspect AI

Inspect: A framework for large language model evaluations

DeepTeam (Confident AI)

DeepTeam is a framework to red team LLMs and AI agents.

EasyEdit

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

AI Fairness 360

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

OpenLIT

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

Webcmd

Self-learning agent browser

LightEval

Hugging Face's Lightweight LLM Assessment Toolbox.

Hugging Face Evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

E2B Code Interpreter

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Fairlearn

A Python package to assess and improve fairness of machine learning models.

Future AGI

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

ADR (Uber)

ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.

Responsible AI Toolbox

Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower develo

AIX360

Interpretability and explainability of data and machine learning models

MLE-bench (OpenAI)

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

MLPerf Inference

Reference implementations of MLPerf® inference benchmarks

PinchBench

PinchBench is a benchmarking system for evaluating LLM models as OpenClaw coding agents. Made with 🦀 by the humans at https://kilo.ai