R_REDDYX.XYZ

Prompt Injection: open-source projects on GitHub

28 repositories on Prompt Injection, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.

// RELATED TOPICS

LLM Security 36AI Security 56MCP 1601AI Agents 1319Agent Security 25LLM 2094Security 125Owasp 13Security Tools 51AI Safety 33Agentic AI 378Guardrails 24Langchain 196Claude Code 1595
NVIDIA/SkillSpector

SKILLSPECTOR: AGENT PROTECTION

Scanner searches for vulnerabilities, prompt injections, and data leaks in Claude Code, Codex, and MCP skills before installation.

★ 26,146 · Python
superagent-ai/superagent

Superagent AI Protection

Superagent protects AI applications from prompt injections, data leaks, and harmful outputs by embedding security directly into your product.

★ 6,596 · TypeScript
Tencent/AI-Infra-Guard

AI SYSTEM SECURITY

A platform for testing the security of AI ecosystems: scanning infrastructure, MCP, agents, and evaluating jailbreak attacks.

★ 3,790 · Python
always-further/nono

Capability-based sandbox proxy

Capability-based sandboxes with fine-grained policy. Proxy access directly in the agent's execution context, with zero configuration and zero latency.

★ 2,407 · Rust
uber/ADR

ADR: AI Agent Security in Uber

ADR provides observability, security testing, and threat detection for enterprise AI agents, already used at Uber.

★ 2,135 · Python
wuyoscar/AISafetyHot

AI SAFETY HOT DIGEST

AI Safety HOT collects daily AI safety news, papers & incidents, jailbreaks, prompt injection, alignment and evals. On the platform — website, daily digest, RSS and MCP.

★ 2,125 · TeX
0sec-labs/0

AI-AGENT FOR SECURITY

0 — open-source AI security agent that autonomously detects, exploits and fixes vulnerabilities in the stack. Research preview from Swiss Applied AI & Cybersecurity Resea

★ 1,356 · TypeScript
pipelab-org/pipelock

PIPELOCK PROTECTS AI AGENTS

AI agent firewall for MCP security and egress traffic. Scans HTTP, MCP, A2A and WebSocket traffic in real time for exfiltration, SSRF and prompt injection, emitting media

★ 993 · Go
AgentSafeLabs/safelabs-eval

PROTECTION OF AI AGENTS FROM THREATS

safelabs-eval — framework for red‑teaming and evaluation of AI agent protection based on the ASI01–ASI10 taxonomy inspired by OWASP. Written in Python, it supports CrewAI

★ 829 · Python
luckyPipewrench/pipelock

AI firewall for MCP

Open AI-agent firewall for MCP protection: outbound request control, DLP, SSRF and prompt injection defense.

★ 636 · Go
toby-bridges/api-relay-audit

API RELAY SECURITY SCANNER

Local scanner for AI API relays and LLM proxies. 620 ⭐ on GitHub.

★ 620 · Python
qybaihe/mu

MU: SMART AGENT FOR CODING

mu (μ) — coding agent, which first evaluates the task with a small fast judge, then passes the complex work to the large model. Built on Pi and AionUi, written in TypeScr

★ 604 · TypeScript
KeyValueSoftwareSystems/agent-opfor

AGENT OPFOR ATTACK EMULATION

Open‑source framework for simulating attacks on AI agents and MCP servers. Written in TypeScript and already has 377⭐.

★ 586 · TypeScript
liu00222/Open-Prompt-Injection

OPEN-PROMPT-INJECTION

Open-Prompt-Injection — benchmark for evaluating attack and defense against prompt injections in LLMs. Contains datasets,test scripts,defense metrics. Implemented in Pyth

★ 514 · Python
PrismorSec/prismor

SECURITY FOR AI CODERS - CAPS

Prismor blocks dangerous commands, secret leaks, and prompt injections in Claude Code, Cursor, and Windsurf in real time.

★ 494 · Python
SponsioLabs/Sponsio

SPONSIO - AI AGENT SECURITY

Sponsio offers deterministic security solutions for probabilistic AI agents, minimizing risks of unpredictable behavior.

★ 472 · Python
TrustAI-laboratory/Learn-Prompt-Hacking

Prompt Hacking Course

The most complete course on prompt engineering and LLM attacks: from basics to advanced hacking and defense techniques.

★ 394 · Jupyter Notebook
lalipa2003-arch/JailbreakHub

HUB FOR LLM JAILBREAKING

JailbreakHub collects prompts and methods to bypass LLM safety. The project has 245★ and attack classification. Useful for vulnerability research.

★ 363 · Roff
CyberSunil/LLMVault

LLMVault: OWASP LLM Training

Learn to protect AI systems: practical Prompt Injection, RAG, and agent vulnerabilities in one open training framework.

★ 356 · Python
heaven999b/hello-agent-system

Enterprise AI Agent Design Course

17 bilingual lessons teaching enterprise AI agent system design with hands-on exercises covering tools, RAG, security, evals, and distributed execution.

★ 316 · Python
langgptai/Awesome-Multimodal-Prompts

PROMPTS FOR GPT-4V AND DALL-E3

Awesome-Multimodal-Prompts — selected collection of prompts for GPT-4V and DALL-E3 that unlock full multimodal capabilities. Use them to improve image understanding with

★ 288
LLMSecurity/awesome-agent-skills-security

PROTECTIVE LIST OF AGENT SKILLS

Collected materials on protecting AI‑agent skills: attacks, defenses, frameworks, and benchmarks. The list helps researchers and developers assess tool‑use vulnerabilitie

★ 287
HeadyZhang/agent-audit

AGENT-AUDIT SECURITY SCANNER

Static security scanner for LLM agents. Detects prompt injection, audits MCP configs, and performs taint analysis. Includes 51 rules mapped to OWASP Agentic Top 10 (2026)

★ 245 · Python
humanbound/humanbound

RED-TEAMING AI AGENTS IN PYTHON

Humanbound — adversarial testing engine, SDK, and CLI for AI agents. Runs locally or via Humanbound Platform. 218 stars on GitHub.

★ 239 · Python
guardana/guardana

GUARDANA AI MODEL PROTECTION

Guardana scans model artifacts, live endpoints, MCP servers, and agent traces for security threats. It generates reproducible evidence for release decisions.

★ 225 · Python
gy15901580825/Argus

ARGUS: AI AGENT SECURITY RED-TEAM TESTING

Open-source framework for red-team testing AI agents. 261 probes mapped to OWASP LLM Top 10, MITRE ATLAS, and NIST AI RMF. Browser, MCP, and mock payment support included

★ 210 · Python
secureagentics/Adrian

ADRIAN: AI AGENT SECURITY

Adrian monitors and blocks dangerous AI agent actions in real time, preventing malicious tool calls and prompt injections.

★ 203 · Python
OWASP/www-project-agent-memory-guard

DEFENSE MEMORY AI-AGENTS

Provides runtime defense against memory AI-agent poisoning (OWASP ASI06). Drop-in for LangChain, OpenAI Agents, AutoGen, CrewAI and mem0.

★ 203 · Python

New projects on this topic in Telegram

Telegram →
Prompt Injection — 28 open-source GitHub projects | REDDYX AI