Prompt Injection: open-source projects on GitHub
28 repositories on Prompt Injection, picked by the REDDYX AI agent. Each has a summary, key features and a breakdown. Sorted by stars.
// RELATED TOPICS
SKILLSPECTOR: AGENT PROTECTION
Scanner searches for vulnerabilities, prompt injections, and data leaks in Claude Code, Codex, and MCP skills before installation.
★ 26,146 · PythonSuperagent AI Protection
Superagent protects AI applications from prompt injections, data leaks, and harmful outputs by embedding security directly into your product.
★ 6,596 · TypeScriptAI SYSTEM SECURITY
A platform for testing the security of AI ecosystems: scanning infrastructure, MCP, agents, and evaluating jailbreak attacks.
★ 3,790 · PythonCapability-based sandbox proxy
Capability-based sandboxes with fine-grained policy. Proxy access directly in the agent's execution context, with zero configuration and zero latency.
★ 2,407 · RustADR: AI Agent Security in Uber
ADR provides observability, security testing, and threat detection for enterprise AI agents, already used at Uber.
★ 2,135 · PythonAI SAFETY HOT DIGEST
AI Safety HOT collects daily AI safety news, papers & incidents, jailbreaks, prompt injection, alignment and evals. On the platform — website, daily digest, RSS and MCP.
★ 2,125 · TeXAI-AGENT FOR SECURITY
0 — open-source AI security agent that autonomously detects, exploits and fixes vulnerabilities in the stack. Research preview from Swiss Applied AI & Cybersecurity Resea
★ 1,356 · TypeScriptPIPELOCK PROTECTS AI AGENTS
AI agent firewall for MCP security and egress traffic. Scans HTTP, MCP, A2A and WebSocket traffic in real time for exfiltration, SSRF and prompt injection, emitting media
★ 993 · GoPROTECTION OF AI AGENTS FROM THREATS
safelabs-eval — framework for red‑teaming and evaluation of AI agent protection based on the ASI01–ASI10 taxonomy inspired by OWASP. Written in Python, it supports CrewAI
★ 829 · PythonAI firewall for MCP
Open AI-agent firewall for MCP protection: outbound request control, DLP, SSRF and prompt injection defense.
★ 636 · GoAPI RELAY SECURITY SCANNER
Local scanner for AI API relays and LLM proxies. 620 ⭐ on GitHub.
★ 620 · PythonMU: SMART AGENT FOR CODING
mu (μ) — coding agent, which first evaluates the task with a small fast judge, then passes the complex work to the large model. Built on Pi and AionUi, written in TypeScr
★ 604 · TypeScriptAGENT OPFOR ATTACK EMULATION
Open‑source framework for simulating attacks on AI agents and MCP servers. Written in TypeScript and already has 377⭐.
★ 586 · TypeScriptOPEN-PROMPT-INJECTION
Open-Prompt-Injection — benchmark for evaluating attack and defense against prompt injections in LLMs. Contains datasets,test scripts,defense metrics. Implemented in Pyth
★ 514 · PythonSECURITY FOR AI CODERS - CAPS
Prismor blocks dangerous commands, secret leaks, and prompt injections in Claude Code, Cursor, and Windsurf in real time.
★ 494 · PythonSPONSIO - AI AGENT SECURITY
Sponsio offers deterministic security solutions for probabilistic AI agents, minimizing risks of unpredictable behavior.
★ 472 · PythonPrompt Hacking Course
The most complete course on prompt engineering and LLM attacks: from basics to advanced hacking and defense techniques.
★ 394 · Jupyter NotebookHUB FOR LLM JAILBREAKING
JailbreakHub collects prompts and methods to bypass LLM safety. The project has 245★ and attack classification. Useful for vulnerability research.
★ 363 · RoffLLMVault: OWASP LLM Training
Learn to protect AI systems: practical Prompt Injection, RAG, and agent vulnerabilities in one open training framework.
★ 356 · PythonEnterprise AI Agent Design Course
17 bilingual lessons teaching enterprise AI agent system design with hands-on exercises covering tools, RAG, security, evals, and distributed execution.
★ 316 · PythonPROMPTS FOR GPT-4V AND DALL-E3
Awesome-Multimodal-Prompts — selected collection of prompts for GPT-4V and DALL-E3 that unlock full multimodal capabilities. Use them to improve image understanding with
★ 288PROTECTIVE LIST OF AGENT SKILLS
Collected materials on protecting AI‑agent skills: attacks, defenses, frameworks, and benchmarks. The list helps researchers and developers assess tool‑use vulnerabilitie
★ 287AGENT-AUDIT SECURITY SCANNER
Static security scanner for LLM agents. Detects prompt injection, audits MCP configs, and performs taint analysis. Includes 51 rules mapped to OWASP Agentic Top 10 (2026)
★ 245 · PythonRED-TEAMING AI AGENTS IN PYTHON
Humanbound — adversarial testing engine, SDK, and CLI for AI agents. Runs locally or via Humanbound Platform. 218 stars on GitHub.
★ 239 · PythonGUARDANA AI MODEL PROTECTION
Guardana scans model artifacts, live endpoints, MCP servers, and agent traces for security threats. It generates reproducible evidence for release decisions.
★ 225 · PythonARGUS: AI AGENT SECURITY RED-TEAM TESTING
Open-source framework for red-team testing AI agents. 261 probes mapped to OWASP LLM Top 10, MITRE ATLAS, and NIST AI RMF. Browser, MCP, and mock payment support included
★ 210 · PythonADRIAN: AI AGENT SECURITY
Adrian monitors and blocks dangerous AI agent actions in real time, preventing malicious tool calls and prompt injections.
★ 203 · PythonDEFENSE MEMORY AI-AGENTS
Provides runtime defense against memory AI-agent poisoning (OWASP ASI06). Drop-in for LangChain, OpenAI Agents, AutoGen, CrewAI and mem0.
★ 203 · PythonNew projects on this topic in Telegram
Telegram →