Prompt Guard Safety Alignment

•
4.0k
•

Protects LLM applications by detecting and filtering prompt injections and jailbreak attempts with high precision.

Prompt Guard is a specialized security skill powered by Meta’s 86M parameter classifier, designed to safeguard AI applications from malicious inputs. It provides robust defense-in-depth by identifying direct jailbreak attempts in user prompts and indirect injections hidden within third-party data or RAG documents. With sub-2ms latency and support for eight languages, it offers a lightweight yet powerful solution for maintaining the integrity and safety of LLM-based systems without significant performance overhead.

Key Features

01Identifies indirect prompt injections within RAG documents and API responses
023,983 GitHub stars
03High-performance inference with sub-2ms latency on GPU
04Multilingual support for 8 major languages including English, Spanish, and Hindi
05Detects direct jailbreak attempts and roleplay-based overrides
06Configurable detection thresholds to balance security and user friction

Use Cases

01Filtering malicious user prompts before they reach an LLM backend
02Implementing a multi-layered safety architecture alongside content moderation tools
03Sanitizing third-party data and web-scraped content in RAG pipelines