Automate LLM red teaming workflows by providing a production-oriented service wrapper for the Llamator framework.
Sponsored
Llamator is a production-oriented service wrapper that facilitates automated red teaming workflows for Large Language Models (LLMs). It provides a robust HTTP API for job submission, state retrieval, and artifact access, alongside an MCP (Streamable HTTP transport) server for seamless agent and tooling integrations. The system handles asynchronous test runs, persists state durably, manages artifacts securely via MinIO, and offers features like API-key protection, OpenAPI schema with authorization, and Prometheus metrics, making it ideal for integrating LLM security testing into existing systems.
主要功能
011 GitHub stars
02Asynchronous test runs with durable state persisted in Redis.
03Request persistence with sensitive secret redaction.
04OpenAPI schema (Swagger UI) with API-key authorization and Prometheus metrics.
05Comprehensive artifacts lifecycle management via MinIO, with presigned download URLs.
06Optional API-key protection for both HTTP and MCP interfaces.
使用案例
01Automating LLM security assessments and red teaming operations.
02Integrating LLAMATOR runs as tools within agent-based systems or CI/CD pipelines.
03Evaluating LLMs for vulnerabilities, misinformation, and hallucinations using predefined attack plans.
