Garak

• Publisher: NVIDIA
• Status: active
• Version: 0.12.0
• Release Date: 2025-08-22
• Date Added: 2025-08-26
• Source URL: https://github.com/NVIDIA/garak/

---

Summary

A vulnerability scanner similar to the Metasploit framework designed to discover weaknesses or unwanted behaviors in LLMs, such as prompt injection, data leakage, hallucinations, and jailbreaking. Modular architecture allows for expansion and customization with plugins. Includes an auto red-team module.

---

Key Takeaways

• LLM Red Teaming.
• Investigation of the failure modes of LLMs and the conditions that lead to them.
• Model robustness testing.
• Automated reporting.
• Write custom plugins to tailor garak to specific use cases.
• Cross-platform support - Hugging Face, OpenAI API, Ollama, etc.

---

Related Code

• TBD

---

Additional Sources

• Garak Reference Documentation
• Garak User Guide

---

Tags

read-team, evals, llm-security, audit-trails, prompt-injection, jailbreak, data-leakage, robustness, automation

---

License

Apache-2.0