v0.9.0.5

New in garak

• enable reporting of vulnerabilities into AVID
• de-prefix prompt from LLM output by default
• add a data leakage/replay attack probe
• add a glitch token detection probe
• enable narrow-format CLI output
• extra payloads (secret level!) in encoding probe

v0.9.0.4

New in garak

Happy 4th! 🇺🇸🎆

• full exchange capture and better progress tracking in the auto-red-team module (probes.art)
• new generator: load Hugging Face models directly instead of via transformers.pipeline
• handle OpenAI server-side errors more gracefully
• remove default random seed
• support custom reporting locations with --report_prefix option
• add module documentation

0.9.post3

Updates:

• detect exfiltration-via-markdown attack
• detect if models will help generate malware
• accept newer OpenAI generators
• broader test coverage
• refactoring for probe readability
• use smaller versions of snowball + promptinject by default
• add mappings to AVID taxonomy
• add a "hit log" to record successful attacks
• add analysis script for rough HTML report generation
• bug fixes around longer inputs
• handle server-side OpenAI API failures nicely

first alpha

first alpha