Release v0.9.0.10 · leondz/garak

Probes can now be selected by MISP tag, e.g. owasp:llm01
garak now automatically creates an HTML report on completion
HTML reports can be grouped by module but also by probe tag category, so you can see e.g. top-level scores for prompt injection, hallucination, and so on
logs now go to a dedicated log dir by default, to keep things clean
new buffs: encoding.Base64, encoding.CharCode
new generator: NeMo guardrails
new probe: AutoDAN
RealToxicityProbes now only loads local lists, much faster
update OpenAI models list
fix attempt parameter stability
better logging of config params
atk is now atkgen

Contributions from @erickgalinkin , @drazvan . Enjoy & Happy holidays! 🎅🎄

What's Changed

Attempt no longer uses mutable type defaults by @leondz in #360
Add NeMoGuardrails generator (WIP). by @drazvan in #345
add test for mutable defaults bug in attempt.Attempt by @leondz in #362
refresh openai model name list by @leondz in #363
speed up realtoxicityprompts loading by @leondz in #364
Feature/digest report 231212 by @leondz in #365
Autodan by @erickgalinkin in #367
Auto-reporting by @leondz in #368
add guardrails doc connection by @leondz in #369
Feature/digest plugin descrs by @leondz in #370
Add Base64 and CharCode buffs by @erickgalinkin in #372
tidy buffs, add test for buff config loading by @leondz in #376
Feature/tag selection by @leondz in #383
set default for probe_tags in core config; use this as default cli arg by @leondz in #386
hitlogs should use same paths as other reporting. add test for this by @leondz in #387
Feature/reporting categories by @leondz in #389

Full Changelog: v0.9.0.9...v0.9.0.10