v0.9.0.14

What's Changed

New plugins

• BEAST Attack Implementation by @erickgalinkin in #728
• add probe for "grandma" attack by @leondz in #740
• generator: lorem ipsum by @leondz in #776

New features

• Feature: configurable plugins by @jmartin-tech in #711
• Add JSON Path support for RestGenerator by @leondz in #651
• Make banner line test dynamic by @jmartin-tech in #670
• Tutorial for contributing a generator by @leondz in #688
• add 'complete' message to report at end of run by @leondz in #735
• support chat modality in attempts by @leondz in #644
• add grandma substance synth probe, update docs and var names by @leondz in #763
• update NVCF to support versioning, custom payload keys by @leondz in #772
• WINDOWS & OSX SUPPORT: test by default on linux, osx, win by @leondz in #793
• enable nested setting of plugin configs by @leondz in #773
• always log nvcf payload by @leondz in #778
• update ecoji for windows support by @jmartin-tech in #787
• remove extraneous default params for nims that expect conservative pa… by @leondz in #749
• require probes to match input modality of the generator by @jmartin-tech in #738
• Improve cloze data for leakreplay probe by @leondz in #708
• add CONTRIBUTING.md, update contributing guide in docs by @leondz in #706
• add DEFAULT_PARAMS to base types that are configurables by @leondz in #771
• atkgen - add configurability, allow config of which adversarial generator to use by @leondz in #777
• enhancement: enable lazy setting of nested dicts by @leondz in #775
• convert mutation_generator to use load_plugin by @jmartin-tech in #795
• Add support for gpt-4o, gpt-4o-mini by @erickgalinkin in #798
• bump transformers ver to min reqd for llama 3.1 by @leondz in #800
• add mitigation strings, add test for string-based mitigation skipping by @leondz in #762
• speedup report generation by using class attribs instead of instantiating by @leondz in #707
• cached plugin enum by @jmartin-tech in #768

Tuning & fixes

• add some actionable opinions about linting by @leondz in #668
• handle target model returning None in atkgen by @leondz in #678
• bump & fix black version by @leondz in #686
• Bump/black 24.4.2 -- and apply formatting by @leondz in #687
• convert module-level constant names to uppercase by @leondz in #685
• Guard cli run with invalid or incomplete config by @jmartin-tech in #677
• Catch generic exception from transformers in huggingface by @jmartin-tech in #690
• stablize openai parallel by @jmartin-tech in #689
• rest generator response must be a list by @jmartin-tech in #693
• Set generator _call_model() and _generate() type hints; amend functions by @leondz in #694
• typo in racial slur prompt by @leondz in #697
• Generator streamlining, docs by @leondz in #682
• Split NVCF generator into completion chat by @leondz in #696
• Update the quality taxonomy by @leondz in #703
• generator & detector structure validation by @leondz in #702
• doc & inheritance fixes to DanInTheWildMini by @leondz in #712
• Remove support for openai api v0 by @leondz in #718
• restore req_template_json_object lost in refactor by @jmartin-tech in #729
• utilize GarakException in cli by @jmartin-tech in #730
• ensure report is printed in utf-8 for Windows by @jmartin-tech in #732
• Linting - 20240612 by @leondz in #733
• add garak preprint paper by @leondz in #739
• only set generations if still default by @jmartin-tech in #741
• return value from batch_decode is already a list by @jmartin-tech in #743
• Handle openai 400 errors more gracefully by @leondz in #744
• Refactor huggingface config support by @jmartin-tech in #742
• rename class level probe doc_uri by @jmartin-tech in #759
• retry openaicompatible requests if invalid content received by @leondz in #761
• add colour theme config by @leondz in #769
• reduce zalgo-ness by @leondz in #770
• move REST generator exception into garak.exceptions by @leondz in #779
• defensive coding: allow python generators more places by @leondz in #782
• stop encoding.payloads accumulating each load by @leondz in #780
• correct sorting for set json in plugin_cache.json by @jmartin-tech in #794
• corrections to config format for TAP internal generators by @jmartin-tech in #796
• add missing comma, extra test case in probes.test.Test by @leondz in #797
• Bugfix/leakreplay output setting by @leondz in #790

Full Changelog: v0.9.0.13...v0.9.0.14