v0.9.0.13 #669

leondz announced in Announcements

leondz
May 10, 2024
Maintainer

What's Changed

garak's 1st birthday! 🎂

Headlines in this release:

Multimodal support! LLaVa + FigStep - HUGE thanks to @DavidLee528
LiteLLM generator support - thanks to @Tien-Cheng!
DoNotAnswer probe for prompts an LLM should decline - thanks to @AhsanAyub!
LangChain Serve generator support - thanks to @GustavFredrikson!
Support for NIM generators, NVIDIA Inference Microservices
OpenAI abstraction with parallelisation support
Windows compatibility enhanced, with optional testing in the workflow
Hugging Face speedup

plugins

LiteLLM generator by @Tien-Cheng in Feature/litellm generator #572
Support for using 'langchain serve' endpoints by @GustavFredrikson in Support for using 'langchain serve' endpoints #588
Enable parallel OpenAI calls by @jmartin-tech in Enable parallel OpenAI calls #645
Multi-modal Jailbreaking Attack on LLaVA by @DavidLee528 in [New Features] Multi-modal Jailbreaking Attack on LLaVA #587
bump openai module version to match paths in latest litellm by @leondz in bump openai module version to match paths in latest litellm #664
generator: NIM by @leondz in generator: NIM #637
Probe: Do Not Answer by @AhsanAyub in Probe: Do Not Answer #608

architecture

change supported pythons to 3.10-3.12 by @leondz in change supported pythons to 3.10-3.12 #503
add more detailed TAP docs by @leondz in add slightly more detailed TAP docs #504
add multiple-result aggregator by @leondz in add multiple-result aggregator #505
add post buff hook by @erickgalinkin in Add post buff hook #506
Add fleshed-out docs to all probes by @leondz in Add fleshed-out docs to all probes #507
add bibtex under citation info in readme by @leondz in add bibtex under citation info in readme #511
define broad test, all probes, 1 gen per by @leondz in define broad test, all probes, 1 gen per #514
Feature/taxonomy payloads by @leondz in Feature/taxonomy payloads #519
include paraphrasing in broad conf by @leondz in include paraphrasing in broad conf #521
choose whether buffing will also include the original prompt by @leondz in choose whether buffing will also include the original prompt #523
add config var for capping max # buffed prompts to add per buff by @leondz in add config var for capping max # buffed prompts to add per buff #526
document Probe.probe(); skip a buff hook if no buffs by @leondz in document Probe.probe(); skip a buff hook if no buffs #527
add type hints to base.Probe; fix base probe rst by @leondz in add type hints to base.Probe; fix base probe rst #528
Bump datasets package by @shubhobm in Bump datasets package #536
Add ConversationalPipeline for huggingface models by @erickgalinkin in Add ConversationalPipeline for huggingface models #539
add generator for supporting openai module v0.x by @leondz in add generator for supporting openai module v0.x #553
Update README.md by @erickgalinkin in Update README.md #558
Minor typo in FAQ by @jmartin-tech in Minor typo in FAQ #562
Add additional error message when doc is None type by @DavidLee528 in Add additional error message when __doc__ is None type #566
shared constant & string literal by @jmartin-tech in shared constant & string literal #571
Spelling corrections for multiple locations by @jmartin-tech in Spelling corrections for multiple locations #564
Reduce Huggingface GPU utilization by @erickgalinkin in Reduce Huggingface GPU utilization #567
skip verbose flag in secondary parser by @jmartin-tech in skip verbose flag in secondary parser #576
Added project twitter link and corrected a grammatic error by @codebrain001 in Added project twitter link and corrected a grammatic error #578
Convert GGML to expect GGUF format by @jmartin-tech in Convert GGML to expect GGUF format #581
Update workflows: CLA asst bump, PR & manual testing by @leondz in Update workflows: CLA asst bump, PR & manual testing #591
add test de-duping using skip-duplicate-actions by @leondz in add test de-duping using skip-duplicate-actions #597
Remove #! entries from files not intended as executables by @jmartin-tech in Remove #! entries from files not intended as executables #612
Further align shebangs with code that has executable entry points by @leondz in Further align shebangs with code that has executable entry points #613
interactive mode intro by @leondz in interactive mode intro #614
add tests for ggml generator by @jmartin-tech in add tests for ggml generator #618
add var for generator context_len and populate this for some generators by @leondz in add var for generator context_len and populate this for some generators #616
allow generators.Base.generate() to take an optional param specifying generation count by @leondz in allow generators.Base.generate() to take an optional param specifying generation count #600
Enable windows tests as github action by @jmartin-tech in Enable windows tests as github action #626
add on-demand macos testing by @leondz in add on-demand macos testing #631
macOS test install from correct path by @jmartin-tech in macOS test install from correct path #633
consolidate test file cleanup by @jmartin-tech in consolidate test file cleanup #634
bump discord link by @leondz in bump discord link #648
meta the arguments a bit for GET vs other request types by @jmartin-tech in meta the arguments a bit for GET vs other request types #640

stability

fail gracefully if nvcf rejects input; compact zalgo prompts by @leondz in fail gracefully if nvcf rejects input; compact zalgo prompts #509
log & skip past NVCF 4xx errors by @leondz in log & skip past NVCF 4xx errors #533
fix empty autodan prompts & poor detector behaviour by @leondz in fix empty autodan prompts & poor detector behaviour #534
Fix AutoDAN issues by @erickgalinkin in Fix AutoDAN issues #537
fix bad nonetype handling in atkgen probe by @leondz in fix bad nonetype handling in atkgen probe #538
Division by zero error fixed in HTML report generation by @CoderMayhem in Division by zero error fixed in HTML report generation #545
cap cohere lib version by @leondz in cap cohere lib version #569
rm deprecated model from example by @leondz in rm deprecated model from example #575
Attack fixes by @erickgalinkin in Attack fixes #555
More regex as string literal by @jmartin-tech in More regex as string literal #586
Bugfix/action dedupe by @leondz in Bugfix/action dedupe #598
wrap cli exec to gracefully catch keyboard exit signal by @jmartin-tech in wrap cli exec to gracefully catch keyboard exit signal #603
Enforce warning output for garak classes. by @jmartin-tech in Enforce warning output for garak classes. #605
bump hf transformers v to avoid transformers#30076 by @leondz in bump hf transformers v to avoid transformers#30076 #636
update avidtools to remove typing reference by @jmartin-tech in update avidtools to remove typing reference #639
torch v bump by @leondz in torch v bump #649
Pause FigStepTiny by @leondz in Pause FigStepTiny #652
Bugfix/visual jailbreak pause by @leondz in Bugfix/visual jailbreak pause #653
limit push test to main by @jmartin-tech in limit push test to main #661
Update MANIFEST.in so all resources are installed by @JKL98ISR in Update MANIFEST.in so all resources are installed #660
handle extant but closed hitlogfile file by @leondz in handle extant but closed hitlogfile file #665

New Contributors

@CoderMayhem made their first contribution in Division by zero error fixed in HTML report generation #545
@jmartin-tech made their first contribution in Minor typo in FAQ #562
@codebrain001 made their first contribution in Added project twitter link and corrected a grammatic error #578
@Tien-Cheng made their first contribution in Feature/litellm generator #572
@GustavFredrikson made their first contribution in Support for using 'langchain serve' endpoints #588
@JKL98ISR made their first contribution in Update MANIFEST.in so all resources are installed #660
@AhsanAyub made their first contribution in Probe: Do Not Answer #608

Full Changelog: v0.9.0.12...v0.9.0.13

This discussion was created from the release v0.9.0.13.

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment