Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add fetch function for SecLists AI LLM Bias Testing datasets #267

Open
romanlutz opened this issue Jun 28, 2024 · 2 comments · May be fixed by #280
Open

Add fetch function for SecLists AI LLM Bias Testing datasets #267

romanlutz opened this issue Jun 28, 2024 · 2 comments · May be fixed by #280
Assignees
@KutalVolkan
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@romanlutz
Copy link
Contributor

Is your feature request related to a problem? Please describe.

Link: https://github.com/danielmiessler/SecLists/tree/master/Ai/LLM_Testing/Bias_Testing

There are three files which we can load and convert to a PromptDataset as prompts. Note that some of them have placeholders for Country, Region, Nationality, Gender, Skin-Color which we'd need to be mindful of. Those are basically PromptTemplates where we need to plug in a parameter.

Describe the solution you'd like

A fetch function under pyrit.datasets similar to what's being added as part of #254 for another dataset.

Describe alternatives you've considered, if relevant

Additional context

PyRIT will have a datasets module soon. Currently, it's just a collection of data files.
@romanlutz romanlutz added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed labels Jun 28, 2024
@KutalVolkan
Copy link
Contributor

Hello @romanlutz,

I would be interested in working on the SecLists AI LLM Bias Testing datasets task after I complete the many-shot-jailbreak task. What are your thoughts on this?

Best regards,
Volkan

@romanlutz
Copy link
Contributor Author

Great idea!

@KutalVolkan KutalVolkan mentioned this issue Jul 1, 2024
Merged
@romanlutz romanlutz mentioned this issue Jul 2, 2024
Open
KutalVolkan added a commit to KutalVolkan/PyRIT that referenced this issue Jul 12, 2024
@KutalVolkan
Enhance: Modularize and add caching in fetch_examples.py (Azure#130, A…
61bfa01 
…zure#267)- Updated 7_many_shot_jailbreak.py to use the new fetch_many_shot_jailbreaking_examples function and added a scorer.- Updated 8_test_seclists_bias_testing.py to use the new fetch_seclists_bias_testing_examples function and added a scorer.- Implemented caching logic in fetch_examples.py to enhance efficiency.- Added pytest tests for fetch_examples and many_shot_template.- Improved code readability and maintainability.
@KutalVolkan KutalVolkan linked a pull request Jul 14, 2024 that will close this issue
Open
@romanlutz romanlutz linked a pull request Jul 23, 2024 that will close this issue
FEAT: Add fetch function for SecLists AI LLM Bias Testing datasets (#267) #280
Open
This was referenced Jul 23, 2024
Open
Open
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@KutalVolkan KutalVolkan

Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

FEAT: Add fetch function for SecLists AI LLM Bias Testing datasets (#267) KutalVolkan/PyRIT
2 participants
@romanlutz @KutalVolkan