Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding Batch/Async Processing to PromptTargets #91

Merged
merged 11 commits into from
Mar 9, 2024
Merged

Adding Batch/Async Processing to PromptTargets #91

merged 11 commits into from
Mar 9, 2024

Conversation

rlundeen2
Copy link
Contributor

Description

This adds Async Processing to Prompts, PromptTargets, and PromptNormalizers, and it extends PromptSendingOrchestrator to utilize this so it can send N messages at a time in parallel.

In scenarios where you want to send all prompts or are using PromptTargets for other work (classifiers), this can speed up execution by N

I also added a demo for sending a bunch of prompts. This will need to be updated, but it's a good start for a common scenario

Tests

  • no new tests required
  • new tests added
  • existing tests adjusted

Documentation

  • no documentation changes needed
  • documentation added or edited
  • example notebook added or updated

@rlundeen2 @rdheekonda
Update pyrit/prompt_normalizer/prompt_normalizer.py
3845202 
Co-authored-by: Raja Sekhar Rao Dheekonda <43563047+rdheekonda@users.noreply.github.com>
@rlundeen2 rlundeen2 merged commit 7fec80a into Azure:main Mar 9, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nina-msft nina-msft nina-msft left review comments

@rdheekonda rdheekonda rdheekonda approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@rlundeen2 @rdheekonda @nina-msft