Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT: Adding Converters to Output #236

Merged
merged 25 commits into from
Jun 7, 2024

Conversation

rlundeen2
Copy link
Contributor

@rlundeen2 rlundeen2 commented Jun 6, 2024

Description

  • Adds Converters to the output. This enables several obvious scenarios, such as, if your responses are a certain way, you can convert them (e.g. if the LLM responds in base64 encoded text, you can base64 decode it with a converter).
  • Removing synchronous send_prompt methods
  • Moving memory additions from targets to the normalizer
    • This reduces code to add memory for every target
    • This also simplifies exception handling - the behavior is the same but there is less code to add exceptions to memory
  • Moved scoring docs to their own folder for better readability and easier notebook generation
  • Minor scoring improvements because notebooks were failing consistently with the asserts

Tests and Documentation

Unit tests added. Jupytext passes

doc/demo/xpia_helpers.py Show resolved Hide resolved
pyrit/exceptions/__init__.py Show resolved Hide resolved
pyrit/models/prompt_request_response.py Outdated Show resolved Hide resolved
@rlundeen2 rlundeen2 merged commit 6a4202a into Azure:main Jun 7, 2024
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants