Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT Add cross-domain prompt injection orchestrator #127

Merged
merged 20 commits into from
Apr 13, 2024

Conversation

romanlutz
Copy link
Contributor

@romanlutz romanlutz commented Mar 28, 2024

Description

Adding an orchestrator for a simple XPIA scenario:

  • medium target uploads attack file to Azure storage
  • processing target retrieves file from prompt and executes XPIA
  • scorer examines output to see if injected string shows up

In a "real" XPIA scenario we need a processing target that has the plugin/skill to retrieve content by itself.

In the future, we will support more mediums & locations (such as files on Azure storage, e.g., emails or PDFs).

Tests and Documentation

Tests included for the orchestrator.

Copy link
Contributor

@cseifert1 cseifert1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great to see XPIA coming together, Roman!

Let's assume the XPIA attack will cause an action to be taken, like sending an email. The success of the XPIA would be determined by a scorer, which would need to connect to an email inbox to see whether the action was taken. Is that what you are thinking?

@romanlutz romanlutz changed the title [DRAFT] FEAT Add cross-domain prompt injection orchestrator FEAT Add cross-domain prompt injection orchestrator Apr 9, 2024
@romanlutz romanlutz merged commit 97b2bba into Azure:main Apr 13, 2024
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants