-
Notifications
You must be signed in to change notification settings - Fork 354
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: create span question from SDK #4617
feat: create span question from SDK #4617
Conversation
for more information, see https://pre-commit.ci
@nataliaElv I've included you as a reviewer to validate the creation workflow. Let me know if you miss something. @burtenshaw I've included you to look at the development flow for the current SDK. |
…la-io/argilla into feat/create-span-question-from-sdk
The URL of the deployed environment for this PR is https://argilla-quickstart-pr-4617-ki24f765kq-no.a.run.app |
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## feat/span-questions-support #4617 +/- ##
================================================================
+ Coverage 45.26% 89.06% +43.80%
================================================================
Files 190 190
Lines 11671 11700 +29
================================================================
+ Hits 5283 10421 +5138
+ Misses 6388 1279 -5109 ☔ View full report in Codecov by Sentry. |
35f6392
to
ceded58
Compare
Looks like there is a failing integration test related with span and a dataset deletion (probably because the dataset was not created well?) |
Description
This PR introduces support for configuring feedback datasets with span questions. A new
SpanQuestion
class is defined for that. The creation workflow would be as follows:Closes #4616
Type of change
(Please delete options that are not relevant. Remember to title the PR according to the type of change)
How Has This Been Tested
(Please describe the tests that you ran to verify your changes. And ideally, reference
tests
)Tested locally using a running instance of the Argilla server.
Checklist
CHANGELOG.md
file (See https://keepachangelog.com/)