-
Notifications
You must be signed in to change notification settings - Fork 39
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add HELM Integration: Guide, Examples and Tests #743
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #743 +/- ##
==========================================
- Coverage 91.42% 91.18% -0.25%
==========================================
Files 100 98 -2
Lines 10061 10002 -59
==========================================
- Hits 9198 9120 -78
- Misses 863 882 +19 ☔ View full report in Codecov by Sentry. |
1983ec1
to
d1972bd
Compare
Signed-off-by: Elron Bandel <elron.bandel@ibm.com>
Signed-off-by: Elron Bandel <elron.bandel@ibm.com>
d1972bd
to
8a9bea9
Compare
utils/run_helm.sh
Outdated
--max-eval-instances 10 --suite v1 | ||
|
||
if [ ! -f "benchmark_output/runs/v1/unitxt:card=cards.wnli,template=templates.classification.multi_class.relation.default,model=microsoft_phi-1_5/scenario_state.json" ]; then | ||
echo "Error: File does not exist." >&2 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe compare output, beyond existence of file?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. One comment below for your consideration.
Signed-off-by: Elron Bandel <elron.bandel@ibm.com>
No description provided.