Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: historical allocations not showing task allocation workspace #9496

Merged
merged 5 commits into from
Jun 13, 2024

Conversation

eecsliu
Copy link
Contributor

@eecsliu eecsliu commented Jun 11, 2024

Ticket

DET-10323

Description

Downloading historical allocations resulted in the workspace field being empty for tasks. This is because we queried for experiment workspace, but not task workspace. This PR fixes that issue, and adds test cases to verify the outputted CSV contains the tasks's workspace. This also fixes a broken test (test_notebook_capture).

Test Plan

Make sure e2e_cpu tests pass.

To manually test, run some tasks (notebooks, commands, or tensorboards), then sign in as admin, go to the clusters page, and the historical usage tab. Download the CSV, making sure to select allocations and not workspaces, and verify that the workspace name field is populated for the tasks you ran.

Checklist

  • Changes have been manually QA'd
  • User-facing API changes need the "User-facing API Change" label.
  • Release notes should be added as a separate file under docs/release-notes/.
    See Release Note for details.
  • Licenses should be included for new code which was copied and/or modified from any external code.

@eecsliu eecsliu requested review from a team as code owners June 11, 2024 01:10
@cla-bot cla-bot bot added the cla-signed label Jun 11, 2024
Copy link

codecov bot commented Jun 11, 2024

Codecov Report

Attention: Patch coverage is 0% with 22 lines in your changes missing coverage. Please review.

Project coverage is 49.00%. Comparing base (439734b) to head (9128977).
Report is 12 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #9496   +/-   ##
=======================================
  Coverage   49.00%   49.00%           
=======================================
  Files        1235     1235           
  Lines      160191   160208   +17     
  Branches     2781     2781           
=======================================
+ Hits        78494    78515   +21     
+ Misses      81522    81518    -4     
  Partials      175      175           
Flag Coverage Δ
backend 43.87% <0.00%> (+0.02%) ⬆️
harness 63.96% <ø> (ø)
web 44.12% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Coverage Δ
master/internal/core.go 6.34% <0.00%> (-0.13%) ⬇️

... and 6 files with indirect coverage changes

Copy link

netlify bot commented Jun 11, 2024

Deploy Preview for determined-ui ready!

Name Link
🔨 Latest commit 9128977
🔍 Latest deploy log https://app.netlify.com/sites/determined-ui/deploys/666a21c55e789a0008217e8d
😎 Deploy Preview https://deploy-preview-9496--determined-ui.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Copy link
Contributor

@MikhailKardash MikhailKardash left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make sure e2e_cpu tests pass.

e2e_cpu does not pass.

@@ -48,15 +48,20 @@ def test_notebook_capture() -> None:

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like on line 36, int(row["experiment_id"] is resulting an error in the test because it's now sending an empty string instead of 0.

Copy link
Contributor Author

@eecsliu eecsliu Jun 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good catch! I think the line 36 one is actually ok because we don't have any tasks that cause that case to come up. The failure was in test_tensorboard_experiment_capture. In any case, I fixed both instances!

Edit: my bad, I stand corrected! circleCI showed both erroring out, but my local test was only failing the tensorboard test.

Copy link
Contributor

@corban-beaird corban-beaird left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good!

@eecsliu eecsliu merged commit 382995c into main Jun 13, 2024
83 of 97 checks passed
@eecsliu eecsliu deleted the task-allocation-workspace-bug-10323 branch June 13, 2024 07:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants