Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: warn about det deploy det-version mistmach #8994

Merged
merged 13 commits into from
Mar 15, 2024
Merged

Conversation

hamidzr
Copy link
Contributor

@hamidzr hamidzr commented Mar 13, 2024

Description

Whenever we add a master config schema change older master binaries would not accept them. This explicitly warns about this situation and recommends using the same version of det deploy for this purpose.

covers:
aws, gke, local, gcp

Test Plan

run the cli for all 4 modalities

  • --det-version value to be: no det-version, matching det-version, mismatching det-version

the test script 390deb1

Commentary (optional)

  • thoughts on the messaging? I included a link to the docs first but those break.
  • should we add an interactive wait/confirmation to proceed?

Checklist

  • Changes have been manually QA'd
  • User-facing API changes need the "User-facing API Change" label.
  • Release notes should be added as a separate file under docs/release-notes/.
    See Release Note for details.
  • Licenses should be included for new code which was copied and/or modified from any external code.

Ticket

https://hpe-aiatscale.atlassian.net/browse/GAS-727

@cla-bot cla-bot bot added the cla-signed label Mar 13, 2024
@hamidzr hamidzr changed the title det-version mistmach det deploy det-version mistmach Mar 13, 2024
Copy link

netlify bot commented Mar 13, 2024

Deploy Preview for determined-ui canceled.

Name Link
🔨 Latest commit a92ee97
🔍 Latest deploy log https://app.netlify.com/sites/determined-ui/deploys/65f375bec574fc000897ad3b

Copy link

codecov bot commented Mar 13, 2024

Codecov Report

Attention: Patch coverage is 32.00000% with 17 lines in your changes are missing coverage. Please review.

Project coverage is 47.48%. Comparing base (0a2fd28) to head (a92ee97).
Report is 6 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #8994      +/-   ##
==========================================
- Coverage   47.51%   47.48%   -0.03%     
==========================================
  Files        1168     1168              
  Lines      176306   176329      +23     
  Branches     2353     2353              
==========================================
- Hits        83765    83738      -27     
- Misses      92383    92433      +50     
  Partials      158      158              
Flag Coverage Δ
backend 42.58% <ø> (-0.08%) ⬇️
harness 63.98% <32.00%> (-0.03%) ⬇️
web 42.83% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Coverage Δ
harness/determined/deploy/aws/cli.py 17.81% <50.00%> (-0.11%) ⬇️
harness/determined/deploy/gke/cli.py 16.98% <50.00%> (+0.42%) ⬆️
harness/determined/deploy/errors.py 72.72% <57.14%> (-27.28%) ⬇️
harness/determined/deploy/gcp/cli.py 21.00% <25.00%> (-0.55%) ⬇️
harness/determined/deploy/local/cli.py 45.00% <10.00%> (-11.67%) ⬇️

... and 4 files with indirect coverage changes

@hamidzr hamidzr changed the title det deploy det-version mistmach chore: warn aboout det deploy det-version mistmach Mar 13, 2024
@hamidzr hamidzr changed the title chore: warn aboout det deploy det-version mistmach chore: warn about det deploy det-version mistmach Mar 13, 2024
@hamidzr hamidzr added the to-cherry-pick Pull requests that need to be cherry-picked into the current release label Mar 13, 2024
@hamidzr hamidzr marked this pull request as ready for review March 13, 2024 19:36
@hamidzr hamidzr requested a review from a team as a code owner March 13, 2024 19:36
@hamidzr hamidzr requested review from daranday, a team and NicholasBlaskey and removed request for a team March 13, 2024 19:36
@hamidzr hamidzr requested review from kkunapuli and removed request for NicholasBlaskey March 14, 2024 19:55
@@ -224,6 +225,7 @@ def configure_helm(args: argparse.Namespace) -> None:
helm_dir = Path(args.helm_dir)
with (helm_dir / "Chart.yaml").open() as f:
helm_chart = safe_load_yaml_with_exceptions(f)
warn_version_mistmatch(args.det_version)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is the only one that doesn't check for args.det_version being None?
e.g.,

    if args.det_version is None:
        args.det_version = determined.__version__

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

aws/cli doesn't either.

I added that only to the ones that had a default in the cli arg definition to keep the behavior the same as before.

Copy link
Contributor

@kkunapuli kkunapuli left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Small naming nit but looks great!

Comment on test procedure: should the tester specify a mismatched det version? Should that argument be included in the test procedure? (Or do we usually leave it up to the tester and not be overly prescriptive?)

@hamidzr
Copy link
Contributor Author

hamidzr commented Mar 14, 2024

thanks for the review
it's a good idea to be more descriptive for the tests. I added a test script as well. 390deb1

@hamidzr hamidzr self-assigned this Mar 14, 2024
@hamidzr hamidzr enabled auto-merge (squash) March 14, 2024 22:23
@hamidzr hamidzr disabled auto-merge March 15, 2024 02:38
@hamidzr hamidzr removed the request for review from daranday March 15, 2024 02:38
@hamidzr
Copy link
Contributor Author

hamidzr commented Mar 15, 2024

why didn't the automerge land this? Does it need a review from the codeowner? @determined-ai/ml-sys-notify

@hamidzr hamidzr merged commit f52f43b into main Mar 15, 2024
71 of 83 checks passed
@hamidzr hamidzr deleted the hz-deploy-vers branch March 15, 2024 17:41
dai-release bot pushed a commit that referenced this pull request Mar 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed to-cherry-pick Pull requests that need to be cherry-picked into the current release
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants