Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: better k8s testing #9074

Merged
merged 6 commits into from
Apr 5, 2024
Merged

chore: better k8s testing #9074

merged 6 commits into from
Apr 5, 2024

Conversation

amandavialva01
Copy link
Contributor

@amandavialva01 amandavialva01 commented Mar 29, 2024

Description

With this PR, CI instances can run e2e tests on a shared GKE cluster.

This moves GKE tests out of long-running since we push the docker image in a shorter job and no longer need to wait for cluste setup and tear down, while also providing the added benefit of being able to view test failures that persist on the master service deployment that was helm installed onto the remote cluster.

Test Plan

CI passes.

Checklist

  • Changes have been manually QA'd
  • User-facing API changes need the "User-facing API Change" label.
  • Release notes should be added as a separate file under docs/release-notes/.
    See Release Note for details.
  • Licenses should be included for new code which was copied and/or modified from any external code.

Ticket

DET-10075, DET-10077, DET-10135, DET-10189

Copy link

netlify bot commented Mar 29, 2024

Deploy Preview for determined-ui canceled.

Name Link
🔨 Latest commit 876db4d
🔍 Latest deploy log https://app.netlify.com/sites/determined-ui/deploys/660f692cc332c5000886a77d

Copy link

codecov bot commented Mar 29, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 46.64%. Comparing base (7fc8d7a) to head (876db4d).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #9074      +/-   ##
==========================================
- Coverage   46.64%   46.64%   -0.01%     
==========================================
  Files        1172     1172              
  Lines      143619   143619              
  Branches     2410     2410              
==========================================
- Hits        66985    66984       -1     
- Misses      76429    76430       +1     
  Partials      205      205              
Flag Coverage Δ
backend 43.38% <ø> (-0.01%) ⬇️
harness 63.99% <ø> (ø)
web 37.77% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

see 3 files with indirect coverage changes

Copy link
Contributor

@carolinaecalderon carolinaecalderon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Nice work

@@ -233,6 +240,10 @@ checkpointStorage:
# the greatest common divisor of all the sizes (4, in that case).
maxSlotsPerPod:


# TODO( POPULATE THIS COMMENT)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Again, another remnant from the WIP branch

Suggested change
# TODO( POPULATE THIS COMMENT)
# Flag for determining whether or not to create the cluster-scoped objects, when deploying multiple namespaces within the same cluster, should be set to false.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like this might be redundant

createNonNamespacedObjects: true

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We use createNonNamespacedObjects for the cluster deployment script when deciding whether to create priority classes

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gah, update on this: I didn't realize I redefined that field, we need createNonNamespacedObjects: true for the longrunning tests since they spinup a new cluster. Resolved here!

@amandavialva01 amandavialva01 enabled auto-merge (squash) April 5, 2024 03:16
@amandavialva01 amandavialva01 merged commit 2ef5ab9 into main Apr 5, 2024
70 of 84 checks passed
@amandavialva01 amandavialva01 deleted the amanda/shortenBuildAndPush branch April 5, 2024 03:16
@@ -56,6 +56,9 @@ stringData:
{{- end }}
security:
{{- if .Values.initialUserPassword }}
initial_user_password: {{ .Values.initialUserPassword | quote }}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

omg, just rebased to this and -- thanks!! Saves me some work on DET-10208 I think!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants