docs: terraforming an EKS cluster with autoscaling and EFS.

[ioga]

Description

Here's a "minimal" terraform code for setting up an EKS cluster with functional autoscaling for both aux and (nvidia) compute pools, plus an EFS for shared filesystem support.

It took me an embarrassing amount of time: EKS entities and terraform support for them are byzantine.

Fixes #9355

Test Plan

Try out the terraform example, if you dare.

Checklist

• Changes have been manually QA'd
• User-facing API changes need the "User-facing API Change" label.
• Release notes should be added as a separate file under docs/release-notes/.
  See Release Note for details.
• Licenses should be included for new code which was copied and/or modified from any external code.

[netlify]

✅ Deploy Preview for determined-ui canceled.

Name	Link
🔨 Latest commit	112fb1b
🔍 Latest deploy log	https://app.netlify.com/sites/determined-ui/deploys/6656119368d1c90008751147

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 40.59%. Comparing base (d4e23f4) to head (9e5c9d3).
Report is 29 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #9427      +/-   ##
==========================================
- Coverage   46.07%   40.59%   -5.49%     
==========================================
  Files        1228      664     -564     
  Lines      155900    77614   -78286     
  Branches     2439        0    -2439     
==========================================
- Hits        71837    31507   -40330     
+ Misses      83872    46107   -37765     
+ Partials      191        0     -191     

Flag	Coverage Δ
harness	37.93% <ø> (-26.14%)	⬇️
web	?

Flags with carried forward coverage won't be shown. Click here to find out more.

see 665 files with indirect coverage changes

[kkunapuli]

LGTM! I really appreciate the comments in the terraform code.