Add images with flash attention 2

[dakinggg]

CI passes when run manually with flash attention 2

=============================================================================== 471 passed, 2 skipped, 239 deselected, 73 xfailed, 144 warnings in 309.04s (0:05:09) ================================================================================
pip show flash-attn
Name: flash-attn
Version: 2.3.2
Summary: Flash Attention: Fast and Memory-Efficient Exact Attention
Home-page: https://github.com/Dao-AILab/flash-attention
Author: Tri Dao
Author-email: trid@cs.stanford.edu
License: 
Location: /usr/lib/python3/dist-packages
Requires: einops, ninja, packaging, torch
Required-by: 

Will do more testing after this PR goes in so that I can add proper CI and use properly built images instead of just test ones.

[mvpatel2000]

It's hard to reason about the docker changes. I am assuming you tested this

[dakinggg]

@mvpatel2000 I tested in that working images get pushed to the staging repo from this pr. I suppose I haven't tested that I didn't break the push to main workflow that releases the production images.