Split out CloudRuntime.dispatch into multiple methods

[awaelchli]

Proposed refactor

Split out CloudRuntime.dispatch into multiple methods.

Motivation

This makes the code easier to read and test. Specifically, when testing individual setup stages of this runtime, we can mock out individual parts that are irrelevant for execution/testing.

Additional context

This first came up here: #14929

---

If you enjoy Lightning, check out our other projects! ⚡

• Metrics: Machine learning metrics for distributed, scalable PyTorch applications.

• Lite: enables pure PyTorch users to scale their existing code on any kind of device while retaining full control over their own loops and optimization logic.

• Flash: The fastest way to get a Lightning baseline! A collection of tasks for fast prototyping, baselining, fine-tuning, and solving problems with deep learning.

• Bolts: Pretrained SOTA Deep Learning models, callbacks, and more for research and production with PyTorch Lightning and PyTorch.

• Lightning Transformers: Flexible interface for high-performance research using SOTA Transformers leveraging PyTorch Lightning, Transformers, and Hydra.

[stale]

This issue has been automatically marked as stale because it hasn't had any recent activity. This issue will be closed in 7 days if no further activity occurs. Thank you for your contributions - the Lightning Team!

[tanaymeh]

Hi @awaelchli, can I take up this issue?