You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently we record state in the Worker class with a variety of dictionaries that hold information like the function to be run, the type of the output, the status, the dependencies that we're waiting on, the number of bytes of the output, and so on. We might consider turning all of these collections into a single collection of a TaskState type.
We did this transformation in the Scheduler a while ago see scheduler.py::TaskState and that seems to have been a good choice. We should probably repeat it for the worker. Maybe something like the following (incomplete)
Currently we record state in the Worker class with a variety of dictionaries that hold information like the function to be run, the type of the output, the status, the dependencies that we're waiting on, the number of bytes of the output, and so on. We might consider turning all of these collections into a single collection of a
TaskState
type.We did this transformation in the Scheduler a while ago see
scheduler.py::TaskState
and that seems to have been a good choice. We should probably repeat it for the worker. Maybe something like the following (incomplete)This has the advantage of being a good learning task
The text was updated successfully, but these errors were encountered: