Graceful errors

[elijahbenizzy]

Response to slack question: https://hamilton-opensource.slack.com/archives/C03M33QB4M8/p1716954444075279

[elijahbenizzy]

POC, this works!

from hamilton import driver
from hamilton.lifecycle import default


class DoNotProceed(Exception):
    pass


def working_res_1() -> int:
    return 1


def working_res_2() -> int:
    return 2


def do_not_proceed_1(working_res_1: int, working_res_2: int) -> int:
    raise DoNotProceed()


def proceed_1(working_res_1: int, working_res_2: int) -> int:
    return working_res_1 + working_res_2


def proceed_2(working_res_1: int, working_res_2: int) -> int:
    return working_res_1 * working_res_2


def short_circuited_1(working_res_1: int, working_res_2: int, do_not_proceed_1: int) -> int:
    return 1  # this should not be reached


def proceed_3(working_res_1: int, working_res_2: int) -> int:
    return working_res_1 - working_res_2


def do_not_proceed_2(proceed_1: int, proceed_2: int, proceed_3: int) -> int:
    raise DoNotProceed()


def short_circuited_2(proceed_1: int, proceed_2: int, proceed_3: int, do_not_proceed_2: int) -> int:
    return 1  # this should not be reached


def short_circuited_3(short_circuited_1: int) -> int:
    return 1  # this should not be reached


def proceed_4(proceed_1: int, proceed_2: int, proceed_3: int) -> int:
    return proceed_1 + proceed_2 + proceed_3


if __name__ == "__main__":
    import __main__

    dr = (
        driver.Builder()
        .with_modules(__main__)
        .with_adapters(
            default.GracefulErrorAdapter(error_to_catch=DoNotProceed, sentinel_value=None)
        )
        .build()
    )
    dr.display_all_functions()
    vars = dr.list_available_variables()
    res = dr.execute(vars)
    print(res) # has nones instead of values we don't want to compute or we want to short-circuit

>> python graceful_errors.py # above
{'do_not_proceed_1': None,
 'do_not_proceed_2': None,
 'proceed_1': 3,
 'proceed_2': 2,
 'proceed_3': -1,
 'proceed_4': 4,
 'short_circuited_1': None,
 'short_circuited_2': None,
 'short_circuited_3': None,
 'working_res_1': 1,
 'working_res_2': 2}

[skrawcz]

This is a vote to allow multiple adapters to implement run_to_execute_node but we can cross that bridge when someone gets there.

[skrawcz]

can you provide python example of usage, e.g. passing in the Exception type to catch, and what it would do.

GracefulErrorAdapter(ValueError) vs GracefulErrorAdapter(Exception) etc

[skrawcz]

just add more to the doc so a user can cut and paste an example.