Support Arbitrary callbacks #2822

T4rk1n · 2024-03-29T18:09:01Z

Allow no output callback, resolve Allow for "null" / no output callbacks #1549
Add global set_props, resolve [Feature Request] Global set_props in backend callbacks. #2803
Fix side update pattern ids, fix [Long Callback] Support pattern matching for long callbacks side updates (progress/cancel/running) #2111

- Allow no output callback - Add global set_props - Fix side update pattern ids

ndrezn · 2024-04-08T15:12:51Z

Going to add a few more tests, then we should be almost there!

dash/_callback.py

dash/_utils.py

dash/_callback.py

dash/dash-renderer/src/actions/callbacks.ts

emilykl · 2024-04-22T20:17:13Z

dash/_callback.py

@@ -331,9 +337,12 @@ def wrap_func(func):
        def add_context(*args, **kwargs):
            output_spec = kwargs.pop("outputs_list")
            app_callback_manager = kwargs.pop("long_callback_manager", None)
-            callback_ctx = kwargs.pop("callback_context", {})
+            callback_ctx = kwargs.pop(
+                "callback_context", AttributeDict({"updated_props": {}})


Why does callback_ctx always need to contain an updated_props key?

I remember there is an error with some mocked tests.

emilykl · 2024-04-22T20:24:44Z

dash/_callback_context.py


 callback_context = CallbackContext()
+
+
+def set_props(component_id: typing.Union[str, dict], props: dict):


Is there a reason why the function signature for set_props isn't structured as 3 inputs: component_id, prop_name, value?

That to me seems more consistent with the rest of the Dash API.

It is the same signature as the frontend set_props, we considered set_props("id", prop=value) but decided to stay with same API for frontend and backend.

It's true, this pattern is a little more javascripty, but consistency is good and it could be convenient to be able to set multiple props of the same component in one call.

dash/dash-renderer/src/actions/dependencies.js

emilykl · 2024-04-22T20:36:34Z

dash/long_callback/_proxy_set_props.py

@@ -0,0 +1,7 @@
+class ProxySetProps(dict):


What's the purpose of ProxySetProps? Maybe add a comment at the top of the file.

It's a trick I found to make it work with background callbacks, when the value is set the handler is called and save the set_props data to be retrieved in the callback loop.

Does that mean background callbacks can update arbitrary props mid-execution and have that reflected in the app? If so that's super slick! Does it work to update the same prop(s) as the regular callback output(s), like progressive loading of the result?

Yes, the app is updated async like with the set_progress, it should be possible to update the same prop as the output.

emilykl · 2024-04-22T20:51:26Z

Aside from my comments, LGTM. ✨

In general there are a number of places where you've added separate code paths for no_output=True vs. no_output=False and I wonder whether some of them can be condensed down to a single code path... for example if we need to run some processing on the list of outputs, plausibly the same code should work on an empty list of outputs without the need for an if/else (or could be made to work with some small tweaks).

.pylintrc

dash/_callback_context.py

dash/dash-renderer/src/actions/callbacks.ts

alexcjohnson · 2024-04-24T14:21:43Z

dash/dash.py

+            if cb.get("no_output"):
+                outputs_list = []
+            elif not outputs_list:
+                # FIXME Old renderer support?


Why do we want to support old renderer? Embedded? We should rebuild & test embedded with this update anyway.

That is what the comment on split_callback_id says for old embedded and new backend, it's pretty old now, maybe we can remove entirely.

I'll look into it when I'll update embedded next.

dash/_callback.py

emilykl · 2024-04-30T21:51:10Z

dash/_callback.py

+                            component_ids[id_str][prop] = vali
+            else:
+                if output_value is not None:
+                    raise InvalidCallbackReturnValue(


This exposes a weird value for the "updating" part:

Not crucial to fix as part of this PR but would be nice if it's an easy fix.

Hmm, the hash part is gonna be for all no-output callback error, let's try to remove it.

emilykl · 2024-04-30T21:52:20Z

dash/_callback.py

+            else:
+                if output_value is not None:
+                    raise InvalidCallbackReturnValue(
+                        f"No output callback received return value: {output_value}"


nit: should be "No-output" rather than "No output"

emilykl · 2024-04-30T21:53:06Z

dash/_utils.py

    # A single dot within a dict id key or value is OK
    # but in case of multiple dots together escape each dot
    # with `\` so we don't mistake it for multi-outputs
    hashed_inputs = None

+    def _hash_inputs():


emilykl

LGTM @T4rk1n , no more comments from me. 🎉

Could you double-check with @alexcjohnson whether his questions have been resolved before merging?

Support Arbitrary callbacks

3488bbe

- Allow no output callback - Add global set_props - Fix side update pattern ids

T4rk1n requested review from alexcjohnson and ndrezn as code owners March 29, 2024 18:09

T4rk1n added 2 commits April 2, 2024 13:03

Fix dvcv001

6623750

Fix test_grouped_callbacks.

2f84022

T4rk1n added 3 commits April 9, 2024 11:14

Add test arbitrary callbacks.

fb60ce0

Add test arbitrary callbacks for background callbacks.

a9f757c

Remove lock from test.

d6564d8

T4rk1n changed the title ~~[WIP] Support Arbitrary callbacks~~ Support Arbitrary callbacks Apr 11, 2024

ndrezn requested a review from emilykl April 15, 2024 15:04

ndrezn assigned emilykl Apr 15, 2024

Merge branch 'dev' into feat/global-set-props

cb84367

emilykl reviewed Apr 22, 2024

View reviewed changes

dash/_callback.py Show resolved Hide resolved

emilykl reviewed Apr 22, 2024

View reviewed changes

dash/_utils.py Outdated Show resolved Hide resolved

syl-oh reviewed Apr 22, 2024

View reviewed changes

dash/_callback.py Outdated Show resolved Hide resolved

dash/dash-renderer/src/actions/callbacks.ts Outdated Show resolved Hide resolved

emilykl reviewed Apr 22, 2024

View reviewed changes

dash/dash-renderer/src/actions/dependencies.js Show resolved Hide resolved

emilykl reviewed Apr 22, 2024

View reviewed changes

T4rk1n added 5 commits April 23, 2024 09:03

reuse hashing

00baa48

reuse hashing

d57134b

Improve sideUpdate

f1a92a3

Add error when returning value in no output callbacks.

b1a0529

Add ProxySetProps docstring

dfdb605

alexcjohnson reviewed Apr 24, 2024

View reviewed changes

.pylintrc Outdated Show resolved Hide resolved

alexcjohnson reviewed Apr 24, 2024

View reviewed changes

dash/_callback_context.py Outdated Show resolved Hide resolved

alexcjohnson reviewed Apr 24, 2024

View reviewed changes

dash/dash-renderer/src/actions/callbacks.ts Outdated Show resolved Hide resolved

alexcjohnson reviewed Apr 24, 2024

View reviewed changes

T4rk1n added 5 commits April 24, 2024 11:18

use stringigfy_id

8891a71

rollback pylintrc change

939c010

fix stringify_id

b12c481

Fix case where the dict id contains a dot

dfaf5d1

Refactor no_output variable to has_output and less branching

6360421

T4rk1n requested a review from emilykl April 25, 2024 18:26

syl-oh reviewed Apr 25, 2024

View reviewed changes

dash/_callback.py Outdated Show resolved Hide resolved

T4rk1n added 3 commits April 25, 2024 14:53

Update changelog

2b29699

Add no output counter test

a1e461f

reverse condition

ad73c29

emilykl reviewed Apr 30, 2024

View reviewed changes

emilykl approved these changes Apr 30, 2024

View reviewed changes

T4rk1n added 2 commits May 1, 2024 15:40

Better error message on no output callbacks exceptions

33f6d74

No output -> No-output

d367a6e

T4rk1n merged commit a5a9e4e into dev May 3, 2024
3 checks passed

T4rk1n deleted the feat/global-set-props branch May 3, 2024 13:20

T4rk1n mentioned this pull request May 9, 2024

Support for callbacks with no outputs #2682

Closed

6 tasks

bionictoucan mentioned this pull request Aug 22, 2024

Pattern Maching ID not working in Dash callback cancel #2955

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Support Arbitrary callbacks #2822

Support Arbitrary callbacks #2822

T4rk1n commented Mar 29, 2024

ndrezn commented Apr 8, 2024

emilykl Apr 22, 2024

T4rk1n Apr 23, 2024

emilykl Apr 22, 2024

T4rk1n Apr 23, 2024

alexcjohnson Apr 24, 2024

emilykl Apr 22, 2024

T4rk1n Apr 23, 2024

alexcjohnson Apr 24, 2024

T4rk1n Apr 24, 2024

emilykl commented Apr 22, 2024

alexcjohnson Apr 24, 2024

T4rk1n Apr 24, 2024

T4rk1n May 1, 2024

emilykl Apr 30, 2024 •

edited

Loading

T4rk1n May 1, 2024 •

edited

Loading

emilykl Apr 30, 2024

emilykl Apr 30, 2024

emilykl left a comment


		callback_context = CallbackContext()


		def set_props(component_id: typing.Union[str, dict], props: dict):

Support Arbitrary callbacks #2822

Support Arbitrary callbacks #2822

Conversation

T4rk1n commented Mar 29, 2024

ndrezn commented Apr 8, 2024

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

emilykl commented Apr 22, 2024

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

emilykl Apr 30, 2024 • edited Loading

Choose a reason for hiding this comment

T4rk1n May 1, 2024 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

emilykl left a comment

Choose a reason for hiding this comment

emilykl Apr 30, 2024 •

edited

Loading

T4rk1n May 1, 2024 •

edited

Loading