Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SAMZA-2796: Introduce config knob for framework thread sub DAG execution #1691

Merged
merged 2 commits into from
Nov 21, 2023

Conversation

mynameborat
Copy link
Contributor

Description
As part of SAMZA-2781, we use framework thread pool to execute hand-offs and sub-DAG execution. We want to add a config knob to enable users opt-in to the feature as opposed to enable it by default.

Changes

  • Introduce config knob to use the framework executor

Tests

  • Added unit tests

API Changes
None

Usage Instructions
Refer to the configuration documentation. To enable framework thread pool for sub-DAG execution and message hand off, set job.operator.framework.executor.enabled to true

Upgrade Instructions
None

@alnzng
Copy link
Contributor

alnzng commented Nov 21, 2023

LGTM. Thanks for providing a way to allow the users to have a way to keep the feature parity with previous versions.

@mynameborat mynameborat merged commit 66495b6 into apache:master Nov 21, 2023
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants