Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix TriggerDagRunOperator Tests for Database Isolation Tests #41298

Conversation

jscheffl
Copy link
Contributor

@jscheffl jscheffl commented Aug 7, 2024

Related: #41067

I attempted to adjust the tests for TriggerDagRunOperator but going into details and after fixing some serialization and adding one API I realized that at least 3 more internal API calls would be needed (marked with TODO) - feels like for an internal API support for all corner cases (good cases are working!) the operator probably needs rather a full rewrite based on stable API. Currently too much specific logic is in there.

Therefore the non working options now are explicit markes as not working in Database Isolation Mode and tests are skipped

@boring-cyborg boring-cyborg bot added area:API Airflow's REST/HTTP API area:core-operators Operators, Sensors and hooks within Core Airflow area:serialization labels Aug 7, 2024
@potiuk
Copy link
Member

potiuk commented Aug 7, 2024

I think it makes sense to mark Trigger DAG Run as not working currently with internal API with TODO and comment that this is yet-another-thing that currently does not work with it.

@jscheffl jscheffl force-pushed the bugfix/41067-fix-tests-operators-test_trigger_dagrun branch from 36dbd9f to 421943b Compare August 7, 2024 19:43
@jscheffl jscheffl changed the title [WIP] Attempt to fix TriggerDagRunOperator for Database Isolation Tests Fix TriggerDagRunOperator Tests for Database Isolation Tests Aug 7, 2024
airflow/api/common/trigger_dag.py Show resolved Hide resolved
airflow/exceptions.py Outdated Show resolved Hide resolved
airflow/operators/trigger_dagrun.py Outdated Show resolved Hide resolved
@jscheffl jscheffl force-pushed the bugfix/41067-fix-tests-operators-test_trigger_dagrun branch from 3bd8980 to 9b68ca6 Compare August 8, 2024 19:06
@jscheffl jscheffl merged commit 6b810b8 into apache:main Aug 9, 2024
49 checks passed
potiuk pushed a commit that referenced this pull request Aug 11, 2024
* Attempt to fix TriggerDagRunOperator for Database Isolation Tests

* Finalize making tests run for triggerdagrunoperator in db isolation mode

* Adjust query count assert for adjustments to serialization

* Review feedback

(cherry picked from commit 6b810b8)
@potiuk potiuk added this to the Airflow 2.10.0 milestone Aug 11, 2024
Artuz37 pushed a commit to Artuz37/airflow that referenced this pull request Aug 13, 2024
…41298)

* Attempt to fix TriggerDagRunOperator for Database Isolation Tests

* Finalize making tests run for triggerdagrunoperator in db isolation mode

* Adjust query count assert for adjustments to serialization

* Review feedback
Artuz37 pushed a commit to Artuz37/airflow that referenced this pull request Aug 13, 2024
…41298)

* Attempt to fix TriggerDagRunOperator for Database Isolation Tests

* Finalize making tests run for triggerdagrunoperator in db isolation mode

* Adjust query count assert for adjustments to serialization

* Review feedback
molcay pushed a commit to VladaZakharova/airflow that referenced this pull request Aug 19, 2024
…41298)

* Attempt to fix TriggerDagRunOperator for Database Isolation Tests

* Finalize making tests run for triggerdagrunoperator in db isolation mode

* Adjust query count assert for adjustments to serialization

* Review feedback
olegmayko pushed a commit to olegmayko/airflow that referenced this pull request Oct 2, 2024
…41298)

* Attempt to fix TriggerDagRunOperator for Database Isolation Tests

* Finalize making tests run for triggerdagrunoperator in db isolation mode

* Adjust query count assert for adjustments to serialization

* Review feedback
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:API Airflow's REST/HTTP API area:core-operators Operators, Sensors and hooks within Core Airflow area:serialization
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants