Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor QueryProcessor::decomposePlanIntoTasks #1983

Closed
rfdavid opened this issue Aug 31, 2023 · 0 comments
Closed

Refactor QueryProcessor::decomposePlanIntoTasks #1983

rfdavid opened this issue Aug 31, 2023 · 0 comments
Assignees

Comments

@rfdavid
Copy link
Collaborator

rfdavid commented Aug 31, 2023

As discussed with @andyfengHKU, cases like COPY_TO end up in the middle of the pipeline, example
ResultCollector} -> {FTableScan -> CopyTo} -> {FTableScan -> ResultCollector}
where only the middle pipeline needs to be executed in a single thread.

The additional code was added as a temporary solution inside this function:

if (op->getOperatorType() == PhysicalOperatorType::COPY_TO) {
  childTask->setSingleThreadedTask();
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants