Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Prefer cluster state config to index documents #36014

Merged
merged 4 commits into from
Nov 29, 2018

Conversation

davidkyle
Copy link
Member

A partial revert of #35940

Duplicate configs in both the clusterstate and index are still possible but now clusterstate config is preferred.

After discussing the changes in #35940 it was decided that during a move operation the original should always be preferred to the new until the operation has completed. This revert also makes the code simpler to read.

Alas the wasted time

@benwtrent you reviewed #35940 would you take a look at this please

@davidkyle davidkyle added >feature :ml Machine learning labels Nov 28, 2018
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core

@benwtrent
Copy link
Member

@davidkyle

No issues with the PR really, but what is the reasoning for the reverting? Why should we prefer the cluster state over the indexed configs?

Copy link
Member

@benwtrent benwtrent left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well @davidkyle , there you stand, with your code in your hands:

https://www.youtube.com/watch?v=c0SvsinEUfY

:D

@davidkyle
Copy link
Member Author

Actually doing this uncovered a bug where on closing a job the check that the job's datafeed must be stopped was only checking the index configs and not the clusterstate jobs. This explains an intermittent failure I'd seen in the rolling upgrade tests.

@davidkyle davidkyle mentioned this pull request Nov 29, 2018
43 tasks
Copy link
Member

@benwtrent benwtrent left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 👍 👍 👍 👍 👍 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>feature :ml Machine learning
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants