Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Job in index: Enable get and update actions for clusterstate jobs #35598

Merged
merged 4 commits into from
Nov 19, 2018

Conversation

davidkyle
Copy link
Member

In 6.6 and 6.7 job and datafeed configuration may be clusterstate or the index. As with #35590 these changes are mostly testing for the location of the config and reinstating the old clusterstate config update code.

This PR covers the get and update actions and is the last change for required for running mixed config jobs.

@davidkyle davidkyle added >feature :ml Machine learning labels Nov 15, 2018
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core

@davidkyle davidkyle mentioned this pull request Nov 15, 2018
43 tasks

if (config != null) {
listener.onResponse(config);
} else {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why isn't this the other way around? I would think that since we are moving towards putting things in the index, that we would want that to be our positive path, and we would always check it first and return it if we find it.

This concern is also for https://github.com/elastic/elasticsearch/pull/35598/files#diff-db8b21d42edc9e4fada4630d49530113R141

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True I haven't been entirely consistent with this. The check for the config in cluster state doesn't require an async call so it makes sense to do the fast check first, then the order of the branching is based on what thoughts I could manage to keep in my brain. Note these code paths are only in 6.6 and 6.7 and will be maintained until 6.7.final_ever_bug_release

Copy link
Member

@benwtrent benwtrent Nov 16, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah, I did not know these predicates were only for specific versions.

@davidkyle
Copy link
Member Author

The tests were failing because there was no index mapping for DelayedDataCheckConfig in the DatafeedConfig (the default is keyword and this is an object. I've fixed that here and will raise a separate PR for the master feature branch

@davidkyle
Copy link
Member Author

run gradle build tests

@davidkyle
Copy link
Member Author

run gradle build tests

Copy link
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@davidkyle davidkyle merged commit 15a9fdf into elastic:feature-jindex-6x Nov 19, 2018
@davidkyle davidkyle deleted the get-actions branch November 19, 2018 13:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>feature :ml Machine learning
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants