-
Notifications
You must be signed in to change notification settings - Fork 24.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ILM] Add unfollow action #36970
[ILM] Add unfollow action #36970
Commits on Dec 23, 2018
-
This change adds the unfollow action for CCR follower indices. This is needed for the shrink action in case an index is a follower index. This will give the follower index the opportunity to fully catch up with the leader index, pause index following and unfollow the leader index. After this the shrink action can safely perform the ilm shrink. The unfollow action needs to be added to the hot phase and acts as barrier for going to the next phase (warm or delete phases), so that follower indices are being unfollowed properly before indices are expected to go in read-only mode. This allows the force merge action to execute its steps safely. The unfollow action has three steps: * `wait-for-indexing-complete` step: waits for the index in question to get the `index.lifecycle.indexing_complete` setting be set to `true` * `wait-for-follow-shard-tasks` step: waits for all the shard follow tasks for the index being handled to report that the leader shard global checkpoint is equal to the follower shard global checkpoint. * `unfollow-index` step: actually performs the unfollow. This consists out of multiple operations being executed on the index being handled: pause index following, close index, unfollow and open index. (a follower index can only be unfollowed when it is closed, because the underlying engine is changed) In the case of the last two steps, if the index in being handled is a regular index then the steps acts as a no-op. Relates to elastic#34648
Configuration menu - View commit details
-
Copy full SHA for c0fc17e - Browse repository at this point
Copy the full SHA c0fc17eView commit details
Commits on Dec 24, 2018
-
Replaced ccr / ilm integ test with multi cluster integ test and
changed WaitForIndexingComplete step to always ignore non follower indices.
Configuration menu - View commit details
-
Copy full SHA for f9f530e - Browse repository at this point
Copy the full SHA f9f530eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 80bb2ef - Browse repository at this point
Copy the full SHA 80bb2efView commit details -
Configuration menu - View commit details
-
Copy full SHA for a265c2a - Browse repository at this point
Copy the full SHA a265c2aView commit details
Commits on Jan 3, 2019
-
Rename class to WaitForIndexingCompleteStep
This aligns WaitForIndexingCompleteStep with naming conventions
Configuration menu - View commit details
-
Copy full SHA for e281b03 - Browse repository at this point
Copy the full SHA e281b03View commit details -
Configuration menu - View commit details
-
Copy full SHA for 07f0136 - Browse repository at this point
Copy the full SHA 07f0136View commit details -
Configuration menu - View commit details
-
Copy full SHA for 509718c - Browse repository at this point
Copy the full SHA 509718cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 974bb8b - Browse repository at this point
Copy the full SHA 974bb8bView commit details
Commits on Jan 4, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 97df36b - Browse repository at this point
Copy the full SHA 97df36bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 37bd0ef - Browse repository at this point
Copy the full SHA 37bd0efView commit details
Commits on Jan 5, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 94dc951 - Browse repository at this point
Copy the full SHA 94dc951View commit details -
Configuration menu - View commit details
-
Copy full SHA for e996f83 - Browse repository at this point
Copy the full SHA e996f83View commit details
Commits on Jan 7, 2019
-
Decreased read_poll_timeout from 60 seconds to 1 second.
The shard follow tasks continuesly poll changes from leader index, in case no new writes arrive in the leader shards, then the leader shards wait up to the defined read_poll_timeout before returning an empty result. The result also includes information about whether the index settings need to be synced. Because in this test no data was indexed it took a full minute for ccr to realize that the followe index settings needed to be updated and caused the test to fail due to an assert busy statement to time out.
Configuration menu - View commit details
-
Copy full SHA for 3949445 - Browse repository at this point
Copy the full SHA 3949445View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0ef7002 - Browse repository at this point
Copy the full SHA 0ef7002View commit details
Commits on Jan 8, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 6bb4055 - Browse repository at this point
Copy the full SHA 6bb4055View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2d368ab - Browse repository at this point
Copy the full SHA 2d368abView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7485773 - Browse repository at this point
Copy the full SHA 7485773View commit details -
Configuration menu - View commit details
-
Copy full SHA for d96ebbb - Browse repository at this point
Copy the full SHA d96ebbbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 464c256 - Browse repository at this point
Copy the full SHA 464c256View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5d63a5a - Browse repository at this point
Copy the full SHA 5d63a5aView commit details
Commits on Jan 9, 2019
-
Configuration menu - View commit details
-
Copy full SHA for f63e73d - Browse repository at this point
Copy the full SHA f63e73dView commit details -
Configuration menu - View commit details
-
Copy full SHA for deac47a - Browse repository at this point
Copy the full SHA deac47aView commit details -
Moved pause follower index, close follower index and
open follower index operation from UnfollowFollowerIndexStep to the following steps respectively: * PauseFollowerIndexStep * CloseFollowerIndexStep * OpenFollowerIndexStep The UnfollowAction now exists of the following steps: * WaitForIndexingCompleteStep * WaitForFollowShardStep * PauseFollowerIndexStep * CloseFollowerIndexStep * UnfollowFollowerIndexStep * OpenFollowerIndexStep
Configuration menu - View commit details
-
Copy full SHA for 886a3f5 - Browse repository at this point
Copy the full SHA 886a3f5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2b60e54 - Browse repository at this point
Copy the full SHA 2b60e54View commit details
Commits on Jan 10, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 6d0e236 - Browse repository at this point
Copy the full SHA 6d0e236View commit details
Commits on Jan 11, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 533bc4f - Browse repository at this point
Copy the full SHA 533bc4fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 731d8d2 - Browse repository at this point
Copy the full SHA 731d8d2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 67f970e - Browse repository at this point
Copy the full SHA 67f970eView commit details -
added wait for yellow step. That will run after open index step,
so that after unfollow is done then the unfollowed index is ready to handle requests.
Configuration menu - View commit details
-
Copy full SHA for 272b8d6 - Browse repository at this point
Copy the full SHA 272b8d6View commit details -
Configuration menu - View commit details
-
Copy full SHA for ea93eda - Browse repository at this point
Copy the full SHA ea93edaView commit details
Commits on Jan 14, 2019
-
Configuration menu - View commit details
-
Copy full SHA for e9b252e - Browse repository at this point
Copy the full SHA e9b252eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0416490 - Browse repository at this point
Copy the full SHA 0416490View commit details -
Configuration menu - View commit details
-
Copy full SHA for 443fc4a - Browse repository at this point
Copy the full SHA 443fc4aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5abf557 - Browse repository at this point
Copy the full SHA 5abf557View commit details -
Configuration menu - View commit details
-
Copy full SHA for caa13ce - Browse repository at this point
Copy the full SHA caa13ceView commit details
Commits on Jan 15, 2019
-
Configuration menu - View commit details
-
Copy full SHA for 7f521e8 - Browse repository at this point
Copy the full SHA 7f521e8View commit details -
OpenFollowerIndexStep cannot extend from AbstractUnfollowIndexStep,
because after the unfollow step it is no longer a follower index.
Configuration menu - View commit details
-
Copy full SHA for 5d3d661 - Browse repository at this point
Copy the full SHA 5d3d661View commit details -
Configuration menu - View commit details
-
Copy full SHA for f7e74d4 - Browse repository at this point
Copy the full SHA f7e74d4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7c1749b - Browse repository at this point
Copy the full SHA 7c1749bView commit details -
Configuration menu - View commit details
-
Copy full SHA for fcf34e6 - Browse repository at this point
Copy the full SHA fcf34e6View commit details
Commits on Jan 16, 2019
-
Configuration menu - View commit details
-
Copy full SHA for c02f8cb - Browse repository at this point
Copy the full SHA c02f8cbView commit details
Commits on Jan 17, 2019
-
Configuration menu - View commit details
-
Copy full SHA for a9b2663 - Browse repository at this point
Copy the full SHA a9b2663View commit details -
Configuration menu - View commit details
-
Copy full SHA for bb67cdb - Browse repository at this point
Copy the full SHA bb67cdbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3ee6298 - Browse repository at this point
Copy the full SHA 3ee6298View commit details
Commits on Jan 18, 2019
-
Run SetPriority before Unfollow
This is necessary, at least in the Hot phase, so that the priority will be set before waiting for the index to unfollow, which is much more likely what the user expects.
Configuration menu - View commit details
-
Copy full SHA for f1c05bd - Browse repository at this point
Copy the full SHA f1c05bdView commit details -
Configuration menu - View commit details
-
Copy full SHA for ca0d2cc - Browse repository at this point
Copy the full SHA ca0d2ccView commit details