Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SNAPSHOTS: Allow Parallel Restore Operations (#36397) #36659

Merged
merged 4 commits into from
Dec 17, 2018

Conversation

original-brownbear
Copy link
Member

  • Enable parallel restore operations
  • Add uuid to restore in progress entries to uniquely identify them
  • Adjust restore in progress entries to be a map in cluster state
  • Added tests for:
    • Parallel restore from two different snapshots
    • Parallel restore from a single snapshot to different indices to test uuid identifiers are correctly used by RestoreService and routing allocator
    • Parallel restore with waiting for completion to test transport actions correctly use uuid identifiers

* Enable parallel restore operations
* Add uuid to restore in progress entries to uniquely identify them
* Adjust restore in progress entries to be a map in cluster state
* Added tests for:
   * Parallel restore from two different snapshots
   * Parallel restore from a single snapshot to different indices to test uuid identifiers are correctly used by `RestoreService` and routing allocator
   * Parallel restore with waiting for completion to test transport actions correctly use uuid identifiers
@original-brownbear original-brownbear added >enhancement :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs backport labels Dec 14, 2018
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed

@original-brownbear
Copy link
Member Author

@elasticmachine run gradle build tests 1 please

@original-brownbear
Copy link
Member Author

@elasticmachine run gradle build tests 1 please

2 similar comments
@original-brownbear
Copy link
Member Author

@elasticmachine run gradle build tests 1 please

@original-brownbear
Copy link
Member Author

@elasticmachine run gradle build tests 1 please

original-brownbear added a commit to original-brownbear/elasticsearch that referenced this pull request Dec 17, 2018
@original-brownbear original-brownbear merged commit e832d87 into elastic:6.x Dec 17, 2018
@original-brownbear original-brownbear deleted the 36397-6.x branch December 17, 2018 15:08
jasontedor added a commit to jasontedor/elasticsearch that referenced this pull request Dec 18, 2018
* master: (30 commits)
  Revert "[Geo] Integrate Lucene's LatLonShape (BKD Backed GeoShapes) as default `geo_shape` indexing approach (elastic#35320)"
  Deprecate types in get_source and exist_source (elastic#36426)
  Fix duplicate phrase in shrink/split error message (elastic#36734)
  ingest: support default pipelines + bulk upserts (elastic#36618)
  TESTS:Debug Log. IndexStatsIT#testFilterCacheStats
  [Geo] Integrate Lucene's LatLonShape (BKD Backed GeoShapes) as default `geo_shape` indexing approach (elastic#35320)
  [TEST] fix float comparison in RandomObjects#getExpectedParsedValue
  Initialize startup `CcrRepositories` (elastic#36730)
  ingest: fix on_failure with Drop processor (elastic#36686)
  SNAPSHOTS: Adjust BwC Versions in Restore Logic (elastic#36718)
  [Painless] Add boxed type to boxed type casts for method/return (elastic#36571)
  Do not resolve addresses in remote connection info (elastic#36671)
  Add back one line removed by mistake regarding java version check and COMPAT jvm parameter existence
  Fixing line length for EnvironmentTests and RecoveryTests (elastic#36657)
  SQL: Fix translation of LIKE/RLIKE keywords (elastic#36672)
  [DOCS] Adds monitoring requirement for ingest node (elastic#36665)
  SNAPSHOTS: Disable BwC Tests Until elastic#36659 Landed (elastic#36709)
  Add doc's sequence number + primary term to GetResult and use it for updates (elastic#36680)
  [CCR] Add time since last auto follow fetch to auto follow stats (elastic#36542)
  Watcher accounts constructed lazily (elastic#36656)
  ...
@DaveCTurner
Copy link
Contributor

This is a backport of #36397 - the number is in the title but you can't click on it there :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport :Distributed/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs >enhancement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants