Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#192624] Fix archive for incompatible_cluster_routing_allocation #193741

Merged

Conversation

afharo
Copy link
Member

@afharo afharo commented Sep 23, 2024

Summary

Related #192624.

ES complained because the archive was created with 8.0.0, but ES 9.0.0 requires the datastore to be upgraded to 8.16.0. The following steps have been followed:

# 1. Start ES 8.16 with the affected data-archive
yarn es snapshot --version=8.16.0 --data-archive src/core/server/integration_tests/saved_objects/migrations/archives/8.0.0_v1_migrations_sample_data_saved_objects.zip
# ... after ES has completely started up, stop it.

# 2. Compress the archive
cd .es/8.16.0
zip -r ../../src/core/server/integration_tests/saved_objects/migrations/archives/8.0.0_v1_migrations_sample_data_saved_objects.zip data  -x "*/\.*"
cd ../../

# 3. Run the tests to confirm that the issue is fixed.
yarn test:jest_integration src/core/server/integration_tests/saved_objects/migrations/group3/incompatible_cluster_routing_allocation.test.ts

Checklist

For maintainers

@afharo afharo added chore Team:Core Core services & architecture: plugins, logging, config, saved objects, http, ES client, i18n, etc release_note:skip Skip the PR/issue when compiling release notes backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) labels Sep 23, 2024
@afharo afharo self-assigned this Sep 23, 2024
@afharo afharo requested a review from a team as a code owner September 23, 2024 15:39
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-core (Team:Core)

Copy link
Contributor

@gsoldevila gsoldevila left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe your strategy for updating the ZIP file is additive, aka doesn't remove existing data.
I tried using this instead:

ditto -c -k --sequesterRsrc --keepParent .es/8.16.0/data src/core/server/integration_tests/saved_objects/migrations/archives/7.13.0_concurrent_5k_foo.zip

Which got me from:

gsoldevila@MacBook archives % ls -lh
-rw-r--r--  1 gsoldevila  staff   260K Sep 23 18:11 7.13.0_concurrent_5k_foo.zip

To an archive less than half the size:

gsoldevila@MacBook archives % ls -lh
-rw-r--r--  1 gsoldevila  staff   121K Sep 23 18:12 7.13.0_concurrent_5k_foo.zip

@gsoldevila gsoldevila self-requested a review September 23, 2024 16:19
@afharo afharo enabled auto-merge (squash) September 23, 2024 16:23
Copy link
Contributor

@gsoldevila gsoldevila left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NIT could we re-package the file?

@kibana-ci
Copy link
Collaborator

💛 Build succeeded, but was flaky

Failed CI Steps

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @afharo

@afharo afharo merged commit df2ccb6 into elastic:main Sep 23, 2024
36 checks passed
@afharo afharo deleted the 192624-incompatible_cluster_routing_allocation branch September 23, 2024 17:33
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Sep 23, 2024
@kibanamachine
Copy link
Contributor

💚 All backports created successfully

Status Branch Result
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Sep 23, 2024
…location` (#193741) (#193763)

# Backport

This will backport the following commits from `main` to `8.x`:
- [[#192624] Fix archive for
`incompatible_cluster_routing_allocation`
(#193741)](#193741)

<!--- Backport version: 9.4.3 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sqren/backport)

<!--BACKPORT [{"author":{"name":"Alejandro Fernández
Haro","email":"alejandro.haro@elastic.co"},"sourceCommit":{"committedDate":"2024-09-23T17:33:47Z","message":"[#192624]
Fix archive for `incompatible_cluster_routing_allocation`
(#193741)","sha":"df2ccb6789537a5a7474cc8a1601696188551352","branchLabelMapping":{"^v9.0.0$":"main","^v8.16.0$":"8.x","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["chore","Team:Core","release_note:skip","v9.0.0","backport:prev-minor"],"title":"[#192624]
Fix archive for
`incompatible_cluster_routing_allocation`","number":193741,"url":"#193741
Fix archive for `incompatible_cluster_routing_allocation`
(#193741)","sha":"df2ccb6789537a5a7474cc8a1601696188551352"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.0.0","branchLabelMappingKey":"^v9.0.0$","isSourceBranch":true,"state":"MERGED","url":"#193741
Fix archive for `incompatible_cluster_routing_allocation`
(#193741)","sha":"df2ccb6789537a5a7474cc8a1601696188551352"}}]}]
BACKPORT-->

Co-authored-by: Alejandro Fernández Haro <alejandro.haro@elastic.co>
@gsoldevila gsoldevila mentioned this pull request Sep 25, 2024
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:prev-minor Backport to (8.x) the previous minor version (i.e. one version back from main) chore release_note:skip Skip the PR/issue when compiling release notes Team:Core Core services & architecture: plugins, logging, config, saved objects, http, ES client, i18n, etc v8.16.0 v9.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants