-
Notifications
You must be signed in to change notification settings - Fork 423
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
pageserver: drop out of secondary download if iteration time has pass…
…ed (#8198) ## Problem Very long running downloads can be wasteful, because the heatmap they're using is outdated after a few minutes. Closes: #8182 ## Summary of changes - Impose a deadline on timeline downloads, using the same period as we use for scheduling, and returning an UpdateError::Restart when it is reached. This restart will involve waiting for a scheduling interval, but that's a good thing: it helps let other tenants proceed. - Refactor download_timeline so that the part where we update the state for local layers is done even if we fall out of the layer download loop with an error: this is important, especially for big tenants, because only layers in the SecondaryDetail state will be considered for eviction.
- Loading branch information
Showing
1 changed file
with
98 additions
and
30 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
babbe12
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
3028 tests run: 2900 passed, 2 failed, 126 skipped (full report)
Failures on Postgres 14
test_sharding_autosplit[github-actions-selfhosted]
: releasetest_download_churn[github-actions-selfhosted-100-tokio-epoll-uring-30]
: releaseFlaky tests (1)
Postgres 14
test_ondemand_wal_download_in_replication_slot_funcs
: debugCode coverage* (full report)
functions
:32.7% (6903 of 21118 functions)
lines
:50.1% (54141 of 108100 lines)
* collected from Rust tests only
babbe12 at 2024-06-28T18:29:36.926Z :recycle: