Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vacuum after upgrade #2370

Merged
merged 2 commits into from
Oct 30, 2019
Merged

Conversation

wezrule
Copy link
Contributor

@wezrule wezrule commented Oct 29, 2019

During the v14 to v15 database upgrade, the ledger grows from 16GB to 24GB, vacuuming is now done after the upgrade. Vacuuming can take substantial time on lower end devices, for instance my 1vCPU, 2GB Ram droplet took 16 minutes for the upgrade itself (swap space was not used) and a further 20 minutes for the vacuum. On Windows, 3.4GHZ, 16GB RAM, the upgrade and vacuum took under 10 minutes in total, both tests were done with the RelWithDebInfo configuration. Additional log entries were added near the beginning upgrade steps. The following was logged for the 1vCPU droplet where it didn't have enough space for the vacuum (only difference is the last log entry which would say successful if it was):

[2019-Oct-29 11:43:41.891987]: Preparing v14 to v15 upgrade...
[2019-Oct-29 11:48:08.388623]: Finished extracting confirmation height to its own database
[2019-Oct-29 11:48:09.311279]: Epoch merge upgrade: Finished accounts, now doing state blocks
[2019-Oct-29 11:48:36.018710]: Database epoch merge upgrade 1 million state blocks upgraded
[2019-Oct-29 11:49:02.430585]: Database epoch merge upgrade 2 million state blocks upgraded
[2019-Oct-29 11:49:27.786613]: Database epoch merge upgrade 3 million state blocks upgraded
[2019-Oct-29 11:49:54.404330]: Database epoch merge upgrade 4 million state blocks upgraded
[2019-Oct-29 11:50:21.338800]: Database epoch merge upgrade 5 million state blocks upgraded
[2019-Oct-29 11:50:47.403554]: Database epoch merge upgrade 6 million state blocks upgraded
[2019-Oct-29 11:51:14.383416]: Database epoch merge upgrade 7 million state blocks upgraded
[2019-Oct-29 11:51:39.606213]: Database epoch merge upgrade 8 million state blocks upgraded
[2019-Oct-29 11:52:06.788994]: Database epoch merge upgrade 9 million state blocks upgraded
[2019-Oct-29 11:52:33.615898]: Database epoch merge upgrade 10 million state blocks upgraded
[2019-Oct-29 11:52:59.939875]: Database epoch merge upgrade 11 million state blocks upgraded
[2019-Oct-29 11:53:26.321183]: Database epoch merge upgrade 12 million state blocks upgraded
[2019-Oct-29 11:53:56.704467]: Database epoch merge upgrade 13 million state blocks upgraded
[2019-Oct-29 11:54:24.592489]: Database epoch merge upgrade 14 million state blocks upgraded
[2019-Oct-29 11:54:51.010085]: Database epoch merge upgrade 15 million state blocks upgraded
[2019-Oct-29 11:55:19.274183]: Database epoch merge upgrade 16 million state blocks upgraded
[2019-Oct-29 11:55:44.799214]: Database epoch merge upgrade 17 million state blocks upgraded
[2019-Oct-29 11:56:11.730480]: Database epoch merge upgrade 18 million state blocks upgraded
[2019-Oct-29 11:56:39.118995]: Database epoch merge upgrade 19 million state blocks upgraded
[2019-Oct-29 11:57:07.463607]: Database epoch merge upgrade 20 million state blocks upgraded
[2019-Oct-29 11:57:34.400243]: Database epoch merge upgrade 21 million state blocks upgraded
[2019-Oct-29 11:58:00.615955]: Database epoch merge upgrade 22 million state blocks upgraded
[2019-Oct-29 11:58:16.030137]: Epoch merge upgrade: Finished state blocks, now doing pending blocks
[2019-Oct-29 11:59:34.224127]: Finished epoch merge upgrade. Preparing vacuum...
[2019-Oct-29 12:02:09.408374]: Failed to vacuum. (Optional) Ensure enough disk space is available for a copy of the database and try to vacuum after shutting down the node

@wezrule wezrule added the quality improvements This item indicates the need for or supplies changes that improve maintainability label Oct 29, 2019
@wezrule wezrule self-assigned this Oct 29, 2019
@guilhermelawless guilhermelawless added this to the V20.0 milestone Oct 29, 2019
@wezrule wezrule merged commit 9aab1c7 into nanocurrency:master Oct 30, 2019
@wezrule wezrule deleted the vacuum_after_upgrade branch October 30, 2019 14:25
argakiig pushed a commit that referenced this pull request Oct 31, 2019
* Vacuum after upgrade

* Modify vacuum failed log message
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
quality improvements This item indicates the need for or supplies changes that improve maintainability
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants