Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: dump state to s3 by multiple nodes #9049

Merged
merged 27 commits into from
May 18, 2023
Merged

feat: dump state to s3 by multiple nodes #9049

merged 27 commits into from
May 18, 2023

Commits on May 18, 2023

  1. in progress

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    56a33b5 View commit details
    Browse the repository at this point in the history

  2. compiled code

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    1c934bb View commit details
    Browse the repository at this point in the history

  3. add debug messages

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    47fe6c6 View commit details
    Browse the repository at this point in the history

  4. fix part_id to be 0..num_parts instead of 1..=num_parts

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    528a8ef View commit details
    Browse the repository at this point in the history

  5. use a new prefix

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    2618899 View commit details
    Browse the repository at this point in the history

  6. add tmp check progress scripts

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    ae789e2 View commit details
    Browse the repository at this point in the history

  7. add ubuntu scripts

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    6928b5f View commit details
    Browse the repository at this point in the history

  8. changes in progress

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    8c2b34e View commit details
    Browse the repository at this point in the history

  9. fix unwrap

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    ce0d11e View commit details
    Browse the repository at this point in the history

  10. format

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    80b7224 View commit details
    Browse the repository at this point in the history

  11. add integration test for multi node dump locally

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    baff814 View commit details
    Browse the repository at this point in the history

  12. delete temporary scripts

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    b9bdc4a View commit details
    Browse the repository at this point in the history

  13. format

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    6ccf043 View commit details
    Browse the repository at this point in the history

  14. minor

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    b97a278 View commit details
    Browse the repository at this point in the history

  15. draw 1 part_id until timer is at 60s instead of a big batch size

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    4e6919d View commit details
    Browse the repository at this point in the history

  16. refactor

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    8619afb View commit details
    Browse the repository at this point in the history

  17. fix after rebase

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    764876f View commit details
    Browse the repository at this point in the history

  18. test multi-node in sync_state_nodes.rs

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    0b82eb9 View commit details
    Browse the repository at this point in the history

  19. add tests to expensive.txt

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    31685e8 View commit details
    Browse the repository at this point in the history

  20. remove idx from parts_to_dump only after it's dumped

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    34572b2 View commit details
    Browse the repository at this point in the history

  21. fmt

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    ac3e575 View commit details
    Browse the repository at this point in the history

  22. minor

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    4999ae9 View commit details
    Browse the repository at this point in the history

  23. address comments and keep only the code for multi node dump

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    4af4e1c View commit details
    Browse the repository at this point in the history

  24. fmt

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    5144bd4 View commit details
    Browse the repository at this point in the history

  25. address comments

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    bc4400a View commit details
    Browse the repository at this point in the history

  26. change time limit to 5 mins

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    f62a07b View commit details
    Browse the repository at this point in the history

  27. add to changelog

    @ppca
    ppca committed May 18, 2023
    Configuration menu
    Copy the full SHA
    5051015 View commit details
    Browse the repository at this point in the history