Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adapt maxSegmentsToMove based on cluster skew #14584

Merged
merged 20 commits into from
Aug 17, 2023
Merged

Adapt maxSegmentsToMove based on cluster skew #14584

merged 20 commits into from
Aug 17, 2023

Commits on Jul 14, 2023

  1. Adapt maxSegmentsToMove based on cluster skew

    @kfaraz
    kfaraz committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    b6c3a0a View commit details
    Browse the repository at this point in the history

  2. Remove extra changes

    @kfaraz
    kfaraz committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    e69356f View commit details
    Browse the repository at this point in the history

  3. Some cleanups

    @kfaraz
    kfaraz committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    c966c94 View commit details
    Browse the repository at this point in the history

  4. Remove all extra changes

    @kfaraz
    kfaraz committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    9865c7c View commit details
    Browse the repository at this point in the history

  5. Some more changes

    @kfaraz
    kfaraz committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    13a0f0d View commit details
    Browse the repository at this point in the history

  6. Reduce test run time

    @kfaraz
    kfaraz committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    234e68f View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2023

  1. Merge branch 'master' of github.com:apache/druid into adaptive_max_se… 

    …gments_to_move
    @kfaraz
    kfaraz committed Jul 17, 2023
    Configuration menu
    Copy the full SHA
    fbab10e View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2023

  1. Merge branch 'master' of github.com:apache/druid into adaptive_max_se… 

    …gments_to_move
    @kfaraz
    kfaraz committed Jul 20, 2023
    Configuration menu
    Copy the full SHA
    0afd1e6 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2023

  1. Compute maxSegmentsToMove based on skew in counts and disk usage

    @kfaraz
    kfaraz committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    ab169c3 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. Merge branch 'master' of github.com:apache/druid into adaptive_max_se… 

    …gments_to_move
    @kfaraz
    kfaraz committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    8edca17 View commit details
    Browse the repository at this point in the history

  2. Move stuff around, add tests

    @kfaraz
    kfaraz committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    82d13e3 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2023

  1. Merge branch 'master' of github.com:apache/druid into adaptive_max_se… 

    …gments_to_move
    @kfaraz
    kfaraz committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    844fc77 View commit details
    Browse the repository at this point in the history

  2. Increase minSegmentsToMove in steps of 100

    @kfaraz
    kfaraz committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    f39b196 View commit details
    Browse the repository at this point in the history

  3. Further cleanup

    @kfaraz
    kfaraz committed Aug 3, 2023
    Configuration menu
    Copy the full SHA
    22dc6b7 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2023

  1. Merge branch 'master' of github.com:apache/druid into adaptive_max_se… 

    …gments_to_move
    @kfaraz
    kfaraz committed Aug 11, 2023
    Configuration menu
    Copy the full SHA
    ed390f0 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2023

  1. Use max gap instead of absolute deviation

    @kfaraz
    kfaraz committed Aug 12, 2023
    Configuration menu
    Copy the full SHA
    636632f View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2023

  1. Fix logic in SegmentToMoveCalculator

    @kfaraz
    kfaraz committed Aug 13, 2023
    Configuration menu
    Copy the full SHA
    9d14aee View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2023

  1. Address feedback

    @kfaraz
    kfaraz committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    4875737 View commit details
    Browse the repository at this point in the history

  2. Fix simulation tests

    @kfaraz
    kfaraz committed Aug 16, 2023
    Configuration menu
    Copy the full SHA
    1cfb934 View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2023

  1. Reduce minSegmentsToMove

    @kfaraz
    kfaraz committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    da23348 View commit details
    Browse the repository at this point in the history