Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce buzhash chunker #6701

Merged
merged 4 commits into from
Oct 7, 2019
Merged

Introduce buzhash chunker #6701

merged 4 commits into from
Oct 7, 2019

Commits on Oct 7, 2019

  1. Introduce buzhash chunker

    It has the same properties as Rabin but is much faster.
    Benchmark results:
    
    ```
    name             speed
    Buzhash2/1K-4    1.71GB/s ± 4%
    Buzhash2/1M-4    1.15GB/s ± 2%
    Buzhash2/16M-4    892MB/s ± 1%
    Buzhash2/100M-4   904MB/s ± 2%
    Rabin/1K-4       13.8MB/s ± 3%
    Rabin/1M-4        171MB/s ± 3%
    Rabin/16M-4       182MB/s ± 4%
    Rabin/100M-4      182MB/s ± 3%
    Default/1K-4     1.74GB/s ± 4%
    Default/1M-4     3.22GB/s ± 2%
    Default/16M-4    3.88GB/s ± 2%
    Default/100M-4   4.21GB/s ± 6%
    ```
    
    License: MIT
    Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
    Jakub Sztandera committed Oct 7, 2019
    Configuration menu
    Copy the full SHA
    67f9837 View commit details
    Browse the repository at this point in the history
  2. Add test for buzhash

    License: MIT
    Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
    Jakub Sztandera committed Oct 7, 2019
    Configuration menu
    Copy the full SHA
    6f4f9b4 View commit details
    Browse the repository at this point in the history
  3. Add buzhash to ipfs add docs

    License: MIT
    Signed-off-by: Jakub Sztandera <kubuxu@protocol.ai>
    Jakub Sztandera committed Oct 7, 2019
    Configuration menu
    Copy the full SHA
    76d2ad4 View commit details
    Browse the repository at this point in the history
  4. fix(sharness): spelling

    Stebalien authored Oct 7, 2019
    Configuration menu
    Copy the full SHA
    4391ef9 View commit details
    Browse the repository at this point in the history