conbench-apache-arrow / Conbench performance report
failed
Jun 15, 2024 in 0s
Found 3 regressions
After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit 7d84c1e.
Benchmarks with performance regressions
There were 3 possible performance regressions, according to the lookback z-score method.
Benchmarks with regressions:
- Commit Run on
test-mac-arm
at 2024-06-14 08:15:21Ztpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-01, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-03, scale_factor=1tpch
(R) with engine=arrow, format=native, language=R, memory_map=False, query_id=TPCH-04, scale_factor=1
All benchmark runs analyzed:
- Commit Run on
ec2-t3-xlarge-us-east-2
at 2024-06-14 22:43:09Z - Commit Run on
ursa-thinkcentre-m75q
at 2024-06-14 01:10:40Z - Commit Run on
arm64-t4g-linux-compute
at 2024-06-14 01:10:39Z - Commit Run on
ec2-m5-4xlarge-us-east-2
at 2024-06-13 22:36:52Z - Commit Run on
arm64-m6g-linux-compute
at 2024-06-14 01:10:18Z - Commit Run on
test-mac-arm
at 2024-06-14 08:15:21Z
Unstable benchmarks with performance regressions
The following benchmark results indicate a possible performance regression, but are known to sometimes produce false positives when applying the lookback z-score analysis.
-
Commit Run on
ursa-thinkcentre-m75q
at 2024-06-14 01:10:40ZRoundArrayBenchmark
(C++) with params=<Round, UInt32Type, RoundMode::HALF_TO_ODD>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkRoundDerivativesArrayBenchmark
(C++) with params=<Ceil, FloatType>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkRoundArrayBenchmark
(C++) with params=<Round, Int64Type, RoundMode::HALF_TOWARDS_ZERO>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkRoundArrayBenchmark
(C++) with params=<Round, UInt32Type, RoundMode::DOWN>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkArrayArrayKernel
(C++) with params=<MultiplyChecked, UInt64Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkRoundDerivativesArrayBenchmark
(C++) with params=<Ceil, FloatType>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkRoundDerivativesArrayBenchmark
(C++) with params=<Trunc, DoubleType>/size:524288/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkRoundDerivativesArrayBenchmark
(C++) with params=<Trunc, DoubleType>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-round-benchmarkArrayArrayKernel
(C++) with params=<MultiplyChecked, Int64Type>/size:524288/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
-
Commit Run on
arm64-t4g-linux-compute
at 2024-06-14 01:10:39Z -
Commit Run on
test-mac-arm
at 2024-06-14 08:15:21ZArrayScalarKernel
(C++) with params=<AddChecked, UInt64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkBinaryCompareOp
(C++) with source=cpp-micro, suite=arrow-decimal-benchmarkArrayScalarKernel
(C++) with params=<AddChecked, UInt16Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayScalarKernel
(C++) with params=<AddChecked, UInt8Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, Int64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<MultiplyChecked, Int64Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, Int32Type>/size:4194304/inverse_null_proportion:0, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmarkArrayArrayKernel
(C++) with params=<SubtractChecked, Int64Type>/size:4194304/inverse_null_proportion:100, source=cpp-micro, suite=arrow-compute-scalar-arithmetic-benchmark
Details
This report was generated using the lookback z-score method with a z-score threshold of 30.0.
Loading