[Perf] Linux/x64: 9 Regressions on 12/11/2023 8:56:10 AM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsFalse<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenSet - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	114.63 μs	133.84 μs	1.17	0.15	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsFalse<String>*'

Payloads

Baseline
Compare

System.Collections.ContainsFalse<String>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_SingleCharFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	1.48 ms	1.72 ms	1.16	0.04	True
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	14.90 μs	16.86 μs	1.13	0.15	True
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	147.91 μs	168.91 μs	1.14	0.11	True
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	1.53 μs	1.72 μs	1.12	0.10	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_SingleCharFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 100)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_SingleCharFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Perf_DefaultFrozenDictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	257.55 μs	300.48 μs	1.17	0.10	True
TryGetValue_False_FrozenDictionary - Duration of single invocation 📈 - ADX Test Multi Config Graph	1.67 μs	1.83 μs	1.10	0.07	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Perf_DefaultFrozenDictionary*'

Payloads

Baseline
Compare

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 1000)

ETL Files

Histogram

JIT Disasms

System.Collections.Perf_DefaultFrozenDictionary.TryGetValue_False_FrozenDictionary(Count: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.ContainsKeyFalse<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionary - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	121.74 μs	151.63 μs	1.25	0.15	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.ContainsKeyFalse<String, String>*'

Payloads

Baseline
Compare

System.Collections.ContainsKeyFalse<String, String>.FrozenDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f0a6dbdf654b07cedc05217824500ae653409880
Compare	6a94e2a137048f7ef9280537a1d2dbcf4fab19b8
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueTrue<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionaryOptimized - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	156.89 μs	179.16 μs	1.14	0.13	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueTrue<String, String>*'

Payloads

Baseline
Compare

System.Collections.TryGetValueTrue<String, String>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

this is dotnet/runtime#92546, duplicate of #26185