Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: track time to stable mesh metric in Grafana #5916

Merged
merged 2 commits into from
Aug 29, 2023
Merged

chore: track time to stable mesh metric in Grafana #5916

merged 2 commits into from
Aug 29, 2023

Conversation

twoeths
Copy link
Contributor

@twoeths twoeths commented Aug 25, 2023

Motivation

  • Track time to stable mesh in grafana

Description

  • Track lodestar_attnets_service_committee_subscriptions_time_to_stable_mesh_seconds_bucket in Networking dashboard
  • There is also metrics to track short lived mesh peers but it's kind of overlap to "Attnet mesh peers per subnet" because since v1.10.0 we subscribe to only 2 long lived subnets per node
Screenshot 2023-08-25 at 15 55 51

Closes #5864

@twoeths twoeths requested a review from a team as a code owner August 25, 2023 08:58
@github-actions
Copy link
Contributor

github-actions bot commented Aug 25, 2023 •
edited
Loading

Performance Report

✔️ no performance regression detected

Full benchmark results
Benchmark suite Current: 388737f Previous: 1b40a91 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 493.20 us/op 515.66 us/op 0.96
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 78.163 us/op 93.805 us/op 0.83
BLS verify - blst-native 1.3384 ms/op 1.3257 ms/op 1.01
BLS verifyMultipleSignatures 3 - blst-native 2.7657 ms/op 2.7578 ms/op 1.00
BLS verifyMultipleSignatures 8 - blst-native 6.0189 ms/op 6.1807 ms/op 0.97
BLS verifyMultipleSignatures 32 - blst-native 22.088 ms/op 21.969 ms/op 1.01
BLS verifyMultipleSignatures 64 - blst-native 43.681 ms/op 43.829 ms/op 1.00
BLS verifyMultipleSignatures 128 - blst-native 86.828 ms/op 89.210 ms/op 0.97
BLS verifyMultipleSignatures - same message - 3 - blst-native 1.3402 ms/op 1.3441 ms/op 1.00
BLS verifyMultipleSignatures - same message - 8 - blst-native 1.5133 ms/op 1.5066 ms/op 1.00
BLS verifyMultipleSignatures - same message - 32 - blst-native 2.3303 ms/op 2.4798 ms/op 0.94
BLS verifyMultipleSignatures - same message - 64 - blst-native 3.4155 ms/op 3.5145 ms/op 0.97
BLS verifyMultipleSignatures - same message - 128 - blst-native 5.6134 ms/op 6.4446 ms/op 0.87
BLS aggregatePubkeys 32 - blst-native 25.561 us/op 27.015 us/op 0.95
BLS aggregatePubkeys 128 - blst-native 101.17 us/op 100.93 us/op 1.00
getAttestationsForBlock 42.969 ms/op 42.159 ms/op 1.02
isKnown best case - 1 super set check 387.00 ns/op 382.00 ns/op 1.01
isKnown normal case - 2 super set checks 418.00 ns/op 297.00 ns/op 1.41
isKnown worse case - 16 super set checks 392.00 ns/op 282.00 ns/op 1.39
CheckpointStateCache - add get delete 6.1180 us/op 5.2380 us/op 1.17
validate api signedAggregateAndProof - struct 2.8325 ms/op 2.7886 ms/op 1.02
validate gossip signedAggregateAndProof - struct 2.8847 ms/op 2.7907 ms/op 1.03
validate gossip attestation - vc 640000 1.3924 ms/op 1.3942 ms/op 1.00
batch validate gossip attestation - vc 640000 - chunk 32 154.45 us/op 147.73 us/op 1.05
batch validate gossip attestation - vc 640000 - chunk 64 133.33 us/op 130.97 us/op 1.02
batch validate gossip attestation - vc 640000 - chunk 128 125.88 us/op 120.18 us/op 1.05
batch validate gossip attestation - vc 640000 - chunk 256 118.74 us/op 110.98 us/op 1.07
pickEth1Vote - no votes 1.3317 ms/op 1.1676 ms/op 1.14
pickEth1Vote - max votes 12.753 ms/op 9.5470 ms/op 1.34
pickEth1Vote - Eth1Data hashTreeRoot value x2048 9.8012 ms/op 8.8139 ms/op 1.11
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 17.368 ms/op 17.857 ms/op 0.97
pickEth1Vote - Eth1Data fastSerialize value x2048 665.61 us/op 646.49 us/op 1.03
pickEth1Vote - Eth1Data fastSerialize tree x2048 8.4902 ms/op 7.0495 ms/op 1.20
bytes32 toHexString 633.00 ns/op 580.00 ns/op 1.09
bytes32 Buffer.toString(hex) 319.00 ns/op 303.00 ns/op 1.05
bytes32 Buffer.toString(hex) from Uint8Array 557.00 ns/op 475.00 ns/op 1.17
bytes32 Buffer.toString(hex) + 0x 315.00 ns/op 295.00 ns/op 1.07
Object access 1 prop 0.18000 ns/op 0.18800 ns/op 0.96
Map access 1 prop 0.15000 ns/op 0.15600 ns/op 0.96
Object get x1000 7.1530 ns/op 7.9760 ns/op 0.90
Map get x1000 0.71100 ns/op 0.64900 ns/op 1.10
Object set x1000 69.758 ns/op 56.174 ns/op 1.24
Map set x1000 48.912 ns/op 41.980 ns/op 1.17
Return object 10000 times 0.26000 ns/op 0.25440 ns/op 1.02
Throw Error 10000 times 3.9881 us/op 3.8926 us/op 1.02
fastMsgIdFn sha256 / 200 bytes 3.4110 us/op 3.2820 us/op 1.04
fastMsgIdFn h32 xxhash / 200 bytes 286.00 ns/op 284.00 ns/op 1.01
fastMsgIdFn h64 xxhash / 200 bytes 354.00 ns/op 347.00 ns/op 1.02
fastMsgIdFn sha256 / 1000 bytes 11.624 us/op 11.307 us/op 1.03
fastMsgIdFn h32 xxhash / 1000 bytes 434.00 ns/op 411.00 ns/op 1.06
fastMsgIdFn h64 xxhash / 1000 bytes 440.00 ns/op 421.00 ns/op 1.05
fastMsgIdFn sha256 / 10000 bytes 105.46 us/op 103.45 us/op 1.02
fastMsgIdFn h32 xxhash / 10000 bytes 1.9820 us/op 1.9250 us/op 1.03
fastMsgIdFn h64 xxhash / 10000 bytes 1.3560 us/op 1.3200 us/op 1.03
enrSubnets - fastDeserialize 64 bits 1.5240 us/op 1.1840 us/op 1.29
enrSubnets - ssz BitVector 64 bits 534.00 ns/op 417.00 ns/op 1.28
enrSubnets - fastDeserialize 4 bits 187.00 ns/op 172.00 ns/op 1.09
enrSubnets - ssz BitVector 4 bits 436.00 ns/op 410.00 ns/op 1.06
prioritizePeers score -10:0 att 32-0.1 sync 2-0 116.45 us/op 99.993 us/op 1.16
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 137.58 us/op 132.77 us/op 1.04
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 182.92 us/op 181.56 us/op 1.01
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 305.46 us/op 312.34 us/op 0.98
prioritizePeers score 0:0 att 64-1 sync 4-1 343.66 us/op 361.50 us/op 0.95
array of 16000 items push then shift 1.6347 us/op 1.6635 us/op 0.98
LinkedList of 16000 items push then shift 9.0710 ns/op 9.0830 ns/op 1.00
array of 16000 items push then pop 95.870 ns/op 79.881 ns/op 1.20
LinkedList of 16000 items push then pop 8.9930 ns/op 8.8510 ns/op 1.02
array of 24000 items push then shift 2.5096 us/op 2.5386 us/op 0.99
LinkedList of 24000 items push then shift 9.4630 ns/op 9.1990 ns/op 1.03
array of 24000 items push then pop 132.33 ns/op 126.54 ns/op 1.05
LinkedList of 24000 items push then pop 8.9840 ns/op 8.6360 ns/op 1.04
intersect bitArray bitLen 8 6.9600 ns/op 6.7450 ns/op 1.03
intersect array and set length 8 57.972 ns/op 56.226 ns/op 1.03
intersect bitArray bitLen 128 32.746 ns/op 31.486 ns/op 1.04
intersect array and set length 128 1.0158 us/op 750.50 ns/op 1.35
bitArray.getTrueBitIndexes() bitLen 128 1.7550 us/op 1.6390 us/op 1.07
bitArray.getTrueBitIndexes() bitLen 248 3.0050 us/op 2.7500 us/op 1.09
bitArray.getTrueBitIndexes() bitLen 512 5.5800 us/op 5.8380 us/op 0.96
Buffer.concat 32 items 1.1040 us/op 1.0390 us/op 1.06
Uint8Array.set 32 items 2.2420 us/op 1.8020 us/op 1.24
Set add up to 64 items then delete first 4.7393 us/op 4.3582 us/op 1.09
OrderedSet add up to 64 items then delete first 6.0014 us/op 5.6215 us/op 1.07
Set add up to 64 items then delete last 5.1167 us/op 4.6990 us/op 1.09
OrderedSet add up to 64 items then delete last 6.9630 us/op 5.7545 us/op 1.21
Set add up to 64 items then delete middle 5.1576 us/op 4.5901 us/op 1.12
OrderedSet add up to 64 items then delete middle 8.1118 us/op 6.9749 us/op 1.16
Set add up to 128 items then delete first 10.347 us/op 9.2244 us/op 1.12
OrderedSet add up to 128 items then delete first 12.895 us/op 12.202 us/op 1.06
Set add up to 128 items then delete last 9.6776 us/op 9.0428 us/op 1.07
OrderedSet add up to 128 items then delete last 12.568 us/op 11.515 us/op 1.09
Set add up to 128 items then delete middle 10.054 us/op 8.9567 us/op 1.12
OrderedSet add up to 128 items then delete middle 18.354 us/op 16.913 us/op 1.09
Set add up to 256 items then delete first 20.009 us/op 18.899 us/op 1.06
OrderedSet add up to 256 items then delete first 24.055 us/op 24.872 us/op 0.97
Set add up to 256 items then delete last 19.220 us/op 18.327 us/op 1.05
OrderedSet add up to 256 items then delete last 25.772 us/op 23.234 us/op 1.11
Set add up to 256 items then delete middle 19.346 us/op 18.084 us/op 1.07
OrderedSet add up to 256 items then delete middle 48.606 us/op 45.981 us/op 1.06
transfer serialized Status (84 B) 1.8890 us/op 1.8090 us/op 1.04
copy serialized Status (84 B) 1.6300 us/op 1.5200 us/op 1.07
transfer serialized SignedVoluntaryExit (112 B) 1.9110 us/op 1.9240 us/op 0.99
copy serialized SignedVoluntaryExit (112 B) 1.6570 us/op 1.6820 us/op 0.99
transfer serialized ProposerSlashing (416 B) 2.0430 us/op 2.7480 us/op 0.74
copy serialized ProposerSlashing (416 B) 1.8410 us/op 2.5310 us/op 0.73
transfer serialized Attestation (485 B) 2.0360 us/op 2.7370 us/op 0.74
copy serialized Attestation (485 B) 1.9450 us/op 2.6410 us/op 0.74
transfer serialized AttesterSlashing (33232 B) 2.1670 us/op 2.7650 us/op 0.78
copy serialized AttesterSlashing (33232 B) 5.3150 us/op 5.6970 us/op 0.93
transfer serialized Small SignedBeaconBlock (128000 B) 2.4710 us/op 2.6890 us/op 0.92
copy serialized Small SignedBeaconBlock (128000 B) 15.917 us/op 13.205 us/op 1.21
transfer serialized Avg SignedBeaconBlock (200000 B) 3.1460 us/op 2.9310 us/op 1.07
copy serialized Avg SignedBeaconBlock (200000 B) 20.860 us/op 22.797 us/op 0.92
transfer serialized BlobsSidecar (524380 B) 3.0710 us/op 3.0430 us/op 1.01
copy serialized BlobsSidecar (524380 B) 190.28 us/op 134.35 us/op 1.42
transfer serialized Big SignedBeaconBlock (1000000 B) 3.4450 us/op 4.0250 us/op 0.86
copy serialized Big SignedBeaconBlock (1000000 B) 253.91 us/op 165.65 us/op 1.53
pass gossip attestations to forkchoice per slot 3.9014 ms/op 3.8549 ms/op 1.01
forkChoice updateHead vc 100000 bc 64 eq 0 685.14 us/op 679.51 us/op 1.01
forkChoice updateHead vc 600000 bc 64 eq 0 4.1776 ms/op 5.4238 ms/op 0.77
forkChoice updateHead vc 1000000 bc 64 eq 0 7.3081 ms/op 7.3579 ms/op 0.99
forkChoice updateHead vc 600000 bc 320 eq 0 4.3267 ms/op 4.3145 ms/op 1.00
forkChoice updateHead vc 600000 bc 1200 eq 0 7.2814 ms/op 4.4067 ms/op 1.65
forkChoice updateHead vc 600000 bc 7200 eq 0 5.8809 ms/op 6.0865 ms/op 0.97
forkChoice updateHead vc 600000 bc 64 eq 1000 11.526 ms/op 11.723 ms/op 0.98
forkChoice updateHead vc 600000 bc 64 eq 10000 12.471 ms/op 13.229 ms/op 0.94
forkChoice updateHead vc 600000 bc 64 eq 300000 17.387 ms/op 26.845 ms/op 0.65
computeDeltas 500000 validators 300 proto nodes 6.4095 ms/op 6.5191 ms/op 0.98
computeDeltas 500000 validators 1200 proto nodes 6.3638 ms/op 6.3002 ms/op 1.01
computeDeltas 500000 validators 7200 proto nodes 6.3546 ms/op 6.5688 ms/op 0.97
computeDeltas 750000 validators 300 proto nodes 9.5818 ms/op 9.4788 ms/op 1.01
computeDeltas 750000 validators 1200 proto nodes 9.7338 ms/op 9.4700 ms/op 1.03
computeDeltas 750000 validators 7200 proto nodes 9.6566 ms/op 9.6028 ms/op 1.01
computeDeltas 1400000 validators 300 proto nodes 18.045 ms/op 17.868 ms/op 1.01
computeDeltas 1400000 validators 1200 proto nodes 17.975 ms/op 17.949 ms/op 1.00
computeDeltas 1400000 validators 7200 proto nodes 18.680 ms/op 18.087 ms/op 1.03
computeDeltas 2100000 validators 300 proto nodes 27.273 ms/op 26.788 ms/op 1.02
computeDeltas 2100000 validators 1200 proto nodes 26.920 ms/op 26.425 ms/op 1.02
computeDeltas 2100000 validators 7200 proto nodes 26.502 ms/op 26.364 ms/op 1.01
computeProposerBoostScoreFromBalances 500000 validators 3.2403 ms/op 3.2142 ms/op 1.01
computeProposerBoostScoreFromBalances 750000 validators 3.2307 ms/op 3.2090 ms/op 1.01
computeProposerBoostScoreFromBalances 1400000 validators 3.2571 ms/op 3.2324 ms/op 1.01
computeProposerBoostScoreFromBalances 2100000 validators 3.2957 ms/op 3.2576 ms/op 1.01
altair processAttestation - 250000 vs - 7PWei normalcase 2.2357 ms/op 2.1239 ms/op 1.05
altair processAttestation - 250000 vs - 7PWei worstcase 3.3607 ms/op 3.0429 ms/op 1.10
altair processAttestation - setStatus - 1/6 committees join 185.60 us/op 129.49 us/op 1.43
altair processAttestation - setStatus - 1/3 committees join 357.42 us/op 253.89 us/op 1.41
altair processAttestation - setStatus - 1/2 committees join 473.24 us/op 338.66 us/op 1.40
altair processAttestation - setStatus - 2/3 committees join 600.12 us/op 436.42 us/op 1.38
altair processAttestation - setStatus - 4/5 committees join 800.96 us/op 599.47 us/op 1.34
altair processAttestation - setStatus - 100% committees join 939.89 us/op 732.20 us/op 1.28
altair processBlock - 250000 vs - 7PWei normalcase 10.735 ms/op 10.374 ms/op 1.03
altair processBlock - 250000 vs - 7PWei normalcase hashState 18.049 ms/op 16.829 ms/op 1.07
altair processBlock - 250000 vs - 7PWei worstcase 41.980 ms/op 38.913 ms/op 1.08
altair processBlock - 250000 vs - 7PWei worstcase hashState 60.289 ms/op 65.399 ms/op 0.92
phase0 processBlock - 250000 vs - 7PWei normalcase 2.5131 ms/op 2.9259 ms/op 0.86
phase0 processBlock - 250000 vs - 7PWei worstcase 33.163 ms/op 29.958 ms/op 1.11
altair processEth1Data - 250000 vs - 7PWei normalcase 635.66 us/op 463.41 us/op 1.37
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 28.898 us/op 14.984 us/op 1.93
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 71.725 us/op 87.176 us/op 0.82
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 28.218 us/op 17.604 us/op 1.60
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 20.963 us/op 15.273 us/op 1.37
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 238.98 us/op 213.18 us/op 1.12
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.7497 ms/op 2.3316 ms/op 0.75
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 3.0100 ms/op 2.8412 ms/op 1.06
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 2.4184 ms/op 2.7653 ms/op 0.87
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 8.5429 ms/op 2.9958 ms/op 2.85
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 4.8058 ms/op 2.3839 ms/op 2.02
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 8.0518 ms/op 4.9784 ms/op 1.62
Tree 40 250000 create 518.35 ms/op 318.76 ms/op 1.63
Tree 40 250000 get(125000) 216.29 ns/op 194.71 ns/op 1.11
Tree 40 250000 set(125000) 1.3881 us/op 908.75 ns/op 1.53
Tree 40 250000 toArray() 27.259 ms/op 17.139 ms/op 1.59
Tree 40 250000 iterate all - toArray() + loop 25.537 ms/op 17.253 ms/op 1.48
Tree 40 250000 iterate all - get(i) 78.548 ms/op 63.572 ms/op 1.24
MutableVector 250000 create 12.957 ms/op 17.949 ms/op 0.72
MutableVector 250000 get(125000) 7.7680 ns/op 6.3870 ns/op 1.22
MutableVector 250000 set(125000) 425.05 ns/op 226.50 ns/op 1.88
MutableVector 250000 toArray() 4.2364 ms/op 3.1712 ms/op 1.34
MutableVector 250000 iterate all - toArray() + loop 4.3291 ms/op 2.6060 ms/op 1.66
MutableVector 250000 iterate all - get(i) 1.6102 ms/op 1.4977 ms/op 1.08
Array 250000 create 4.1271 ms/op 2.7393 ms/op 1.51
Array 250000 clone - spread 1.4628 ms/op 1.0151 ms/op 1.44
Array 250000 get(125000) 0.87300 ns/op 0.49700 ns/op 1.76
Array 250000 set(125000) 1.0660 ns/op 0.57600 ns/op 1.85
Array 250000 iterate all - loop 90.426 us/op 81.962 us/op 1.10
effectiveBalanceIncrements clone Uint8Array 300000 57.778 us/op 23.894 us/op 2.42
effectiveBalanceIncrements clone MutableVector 300000 389.00 ns/op 275.00 ns/op 1.41
effectiveBalanceIncrements rw all Uint8Array 300000 184.15 us/op 177.44 us/op 1.04
effectiveBalanceIncrements rw all MutableVector 300000 156.44 ms/op 75.932 ms/op 2.06
phase0 afterProcessEpoch - 250000 vs - 7PWei 131.09 ms/op 113.19 ms/op 1.16
phase0 beforeProcessEpoch - 250000 vs - 7PWei 40.817 ms/op 41.193 ms/op 0.99
altair processEpoch - mainnet_e81889 349.08 ms/op 354.24 ms/op 0.99
mainnet_e81889 - altair beforeProcessEpoch 72.491 ms/op 64.624 ms/op 1.12
mainnet_e81889 - altair processJustificationAndFinalization 28.743 us/op 26.207 us/op 1.10
mainnet_e81889 - altair processInactivityUpdates 7.7049 ms/op 5.7830 ms/op 1.33
mainnet_e81889 - altair processRewardsAndPenalties 55.082 ms/op 73.790 ms/op 0.75
mainnet_e81889 - altair processRegistryUpdates 3.0880 us/op 3.6200 us/op 0.85
mainnet_e81889 - altair processSlashings 477.00 ns/op 1.0540 us/op 0.45
mainnet_e81889 - altair processEth1DataReset 752.00 ns/op 683.00 ns/op 1.10
mainnet_e81889 - altair processEffectiveBalanceUpdates 2.1861 ms/op 1.5791 ms/op 1.38
mainnet_e81889 - altair processSlashingsReset 7.4180 us/op 5.4320 us/op 1.37
mainnet_e81889 - altair processRandaoMixesReset 7.2060 us/op 8.5560 us/op 0.84
mainnet_e81889 - altair processHistoricalRootsUpdate 1.3770 us/op 1.0950 us/op 1.26
mainnet_e81889 - altair processParticipationFlagUpdates 5.3380 us/op 2.6230 us/op 2.04
mainnet_e81889 - altair processSyncCommitteeUpdates 1.2730 us/op 937.00 ns/op 1.36
mainnet_e81889 - altair afterProcessEpoch 151.81 ms/op 130.69 ms/op 1.16
capella processEpoch - mainnet_e217614 1.3079 s/op 1.1139 s/op 1.17
mainnet_e217614 - capella beforeProcessEpoch 325.15 ms/op 265.64 ms/op 1.22
mainnet_e217614 - capella processJustificationAndFinalization 27.346 us/op 15.174 us/op 1.80
mainnet_e217614 - capella processInactivityUpdates 18.549 ms/op 17.206 ms/op 1.08
mainnet_e217614 - capella processRewardsAndPenalties 302.36 ms/op 313.66 ms/op 0.96
mainnet_e217614 - capella processRegistryUpdates 25.899 us/op 22.219 us/op 1.17
mainnet_e217614 - capella processSlashings 910.00 ns/op 530.00 ns/op 1.72
mainnet_e217614 - capella processEth1DataReset 791.00 ns/op 615.00 ns/op 1.29
mainnet_e217614 - capella processEffectiveBalanceUpdates 5.6655 ms/op 4.1776 ms/op 1.36
mainnet_e217614 - capella processSlashingsReset 3.9120 us/op 2.3830 us/op 1.64
mainnet_e217614 - capella processRandaoMixesReset 11.635 us/op 4.1670 us/op 2.79
mainnet_e217614 - capella processHistoricalRootsUpdate 1.1340 us/op 620.00 ns/op 1.83
mainnet_e217614 - capella processParticipationFlagUpdates 3.0440 us/op 1.6130 us/op 1.89
mainnet_e217614 - capella afterProcessEpoch 333.40 ms/op 308.87 ms/op 1.08
phase0 processEpoch - mainnet_e58758 411.66 ms/op 337.50 ms/op 1.22
mainnet_e58758 - phase0 beforeProcessEpoch 171.54 ms/op 131.25 ms/op 1.31
mainnet_e58758 - phase0 processJustificationAndFinalization 28.900 us/op 15.887 us/op 1.82
mainnet_e58758 - phase0 processRewardsAndPenalties 53.650 ms/op 51.402 ms/op 1.04
mainnet_e58758 - phase0 processRegistryUpdates 20.232 us/op 9.9110 us/op 2.04
mainnet_e58758 - phase0 processSlashings 1.1060 us/op 527.00 ns/op 2.10
mainnet_e58758 - phase0 processEth1DataReset 901.00 ns/op 1.2070 us/op 0.75
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.8435 ms/op 1.2108 ms/op 1.52
mainnet_e58758 - phase0 processSlashingsReset 4.3480 us/op 2.4730 us/op 1.76
mainnet_e58758 - phase0 processRandaoMixesReset 11.210 us/op 4.6750 us/op 2.40
mainnet_e58758 - phase0 processHistoricalRootsUpdate 1.0090 us/op 511.00 ns/op 1.97
mainnet_e58758 - phase0 processParticipationRecordUpdates 8.1810 us/op 5.9660 us/op 1.37
mainnet_e58758 - phase0 afterProcessEpoch 135.90 ms/op 108.00 ms/op 1.26
phase0 processEffectiveBalanceUpdates - 250000 normalcase 2.0155 ms/op 1.5089 ms/op 1.34
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 2.7617 ms/op 2.3478 ms/op 1.18
altair processInactivityUpdates - 250000 normalcase 39.481 ms/op 21.269 ms/op 1.86
altair processInactivityUpdates - 250000 worstcase 30.382 ms/op 20.696 ms/op 1.47
phase0 processRegistryUpdates - 250000 normalcase 11.598 us/op 9.0470 us/op 1.28
phase0 processRegistryUpdates - 250000 badcase_full_deposits 397.66 us/op 404.13 us/op 0.98
phase0 processRegistryUpdates - 250000 worstcase 0.5 132.27 ms/op 132.33 ms/op 1.00
altair processRewardsAndPenalties - 250000 normalcase 70.170 ms/op 66.652 ms/op 1.05
altair processRewardsAndPenalties - 250000 worstcase 68.002 ms/op 59.786 ms/op 1.14
phase0 getAttestationDeltas - 250000 normalcase 8.4684 ms/op 8.3983 ms/op 1.01
phase0 getAttestationDeltas - 250000 worstcase 8.0213 ms/op 8.6012 ms/op 0.93
phase0 processSlashings - 250000 worstcase 2.4000 ms/op 2.3495 ms/op 1.02
altair processSyncCommitteeUpdates - 250000 158.33 ms/op 152.27 ms/op 1.04
BeaconState.hashTreeRoot - No change 264.00 ns/op 287.00 ns/op 0.92
BeaconState.hashTreeRoot - 1 full validator 51.412 us/op 50.504 us/op 1.02
BeaconState.hashTreeRoot - 32 full validator 554.68 us/op 600.25 us/op 0.92
BeaconState.hashTreeRoot - 512 full validator 6.1436 ms/op 6.2784 ms/op 0.98
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 64.299 us/op 69.361 us/op 0.93
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 953.09 us/op 953.56 us/op 1.00
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 12.230 ms/op 13.419 ms/op 0.91
BeaconState.hashTreeRoot - 1 balances 47.225 us/op 53.865 us/op 0.88
BeaconState.hashTreeRoot - 32 balances 434.26 us/op 501.56 us/op 0.87
BeaconState.hashTreeRoot - 512 balances 4.5223 ms/op 4.8260 ms/op 0.94
BeaconState.hashTreeRoot - 250000 balances 77.453 ms/op 79.082 ms/op 0.98
aggregationBits - 2048 els - zipIndexesInBitList 16.881 us/op 17.250 us/op 0.98
regular array get 100000 times 43.350 us/op 41.399 us/op 1.05
wrappedArray get 100000 times 40.372 us/op 33.986 us/op 1.19
arrayWithProxy get 100000 times 14.927 ms/op 14.488 ms/op 1.03
ssz.Root.equals 223.00 ns/op 246.00 ns/op 0.91
byteArrayEquals 228.00 ns/op 252.00 ns/op 0.90
shuffle list - 16384 els 7.1606 ms/op 7.1337 ms/op 1.00
shuffle list - 250000 els 105.03 ms/op 105.41 ms/op 1.00
processSlot - 1 slots 8.7530 us/op 8.4320 us/op 1.04
processSlot - 32 slots 1.3926 ms/op 1.3670 ms/op 1.02
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 51.763 ms/op 51.708 ms/op 1.00
getCommitteeAssignments - req 1 vs - 250000 vc 2.5141 ms/op 2.5396 ms/op 0.99
getCommitteeAssignments - req 100 vs - 250000 vc 3.7324 ms/op 3.8019 ms/op 0.98
getCommitteeAssignments - req 1000 vs - 250000 vc 4.0661 ms/op 4.1152 ms/op 0.99
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.8500 ns/op 5.0600 ns/op 0.96
state getBlockRootAtSlot - 250000 vs - 7PWei 643.86 ns/op 513.93 ns/op 1.25
computeProposers - vc 250000 9.1523 ms/op 8.8413 ms/op 1.04
computeEpochShuffling - vc 250000 105.61 ms/op 105.31 ms/op 1.00
getNextSyncCommittee - vc 250000 150.18 ms/op 157.39 ms/op 0.95
computeSigningRoot for AttestationData 12.914 us/op 13.758 us/op 0.94
hash AttestationData serialized data then Buffer.toString(base64) 2.3889 us/op 2.3649 us/op 1.01
toHexString serialized data 1.0751 us/op 1.1600 us/op 0.93
Buffer.toString(base64) 230.68 ns/op 236.03 ns/op 0.98

by benchmarkbot/action

@dapplion
Copy link
Contributor

The coloring increasing from left to right is strange. Should you add a rate() to the bucket metric?

@twoeths
Copy link
Contributor Author

twoeths commented Aug 28, 2023

@dapplion added rate() and it looks like

Screenshot 2023-08-28 at 15 29 54

@wemeetagain wemeetagain merged commit b34bbe3 into unstable Aug 29, 2023
10 of 11 checks passed
@wemeetagain wemeetagain deleted the tuyen/track_time_to_stable_mesh_in_grafana branch August 29, 2023 16:12
@wemeetagain
Copy link
Member

🎉 This PR is included in v1.12.0 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@wemeetagain wemeetagain wemeetagain approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add metric: time to stable mesh
3 participants
@twoeths @dapplion @wemeetagain