Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[chore](show partitions) show partitions print commit version #28274

Merged
merged 4 commits into from
Aug 7, 2024

Conversation

yujun777
Copy link
Collaborator

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.08 seconds
stream load tsv: 578 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.8 seconds inserted 10000000 Rows, about 347K ops/s
storage size: 17219690254 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit 5ec94cb307c2d231bf50b1973a10139d0c7a9be5, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4668	4419	4469	4419
q2	368	147	158	147
q3	1446	1269	1224	1224
q4	1122	902	907	902
q5	3102	3106	3144	3106
q6	247	128	124	124
q7	995	486	467	467
q8	2178	2203	2149	2149
q9	6654	6673	6707	6673
q10	3199	3265	3252	3252
q11	315	200	193	193
q12	350	205	203	203
q13	4557	3833	3797	3797
q14	247	216	207	207
q15	565	521	536	521
q16	449	382	383	382
q17	996	558	607	558
q18	7461	7102	7276	7102
q19	1515	1286	1449	1286
q20	520	324	292	292
q21	3115	2655	2656	2655
q22	347	277	285	277
Total cold run time: 44416 ms
Total hot run time: 39936 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4420	4401	4386	4386
q2	270	161	172	161
q3	3556	3528	3533	3528
q4	2374	2367	2368	2367
q5	5739	5732	5901	5732
q6	240	120	121	120
q7	2372	1927	1883	1883
q8	3510	3507	3511	3507
q9	9027	8938	8955	8938
q10	3903	4000	3977	3977
q11	499	388	378	378
q12	758	595	604	595
q13	4276	3588	3523	3523
q14	278	251	258	251
q15	566	511	517	511
q16	510	461	455	455
q17	1863	1836	1845	1836
q18	8659	8416	8294	8294
q19	1734	1747	1751	1747
q20	2256	1942	1932	1932
q21	6511	6136	6191	6136
q22	504	419	428	419
Total cold run time: 63825 ms
Total hot run time: 60676 ms

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit b8611aa829fb0ad09923c34223f0beee2cbc4e0b, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4703	4460	4474	4460
q2	359	148	163	148
q3	1462	1253	1259	1253
q4	1103	961	920	920
q5	3183	3179	3164	3164
q6	246	131	126	126
q7	988	495	475	475
q8	2299	2211	2181	2181
q9	6667	6672	6662	6662
q10	3321	3287	3254	3254
q11	327	206	195	195
q12	351	205	205	205
q13	4758	4052	3795	3795
q14	249	206	211	206
q15	576	540	522	522
q16	436	383	398	383
q17	1009	595	530	530
q18	7387	7638	6969	6969
q19	1535	1486	1358	1358
q20	577	311	322	311
q21	3040	2652	2648	2648
q22	349	284	294	284
Total cold run time: 44925 ms
Total hot run time: 40049 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4412	4402	4411	4402
q2	271	162	181	162
q3	3515	3499	3490	3490
q4	2374	2376	2369	2369
q5	5723	5733	5765	5733
q6	234	121	121	121
q7	2366	1902	1837	1837
q8	3510	3531	3525	3525
q9	9055	9009	9041	9009
q10	3923	4010	3987	3987
q11	503	386	366	366
q12	765	606	607	606
q13	4284	3569	3563	3563
q14	295	261	265	261
q15	572	523	518	518
q16	507	464	511	464
q17	1885	1855	1837	1837
q18	8533	8086	8182	8086
q19	1719	1778	1735	1735
q20	2259	1945	1937	1937
q21	6485	6133	6106	6106
q22	494	414	414	414
Total cold run time: 63684 ms
Total hot run time: 60528 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.48 seconds
stream load tsv: 578 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 67 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17222978854 Bytes

@yiguolei yiguolei force-pushed the show-partition-commit-version branch from b8611aa to 8e5d78c Compare December 12, 2023 13:31
@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit 8e5d78c12c5da890d5eb508762bba04a93e78556, data reload: false

run tpch-sf100 query with default conf and session variables
q1	51513	31818	31859	31818
q2	396	147	144	144
q3	1591	1296	1256	1256
q4	1119	908	887	887
q5	3214	3233	3226	3226
q6	275	143	143	143
q7	978	539	546	539
q8	2190	2219	2205	2205
q9	6985	6912	6855	6855
q10	3252	3301	3305	3301
q11	346	220	215	215
q12	349	207	208	207
q13	4579	3848	3815	3815
q14	429	319	322	319
q15	779	1303	1324	1303
q16	449	395	389	389
q17	1025	592	527	527
q18	7560	7475	7751	7475
q19	1529	1324	1431	1324
q20	954	311	283	283
q21	3111	2676	2696	2676
q22	356	289	283	283
Total cold run time: 92979 ms
Total hot run time: 69190 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	30818	31845	31813	31813
q2	284	169	178	169
q3	3706	3695	3621	3621
q4	2413	2395	2399	2395
q5	5845	5822	5824	5822
q6	240	138	134	134
q7	3071	3410	3365	3365
q8	3552	3556	3537	3537
q9	9274	9226	9222	9222
q10	3980	4071	4080	4071
q11	820	923	1345	923
q12	772	597	603	597
q13	4323	3581	3602	3581
q14	501	440	434	434
q15	1141	1330	1335	1330
q16	505	480	468	468
q17	1889	1873	1866	1866
q18	8805	8349	8259	8259
q19	1773	1781	1832	1781
q20	2942	2603	2774	2603
q21	6609	6253	6196	6196
q22	526	420	419	419
Total cold run time: 93789 ms
Total hot run time: 92606 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.62 seconds
stream load tsv: 592 seconds loaded 74807831229 Bytes, about 120 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 29.2 seconds inserted 10000000 Rows, about 342K ops/s
storage size: 17219589686 Bytes

@yujun777 yujun777 force-pushed the show-partition-commit-version branch from 8e5d78c to e3a09a8 Compare December 13, 2023 13:57
@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 43.55 seconds
stream load tsv: 590 seconds loaded 74807831229 Bytes, about 120 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 67 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17219570702 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit e3a09a8e3aadb333612548f0d0dad278b62885bd, data reload: false

run tpch-sf100 query with default conf and session variables
q1	50885	31847	31869	31847
q2	374	137	141	137
q3	1496	1224	1242	1224
q4	1113	917	903	903
q5	3175	3222	3184	3184
q6	264	137	153	137
q7	1026	503	477	477
q8	2137	2189	2198	2189
q9	6888	6872	6863	6863
q10	3222	3302	3287	3287
q11	337	213	215	213
q12	364	208	209	208
q13	4561	3774	3827	3774
q14	427	314	317	314
q15	792	1318	1343	1318
q16	442	392	381	381
q17	1013	581	540	540
q18	7370	7267	6820	6820
q19	1534	1487	1365	1365
q20	603	306	298	298
q21	3059	2657	2689	2657
q22	348	281	293	281
Total cold run time: 91430 ms
Total hot run time: 68417 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	30812	31888	31841	31841
q2	282	163	177	163
q3	3645	3604	3584	3584
q4	2419	2378	2366	2366
q5	5772	5751	5764	5751
q6	243	135	135	135
q7	3041	3415	3363	3363
q8	3551	3534	3556	3534
q9	9184	9217	9136	9136
q10	4015	4053	4058	4053
q11	831	885	1381	885
q12	770	591	598	591
q13	4315	3563	3600	3563
q14	469	456	458	456
q15	1152	1349	1341	1341
q16	508	472	449	449
q17	1875	1873	1847	1847
q18	8768	8621	8853	8621
q19	1774	1763	1773	1763
q20	2916	2601	2665	2601
q21	6519	6093	6122	6093
q22	507	426	421	421
Total cold run time: 93368 ms
Total hot run time: 92557 ms

@yujun777 yujun777 force-pushed the show-partition-commit-version branch from e3a09a8 to f6d1847 Compare December 18, 2023 02:26
@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit f6d1847675a67d33c06ef0947f69bcac40ca93b5, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4689	4433	4478	4433
q2	379	176	157	157
q3	1452	1225	1268	1225
q4	1108	924	920	920
q5	3166	3142	3158	3142
q6	247	129	128	128
q7	999	482	482	482
q8	2195	2225	2176	2176
q9	6685	6650	6656	6650
q10	3192	3269	3272	3269
q11	311	206	204	204
q12	348	217	206	206
q13	4534	3833	3781	3781
q14	246	213	210	210
q15	571	519	527	519
q16	446	383	391	383
q17	1002	632	503	503
q18	7270	6981	7030	6981
q19	1544	1406	1366	1366
q20	569	309	288	288
q21	3086	2652	2670	2652
q22	344	281	288	281
Total cold run time: 44383 ms
Total hot run time: 39956 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4357	4380	4392	4380
q2	264	163	171	163
q3	3541	3535	3521	3521
q4	2382	2373	2375	2373
q5	5721	5721	5748	5721
q6	240	119	122	119
q7	2369	1879	1891	1879
q8	3524	3517	3531	3517
q9	9025	8999	8986	8986
q10	3896	3979	3978	3978
q11	495	385	379	379
q12	767	598	599	598
q13	4281	3591	3585	3585
q14	285	262	243	243
q15	575	523	518	518
q16	535	455	462	455
q17	1891	1842	1850	1842
q18	8653	8097	8288	8097
q19	1739	1748	1759	1748
q20	2258	1955	1943	1943
q21	6539	6187	6160	6160
q22	507	419	419	419
Total cold run time: 63844 ms
Total hot run time: 60624 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.09 seconds
stream load tsv: 582 seconds loaded 74807831229 Bytes, about 122 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 67 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17219602950 Bytes

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.39 seconds
stream load tsv: 569 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.7 seconds inserted 10000000 Rows, about 348K ops/s
storage size: 17183650104 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit f6d1847675a67d33c06ef0947f69bcac40ca93b5, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4659	4425	4470	4425
q2	365	148	160	148
q3	1482	1267	1234	1234
q4	1123	894	903	894
q5	3158	3142	3167	3142
q6	255	128	131	128
q7	989	486	491	486
q8	2208	2203	2196	2196
q9	6719	6666	6640	6640
q10	3229	3281	3282	3281
q11	308	184	184	184
q12	349	206	209	206
q13	4586	3799	3784	3784
q14	241	210	209	209
q15	561	519	523	519
q16	435	397	388	388
q17	1005	585	574	574
q18	7155	6862	6882	6862
q19	1525	1368	1409	1368
q20	541	324	292	292
q21	3109	2630	2659	2630
q22	349	271	277	271
Total cold run time: 44351 ms
Total hot run time: 39861 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4353	4321	4320	4320
q2	267	164	174	164
q3	3531	3526	3517	3517
q4	2370	2358	2368	2358
q5	5731	5712	5725	5712
q6	243	124	123	123
q7	2379	1880	1893	1880
q8	3514	3520	3516	3516
q9	9058	9057	9018	9018
q10	3907	3992	3992	3992
q11	486	360	378	360
q12	780	601	608	601
q13	4283	3545	3568	3545
q14	276	247	257	247
q15	577	521	526	521
q16	512	436	462	436
q17	1866	1842	1831	1831
q18	8617	8238	8308	8238
q19	1723	1731	1758	1731
q20	2251	1944	1932	1932
q21	6606	6191	6166	6166
q22	506	411	415	411
Total cold run time: 63836 ms
Total hot run time: 60619 ms

dataroaring
dataroaring previously approved these changes Dec 21, 2023
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 21, 2023
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Copy link
Contributor

@deardeng deardeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yujun777 yujun777 force-pushed the show-partition-commit-version branch from f6d1847 to d365bc0 Compare December 21, 2023 04:26
@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.41 seconds
stream load tsv: 570 seconds loaded 74807831229 Bytes, about 125 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17189082696 Bytes

@yujun777
Copy link
Collaborator Author

yujun777 commented Aug 6, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41647 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1d509964a781a8bc3d68df541ea3c4c4046602a3, data reload: false

------ Round 1 ----------------------------------
q1	18004	4147	4113	4113
q2	2391	200	199	199
q3	10463	1310	1329	1310
q4	10178	816	946	816
q5	7658	2871	2951	2871
q6	225	137	139	137
q7	1037	620	646	620
q8	9438	1879	1916	1879
q9	8492	6553	6578	6553
q10	8735	3848	3873	3848
q11	421	256	246	246
q12	415	236	230	230
q13	17761	2953	2940	2940
q14	276	248	245	245
q15	519	474	489	474
q16	493	415	395	395
q17	951	932	923	923
q18	8014	7251	7264	7251
q19	1613	1206	1207	1206
q20	564	328	335	328
q21	5329	4774	4787	4774
q22	352	296	289	289
Total cold run time: 113329 ms
Total hot run time: 41647 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4068	4020	4028	4020
q2	324	220	227	220
q3	2962	2995	2984	2984
q4	1939	1873	1866	1866
q5	5244	5197	5215	5197
q6	217	130	136	130
q7	2048	1689	1698	1689
q8	3172	3246	3211	3211
q9	8303	8252	8246	8246
q10	3768	3883	3877	3877
q11	547	477	451	451
q12	706	550	538	538
q13	16674	2970	2967	2967
q14	282	254	250	250
q15	513	471	470	470
q16	439	404	386	386
q17	1858	1713	1678	1678
q18	7696	7402	7266	7266
q19	1769	1685	1691	1685
q20	1973	1737	1739	1737
q21	5507	5373	5303	5303
q22	533	454	456	454
Total cold run time: 70542 ms
Total hot run time: 54625 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 167591 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1d509964a781a8bc3d68df541ea3c4c4046602a3, data reload: false

query1	906	380	364	364
query2	6490	1755	1736	1736
query3	6683	212	222	212
query4	19991	17194	17437	17194
query5	4260	528	517	517
query6	283	171	158	158
query7	4605	299	300	299
query8	260	198	194	194
query9	8508	2397	2370	2370
query10	447	273	262	262
query11	10617	10124	10074	10074
query12	134	91	82	82
query13	1632	374	376	374
query14	9992	6702	6149	6149
query15	223	162	165	162
query16	7116	486	490	486
query17	939	557	545	545
query18	1907	305	281	281
query19	199	146	147	146
query20	93	82	87	82
query21	214	96	98	96
query22	4239	4047	4088	4047
query23	33594	32860	32799	32799
query24	10317	3059	3050	3050
query25	688	379	412	379
query26	1764	150	148	148
query27	2945	274	278	274
query28	6919	1982	1971	1971
query29	1340	409	404	404
query30	287	148	152	148
query31	944	752	751	751
query32	102	54	56	54
query33	710	315	328	315
query34	919	515	479	479
query35	845	742	720	720
query36	1004	884	856	856
query37	300	80	83	80
query38	2836	2761	2765	2761
query39	864	795	813	795
query40	285	112	112	112
query41	53	46	45	45
query42	127	104	105	104
query43	491	422	429	422
query44	1208	735	736	735
query45	208	175	182	175
query46	1083	822	779	779
query47	1793	1704	1726	1704
query48	365	292	294	292
query49	1175	428	428	428
query50	897	434	445	434
query51	6808	6715	6685	6685
query52	104	97	89	89
query53	262	185	183	183
query54	648	485	468	468
query55	80	75	77	75
query56	295	261	270	261
query57	1182	1062	1017	1017
query58	274	260	253	253
query59	2709	2269	2355	2269
query60	308	274	277	274
query61	101	97	101	97
query62	940	647	673	647
query63	218	190	188	188
query64	5929	1901	1884	1884
query65	3192	3087	3092	3087
query66	1434	337	333	333
query67	15415	14695	14669	14669
query68	4423	569	582	569
query69	437	327	294	294
query70	1092	1075	1098	1075
query71	423	283	293	283
query72	7288	2826	2481	2481
query73	773	324	329	324
query74	6018	5568	5569	5568
query75	3412	2711	2742	2711
query76	2418	1228	1284	1228
query77	445	330	328	328
query78	9478	9059	8873	8873
query79	2699	543	550	543
query80	1222	532	502	502
query81	558	228	225	225
query82	1043	134	129	129
query83	238	179	171	171
query84	265	81	78	78
query85	1387	328	305	305
query86	476	290	281	281
query87	3262	3063	3112	3063
query88	3906	2402	2417	2402
query89	390	299	286	286
query90	1807	192	198	192
query91	128	103	98	98
query92	66	51	50	50
query93	2005	625	623	623
query94	939	298	346	298
query95	385	270	269	269
query96	612	285	285	285
query97	3208	3075	3045	3045
query98	217	199	205	199
query99	1622	1326	1290	1290
Total cold run time: 266342 ms
Total hot run time: 167591 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.87 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1d509964a781a8bc3d68df541ea3c4c4046602a3, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.08	0.08
query5	0.49	0.48	0.48
query6	1.13	0.73	0.71
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.56	0.52	0.51
query10	0.56	0.57	0.57
query11	0.15	0.12	0.12
query12	0.15	0.13	0.12
query13	0.60	0.61	0.60
query14	0.78	0.80	0.79
query15	0.89	0.85	0.85
query16	0.35	0.36	0.35
query17	0.99	0.98	1.01
query18	0.22	0.24	0.22
query19	1.84	1.72	1.72
query20	0.01	0.01	0.01
query21	15.41	0.73	0.65
query22	4.35	7.82	1.15
query23	17.99	1.31	1.27
query24	2.24	0.22	0.22
query25	0.19	0.08	0.08
query26	0.32	0.21	0.22
query27	0.46	0.25	0.24
query28	13.16	1.00	0.97
query29	12.52	3.30	3.27
query30	0.25	0.07	0.06
query31	2.89	0.42	0.40
query32	3.24	0.49	0.48
query33	2.96	2.95	2.96
query34	15.39	4.29	4.28
query35	4.31	4.32	4.30
query36	0.66	0.49	0.46
query37	0.18	0.16	0.17
query38	0.17	0.14	0.15
query39	0.04	0.03	0.04
query40	0.17	0.13	0.13
query41	0.11	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.05
Total cold run time: 107.92 s
Total hot run time: 29.87 s

@yujun777
Copy link
Collaborator Author

yujun777 commented Aug 6, 2024

run p1

@yujun777
Copy link
Collaborator Author

yujun777 commented Aug 6, 2024

run cloud_p0

@yujun777
Copy link
Collaborator Author

yujun777 commented Aug 6, 2024

run cloud_p1

@@ -380,6 +380,9 @@ private List<Pair<List<Comparable>, TRow>> getPartitionInfosInrernal() throws An
trow.addToColumnValue(new TCell().setStringVal(FeConstants.null_string));
}

partitionInfo.add(partition.getCommittedVersion());
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the result of CloudPartition.getCommittedVersion()?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cloud partition no committed version, no real meaning, no changed

@yujun777
Copy link
Collaborator Author

yujun777 commented Aug 6, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41528 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c7586e6d46629d8647f3815ef87bda21ba819b2c, data reload: false

------ Round 1 ----------------------------------
q1	17615	4089	4048	4048
q2	2015	202	204	202
q3	10445	1308	1347	1308
q4	10159	873	945	873
q5	7662	2976	2952	2952
q6	221	136	138	136
q7	1052	613	623	613
q8	9443	1758	1907	1758
q9	8536	6625	6619	6619
q10	8747	3848	3832	3832
q11	427	251	253	251
q12	428	227	231	227
q13	17756	2921	2928	2921
q14	269	243	240	240
q15	526	486	484	484
q16	526	390	382	382
q17	965	940	922	922
q18	8040	7278	7192	7192
q19	1541	1222	1205	1205
q20	572	319	324	319
q21	5213	4763	4846	4763
q22	351	286	281	281
Total cold run time: 112509 ms
Total hot run time: 41528 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4052	3994	3992	3992
q2	331	227	224	224
q3	2998	3011	3149	3011
q4	1988	2022	2007	2007
q5	5650	5592	5592	5592
q6	223	133	133	133
q7	2221	1795	1889	1795
q8	3324	3338	3321	3321
q9	8686	8581	8810	8581
q10	3934	4057	3885	3885
q11	551	472	460	460
q12	764	609	600	600
q13	15059	3123	3104	3104
q14	317	274	289	274
q15	540	472	479	472
q16	461	429	437	429
q17	1754	1717	1737	1717
q18	8255	7749	7709	7709
q19	1700	1710	1705	1705
q20	2139	1847	1865	1847
q21	5813	5405	5239	5239
q22	565	471	462	462
Total cold run time: 71325 ms
Total hot run time: 56559 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 170181 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c7586e6d46629d8647f3815ef87bda21ba819b2c, data reload: false

query1	908	374	373	373
query2	6480	1680	1699	1680
query3	6676	208	220	208
query4	20427	17405	17205	17205
query5	3649	539	546	539
query6	278	189	166	166
query7	4598	302	298	298
query8	262	211	199	199
query9	8510	2369	2372	2369
query10	417	300	264	264
query11	10680	10028	10052	10028
query12	119	92	90	90
query13	1643	386	392	386
query14	10100	7202	6910	6910
query15	215	159	166	159
query16	6974	439	457	439
query17	966	597	566	566
query18	1889	291	293	291
query19	204	151	149	149
query20	102	91	92	91
query21	209	102	105	102
query22	4234	4114	4163	4114
query23	34170	33441	33643	33441
query24	9536	3129	3139	3129
query25	718	441	463	441
query26	1495	172	163	163
query27	3088	303	291	291
query28	7406	2039	2007	2007
query29	1141	472	479	472
query30	243	172	159	159
query31	977	800	791	791
query32	104	58	58	58
query33	726	348	352	348
query34	968	510	515	510
query35	865	788	775	775
query36	1053	913	910	910
query37	166	82	82	82
query38	2860	2766	2796	2766
query39	850	818	845	818
query40	268	121	120	120
query41	51	45	48	45
query42	130	100	101	100
query43	481	429	430	429
query44	1215	740	736	736
query45	210	181	185	181
query46	1092	832	794	794
query47	1822	1745	1732	1732
query48	376	303	300	300
query49	979	461	484	461
query50	918	450	444	444
query51	6765	6617	6570	6570
query52	103	90	96	90
query53	264	194	191	191
query54	653	467	476	467
query55	76	78	77	77
query56	287	266	283	266
query57	1210	996	1036	996
query58	275	282	286	282
query59	2592	2420	2514	2420
query60	299	273	280	273
query61	104	92	91	91
query62	905	662	634	634
query63	222	187	189	187
query64	5476	1928	1910	1910
query65	3193	3073	3110	3073
query66	1013	333	324	324
query67	15552	15009	14836	14836
query68	6650	586	578	578
query69	783	396	315	315
query70	1165	1098	1089	1089
query71	508	288	280	280
query72	8062	2658	2523	2523
query73	962	329	333	329
query74	6073	5692	5575	5575
query75	4180	2714	2719	2714
query76	5093	1278	1268	1268
query77	771	319	304	304
query78	9532	9095	8944	8944
query79	3419	527	535	527
query80	2037	522	519	519
query81	575	233	225	225
query82	745	141	138	138
query83	291	176	181	176
query84	265	87	82	82
query85	1460	318	312	312
query86	463	315	295	295
query87	3271	3160	3115	3115
query88	3569	2428	2426	2426
query89	405	306	288	288
query90	1972	205	199	199
query91	127	104	101	101
query92	65	52	52	52
query93	2777	626	630	626
query94	918	319	311	311
query95	386	277	274	274
query96	614	292	280	280
query97	3204	3066	3023	3023
query98	216	203	194	194
query99	1604	1299	1283	1283
Total cold run time: 274599 ms
Total hot run time: 170181 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.86 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c7586e6d46629d8647f3815ef87bda21ba819b2c, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.04	0.04
query3	0.22	0.04	0.04
query4	1.68	0.06	0.07
query5	0.48	0.48	0.49
query6	1.14	0.72	0.71
query7	0.02	0.02	0.01
query8	0.05	0.05	0.05
query9	0.56	0.53	0.52
query10	0.56	0.55	0.56
query11	0.16	0.12	0.12
query12	0.15	0.12	0.12
query13	0.61	0.61	0.60
query14	0.77	0.79	0.79
query15	0.94	0.88	0.86
query16	0.34	0.36	0.35
query17	1.00	0.98	0.98
query18	0.23	0.22	0.21
query19	1.82	1.78	1.76
query20	0.03	0.01	0.01
query21	15.41	0.75	0.67
query22	4.32	8.36	1.17
query23	17.82	1.34	1.32
query24	2.26	0.22	0.23
query25	0.19	0.08	0.08
query26	0.33	0.22	0.21
query27	0.46	0.23	0.23
query28	13.19	1.01	0.96
query29	12.55	3.30	3.26
query30	0.25	0.06	0.05
query31	2.85	0.41	0.39
query32	3.26	0.49	0.49
query33	2.95	2.96	2.93
query34	15.48	4.24	4.27
query35	4.28	4.28	4.27
query36	0.69	0.47	0.49
query37	0.19	0.17	0.17
query38	0.16	0.15	0.15
query39	0.04	0.03	0.03
query40	0.16	0.13	0.14
query41	0.10	0.04	0.05
query42	0.06	0.05	0.04
query43	0.05	0.05	0.04
Total cold run time: 107.93 s
Total hot run time: 29.86 s

@yujun777
Copy link
Collaborator Author

yujun777 commented Aug 6, 2024

run cloud_p1

@yujun777
Copy link
Collaborator Author

yujun777 commented Aug 6, 2024

run feut

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 7, 2024
Copy link
Contributor

github-actions bot commented Aug 7, 2024

PR approved by at least one committer and no changes requested.

@dataroaring dataroaring merged commit db5feaf into apache:master Aug 7, 2024
28 checks passed
dataroaring pushed a commit that referenced this pull request Aug 11, 2024
wyxxxcat pushed a commit to wyxxxcat/doris that referenced this pull request Aug 14, 2024
dataroaring pushed a commit that referenced this pull request Aug 16, 2024
yiguolei pushed a commit that referenced this pull request Sep 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants