Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature](analyze_cmd) add show-tablets-belong stmt for analyzing a batch of tablet-ids (#27994) #31255

Merged
merged 3 commits into from
Feb 22, 2024

Conversation

morningman
Copy link
Contributor

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@github-actions github-actions bot added area/nereids area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation. labels Feb 22, 2024
@morningman
Copy link
Contributor Author

run buildall

1 similar comment
@morningman
Copy link
Contributor Author

run buildall

@morningman
Copy link
Contributor Author

run buildall

@morningman
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49950 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e4444faabb3dd3445da733c3fd7d8f461d712a70, data reload: false

------ Round 1 ----------------------------------
q1	18019	4410	4347	4347
q2	2029	153	142	142
q3	10348	1907	1928	1907
q4	10098	1272	1339	1272
q5	8508	3983	4032	3983
q6	226	121	126	121
q7	2068	1599	1574	1574
q8	9371	2763	2737	2737
q9	10994	10634	10438	10438
q10	8663	3506	3500	3500
q11	422	249	236	236
q12	464	297	300	297
q13	18355	3966	4067	3966
q14	355	323	322	322
q15	513	461	449	449
q16	706	592	598	592
q17	1137	962	936	936
q18	7241	6788	6760	6760
q19	1704	1542	1558	1542
q20	514	311	326	311
q21	4446	4156	4133	4133
q22	508	414	385	385
Total cold run time: 116689 ms
Total hot run time: 49950 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4335	4316	4361	4316
q2	318	221	224	221
q3	4129	4141	4137	4137
q4	2751	2767	2757	2757
q5	7299	7210	7235	7210
q6	236	120	117	117
q7	3260	2841	2835	2835
q8	4356	4467	4469	4467
q9	17174	17023	17059	17023
q10	4247	4263	4274	4263
q11	752	681	691	681
q12	1019	845	834	834
q13	7091	3757	3757	3757
q14	455	428	431	428
q15	499	446	455	446
q16	768	694	698	694
q17	3803	3910	3811	3811
q18	8847	8862	8825	8825
q19	1720	1715	1656	1656
q20	2394	2177	2132	2132
q21	8480	8398	8424	8398
q22	1011	965	978	965
Total cold run time: 84944 ms
Total hot run time: 79973 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 202033 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e4444faabb3dd3445da733c3fd7d8f461d712a70, data reload: false

query1	914	387	382	382
query2	6541	2285	2128	2128
query3	6912	199	196	196
query4	20032	18087	18154	18087
query5	19735	6536	6536	6536
query6	287	211	223	211
query7	4167	305	297	297
query8	244	237	255	237
query9	3120	2712	2623	2623
query10	402	304	306	304
query11	11356	10722	10775	10722
query12	116	73	69	69
query13	5586	631	630	630
query14	17663	13345	13370	13345
query15	371	245	235	235
query16	6460	261	269	261
query17	1735	1469	888	888
query18	2295	407	402	402
query19	221	141	144	141
query20	74	80	75	75
query21	186	93	92	92
query22	5350	5133	5143	5133
query23	32645	31887	31930	31887
query24	6909	6552	6469	6469
query25	520	409	416	409
query26	535	158	159	158
query27	1912	291	285	285
query28	6032	2201	2175	2175
query29	3018	2674	2649	2649
query30	236	160	166	160
query31	920	692	705	692
query32	66	57	58	57
query33	387	237	237	237
query34	843	467	487	467
query35	1092	938	893	893
query36	1687	1270	1657	1270
query37	97	59	61	59
query38	3043	2936	2928	2928
query39	1386	1319	1332	1319
query40	219	101	93	93
query41	37	36	34	34
query42	84	77	87	77
query43	679	647	624	624
query44	1148	704	703	703
query45	240	227	230	227
query46	1277	976	1014	976
query47	2054	1739	1757	1739
query48	987	680	683	680
query49	613	374	359	359
query50	863	613	586	586
query51	4754	4680	4707	4680
query52	94	80	87	80
query53	435	317	325	317
query54	2660	2488	2475	2475
query55	88	80	79	79
query56	220	199	209	199
query57	1268	1115	1074	1074
query58	211	199	202	199
query59	3427	3246	3209	3209
query60	198	192	216	192
query61	80	83	81	81
query62	829	534	509	509
query63	473	331	327	327
query64	2503	1493	1380	1380
query65	3611	3597	3556	3556
query66	768	365	361	361
query67	16833	16178	15152	15152
query68	8506	623	659	623
query69	572	334	335	334
query70	2061	1670	1887	1670
query71	398	312	306	306
query72	6492	3398	3380	3380
query73	729	323	313	313
query74	6351	5823	5890	5823
query75	5191	3727	3696	3696
query76	5179	1135	1128	1128
query77	884	242	249	242
query78	12571	11949	11896	11896
query79	9062	640	636	636
query80	1247	382	389	382
query81	489	226	232	226
query82	1663	98	93	93
query83	173	129	134	129
query84	263	67	65	65
query85	881	273	270	270
query86	388	374	398	374
query87	3215	2969	2970	2969
query88	5057	2281	2303	2281
query89	384	280	274	274
query90	1922	208	204	204
query91	148	113	122	113
query92	60	47	50	47
query93	5340	567	519	519
query94	716	195	204	195
query95	1110	1049	1057	1049
query96	653	332	328	328
query97	6444	6374	6360	6360
query98	196	171	167	167
query99	2933	865	928	865
Total cold run time: 313026 ms
Total hot run time: 202033 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.86 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e4444faabb3dd3445da733c3fd7d8f461d712a70, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.24	0.05	0.04
query4	1.81	0.07	0.06
query5	0.52	0.52	0.52
query6	1.23	0.69	0.63
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.53	0.48	0.48
query10	0.55	0.53	0.53
query11	0.13	0.08	0.08
query12	0.12	0.10	0.10
query13	0.62	0.61	0.62
query14	0.77	0.79	0.79
query15	0.77	0.76	0.78
query16	0.37	0.37	0.37
query17	0.99	1.00	1.03
query18	0.23	0.26	0.25
query19	1.84	1.87	1.86
query20	0.02	0.00	0.00
query21	15.49	0.57	0.58
query22	2.05	2.60	1.77
query23	17.42	0.93	0.84
query24	4.37	1.00	4.71
query25	1.54	0.12	0.10
query26	0.28	0.14	0.12
query27	0.11	0.11	0.11
query28	6.50	0.75	0.75
query29	12.86	2.10	2.27
query30	0.59	0.56	0.52
query31	2.82	0.37	0.40
query32	3.38	0.49	0.49
query33	3.05	3.10	3.09
query34	15.26	4.81	4.82
query35	4.86	4.85	4.84
query36	1.09	1.02	1.00
query37	0.06	0.04	0.05
query38	0.03	0.03	0.02
query39	0.02	0.02	0.01
query40	0.17	0.15	0.13
query41	0.06	0.01	0.02
query42	0.02	0.01	0.02
query43	0.02	0.02	0.01
Total cold run time: 102.94 s
Total hot run time: 30.86 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit e4444faabb3dd3445da733c3fd7d8f461d712a70 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      33 seconds loaded 861443392 Bytes, about 24 MB/s
Insert into select:       21.9 seconds inserted 10000000 Rows, about 456K ops/s

@morningman morningman merged commit 762820d into apache:branch-2.0 Feb 22, 2024
24 of 26 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/nereids area/planner Issues or PRs related to the query planner kind/docs Categorizes issue or PR as related to documentation.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants