Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](mtmv)Mtmv support set both immediate and starttime #39573

Merged
merged 6 commits into from
Aug 29, 2024
Merged

[fix](mtmv)Mtmv support set both immediate and starttime #39573

merged 6 commits into from
Aug 29, 2024

Conversation

zddr
Copy link
Contributor

@zddr zddr commented Aug 19, 2024

extends: #36805

Previously, if the user set immediate execution, the current time would replace the user's set start time

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zddr
Copy link
Contributor Author

zddr commented Aug 19, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38511 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 221dd7da340631102534435ac9d45450de6d6aa5, data reload: false

------ Round 1 ----------------------------------
q1	17864	4356	4365	4356
q2	2040	226	210	210
q3	11565	971	1153	971
q4	10529	716	760	716
q5	7782	2826	2799	2799
q6	267	165	162	162
q7	1029	670	679	670
q8	9595	2086	2106	2086
q9	8793	6531	6528	6528
q10	7089	2222	2235	2222
q11	470	283	279	279
q12	439	263	266	263
q13	19103	3183	3168	3168
q14	315	264	268	264
q15	574	546	524	524
q16	527	447	429	429
q17	1007	705	788	705
q18	7452	6719	6869	6719
q19	6477	1065	1039	1039
q20	693	363	352	352
q21	3941	3039	3018	3018
q22	1145	1031	1039	1031
Total cold run time: 118696 ms
Total hot run time: 38511 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4586	4342	4304	4304
q2	418	324	317	317
q3	2852	2637	2797	2637
q4	2044	1703	1779	1703
q5	5618	5745	5569	5569
q6	242	153	167	153
q7	2126	1727	1773	1727
q8	3406	3497	3465	3465
q9	8758	8748	8738	8738
q10	3614	3362	3287	3287
q11	670	534	543	534
q12	846	659	665	659
q13	17100	3266	3032	3032
q14	317	306	305	305
q15	571	550	532	532
q16	526	481	503	481
q17	1886	1551	1551	1551
q18	8198	7758	7722	7722
q19	8771	1726	1756	1726
q20	2142	1895	1869	1869
q21	13492	5374	5350	5350
q22	1182	1105	1074	1074
Total cold run time: 89365 ms
Total hot run time: 56735 ms

@zddr
Copy link
Contributor Author

zddr commented Aug 20, 2024

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 20, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morrySnow
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 37755 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 54e93880b7427524d08d4412a3a97b1dd25dc268, data reload: false

------ Round 1 ----------------------------------
q1	17669	4363	4247	4247
q2	2020	179	179	179
q3	11770	987	1076	987
q4	10519	812	712	712
q5	7756	2811	2828	2811
q6	231	138	139	138
q7	960	611	588	588
q8	9360	2107	2068	2068
q9	7377	6550	6524	6524
q10	6998	2315	2288	2288
q11	443	236	235	235
q12	396	224	226	224
q13	17759	3036	3014	3014
q14	281	232	228	228
q15	514	488	493	488
q16	574	507	504	504
q17	976	675	584	584
q18	7317	6803	6934	6803
q19	1384	994	1010	994
q20	674	335	325	325
q21	3922	2822	2907	2822
q22	1093	992	1034	992
Total cold run time: 109993 ms
Total hot run time: 37755 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4385	4307	4306	4306
q2	387	279	267	267
q3	2850	2706	2729	2706
q4	1935	1703	1661	1661
q5	5560	5663	5678	5663
q6	236	137	137	137
q7	2290	1781	1866	1781
q8	3309	3421	3459	3421
q9	8854	8874	8979	8874
q10	3596	3431	3371	3371
q11	597	512	505	505
q12	857	704	705	704
q13	14737	3259	3233	3233
q14	327	306	281	281
q15	532	490	511	490
q16	602	593	569	569
q17	1823	1530	1559	1530
q18	8063	7933	7974	7933
q19	1753	1717	1403	1403
q20	2188	1903	1953	1903
q21	5846	5391	5415	5391
q22	1125	1038	1041	1038
Total cold run time: 71852 ms
Total hot run time: 57167 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193118 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 54e93880b7427524d08d4412a3a97b1dd25dc268, data reload: false

query1	1256	895	870	870
query2	6257	2067	1980	1980
query3	10624	4042	3844	3844
query4	59185	23997	23215	23215
query5	5478	504	502	502
query6	420	167	173	167
query7	5773	304	300	300
query8	284	210	209	209
query9	9025	2466	2473	2466
query10	499	274	268	268
query11	18310	14963	15233	14963
query12	162	107	116	107
query13	1591	385	388	385
query14	11237	7360	6903	6903
query15	251	177	179	177
query16	7622	498	494	494
query17	1160	609	585	585
query18	2061	296	289	289
query19	279	148	149	148
query20	122	114	118	114
query21	212	104	107	104
query22	4574	4493	4478	4478
query23	34438	33851	33326	33326
query24	5994	2908	2848	2848
query25	547	404	398	398
query26	695	163	162	162
query27	1776	295	295	295
query28	3849	2134	2114	2114
query29	721	429	437	429
query30	244	155	163	155
query31	941	736	773	736
query32	90	56	61	56
query33	459	298	293	293
query34	878	486	485	485
query35	822	730	708	708
query36	1047	954	926	926
query37	144	89	95	89
query38	4081	3875	3880	3875
query39	1436	1417	1401	1401
query40	205	119	118	118
query41	48	49	45	45
query42	120	102	101	101
query43	510	487	453	453
query44	1138	770	765	765
query45	197	168	170	168
query46	1098	774	767	767
query47	1906	1775	1795	1775
query48	387	302	310	302
query49	781	439	437	437
query50	833	435	430	430
query51	7150	7022	7025	7022
query52	103	88	93	88
query53	261	182	187	182
query54	590	476	467	467
query55	81	80	79	79
query56	303	259	274	259
query57	1189	1059	1082	1059
query58	235	231	245	231
query59	3077	2877	2864	2864
query60	311	284	292	284
query61	125	122	115	115
query62	756	671	667	667
query63	220	186	192	186
query64	2911	759	747	747
query65	3232	3174	3171	3171
query66	688	344	458	344
query67	15327	15344	15263	15263
query68	4510	581	568	568
query69	454	278	283	278
query70	1173	1079	1083	1079
query71	381	287	284	284
query72	6583	4010	4017	4010
query73	761	337	340	337
query74	9207	8831	8839	8831
query75	3394	2699	2756	2699
query76	2077	999	1024	999
query77	562	332	322	322
query78	10374	9123	9060	9060
query79	1661	547	540	540
query80	827	517	509	509
query81	560	237	242	237
query82	341	151	146	146
query83	243	152	152	152
query84	265	78	78	78
query85	876	289	320	289
query86	370	300	296	296
query87	4584	4262	4427	4262
query88	3998	2364	2358	2358
query89	384	289	289	289
query90	1989	203	199	199
query91	126	101	100	100
query92	62	51	52	51
query93	1325	537	540	537
query94	833	296	276	276
query95	357	266	258	258
query96	599	271	275	271
query97	3223	3087	3081	3081
query98	214	207	209	207
query99	1577	1277	1262	1262
Total cold run time: 312216 ms
Total hot run time: 193118 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.13 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 54e93880b7427524d08d4412a3a97b1dd25dc268, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.05	0.04
query3	0.22	0.05	0.05
query4	1.66	0.08	0.08
query5	0.55	0.49	0.50
query6	1.13	0.72	0.73
query7	0.02	0.02	0.01
query8	0.06	0.05	0.05
query9	0.55	0.50	0.50
query10	0.55	0.55	0.55
query11	0.15	0.12	0.11
query12	0.15	0.12	0.12
query13	0.62	0.59	0.58
query14	2.06	2.07	2.07
query15	0.86	0.82	0.84
query16	0.39	0.37	0.42
query17	1.00	1.01	0.98
query18	0.20	0.20	0.20
query19	1.96	1.81	1.83
query20	0.01	0.01	0.01
query21	15.39	0.68	0.67
query22	4.22	6.56	1.94
query23	18.31	1.42	1.33
query24	2.07	0.22	0.22
query25	0.16	0.08	0.09
query26	0.27	0.18	0.17
query27	0.09	0.07	0.08
query28	13.27	1.03	1.00
query29	12.62	3.31	3.32
query30	0.23	0.05	0.05
query31	2.88	0.41	0.40
query32	3.24	0.48	0.50
query33	2.96	3.00	3.01
query34	17.21	4.39	4.33
query35	4.46	4.49	4.40
query36	0.66	0.47	0.49
query37	0.19	0.16	0.16
query38	0.16	0.15	0.15
query39	0.04	0.04	0.04
query40	0.15	0.13	0.13
query41	0.09	0.06	0.05
query42	0.05	0.04	0.04
query43	0.05	0.04	0.04
Total cold run time: 111.04 s
Total hot run time: 32.13 s

@morrySnow morrySnow merged commit fb509ee into apache:master Aug 29, 2024
27 of 28 checks passed
zddr added a commit to zddr/incubator-doris that referenced this pull request Sep 5, 2024
@zddr
[fix](mtmv) Mtmv support set both immediate and starttime (apache#39573)
6c6bc73 
extends: apache#36805

Previously, if the user set immediate execution, the current time would
replace the user's set start time
@zddr zddr mentioned this pull request Sep 5, 2024
Merged
yiguolei pushed a commit that referenced this pull request Sep 9, 2024
@zddr
[fix](mtmv) Mtmv support set both immediate and starttime (#39573) (#…
ecb75c2 
…40418)

pick: #39573
dataroaring pushed a commit that referenced this pull request Sep 26, 2024
@zddr @dataroaring
[fix](mtmv) Mtmv support set both immediate and starttime (#39573)
7ef4c13 
extends: #36805

Previously, if the user set immediate execution, the current time would
replace the user's set start time
@gavinchou gavinchou mentioned this pull request Oct 13, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@CalvinKirs CalvinKirs CalvinKirs approved these changes

@morrySnow morrySnow morrySnow approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.7-merged dev/3.0.2-merged p0_b reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@zddr @doris-robot @morrySnow @CalvinKirs @yiguolei @dataroaring