[opt](nereids)use SetPreAggStatus rule instead of AdjustPreAggStatus with join limited by starocean999 · Pull Request #48502 · apache/doris

starocean999 · 2025-03-01T02:36:51Z

The old AdjustPreAggStatus rule can't set preagg open if there is a join node under agg node. But in some senario, the preagg can be set to open as bellow:

agg (sum(t1.a),max(t2.a))
 |- join
      |- t1 PREAGG ON (The data produced by join has no impact on max(t2.a)）
      |- t2 PREAGG OFF(The data produced by join will make sum(t1.a) incorrect, so the preagg is set to off)

The new SetPreAggStatus rule is enhanced to handle such case

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2025-03-01T02:36:56Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

starocean999 · 2025-03-01T02:37:00Z

run buildall

doris-robot · 2025-03-01T04:23:13Z

TPC-H: Total hot run time: 31861 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b5d48bb59f43d172473bba54d2c3ddb4d56a07ed, data reload: false

------ Round 1 ----------------------------------
q1	17594	5261	5091	5091
q2	2061	301	177	177
q3	10488	1233	762	762
q4	10227	1035	557	557
q5	7633	2417	2328	2328
q6	201	171	135	135
q7	907	751	606	606
q8	9298	1353	1097	1097
q9	4865	4724	4870	4724
q10	6837	2310	1900	1900
q11	490	291	258	258
q12	361	358	225	225
q13	17756	3693	3136	3136
q14	228	229	206	206
q15	521	462	463	462
q16	632	611	582	582
q17	588	865	357	357
q18	6584	6336	6175	6175
q19	1722	952	553	553
q20	325	320	199	199
q21	2946	2184	2024	2024
q22	376	341	307	307
Total cold run time: 102640 ms
Total hot run time: 31861 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5174	5146	5138	5138
q2	237	329	235	235
q3	2145	2758	2283	2283
q4	1470	1870	1378	1378
q5	4278	4134	4112	4112
q6	203	167	127	127
q7	1865	1818	1714	1714
q8	2606	2519	2573	2519
q9	7184	7261	7227	7227
q10	3012	3203	2779	2779
q11	582	516	505	505
q12	700	771	631	631
q13	3540	3861	3381	3381
q14	276	304	273	273
q15	507	473	468	468
q16	649	694	632	632
q17	1154	1618	1320	1320
q18	7543	7477	7386	7386
q19	831	828	900	828
q20	1959	2066	1913	1913
q21	5593	5054	4794	4794
q22	616	583	561	561
Total cold run time: 52124 ms
Total hot run time: 50204 ms

doris-robot · 2025-03-01T04:35:20Z

TPC-DS: Total hot run time: 190880 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b5d48bb59f43d172473bba54d2c3ddb4d56a07ed, data reload: false

query1	1314	941	952	941
query2	6243	1890	1868	1868
query3	11052	4493	4418	4418
query4	54462	25432	23310	23310
query5	5109	610	470	470
query6	335	188	216	188
query7	4871	515	295	295
query8	321	255	237	237
query9	5547	2590	2552	2552
query10	435	313	258	258
query11	15393	15049	14884	14884
query12	166	110	105	105
query13	1039	545	387	387
query14	10398	6802	6795	6795
query15	197	196	204	196
query16	7165	700	509	509
query17	1092	736	545	545
query18	1566	412	303	303
query19	197	190	171	171
query20	137	128	124	124
query21	206	130	108	108
query22	4403	4348	4402	4348
query23	33979	33212	33344	33212
query24	5739	2428	2442	2428
query25	448	468	396	396
query26	734	279	167	167
query27	1908	502	325	325
query28	2837	2472	2432	2432
query29	587	559	434	434
query30	216	188	164	164
query31	866	899	827	827
query32	82	61	65	61
query33	483	360	317	317
query34	788	881	545	545
query35	831	839	793	793
query36	951	1015	902	902
query37	118	95	72	72
query38	4143	4136	4272	4136
query39	1464	1479	1439	1439
query40	215	118	102	102
query41	51	50	50	50
query42	128	109	107	107
query43	516	520	493	493
query44	1354	840	822	822
query45	178	172	162	162
query46	886	1057	668	668
query47	1864	1863	1846	1846
query48	386	426	309	309
query49	694	513	423	423
query50	721	744	435	435
query51	4277	4290	4216	4216
query52	119	114	106	106
query53	241	264	202	202
query54	515	521	420	420
query55	83	78	79	78
query56	268	284	267	267
query57	1170	1186	1152	1152
query58	249	255	247	247
query59	2777	2877	2784	2784
query60	290	269	260	260
query61	141	119	130	119
query62	724	742	662	662
query63	237	200	198	198
query64	1969	1029	694	694
query65	3301	3214	3221	3214
query66	754	399	296	296
query67	15891	15549	15220	15220
query68	6513	872	502	502
query69	535	300	267	267
query70	1217	1124	1042	1042
query71	459	285	265	265
query72	5750	3652	3856	3652
query73	1376	752	363	363
query74	8979	9159	9001	9001
query75	3580	3247	2682	2682
query76	4079	1167	730	730
query77	613	364	281	281
query78	10043	10179	9307	9307
query79	2500	824	596	596
query80	581	522	442	442
query81	513	288	242	242
query82	521	123	103	103
query83	179	173	149	149
query84	292	94	76	76
query85	760	343	305	305
query86	354	322	300	300
query87	4565	4425	4369	4369
query88	3589	2228	2214	2214
query89	403	325	275	275
query90	1767	189	191	189
query91	139	136	107	107
query92	72	62	58	58
query93	1920	1080	562	562
query94	722	404	294	294
query95	368	269	246	246
query96	482	566	269	269
query97	3287	3428	3293	3293
query98	225	215	200	200
query99	1292	1403	1285	1285
Total cold run time: 295496 ms
Total hot run time: 190880 ms

doris-robot · 2025-03-01T04:40:38Z

ClickBench: Total hot run time: 31.27 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b5d48bb59f43d172473bba54d2c3ddb4d56a07ed, data reload: false

query1	0.03	0.03	0.05
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.60	0.10	0.10
query5	0.57	0.54	0.57
query6	1.17	0.71	0.72
query7	0.02	0.01	0.02
query8	0.05	0.03	0.03
query9	0.59	0.54	0.51
query10	0.56	0.58	0.58
query11	0.15	0.11	0.10
query12	0.15	0.11	0.11
query13	0.62	0.61	0.60
query14	2.69	2.69	2.72
query15	0.94	0.84	0.85
query16	0.39	0.38	0.38
query17	0.99	1.04	1.05
query18	0.21	0.20	0.20
query19	1.92	1.80	1.96
query20	0.02	0.02	0.02
query21	15.36	0.92	0.56
query22	0.76	1.18	0.73
query23	14.84	1.37	0.61
query24	6.62	2.09	1.27
query25	0.53	0.26	0.06
query26	0.57	0.16	0.13
query27	0.04	0.05	0.04
query28	10.58	0.82	0.43
query29	12.62	3.96	3.30
query30	0.25	0.10	0.06
query31	2.82	0.63	0.40
query32	3.23	0.56	0.48
query33	3.07	3.02	3.03
query34	15.68	5.22	4.50
query35	4.52	4.47	4.55
query36	0.66	0.50	0.52
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.02	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.61 s
Total hot run time: 31.27 s

starocean999 · 2025-03-03T08:09:08Z

run buildall

doris-robot · 2025-03-03T08:27:41Z

TPC-H: Total hot run time: 30473 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 99575580fdcf55d7ba2b42f7de36fcc02c83dabc, data reload: false

------ Round 1 ----------------------------------
partsupp	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:44:20	NULL	utf-8	NULL	NULL	
region	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:24	NULL	utf-8	NULL	NULL	
revenue0	View	NULL	NULL	-1	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:24	NULL	NULL	utf-8	NULL	NULL	
supplier	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:25	NULL	utf-8	NULL	NULL	
============================================
q1	17632	5194	5085	5085
q2	q3	9987	1269	801	801
q4	10225	1017	531	531
q5	7552	2477	2317	2317
q6	194	177	132	132
q7	914	746	610	610
q8	9601	1287	1112	1112
q9	7108	4775	4771	4771
q10	6827	2313	1898	1898
q11	q12	336	336	219	219
q13	17766	3689	3141	3141
q14	227	226	230	226
q15	q16	662	600	606	600
q17	q18	6856	6310	6196	6196
q19	1260	959	565	565
q20	q21	3084	2281	1962	1962
q22	392	339	307	307
Total cold run time: 100623 ms
Total hot run time: 30473 ms

----- Round 2, with runtime_filter_mode=off -----
partsupp	Doris	NULL	NULL	80000000	56	4534120086	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:44:20	NULL	utf-8	NULL	NULL	
region	Doris	NULL	NULL	5	240	1201	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:24	NULL	utf-8	NULL	NULL	
revenue0	View	NULL	NULL	-1	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:24	NULL	NULL	utf-8	NULL	NULL	
supplier	Doris	NULL	NULL	1000000	87	87519212	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:25	NULL	utf-8	NULL	NULL	
============================================
q1	5172	5144	5482	5144
q2	q3	2169	2641	2302	2302
q4	1453	1836	1356	1356
q5	4204	4172	4123	4123
q6	217	169	130	130
q7	1979	1847	1675	1675
q8	2508	2484	2504	2484
q9	7302	7311	6852	6852
q10	3050	3232	2691	2691
q11	q12	679	695	592	592
q13	3502	4016	3424	3424
q14	272	285	271	271
q15	q16	648	659	667	659
q17	q18	7317	6976	6837	6837
q19	804	845	904	845
q20	q21	5140	4769	4625	4625
q22	610	581	556	556
Total cold run time: 47026 ms
Total hot run time: 44566 ms

doris-robot · 2025-03-03T08:32:03Z

TPC-DS: Total hot run time: 45834 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 99575580fdcf55d7ba2b42f7de36fcc02c83dabc, data reload: false

table_stats_health_threshold	90	90	0
test_query_cache_hit	none	none	0
time_zone	Asia/Shanghai	Asia/Shanghai	0
topn_filter_ratio	0.5	0.5	0
topn_opt_limit_threshold	1024	1024	0
trace_nereids	false	false	0
transaction_isolation	REPEATABLE-READ	REPEATABLE-READ	0
transaction_read_only	false	false	0
trim_tailing_spaces_for_external_table_query	false	false	0
truncate_char_or_varchar_columns	false	false	0
tx_isolation	REPEATABLE-READ	REPEATABLE-READ	0
tx_read_only	false	false	0
use_consistent_hash_for_external_scan	false	false	0
use_fix_replica	-1	-1	0
use_max_length_of_varchar_in_ctas	true	true	0
use_rf_default	false	false	0
use_v2_rollup	false	false	0
validate_password_policy	NONE	NONE	0
version	5.7.99	5.7.99	0
version_comment	Doris version doris-0.0.0--99575580fd	Doris version doris-0.0.0--99575580fd	0
wait_full_block_schedule_times	2	2	0
wait_timeout	28800	28800	0
workload_group			0
============================================
show table status;
Name	Engine	Version	Row_format	Rows	Avg_row_length	Data_length	Max_data_length	Index_length	Data_free	Auto_increment	Create_time	Update_time	Check_time	Collation	Checksum	Create_options	Comment
call_center	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:57	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
catalog_page	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
catalog_returns	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:57	2023-12-26 22:46:25	NULL	utf-8	NULL	NULL	
catalog_sales	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:57	2023-12-26 22:55:02	NULL	utf-8	NULL	NULL	
customer	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:44:00	2023-12-26 22:44:53	NULL	utf-8	NULL	NULL	
customer_address	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:41	NULL	utf-8	NULL	NULL	
customer_demographics	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:34	NULL	utf-8	NULL	NULL	
date_dim	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
dbgen_version	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:44:00	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
household_demographics	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
income_band	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
inventory	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:57	2023-12-26 22:50:32	NULL	utf-8	NULL	NULL	
item	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:05	NULL	utf-8	NULL	NULL	
promotion	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
reason	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
ship_mode	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:44:00	2023-12-26 22:44:05	NULL	utf-8	NULL	NULL	
store	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
store_returns	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:47:09	NULL	utf-8	NULL	NULL	
store_sales	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:59:20	NULL	utf-8	NULL	NULL	
time_dim	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:03	NULL	utf-8	NULL	NULL	
warehouse	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
web_page	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
web_returns	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:45:43	NULL	utf-8	NULL	NULL	
web_sales	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:53:25	NULL	utf-8	NULL	NULL	
web_site	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
============================================
query1	query2	query3	11211	4669	4713	4669
query4	query5	query6	query7	27772	1570	347	347
query8	query9	query10	1016	296	295	295
query11	query12	234	120	125	120
query13	4974	401	405	401
query14	query15	302	201	182	182
query16	9394	668	479	479
query17	2615	733	588	588
query18	2224	419	324	324
query19	538	192	162	162
query20	122	122	116	116
query21	225	126	101	101
query22	4628	4836	4687	4687
query23	query24	query25	759	435	408	408
query26	1249	246	170	170
query27	5503	507	329	329
query28	query29	913	528	447	447
query30	query31	query32	query33	query34	query35	898	877	767	767
query36	2516	1012	909	909
query37	131	100	91	91
query38	query39	query40	210	129	112	112
query41	74	66	76	66
query42	145	136	113	113
query43	545	563	503	503
query44	query45	204	184	188	184
query46	query47	query48	1174	474	317	317
query49	query50	6017	774	405	405
query51	query52	105	110	102	102
query53	234	254	190	190
query54	query55	93	92	88	88
query56	query57	query58	query59	query60	query61	query62	873	769	685	685
query63	374	257	190	190
query64	query65	query66	query67	15886	15542	15230	15230
query68	query69	507	292	281	281
query70	1220	1076	1158	1076
query71	query72	6410	3965	3537	3537
query73	query74	query75	query76	query77	query78	query79	query80	query81	query82	194	129	100	100
query83	query84	query85	1844	399	317	317
query86	486	316	287	287
query87	query88	query89	356	395	292	292
query90	query91	323	142	110	110
query92	query93	1171	1114	564	564
query94	2776	408	307	307
query95	query96	4709	600	269	269
query97	3292	3421	3406	3406
query98	243	214	216	214
query99	1371	1458	1297	1297
Total cold run time: 128060 ms
Total hot run time: 45834 ms

doris-robot · 2025-03-03T08:37:21Z

ClickBench: Total hot run time: 30.92 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 99575580fdcf55d7ba2b42f7de36fcc02c83dabc, data reload: false

query1	0.03	0.04	0.05
query2	0.08	0.04	0.03
query3	0.24	0.06	0.08
query4	1.61	0.10	0.10
query5	0.55	0.55	0.55
query6	1.19	0.72	0.73
query7	0.02	0.02	0.02
query8	0.04	0.02	0.04
query9	0.57	0.53	0.53
query10	0.59	0.57	0.57
query11	0.16	0.11	0.10
query12	0.14	0.11	0.12
query13	0.62	0.59	0.60
query14	2.67	2.70	2.71
query15	0.92	0.84	0.84
query16	0.38	0.37	0.37
query17	1.01	1.02	1.07
query18	0.21	0.20	0.19
query19	1.94	1.78	1.98
query20	0.02	0.02	0.01
query21	15.37	0.92	0.54
query22	0.74	1.46	0.81
query23	14.72	1.40	0.65
query24	6.42	2.63	0.73
query25	0.54	0.28	0.09
query26	0.55	0.16	0.14
query27	0.06	0.05	0.05
query28	9.78	0.90	0.43
query29	12.56	3.96	3.32
query30	0.26	0.09	0.06
query31	2.81	0.58	0.39
query32	3.23	0.56	0.47
query33	3.01	3.06	2.98
query34	15.83	5.17	4.53
query35	4.60	4.58	4.56
query36	0.67	0.50	0.50
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 104.61 s
Total hot run time: 30.92 s

starocean999 · 2025-03-03T08:49:48Z

run buildall

doris-robot · 2025-03-03T09:28:05Z

TPC-H: Total hot run time: 30510 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 753d8cd2fd10805acbe9f309fa1a46f400387be0, data reload: false

------ Round 1 ----------------------------------
partsupp	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:44:20	NULL	utf-8	NULL	NULL	
region	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:24	NULL	utf-8	NULL	NULL	
revenue0	View	NULL	NULL	-1	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:24	NULL	NULL	utf-8	NULL	NULL	
supplier	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:25	NULL	utf-8	NULL	NULL	
============================================
q1	17613	5213	5093	5093
q2	q3	10167	1221	780	780
q4	10285	1025	545	545
q5	8293	2364	2340	2340
q6	192	165	134	134
q7	893	752	602	602
q8	9609	1296	1072	1072
q9	6959	4871	4748	4748
q10	6842	2320	1883	1883
q11	q12	345	349	222	222
q13	17782	3702	3059	3059
q14	230	227	221	221
q15	q16	690	630	581	581
q17	q18	6956	6379	6300	6300
q19	1280	993	570	570
q20	q21	3191	2255	2045	2045
q22	379	344	315	315
Total cold run time: 101706 ms
Total hot run time: 30510 ms

----- Round 2, with runtime_filter_mode=off -----
partsupp	Doris	NULL	NULL	80000000	56	4534120086	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:44:20	NULL	utf-8	NULL	NULL	
region	Doris	NULL	NULL	5	240	1201	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:24	NULL	utf-8	NULL	NULL	
revenue0	View	NULL	NULL	-1	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:24	NULL	NULL	utf-8	NULL	NULL	
supplier	Doris	NULL	NULL	1000000	87	87519212	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:25	NULL	utf-8	NULL	NULL	
============================================
q1	5133	5121	5083	5083
q2	q3	2169	2635	2274	2274
q4	1405	1815	1382	1382
q5	4238	4183	4092	4092
q6	207	165	129	129
q7	1962	1846	1647	1647
q8	2491	2380	2608	2380
q9	7264	7265	7236	7236
q10	3028	3210	2773	2773
q11	q12	685	771	642	642
q13	3613	3841	3190	3190
q14	284	286	276	276
q15	q16	647	704	664	664
q17	q18	7576	7410	7316	7316
q19	828	879	895	879
q20	q21	5534	4957	4919	4919
q22	662	619	576	576
Total cold run time: 47726 ms
Total hot run time: 45458 ms

doris-robot · 2025-03-03T09:32:54Z

TPC-DS: Total hot run time: 56958 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 753d8cd2fd10805acbe9f309fa1a46f400387be0, data reload: false

use_consistent_hash_for_external_scan	false	false	0
use_fix_replica	-1	-1	0
use_max_length_of_varchar_in_ctas	true	true	0
use_rf_default	false	false	0
use_v2_rollup	false	false	0
validate_password_policy	NONE	NONE	0
version	5.7.99	5.7.99	0
version_comment	Doris version doris-0.0.0--0eb5d05591	Doris version doris-0.0.0--0eb5d05591	0
wait_full_block_schedule_times	2	2	0
wait_timeout	28800	28800	0
workload_group			0
============================================
show table status;
Name	Engine	Version	Row_format	Rows	Avg_row_length	Data_length	Max_data_length	Index_length	Data_free	Auto_increment	Create_time	Update_time	Check_time	Collation	Checksum	Create_options	Comment
call_center	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:57	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
catalog_page	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
catalog_returns	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:57	2023-12-26 22:46:25	NULL	utf-8	NULL	NULL	
catalog_sales	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:57	2023-12-26 22:55:02	NULL	utf-8	NULL	NULL	
customer	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:44:00	2023-12-26 22:44:53	NULL	utf-8	NULL	NULL	
customer_address	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:41	NULL	utf-8	NULL	NULL	
customer_demographics	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:34	NULL	utf-8	NULL	NULL	
date_dim	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
dbgen_version	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:44:00	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
household_demographics	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
income_band	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
inventory	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:57	2023-12-26 22:50:32	NULL	utf-8	NULL	NULL	
item	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:05	NULL	utf-8	NULL	NULL	
promotion	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
reason	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
ship_mode	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:44:00	2023-12-26 22:44:05	NULL	utf-8	NULL	NULL	
store	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
store_returns	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:47:09	NULL	utf-8	NULL	NULL	
store_sales	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:59:20	NULL	utf-8	NULL	NULL	
time_dim	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:03	NULL	utf-8	NULL	NULL	
warehouse	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
web_page	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:59	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
web_returns	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:45:43	NULL	utf-8	NULL	NULL	
web_sales	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:53:25	NULL	utf-8	NULL	NULL	
web_site	Doris	NULL	NULL	0	0	0	NULL	NULL	NULL	NULL	2023-12-26 22:43:58	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
============================================
query1	query2	query3	11050	4540	4512	4512
query4	query5	query6	14783	227	198	198
query7	4287	334	309	309
query8	354	259	239	239
query9	query10	592	302	264	264
query11	query12	248	117	111	111
query13	4777	578	437	437
query14	query15	302	219	195	195
query16	9408	651	478	478
query17	2741	761	580	580
query18	2241	460	328	328
query19	555	203	166	166
query20	125	120	123	120
query21	222	125	105	105
query22	4222	4092	4079	4079
query23	query24	query25	797	456	433	433
query26	1263	244	168	168
query27	6144	508	330	330
query28	query29	912	530	446	446
query30	query31	query32	query33	794	381	332	332
query34	query35	899	809	759	759
query36	2248	998	908	908
query37	125	97	80	80
query38	4181	4123	4110	4110
query39	query40	208	123	114	114
query41	72	61	60	60
query42	128	116	130	116
query43	618	575	496	496
query44	query45	209	190	173	173
query46	query47	query48	1237	471	324	324
query49	1958	557	472	472
query50	4537	768	411	411
query51	query52	101	103	99	99
query53	240	253	231	231
query54	2160	507	435	435
query55	91	82	84	82
query56	323	267	264	264
query57	query58	query59	query60	399	272	280	272
query61	query62	803	706	657	657
query63	371	236	184	184
query64	query65	query66	1374	406	312	312
query67	15435	15368	15344	15344
query68	query69	463	262	267	262
query70	1183	1129	1153	1129
query71	396	278	278	278
query72	5999	3457	3765	3457
query73	query74	query75	query76	query77	query78	query79	query80	1045	584	432	432
query81	query82	185	123	92	92
query83	query84	query85	1244	399	311	311
query86	446	320	293	293
query87	4524	4673	4409	4409
query88	query89	359	376	308	308
query90	query91	267	140	129	129
query92	query93	1476	1088	597	597
query94	2373	433	303	303
query95	query96	4109	662	277	277
query97	3343	3498	3394	3394
query98	229	210	205	205
query99	1338	1446	1349	1349
Total cold run time: 132513 ms
Total hot run time: 56958 ms

doris-robot · 2025-03-03T09:38:08Z

ClickBench: Total hot run time: 30.34 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 753d8cd2fd10805acbe9f309fa1a46f400387be0, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.05	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.55	0.54	0.56
query6	1.17	0.72	0.71
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.52	0.52
query10	0.57	0.57	0.57
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.60	0.60
query14	2.81	2.73	2.78
query15	0.91	0.84	0.85
query16	0.36	0.38	0.39
query17	1.01	1.01	1.00
query18	0.18	0.18	0.18
query19	1.92	1.78	1.94
query20	0.02	0.01	0.02
query21	15.36	0.89	0.54
query22	0.75	1.32	0.68
query23	14.79	1.39	0.63
query24	6.88	2.18	0.42
query25	0.52	0.23	0.11
query26	0.64	0.17	0.14
query27	0.04	0.04	0.05
query28	9.19	0.88	0.43
query29	12.57	3.99	3.31
query30	0.25	0.09	0.07
query31	2.82	0.60	0.39
query32	3.22	0.56	0.47
query33	3.00	3.00	3.02
query34	15.68	5.16	4.50
query35	4.55	4.54	4.45
query36	0.66	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.09	0.02	0.03
query42	0.04	0.02	0.02
query43	0.03	0.02	0.03
Total cold run time: 104.42 s
Total hot run time: 30.34 s

starocean999 · 2025-03-03T10:06:39Z

run buildall

doris-robot · 2025-03-03T10:25:39Z

TPC-H: Total hot run time: 31653 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 66c5a858081fa8f9239c763db38bd76d65d22838, data reload: false

------ Round 1 ----------------------------------
q1	17639	5225	5174	5174
q2	2047	302	166	166
q3	10407	1289	716	716
q4	10224	993	536	536
q5	7563	2427	2400	2400
q6	191	171	135	135
q7	917	748	597	597
q8	9305	1289	1109	1109
q9	5075	4616	4868	4616
q10	6839	2315	1896	1896
q11	480	268	261	261
q12	350	362	222	222
q13	17764	3657	3048	3048
q14	223	228	209	209
q15	506	458	452	452
q16	627	610	589	589
q17	583	864	361	361
q18	6592	6199	6268	6199
q19	1219	960	544	544
q20	314	323	192	192
q21	2846	2154	1933	1933
q22	364	338	298	298
Total cold run time: 102075 ms
Total hot run time: 31653 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5155	5185	5137	5137
q2	237	335	228	228
q3	2169	2685	2317	2317
q4	1411	1830	1378	1378
q5	4237	4102	4144	4102
q6	206	165	124	124
q7	1883	1844	1657	1657
q8	2662	2698	2545	2545
q9	7390	7153	7161	7153
q10	2983	3205	2828	2828
q11	575	520	496	496
q12	677	773	605	605
q13	3450	3894	3237	3237
q14	271	287	272	272
q15	509	472	461	461
q16	650	664	639	639
q17	1148	1586	1357	1357
q18	7597	7367	7262	7262
q19	815	878	1037	878
q20	1966	2001	1847	1847
q21	5422	4986	4686	4686
q22	619	583	587	583
Total cold run time: 52032 ms
Total hot run time: 49792 ms

doris-robot · 2025-03-03T10:37:04Z

TPC-DS: Total hot run time: 184860 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 66c5a858081fa8f9239c763db38bd76d65d22838, data reload: false

query1	969	384	386	384
query2	6535	1974	1950	1950
query3	6803	214	209	209
query4	25914	23612	23702	23612
query5	4332	662	491	491
query6	313	207	198	198
query7	4619	512	300	300
query8	299	249	241	241
query9	8608	2524	2516	2516
query10	486	329	278	278
query11	15302	15095	14843	14843
query12	156	115	106	106
query13	1675	528	395	395
query14	8719	6017	6682	6017
query15	216	195	179	179
query16	7147	643	461	461
query17	1057	691	542	542
query18	1934	393	286	286
query19	189	185	155	155
query20	118	113	117	113
query21	213	120	100	100
query22	4154	4210	4506	4210
query23	34341	33515	33285	33285
query24	7864	2394	2404	2394
query25	510	453	385	385
query26	1218	272	155	155
query27	2576	489	330	330
query28	4295	2395	2373	2373
query29	750	542	410	410
query30	234	189	153	153
query31	949	845	765	765
query32	74	62	61	61
query33	586	359	292	292
query34	800	846	508	508
query35	803	835	736	736
query36	952	999	894	894
query37	113	101	73	73
query38	4114	4268	4186	4186
query39	1445	1382	1416	1382
query40	205	116	104	104
query41	54	52	58	52
query42	126	104	101	101
query43	511	527	490	490
query44	1291	823	794	794
query45	179	168	155	155
query46	865	1048	650	650
query47	1789	1786	1747	1747
query48	385	440	292	292
query49	798	495	462	462
query50	683	732	428	428
query51	4157	4198	4120	4120
query52	113	103	96	96
query53	229	255	186	186
query54	484	500	416	416
query55	82	79	78	78
query56	284	268	249	249
query57	1148	1154	1054	1054
query58	253	240	241	240
query59	2777	2793	2957	2793
query60	279	288	291	288
query61	128	127	122	122
query62	806	706	658	658
query63	230	195	186	186
query64	4360	1010	667	667
query65	3171	3157	3122	3122
query66	1137	403	296	296
query67	15733	15327	15280	15280
query68	7351	872	507	507
query69	485	304	272	272
query70	1166	1130	1148	1130
query71	398	295	274	274
query72	5554	3618	3758	3618
query73	749	732	356	356
query74	9134	9122	8852	8852
query75	3166	3210	2716	2716
query76	3178	1191	757	757
query77	462	387	281	281
query78	9876	10213	9350	9350
query79	1409	845	585	585
query80	588	543	452	452
query81	521	278	243	243
query82	199	127	94	94
query83	191	187	154	154
query84	273	96	76	76
query85	744	354	311	311
query86	413	307	286	286
query87	4413	4490	4426	4426
query88	2892	2231	2210	2210
query89	380	318	278	278
query90	1998	197	190	190
query91	139	145	114	114
query92	78	59	57	57
query93	1485	1060	572	572
query94	675	396	304	304
query95	360	258	256	256
query96	496	553	273	273
query97	3309	3353	3299	3299
query98	221	213	218	213
query99	1318	1400	1260	1260
Total cold run time: 267260 ms
Total hot run time: 184860 ms

doris-robot · 2025-03-03T10:42:22Z

ClickBench: Total hot run time: 31.38 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 66c5a858081fa8f9239c763db38bd76d65d22838, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.04
query3	0.23	0.07	0.06
query4	1.62	0.10	0.10
query5	0.55	0.55	0.54
query6	1.22	0.72	0.71
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.59	0.55	0.53
query10	0.57	0.57	0.58
query11	0.16	0.11	0.11
query12	0.14	0.11	0.13
query13	0.61	0.60	0.59
query14	2.80	2.78	2.69
query15	0.92	0.87	0.84
query16	0.38	0.40	0.38
query17	1.04	1.00	1.04
query18	0.21	0.19	0.19
query19	1.92	1.81	1.94
query20	0.02	0.02	0.01
query21	15.37	0.89	0.55
query22	0.75	1.09	0.62
query23	15.07	1.39	0.61
query24	6.58	1.71	1.36
query25	0.52	0.13	0.12
query26	0.62	0.16	0.15
query27	0.05	0.05	0.06
query28	9.72	0.88	0.44
query29	12.57	3.95	3.31
query30	0.24	0.09	0.07
query31	2.83	0.62	0.40
query32	3.23	0.55	0.47
query33	3.00	3.01	3.06
query34	15.70	5.16	4.53
query35	4.58	4.54	4.56
query36	0.68	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.15 s
Total hot run time: 31.38 s

starocean999 · 2025-03-03T12:48:40Z

run buildall

doris-robot · 2025-03-03T13:27:15Z

TPC-H: Total hot run time: 31476 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 641dfda306069700d7ec88cceb36ba4ef0e92273, data reload: false

------ Round 1 ----------------------------------
q1	17620	5438	5127	5127
q2	2042	305	174	174
q3	10418	1231	738	738
q4	10211	1040	539	539
q5	7524	2432	2277	2277
q6	187	165	132	132
q7	893	728	597	597
q8	9300	1237	1002	1002
q9	4846	4871	4717	4717
q10	6788	2311	1867	1867
q11	485	284	259	259
q12	353	365	219	219
q13	17783	3677	3074	3074
q14	225	225	205	205
q15	519	480	460	460
q16	620	635	592	592
q17	572	846	343	343
q18	6626	6168	6171	6168
q19	1209	939	553	553
q20	325	335	192	192
q21	2769	2134	1939	1939
q22	362	327	302	302
Total cold run time: 101677 ms
Total hot run time: 31476 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5102	5126	5055	5055
q2	234	334	230	230
q3	2141	2660	2267	2267
q4	1455	1851	1392	1392
q5	4208	4098	4131	4098
q6	206	161	123	123
q7	1873	1796	1639	1639
q8	2550	2648	2547	2547
q9	7161	7223	7223	7223
q10	2985	3196	2753	2753
q11	573	520	509	509
q12	714	761	636	636
q13	3556	3901	3299	3299
q14	283	292	272	272
q15	517	472	474	472
q16	635	675	644	644
q17	1121	1619	1312	1312
q18	7419	7393	7378	7378
q19	798	844	950	844
q20	1961	2004	1886	1886
q21	5505	4913	4825	4825
q22	661	591	517	517
Total cold run time: 51658 ms
Total hot run time: 49921 ms

doris-robot · 2025-03-03T13:39:22Z

TPC-DS: Total hot run time: 190613 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 641dfda306069700d7ec88cceb36ba4ef0e92273, data reload: false

query1	1318	961	929	929
query2	6223	1896	1844	1844
query3	11026	4473	4543	4473
query4	54218	24495	23205	23205
query5	5119	572	488	488
query6	331	197	191	191
query7	4884	507	302	302
query8	310	242	238	238
query9	5562	2556	2547	2547
query10	434	304	253	253
query11	15034	15051	14827	14827
query12	162	105	108	105
query13	1032	524	397	397
query14	10740	7204	7195	7195
query15	197	207	184	184
query16	7096	663	494	494
query17	1089	755	601	601
query18	1542	417	315	315
query19	212	202	171	171
query20	129	125	120	120
query21	217	125	110	110
query22	4278	4437	4408	4408
query23	33967	33449	33121	33121
query24	5717	2430	2437	2430
query25	437	472	408	408
query26	814	275	156	156
query27	2133	497	329	329
query28	2749	2489	2396	2396
query29	564	567	408	408
query30	218	192	158	158
query31	881	850	841	841
query32	78	64	62	62
query33	458	367	314	314
query34	754	875	531	531
query35	803	859	748	748
query36	946	1015	898	898
query37	112	95	68	68
query38	4177	4344	4349	4344
query39	1474	1428	1434	1428
query40	213	115	102	102
query41	50	52	48	48
query42	124	107	113	107
query43	529	510	472	472
query44	1317	861	804	804
query45	185	175	163	163
query46	868	1080	672	672
query47	1841	1885	1813	1813
query48	392	445	300	300
query49	735	502	407	407
query50	714	753	422	422
query51	4233	4381	4276	4276
query52	112	111	97	97
query53	234	262	189	189
query54	500	493	432	432
query55	86	89	79	79
query56	264	268	264	264
query57	1160	1154	1141	1141
query58	243	266	226	226
query59	2704	3000	2726	2726
query60	278	280	266	266
query61	121	149	114	114
query62	766	740	672	672
query63	235	191	188	188
query64	1976	1015	667	667
query65	3277	3209	3305	3209
query66	745	396	284	284
query67	15814	15591	15286	15286
query68	7466	870	513	513
query69	534	310	260	260
query70	1203	1146	1118	1118
query71	502	301	294	294
query72	5558	3548	3757	3548
query73	1475	736	347	347
query74	8910	8971	8644	8644
query75	3815	3125	2696	2696
query76	4130	1168	734	734
query77	635	375	275	275
query78	10035	10159	9200	9200
query79	2450	810	593	593
query80	624	572	436	436
query81	515	289	235	235
query82	677	129	98	98
query83	175	169	153	153
query84	285	97	70	70
query85	775	355	311	311
query86	392	313	311	311
query87	4429	4390	4333	4333
query88	3841	2211	2211	2211
query89	415	313	274	274
query90	1811	187	191	187
query91	137	140	112	112
query92	72	63	58	58
query93	1820	1049	572	572
query94	665	385	304	304
query95	343	265	263	263
query96	488	559	274	274
query97	3351	3408	3268	3268
query98	228	208	201	201
query99	1429	1425	1257	1257
Total cold run time: 296336 ms
Total hot run time: 190613 ms

doris-robot · 2025-03-03T13:44:38Z

ClickBench: Total hot run time: 30.3 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 641dfda306069700d7ec88cceb36ba4ef0e92273, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.63	0.10	0.11
query5	0.59	0.54	0.56
query6	1.20	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.51	0.53
query10	0.57	0.57	0.56
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.62	0.60	0.61
query14	2.68	2.68	2.72
query15	0.91	0.86	0.86
query16	0.38	0.38	0.36
query17	1.02	1.01	1.04
query18	0.22	0.19	0.19
query19	1.87	1.86	1.98
query20	0.01	0.01	0.01
query21	15.35	0.91	0.54
query22	0.74	1.26	0.63
query23	14.89	1.38	0.63
query24	7.29	1.82	0.47
query25	0.50	0.16	0.10
query26	0.64	0.16	0.13
query27	0.05	0.05	0.04
query28	8.63	0.83	0.44
query29	12.55	3.81	3.23
query30	0.26	0.10	0.06
query31	2.82	0.58	0.39
query32	3.23	0.55	0.46
query33	3.13	3.04	3.02
query34	15.75	5.06	4.45
query35	4.54	4.51	4.51
query36	0.68	0.51	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 104.51 s
Total hot run time: 30.3 s

starocean999 · 2025-03-07T08:11:38Z

run buildall

doris-robot · 2025-03-07T08:30:50Z

TPC-H: Total hot run time: 32930 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 137c8b7768c80fb04356f29de7440d0667274279, data reload: false

------ Round 1 ----------------------------------
q1	17610	5217	5115	5115
q2	2048	299	169	169
q3	10411	1343	754	754
q4	10221	1019	531	531
q5	7475	2479	2354	2354
q6	194	169	132	132
q7	884	744	601	601
q8	9302	1285	1111	1111
q9	4960	4927	4845	4845
q10	6819	2323	1924	1924
q11	489	275	269	269
q12	356	353	221	221
q13	17768	3693	3089	3089
q14	218	229	217	217
q15	528	482	475	475
q16	651	593	585	585
q17	597	866	349	349
q18	6834	6526	6459	6459
q19	1217	948	564	564
q20	314	332	194	194
q21	2989	2240	1985	1985
q22	1075	1014	987	987
Total cold run time: 102960 ms
Total hot run time: 32930 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5235	5137	5174	5137
q2	235	329	232	232
q3	2165	2662	2291	2291
q4	1409	1860	1350	1350
q5	4265	4141	4151	4141
q6	212	161	123	123
q7	1874	1970	1823	1823
q8	2615	2658	2582	2582
q9	7229	7198	7266	7198
q10	2990	3192	2750	2750
q11	560	508	498	498
q12	677	810	622	622
q13	3533	3844	3258	3258
q14	316	307	288	288
q15	526	481	489	481
q16	647	656	644	644
q17	1156	1602	1339	1339
q18	7776	7626	7502	7502
q19	859	883	996	883
q20	2068	2015	1897	1897
q21	5501	4873	4941	4873
q22	1128	1036	1004	1004
Total cold run time: 52976 ms
Total hot run time: 50916 ms

doris-robot · 2025-03-07T08:42:24Z

TPC-DS: Total hot run time: 185347 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 137c8b7768c80fb04356f29de7440d0667274279, data reload: false

query1	972	414	382	382
query2	6528	1969	1894	1894
query3	6790	220	215	215
query4	26846	23295	23394	23295
query5	4387	699	505	505
query6	316	217	201	201
query7	4611	506	298	298
query8	304	257	236	236
query9	8634	2526	2535	2526
query10	455	305	267	267
query11	15946	15149	15094	15094
query12	164	108	104	104
query13	1643	532	387	387
query14	9636	6317	6204	6204
query15	206	185	168	168
query16	7153	680	478	478
query17	1188	721	541	541
query18	1936	404	316	316
query19	201	192	163	163
query20	120	114	119	114
query21	211	126	109	109
query22	4224	4326	4028	4028
query23	34107	33080	32833	32833
query24	7727	2466	2489	2466
query25	556	501	436	436
query26	1242	282	164	164
query27	2232	492	337	337
query28	4007	2391	2381	2381
query29	816	575	454	454
query30	289	218	194	194
query31	949	851	776	776
query32	82	71	72	71
query33	629	360	313	313
query34	802	853	510	510
query35	801	805	761	761
query36	958	964	880	880
query37	121	97	78	78
query38	4236	4467	4053	4053
query39	1445	1394	1376	1376
query40	210	117	106	106
query41	54	53	53	53
query42	123	116	106	106
query43	515	516	498	498
query44	1300	796	790	790
query45	178	170	168	168
query46	871	1035	629	629
query47	1741	1792	1686	1686
query48	382	423	302	302
query49	790	497	426	426
query50	735	785	417	417
query51	4206	4211	4248	4211
query52	108	109	90	90
query53	239	267	189	189
query54	498	510	415	415
query55	86	78	81	78
query56	269	307	260	260
query57	1103	1166	1076	1076
query58	249	241	239	239
query59	2712	2662	2747	2662
query60	294	284	267	267
query61	122	123	119	119
query62	797	741	674	674
query63	236	191	196	191
query64	4404	1017	666	666
query65	4480	4358	4358	4358
query66	1155	414	338	338
query67	15622	15478	15207	15207
query68	8231	896	512	512
query69	469	304	277	277
query70	1217	1125	1044	1044
query71	457	289	268	268
query72	5394	3524	3851	3524
query73	779	724	339	339
query74	9408	9126	8685	8685
query75	3869	3192	2722	2722
query76	3721	1200	787	787
query77	799	413	283	283
query78	10021	10112	9262	9262
query79	3030	848	578	578
query80	718	540	467	467
query81	505	259	225	225
query82	702	131	95	95
query83	212	175	152	152
query84	294	94	73	73
query85	797	358	311	311
query86	392	305	293	293
query87	4539	4646	4428	4428
query88	3597	2271	2270	2270
query89	397	329	291	291
query90	1825	218	222	218
query91	149	145	112	112
query92	79	66	61	61
query93	1954	1076	601	601
query94	665	407	310	310
query95	371	273	268	268
query96	494	588	278	278
query97	3370	3432	3278	3278
query98	241	223	223	223
query99	1442	1420	1283	1283
Total cold run time: 277087 ms
Total hot run time: 185347 ms

doris-robot · 2025-03-07T08:47:42Z

ClickBench: Total hot run time: 31.09 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 137c8b7768c80fb04356f29de7440d0667274279, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.55	0.57	0.54
query6	1.19	0.73	0.72
query7	0.03	0.01	0.02
query8	0.05	0.03	0.03
query9	0.60	0.52	0.52
query10	0.57	0.60	0.58
query11	0.17	0.12	0.11
query12	0.14	0.12	0.11
query13	0.61	0.61	0.60
query14	2.82	2.79	2.82
query15	0.92	0.87	0.85
query16	0.38	0.38	0.38
query17	1.04	0.99	1.03
query18	0.21	0.19	0.20
query19	1.90	1.83	1.94
query20	0.02	0.02	0.01
query21	15.36	0.89	0.54
query22	0.77	1.18	0.64
query23	14.95	1.38	0.65
query24	6.96	1.22	0.90
query25	0.51	0.23	0.14
query26	0.57	0.16	0.13
query27	0.05	0.06	0.05
query28	9.68	0.90	0.44
query29	12.55	3.96	3.32
query30	0.24	0.09	0.07
query31	2.81	0.58	0.39
query32	3.23	0.55	0.46
query33	3.06	3.00	2.99
query34	15.76	5.15	4.53
query35	4.60	4.55	4.55
query36	0.66	0.50	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.12	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.4 s
Total hot run time: 31.09 s

…with join limited

starocean999 · 2025-05-12T10:52:51Z

run buildall

doris-robot · 2025-05-12T11:17:19Z

TPC-H: Total hot run time: 34001 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e932ac47687ef0b1e7380bcdbf6826baf344bbfe, data reload: false

------ Round 1 ----------------------------------
q1	26150	5518	5047	5047
q2	2114	287	189	189
q3	10449	1291	699	699
q4	10280	998	531	531
q5	9067	2525	2298	2298
q6	268	160	131	131
q7	933	775	607	607
q8	9305	1271	1008	1008
q9	7021	5227	5145	5145
q10	6868	2327	1886	1886
q11	496	298	274	274
q12	345	353	222	222
q13	17791	3651	3081	3081
q14	222	238	216	216
q15	532	486	488	486
q16	429	438	382	382
q17	614	872	386	386
q18	7559	7123	7132	7123
q19	1552	962	548	548
q20	348	341	233	233
q21	4188	3365	2531	2531
q22	1065	1016	978	978
Total cold run time: 117596 ms
Total hot run time: 34001 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5231	5104	5138	5104
q2	227	321	225	225
q3	2142	2665	2279	2279
q4	1323	1888	1501	1501
q5	4589	4424	4424	4424
q6	208	166	123	123
q7	1984	1907	1816	1816
q8	2576	2396	2525	2396
q9	7230	7241	7076	7076
q10	3018	3199	2754	2754
q11	586	517	504	504
q12	698	749	578	578
q13	3523	3981	3243	3243
q14	280	289	264	264
q15	527	485	471	471
q16	443	535	459	459
q17	1174	1597	1383	1383
q18	7780	7428	7453	7428
q19	782	760	808	760
q20	1982	2001	1859	1859
q21	5106	4689	4580	4580
q22	1087	1026	984	984
Total cold run time: 52496 ms
Total hot run time: 50211 ms

doris-robot · 2025-05-12T11:28:56Z

TPC-DS: Total hot run time: 186346 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e932ac47687ef0b1e7380bcdbf6826baf344bbfe, data reload: false

query1	1024	485	493	485
query2	6557	1811	1765	1765
query3	6747	231	225	225
query4	26145	23370	23335	23335
query5	4392	617	491	491
query6	311	221	214	214
query7	4645	493	308	308
query8	322	256	256	256
query9	8615	2666	2633	2633
query10	476	313	267	267
query11	15831	14989	14853	14853
query12	170	114	103	103
query13	1650	525	388	388
query14	10007	6241	6256	6241
query15	212	195	177	177
query16	7637	668	496	496
query17	1192	749	580	580
query18	2006	396	284	284
query19	188	179	159	159
query20	121	114	117	114
query21	218	125	103	103
query22	3958	4039	3941	3941
query23	34065	33042	33086	33042
query24	8370	2382	2379	2379
query25	522	492	414	414
query26	1244	272	165	165
query27	2741	500	345	345
query28	4340	2142	2134	2134
query29	762	577	451	451
query30	285	217	193	193
query31	963	857	773	773
query32	76	67	66	66
query33	592	376	321	321
query34	803	851	526	526
query35	787	812	732	732
query36	987	990	900	900
query37	114	100	85	85
query38	4171	4197	4117	4117
query39	1485	1421	1403	1403
query40	217	124	110	110
query41	64	59	59	59
query42	124	110	117	110
query43	502	512	488	488
query44	1311	837	840	837
query45	179	177	171	171
query46	875	1034	636	636
query47	1751	1779	1734	1734
query48	384	429	309	309
query49	781	563	422	422
query50	635	678	405	405
query51	4126	4142	4176	4142
query52	111	110	96	96
query53	227	252	182	182
query54	595	569	507	507
query55	87	83	84	83
query56	302	309	284	284
query57	1121	1147	1102	1102
query58	262	256	247	247
query59	2487	2629	2445	2445
query60	338	321	310	310
query61	127	127	121	121
query62	809	746	648	648
query63	218	189	185	185
query64	4298	997	665	665
query65	4382	4230	4290	4230
query66	1088	408	360	360
query67	15669	15739	15263	15263
query68	8814	877	524	524
query69	468	306	268	268
query70	1216	1133	1134	1133
query71	488	319	305	305
query72	5646	4660	4684	4660
query73	692	572	364	364
query74	9064	9096	8686	8686
query75	4233	3221	2752	2752
query76	3694	1189	750	750
query77	772	383	282	282
query78	10099	10181	9263	9263
query79	2564	817	586	586
query80	640	513	474	474
query81	494	258	223	223
query82	494	131	96	96
query83	278	246	235	235
query84	304	101	89	89
query85	873	352	309	309
query86	384	290	298	290
query87	4439	4515	4432	4432
query88	3386	2272	2271	2271
query89	389	317	279	279
query90	1852	206	205	205
query91	137	139	111	111
query92	76	69	57	57
query93	1794	924	576	576
query94	682	379	310	310
query95	378	287	287	287
query96	488	574	279	279
query97	3174	3267	3126	3126
query98	239	217	216	216
query99	1460	1413	1293	1293
Total cold run time: 277512 ms
Total hot run time: 186346 ms

doris-robot · 2025-05-12T11:34:06Z

ClickBench: Total hot run time: 29.12 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e932ac47687ef0b1e7380bcdbf6826baf344bbfe, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.25	0.19	0.19
query4	1.60	0.19	0.19
query5	0.60	0.58	0.59
query6	1.21	0.71	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.58	0.51	0.51
query10	0.58	0.57	0.57
query11	0.16	0.10	0.11
query12	0.16	0.12	0.11
query13	0.61	0.60	0.59
query14	0.79	0.80	0.82
query15	0.88	0.86	0.85
query16	0.39	0.39	0.39
query17	1.06	1.02	1.04
query18	0.22	0.21	0.21
query19	1.91	1.82	1.79
query20	0.01	0.01	0.02
query21	15.40	0.87	0.55
query22	0.74	1.27	0.95
query23	14.72	1.41	0.66
query24	7.25	1.68	0.41
query25	0.38	0.28	0.06
query26	0.64	0.17	0.13
query27	0.05	0.04	0.05
query28	8.94	0.94	0.47
query29	12.60	4.03	3.26
query30	0.26	0.09	0.07
query31	2.83	0.60	0.39
query32	3.22	0.56	0.47
query33	3.03	3.05	3.05
query34	15.79	5.15	4.49
query35	4.56	4.58	4.52
query36	0.68	0.50	0.48
query37	0.08	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.14	0.13
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 102.8 s
Total hot run time: 29.12 s

924060929 · 2025-05-13T09:33:37Z

good refactor, more clear

github-actions · 2025-05-13T09:42:38Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-05-13T09:42:40Z

PR approved by anyone and no changes requested.

…with join limited (apache#48502) The old AdjustPreAggStatus rule can't set preagg open if there is a join node under agg node. But in some senario, the preagg can be set to open as bellow: ``` agg (sum(t1.a),max(t2.a)) |- join |- t1 PREAGG ON (The data produced by join has no impact on max(t2.a)） |- t2 PREAGG OFF(The data produced by join will make sum(t1.a) incorrect, so the preagg is set to off) ``` The new SetPreAggStatus rule is enhanced to handle such case

…reAggStatus with join limited #48502 (#51947) pick from master #48502

starocean999 mentioned this pull request Mar 1, 2025

[opt](nereids)use SetPreAggStatus rule instead of AdjustPreAggStatus with join limited #48504

Closed

16 tasks

starocean999 force-pushed the master_0116 branch from b5d48bb to 9957558 Compare March 3, 2025 08:08

starocean999 force-pushed the master_0116 branch from 641dfda to 137c8b7 Compare March 7, 2025 08:11

starocean999 marked this pull request as ready for review March 7, 2025 11:34

morrySnow added the dev/2.1.x label Mar 20, 2025

starocean999 added 10 commits May 12, 2025 18:39

[opt](nereids)use SetPreAggStatus rule instead of AdjustPreAggStatus …

a41ed13

…with join limited

update code

fa07118

fix case

29f0e2b

fix case

2ad5c40

fix code

ef2584c

update code

29d95fa

update code

2e40ba5

fix failed ut

5ac126b

fix case

5fa9da9

update code

e932ac4

starocean999 force-pushed the master_0116 branch from 17fc521 to e932ac4 Compare May 12, 2025 10:52

morrySnow approved these changes May 13, 2025

View reviewed changes

924060929 approved these changes May 13, 2025

View reviewed changes

github-actions Bot added the approved Indicates a PR has been approved by one committer. label May 13, 2025

github-actions Bot added the reviewed label May 13, 2025

924060929 merged commit dd088eb into apache:master May 13, 2025

starocean999 mentioned this pull request Jun 19, 2025

branch-3.1:[opt](nereids)use SetPreAggStatus rule instead of AdjustPreAggStatus with join limited #48502 #51947

Merged

16 tasks

morrySnow pushed a commit that referenced this pull request Jun 19, 2025

branch-3.1: [opt](nereids)use SetPreAggStatus rule instead of AdjustP…

bc381f0

…reAggStatus with join limited #48502 (#51947) pick from master #48502

morrySnow added dev/3.1.0-merged and removed dev/3.1.x labels Jun 19, 2025

This was referenced Jul 1, 2026

[refactor](fe) Refactor SetPreAggStatus traversal to use per-scan context map instead of shared stack #65095

Closed

[refactor](fe) Create PreAggInfoContext top-down from aggregate instead of bottom-up from scan in SetPreAggStatus #65237

Open

Uh oh!

Conversation

starocean999 commented Mar 1, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Mar 1, 2025

Uh oh!

starocean999 commented Mar 1, 2025

Uh oh!

doris-robot commented Mar 1, 2025

Uh oh!

doris-robot commented Mar 1, 2025

Uh oh!

doris-robot commented Mar 1, 2025

Uh oh!

starocean999 commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

starocean999 commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

starocean999 commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

starocean999 commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

doris-robot commented Mar 3, 2025

Uh oh!

starocean999 commented Mar 7, 2025

Uh oh!

doris-robot commented Mar 7, 2025

Uh oh!

doris-robot commented Mar 7, 2025

Uh oh!

doris-robot commented Mar 7, 2025

Uh oh!

starocean999 commented May 12, 2025

Uh oh!

doris-robot commented May 12, 2025

Uh oh!

doris-robot commented May 12, 2025

Uh oh!

doris-robot commented May 12, 2025

Uh oh!

924060929 commented May 13, 2025

Uh oh!

github-actions Bot commented May 13, 2025

Uh oh!

github-actions Bot commented May 13, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

starocean999 commented Mar 1, 2025 •

edited

Loading