Skip to content

[enhance](metric)add metrics for statistics/mtmv/sql cache/plan#55617

Merged
924060929 merged 11 commits intoapache:masterfrom
zddr:metrics
Sep 19, 2025
Merged

[enhance](metric)add metrics for statistics/mtmv/sql cache/plan#55617
924060929 merged 11 commits intoapache:masterfrom
zddr:metrics

Conversation

@zddr
Copy link
Copy Markdown
Contributor

@zddr zddr commented Sep 3, 2025 •
edited
Loading

What problem does this PR solve?

MTMV
doris_fe_async_materialized_view_num
doris_fe_async_materialized_view_num{trigger="COMMIT"}
doris_fe_async_materialized_view_num{trigger="SCHEDULE"}
doris_fe_async_materialized_view_num{trigger="MANUAL"}
doris_fe_async_materialized_view_num{partitionType="FOLLOW_BASE_TABLE"}
doris_fe_async_materialized_view_num{partitionType="EXPR"}
doris_fe_async_materialized_view_num{partitionType="SELF_MANAGE"}
doris_fe_async_materialized_view_num{method="COMPLETE"}
doris_fe_async_materialized_view_num{method="AUTO"}
doris_fe_async_materialized_view_task_duration_ms
doris_fe_async_materialized_view_task_success_num
doris_fe_async_materialized_view_task_failed_num
doris_fe_async_materialized_view_task_running_num
doris_fe_async_materialized_view_task_pending_num
doris_fe_async_materialized_view_task_skip_num
PLAN
doris_fe_plan_num
doris_fe_plan_parse_duration_ms
doris_fe_plan_analyze_duration_ms
doris_fe_plan_rewrite_duration_ms
doris_fe_plan_fold_const_by_be_duration_ms
doris_fe_plan_optimize_duration_ms
doris_fe_plan_translate_duration_ms
doris_fe_plan_init_scan_node_duration_ms
doris_fe_plan_finalize_scan_node_duration_ms
doris_fe_plan_create_scan_range_duration_ms
doris_fe_plan_distribute_duration_ms
doris_fe_plan_duration_ms
doris_fe_plan_external_catalog_meta_duration_ms
doris_fe_plan_external_tvf_init_duration_ms
doris_fe_plan_lock_tables_duration_ms
doris_fe_plan_partition_prune_duration_ms
doris_fe_plan_cloud_meta_duration_ms
doris_fe_plan_materialized_view_rewrite_duration_ms
statistics
doris_fe_statistics_unhealthy_table_rate
doris_fe_statistics_unhealthy_column_rate
doris_fe_statistics_unhealthy_table_num
doris_fe_statistics_unhealthy_column_num
doris_fe_statistics_succeed_analyze_job
doris_fe_statistics_failed_analyze_job
doris_fe_statistics_succeed_analyze_task
doris_fe_statistics_failed_analyze_task
doris_fe_statistics_invalid_stats
doris_fe_statistics_high_priority_queue_length
doris_fe_statistics_mid_priority_queue_length
doris_fe_statistics_low_priority_queue_length
doris_fe_statistics_very_low_priority_queue_length
doris_fe_statistics_not_analyzed_table_num
doris_fe_statistics_empty_table_num
sql cache
doris_fe_sql_cache_num
doris_fe_sql_cache_added
doris_fe_sql_cache_hit
doris_fe_sql_cache_total_search_times

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
enhanceadd metrics for statistics/mtmv/sql cache/plan

Release note

enhanceadd metrics for statistics/mtmv/sql cache/plan

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Copy Markdown
Contributor

Thearas commented Sep 3, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@zddr
Copy link
Copy Markdown
Contributor Author

zddr commented Sep 3, 2025

run buildall

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 3, 2025

FE UT Coverage Report

Increment line coverage 74.12% (252/340) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

TPC-H: Total hot run time: 34270 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c79c76a1d1a2e1abd40c7f28e0d2167599d1ac7e, data reload: false

------ Round 1 ----------------------------------
q1	17605	5312	5144	5144
q2	2004	326	228	228
q3	10250	1320	735	735
q4	10236	1087	532	532
q5	7524	2476	2343	2343
q6	189	172	140	140
q7	947	767	623	623
q8	9338	1334	1121	1121
q9	7029	5120	5105	5105
q10	6978	2409	1960	1960
q11	503	316	274	274
q12	376	353	237	237
q13	17799	3668	3067	3067
q14	250	256	231	231
q15	584	511	490	490
q16	427	436	395	395
q17	619	851	379	379
q18	7936	7076	7117	7076
q19	1109	972	589	589
q20	340	341	223	223
q21	3729	2607	2390	2390
q22	1055	1029	988	988
Total cold run time: 106827 ms
Total hot run time: 34270 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5211	5151	5194	5151
q2	250	334	232	232
q3	2197	2704	2323	2323
q4	1339	1794	1367	1367
q5	4284	4395	4263	4263
q6	209	168	127	127
q7	1933	1846	1687	1687
q8	2511	2451	2455	2451
q9	6810	6814	6844	6814
q10	2969	3160	2707	2707
q11	561	528	512	512
q12	665	752	602	602
q13	3252	3710	3139	3139
q14	293	297	266	266
q15	528	476	477	476
q16	442	478	443	443
q17	1166	1543	1344	1344
q18	7253	7090	7052	7052
q19	793	771	826	771
q20	1909	1982	1800	1800
q21	4723	4327	4336	4327
q22	1100	1032	1011	1011
Total cold run time: 50398 ms
Total hot run time: 48865 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

TPC-DS: Total hot run time: 187215 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c79c76a1d1a2e1abd40c7f28e0d2167599d1ac7e, data reload: false

query1	1046	442	444	442
query2	6548	1766	1755	1755
query3	6760	222	221	221
query4	26245	23908	22816	22816
query5	4835	667	523	523
query6	336	237	233	233
query7	4683	517	300	300
query8	306	247	257	247
query9	8662	2938	2951	2938
query10	525	353	306	306
query11	16046	15025	14762	14762
query12	179	118	114	114
query13	1672	571	439	439
query14	9606	5988	5939	5939
query15	216	194	181	181
query16	7588	686	483	483
query17	1172	744	611	611
query18	2035	433	338	338
query19	205	204	172	172
query20	134	142	129	129
query21	216	133	128	128
query22	4079	4599	4152	4152
query23	33730	33284	33005	33005
query24	8197	2464	2464	2464
query25	600	541	484	484
query26	1252	281	176	176
query27	2715	530	377	377
query28	4392	2320	2313	2313
query29	811	645	529	529
query30	310	219	196	196
query31	924	805	776	776
query32	94	81	81	81
query33	599	410	371	371
query34	835	860	542	542
query35	820	844	782	782
query36	981	1022	908	908
query37	132	121	92	92
query38	4169	4182	3981	3981
query39	1470	1462	1438	1438
query40	232	141	134	134
query41	65	62	59	59
query42	135	118	114	114
query43	499	510	475	475
query44	1413	876	868	868
query45	186	179	171	171
query46	866	1048	683	683
query47	1779	1801	1745	1745
query48	437	433	318	318
query49	752	521	423	423
query50	670	691	410	410
query51	4182	4195	4212	4195
query52	123	125	113	113
query53	257	270	202	202
query54	628	611	547	547
query55	94	91	88	88
query56	338	353	323	323
query57	1183	1191	1140	1140
query58	300	284	282	282
query59	2649	2745	2562	2562
query60	371	360	350	350
query61	161	161	153	153
query62	814	740	687	687
query63	235	206	199	199
query64	4431	1161	831	831
query65	4310	4226	4249	4226
query66	1137	443	353	353
query67	15554	15572	15068	15068
query68	8709	922	576	576
query69	491	330	295	295
query70	1246	1173	1115	1115
query71	586	350	329	329
query72	6055	5072	5504	5072
query73	786	723	365	365
query74	9313	9238	9032	9032
query75	4164	3111	2694	2694
query76	3671	1126	724	724
query77	823	410	329	329
query78	9775	9863	8848	8848
query79	1974	831	597	597
query80	640	582	524	524
query81	483	270	230	230
query82	459	145	111	111
query83	267	274	250	250
query84	258	121	88	88
query85	891	463	491	463
query86	393	323	294	294
query87	4299	4451	4171	4171
query88	3326	2196	2229	2196
query89	393	329	324	324
query90	1919	232	223	223
query91	170	170	129	129
query92	101	72	71	71
query93	1602	982	648	648
query94	688	430	327	327
query95	405	340	320	320
query96	495	567	278	278
query97	2669	2790	2617	2617
query98	253	227	219	219
query99	1394	1422	1293	1293
Total cold run time: 277624 ms
Total hot run time: 187215 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

ClickBench: Total hot run time: 32.77 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c79c76a1d1a2e1abd40c7f28e0d2167599d1ac7e, data reload: false

query1	0.05	0.04	0.05
query2	0.09	0.06	0.06
query3	0.25	0.08	0.08
query4	1.60	0.12	0.11
query5	0.44	0.43	0.42
query6	1.18	0.63	0.66
query7	0.03	0.04	0.03
query8	0.06	0.04	0.05
query9	0.61	0.53	0.53
query10	0.59	0.59	0.58
query11	0.18	0.11	0.11
query12	0.16	0.12	0.12
query13	0.63	0.63	0.62
query14	0.82	0.82	0.84
query15	0.87	0.87	0.86
query16	0.40	0.42	0.41
query17	1.06	1.04	1.04
query18	0.23	0.20	0.20
query19	1.97	1.84	1.88
query20	0.02	0.01	0.02
query21	15.52	0.96	0.59
query22	0.79	1.28	0.80
query23	14.75	1.39	0.62
query24	6.48	0.60	1.40
query25	0.49	0.23	0.18
query26	0.57	0.16	0.13
query27	0.06	0.05	0.05
query28	10.47	0.98	0.44
query29	12.56	3.93	3.24
query30	3.11	3.01	2.97
query31	2.83	0.58	0.38
query32	3.24	0.56	0.47
query33	3.13	3.10	3.15
query34	15.91	5.51	4.88
query35	4.90	4.91	4.99
query36	0.73	0.53	0.49
query37	0.11	0.08	0.07
query38	0.06	0.04	0.05
query39	0.03	0.03	0.03
query40	0.19	0.16	0.14
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 107.34 s
Total hot run time: 32.77 s

@zddr
Copy link
Copy Markdown
Contributor Author

zddr commented Sep 3, 2025

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

TPC-H: Total hot run time: 34474 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6b3fba05a25ca3c01bb06c8c8f6a77788a317585, data reload: false

------ Round 1 ----------------------------------
q1	17608	5236	5021	5021
q2	1987	319	246	246
q3	10239	1310	734	734
q4	10227	1036	551	551
q5	7508	2454	2390	2390
q6	181	171	136	136
q7	941	785	647	647
q8	9351	1444	1231	1231
q9	7102	5189	5224	5189
q10	6915	2418	1984	1984
q11	486	300	282	282
q12	353	349	224	224
q13	17793	3686	3060	3060
q14	248	249	215	215
q15	542	506	478	478
q16	454	433	385	385
q17	608	890	377	377
q18	7533	7239	7178	7178
q19	1109	964	585	585
q20	349	351	233	233
q21	3879	2571	2348	2348
q22	1071	1044	980	980
Total cold run time: 106484 ms
Total hot run time: 34474 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5143	5107	5151	5107
q2	267	336	221	221
q3	2191	2717	2320	2320
q4	1352	1774	1309	1309
q5	4267	4430	4217	4217
q6	205	168	125	125
q7	1900	1863	1687	1687
q8	2518	2479	2515	2479
q9	6937	6852	6893	6852
q10	2972	3137	2721	2721
q11	566	519	509	509
q12	666	738	567	567
q13	3264	3689	3137	3137
q14	270	288	260	260
q15	513	475	473	473
q16	431	471	422	422
q17	1160	1521	1342	1342
q18	7415	7119	7102	7102
q19	798	815	847	815
q20	1927	1956	1825	1825
q21	4813	4352	4263	4263
q22	1068	1036	1011	1011
Total cold run time: 50643 ms
Total hot run time: 48764 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

TPC-DS: Total hot run time: 187259 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6b3fba05a25ca3c01bb06c8c8f6a77788a317585, data reload: false

query1	1050	472	439	439
query2	6561	1748	1726	1726
query3	6751	235	223	223
query4	26264	23767	23192	23192
query5	4862	637	530	530
query6	343	240	237	237
query7	4668	528	298	298
query8	294	250	255	250
query9	8635	2935	2918	2918
query10	526	348	313	313
query11	15850	15406	14660	14660
query12	191	129	123	123
query13	1669	556	423	423
query14	9808	5885	5794	5794
query15	211	196	184	184
query16	7653	693	505	505
query17	1238	758	647	647
query18	2052	460	354	354
query19	236	209	181	181
query20	137	143	128	128
query21	217	135	115	115
query22	3997	4407	4100	4100
query23	33791	33271	33098	33098
query24	8160	2442	2433	2433
query25	610	539	497	497
query26	1254	304	247	247
query27	2621	528	388	388
query28	4374	2297	2276	2276
query29	766	597	489	489
query30	289	228	199	199
query31	914	789	734	734
query32	93	82	81	81
query33	555	429	363	363
query34	813	859	533	533
query35	842	849	764	764
query36	987	1052	937	937
query37	132	111	95	95
query38	4068	4138	3985	3985
query39	1488	1431	1467	1431
query40	230	145	131	131
query41	65	65	68	65
query42	138	117	117	117
query43	508	512	478	478
query44	1345	911	876	876
query45	185	177	171	171
query46	855	1027	659	659
query47	1779	1825	1740	1740
query48	396	440	334	334
query49	751	499	438	438
query50	651	696	408	408
query51	4429	4252	4102	4102
query52	120	117	105	105
query53	246	280	197	197
query54	625	598	554	554
query55	93	98	92	92
query56	344	368	327	327
query57	1204	1218	1145	1145
query58	316	289	280	280
query59	2604	2705	2673	2673
query60	358	352	370	352
query61	172	159	159	159
query62	848	731	684	684
query63	235	190	196	190
query64	4374	1182	852	852
query65	4311	4227	4167	4167
query66	1104	466	349	349
query67	15662	15284	15099	15099
query68	8922	936	583	583
query69	515	336	301	301
query70	1274	1106	1125	1106
query71	592	346	330	330
query72	5646	5288	5077	5077
query73	735	621	370	370
query74	8986	9131	8885	8885
query75	4207	3097	2684	2684
query76	3698	1185	745	745
query77	809	413	342	342
query78	9786	9677	8815	8815
query79	2738	860	599	599
query80	697	578	513	513
query81	503	263	233	233
query82	481	140	117	117
query83	294	255	246	246
query84	300	107	97	97
query85	930	475	439	439
query86	394	309	306	306
query87	4462	4336	4181	4181
query88	3474	2256	2222	2222
query89	386	322	299	299
query90	1919	238	228	228
query91	185	171	168	168
query92	91	81	73	73
query93	1868	1013	640	640
query94	706	429	317	317
query95	410	393	325	325
query96	486	580	282	282
query97	2663	2744	2586	2586
query98	271	223	222	222
query99	1437	1400	1294	1294
Total cold run time: 278783 ms
Total hot run time: 187259 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

ClickBench: Total hot run time: 32.96 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6b3fba05a25ca3c01bb06c8c8f6a77788a317585, data reload: false

query1	0.06	0.05	0.04
query2	0.10	0.06	0.05
query3	0.27	0.08	0.08
query4	1.60	0.12	0.12
query5	0.45	0.43	0.42
query6	1.16	0.66	0.66
query7	0.03	0.02	0.02
query8	0.05	0.04	0.05
query9	0.60	0.54	0.53
query10	0.58	0.58	0.58
query11	0.17	0.11	0.12
query12	0.15	0.12	0.12
query13	0.63	0.63	0.62
query14	0.79	0.83	0.85
query15	0.87	0.90	0.85
query16	0.40	0.41	0.39
query17	1.04	1.07	1.06
query18	0.21	0.23	0.20
query19	1.98	1.85	1.79
query20	0.02	0.01	0.01
query21	15.50	0.96	0.57
query22	0.77	1.15	0.66
query23	14.93	1.40	0.64
query24	6.71	2.18	1.04
query25	0.47	0.13	0.07
query26	0.64	0.16	0.14
query27	0.06	0.05	0.05
query28	10.02	0.93	0.42
query29	12.54	3.91	3.24
query30	3.07	3.02	2.95
query31	2.83	0.60	0.38
query32	3.25	0.55	0.49
query33	3.08	3.11	3.22
query34	16.05	5.47	4.94
query35	4.91	4.95	4.90
query36	0.71	0.51	0.49
query37	0.11	0.07	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.19	0.14	0.15
query41	0.09	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 107.28 s
Total hot run time: 32.96 s

@zddr
Copy link
Copy Markdown
Contributor Author

zddr commented Sep 3, 2025

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

TPC-H: Total hot run time: 33895 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ce3d45bc7e907e1b050a1b48b9637683d17acdfe, data reload: false

------ Round 1 ----------------------------------
q1	17588	5279	5029	5029
q2	1987	351	200	200
q3	10228	1279	725	725
q4	10237	1021	543	543
q5	7549	2357	2355	2355
q6	181	165	137	137
q7	940	747	624	624
q8	9361	1357	1121	1121
q9	6986	5116	5160	5116
q10	6942	2383	2000	2000
q11	489	309	281	281
q12	349	366	225	225
q13	17819	3727	3004	3004
q14	225	242	226	226
q15	568	515	484	484
q16	441	443	381	381
q17	593	849	365	365
q18	7430	7198	6946	6946
q19	1499	961	560	560
q20	335	341	223	223
q21	3818	3248	2361	2361
q22	1070	1043	989	989
Total cold run time: 106635 ms
Total hot run time: 33895 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5224	5123	5148	5123
q2	260	332	230	230
q3	2142	2693	2266	2266
q4	1327	1740	1324	1324
q5	4212	4253	4170	4170
q6	210	167	129	129
q7	1888	1862	1729	1729
q8	2467	2496	2401	2401
q9	6863	6748	6749	6748
q10	2949	3166	2746	2746
q11	566	502	503	502
q12	666	731	618	618
q13	3240	3670	3121	3121
q14	277	289	270	270
q15	521	485	478	478
q16	431	510	442	442
q17	1096	1405	1374	1374
q18	7289	7118	7000	7000
q19	791	797	851	797
q20	1889	1952	1788	1788
q21	4817	4343	4276	4276
q22	1089	1031	996	996
Total cold run time: 50214 ms
Total hot run time: 48528 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

TPC-DS: Total hot run time: 188271 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ce3d45bc7e907e1b050a1b48b9637683d17acdfe, data reload: false

query1	1073	445	421	421
query2	6588	1803	1693	1693
query3	6750	230	222	222
query4	25969	23851	23248	23248
query5	5118	657	509	509
query6	335	251	247	247
query7	4669	545	314	314
query8	324	258	255	255
query9	8669	2914	2915	2914
query10	505	372	297	297
query11	15921	15221	15162	15162
query12	186	121	127	121
query13	1676	573	423	423
query14	9638	5902	5869	5869
query15	219	208	173	173
query16	7670	639	485	485
query17	1179	767	623	623
query18	2046	438	327	327
query19	213	198	169	169
query20	132	129	121	121
query21	219	134	113	113
query22	4172	4444	4114	4114
query23	33848	33123	33495	33123
query24	8166	2479	2474	2474
query25	583	520	440	440
query26	1253	280	169	169
query27	2756	521	381	381
query28	4327	2297	2269	2269
query29	835	602	508	508
query30	301	229	201	201
query31	935	806	774	774
query32	90	84	82	82
query33	590	418	408	408
query34	814	849	543	543
query35	806	836	765	765
query36	957	1016	941	941
query37	129	114	95	95
query38	4059	4048	4006	4006
query39	1496	1434	1433	1433
query40	231	137	127	127
query41	67	62	66	62
query42	135	124	122	122
query43	498	521	472	472
query44	1391	884	871	871
query45	184	177	168	168
query46	867	1052	671	671
query47	1747	1827	1756	1756
query48	393	437	332	332
query49	741	544	426	426
query50	676	723	424	424
query51	4199	4248	4129	4129
query52	118	114	107	107
query53	269	275	204	204
query54	616	599	549	549
query55	96	88	97	88
query56	349	343	333	333
query57	1190	1183	1134	1134
query58	290	288	284	284
query59	2596	2709	2570	2570
query60	364	355	351	351
query61	159	156	155	155
query62	814	777	649	649
query63	241	211	210	210
query64	4598	1128	826	826
query65	4312	4227	4193	4193
query66	1091	449	382	382
query67	15683	15398	15132	15132
query68	7498	952	588	588
query69	502	331	303	303
query70	1253	1195	1134	1134
query71	519	377	334	334
query72	6097	5013	5062	5013
query73	704	688	366	366
query74	9035	9136	9092	9092
query75	3177	3145	2664	2664
query76	3224	1183	784	784
query77	508	441	344	344
query78	9606	9684	8948	8948
query79	2026	873	602	602
query80	745	580	547	547
query81	514	269	232	232
query82	203	142	112	112
query83	257	264	252	252
query84	258	107	96	96
query85	855	485	424	424
query86	385	322	312	312
query87	4281	4317	4225	4225
query88	2856	2268	2244	2244
query89	391	339	316	316
query90	1777	234	237	234
query91	165	163	137	137
query92	82	76	75	75
query93	1158	1014	649	649
query94	650	429	344	344
query95	413	344	376	344
query96	490	610	282	282
query97	2603	2688	2602	2602
query98	252	227	224	224
query99	1348	1445	1289	1289
Total cold run time: 272963 ms
Total hot run time: 188271 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 3, 2025

ClickBench: Total hot run time: 32.78 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ce3d45bc7e907e1b050a1b48b9637683d17acdfe, data reload: false

query1	0.06	0.04	0.05
query2	0.10	0.06	0.06
query3	0.26	0.10	0.09
query4	1.60	0.12	0.12
query5	0.48	0.42	0.43
query6	1.18	0.64	0.66
query7	0.03	0.02	0.02
query8	0.06	0.05	0.06
query9	0.61	0.53	0.52
query10	0.59	0.57	0.58
query11	0.17	0.11	0.12
query12	0.15	0.12	0.12
query13	0.62	0.64	0.62
query14	0.81	0.85	0.84
query15	0.87	0.86	0.86
query16	0.39	0.41	0.39
query17	1.07	1.07	1.03
query18	0.21	0.21	0.20
query19	1.94	1.85	1.80
query20	0.02	0.01	0.02
query21	15.39	0.98	0.59
query22	0.75	1.09	0.75
query23	15.03	1.41	0.64
query24	6.37	1.68	0.73
query25	0.48	0.18	0.15
query26	0.45	0.15	0.14
query27	0.08	0.05	0.05
query28	10.55	0.98	0.43
query29	12.70	3.89	3.25
query30	3.09	2.98	3.02
query31	2.82	0.60	0.39
query32	3.27	0.56	0.49
query33	3.03	3.09	3.19
query34	16.00	5.49	4.82
query35	4.88	4.88	4.94
query36	0.69	0.53	0.50
query37	0.10	0.07	0.07
query38	0.06	0.06	0.04
query39	0.04	0.03	0.03
query40	0.18	0.15	0.15
query41	0.08	0.04	0.03
query42	0.04	0.03	0.03
query43	0.05	0.04	0.04
Total cold run time: 107.35 s
Total hot run time: 32.78 s

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 3, 2025

FE UT Coverage Report

Increment line coverage 73.55% (253/344) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 3, 2025

FE Regression Coverage Report

Increment line coverage 47.38% (163/344) 🎉
Increment coverage report
Complete coverage report

@zddr
Copy link
Copy Markdown
Contributor Author

zddr commented Sep 10, 2025

run buildall

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 10, 2025

TPC-H: Total hot run time: 35072 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 46712a5a2cdcb38e905d086512a789363032b137, data reload: false

------ Round 1 ----------------------------------
q1	17613	5230	5089	5089
q2	1999	315	210	210
q3	10279	1337	757	757
q4	10254	1041	537	537
q5	7573	2412	2364	2364
q6	192	170	140	140
q7	933	764	638	638
q8	9360	1332	1148	1148
q9	6917	5159	5160	5159
q10	6904	2394	1982	1982
q11	487	306	286	286
q12	358	362	231	231
q13	17758	3637	3042	3042
q14	239	244	221	221
q15	554	504	481	481
q16	1011	999	973	973
q17	623	855	367	367
q18	7662	7338	7212	7212
q19	1236	977	572	572
q20	351	345	228	228
q21	3876	3216	2444	2444
q22	1091	1024	991	991
Total cold run time: 107270 ms
Total hot run time: 35072 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5121	5132	5096	5096
q2	250	340	235	235
q3	2156	2682	2336	2336
q4	1342	1764	1355	1355
q5	4277	4368	4170	4170
q6	208	165	127	127
q7	1891	1843	1701	1701
q8	2503	2432	2416	2416
q9	6819	6754	6738	6738
q10	2931	3163	2701	2701
q11	569	508	502	502
q12	638	775	669	669
q13	3297	3710	3097	3097
q14	272	294	263	263
q15	526	482	474	474
q16	1021	1046	1004	1004
q17	1156	1516	1326	1326
q18	7560	7248	6936	6936
q19	836	788	797	788
q20	1932	1957	1854	1854
q21	4864	4419	4252	4252
q22	1142	1051	989	989
Total cold run time: 51311 ms
Total hot run time: 49029 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 10, 2025

TPC-DS: Total hot run time: 189507 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 46712a5a2cdcb38e905d086512a789363032b137, data reload: false

query1	1070	452	415	415
query2	6594	1656	1697	1656
query3	6762	241	228	228
query4	25981	23504	22787	22787
query5	4400	653	514	514
query6	332	244	220	220
query7	4647	520	308	308
query8	297	247	236	236
query9	8675	2997	2932	2932
query10	492	389	302	302
query11	15841	15175	14757	14757
query12	180	125	115	115
query13	1684	592	441	441
query14	10272	9192	9326	9192
query15	218	199	178	178
query16	7238	695	506	506
query17	1246	736	637	637
query18	2012	430	329	329
query19	214	204	184	184
query20	140	128	124	124
query21	214	143	130	130
query22	4213	4145	4183	4145
query23	33793	33203	32984	32984
query24	8163	2550	2570	2550
query25	640	534	479	479
query26	1880	299	184	184
query27	2756	536	364	364
query28	4444	2284	2268	2268
query29	836	608	483	483
query30	289	231	195	195
query31	917	796	781	781
query32	90	81	78	78
query33	565	413	359	359
query34	838	844	520	520
query35	819	871	749	749
query36	975	1034	924	924
query37	129	120	99	99
query38	3498	3595	3513	3513
query39	1460	1409	1402	1402
query40	234	145	131	131
query41	70	65	70	65
query42	140	121	117	117
query43	498	513	506	506
query44	1417	901	878	878
query45	186	175	173	173
query46	872	1030	660	660
query47	1799	1832	1742	1742
query48	415	454	346	346
query49	773	548	430	430
query50	681	695	451	451
query51	3857	3941	3861	3861
query52	121	117	109	109
query53	257	282	197	197
query54	633	629	576	576
query55	101	97	99	97
query56	384	360	332	332
query57	1188	1190	1121	1121
query58	304	300	296	296
query59	2576	2691	2653	2653
query60	383	367	339	339
query61	165	158	175	158
query62	786	728	658	658
query63	229	195	192	192
query64	4541	1150	898	898
query65	4064	3967	3971	3967
query66	1176	440	336	336
query67	15581	15423	15450	15423
query68	9636	945	592	592
query69	509	330	308	308
query70	1359	1330	1325	1325
query71	574	354	320	320
query72	5858	5006	5088	5006
query73	772	673	368	368
query74	8959	9207	8880	8880
query75	4495	3277	2730	2730
query76	4057	1150	750	750
query77	1083	407	334	334
query78	9604	9732	8827	8827
query79	2012	848	590	590
query80	672	578	524	524
query81	478	266	232	232
query82	467	171	149	149
query83	296	256	248	248
query84	304	115	97	97
query85	940	462	418	418
query86	343	336	296	296
query87	3766	3829	3659	3659
query88	2871	2224	2210	2210
query89	422	320	293	293
query90	1912	225	221	221
query91	170	167	134	134
query92	90	77	71	71
query93	1198	979	651	651
query94	696	405	330	330
query95	430	344	335	335
query96	486	600	280	280
query97	2965	2971	2851	2851
query98	258	225	225	225
query99	1463	1433	1273	1273
Total cold run time: 277390 ms
Total hot run time: 189507 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 10, 2025

ClickBench: Total hot run time: 29.94 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 46712a5a2cdcb38e905d086512a789363032b137, data reload: false

query1	0.06	0.06	0.06
query2	0.09	0.06	0.06
query3	0.25	0.08	0.08
query4	1.62	0.11	0.12
query5	0.28	0.27	0.26
query6	1.18	0.68	0.65
query7	0.03	0.03	0.03
query8	0.06	0.04	0.04
query9	0.61	0.53	0.53
query10	0.59	0.58	0.60
query11	0.16	0.12	0.11
query12	0.15	0.12	0.12
query13	0.62	0.63	0.62
query14	1.01	1.02	1.01
query15	0.88	0.87	0.86
query16	0.40	0.39	0.39
query17	1.05	1.07	1.06
query18	0.22	0.20	0.21
query19	1.93	1.84	1.83
query20	0.02	0.02	0.01
query21	15.40	1.05	0.58
query22	0.79	1.01	0.75
query23	15.00	1.40	0.59
query24	7.33	1.48	0.72
query25	0.53	0.23	0.18
query26	0.61	0.17	0.13
query27	0.06	0.06	0.05
query28	9.83	0.90	0.43
query29	12.59	3.89	3.21
query30	0.30	0.13	0.11
query31	2.82	0.59	0.39
query32	3.24	0.57	0.48
query33	3.15	3.05	3.18
query34	16.13	5.47	4.85
query35	4.90	4.99	4.92
query36	0.68	0.50	0.50
query37	0.10	0.08	0.08
query38	0.06	0.05	0.05
query39	0.04	0.04	0.03
query40	0.19	0.15	0.15
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 105.13 s
Total hot run time: 29.94 s

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 10, 2025

FE Regression Coverage Report

Increment line coverage 47.38% (163/344) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 11, 2025

ClickBench: Total hot run time: 30.09 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7aa8f60591a34d7bb8efcc8ea79b382e3a4006fa, data reload: false

query1	0.06	0.05	0.04
query2	0.09	0.06	0.06
query3	0.26	0.08	0.08
query4	1.61	0.12	0.11
query5	0.28	0.26	0.25
query6	1.18	0.65	0.64
query7	0.03	0.02	0.02
query8	0.06	0.05	0.05
query9	0.62	0.53	0.52
query10	0.58	0.57	0.57
query11	0.17	0.12	0.11
query12	0.16	0.11	0.16
query13	0.64	0.63	0.62
query14	1.02	1.03	1.03
query15	0.88	0.87	0.87
query16	0.42	0.42	0.39
query17	1.04	1.05	1.03
query18	0.22	0.20	0.21
query19	1.92	1.86	1.89
query20	0.02	0.01	0.02
query21	15.43	0.92	0.60
query22	0.77	1.23	0.76
query23	14.79	1.43	0.66
query24	6.58	1.97	0.78
query25	0.52	0.11	0.07
query26	0.56	0.18	0.14
query27	0.06	0.06	0.06
query28	10.08	0.93	0.44
query29	12.62	3.94	3.27
query30	0.28	0.13	0.11
query31	2.84	0.60	0.39
query32	3.26	0.56	0.47
query33	3.05	3.10	3.10
query34	16.15	5.45	4.86
query35	4.92	4.94	4.92
query36	0.71	0.50	0.51
query37	0.10	0.07	0.08
query38	0.06	0.05	0.04
query39	0.03	0.03	0.04
query40	0.18	0.15	0.14
query41	0.10	0.04	0.05
query42	0.04	0.03	0.03
query43	0.04	0.04	0.04
Total cold run time: 104.43 s
Total hot run time: 30.09 s

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 11, 2025

FE UT Coverage Report

Increment line coverage 73.18% (251/343) 🎉
Increment coverage report
Complete coverage report

@zddr
Copy link
Copy Markdown
Contributor Author

zddr commented Sep 11, 2025

run p0

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 11, 2025

FE Regression Coverage Report

Increment line coverage 47.23% (162/343) 🎉
Increment coverage report
Complete coverage report

1 similar comment
@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 11, 2025

FE Regression Coverage Report

Increment line coverage 47.23% (162/343) 🎉
Increment coverage report
Complete coverage report

924060929
924060929 reviewed Sep 16, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

@924060929 924060929 left a comment •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. add sql_cache_total_search_times metric, sql_cache_total_search_times = COUNTER_SQL_CACHE_HIT + COUNTER_SQL_CACHE_NOT_HIT
  2. COUNTER_SQL_CACHE_NOT_HIT should increment when tryParseSql return empty result

Jibing-Li
Jibing-Li previously approved these changes Sep 17, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

@Jibing-Li Jibing-Li left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zddr zddr requested a review from 924060929 September 18, 2025 09:46
@zddr
Copy link
Copy Markdown
Contributor Author

zddr commented Sep 18, 2025

run buildall

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Sep 18, 2025
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Sep 18, 2025

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Sep 18, 2025

PR approved by anyone and no changes requested.

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 18, 2025

TPC-H: Total hot run time: 1485 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c6f7e0792fbe0cafff7719ce79025d7e4c4ca25c, data reload: false

------ Round 1 ----------------------------------
q1	17608	61	20	20
q2	2597	24	24	24
q3	10738	17	14	14
q4	11182	15	15	15
q5	8131	20	13	13
q6	229	14	13	13
q7	945	21	21	21
q8	9438	16	14	14
q9	9673	22	13	13
q10	7025	12	11	11
q11	731	24	21	21
q12	348	12	10	10
q13	18682	13	11	11
q14	268	14	12	12
q15	612	13	11	11
q16	1062	989	949	949
q17	574	14	12	12
q18	7619	12	11	11
q19	1212	12	11	11
q20	1981	378	246	246
q21	9045	21	21	21
q22	1113	13	12	12
Total cold run time: 120813 ms
Total hot run time: 1485 ms

----- Round 2, with runtime_filter_mode=off -----
q1	13	12	12	12
q2	22	21	21	21
q3	12	11	11	11
q4	13	13	12	12
q5	13	12	12	12
q6	13	12	12	12
q7	20	20	19	19
q8	11	10	11	10
q9	10	11	11	11
q10	10	10	10	10
q11	18	19	19	19
q12	10	10	10	10
q13	9	10	11	10
q14	10	12	12	12
q15	11	10	10	10
q16	1059	1078	1020	1020
q17	13	13	11	11
q18	11	10	10	10
q19	11	10	10	10
q20	1840	1980	1922	1922
q21	24	20	19	19
q22	10	10	10	10
Total cold run time: 3163 ms
Total hot run time: 3193 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 18, 2025

TPC-DS: Total hot run time: 2734 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c6f7e0792fbe0cafff7719ce79025d7e4c4ca25c, data reload: false

query1	1068	19	12	12
query2	7132	18	16	16
query3	7643	13	12	12
query4	26737	12	12	12
query5	4423	14	13	13
query6	387	11	11	11
query7	5429	12	11	11
query8	370	19	17	17
query9	9201	12	11	11
query10	719	11	11	11
query11	15574	10	10	10
query12	171	12	9	9
query13	1699	10	9	9
query14	10993	14	11	11
query15	218	11	10	10
query16	7162	11	10	10
query17	1440	10	9	9
query18	2898	28	11	11
query19	201	10	9	9
query20	134	10	9	9
query21	225	11	11	11
query22	4015	9	8	8
query23	33694	17	11	11
query24	9271	12	13	12
query25	727	9	8	8
query26	1064	10	10	10
query27	3399	10	8	8
query28	6286	10	10	10
query29	1203	10	9	9
query30	657	12	10	10
query31	1755	11	10	10
query32	118	13	10	10
query33	1030	11	9	9
query34	1575	845	524	524
query35	875	11	10	10
query36	1004	10	10	10
query37	123	11	10	10
query38	3579	11	9	9
query39	1542	732	782	732
query40	235	11	10	10
query41	94	12	11	11
query42	161	11	10	10
query43	514	9	9	9
query44	1361	11	9	9
query45	193	10	10	10
query46	929	10	9	9
query47	1793	10	9	9
query48	399	9	8	8
query49	1131	11	10	10
query50	785	9	9	9
query51	3884	10	9	9
query52	124	11	10	10
query53	242	12	12	12
query54	749	11	11	11
query55	94	11	9	9
query56	341	10	9	9
query57	1204	9	8	8
query58	310	10	9	9
query59	2629	10	8	8
query60	376	11	9	9
query61	176	10	9	9
query62	837	10	10	10
query63	274	11	11	11
query64	4023	11	9	9
query65	4030	9	8	8
query66	1102	10	9	9
query67	16019	11	11	11
query68	3545	10	9	9
query69	880	10	11	10
query70	1462	9	9	9
query71	405	351	319	319
query72	6975	11	11	11
query73	513	10	9	9
query74	9799	9	10	9
query75	3428	12	11	11
query76	2516	10	10	10
query77	813	10	12	10
query78	9671	11	11	11
query79	1051	9	8	8
query80	700	12	13	12
query81	506	10	11	10
query82	221	13	12	12
query83	356	10	10	10
query84	299	10	10	10
query85	1025	10	54	10
query86	358	9	8	8
query87	4069	9	8	8
query88	2878	11	9	9
query89	394	9	8	8
query90	1892	11	10	10
query91	237	10	9	9
query92	79	11	9	9
query93	1081	11	11	11
query94	744	9	8	8
query95	550	11	9	9
query96	468	12	13	12
query97	3203	9	8	8
query98	228	221	216	216
query99	1463	12	10	10
Total cold run time: 281559 ms
Total hot run time: 2734 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 18, 2025

ClickBench: Total hot run time: 0.07 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c6f7e0792fbe0cafff7719ce79025d7e4c4ca25c, data reload: false

query1	0.06	0.02	0.00
query2	0.10	0.01	0.00
query3	0.26	0.01	0.01
query4	1.74	0.01	0.01
query5	0.29	0.01	0.00
query6	1.65	0.01	0.01
query7	0.05	0.00	0.01
query8	0.06	0.00	0.00
query9	0.62	0.00	0.00
query10	0.62	0.01	0.00
query11	0.17	0.00	0.00
query12	0.16	0.01	0.00
query13	0.64	0.00	0.00
query14	1.03	0.00	0.00
query15	0.90	0.01	0.00
query16	0.40	0.01	0.00
query17	1.05	0.01	0.00
query18	0.22	0.01	0.00
query19	1.94	0.00	0.00
query20	0.02	0.00	0.00
query21	15.39	0.00	0.00
query22	6.86	0.00	0.00
query23	15.72	0.01	0.00
query24	1.27	0.00	0.01
query25	0.21	0.00	0.00
query26	0.17	0.00	0.01
query27	0.10	0.00	0.00
query28	1.10	0.00	0.01
query29	13.23	0.00	0.01
query30	0.31	0.00	0.00
query31	2.21	0.00	0.00
query32	5.80	0.01	0.01
query33	4.38	0.00	0.00
query34	7.41	0.00	0.00
query35	6.09	0.01	0.01
query36	0.70	0.00	0.00
query37	0.11	0.00	0.01
query38	0.07	0.00	0.01
query39	0.05	0.00	0.01
query40	0.20	0.01	0.01
query41	0.10	0.01	0.01
query42	0.06	0.00	0.00
query43	0.05	0.01	0.00
Total cold run time: 93.57 s
Total hot run time: 0.07 s

@zddr
Copy link
Copy Markdown
Contributor Author

zddr commented Sep 19, 2025

run buildall

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 19, 2025

FE UT Coverage Report

Increment line coverage 68.34% (231/338) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 19, 2025

TPC-H: Total hot run time: 1502 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9b3b7c32878d44f7e2381f9e3075101420e98e21, data reload: false

------ Round 1 ----------------------------------
q1	17648	37	19	19
q2	2620	26	26	26
q3	10704	16	14	14
q4	11209	16	14	14
q5	8103	17	17	17
q6	237	21	14	14
q7	955	22	23	22
q8	9669	14	12	12
q9	9847	14	13	13
q10	7025	13	12	12
q11	723	22	20	20
q12	898	13	12	12
q13	18690	13	12	12
q14	255	12	11	11
q15	613	12	11	11
q16	1064	984	958	958
q17	581	12	10	10
q18	7748	12	11	11
q19	1483	13	12	12
q20	1983	372	250	250
q21	9029	21	21	21
q22	1148	13	11	11
Total cold run time: 122232 ms
Total hot run time: 1502 ms

----- Round 2, with runtime_filter_mode=off -----
q1	11	11	10	10
q2	20	20	20	20
q3	12	10	11	10
q4	13	12	11	11
q5	11	10	11	10
q6	12	11	11	11
q7	20	18	18	18
q8	11	10	10	10
q9	9	11	10	10
q10	9	10	10	10
q11	18	23	20	20
q12	10	10	9	9
q13	10	10	12	10
q14	10	10	11	10
q15	11	11	10	10
q16	1078	1096	1034	1034
q17	12	10	10	10
q18	10	9	9	9
q19	10	10	10	10
q20	1847	1960	1831	1831
q21	22	20	18	18
q22	10	9	11	9
Total cold run time: 3176 ms
Total hot run time: 3100 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 19, 2025

TPC-DS: Total hot run time: 2753 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9b3b7c32878d44f7e2381f9e3075101420e98e21, data reload: false

query1	1082	18	10	10
query2	7154	20	16	16
query3	7620	12	11	11
query4	27319	12	12	12
query5	4413	12	11	11
query6	384	11	10	10
query7	5428	12	11	11
query8	361	23	17	17
query9	9242	12	10	10
query10	722	12	11	11
query11	16545	12	12	12
query12	184	12	10	10
query13	1715	11	10	10
query14	10852	15	14	14
query15	231	11	11	11
query16	7174	11	11	11
query17	1533	11	10	10
query18	2805	10	10	10
query19	199	10	9	9
query20	130	10	9	9
query21	224	10	9	9
query22	4013	9	9	9
query23	33664	22	12	12
query24	9239	11	12	11
query25	711	10	7	7
query26	1062	10	9	9
query27	3392	11	9	9
query28	6273	11	11	11
query29	1221	11	9	9
query30	653	11	10	10
query31	1741	11	12	11
query32	123	11	9	9
query33	1052	12	10	10
query34	1584	822	526	526
query35	876	10	9	9
query36	1008	11	11	11
query37	114	10	10	10
query38	3532	10	9	9
query39	1503	737	784	737
query40	235	10	9	9
query41	81	11	11	11
query42	154	9	9	9
query43	496	9	9	9
query44	1321	9	9	9
query45	198	9	9	9
query46	909	9	9	9
query47	1788	10	10	10
query48	395	10	10	10
query49	1134	10	10	10
query50	755	10	9	9
query51	3887	10	9	9
query52	123	10	9	9
query53	251	10	10	10
query54	708	9	10	9
query55	127	9	8	8
query56	332	11	9	9
query57	1205	9	9	9
query58	309	11	11	11
query59	2639	9	9	9
query60	373	9	8	8
query61	171	9	8	8
query62	842	11	8	8
query63	264	9	9	9
query64	3974	10	9	9
query65	4045	10	8	8
query66	1073	10	11	10
query67	16359	18	9	9
query68	3452	9	9	9
query69	591	10	9	9
query70	1400	10	9	9
query71	403	337	356	337
query72	6976	9	9	9
query73	512	10	9	9
query74	9436	10	10	10
query75	3484	11	11	11
query76	2662	12	10	10
query77	852	12	11	11
query78	9946	14	10	10
query79	1059	11	15	11
query80	725	10	10	10
query81	518	12	10	10
query82	217	10	8	8
query83	401	13	11	11
query84	313	11	11	11
query85	1700	13	11	11
query86	519	9	9	9
query87	3890	12	10	10
query88	2832	11	9	9
query89	384	10	9	9
query90	2108	11	11	11
query91	188	10	9	9
query92	94	11	11	11
query93	1173	9	8	8
query94	800	11	9	9
query95	510	10	9	9
query96	522	10	10	10
query97	3208	8	8	8
query98	224	271	217	217
query99	1466	10	9	9
Total cold run time: 283791 ms
Total hot run time: 2753 ms

@doris-robot
Copy link
Copy Markdown

doris-robot commented Sep 19, 2025

ClickBench: Total hot run time: 0.11 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9b3b7c32878d44f7e2381f9e3075101420e98e21, data reload: false

query1	0.06	0.02	0.01
query2	0.10	0.01	0.01
query3	0.27	0.01	0.01
query4	1.74	0.01	0.01
query5	0.29	0.01	0.00
query6	1.66	0.01	0.01
query7	0.05	0.00	0.01
query8	0.06	0.01	0.00
query9	0.63	0.00	0.00
query10	0.59	0.01	0.01
query11	0.17	0.00	0.01
query12	0.16	0.00	0.00
query13	0.64	0.01	0.01
query14	1.02	0.01	0.01
query15	0.88	0.00	0.00
query16	0.41	0.00	0.01
query17	1.04	0.00	0.00
query18	0.23	0.00	0.00
query19	1.95	0.01	0.00
query20	0.02	0.00	0.00
query21	15.40	0.00	0.00
query22	6.32	0.00	0.00
query23	15.96	0.01	0.01
query24	1.35	0.00	0.00
query25	0.23	0.00	0.00
query26	0.17	0.00	0.00
query27	0.10	0.01	0.01
query28	1.12	0.01	0.01
query29	13.24	0.00	0.00
query30	0.32	0.00	0.00
query31	2.26	0.00	0.00
query32	5.87	0.01	0.00
query33	4.37	0.00	0.00
query34	7.38	0.01	0.00
query35	6.20	0.00	0.00
query36	0.72	0.00	0.00
query37	0.12	0.01	0.00
query38	0.09	0.00	0.00
query39	0.05	0.00	0.00
query40	0.20	0.01	0.00
query41	0.10	0.00	0.00
query42	0.07	0.00	0.00
query43	0.06	0.01	0.00
Total cold run time: 93.67 s
Total hot run time: 0.11 s

@hello-stephen
Copy link
Copy Markdown
Contributor

hello-stephen commented Sep 19, 2025

FE Regression Coverage Report

Increment line coverage 46.45% (157/338) 🎉
Increment coverage report
Complete coverage report

@924060929 924060929 merged commit b776be4 into apache:master Sep 19, 2025
28 of 30 checks passed
dwdwqfwe pushed a commit to dwdwqfwe/doris that referenced this pull request Sep 22, 2025
@zddr @dwdwqfwe
[enhance](metric)add metrics for statistics/mtmv/sql cache/plan (apac…
5acdcdc 
…he#55617)

add some metrics:

**MTMV**
doris_fe_async_materialized_view_num  
doris_fe_async_materialized_view_num{trigger="COMMIT"}  
doris_fe_async_materialized_view_num{trigger="SCHEDULE"}  
doris_fe_async_materialized_view_num{trigger="MANUAL"}  
doris_fe_async_materialized_view_num{partitionType="FOLLOW_BASE_TABLE"}
doris_fe_async_materialized_view_num{partitionType="EXPR"}  
doris_fe_async_materialized_view_num{partitionType="SELF_MANAGE"}  
doris_fe_async_materialized_view_num{method="COMPLETE"}  
doris_fe_async_materialized_view_num{method="AUTO"}  
doris_fe_async_materialized_view_task_duration_ms  
doris_fe_async_materialized_view_task_success_num  
doris_fe_async_materialized_view_task_failed_num  
doris_fe_async_materialized_view_task_running_num  
doris_fe_async_materialized_view_task_pending_num  
doris_fe_async_materialized_view_task_skip_num  

**PLAN**
doris_fe_plan_num
doris_fe_plan_parse_duration_ms
doris_fe_plan_analyze_duration_ms
doris_fe_plan_rewrite_duration_ms
doris_fe_plan_fold_const_by_be_duration_ms
doris_fe_plan_optimize_duration_ms
doris_fe_plan_translate_duration_ms
doris_fe_plan_init_scan_node_duration_ms
doris_fe_plan_finalize_scan_node_duration_ms
doris_fe_plan_create_scan_range_duration_ms
doris_fe_plan_distribute_duration_ms
doris_fe_plan_duration_ms
doris_fe_plan_external_catalog_meta_duration_ms
doris_fe_plan_external_tvf_init_duration_ms
doris_fe_plan_lock_tables_duration_ms
doris_fe_plan_partition_prune_duration_ms
doris_fe_plan_cloud_meta_duration_ms
doris_fe_plan_materialized_view_rewrite_duration_ms
**statistics**
doris_fe_statistics_unhealthy_table_rate
doris_fe_statistics_unhealthy_column_rate
doris_fe_statistics_unhealthy_table_num
doris_fe_statistics_unhealthy_column_num
doris_fe_statistics_succeed_analyze_job
doris_fe_statistics_failed_analyze_job
doris_fe_statistics_succeed_analyze_task
doris_fe_statistics_failed_analyze_task
doris_fe_statistics_invalid_stats
doris_fe_statistics_high_priority_queue_length
doris_fe_statistics_mid_priority_queue_length
doris_fe_statistics_low_priority_queue_length
doris_fe_statistics_very_low_priority_queue_length
doris_fe_statistics_not_analyzed_table_num
doris_fe_statistics_empty_table_num

**sql cache**
doris_fe_sql_cache_num
doris_fe_sql_cache_added
doris_fe_sql_cache_hit
doris_fe_sql_cache_total_search_times
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@924060929 924060929 924060929 approved these changes

@CalvinKirs CalvinKirs CalvinKirs approved these changes

@Jibing-Li Jibing-Li Jibing-Li left review comments

@dataroaring dataroaring Awaiting requested review from dataroaring dataroaring is a code owner

@morningman morningman Awaiting requested review from morningman morningman is a code owner

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@zddr @Thearas @hello-stephen @doris-robot @924060929 @CalvinKirs @Jibing-Li