Skip to content

Conversation

@xy720
Copy link
Member

@xy720 xy720 commented Oct 16, 2025

What problem does this PR solve?

When doing restore with the config restore_reset_index_id is set to true, the index id is not actually refresh in rowset schema.

Then the schema saved by create tablet request and the schema saved by commit restore request will be different.
This will cause a Fatal error in meta service:

W20251010 19:23:27.299336  5752 meta_service_schema.cpp:92] existed index: index_id: 1760001798354
index_name: "idx_ngrambf"
index_type: NGRAM_BF
col_unique_id: 2
properties {
  key: "bf_size"
  value: "256"
}
properties {
  key: "gram_size"
  value: "3"
}

to save index: index_id: 1741962429779
index_name: "idx_ngrambf"
index_type: NGRAM_BF
col_unique_id: 2
properties {
  key: "bf_size"
  value: "256"
}
properties {
  key: "gram_size"
  value: "3"
}
properties {
  key: "lower_case"
  value: "true"
}
index_suffix_name: ""
F20251010 19:23:27.299504  5752 meta_service_schema.cpp:118] Check failed: [&] { ValueBuf buf; auto err = cloud::blob_get(txn, schema_key, &buf); if (err != TxnErrorCode::TXN_OK) { google::LogMessage( "/data/home/lambxu/work/git/doris-master/doris/cloud/src/meta-service/meta_service_schema.cpp", 109, google::GLOG_WARNING).stream() << "failed to get schema, err=" << err; return false; } doris::TabletSchemaCloudPB saved_schema; if (!buf.to_pb(&saved_schema)) { google::LogMessage( "/data/home/lambxu/work/git/doris-master/doris/cloud/src/meta-service/meta_service_schema.cpp", 114, google::GLOG_WARNING).stream() << "failed to parse schema value"; return false; } return check_tablet_schema(schema, saved_schema); }() 01106d657461000110353131313132000110736368656d6100011200000199c84830ce120000000000000000
Clipboard_Screenshot_1760632439

This problem not only exists in cloud mode.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Oct 16, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@xy720
Copy link
Member Author

xy720 commented Oct 16, 2025

run buildall

1 similar comment
@xy720
Copy link
Member Author

xy720 commented Oct 17, 2025

run buildall

@doris-robot
Copy link

TPC-DS: Total hot run time: 190562 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ad066c628d5c06e3981ff5c42e1a63c128d0e4e5, data reload: false

query1	1058	449	408	408
query2	6583	1731	1719	1719
query3	6758	228	230	228
query4	26370	23930	23219	23219
query5	5494	642	465	465
query6	357	255	231	231
query7	4643	506	322	322
query8	300	257	261	257
query9	8738	2571	2576	2571
query10	551	338	295	295
query11	15727	15083	14847	14847
query12	181	127	114	114
query13	1674	556	427	427
query14	11326	9383	9481	9383
query15	209	190	176	176
query16	7647	683	509	509
query17	1316	747	637	637
query18	2079	497	403	403
query19	250	224	193	193
query20	139	136	145	136
query21	267	137	118	118
query22	4633	4754	4538	4538
query23	35009	34045	33968	33968
query24	8811	2595	2528	2528
query25	709	554	464	464
query26	1261	309	163	163
query27	2883	530	394	394
query28	4565	2215	2197	2197
query29	873	656	530	530
query30	323	233	218	218
query31	931	867	791	791
query32	81	69	81	69
query33	608	465	409	409
query34	838	905	535	535
query35	791	848	775	775
query36	951	984	902	902
query37	114	110	84	84
query38	3592	3643	3532	3532
query39	1493	1421	1407	1407
query40	221	129	120	120
query41	63	57	59	57
query42	117	111	115	111
query43	460	494	474	474
query44	1324	835	826	826
query45	180	184	170	170
query46	847	996	626	626
query47	1723	1802	1740	1740
query48	411	418	331	331
query49	762	528	410	410
query50	645	699	410	410
query51	3900	4037	4033	4033
query52	114	106	100	100
query53	234	267	201	201
query54	598	595	520	520
query55	85	81	86	81
query56	325	328	309	309
query57	1176	1187	1122	1122
query58	282	272	271	271
query59	2607	2637	2569	2569
query60	351	358	323	323
query61	160	173	159	159
query62	842	755	685	685
query63	228	195	196	195
query64	4471	1169	833	833
query65	4098	3973	3979	3973
query66	1046	428	330	330
query67	15376	15248	14931	14931
query68	9577	956	586	586
query69	496	330	286	286
query70	1342	1338	1260	1260
query71	512	339	317	317
query72	5622	4953	4963	4953
query73	697	576	356	356
query74	9269	8852	9055	8852
query75	4583	3395	2844	2844
query76	4150	1155	735	735
query77	1096	401	304	304
query78	9644	9743	8970	8970
query79	4264	833	570	570
query80	712	579	512	512
query81	496	274	224	224
query82	345	167	125	125
query83	298	266	248	248
query84	303	118	91	91
query85	870	483	450	450
query86	344	320	281	281
query87	3744	3774	3617	3617
query88	2925	2272	2223	2223
query89	438	335	293	293
query90	2055	226	235	226
query91	160	175	144	144
query92	84	69	63	63
query93	2880	991	633	633
query94	739	446	340	340
query95	408	329	315	315
query96	497	581	273	273
query97	2942	2958	2864	2864
query98	240	224	214	214
query99	1405	1412	1321	1321
Total cold run time: 285916 ms
Total hot run time: 190562 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.21 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ad066c628d5c06e3981ff5c42e1a63c128d0e4e5, data reload: false

query1	0.05	0.05	0.04
query2	0.09	0.06	0.05
query3	0.24	0.08	0.08
query4	1.60	0.12	0.12
query5	0.28	0.27	0.26
query6	1.20	0.66	0.63
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.62	0.53	0.54
query10	0.58	0.57	0.60
query11	0.16	0.11	0.12
query12	0.15	0.11	0.12
query13	0.64	0.61	0.61
query14	1.03	1.06	1.02
query15	0.86	0.86	0.87
query16	0.42	0.39	0.39
query17	1.04	1.05	1.03
query18	0.23	0.20	0.20
query19	1.91	1.84	1.79
query20	0.01	0.02	0.02
query21	15.43	0.93	0.59
query22	0.75	1.05	0.73
query23	15.01	1.40	0.65
query24	7.37	1.39	0.48
query25	0.53	0.23	0.12
query26	0.68	0.15	0.14
query27	0.05	0.06	0.06
query28	9.63	1.39	0.96
query29	12.58	3.96	3.22
query30	0.30	0.16	0.13
query31	2.84	0.60	0.38
query32	3.23	0.54	0.48
query33	3.12	3.09	3.09
query34	16.29	5.47	4.90
query35	4.94	4.94	4.98
query36	0.69	0.50	0.51
query37	0.11	0.08	0.07
query38	0.06	0.05	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.14
query41	0.08	0.04	0.03
query42	0.04	0.04	0.03
query43	0.04	0.04	0.03
Total cold run time: 105.16 s
Total hot run time: 30.21 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 59.21% (45/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.55% (17823/33919)
Line Coverage 37.75% (161981/429088)
Region Coverage 32.20% (123522/383602)
Branch Coverage 33.61% (54237/161391)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 59.21% (45/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.21% (23682/33258)
Line Coverage 57.63% (247171/428861)
Region Coverage 52.75% (204969/388578)
Branch Coverage 54.57% (88561/162300)

@xy720
Copy link
Member Author

xy720 commented Oct 20, 2025

run buildall

@doris-robot
Copy link

TPC-DS: Total hot run time: 190927 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 35af353073e232d67d4a979ef5b5b2fe80ca0d85, data reload: false

query1	1071	442	417	417
query2	6600	1723	1734	1723
query3	6770	236	233	233
query4	26130	23801	23310	23310
query5	5067	676	486	486
query6	379	244	242	242
query7	4661	510	296	296
query8	335	272	257	257
query9	8729	2621	2656	2621
query10	540	364	300	300
query11	15354	15180	15790	15180
query12	200	126	136	126
query13	1775	604	489	489
query14	12237	9581	9521	9521
query15	336	227	195	195
query16	8345	687	493	493
query17	1780	838	652	652
query18	2109	433	356	356
query19	289	212	183	183
query20	145	123	126	123
query21	217	156	119	119
query22	4723	4674	4600	4600
query23	35097	34415	33834	33834
query24	8314	2403	2407	2403
query25	535	497	434	434
query26	1221	279	166	166
query27	2671	513	373	373
query28	4261	2179	2192	2179
query29	815	653	531	531
query30	304	226	204	204
query31	902	832	745	745
query32	84	77	70	70
query33	589	395	332	332
query34	789	907	536	536
query35	792	845	731	731
query36	960	982	902	902
query37	117	113	91	91
query38	3566	3518	3429	3429
query39	1475	1430	1424	1424
query40	218	125	116	116
query41	60	57	63	57
query42	119	107	114	107
query43	491	489	464	464
query44	1318	835	818	818
query45	187	224	179	179
query46	834	1014	653	653
query47	1780	1827	1775	1775
query48	397	426	319	319
query49	770	508	417	417
query50	639	703	405	405
query51	3987	3967	3866	3866
query52	106	115	105	105
query53	234	278	197	197
query54	592	591	520	520
query55	88	95	90	90
query56	310	311	320	311
query57	1200	1195	1142	1142
query58	287	275	290	275
query59	2552	2659	2532	2532
query60	345	342	326	326
query61	154	158	170	158
query62	785	729	701	701
query63	229	196	196	196
query64	4431	1143	835	835
query65	4072	3976	3994	3976
query66	1094	436	389	389
query67	15517	15539	15035	15035
query68	9523	954	606	606
query69	500	334	294	294
query70	1359	1233	1271	1233
query71	511	357	320	320
query72	6013	4923	4876	4876
query73	716	585	365	365
query74	9195	9329	8784	8784
query75	4443	3366	2930	2930
query76	4130	1162	735	735
query77	1018	418	316	316
query78	9699	9646	9038	9038
query79	6796	820	573	573
query80	736	599	495	495
query81	505	263	225	225
query82	392	168	135	135
query83	301	272	258	258
query84	301	118	93	93
query85	903	483	502	483
query86	337	332	281	281
query87	3845	3755	3661	3661
query88	2801	2255	2212	2212
query89	438	336	296	296
query90	2157	218	213	213
query91	162	162	132	132
query92	88	75	63	63
query93	3800	1024	630	630
query94	704	419	388	388
query95	411	325	315	315
query96	497	572	278	278
query97	2940	2959	2917	2917
query98	229	212	205	205
query99	1435	1381	1307	1307
Total cold run time: 289965 ms
Total hot run time: 190927 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.94 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 35af353073e232d67d4a979ef5b5b2fe80ca0d85, data reload: false

query1	0.05	0.05	0.04
query2	0.09	0.06	0.06
query3	0.27	0.09	0.09
query4	1.61	0.11	0.12
query5	0.28	0.28	0.25
query6	1.15	0.67	0.66
query7	0.03	0.02	0.03
query8	0.06	0.05	0.04
query9	0.62	0.53	0.53
query10	0.59	0.58	0.59
query11	0.16	0.12	0.12
query12	0.16	0.13	0.12
query13	0.64	0.63	0.62
query14	1.05	1.08	1.04
query15	0.89	0.88	0.87
query16	0.41	0.41	0.41
query17	1.08	1.08	1.08
query18	0.22	0.22	0.21
query19	1.96	1.91	1.83
query20	0.02	0.01	0.02
query21	15.39	0.92	0.59
query22	0.77	1.35	0.77
query23	14.74	1.42	0.66
query24	7.39	1.16	0.76
query25	0.42	0.13	0.13
query26	0.66	0.16	0.15
query27	0.07	0.05	0.06
query28	9.18	1.39	0.94
query29	12.57	4.12	3.34
query30	0.30	0.14	0.12
query31	2.84	0.61	0.41
query32	3.25	0.57	0.48
query33	3.21	3.19	3.16
query34	16.14	5.57	4.85
query35	5.01	4.94	4.94
query36	0.70	0.54	0.51
query37	0.11	0.08	0.08
query38	0.07	0.06	0.04
query39	0.04	0.03	0.04
query40	0.18	0.16	0.14
query41	0.09	0.03	0.03
query42	0.04	0.04	0.03
query43	0.05	0.04	0.04
Total cold run time: 104.56 s
Total hot run time: 30.94 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 72.37% (55/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.61% (17878/33980)
Line Coverage 37.84% (162203/428670)
Region Coverage 32.29% (123842/383539)
Branch Coverage 33.68% (54233/161046)

@xy720
Copy link
Member Author

xy720 commented Oct 24, 2025

run buildall

@doris-robot
Copy link

ClickBench: Total hot run time: 27.53 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b6690a512aec15500acc8d8fa87844382e76ba91, data reload: false

query1	0.06	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.09	0.08
query4	1.61	0.12	0.13
query5	0.28	0.26	0.25
query6	1.18	0.68	0.65
query7	0.03	0.03	0.02
query8	0.06	0.05	0.05
query9	0.62	0.52	0.51
query10	0.59	0.58	0.57
query11	0.20	0.11	0.12
query12	0.16	0.12	0.12
query13	0.61	0.60	0.61
query14	1.01	1.03	1.02
query15	0.86	0.85	0.87
query16	0.39	0.40	0.39
query17	1.04	1.04	1.03
query18	0.22	0.21	0.21
query19	1.87	1.81	1.82
query20	0.02	0.01	0.02
query21	15.43	0.17	0.13
query22	5.24	0.07	0.05
query23	15.69	0.26	0.11
query24	3.12	1.01	0.31
query25	0.07	0.07	0.06
query26	0.14	0.14	0.13
query27	0.06	0.05	0.06
query28	3.89	1.14	0.93
query29	12.60	3.96	3.24
query30	0.29	0.13	0.14
query31	2.82	0.58	0.39
query32	3.23	0.56	0.50
query33	3.10	3.04	3.02
query34	15.88	5.13	4.58
query35	4.56	4.55	4.60
query36	0.68	0.51	0.49
query37	0.10	0.07	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.04	0.03
query43	0.05	0.04	0.03
Total cold run time: 98.51 s
Total hot run time: 27.53 s

@xy720
Copy link
Member Author

xy720 commented Oct 27, 2025

run buildall

@doris-robot
Copy link

ClickBench: Total hot run time: 27.65 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4ba2f1c7d808f89086b02afb341d265157c22f6a, data reload: false

query1	0.06	0.04	0.05
query2	0.10	0.05	0.06
query3	0.26	0.08	0.08
query4	1.61	0.12	0.11
query5	0.27	0.26	0.26
query6	1.17	0.67	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.64	0.53	0.52
query10	0.58	0.58	0.59
query11	0.17	0.12	0.12
query12	0.15	0.12	0.12
query13	0.63	0.61	0.61
query14	1.01	1.02	1.01
query15	0.86	0.85	0.87
query16	0.40	0.40	0.38
query17	1.04	1.01	1.03
query18	0.21	0.20	0.21
query19	1.89	1.84	1.87
query20	0.01	0.01	0.02
query21	15.45	0.19	0.13
query22	5.15	0.07	0.05
query23	15.66	0.28	0.10
query24	3.04	0.57	0.38
query25	0.08	0.06	0.06
query26	0.16	0.15	0.14
query27	0.07	0.06	0.05
query28	4.29	1.15	0.96
query29	12.54	4.00	3.30
query30	0.29	0.14	0.11
query31	2.83	0.60	0.37
query32	3.24	0.56	0.47
query33	3.06	3.07	3.09
query34	15.89	5.15	4.56
query35	4.54	4.55	4.62
query36	0.71	0.50	0.49
query37	0.09	0.07	0.07
query38	0.07	0.05	0.04
query39	0.04	0.04	0.03
query40	0.17	0.16	0.14
query41	0.08	0.03	0.04
query42	0.04	0.04	0.03
query43	0.05	0.04	0.03
Total cold run time: 98.68 s
Total hot run time: 27.65 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 72.37% (55/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.65% (17970/34132)
Line Coverage 37.92% (163103/430068)
Region Coverage 32.33% (124404/384758)
Branch Coverage 33.71% (54402/161405)

@xy720
Copy link
Member Author

xy720 commented Oct 27, 2025

run nonConcurrent

@xy720
Copy link
Member Author

xy720 commented Oct 27, 2025

run p0

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 72.37% (55/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.38% (23918/33510)
Line Coverage 57.82% (248875/430410)
Region Coverage 53.00% (206718/390022)
Branch Coverage 54.67% (88778/162398)

@xy720 xy720 force-pushed the fix-restore-schema branch from 4ba2f1c to 156b052 Compare November 17, 2025 06:31
@xy720
Copy link
Member Author

xy720 commented Nov 17, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34452 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 156b052a73c7bc4feadc4b45cb5f1bb902dbf11e, data reload: false

------ Round 1 ----------------------------------
q1	17634	5245	5092	5092
q2	2043	328	245	245
q3	10167	1315	752	752
q4	10221	913	386	386
q5	7496	2449	2268	2268
q6	193	173	141	141
q7	914	751	627	627
q8	9343	1415	1154	1154
q9	7067	5146	5145	5145
q10	6864	2221	1849	1849
q11	496	302	278	278
q12	384	381	232	232
q13	17779	3646	3077	3077
q14	229	252	220	220
q15	581	524	496	496
q16	998	996	934	934
q17	607	883	362	362
q18	7729	7120	7050	7050
q19	1088	962	560	560
q20	356	348	237	237
q21	4015	3290	2358	2358
q22	1046	1044	989	989
Total cold run time: 107250 ms
Total hot run time: 34452 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5162	5140	5088	5088
q2	250	326	228	228
q3	2219	2760	2267	2267
q4	1344	1770	1286	1286
q5	4221	4565	4640	4565
q6	229	199	139	139
q7	2075	2021	1814	1814
q8	2645	2609	2601	2601
q9	7311	7386	7281	7281
q10	3094	3207	2836	2836
q11	604	517	533	517
q12	689	797	650	650
q13	3597	3885	3464	3464
q14	302	309	281	281
q15	546	504	500	500
q16	1121	1181	1130	1130
q17	1210	1624	1383	1383
q18	7822	7814	7749	7749
q19	827	861	921	861
q20	1974	2156	1907	1907
q21	4954	4399	4280	4280
q22	1079	1024	1023	1023
Total cold run time: 53275 ms
Total hot run time: 51850 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186913 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 156b052a73c7bc4feadc4b45cb5f1bb902dbf11e, data reload: false

query1	1031	409	391	391
query2	6562	1681	1701	1681
query3	6764	239	228	228
query4	26502	23357	23424	23357
query5	4684	640	530	530
query6	357	264	249	249
query7	4661	515	313	313
query8	314	262	263	262
query9	8734	2973	2968	2968
query10	551	343	304	304
query11	15503	15453	14785	14785
query12	196	128	121	121
query13	1707	589	456	456
query14	11704	9215	9077	9077
query15	206	185	172	172
query16	7672	665	495	495
query17	1304	752	617	617
query18	2038	415	336	336
query19	215	197	202	197
query20	137	131	124	124
query21	222	132	115	115
query22	3959	4063	4027	4027
query23	34050	32793	32824	32793
query24	8056	2365	2372	2365
query25	618	520	460	460
query26	1236	282	173	173
query27	2748	495	351	351
query28	4402	2290	2268	2268
query29	836	615	490	490
query30	297	223	200	200
query31	909	815	712	712
query32	98	85	85	85
query33	612	396	352	352
query34	784	850	513	513
query35	810	851	784	784
query36	974	1000	917	917
query37	142	130	99	99
query38	3544	3515	3515	3515
query39	1488	1421	1409	1409
query40	226	138	128	128
query41	65	60	62	60
query42	130	123	116	116
query43	470	492	461	461
query44	1252	812	802	802
query45	184	179	173	173
query46	890	1001	651	651
query47	1749	1788	1721	1721
query48	393	425	325	325
query49	766	489	421	421
query50	651	678	410	410
query51	3961	3916	3967	3916
query52	115	119	103	103
query53	263	267	207	207
query54	324	313	308	308
query55	101	93	92	92
query56	356	378	358	358
query57	1153	1191	1099	1099
query58	311	287	293	287
query59	2521	2609	2498	2498
query60	364	369	347	347
query61	162	156	166	156
query62	786	714	686	686
query63	232	193	198	193
query64	4489	1138	880	880
query65	4022	3969	3949	3949
query66	1099	456	351	351
query67	15148	15094	15081	15081
query68	5560	967	651	651
query69	489	341	307	307
query70	1307	1221	1307	1221
query71	459	380	332	332
query72	6049	2932	5574	2932
query73	768	769	383	383
query74	8875	9056	8950	8950
query75	3320	3314	2834	2834
query76	3312	1126	729	729
query77	517	479	353	353
query78	9486	9784	8883	8883
query79	1968	829	605	605
query80	702	599	544	544
query81	514	266	228	228
query82	221	171	157	157
query83	295	265	251	251
query84	257	113	96	96
query85	880	492	446	446
query86	389	311	311	311
query87	3723	3666	3626	3626
query88	2794	2259	2252	2252
query89	403	329	301	301
query90	1924	234	230	230
query91	174	170	129	129
query92	89	80	77	77
query93	1502	989	698	698
query94	728	422	325	325
query95	442	337	327	327
query96	485	606	289	289
query97	2887	2957	2858	2858
query98	241	227	219	219
query99	1332	1405	1299	1299
Total cold run time: 270902 ms
Total hot run time: 186913 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.64 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 156b052a73c7bc4feadc4b45cb5f1bb902dbf11e, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.61	0.12	0.11
query5	0.27	0.25	0.26
query6	1.17	0.64	0.65
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.58	0.53	0.52
query10	0.57	0.58	0.57
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.63	0.60	0.61
query14	1.00	1.00	0.98
query15	0.84	0.83	0.83
query16	0.38	0.39	0.38
query17	1.01	1.02	1.04
query18	0.21	0.19	0.20
query19	1.90	1.78	1.86
query20	0.02	0.02	0.02
query21	15.41	0.20	0.12
query22	5.13	0.06	0.05
query23	15.69	0.25	0.11
query24	2.04	1.46	0.52
query25	0.07	0.07	0.07
query26	0.15	0.14	0.15
query27	0.06	0.05	0.06
query28	4.49	1.16	0.96
query29	12.63	4.04	3.22
query30	0.28	0.14	0.12
query31	2.81	0.58	0.38
query32	3.24	0.55	0.46
query33	3.13	3.12	3.08
query34	15.72	5.16	4.56
query35	4.54	4.59	4.61
query36	0.68	0.52	0.49
query37	0.09	0.07	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.13	0.15
query41	0.09	0.03	0.03
query42	0.04	0.04	0.03
query43	0.04	0.04	0.03
Total cold run time: 97.58 s
Total hot run time: 27.64 s

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 72.37% (55/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.76% (18278/34646)
Line Coverage 38.13% (166187/435799)
Region Coverage 33.09% (129219/390450)
Branch Coverage 33.85% (55445/163816)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 72.37% (55/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.48% (24337/34046)
Line Coverage 57.98% (253069/436473)
Region Coverage 53.29% (210997/395954)
Branch Coverage 54.55% (89954/164891)

@xy720 xy720 force-pushed the fix-restore-schema branch from 156b052 to 2622d22 Compare November 20, 2025 13:01
@xy720
Copy link
Member Author

xy720 commented Nov 20, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34432 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2622d2296c104cbf3e280f337431d9ee123e6fd1, data reload: false

------ Round 1 ----------------------------------
q1	17594	5093	5147	5093
q2	2031	311	204	204
q3	10269	1267	724	724
q4	10239	972	364	364
q5	7521	2415	2338	2338
q6	178	167	138	138
q7	907	754	631	631
q8	9334	1329	1105	1105
q9	7272	5390	5441	5390
q10	6900	2215	1802	1802
q11	483	298	283	283
q12	351	364	221	221
q13	17793	3616	3019	3019
q14	233	233	219	219
q15	566	515	502	502
q16	1024	1003	946	946
q17	600	879	355	355
q18	7656	7209	7045	7045
q19	1089	949	572	572
q20	359	342	229	229
q21	3813	3213	2260	2260
q22	1064	1005	992	992
Total cold run time: 107276 ms
Total hot run time: 34432 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4971	4958	4943	4943
q2	329	390	307	307
q3	2182	2694	2326	2326
q4	1339	1762	1334	1334
q5	4181	4429	4588	4429
q6	221	183	145	145
q7	1984	1978	1840	1840
q8	2686	2727	2630	2630
q9	7575	7564	7671	7564
q10	3032	3309	2792	2792
q11	607	532	493	493
q12	703	764	622	622
q13	3528	3961	3219	3219
q14	279	310	271	271
q15	544	498	506	498
q16	1053	1101	1018	1018
q17	1202	1664	1387	1387
q18	8238	7669	7562	7562
q19	811	856	1046	856
q20	2002	2078	1938	1938
q21	4749	4373	4293	4293
q22	1098	1034	992	992
Total cold run time: 53314 ms
Total hot run time: 51459 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187137 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2622d2296c104cbf3e280f337431d9ee123e6fd1, data reload: false

query1	1052	412	419	412
query2	6556	1684	1754	1684
query3	6752	222	221	221
query4	25919	23091	22574	22574
query5	4411	637	471	471
query6	350	265	219	219
query7	4633	488	299	299
query8	309	254	245	245
query9	8700	2591	2589	2589
query10	518	347	288	288
query11	15903	15128	14848	14848
query12	183	120	111	111
query13	1688	587	477	477
query14	10716	9242	9196	9196
query15	195	192	174	174
query16	7271	700	537	537
query17	1266	764	638	638
query18	2015	435	344	344
query19	212	212	189	189
query20	132	128	126	126
query21	217	142	117	117
query22	4041	4127	3894	3894
query23	33890	33200	33036	33036
query24	8480	2425	2410	2410
query25	643	557	473	473
query26	1241	273	169	169
query27	2757	511	368	368
query28	4373	2191	2183	2183
query29	881	643	531	531
query30	306	231	200	200
query31	902	794	728	728
query32	90	72	76	72
query33	592	391	344	344
query34	799	858	535	535
query35	858	822	724	724
query36	956	1015	903	903
query37	122	106	84	84
query38	3582	3494	3414	3414
query39	1488	1428	1423	1423
query40	229	127	123	123
query41	66	68	67	67
query42	124	113	114	113
query43	498	487	450	450
query44	1261	794	786	786
query45	187	182	170	170
query46	898	984	640	640
query47	1771	1765	1692	1692
query48	390	421	320	320
query49	761	491	410	410
query50	660	690	409	409
query51	3840	3868	3937	3868
query52	113	111	108	108
query53	253	273	196	196
query54	299	293	273	273
query55	93	90	92	90
query56	316	334	305	305
query57	1192	1181	1105	1105
query58	290	268	281	268
query59	2480	2550	2577	2550
query60	338	387	331	331
query61	164	162	161	161
query62	794	694	640	640
query63	225	198	195	195
query64	4531	1162	872	872
query65	4025	3945	3922	3922
query66	1190	442	351	351
query67	15512	14974	14842	14842
query68	8298	1011	629	629
query69	496	322	293	293
query70	1363	1245	1302	1245
query71	488	376	321	321
query72	5882	4982	4873	4873
query73	687	604	364	364
query74	9114	8967	9012	8967
query75	3916	3300	2754	2754
query76	3741	1163	781	781
query77	831	416	331	331
query78	9545	9658	8902	8902
query79	1873	857	601	601
query80	645	584	498	498
query81	489	258	223	223
query82	443	161	131	131
query83	267	260	252	252
query84	249	110	92	92
query85	935	495	439	439
query86	362	301	303	301
query87	3665	3691	3630	3630
query88	2913	2299	2278	2278
query89	385	319	293	293
query90	1971	228	232	228
query91	159	169	138	138
query92	85	64	66	64
query93	1127	1017	688	688
query94	725	454	347	347
query95	399	323	319	319
query96	486	565	279	279
query97	2901	2959	2864	2864
query98	239	213	212	212
query99	1422	1351	1293	1293
Total cold run time: 273600 ms
Total hot run time: 187137 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.33 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2622d2296c104cbf3e280f337431d9ee123e6fd1, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.60	0.11	0.11
query5	0.27	0.25	0.25
query6	1.19	0.65	0.64
query7	0.04	0.03	0.02
query8	0.05	0.04	0.04
query9	0.58	0.52	0.52
query10	0.56	0.57	0.58
query11	0.16	0.12	0.11
query12	0.14	0.11	0.11
query13	0.61	0.61	0.61
query14	1.00	1.00	0.99
query15	0.85	0.82	0.84
query16	0.38	0.38	0.40
query17	1.03	1.02	1.03
query18	0.21	0.19	0.20
query19	1.96	1.73	1.84
query20	0.02	0.01	0.01
query21	15.44	0.21	0.14
query22	5.03	0.07	0.04
query23	15.68	0.28	0.10
query24	2.54	0.76	0.48
query25	0.07	0.05	0.07
query26	0.13	0.15	0.13
query27	0.06	0.06	0.05
query28	4.29	1.14	0.93
query29	12.57	3.90	3.22
query30	0.27	0.13	0.11
query31	2.82	0.59	0.38
query32	3.23	0.55	0.46
query33	3.06	3.04	3.00
query34	15.82	5.23	4.54
query35	4.57	4.53	4.53
query36	0.68	0.52	0.49
query37	0.11	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.04	0.04
query40	0.18	0.15	0.14
query41	0.08	0.04	0.04
query42	0.05	0.03	0.03
query43	0.04	0.03	0.04
Total cold run time: 97.86 s
Total hot run time: 27.33 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 88.16% (67/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.64% (18285/34738)
Line Coverage 38.09% (166409/436873)
Region Coverage 33.03% (129368/391711)
Branch Coverage 33.85% (55568/164170)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 88.16% (67/76) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.55% (24393/34092)
Line Coverage 58.04% (253664/437013)
Region Coverage 53.28% (211546/397012)
Branch Coverage 54.69% (90340/165181)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants