[opt](paimon)Upgrade the Paimon version to 1.0.0 and Iceberg to 1.6.1 #46990

wuwenchi · 2025-01-14T12:14:25Z

What problem does this PR solve?

Problem Summary:

Upgrade the Paimon version to 1.0.0

By default, paimon uses a caching catalog to cache some data to improve read performance.
FYI: https://paimon.apache.org/docs/1.0/maintenance/configurations/#catalogoptions

If you do not want to use this catalog, you can add a configuration paimon.cache-enabled to turn it off:

CREATE CATALOG `c1` PROPERTIES (
"type" = "paimon",
"paimon.catalog.type" = "xxx",
"paimon.cache-enabled" = "false",
"warehouse" = "xxx"
);

If you want to modify cache-related parameters, you can add the paimon. prefix to the parameters supported by paimon, such as:

CREATE CATALOG `c1` PROPERTIES (
"type" = "paimon",
"paimon.catalog.type" = "xxx",
"warehouse" = "xxx",
"paimon.cache.expiration-interval" = "20 min",
"paimon.cache.manifest.small-file-memory"="10 mb"
);

Note:
During the doris upgrade process, this error may occur:

This is because doris will upgrade be first, and then upgrade fe. During this process, the version of paimon on be may be higher than that on fe. This is normal. Because bucketkey judgment is newly added in the higher version of paimon, which is not available in the lower version. After the fe upgrade is completed normally, there will be no more errors.

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- [] No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-01-14T12:14:32Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

wuwenchi · 2025-01-15T02:04:42Z

run buildall

doris-robot · 2025-01-15T02:30:16Z

TPC-H: Total hot run time: 32924 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ed5afca7df8f5ec13ad0c7c8dc64606a0ba0c27f, data reload: false

------ Round 1 ----------------------------------
q1	17580	6234	6130	6130
q2	2057	317	173	173
q3	10407	1285	738	738
q4	10212	897	446	446
q5	7519	2211	1969	1969
q6	207	186	155	155
q7	877	757	632	632
q8	9231	1360	1198	1198
q9	5232	4915	4838	4838
q10	6782	2298	1849	1849
q11	470	292	269	269
q12	355	356	222	222
q13	17755	3703	3096	3096
q14	229	237	205	205
q15	588	515	522	515
q16	619	615	583	583
q17	572	862	325	325
q18	6989	6550	6493	6493
q19	1200	947	544	544
q20	316	328	197	197
q21	2876	2236	2027	2027
q22	374	329	320	320
Total cold run time: 102447 ms
Total hot run time: 32924 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6261	6292	6277	6277
q2	245	337	236	236
q3	2282	2654	2372	2372
q4	1397	1829	1394	1394
q5	4385	4793	4839	4793
q6	197	181	149	149
q7	2062	2043	1856	1856
q8	2657	2786	2675	2675
q9	7409	7223	7354	7223
q10	3022	3324	2790	2790
q11	612	516	504	504
q12	692	782	622	622
q13	3464	3984	3303	3303
q14	277	293	271	271
q15	572	528	543	528
q16	648	686	662	662
q17	1220	1746	1250	1250
q18	7760	7627	7349	7349
q19	815	1139	1074	1074
q20	1986	1991	1890	1890
q21	5871	5164	4860	4860
q22	593	580	577	577
Total cold run time: 54427 ms
Total hot run time: 52655 ms

doris-robot · 2025-01-15T02:42:08Z

TPC-DS: Total hot run time: 188631 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ed5afca7df8f5ec13ad0c7c8dc64606a0ba0c27f, data reload: false

query1	976	392	374	374
query2	6525	2076	1995	1995
query3	6701	218	218	218
query4	33915	23493	23575	23493
query5	4373	648	452	452
query6	301	203	186	186
query7	4619	490	316	316
query8	284	229	224	224
query9	9543	2730	2750	2730
query10	495	313	262	262
query11	17900	15237	14980	14980
query12	164	107	110	107
query13	1663	528	404	404
query14	10436	6851	6892	6851
query15	219	203	186	186
query16	7886	636	463	463
query17	1635	738	567	567
query18	2056	413	312	312
query19	232	192	159	159
query20	120	115	112	112
query21	220	126	105	105
query22	4333	4361	4239	4239
query23	34470	33414	33284	33284
query24	6544	2255	2266	2255
query25	483	450	379	379
query26	1198	270	156	156
query27	1986	479	343	343
query28	5082	2471	2488	2471
query29	648	542	424	424
query30	228	198	155	155
query31	962	874	788	788
query32	71	64	59	59
query33	519	352	306	306
query34	734	869	517	517
query35	781	803	705	705
query36	1000	1054	947	947
query37	120	127	77	77
query38	4236	4168	4143	4143
query39	1428	1385	1403	1385
query40	199	114	103	103
query41	61	49	52	49
query42	127	107	104	104
query43	529	526	489	489
query44	1410	836	819	819
query45	177	173	166	166
query46	871	1020	661	661
query47	1817	1835	1758	1758
query48	384	404	329	329
query49	783	499	400	400
query50	622	639	398	398
query51	6887	6930	6713	6713
query52	106	102	93	93
query53	230	256	199	199
query54	487	505	399	399
query55	85	81	82	81
query56	270	272	282	272
query57	1151	1173	1079	1079
query58	256	241	244	241
query59	3117	3078	2866	2866
query60	283	275	259	259
query61	120	122	121	121
query62	898	798	723	723
query63	223	209	197	197
query64	4037	1032	713	713
query65	3268	3130	3190	3130
query66	1082	418	321	321
query67	15872	15500	15559	15500
query68	4918	839	550	550
query69	465	302	259	259
query70	1227	1123	1113	1113
query71	399	289	276	276
query72	5844	3857	3822	3822
query73	660	754	366	366
query74	10113	9089	8773	8773
query75	3222	3162	2663	2663
query76	3287	1167	783	783
query77	473	399	294	294
query78	9987	10070	9282	9282
query79	2557	830	625	625
query80	1710	570	445	445
query81	579	280	234	234
query82	396	204	124	124
query83	266	189	158	158
query84	249	107	76	76
query85	816	361	299	299
query86	476	312	310	310
query87	4423	4442	4337	4337
query88	3810	2215	2175	2175
query89	400	330	292	292
query90	1845	191	192	191
query91	145	139	112	112
query92	78	58	55	55
query93	2013	930	534	534
query94	729	413	298	298
query95	353	273	260	260
query96	496	616	287	287
query97	2763	2875	2752	2752
query98	231	207	200	200
query99	1422	1499	1374	1374
Total cold run time: 286790 ms
Total hot run time: 188631 ms

doris-robot · 2025-01-15T02:47:29Z

ClickBench: Total hot run time: 31.04 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ed5afca7df8f5ec13ad0c7c8dc64606a0ba0c27f, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.03	0.03
query3	0.24	0.07	0.07
query4	1.61	0.10	0.10
query5	0.41	0.40	0.42
query6	1.18	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.51	0.51
query10	0.55	0.58	0.54
query11	0.15	0.10	0.11
query12	0.14	0.11	0.11
query13	0.60	0.60	0.60
query14	2.78	2.74	2.73
query15	0.91	0.83	0.83
query16	0.37	0.38	0.38
query17	1.05	1.05	1.07
query18	0.23	0.21	0.21
query19	1.92	1.78	1.93
query20	0.01	0.01	0.01
query21	15.39	0.95	0.59
query22	0.76	0.83	0.66
query23	15.24	1.44	0.57
query24	3.34	0.64	1.85
query25	0.26	0.12	0.20
query26	0.23	0.14	0.14
query27	0.07	0.05	0.05
query28	13.64	1.53	1.05
query29	12.56	3.93	3.23
query30	0.25	0.10	0.06
query31	2.83	0.61	0.38
query32	3.23	0.54	0.46
query33	3.03	3.02	3.03
query34	16.80	5.23	4.57
query35	4.58	4.53	4.60
query36	0.65	0.50	0.48
query37	0.11	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.12
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 106.27 s
Total hot run time: 31.04 s

morningman · 2025-01-15T04:05:56Z

fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonExternalCatalog.java

-            return hadoopAuthenticator.doAs(() -> catalog.tableExists(Identifier.create(dbName, tblName)));
+            return hadoopAuthenticator.doAs(() -> {
+                try {
+                    catalog.getTable(Identifier.create(dbName, tblName));


The API is changed?

wuwenchi · 2025-01-16T10:22:03Z

run buildall

doris-robot · 2025-01-16T10:40:56Z

TPC-H: Total hot run time: 32088 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6ec6527ee4f1361cb4dc541acd90cc0e0aec967a, data reload: false

------ Round 1 ----------------------------------
q1	17606	6316	5446	5446
q2	2049	309	195	195
q3	10382	1270	707	707
q4	10225	978	512	512
q5	7545	2382	2099	2099
q6	184	162	131	131
q7	898	734	611	611
q8	9220	1332	1141	1141
q9	5336	4825	4888	4825
q10	6821	2332	1903	1903
q11	473	265	265	265
q12	343	351	209	209
q13	17757	3663	3101	3101
q14	232	225	235	225
q15	512	476	489	476
q16	644	621	583	583
q17	559	853	325	325
q18	6955	6572	6356	6356
q19	1208	955	520	520
q20	305	333	194	194
q21	2839	2152	1955	1955
q22	369	331	309	309
Total cold run time: 102462 ms
Total hot run time: 32088 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5615	5540	5561	5540
q2	236	329	234	234
q3	2291	2627	2337	2337
q4	1466	1860	1401	1401
q5	4299	4727	4626	4626
q6	164	160	123	123
q7	2051	1957	1839	1839
q8	2671	2787	2682	2682
q9	7243	7223	7292	7223
q10	2999	3304	2784	2784
q11	582	504	516	504
q12	706	762	618	618
q13	3491	3834	3237	3237
q14	295	318	278	278
q15	523	469	458	458
q16	647	682	642	642
q17	1220	1720	1280	1280
q18	7618	7493	7224	7224
q19	799	1166	1090	1090
q20	2030	2020	1879	1879
q21	5728	5323	5058	5058
q22	612	596	585	585
Total cold run time: 53286 ms
Total hot run time: 51642 ms

doris-robot · 2025-01-16T10:52:35Z

TPC-DS: Total hot run time: 187610 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6ec6527ee4f1361cb4dc541acd90cc0e0aec967a, data reload: false

query1	992	376	377	376
query2	6523	2102	1986	1986
query3	6792	214	214	214
query4	33089	23470	22855	22855
query5	4427	613	460	460
query6	292	199	176	176
query7	4621	489	300	300
query8	307	240	235	235
query9	9548	2666	2639	2639
query10	477	315	267	267
query11	17755	15170	14750	14750
query12	152	107	104	104
query13	1654	539	402	402
query14	10770	6791	6720	6720
query15	239	190	184	184
query16	8121	603	447	447
query17	1604	711	557	557
query18	2124	395	298	298
query19	206	176	152	152
query20	116	122	112	112
query21	221	125	99	99
query22	4616	4621	4372	4372
query23	34037	32790	32820	32790
query24	6475	2269	2199	2199
query25	502	451	387	387
query26	877	267	155	155
query27	2019	465	333	333
query28	5114	2436	2426	2426
query29	687	552	441	441
query30	231	190	158	158
query31	957	906	797	797
query32	92	61	58	58
query33	511	354	300	300
query34	744	858	486	486
query35	798	800	748	748
query36	985	1046	942	942
query37	119	109	80	80
query38	4248	4277	4235	4235
query39	1445	1388	1412	1388
query40	197	114	102	102
query41	55	52	51	51
query42	121	105	104	104
query43	494	502	498	498
query44	1313	794	821	794
query45	175	174	166	166
query46	860	1057	635	635
query47	1859	1878	1793	1793
query48	386	394	324	324
query49	745	490	393	393
query50	610	673	377	377
query51	6894	6907	6926	6907
query52	103	103	89	89
query53	225	250	189	189
query54	486	491	423	423
query55	80	79	79	79
query56	263	295	246	246
query57	1204	1120	1105	1105
query58	250	234	235	234
query59	3032	3085	2948	2948
query60	297	273	255	255
query61	117	117	119	117
query62	833	714	654	654
query63	225	184	181	181
query64	3864	1000	649	649
query65	3253	3170	3128	3128
query66	944	399	299	299
query67	15786	15632	15491	15491
query68	2074	823	546	546
query69	425	294	264	264
query70	1227	1099	1146	1099
query71	322	286	255	255
query72	6042	3860	3839	3839
query73	703	740	354	354
query74	10036	9199	8921	8921
query75	3089	3159	2646	2646
query76	2233	1162	779	779
query77	337	361	283	283
query78	10058	10295	9654	9654
query79	995	877	591	591
query80	1260	528	484	484
query81	537	278	234	234
query82	510	154	119	119
query83	281	202	165	165
query84	240	95	68	68
query85	931	353	303	303
query86	405	323	302	302
query87	4512	4557	4390	4390
query88	3453	2213	2193	2193
query89	392	327	292	292
query90	1705	194	192	192
query91	135	140	108	108
query92	60	61	55	55
query93	952	871	531	531
query94	671	409	309	309
query95	348	260	249	249
query96	500	617	284	284
query97	2822	2838	2776	2776
query98	221	216	204	204
query99	1271	1384	1262	1262
Total cold run time: 277905 ms
Total hot run time: 187610 ms

doris-robot · 2025-01-16T10:57:53Z

ClickBench: Total hot run time: 30.69 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6ec6527ee4f1361cb4dc541acd90cc0e0aec967a, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.42	0.43	0.42
query6	1.16	0.64	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.61	0.50	0.51
query10	0.55	0.56	0.55
query11	0.14	0.10	0.11
query12	0.14	0.10	0.11
query13	0.60	0.61	0.59
query14	2.81	2.82	2.74
query15	0.90	0.84	0.82
query16	0.38	0.39	0.39
query17	1.07	1.03	1.07
query18	0.24	0.21	0.21
query19	1.93	1.89	2.03
query20	0.02	0.01	0.01
query21	15.36	0.93	0.59
query22	0.74	0.78	0.74
query23	15.21	1.40	0.60
query24	2.91	0.72	1.19
query25	0.23	0.11	0.21
query26	0.22	0.15	0.13
query27	0.07	0.06	0.05
query28	13.81	1.01	0.43
query29	12.56	3.92	3.30
query30	0.25	0.10	0.06
query31	2.82	0.61	0.40
query32	3.23	0.54	0.46
query33	2.96	2.98	3.00
query34	16.44	5.15	4.57
query35	4.62	4.54	4.53
query36	0.65	0.49	0.47
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.02
Total cold run time: 105.55 s
Total hot run time: 30.69 s

wuwenchi · 2025-01-17T08:18:10Z

run buildall

doris-robot · 2025-01-17T08:58:27Z

TPC-H: Total hot run time: 32150 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d48a6aad006acca5db5f47ea11a959c080f2160f, data reload: false

------ Round 1 ----------------------------------
q1	17582	5472	5387	5387
q2	2046	315	164	164
q3	10420	1225	722	722
q4	10230	961	503	503
q5	8039	2401	2129	2129
q6	191	166	132	132
q7	902	756	607	607
q8	9591	1394	1184	1184
q9	5311	4850	4871	4850
q10	6841	2314	1873	1873
q11	486	276	259	259
q12	338	352	218	218
q13	17754	3641	3112	3112
q14	235	234	218	218
q15	516	466	476	466
q16	611	632	596	596
q17	561	860	316	316
q18	6881	6529	6441	6441
q19	1572	942	516	516
q20	311	324	190	190
q21	2826	2306	1958	1958
q22	367	332	309	309
Total cold run time: 103611 ms
Total hot run time: 32150 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5480	5417	5422	5417
q2	238	333	230	230
q3	2240	2662	2317	2317
q4	1383	1808	1383	1383
q5	4301	4778	4595	4595
q6	163	157	125	125
q7	2062	1949	1826	1826
q8	2611	2775	2723	2723
q9	7318	7290	7301	7290
q10	3031	3291	2788	2788
q11	599	505	476	476
q12	653	714	594	594
q13	3487	3965	3232	3232
q14	285	303	293	293
q15	528	474	473	473
q16	660	724	659	659
q17	1220	1729	1277	1277
q18	7731	7432	7277	7277
q19	808	1146	1070	1070
q20	2019	2036	1884	1884
q21	5798	5133	4764	4764
q22	611	622	554	554
Total cold run time: 53226 ms
Total hot run time: 51247 ms

doris-robot · 2025-01-17T09:10:34Z

TPC-DS: Total hot run time: 193869 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d48a6aad006acca5db5f47ea11a959c080f2160f, data reload: false

query1	1299	969	931	931
query2	6419	2095	2036	2036
query3	10989	4500	4574	4500
query4	32631	23292	22969	22969
query5	3653	590	457	457
query6	282	200	187	187
query7	3980	494	304	304
query8	295	240	238	238
query9	9277	2569	2551	2551
query10	444	306	256	256
query11	18014	15207	14876	14876
query12	158	104	105	104
query13	1555	507	381	381
query14	9891	7114	6646	6646
query15	248	207	181	181
query16	7785	643	492	492
query17	1561	764	571	571
query18	2100	398	312	312
query19	219	189	167	167
query20	123	119	112	112
query21	215	133	122	122
query22	4618	4552	4538	4538
query23	34132	33419	34370	33419
query24	6827	2385	2322	2322
query25	460	463	379	379
query26	731	244	152	152
query27	2014	467	333	333
query28	5450	2457	2450	2450
query29	567	543	417	417
query30	223	193	163	163
query31	1049	869	816	816
query32	70	60	61	60
query33	489	355	305	305
query34	723	875	501	501
query35	825	849	767	767
query36	1018	1038	973	973
query37	132	103	84	84
query38	4364	4310	4321	4310
query39	1511	1440	1426	1426
query40	213	122	105	105
query41	58	56	57	56
query42	130	111	104	104
query43	524	547	509	509
query44	1345	838	854	838
query45	184	172	176	172
query46	878	1053	651	651
query47	1930	1967	1920	1920
query48	375	412	318	318
query49	713	486	431	431
query50	655	685	399	399
query51	7148	7054	7005	7005
query52	101	99	95	95
query53	224	255	225	225
query54	499	505	410	410
query55	85	81	85	81
query56	249	285	254	254
query57	1238	1217	1152	1152
query58	253	237	235	235
query59	3184	3180	3063	3063
query60	287	279	260	260
query61	116	118	118	118
query62	795	737	688	688
query63	230	191	185	185
query64	3019	1020	658	658
query65	3250	3157	3143	3143
query66	681	402	291	291
query67	15854	16020	15554	15554
query68	6555	815	516	516
query69	479	288	275	275
query70	1117	1100	1119	1100
query71	388	285	252	252
query72	5954	3912	3798	3798
query73	636	750	347	347
query74	10094	9181	8872	8872
query75	3237	3167	2660	2660
query76	3118	1194	759	759
query77	488	354	279	279
query78	10130	10087	9347	9347
query79	3774	817	583	583
query80	727	533	441	441
query81	504	274	235	235
query82	653	146	116	116
query83	217	177	153	153
query84	233	86	73	73
query85	776	342	301	301
query86	398	327	298	298
query87	4364	4438	4413	4413
query88	4807	2129	2109	2109
query89	409	322	287	287
query90	1740	193	252	193
query91	136	140	107	107
query92	66	57	52	52
query93	2535	855	529	529
query94	703	410	260	260
query95	337	269	255	255
query96	499	615	281	281
query97	2799	2843	2788	2788
query98	303	197	195	195
query99	1316	1394	1267	1267
Total cold run time: 290051 ms
Total hot run time: 193869 ms

doris-robot · 2025-01-17T09:15:52Z

ClickBench: Total hot run time: 30.54 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d48a6aad006acca5db5f47ea11a959c080f2160f, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.62	0.11	0.10
query5	0.43	0.41	0.43
query6	1.15	0.65	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.59	0.51	0.49
query10	0.54	0.58	0.54
query11	0.14	0.10	0.10
query12	0.14	0.10	0.10
query13	0.61	0.60	0.60
query14	2.72	2.77	2.73
query15	0.92	0.82	0.82
query16	0.38	0.38	0.36
query17	0.96	1.03	1.00
query18	0.24	0.22	0.21
query19	1.86	1.82	1.87
query20	0.02	0.01	0.01
query21	15.37	1.00	0.59
query22	0.74	0.77	0.55
query23	15.43	1.43	0.52
query24	2.93	1.57	0.97
query25	0.23	0.16	0.13
query26	0.29	0.14	0.13
query27	0.05	0.05	0.04
query28	14.14	0.98	0.43
query29	12.58	4.02	3.34
query30	0.25	0.09	0.06
query31	2.83	0.59	0.38
query32	3.22	0.55	0.45
query33	2.97	3.05	3.08
query34	16.49	5.16	4.52
query35	4.54	4.51	4.53
query36	0.83	0.47	0.50
query37	0.10	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.03	0.04	0.03
Total cold run time: 106.09 s
Total hot run time: 30.54 s

wuwenchi · 2025-01-20T07:28:31Z

run buildall

doris-robot · 2025-01-20T07:59:52Z

TPC-H: Total hot run time: 32524 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b731137e8da988548ae95a248f624a27f56383a5, data reload: false

------ Round 1 ----------------------------------
q1	17599	5583	5390	5390
q2	2058	326	198	198
q3	10479	1252	758	758
q4	10245	976	523	523
q5	7875	2409	2183	2183
q6	191	167	131	131
q7	898	754	631	631
q8	9243	1378	1216	1216
q9	5245	4914	4929	4914
q10	6845	2325	1913	1913
q11	482	285	264	264
q12	351	356	214	214
q13	17780	3735	3161	3161
q14	225	230	207	207
q15	522	481	491	481
q16	643	615	585	585
q17	581	884	322	322
q18	7359	6416	6521	6416
q19	2599	962	523	523
q20	302	322	187	187
q21	2827	2187	2001	2001
q22	365	340	306	306
Total cold run time: 104714 ms
Total hot run time: 32524 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5674	5458	5893	5458
q2	242	332	231	231
q3	2278	2676	2321	2321
q4	1437	1824	1387	1387
q5	4302	4768	4771	4768
q6	175	164	130	130
q7	2096	1966	1809	1809
q8	2630	2832	2714	2714
q9	7385	7282	7413	7282
q10	3010	3284	2770	2770
q11	562	505	488	488
q12	619	772	655	655
q13	3531	3912	3323	3323
q14	287	295	278	278
q15	501	495	471	471
q16	648	652	660	652
q17	1219	1740	1255	1255
q18	7803	7462	7267	7267
q19	793	1190	1066	1066
q20	1998	2030	1897	1897
q21	5806	5145	5033	5033
q22	602	587	552	552
Total cold run time: 53598 ms
Total hot run time: 51807 ms

doris-robot · 2025-01-20T08:12:29Z

TPC-DS: Total hot run time: 194900 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b731137e8da988548ae95a248f624a27f56383a5, data reload: false

query1	1304	968	921	921
query2	6310	1954	2004	1954
query3	11131	4545	4523	4523
query4	61355	30614	23344	23344
query5	5534	594	458	458
query6	460	186	171	171
query7	5551	518	290	290
query8	318	231	213	213
query9	8435	2607	2591	2591
query10	483	308	254	254
query11	17516	15085	15767	15085
query12	166	110	107	107
query13	1459	555	429	429
query14	10984	7332	7267	7267
query15	215	209	189	189
query16	6667	661	488	488
query17	1181	734	608	608
query18	845	411	294	294
query19	221	192	168	168
query20	122	117	113	113
query21	203	121	108	108
query22	4369	4814	4494	4494
query23	33706	33618	33766	33618
query24	5561	2243	2366	2243
query25	454	465	402	402
query26	629	276	161	161
query27	1767	470	339	339
query28	4366	2493	2452	2452
query29	528	572	423	423
query30	231	192	156	156
query31	937	866	845	845
query32	76	58	55	55
query33	476	362	300	300
query34	734	873	518	518
query35	831	840	753	753
query36	994	1073	970	970
query37	115	100	74	74
query38	4362	4296	4328	4296
query39	1496	1443	1464	1443
query40	207	116	100	100
query41	50	49	48	48
query42	121	110	104	104
query43	574	512	476	476
query44	1352	817	836	817
query45	185	172	177	172
query46	892	1050	656	656
query47	1889	1958	1887	1887
query48	401	392	319	319
query49	747	522	405	405
query50	666	674	398	398
query51	7031	6978	6987	6978
query52	102	99	90	90
query53	218	250	187	187
query54	481	515	426	426
query55	82	81	79	79
query56	275	249	253	249
query57	1223	1211	1096	1096
query58	236	226	234	226
query59	3022	3057	2832	2832
query60	271	265	246	246
query61	120	118	118	118
query62	749	702	663	663
query63	221	184	182	182
query64	1236	994	645	645
query65	3223	3143	3176	3143
query66	723	399	300	300
query67	15984	15629	15576	15576
query68	5066	822	536	536
query69	505	297	261	261
query70	1201	1107	1135	1107
query71	426	285	259	259
query72	5433	3791	3886	3791
query73	796	740	348	348
query74	10110	9057	9092	9057
query75	3198	3154	2668	2668
query76	3836	1171	767	767
query77	497	381	277	277
query78	10045	9929	9264	9264
query79	3240	795	593	593
query80	1668	616	440	440
query81	564	269	243	243
query82	485	153	120	120
query83	261	184	163	163
query84	285	102	76	76
query85	801	356	305	305
query86	460	311	308	308
query87	4344	4477	4406	4406
query88	4779	2169	2132	2132
query89	404	319	288	288
query90	1615	193	195	193
query91	134	143	107	107
query92	63	59	52	52
query93	2758	875	521	521
query94	757	412	303	303
query95	334	268	265	265
query96	489	629	287	287
query97	2820	2887	2754	2754
query98	229	202	192	192
query99	1306	1363	1282	1282
Total cold run time: 313282 ms
Total hot run time: 194900 ms

doris-robot · 2025-01-20T08:17:49Z

ClickBench: Total hot run time: 31 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b731137e8da988548ae95a248f624a27f56383a5, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.42	0.40	0.43
query6	1.16	0.66	0.66
query7	0.02	0.01	0.01
query8	0.03	0.03	0.03
query9	0.59	0.51	0.49
query10	0.54	0.57	0.55
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.61	0.61	0.61
query14	2.73	2.75	2.73
query15	0.90	0.82	0.82
query16	0.38	0.39	0.38
query17	0.97	1.00	0.98
query18	0.22	0.20	0.20
query19	1.97	1.90	2.00
query20	0.01	0.02	0.01
query21	15.36	0.93	0.61
query22	0.76	0.78	0.62
query23	15.36	1.40	0.53
query24	3.34	1.21	1.09
query25	0.19	0.15	0.18
query26	0.20	0.15	0.14
query27	0.08	0.08	0.06
query28	14.21	1.02	0.44
query29	12.57	3.93	3.31
query30	0.25	0.09	0.06
query31	2.83	0.59	0.38
query32	3.24	0.54	0.46
query33	2.94	3.00	3.03
query34	16.52	5.18	4.53
query35	4.59	4.60	4.63
query36	0.65	0.50	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.04	0.03	0.02
query40	0.16	0.14	0.14
query41	0.07	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.36 s
Total hot run time: 31 s

wuwenchi · 2025-01-24T09:12:45Z

run buildall

doris-robot · 2025-01-24T09:31:39Z

TPC-H: Total hot run time: 32553 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 970aa72a031b2210444e6582690f7ecbcac4d46b, data reload: false

------ Round 1 ----------------------------------
q1	17587	5580	5473	5473
q2	2042	304	172	172
q3	10418	1296	732	732
q4	10210	989	541	541
q5	7496	2452	2173	2173
q6	197	171	138	138
q7	911	774	613	613
q8	9224	1371	1140	1140
q9	5257	4914	4932	4914
q10	6862	2353	1904	1904
q11	482	263	265	263
q12	343	367	226	226
q13	17783	3717	3117	3117
q14	225	241	212	212
q15	526	489	464	464
q16	640	601	592	592
q17	562	883	331	331
q18	6983	6469	6589	6469
q19	1212	941	523	523
q20	308	329	197	197
q21	2913	2186	2041	2041
q22	378	335	318	318
Total cold run time: 102559 ms
Total hot run time: 32553 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5518	5558	5542	5542
q2	232	325	243	243
q3	2266	2638	2334	2334
q4	1464	1866	1370	1370
q5	4314	4735	4649	4649
q6	165	160	130	130
q7	2078	2021	1895	1895
q8	2675	2825	2697	2697
q9	7231	7190	7195	7190
q10	3032	3220	2799	2799
q11	598	513	500	500
q12	674	740	605	605
q13	3522	4088	3363	3363
q14	302	293	267	267
q15	526	469	470	469
q16	663	689	626	626
q17	1212	1724	1261	1261
q18	7778	7419	7396	7396
q19	840	1060	1143	1060
q20	2017	2074	1891	1891
q21	5767	5170	5089	5089
q22	575	600	556	556
Total cold run time: 53449 ms
Total hot run time: 51932 ms

doris-robot · 2025-01-24T09:43:20Z

TPC-DS: Total hot run time: 184758 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 970aa72a031b2210444e6582690f7ecbcac4d46b, data reload: false

query1	985	377	373	373
query2	6529	2090	2040	2040
query3	6782	218	210	210
query4	34073	23379	23206	23206
query5	4408	618	459	459
query6	289	201	185	185
query7	4611	494	306	306
query8	303	257	214	214
query9	9550	2595	2607	2595
query10	461	306	237	237
query11	18167	15179	14982	14982
query12	160	107	106	106
query13	1650	514	381	381
query14	9689	7440	6343	6343
query15	230	188	185	185
query16	8044	597	446	446
query17	1593	726	590	590
query18	2126	402	310	310
query19	230	185	176	176
query20	121	116	112	112
query21	212	123	104	104
query22	4188	4309	4152	4152
query23	33966	32896	33027	32896
query24	6531	2231	2293	2231
query25	516	476	421	421
query26	1211	275	162	162
query27	1990	472	342	342
query28	5313	2457	2422	2422
query29	754	568	445	445
query30	236	201	158	158
query31	943	922	835	835
query32	89	65	61	61
query33	518	368	308	308
query34	749	862	517	517
query35	856	822	737	737
query36	1011	1026	942	942
query37	128	103	73	73
query38	4056	4162	4231	4162
query39	1457	1382	1400	1382
query40	204	114	101	101
query41	58	52	51	51
query42	124	104	102	102
query43	509	525	471	471
query44	1295	812	800	800
query45	185	168	162	162
query46	867	1039	636	636
query47	1843	1840	1768	1768
query48	382	400	356	356
query49	782	488	412	412
query50	626	656	407	407
query51	4126	4180	4180	4180
query52	106	101	94	94
query53	243	264	202	202
query54	482	486	415	415
query55	83	78	78	78
query56	262	272	253	253
query57	1163	1137	1077	1077
query58	254	236	234	234
query59	3078	3087	2914	2914
query60	269	267	260	260
query61	126	117	114	114
query62	792	722	661	661
query63	230	191	188	188
query64	4461	1004	637	637
query65	3241	3212	3226	3212
query66	1054	395	307	307
query67	15973	15658	15445	15445
query68	4807	820	536	536
query69	476	299	266	266
query70	1205	1082	1110	1082
query71	389	307	260	260
query72	5800	3812	3833	3812
query73	654	754	370	370
query74	10519	9046	9039	9039
query75	3153	3148	2663	2663
query76	3131	1186	780	780
query77	457	382	284	284
query78	10014	10116	9380	9380
query79	2439	836	603	603
query80	1689	532	441	441
query81	564	278	231	231
query82	356	149	122	122
query83	271	174	148	148
query84	239	102	83	83
query85	793	341	302	302
query86	391	328	305	305
query87	4506	4513	4292	4292
query88	3527	2231	2186	2186
query89	410	332	298	298
query90	1754	200	198	198
query91	135	142	111	111
query92	60	57	51	51
query93	1054	926	534	534
query94	692	417	306	306
query95	349	278	257	257
query96	483	608	281	281
query97	2766	2899	2734	2734
query98	224	213	194	194
query99	1277	1401	1266	1266
Total cold run time: 282127 ms
Total hot run time: 184758 ms

doris-robot · 2025-01-24T09:48:39Z

ClickBench: Total hot run time: 30.98 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 970aa72a031b2210444e6582690f7ecbcac4d46b, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.63	0.10	0.11
query5	0.41	0.42	0.40
query6	1.15	0.65	0.67
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.53
query10	0.56	0.56	0.55
query11	0.14	0.10	0.10
query12	0.15	0.11	0.11
query13	0.62	0.60	0.59
query14	2.72	2.88	2.76
query15	0.90	0.82	0.83
query16	0.37	0.38	0.39
query17	1.01	1.06	1.02
query18	0.23	0.21	0.21
query19	1.98	1.81	1.98
query20	0.01	0.02	0.01
query21	15.36	0.95	0.59
query22	0.75	0.93	0.89
query23	14.97	1.46	0.51
query24	3.32	0.91	1.44
query25	0.22	0.12	0.16
query26	0.20	0.15	0.14
query27	0.05	0.05	0.05
query28	14.01	1.04	0.44
query29	12.58	4.00	3.30
query30	0.25	0.10	0.06
query31	2.81	0.60	0.40
query32	3.23	0.55	0.47
query33	3.05	3.00	3.05
query34	16.78	5.13	4.55
query35	4.67	4.56	4.55
query36	0.64	0.52	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.26 s
Total hot run time: 30.98 s

wuwenchi · 2025-01-26T08:26:52Z

run buildall

doris-robot · 2025-01-26T08:45:39Z

TPC-H: Total hot run time: 32180 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6b5ae4d463bbcdbe6892c2846d2fbdbab423557a, data reload: false

------ Round 1 ----------------------------------
q1	17597	5392	5368	5368
q2	2047	328	168	168
q3	10498	1296	717	717
q4	10258	979	522	522
q5	8854	2403	2182	2182
q6	191	161	131	131
q7	892	755	597	597
q8	9248	1365	1174	1174
q9	5980	4899	4936	4899
q10	6885	2355	1870	1870
q11	482	273	255	255
q12	338	351	216	216
q13	17789	3646	3077	3077
q14	223	225	206	206
q15	522	466	467	466
q16	634	629	595	595
q17	586	871	319	319
q18	7060	6532	6429	6429
q19	1286	945	547	547
q20	303	328	199	199
q21	2837	2140	1934	1934
q22	362	329	309	309
Total cold run time: 104872 ms
Total hot run time: 32180 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5471	5446	5479	5446
q2	237	326	241	241
q3	2235	2660	2329	2329
q4	1379	1838	1375	1375
q5	4325	4718	4689	4689
q6	178	175	131	131
q7	2102	1939	1852	1852
q8	2654	2779	2728	2728
q9	7343	7221	7313	7221
q10	2983	3241	2769	2769
q11	600	512	492	492
q12	653	778	629	629
q13	3550	3845	3294	3294
q14	286	296	265	265
q15	519	468	474	468
q16	649	698	636	636
q17	1207	1749	1241	1241
q18	7749	7504	7252	7252
q19	784	1099	1080	1080
q20	2039	2001	1917	1917
q21	5572	5243	4895	4895
q22	598	590	535	535
Total cold run time: 53113 ms
Total hot run time: 51485 ms

doris-robot · 2025-01-26T08:57:17Z

TPC-DS: Total hot run time: 184943 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6b5ae4d463bbcdbe6892c2846d2fbdbab423557a, data reload: false

query1	967	389	368	368
query2	6539	2056	1970	1970
query3	6788	226	219	219
query4	33688	23201	23330	23201
query5	4318	603	434	434
query6	274	201	179	179
query7	4591	492	310	310
query8	307	256	232	232
query9	9476	2717	2692	2692
query10	487	308	257	257
query11	17963	15369	14987	14987
query12	158	108	107	107
query13	1663	537	420	420
query14	9821	7123	6878	6878
query15	233	197	193	193
query16	8078	632	463	463
query17	1615	737	568	568
query18	2121	406	299	299
query19	227	185	158	158
query20	120	114	114	114
query21	215	122	106	106
query22	4020	4353	4081	4081
query23	34038	33150	33087	33087
query24	6867	2276	2313	2276
query25	510	449	370	370
query26	1208	269	154	154
query27	2047	463	342	342
query28	5140	2482	2424	2424
query29	727	542	450	450
query30	233	193	160	160
query31	947	900	786	786
query32	91	60	63	60
query33	519	368	297	297
query34	724	850	498	498
query35	789	816	721	721
query36	982	1045	946	946
query37	120	100	77	77
query38	4108	4157	4049	4049
query39	1425	1396	1393	1393
query40	203	115	104	104
query41	54	51	50	50
query42	120	100	106	100
query43	519	522	481	481
query44	1313	833	809	809
query45	178	174	159	159
query46	847	1032	634	634
query47	1813	1829	1722	1722
query48	372	401	312	312
query49	785	484	389	389
query50	632	640	404	404
query51	4201	4212	4172	4172
query52	108	102	89	89
query53	230	252	191	191
query54	485	484	405	405
query55	90	81	80	80
query56	261	253	283	253
query57	1168	1140	1104	1104
query58	249	241	248	241
query59	2940	3163	3014	3014
query60	287	266	253	253
query61	115	112	109	109
query62	798	724	650	650
query63	216	193	190	190
query64	4551	1009	627	627
query65	3212	3166	3189	3166
query66	1050	406	317	317
query67	15937	15640	15397	15397
query68	3543	847	528	528
query69	452	293	250	250
query70	1199	1140	1121	1121
query71	392	301	279	279
query72	5849	3773	3850	3773
query73	657	755	354	354
query74	9763	8694	8991	8694
query75	3144	3122	2644	2644
query76	3135	1178	754	754
query77	486	373	283	283
query78	10037	10099	9254	9254
query79	2437	806	617	617
query80	1339	580	451	451
query81	558	276	231	231
query82	356	155	121	121
query83	180	176	153	153
query84	238	88	82	82
query85	751	376	303	303
query86	417	292	302	292
query87	4304	4500	4485	4485
query88	4153	2234	2200	2200
query89	385	334	300	300
query90	1750	198	197	197
query91	140	134	109	109
query92	69	58	56	56
query93	1261	875	553	553
query94	697	408	307	307
query95	328	271	256	256
query96	512	617	290	290
query97	2769	2819	2788	2788
query98	227	212	200	200
query99	1287	1388	1270	1270
Total cold run time: 279693 ms
Total hot run time: 184943 ms

doris-robot · 2025-01-26T09:02:37Z

ClickBench: Total hot run time: 30.73 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6b5ae4d463bbcdbe6892c2846d2fbdbab423557a, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.03	0.03
query3	0.24	0.08	0.06
query4	1.60	0.10	0.11
query5	0.42	0.41	0.41
query6	1.19	0.67	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.59	0.51	0.50
query10	0.55	0.56	0.54
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.72	2.78	2.74
query15	0.91	0.83	0.83
query16	0.38	0.39	0.39
query17	1.05	1.05	1.09
query18	0.23	0.20	0.20
query19	1.95	1.86	2.00
query20	0.02	0.01	0.01
query21	15.36	0.95	0.59
query22	0.74	0.85	0.86
query23	15.03	1.45	0.56
query24	2.87	0.84	1.97
query25	0.26	0.06	0.14
query26	0.24	0.17	0.14
query27	0.06	0.05	0.07
query28	14.25	1.06	0.43
query29	12.87	3.97	3.26
query30	0.25	0.09	0.06
query31	2.83	0.61	0.39
query32	3.25	0.55	0.46
query33	2.99	3.01	3.06
query34	16.63	5.13	4.48
query35	4.49	4.51	4.53
query36	0.64	0.50	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.17 s
Total hot run time: 30.73 s

github-actions · 2025-01-26T15:54:57Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-01-26T15:54:59Z

PR approved by anyone and no changes requested.

wuwenchi · 2025-01-27T03:28:40Z

run feut

morningman · 2025-01-31T16:54:24Z

run buildall

doris-robot · 2025-01-31T17:32:33Z

TPC-H: Total hot run time: 32054 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e240ca420c2d0dd67223b7036b55391752c4a804, data reload: false

------ Round 1 ----------------------------------
q1	17589	5466	5330	5330
q2	2049	302	171	171
q3	10415	1209	727	727
q4	10204	954	523	523
q5	7532	2336	2142	2142
q6	186	164	141	141
q7	917	766	596	596
q8	9217	1347	1178	1178
q9	5216	4863	4858	4858
q10	6840	2317	1872	1872
q11	480	282	248	248
q12	338	356	224	224
q13	17782	3656	3142	3142
q14	223	225	212	212
q15	515	459	465	459
q16	621	612	582	582
q17	547	847	315	315
q18	7056	6351	6385	6351
q19	1208	954	537	537
q20	296	314	190	190
q21	2755	2148	1950	1950
q22	368	326	306	306
Total cold run time: 102354 ms
Total hot run time: 32054 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5449	5471	5499	5471
q2	240	331	230	230
q3	2241	2622	2327	2327
q4	1415	1842	1363	1363
q5	4354	4690	4703	4690
q6	173	159	125	125
q7	1986	2019	1906	1906
q8	2676	2884	2780	2780
q9	7573	7346	7475	7346
q10	3091	3326	2819	2819
q11	576	502	503	502
q12	664	788	610	610
q13	3538	3936	3221	3221
q14	280	306	293	293
q15	518	489	481	481
q16	665	680	650	650
q17	1220	1729	1277	1277
q18	7745	7700	7501	7501
q19	821	1086	1132	1086
q20	2112	2129	1985	1985
q21	5962	5218	5182	5182
q22	623	627	614	614
Total cold run time: 53922 ms
Total hot run time: 52459 ms

doris-robot · 2025-01-31T17:44:34Z

TPC-DS: Total hot run time: 190757 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e240ca420c2d0dd67223b7036b55391752c4a804, data reload: false

query1	2328	953	932	932
query2	6138	2027	2022	2022
query3	10969	4583	4509	4509
query4	32452	23600	23075	23075
query5	4865	615	463	463
query6	295	217	187	187
query7	3990	480	308	308
query8	295	237	235	235
query9	9341	2632	2641	2632
query10	506	307	265	265
query11	17803	15276	14948	14948
query12	153	107	103	103
query13	1608	516	403	403
query14	11134	7156	6538	6538
query15	232	199	186	186
query16	7925	653	489	489
query17	1545	739	567	567
query18	2095	403	306	306
query19	197	211	152	152
query20	120	122	110	110
query21	205	122	102	102
query22	4484	4576	4362	4362
query23	34285	33515	33490	33490
query24	6329	2275	2248	2248
query25	509	452	408	408
query26	799	283	156	156
query27	2195	474	341	341
query28	5530	2512	2482	2482
query29	654	560	421	421
query30	210	189	164	164
query31	961	883	838	838
query32	81	59	55	55
query33	479	366	297	297
query34	801	884	514	514
query35	839	848	750	750
query36	1002	1038	948	948
query37	128	93	78	78
query38	4320	4398	4272	4272
query39	1479	1435	1439	1435
query40	203	113	105	105
query41	57	50	49	49
query42	123	102	99	99
query43	538	526	485	485
query44	1314	833	825	825
query45	179	177	165	165
query46	863	1042	645	645
query47	1928	1976	1884	1884
query48	401	408	324	324
query49	729	491	408	408
query50	645	679	393	393
query51	4331	4338	4269	4269
query52	111	103	100	100
query53	236	265	205	205
query54	501	531	416	416
query55	82	80	82	80
query56	282	268	279	268
query57	1241	1245	1158	1158
query58	257	238	236	236
query59	3102	3304	3074	3074
query60	295	289	270	270
query61	147	140	139	139
query62	771	783	671	671
query63	231	190	192	190
query64	3667	1036	666	666
query65	3292	3293	3226	3226
query66	943	413	315	315
query67	16379	15852	15358	15358
query68	7373	804	519	519
query69	466	291	257	257
query70	1231	1125	1147	1125
query71	392	283	252	252
query72	5959	3776	3853	3776
query73	662	746	358	358
query74	9859	8862	8758	8758
query75	3196	3131	2658	2658
query76	3094	1148	778	778
query77	466	348	271	271
query78	10012	9957	9251	9251
query79	2852	786	593	593
query80	681	523	441	441
query81	483	277	235	235
query82	436	155	119	119
query83	170	173	163	163
query84	235	85	74	74
query85	798	364	293	293
query86	382	319	297	297
query87	4444	4418	4379	4379
query88	4684	2142	2125	2125
query89	390	326	343	326
query90	1830	191	182	182
query91	131	137	105	105
query92	63	58	51	51
query93	2454	863	519	519
query94	681	398	299	299
query95	341	267	245	245
query96	491	606	289	289
query97	2770	2850	2765	2765
query98	223	197	195	195
query99	1253	1399	1245	1245
Total cold run time: 290631 ms
Total hot run time: 190757 ms

doris-robot · 2025-01-31T17:49:53Z

ClickBench: Total hot run time: 30.32 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e240ca420c2d0dd67223b7036b55391752c4a804, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.64	0.10	0.10
query5	0.39	0.42	0.42
query6	1.15	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.56	0.51	0.52
query10	0.55	0.57	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	2.82	2.84	2.77
query15	0.91	0.83	0.83
query16	0.37	0.38	0.40
query17	1.05	1.05	0.95
query18	0.23	0.20	0.21
query19	1.89	1.80	2.03
query20	0.01	0.01	0.02
query21	15.36	0.92	0.57
query22	0.76	0.82	0.56
query23	15.36	1.46	0.60
query24	3.30	1.10	0.84
query25	0.22	0.19	0.06
query26	0.20	0.15	0.14
query27	0.08	0.05	0.04
query28	13.99	1.03	0.43
query29	12.54	3.97	3.28
query30	0.25	0.09	0.06
query31	2.84	0.59	0.39
query32	3.23	0.54	0.47
query33	2.98	2.96	3.05
query34	16.50	5.12	4.50
query35	4.49	4.46	4.48
query36	0.65	0.50	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.12 s
Total hot run time: 30.32 s

wuwenchi · 2025-02-01T06:48:09Z

run p0

wuwenchi requested review from CalvinKirs and morningman as code owners January 14, 2025 12:14

morningman reviewed Jan 15, 2025

View reviewed changes

morningman added dev/2.1.x-experimental dev/3.0.x-experimental labels Jan 16, 2025

wuwenchi force-pushed the fix-paimon-1.0 branch from 6ec6527 to d48a6aa Compare January 17, 2025 05:09

wuwenchi changed the title ~~[opt](paimon)Upgrade the Paimon version to 1.0.0~~ [opt](paimon)Upgrade the Paimon version to 1.0.0 and Iceberg to 1.6.1 Jan 21, 2025

wuwenchi force-pushed the fix-paimon-1.0 branch from b731137 to e0689f2 Compare January 24, 2025 03:30

morningman approved these changes Jan 26, 2025

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 26, 2025

github-actions bot added the reviewed label Jan 26, 2025

CalvinKirs approved these changes Jan 27, 2025

View reviewed changes

wuwenchi added 3 commits February 1, 2025 00:54

fix

8638034

fix test

083d6f4

fix test

e240ca4

morningman force-pushed the fix-paimon-1.0 branch from 6b5ae4d to e240ca4 Compare January 31, 2025 16:54

morningman approved these changes Feb 1, 2025

View reviewed changes

morningman merged commit 6cbde0c into apache:master Feb 1, 2025
24 checks passed

[opt](paimon)Upgrade the Paimon version to 1.0.0 and Iceberg to 1.6.1 #46990

[opt](paimon)Upgrade the Paimon version to 1.0.0 and Iceberg to 1.6.1 #46990

Conversation

wuwenchi commented Jan 14, 2025 • edited Loading

What problem does this PR solve?

Check List (For Author)

Check List (For Reviewer who merge this PR)

hello-stephen commented Jan 14, 2025

wuwenchi commented Jan 15, 2025

doris-robot commented Jan 15, 2025

doris-robot commented Jan 15, 2025

doris-robot commented Jan 15, 2025

morningman Jan 15, 2025

Choose a reason for hiding this comment

wuwenchi Jan 15, 2025

Choose a reason for hiding this comment

wuwenchi commented Jan 16, 2025

doris-robot commented Jan 16, 2025

doris-robot commented Jan 16, 2025

doris-robot commented Jan 16, 2025

wuwenchi commented Jan 17, 2025

doris-robot commented Jan 17, 2025

doris-robot commented Jan 17, 2025

doris-robot commented Jan 17, 2025

wuwenchi commented Jan 20, 2025

doris-robot commented Jan 20, 2025

doris-robot commented Jan 20, 2025

doris-robot commented Jan 20, 2025

wuwenchi commented Jan 24, 2025

doris-robot commented Jan 24, 2025

doris-robot commented Jan 24, 2025

doris-robot commented Jan 24, 2025

wuwenchi commented Jan 26, 2025

doris-robot commented Jan 26, 2025

doris-robot commented Jan 26, 2025

doris-robot commented Jan 26, 2025

github-actions bot commented Jan 26, 2025

github-actions bot commented Jan 26, 2025

wuwenchi commented Jan 27, 2025

morningman commented Jan 31, 2025

doris-robot commented Jan 31, 2025

doris-robot commented Jan 31, 2025

doris-robot commented Jan 31, 2025

wuwenchi commented Feb 1, 2025

wuwenchi commented Jan 14, 2025 •

edited

Loading