[KYUUBI #5738][FEATURE] Add a spark commit protocol to support compact small file before commit job #18540
Job | Run time |
---|---|
50m 21s | |
1h 22m 31s | |
51m 13s | |
25m 52s | |
32m 1s | |
1h 23m 27s | |
51m 20s | |
27m 57s | |
1h 25m 38s | |
53m 38s | |
1h 25m 23s | |
12m 57s | |
51m 44s | |
1h 13m 30s | |
1h 33m 30s | |
48m 49s | |
1h 24m 55s | |
23m 54s | |
1h 24m 3s | |
19m 39s | |
35m 8s | |
23m 43s | |
1h 25m 33s | |
1h 24m 36s | |
31m 1s | |
1h 17m 25s | |
10m 2s | |
30m 42s | |
1h 17m 11s | |
10m 38s | |
1h 16m 21s | |
10m 41s | |
1h 4m 5s | |
10m 11s | |
1h 20m 38s | |
1h 17m 35s | |
1h 19m 27s | |
1h 30m 25s | |
1d 10h 37m 44s |