Skip to content
CI

[KYUUBI #5738][FEATURE] Add a spark commit protocol to support compact small file before commit job #18540

Sign in to view logs

[KYUUBI #5738][FEATURE] Add a spark commit protocol to support compact small file before commit job

[KYUUBI #5738][FEATURE] Add a spark commit protocol to support compact small file before commit job #18540

Triggered via pull request November 23, 2023 10:16
@AngersZhuuuuAngersZhuuuu
synchronize #5758
AngersZhuuuu:KYUUBI-5738
Status Failure
Total duration 1h 35m 12s
Artifacts 1

master.yml

on: pull_request
TPC-H and TPC-DS Tests
35m 8s
TPC-H and TPC-DS Tests
Kyuubi Server On Kubernetes Integration Test
12m 57s
Kyuubi Server On Kubernetes Integration Test
Spark Engine On Kubernetes Integration Test
19m 39s
Spark Engine On Kubernetes Integration Test
Matrix: Kyuubi and Spark Test
Matrix: Flink Test
Matrix: Hive Test
Matrix: JDBC Test
Matrix: Scala Test
Matrix: Trino Test
Matrix: Zookeeper Integration Test
Fit to window
Zoom out
Zoom in

Annotations

46 errors and 2 warnings
Kyuubi Server On Kubernetes Integration Test
Process completed with exit code 1.
Kyuubi Server On Kubernetes Integration Test
Process completed with exit code 1.
Kyuubi Server On Kubernetes Integration Test
Process completed with exit code 1.
Kyuubi Server On Kubernetes Integration Test
buildx failed with: ERROR: failed to solve: process "/bin/sh -c apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y bash python3 && ln -snf /bin/bash /bin/sh && ./build/dist ${MVN_ARG} && mv /workspace/kyuubi/dist /opt/kyuubi && rm -rf ~/.m2 && rm -rf /workspace/kyuubi" did not complete successfully: exit code: 1
Spark Engine On Kubernetes Integration Test
Process completed with exit code 1.
Kyuubi and Spark Test (17, 3.5, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.5, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (17, 3.5, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.5, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.5, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (17, 3.5, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (8, 3.5, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.5, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (17, 3.4, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.4, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (17, 3.4, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.4, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.4, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (17, 3.4, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.3, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.3, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (17, 3.3, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.3, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (17, 3.3, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (17, 3.3, normal)
Cannot invoke "org.apache.kyuubi.engine.KyuubiApplicationManager.killApplication(org.apache.kyuubi.engine.ApplicationManagerInfo, String, scala.Option)" because "$this.engineManager" is null
Kyuubi and Spark Test (11, 3.5, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.5, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.1, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.1, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.2, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.2, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.2, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.2, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.4, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.4, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.1, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.1, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.4, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.4, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.3, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (11, 3.3, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.3, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Kyuubi and Spark Test (8, 3.3, normal)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Scala Test (2.13, 8, 3.4)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Scala Test (2.13, 8, 3.4)
Timeout to lock on path [/engine_test2_1.9.0-SNAPSHOT_USER_SPARK_SQL_lock/runner/default] after 4500 ms. There would be some problem that other session may create engine timeout.
Scala Test (2.13, 8, 3.4)
Process completed with exit code 1.
Kyuubi Server On Kubernetes Integration Test
No files were found with the provided path: **/target/unit-tests.log **/target/work/**. No artifacts will be uploaded.
Spark Engine On Kubernetes Integration Test
No files were found with the provided path: **/target/unit-tests.log **/kyuubi-spark-sql-engine.log* **/kyuubi-spark-batch-submit.log*. No artifacts will be uploaded.

Artifacts

Produced during runtime
Name Size
unit-tests-log-scala-2.13-java-8-spark-3.4 Expired
1.88 GB