PR Build

perf: Reduce native shuffle memory overhead by 50% #4467

Sign in to view logs

Triggered via pull request February 28, 2025 14:24

andygrove

synchronize #1452

andygrove:shuffle-no-double-alloc

Status Cancelled

Total duration 3m 7s

Artifacts –

pr_build.yml

on: pull_request

Matrix: linux-test-with-old-spark

Matrix: linux-test-with-spark4_0

Matrix: linux-test

Matrix: macos-aarch64-test-with-old-spark

Matrix: macos-aarch64-test-with-spark4_0

Matrix: macos-aarch64-test

Matrix: macos-test-with-spark4_0

Matrix: macos-test

Annotations

44 errors

macos-14(Silicon)/java 17-spark-3.4-scala-2.12/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 11-spark-3.4-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 8-spark-3.5-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 11-spark-3.3-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-3.3-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 8-spark-3.3-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-3.4-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-3.5-scala-2.13/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 8-spark-3.5-scala-2.13/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-3.5-scala-2.12/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-3.4-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 11-spark-3.4-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-4.0/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 8-spark-3.4-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-3.5-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 11-spark-3.3-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-3.3-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 17-spark-3.5-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 8-spark-3.5-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 8-spark-3.5-scala-2.12/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 8-spark-3.4-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

ubuntu-latest/java 8-spark-3.3-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.4-scala-2.13/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.5-scala-2.12/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.4-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.5-scala-2.13/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.4-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.5-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.5-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.4-scala-2.13/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.5-scala-2.13/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.5-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.5-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.4-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.3-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.4-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.4-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.4-scala-2.12/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.4-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-4.0/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 17-spark-3.3-scala-2.12/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.5-scala-2.12/rust

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.4-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists

macos-14(Silicon)/java 8-spark-3.4-scala-2.13/java

Canceling since a higher priority waiting request for 'apache/datafusion-comet-shuffle-no-double-alloc-PR Build' exists