Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"Archery test With other arrows" integration tests are failing #5719

Closed
alamb opened this issue May 4, 2024 · 14 comments · Fixed by #5761
Closed

"Archery test With other arrows" integration tests are failing #5719

alamb opened this issue May 4, 2024 · 14 comments · Fixed by #5761
Labels
arrow Changes to the arrow crate bug documentation Improvements or additions to documentation help wanted parquet Changes to the parquet crate

Comments

@alamb
Copy link
Contributor

alamb commented May 4, 2024

Describe the bug
The CI test is failing on unrelated PRs. For example #5713 and #5710

Examples
https://github.com/apache/arrow-rs/actions/runs/8946495425/job/24577217807?pr=5713
https://github.com/apache/arrow-rs/actions/runs/8939077861/job/24566295491?pr=5710

Example failure:

error: linking with `cc` failed: exit status: 1
  |
  = note: LC_ALL="C" PATH="/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/bin:/opt/conda/envs/arrow/bin:/opt/conda/condabin:/root/.cargo/bin:/opt/conda/envs/arrow/bin:/opt/dotnet:/opt/go/bin:/opt/conda/envs/arrow/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin" VSLANG="1033" "cc" "-m64" "/tmp/rustc3q1NBo/symbols.o" "/build/rust/debug/build/proc-macro2-e1c9616b390a0fae/build_script_build-e1c9616b390a0fae.build_script_build.14a851ef5971097e-cgu.0.rcgu.o" "/build/rust/debug/build/proc-macro2-e1c9616b390a0fae/build_script_build-e1c9616b390a0fae.build_script_build.14a851ef5971097e-cgu.1.rcgu.o" "/build/rust/debug/build/proc-macro2-e1c9616b390a0fae/build_script_build-e1c9616b390a0fae.4sbifmcmrozjtl2m.rcgu.o" "-Wl,--as-needed" "-L" "/build/rust/debug/deps" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-Wl,-Bstatic" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd-d2ef02247056996e.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libpanic_unwind-fde67f6c4eccaa42.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libobject-2549d0ec992a5666.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libmemchr-bb9bfc0931d5cad0.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libaddr2line-7c0b91fdc4adc2c5.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libgimli-6ec164769e6c2957.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_demangle-95326caaef561554.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd_detect-704dba0df3717bb7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libhashbrown-5f0117cb69112303.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_alloc-7a95907f1ed0cea5.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libminiz_oxide-d4aa666f8242aefc.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libadler-9abec8861e966bc7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libunwind-863ac378b60eeb30.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcfg_if-fc8aa5b7d220f0a9.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liblibc-0cc850f1e941238d.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liballoc-f7b445210e88e768.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_core-f37052492751c579.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcore-fd15ec7f305d48e7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcompiler_builtins-d700583125da6701.rlib" "-Wl,-Bdynamic" "-lgcc_s" "-lutil" "-lrt" "-lpthread" "-lm" "-ldl" "-lc" "-Wl,--eh-frame-hdr" "-Wl,-z,noexecstack" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-o" "/build/rust/debug/build/proc-macro2-e1c9616b390a0fae/build_script_build-e1c9616b390a0fae" "-Wl,--gc-sections" "-pie" "-Wl,-z,relro,-z,now" "-nodefaultlibs"
  = note: /opt/conda/envs/arrow/bin/../lib/gcc/x86_64-conda-linux-gnu/12.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: /root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd-d2ef02247056996e.rlib(std-d2ef02247056996e.std.e4dfbc2c3f4b09f1-cgu.0.rcgu.o): in function `std::sys::pal::unix::stack_overflow::imp::sigstack_size':
          /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/stack_overflow.rs:216: undefined reference to `getauxval'
          /opt/conda/envs/arrow/bin/../lib/gcc/x86_64-conda-linux-gnu/12.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/stack_overflow.rs:216: undefined reference to `getauxval'
          collect2: error: ld returned 1 exit status
          
  = note: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
  = note: use the `-l` flag to specify native libraries to link
  = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#rustc-link-lib)

error: could not compile `proc-macro2` (build script) due to 1 previous error
warning: build failed, waiting for other jobs to finish...
error: linking with `cc` failed: exit status: 1
  |
  = note: LC_ALL="C" PATH="/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/bin:/opt/conda/envs/arrow/bin:/opt/conda/condabin:/root/.cargo/bin:/opt/conda/envs/arrow/bin:/opt/dotnet:/opt/go/bin:/opt/conda/envs/arrow/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin" VSLANG="1033" "cc" "-m64" "/tmp/rustcD6ur0p/symbols.o" "/build/rust/debug/build/libc-a5f595ef1ee1b008/build_script_build-a5f595ef1ee1b008.build_script_build.bed1d3ed[193](https://github.com/apache/arrow-rs/actions/runs/8939077861/job/24566295491?pr=5710#step:10:194)79003-cgu.0.rcgu.o" "/build/rust/debug/build/libc-a5f595ef1ee1b008/build_script_build-a5f595ef1ee1b008.build_script_build.bed1d3ed19379003-cgu.1.rcgu.o" "/build/rust/debug/build/libc-a5f595ef1ee1b008/build_script_build-a5f595ef1ee1b008.build_script_build.bed1d3ed19379003-cgu.2.rcgu.o" "/build/rust/debug/build/libc-a5f595ef1ee1b008/build_script_build-a5f595ef1ee1b008.build_script_build.bed1d3ed19379003-cgu.3.rcgu.o" "/build/rust/debug/build/libc-a5f595ef1ee1b008/build_script_build-a5f595ef1ee1b008.1s1ikv2rfw9lot6x.rcgu.o" "-Wl,--as-needed" "-L" "/build/rust/debug/deps" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-Wl,-Bstatic" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd-d2ef02247056996e.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libpanic_unwind-fde67f6c4eccaa42.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libobject-2549d0ec992a5666.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libmemchr-bb9bfc0931d5cad0.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libaddr2line-7c0b91fdc4adc2c5.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libgimli-6ec164769e6c2957.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_demangle-95326caaef561554.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd_detect-704dba0df3717bb7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libhashbrown-5f0117cb69112303.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_alloc-7a95907f1ed0cea5.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libminiz_oxide-d4aa666f8242aefc.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libadler-9abec8861e966bc7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libunwind-863ac378b60eeb30.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcfg_if-fc8aa5b7d220f0a9.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liblibc-0cc850f1e941238d.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liballoc-f7b445210e88e768.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_core-f37052492751c579.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcore-fd15ec7f305d48e7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcompiler_builtins-d700583125da6701.rlib" "-Wl,-Bdynamic" "-lgcc_s" "-lutil" "-lrt" "-lpthread" "-lm" "-ldl" "-lc" "-Wl,--eh-frame-hdr" "-Wl,-z,noexecstack" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-o" "/build/rust/debug/build/libc-a5f595ef1ee1b008/build_script_build-a5f595ef1ee1b008" "-Wl,--gc-sections" "-pie" "-Wl,-z,relro,-z,now" "-nodefaultlibs"
  = note: /opt/conda/envs/arrow/bin/../lib/gcc/x86_64-conda-linux-gnu/12.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: /root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd-d2ef02247056996e.rlib(std-d2ef02247056996e.std.e4dfbc2c3f4b09f1-cgu.0.rcgu.o): in function `std::sys::pal::unix::stack_overflow::imp::sigstack_size':
          /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/stack_overflow.rs:216: undefined reference to `getauxval'
          /opt/conda/envs/arrow/bin/../lib/gcc/x86_64-conda-linux-gnu/12.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/stack_overflow.rs:216: undefined reference to `getauxval'
          collect2: error: ld returned 1 exit status
          
  = note: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
  = note: use the `-l` flag to specify native libraries to link
  = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#rustc-link-lib)

error: could not compile `libc` (build script) due to 1 previous error
ERROR conda.cli.main_run:execute(124): `conda run ci/scripts/integration_arrow_build.sh /__w/arrow-rs/arrow-rs /build` failed. (See above for error)
Error: Process completed with exit code 101.

To Reproduce
Run CI on a PR

Expected behavior
CI test should pass

Additional context

@Jefffrey
Copy link
Contributor

Jefffrey commented May 6, 2024

Seems to be an issue with the apache/arrow-dev:amd64-conda-integration Docker image, specifically with conda?

Relevant discussions:

Apparently need sysroot_linux-64>=2.16 but when I check manually in the Docker image:

arrow-rs$ docker run --rm -it --entrypoint bash apache/arrow-dev:amd64-conda-integration
root@9c44f644db4a:/# conda list sysroot_linux-64
# packages in environment at /opt/conda/envs/arrow:
#
# Name                    Version                   Build  Channel
sysroot_linux-64          2.12                he073ed8_17    conda-forge
root@9c44f644db4a:/# echo '#include <sys/auxv.h>' | g++ -c -x c++ -
<stdin>:1:10: fatal error: sys/auxv.h: No such file or directory
compilation terminated.
root@9c44f644db4a:/#

Not too familiar with this stuff but I guess issue would lie upstream in arrow repo 🤔

@tustvold
Copy link
Contributor

tustvold commented May 8, 2024

@pitrou do you have any insights you could possibly share here. My usual response to conda shenanigans is to uninstall it, which isn't exactly an option here 😅

@alamb
Copy link
Contributor Author

alamb commented May 8, 2024

I can reproduce this:

docker run --rm  -it --entrypoint bash apache/arrow-dev:amd64-conda-integration

Then in docker

git clone https://github.com/apache/arrow-rs.git
cd arrow-rs/
cargo build -p arrow-integration-testing

This results in

...
error: linking with `cc` failed: exit status: 1
  |
  = note: LC_ALL="C" PATH="/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/bin:/root/.cargo/bin:/opt/dotnet:/opt/go/bin:/opt/conda/envs/arrow/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin" VSLANG="1033" "cc" "-m64" "/tmp/rustcViz8C1/symbols.o" "/arrow-rs/target/debug/build/rustversion-47773c9b3a89e10f/build_script_build-47773c9b3a89e10f.build_script_build.29af30b56caec0f1-cgu.0.rcgu.o" "/arrow-rs/target/debug/build/rustversion-47773c9b3a89e10f/build_script_build-47773c9b3a89e10f.build_script_build.29af30b56caec0f1-cgu.1.rcgu.o" "/arrow-rs/target/debug/build/rustversion-47773c9b3a89e10f/build_script_build-47773c9b3a89e10f.3848dfde1s3kgj0j.rcgu.o" "-Wl,--as-needed" "-L" "/arrow-rs/target/debug/deps" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-Wl,-Bstatic" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd-d2ef02247056996e.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libpanic_unwind-fde67f6c4eccaa42.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libobject-2549d0ec992a5666.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libmemchr-bb9bfc0931d5cad0.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libaddr2line-7c0b91fdc4adc2c5.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libgimli-6ec164769e6c2957.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_demangle-95326caaef561554.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd_detect-704dba0df3717bb7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libhashbrown-5f0117cb69112303.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_alloc-7a95907f1ed0cea5.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libminiz_oxide-d4aa666f8242aefc.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libadler-9abec8861e966bc7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libunwind-863ac378b60eeb30.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcfg_if-fc8aa5b7d220f0a9.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liblibc-0cc850f1e941238d.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liballoc-f7b445210e88e768.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_core-f37052492751c579.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcore-fd15ec7f305d48e7.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcompiler_builtins-d700583125da6701.rlib" "-Wl,-Bdynamic" "-lgcc_s" "-lutil" "-lrt" "-lpthread" "-lm" "-ldl" "-lc" "-Wl,--eh-frame-hdr" "-Wl,-z,noexecstack" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-o" "/arrow-rs/target/debug/build/rustversion-47773c9b3a89e10f/build_script_build-47773c9b3a89e10f" "-Wl,--gc-sections" "-pie" "-Wl,-z,relro,-z,now" "-nodefaultlibs"
  = note: /opt/conda/envs/arrow/bin/../lib/gcc/x86_64-conda-linux-gnu/12.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: /root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd-d2ef02247056996e.rlib(std-d2ef02247056996e.std.e4dfbc2c3f4b09f1-cgu.0.rcgu.o): in function `std::sys::pal::unix::stack_overflow::imp::sigstack_size':
          /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/stack_overflow.rs:216: undefined reference to `getauxval'
          /opt/conda/envs/arrow/bin/../lib/gcc/x86_64-conda-linux-gnu/12.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: /rustc/9b00956e56009bab2aa15d7bff10916599e3d6d6/library/std/src/sys/pal/unix/stack_overflow.rs:216: undefined reference to `getauxval'
          collect2: error: ld returned 1 exit status

  = note: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
  = note: use the `-l` flag to specify native libraries to link
  = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#rustc-link-lib)

error: could not compile `rustversion` (build script) due to 1 previous error
...

I am looking into this more carefully now

@alamb
Copy link
Contributor Author

alamb commented May 8, 2024

I played around a but didn't find anything else

@tustvold
Copy link
Contributor

I'm not really sure what exactly is causing this, but I've filled a ticket on rustc in case this is actually a regression in the compiler - rust-lang/rust#125067

In the meantime I will prepare a PR to temporarily downgrade rust in the integration test pipeline

tustvold added a commit to tustvold/arrow-rs that referenced this issue May 13, 2024
alamb pushed a commit that referenced this issue May 13, 2024
* Downgrade to Rust 1.77 in integration pipeline (#5719)

* Checkout nanoarrow
@workingjubilee
Copy link

Seems to be an issue with the apache/arrow-dev:amd64-conda-integration Docker image, specifically with conda?

Relevant discussions:

* [g++ cannot find sys/auxv.h on ubuntu 18.04 conda-forge/ctng-compiler-activation-feedstock#88](https://github.com/conda-forge/ctng-compiler-activation-feedstock/issues/88)

* [Missing header auxv.h conda-forge/conda-forge.github.io#1625](https://github.com/conda-forge/conda-forge.github.io/issues/1625)

Apparently need sysroot_linux-64>=2.16 but when I check manually in the Docker image:

arrow-rs$ docker run --rm -it --entrypoint bash apache/arrow-dev:amd64-conda-integration
root@9c44f644db4a:/# conda list sysroot_linux-64
# packages in environment at /opt/conda/envs/arrow:
#
# Name                    Version                   Build  Channel
sysroot_linux-64          2.12                he073ed8_17    conda-forge
root@9c44f644db4a:/# echo '#include <sys/auxv.h>' | g++ -c -x c++ -
<stdin>:1:10: fatal error: sys/auxv.h: No such file or directory
compilation terminated.
root@9c44f644db4a:/#

Not too familiar with this stuff but I guess issue would lie upstream in arrow repo 🤔

@Jefffrey I'm sorry, is sysroot_linux-64 with a version of 2.12 not in fact less than and not greater than 2.16?

This issue should be reopened, as the problem was not actually fixed. The actual minimum is 2.17 and has been for a long time so there will be no upstream fix for this: https://blog.rust-lang.org/2022/08/01/Increasing-glibc-kernel-requirements.html

@alamb
Copy link
Contributor Author

alamb commented May 13, 2024

This issue should be reopened, as the problem was not actually fixed.

I think in so far that the arrow-rs CI tests are now working again (with a workaround) this particular issue was 'fixed'

@workingjubilee , what it sounds like you are saying is that Rust requires glibc 2.17 or later, and thus the version of glibc in the apache/arrow-dev:amd64-conda-integration image is too old (2.12).

If that is the case, I think we should file a ticket upstream in the arrow repo tracking this problem -- rust-lang/rust#125067 (comment)

@workingjubilee
Copy link

Yes.

Ah, my mistake. The arrow-rs repo is not the arrow repo, I see.

@workingjubilee
Copy link

Apparently apache/arrow#41481 already exists.

@alamb
Copy link
Contributor Author

alamb commented May 13, 2024

Ah, my mistake. The arrow-rs repo is not the arrow repo, I see.

It is a maze of twisty repos all the way down :) @tustvold also filed apache/arrow#41637 (updated) for this specific issue it seems

Thanks again

@tustvold
Copy link
Contributor

@tustvold also filed #5719 for this specific issue it seems

I think you meant apache/arrow#41637 and yes

@tustvold
Copy link
Contributor

tustvold commented Jun 3, 2024

label_issue.py automatically added labels {'arrow'} from #5713

@tustvold tustvold added the parquet Changes to the parquet crate label Jun 3, 2024
@tustvold
Copy link
Contributor

tustvold commented Jun 3, 2024

label_issue.py automatically added labels {'parquet'} from #5710

@tustvold tustvold added the documentation Improvements or additions to documentation label Jun 3, 2024
@tustvold
Copy link
Contributor

tustvold commented Jun 3, 2024

label_issue.py automatically added labels {'documentation'} from #5705

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
arrow Changes to the arrow crate bug documentation Improvements or additions to documentation help wanted parquet Changes to the parquet crate
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants