Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to build installable wheels for some pyproject.toml based projects (tensornvme) #58

Open
KLL535 opened this issue Jan 3, 2025 · 1 comment
Open

Failed to build installable wheels for some pyproject.toml based projects (tensornvme) #58

KLL535 opened this issue Jan 3, 2025 · 1 comment

Comments

@KLL535
Copy link

KLL535 commented Jan 3, 2025

Help me!

(venv) user@DESKTOP-ULK7M66:~/Open-Sora$ pip install git+https://github.com/hpcaitech/TensorNVMe.git
Collecting git+https://github.com/hpcaitech/TensorNVMe.git
Cloning https://github.com/hpcaitech/TensorNVMe.git to /tmp/pip-req-build-64o7_c6v
Running command git clone --filter=blob:none --quiet https://github.com/hpcaitech/TensorNVMe.git /tmp/pip-req-build-64o7_c6v
Resolved https://github.com/hpcaitech/TensorNVMe.git to commit 6403388
Preparing metadata (setup.py) ... done
Requirement already satisfied: packaging in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (24.2)
Requirement already satisfied: click in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (8.1.8)
Requirement already satisfied: torch in ./venv/lib/python3.11/site-packages (from tensornvme==0.1.0) (2.2.2)
Requirement already satisfied: filelock in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.16.1)
Requirement already satisfied: typing-extensions>=4.8.0 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (4.12.2)
Requirement already satisfied: sympy in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (1.13.3)
Requirement already satisfied: networkx in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.4.2)
Requirement already satisfied: jinja2 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (3.1.5)
Requirement already satisfied: fsspec in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2024.12.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105)
Requirement already satisfied: nvidia-cudnn-cu12==8.9.2.26 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (8.9.2.26)
Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.3.1)
Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (11.0.2.54)
Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (10.3.2.106)
Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (11.4.5.107)
Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.0.106)
Requirement already satisfied: nvidia-nccl-cu12==2.19.3 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2.19.3)
Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (12.1.105)
Requirement already satisfied: triton==2.2.0 in ./venv/lib/python3.11/site-packages (from torch->tensornvme==0.1.0) (2.2.0)
Requirement already satisfied: nvidia-nvjitlink-cu12 in ./venv/lib/python3.11/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch->tensornvme==0.1.0) (12.6.85)
Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.11/site-packages (from jinja2->torch->tensornvme==0.1.0) (2.1.5)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in ./venv/lib/python3.11/site-packages (from sympy->torch->tensornvme==0.1.0) (1.3.0)
Building wheels for collected packages: tensornvme
Building wheel for tensornvme (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [176 lines of output]
-- The CXX compiler identification is GNU 13.3.0
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
liburing is found in /home/user/.tensornvme/lib/liburing.so
libaio is found in /home/user/.tensornvme/lib/libaio.so
-- Configuring done (0.3s)
-- Generating done (0.0s)
-- Build files have been written to: /tmp/pip-req-build-64o7_c6v/cmake-build
make: *** No rule to make target 'extern_uring'. Stop.
make: *** No rule to make target 'extern_aio'. Stop.
running bdist_wheel
running build
running build_py
creating build/lib.linux-x86_64-cpython-311/tensornvme
copying tensornvme/async_file_io.py -> build/lib.linux-x86_64-cpython-311/tensornvme
copying tensornvme/offload.py -> build/lib.linux-x86_64-cpython-311/tensornvme
copying tensornvme/init.py -> build/lib.linux-x86_64-cpython-311/tensornvme
creating build/lib.linux-x86_64-cpython-311/tensornvme/cli
copying tensornvme/cli/cli.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli
copying tensornvme/cli/init.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli
copying tensornvme/cli/check.py -> build/lib.linux-x86_64-cpython-311/tensornvme/cli
running build_ext
building 'tensornvme._C' extension
creating /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc
Emitting ninja build file /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o
c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/pip-req-build-64o7_c6v/include/pthread_backend.h:13,
from /tmp/pip-req-build-64o7_c6v/csrc/pthread_backend.cpp:1:
/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/cuda/CUDAStream.h:6:10: fatal error: cuda_runtime_api.h: No such file or directory
6 | #include <cuda_runtime_api.h>
| ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
[2/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/space_mgr.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/space_mgr.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/space_mgr.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[3/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
FAILED: /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o
c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/backend.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /tmp/pip-req-build-64o7_c6v/include/pthread_backend.h:13,
from /tmp/pip-req-build-64o7_c6v/csrc/backend.cpp:15:
/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/cuda/CUDAStream.h:6:10: fatal error: cuda_runtime_api.h: No such file or directory
6 | #include <cuda_runtime_api.h>
| ^~~~~~~~~~~~~~~~~~~~
compilation terminated.
[4/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/async_file_io.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/async_file_io.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/async_file_io.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[5/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/aio.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/aio.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
In file included from /usr/include/c++/13/memory:78,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/C++17.h:8,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/TypeList.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/util/Metaprogramming.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/DispatchKeySet.h:4,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/Backend.h:5,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/c10/core/Layout.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/core/TensorBody.h:12,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/core/Tensor.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/ATen/Tensor.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/function_hook.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/cpp_hook.h:2,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/variable.h:6,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/autograd/autograd.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/autograd.h:3,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/all.h:7,
from /home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include/torch/torch.h:3,
from /tmp/pip-req-build-64o7_c6v/include/aio.h:4,
from /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:1:
In member function ‘void std::default_delete<_Tp>::operator()(_Tp*) const [with _Tp = io_event]’,
inlined from ‘std::unique_ptr<_Tp, _Dp>::~unique_ptr() [with _Tp = io_event; _Dp = std::default_delete<io_event>]’ at /usr/include/c++/13/bits/unique_ptr.h:404:17,
inlined from ‘virtual void AIOAsyncIO::get_event(WaitType)’ at /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:45:1:
/usr/include/c++/13/bits/unique_ptr.h:99:9: warning: ‘void operator delete(void*, std::size_t)’ called on pointer returned from a mismatched allocation function [-Wmismatched-new-delete]
99 | delete __ptr;
| ^~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/aio.cpp: In member function ‘virtual void AIOAsyncIO::get_event(WaitType)’:
/tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:23:63: note: returned from ‘void* operator new ’
23 | std::unique_ptr<io_event> events(new io_event[this->max_nr]);
| ^
In member function ‘void std::default_delete<_Tp>::operator()(_Tp*) const [with _Tp = io_event]’,
inlined from ‘std::unique_ptr<_Tp, _Dp>::~unique_ptr() [with _Tp = io_event; _Dp = std::default_delete<io_event>]’ at /usr/include/c++/13/bits/unique_ptr.h:404:17,
inlined from ‘virtual void AIOAsyncIO::get_event(WaitType)’ at /tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:45:1:
/usr/include/c++/13/bits/unique_ptr.h:99:9: warning: ‘void operator delete(void*, std::size_t)’ called on pointer returned from a mismatched allocation function [-Wmismatched-new-delete]
99 | delete __ptr;
| ^~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/aio.cpp: In member function ‘virtual void AIOAsyncIO::get_event(WaitType)’:
/tmp/pip-req-build-64o7_c6v/csrc/aio.cpp:23:63: note: returned from ‘void* operator new ’
23 | std::unique_ptr<io_event> events(new io_event[this->max_nr]);
| ^
[6/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/uring.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/uring.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/uring.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
[7/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/offload.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/offload.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/offload.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_write(const at::Tensor&, const std::string&)’:
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:85:10: warning: ignoring return value of ‘ssize_t write(int, const void*, size_t)’ declared with attribute ‘warn_unused_result’ [-Wunused-result]
85 | write(this->fd, tensor.data_ptr(), bytes);
| ~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_read(const at::Tensor&, const std::string&)’:
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:93:9: warning: ignoring return value of ‘ssize_t read(int, void*, size_t)’ declared with attribute ‘warn_unused_result’ [-Wunused-result]
93 | read(this->fd, tensor.data_ptr(), bytes);
| ~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_writev(const std::vectorat::Tensor&, const std::string&)’:
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:182:11: warning: ignoring return value of ‘ssize_t writev(int, const iovec*, int)’ declared with attribute ‘warn_unused_result’ [-Wunused-result]
182 | writev(this->fd, iov, tensors.size());
| ~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp: In member function ‘void Offloader::sync_readv(const std::vectorat::Tensor&, const std::string&)’:
/tmp/pip-req-build-64o7_c6v/csrc/offload.cpp:192:10: warning: ignoring return value of ‘ssize_t readv(int, const iovec*, int)’ declared with attribute ‘warn_unused_result’ [-Wunused-result]
192 | readv(this->fd, iov, tensors.size());
| ~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[8/8] c++ -MMD -MF /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/py_api.o.d -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -g -fwrapv -O2 -fPIC -I/tmp/pip-req-build-64o7_c6v/csrc -I/tmp/pip-req-build-64o7_c6v/include -I/home/user/.tensornvme/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/torch/csrc/api/include -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/TH -I/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/include/THC -I/home/user/Open-Sora/venv/include -I/usr/include/python3.11 -c -c /tmp/pip-req-build-64o7_c6v/csrc/py_api.cpp -o /tmp/pip-req-build-64o7_c6v/build/temp.linux-x86_64-cpython-311/tmp/pip-req-build-64o7_c6v/csrc/py_api.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2096, in _run_ninja_build
subprocess.run(
File "/usr/lib/python3.11/subprocess.py", line 571, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

  The above exception was the direct cause of the following exception:

  Traceback (most recent call last):
    File "<string>", line 2, in <module>
    File "<pip-setuptools-caller>", line 34, in <module>
    File "/tmp/pip-req-build-64o7_c6v/setup.py", line 172, in <module>
      setup(
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/__init__.py", line 117, in setup
      return distutils.core.setup(**attrs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 183, in setup
      return run_commands(dist)
             ^^^^^^^^^^^^^^^^^^
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 199, in run_commands
      dist.run_commands()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 954, in run_commands
      self.run_command(cmd)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
      super().run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
      cmd_obj.run()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/bdist_wheel.py", line 381, in run
      self.run_command("build")
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
      self.distribution.run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
      super().run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
      cmd_obj.run()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build.py", line 135, in run
      self.run_command(cmd_name)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 316, in run_command
      self.distribution.run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/dist.py", line 995, in run_command
      super().run_command(command)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
      cmd_obj.run()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 99, in run
      _build_ext.run(self)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 359, in run
      self.build_extensions()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 871, in build_extensions
      build_ext.build_extensions(self)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 476, in build_extensions
      self._build_extensions_serial()
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 502, in _build_extensions_serial
      self.build_extension(ext)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 264, in build_extension
      _build_ext.build_extension(self, ext)
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 557, in build_extension
      objects = self.compiler.compile(
                ^^^^^^^^^^^^^^^^^^^^^^
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 684, in unix_wrap_ninja_compile
      _write_ninja_file_and_compile_objects(
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1774, in _write_ninja_file_and_compile_objects
      _run_ninja_build(
    File "/home/user/Open-Sora/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2112, in _run_ninja_build
      raise RuntimeError(message) from e
  RuntimeError: Error compiling objects for extension
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tensornvme
Running setup.py clean for tensornvme
Failed to build tensornvme
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (tensornvme)
@KLL535
Copy link
Author

KLL535 commented Jan 3, 2025

ls /usr/local/cuda
Nothing

echo $LD_LIBRARY_PATH
Nothing

sudo apt install nvidia-cuda-toolkit

ls /usr/lib/nvidia-cuda-toolkit
bin compute-sanitizer libdevice

sudo ln -s /usr/lib/nvidia-cuda-toolkit/ /usr/local/cuda
export LD_LIBRARY_PATH=/usr/lib/nvidia-cuda-toolkit/bin

WORK

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@KLL535