关于TF-T2V的环境错误

[HAHAkun]

你好，我是根据tft2v_environment.yaml来搭环境的，下面是我的pip list
aiofiles 23.2.1
aiohttp 3.9.1
aiosignal 1.3.1
aliyun-python-sdk-core 2.14.0
aliyun-python-sdk-kms 2.16.2
altair 5.2.0
annotated-types 0.6.0
antlr4-python3-runtime 4.9.3
anyio 4.2.0
asttokens 2.4.1
async-timeout 4.0.3
attrs 23.2.0
Automat 22.10.0
beartype 0.16.4
blessed 1.20.0
buildtools 1.0.6
causal-conv1d 1.1.3.post1
certifi 2023.11.17
cffi 1.16.0
chardet 5.2.0
charset-normalizer 3.3.2
clean-fid 0.1.35
click 8.1.7
cmake 3.28.1
colorama 0.4.6
constantly 23.10.4
contourpy 1.2.0
crcmod 1.7
cryptography 42.0.4
cycler 0.12.1
decorator 5.1.1
decord 0.6.0
diffusers 0.26.3
dnspython 2.6.1
docopt 0.6.2
easydict 1.11
einops 0.7.0
email_validator 2.1.1
exceptiongroup 1.2.0
executing 2.0.1
fairscale 0.4.13
fastapi 0.109.0
fastapi-cli 0.0.4
ffmpy 0.3.1
filelock 3.13.1
fonttools 4.47.2
frozenlist 1.4.1
fsspec 2023.12.2
ftfy 6.1.3
furl 2.1.3
gpustat 1.1.1
gradio 4.14.0
gradio_client 0.8.0
greenlet 3.0.3
h11 0.14.0
httpcore 1.0.2
httptools 0.6.1
httpx 0.26.0
huggingface-hub 0.20.2
hyperlink 21.0.0
idna 3.6
imageio 2.33.1
imageio-ffmpeg 0.4.9
importlib-metadata 7.0.1
importlib-resources 6.1.1
incremental 22.10.0
ipdb 0.13.13
ipython 8.18.1
jedi 0.19.1
Jinja2 3.1.3
jmespath 0.10.0
joblib 1.3.2
jsonschema 4.21.0
jsonschema-specifications 2023.12.1
kiwisolver 1.4.5
kornia 0.7.1
lazy_loader 0.3
lightning-utilities 0.10.0
lit 17.0.6
mamba-ssm 1.1.4
markdown-it-py 3.0.0
MarkupSafe 2.1.3
matplotlib 3.8.2
matplotlib-inline 0.1.6
mdurl 0.1.2
motion-vector-extractor 1.0.6
mpmath 1.3.0
multidict 6.0.4
mypy-extensions 1.0.0
networkx 3.2.1
ninja 1.11.1.1
numpy 1.26.3
nvidia-cublas-cu11 11.10.3.66
nvidia-cublas-cu12 12.1.3.1
nvidia-cuda-cupti-cu11 11.7.101
nvidia-cuda-cupti-cu12 12.1.105
nvidia-cuda-nvrtc-cu11 11.7.99
nvidia-cuda-nvrtc-cu12 12.1.105
nvidia-cuda-runtime-cu11 11.7.99
nvidia-cuda-runtime-cu12 12.1.105
nvidia-cudnn-cu11 8.5.0.96
nvidia-cudnn-cu12 8.9.2.26
nvidia-cufft-cu11 10.9.0.58
nvidia-cufft-cu12 11.0.2.54
nvidia-curand-cu11 10.2.10.91
nvidia-curand-cu12 10.3.2.106
nvidia-cusolver-cu11 11.4.0.1
nvidia-cusolver-cu12 11.4.5.107
nvidia-cusparse-cu11 11.7.4.91
nvidia-cusparse-cu12 12.1.0.106
nvidia-ml-py 12.535.133
nvidia-nccl-cu11 2.14.3
nvidia-nccl-cu12 2.19.3
nvidia-nvjitlink-cu12 12.3.101
nvidia-nvtx-cu11 11.7.91
nvidia-nvtx-cu12 12.1.105
omegaconf 2.3.0
open-clip-torch 2.24.0
opencv-python 4.5.3.56
opencv-python-headless 4.9.0.80
orderedmultidict 1.0.1
orjson 3.9.10
oss2 2.18.4
packaging 23.2
pandas 2.1.4
parso 0.8.3
pexpect 4.9.0
pillow 10.2.0
pip 24.0
pkgconfig 1.5.5
pqi 3.0.0
prompt-toolkit 3.0.43
protobuf 4.25.2
psutil 5.9.8
ptflops 0.7.2.2
ptyprocess 0.7.0
pure-eval 0.2.2
pycparser 2.21
pycryptodome 3.20.0
pydantic 2.5.3
pydantic_core 2.14.6
pydub 0.25.1
Pygments 2.17.2
pynvml 11.5.0
pyparsing 3.1.1
pyre-extensions 0.0.29
python-dateutil 2.8.2
python-dotenv 1.0.1
python-multipart 0.0.6
pytorch-lightning 2.1.3
pytz 2023.3.post1
PyYAML 6.0.1
redo 2.0.4
referencing 0.32.1
regex 2023.12.25
requests 2.31.0
rich 13.7.0
rotary-embedding-torch 0.5.3
rpds-py 0.17.1
ruff 0.2.0
safetensors 0.4.1
scikit-image 0.22.0
scikit-learn 1.4.0
scipy 1.11.4
semantic-version 2.10.0
sentencepiece 0.1.99
setuptools 69.5.1
shellingham 1.5.4
simplejson 3.19.2
six 1.16.0
sk-video 1.1.10
sniffio 1.3.0
SQLAlchemy 2.0.27
stack-data 0.6.3
starlette 0.35.1
sympy 1.12
thop 0.1.1.post2209072238
threadpoolctl 3.2.0
tifffile 2023.12.9
timm 0.9.12
tokenizers 0.15.0
tomli 2.0.1
tomlkit 0.12.0
toolz 0.12.0
torch 2.0.1+cu118
torchaudio 2.0.2+cu118
torchmetrics 1.4.0.post0
torchvision 0.15.2+cu118
tqdm 4.66.1
traitlets 5.14.1
trampoline 0.1.2
transformers 4.36.2
triton 2.0.0
Twisted 23.10.0
typer 0.9.0
typing_extensions 4.9.0
typing-inspect 0.9.0
tzdata 2023.4
ujson 5.10.0
urllib3 2.1.0
uvicorn 0.26.0
uvloop 0.19.0
watchfiles 0.22.0
wcwidth 0.2.13
websockets 11.0.3
wheel 0.43.0
xformers 0.0.20
yarl 1.9.4
zipp 3.17.0
zope.interface 6.2
然后我这边cuda版本是11.8，然后运行python inference.py --cfg configs/tft2v_t2v_infer.yaml 出现下面的报错

[2024-06-14 17:15:10,388] INFO: Loaded ViT-H-14 model config.
[2024-06-14 17:15:10,388] INFO: Loaded ViT-H-14 model config.
[2024-06-14 17:15:10,389] INFO: Loaded ViT-H-14 model config.
[2024-06-14 17:15:10,390] INFO: Loaded ViT-H-14 model config.
[2024-06-14 17:15:10,390] INFO: Loaded ViT-H-14 model config.
[2024-06-14 17:15:10,390] INFO: Loaded ViT-H-14 model config.
[2024-06-14 17:15:10,391] INFO: Loaded ViT-H-14 model config.
[2024-06-14 17:15:10,394] INFO: Loaded ViT-H-14 model config.
[2024-06-14 17:15:16,105] INFO: Loading pretrained ViT-H-14 weights (models/open_clip_pytorch_model.bin).
[2024-06-14 17:15:16,107] INFO: Loading pretrained ViT-H-14 weights (models/open_clip_pytorch_model.bin).
[2024-06-14 17:15:16,116] INFO: Loading pretrained ViT-H-14 weights (models/open_clip_pytorch_model.bin).
[2024-06-14 17:15:16,118] INFO: Loading pretrained ViT-H-14 weights (models/open_clip_pytorch_model.bin).
[2024-06-14 17:15:16,173] INFO: Loading pretrained ViT-H-14 weights (models/open_clip_pytorch_model.bin).
[2024-06-14 17:15:16,214] INFO: Loading pretrained ViT-H-14 weights (models/open_clip_pytorch_model.bin).
[2024-06-14 17:15:16,374] INFO: Loading pretrained ViT-H-14 weights (models/open_clip_pytorch_model.bin).
[2024-06-14 17:15:16,535] INFO: Loading pretrained ViT-H-14 weights (models/open_clip_pytorch_model.bin).
[2024-06-14 17:15:34,072] INFO: Restored from models/v2-1_512-ema-pruned.ckpt
[2024-06-14 17:15:34,835] INFO: Restored from models/v2-1_512-ema-pruned.ckpt
[2024-06-14 17:15:35,661] INFO: Restored from models/v2-1_512-ema-pruned.ckpt
[2024-06-14 17:15:36,006] INFO: Restored from models/v2-1_512-ema-pruned.ckpt
[2024-06-14 17:15:36,452] INFO: Restored from models/v2-1_512-ema-pruned.ckpt
[2024-06-14 17:15:36,556] INFO: Restored from models/v2-1_512-ema-pruned.ckpt
[2024-06-14 17:15:36,732] INFO: Restored from models/v2-1_512-ema-pruned.ckpt
[2024-06-14 17:15:37,581] INFO: Restored from models/v2-1_512-ema-pruned.ckpt
[2024-06-14 17:15:44,692] INFO: Load model from models/tft2v_t2v_non_ema_512000.pth with status
[2024-06-14 17:15:45,680] INFO: Load model from models/tft2v_t2v_non_ema_512000.pth with status
[2024-06-14 17:15:46,595] INFO: Load model from models/tft2v_t2v_non_ema_512000.pth with status
[2024-06-14 17:15:53,825] INFO: Load model from models/tft2v_t2v_non_ema_512000.pth with status
[2024-06-14 17:16:00,424] INFO: Load model from models/tft2v_t2v_non_ema_512000.pth with status
[2024-06-14 17:16:00,540] INFO: Load model from models/tft2v_t2v_non_ema_512000.pth with status
[2024-06-14 17:16:00,571] INFO: Load model from models/tft2v_t2v_non_ema_512000.pth with status
[2024-06-14 17:16:00,601] INFO: Load model from models/tft2v_t2v_non_ema_512000.pth with status
[2024-06-14 17:16:05,754] INFO: There are 10 videos. with 1 times
[2024-06-14 17:16:05,755] INFO: [0]/[10] Begin to sample Fun chicken - 3D Animation ...
[2024-06-14 17:16:05,758] INFO: There are 10 videos. with 1 times
[2024-06-14 17:16:05,759] INFO: [0]/[10] Begin to sample Fun chicken - 3D Animation ...
[2024-06-14 17:16:05,776] INFO: There are 10 videos. with 1 times
[2024-06-14 17:16:05,777] INFO: [0]/[10] Begin to sample Fun chicken - 3D Animation ...
[2024-06-14 17:16:05,777] INFO: There are 10 videos. with 1 times
[2024-06-14 17:16:05,778] INFO: [0]/[10] Begin to sample Fun chicken - 3D Animation ...
[2024-06-14 17:16:05,778] INFO: There are 10 videos. with 1 times
[2024-06-14 17:16:05,780] INFO: [0]/[10] Begin to sample Fun chicken - 3D Animation ...
[2024-06-14 17:16:05,780] INFO: There are 10 videos. with 1 times
[2024-06-14 17:16:05,781] INFO: There are 10 videos. with 1 times
[2024-06-14 17:16:05,781] INFO: [0]/[10] Begin to sample Fun chicken - 3D Animation ...
[2024-06-14 17:16:05,781] INFO: [0]/[10] Begin to sample Fun chicken - 3D Animation ...
[2024-06-14 17:16:05,782] INFO: GPU Memory used 31.90 GB
[2024-06-14 17:16:05,782] INFO: Current seed 888 ...
[2024-06-14 17:16:05,790] INFO: GPU Memory used 31.90 GB
[2024-06-14 17:16:05,790] INFO: GPU Memory used 31.90 GB
[2024-06-14 17:16:05,791] INFO: Current seed 890 ...
[2024-06-14 17:16:05,791] INFO: Current seed 895 ...
[2024-06-14 17:16:05,794] INFO: GPU Memory used 31.90 GB
[2024-06-14 17:16:05,794] INFO: GPU Memory used 31.90 GB
[2024-06-14 17:16:05,794] INFO: GPU Memory used 31.90 GB
[2024-06-14 17:16:05,794] INFO: Current seed 889 ...
[2024-06-14 17:16:05,795] INFO: Current seed 892 ...
[2024-06-14 17:16:05,795] INFO: Current seed 891 ...
[2024-06-14 17:16:05,796] INFO: GPU Memory used 31.90 GB
[2024-06-14 17:16:05,797] INFO: Current seed 894 ...
CUDA error (third_party/flash-attention/csrc/flash_attn/src/fmha_fwd_launch_template.h:89): no kernel image is available for execution on the device
CUDA error (third_party/flash-attention/csrc/flash_attn/src/fmha_fwd_launch_template.h:89): no kernel image is available for execution on the device
CUDA error (third_party/flash-attention/csrc/flash_attn/src/fmha_fwd_launch_template.h:89): no kernel image is available for execution on the device
CUDA error (third_party/flash-attention/csrc/flash_attn/src/fmha_fwd_launch_template.h:89): no kernel image is available for execution on the device
CUDA error (third_party/flash-attention/csrc/flash_attn/src/fmha_fwd_launch_template.h:89): no kernel image is available for execution on the device
CUDA error (third_party/flash-attention/csrc/flash_attn/src/fmha_fwd_launch_template.h:89): no kernel image is available for execution on the device
CUDA error (third_party/flash-attention/csrc/flash_attn/src/fmha_fwd_launch_template.h:89): no kernel image is available for execution on the device
Traceback (most recent call last):
File "/data-123/zishen/cvproject/VGen/utils/registry.py", line 67, in build_from_config
return req_type_entry(**cfg)
File "/data-123/zishen/cvproject/VGen/tools/inferences/inference_tft2v_entrance.py", line 76, in inference_tft2v_entrance
mp.spawn(worker, nprocs=cfg.gpus_per_machine, args=(cfg, cfg_update))
File "/home/zishen/anaconda3/envs/vgen/lib/python3.9/site-packages/torch/multiprocessing/spawn.py", line 239, in spawn
return start_processes(fn, args, nprocs, join, daemon, start_method='spawn')
File "/home/zishen/anaconda3/envs/vgen/lib/python3.9/site-packages/torch/multiprocessing/spawn.py", line 197, in start_processes
while not context.join():
File "/home/zishen/anaconda3/envs/vgen/lib/python3.9/site-packages/torch/multiprocessing/spawn.py", line 149, in join
raise ProcessExitedException(
torch.multiprocessing.spawn.ProcessExitedException: process 7 terminated with exit code 1

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/zishen/anaconda3/envs/vgen/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/zishen/anaconda3/envs/vgen/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/zishen/.vscode-server/extensions/ms-python.debugpy-2024.6.0-linux-x64/bundled/libs/debugpy/adapter/../../debugpy/launcher/../../debugpy/main.py", line 39, in
cli.main()
File "/home/zishen/.vscode-server/extensions/ms-python.debugpy-2024.6.0-linux-x64/bundled/libs/debugpy/adapter/../../debugpy/launcher/../../debugpy/../debugpy/server/cli.py", line 430, in main
run()
File "/home/zishen/.vscode-server/extensions/ms-python.debugpy-2024.6.0-linux-x64/bundled/libs/debugpy/adapter/../../debugpy/launcher/../../debugpy/../debugpy/server/cli.py", line 284, in run_file
runpy.run_path(target, run_name="main")
File "/home/zishen/.vscode-server/extensions/ms-python.debugpy-2024.6.0-linux-x64/bundled/libs/debugpy/_vendored/pydevd/_pydevd_bundle/pydevd_runpy.py", line 321, in run_path
return _run_module_code(code, init_globals, run_name,
File "/home/zishen/.vscode-server/extensions/ms-python.debugpy-2024.6.0-linux-x64/bundled/libs/debugpy/_vendored/pydevd/_pydevd_bundle/pydevd_runpy.py", line 135, in _run_module_code
_run_code(code, mod_globals, init_globals,
File "/home/zishen/.vscode-server/extensions/ms-python.debugpy-2024.6.0-linux-x64/bundled/libs/debugpy/_vendored/pydevd/_pydevd_bundle/pydevd_runpy.py", line 124, in _run_code
exec(code, run_globals)
File "/data-123/zishen/cvproject/VGen/inference.py", line 18, in
INFER_ENGINE.build(dict(type=cfg_update.TASK_TYPE), cfg_update=cfg_update.cfg_dict)
File "/data-123/zishen/cvproject/VGen/utils/registry.py", line 107, in build
return self.build_func(*args, **kwargs, registry=self)
File "/data-123/zishen/cvproject/VGen/utils/registry_class.py", line 7, in build_func
return build_from_config(cfg, registry, **kwargs)
File "/data-123/zishen/cvproject/VGen/utils/registry.py", line 69, in build_from_config
raise Exception(f"Failed to invoke function {req_type_entry}, with {e}")
Exception: Failed to invoke function <function inference_tft2v_entrance at 0x7f8b2e6ce550>, with process 7 terminated with exit code 1