CUDA can't use gpu as backend #3751

ChiaYen-Kan · 2025-02-08T12:50:20Z

ChiaYen-Kan
Feb 8, 2025

GPU is RTX 3060 12g vram, after install can't use GPU as backend
use txt2img test, GPU is not work, only cpu work

log

Using VENV: F:\AI\sdnext\venv
20:38:57-152717 INFO     Starting SD.Next
20:38:57-152717 INFO     Logger: file="F:\AI\sdnext\sdnext.log" level=DEBUG size=65 mode=create
20:38:57-152717 INFO     Python: version=3.11.9 platform=Windows bin="F:\AI\sdnext\venv\Scripts\python.exe"
                         venv="F:\AI\sdnext\venv"
20:38:57-294995 INFO     Version: app=sd.next updated=2025-02-05 hash=9f122234 branch=master
                         url=https://github.com/vladmandic/sdnext/tree/master ui=main
20:38:58-025375 INFO     Platform: arch=AMD64 cpu=AMD64 Family 25 Model 97 Stepping 2, AuthenticAMD system=Windows
                         release=Windows-10-10.0.26100-SP0 python=3.11.9 docker=False
20:38:58-025375 DEBUG    Packages: venv=venv site=['venv', 'venv\\Lib\\site-packages']
20:38:58-041595 INFO     Args: ['--use-cuda', '--debug', '--models-dir', 'F:/AI/Models']
20:38:58-041595 DEBUG    Setting environment tuning
20:38:58-041595 DEBUG    Torch allocator: "garbage_collection_threshold:0.80,max_split_size_mb:512"
20:38:58-045777 DEBUG    Torch overrides: cuda=True rocm=False ipex=False directml=False openvino=False zluda=False
20:38:58-045777 INFO     CUDA: nVidia toolkit detected
20:38:58-088733 WARNING  Modified files: ['modules/lora/extra_networks_lora.py', 'modules/lora/network.py']
20:38:58-135920 INFO     Install: verifying requirements
20:38:58-167685 DEBUG    Timestamp repository update time: Wed Feb  5 21:26:20 2025
20:38:58-167685 INFO     Startup: standard
20:38:58-167685 INFO     Verifying submodules
20:39:00-035774 DEBUG    Git submodule: extensions-builtin/sd-extension-chainner / main
20:39:00-095385 DEBUG    Git submodule: extensions-builtin/sd-extension-system-info / main
20:39:00-154597 DEBUG    Git submodule: extensions-builtin/sd-webui-agent-scheduler / main
20:39:00-241118 DEBUG    Git detached head detected: folder="extensions-builtin/sdnext-modernui" reattach=main
20:39:00-243120 DEBUG    Git submodule: extensions-builtin/sdnext-modernui / main
20:39:00-299422 DEBUG    Git submodule: extensions-builtin/stable-diffusion-webui-rembg / master
20:39:00-359615 DEBUG    Git submodule: modules/k-diffusion / master
20:39:00-446311 DEBUG    Git detached head detected: folder="wiki" reattach=master
20:39:00-446311 DEBUG    Git submodule: wiki / master
20:39:00-479824 DEBUG    Register paths
20:39:00-515337 DEBUG    Installed packages: 185
20:39:00-515337 DEBUG    Extensions all: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
                         'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg']
20:39:00-621888 DEBUG    Extension installer: F:\AI\sdnext\extensions-builtin\sd-webui-agent-scheduler\install.py
20:39:03-134488 DEBUG    Extension installer: F:\AI\sdnext\extensions-builtin\stable-diffusion-webui-rembg\install.py
20:39:08-881838 DEBUG    Extensions all: ['adetailer', 'ultimate-upscale-for-automatic1111']
20:39:08-881838 DEBUG    Extension force: name="adetailer" commit=a89c01d
20:39:08-913924 DEBUG    Extension installer: F:\AI\sdnext\extensions\adetailer\install.py
20:39:09-073173 INFO     Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
                         'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg', 'adetailer',
                         'ultimate-upscale-for-automatic1111']
20:39:09-073173 INFO     Install: verifying requirements
20:39:09-073173 DEBUG    Setup complete without errors: 1739018349
20:39:09-088830 DEBUG    Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0}
20:39:09-088830 INFO     Command line args: ['--use-cuda', '--debug', '--models-dir', 'F:/AI/Models']
                         models_dir=F:/AI/Models use_cuda=True debug=True args=[]
20:39:09-088830 DEBUG    Env flags: []
20:39:09-088830 DEBUG    Starting module: <module 'webui' from 'F:\\AI\\sdnext\\webui.py'>
20:39:21-940899 INFO     Torch: torch==2.6.0+cpu torchvision==0.21.0+cpu
20:39:21-940899 INFO     Packages: diffusers==0.33.0.dev0 transformers==4.48.2 accelerate==1.3.0 gradio==3.43.2
20:39:22-051649 DEBUG    Read: file="config.json" json=33 bytes=1527 time=0.000 fn=<module>:load
20:39:22-566550 INFO     Engine: backend=Backend.DIFFUSERS compute=cpu device=cpu attention="Scaled-Dot-Product"
                         mode=no_grad
20:39:22-575061 DEBUG    Read: file="html\reference.json" json=63 bytes=32978 time=0.009
                         fn=_call_with_frames_removed:<module>
20:39:22-575061 INFO     Torch parameters: backend=cpu device=cpu config=Auto dtype=torch.bfloat16 context=no_grad
                         nohalf=False nohalfvae=False upcast=False deterministic=False tunable=[False, False] fp16=pass
                         bf16=pass optimization="Scaled-Dot-Product"
20:39:22-766411 DEBUG    ONNX: version=1.20.1 provider=CPUExecutionProvider, available=['AzureExecutionProvider',
                         'CPUExecutionProvider']
20:39:22-796667 INFO     Device:
20:39:22-875690 DEBUG    Entering start sequence
20:39:22-875690 INFO     Base path: models="F:/AI/Models"
20:39:22-875690 DEBUG    Initializing
20:39:22-875690 DEBUG    Read: file="metadata.json" json=3 bytes=5904 time=0.000 fn=initialize:init_metadata
20:39:22-875690 DEBUG    Read: file="cache.json" json=2 bytes=239 time=0.000 fn=initialize:init_cache
20:39:22-875690 DEBUG    Huggingface cache: path="C:\Users\ChiaYen\.cache\huggingface\hub"
20:39:22-907468 INFO     Available VAEs: path="F:/AI/Models\VAE" items=7
20:39:22-907468 INFO     Available UNets: path="F:/AI/Models\UNET" items=0
20:39:22-907468 INFO     Available TEs: path="F:/AI/Models\Text-encoder" items=0
20:39:22-907468 INFO     Available Models: items=1 safetensors="F:/AI/Models\Stable-diffusion":1
                         diffusers="F:/AI/Models\Diffusers":0 time=0.00
20:39:22-923429 INFO     Available LoRAs: path="F:/AI/Models\Lora" items=2 folders=2 time=0.00
20:39:23-367084 INFO     Available Styles: folder="F:/AI/Models\styles" items=365 time=0.44
20:39:23-413107 INFO     Available Detailer: path="F:/AI/Models\yolo" items=10 downloaded=1
20:39:23-413107 DEBUG    Extensions: disabled=['Lora', 'sdnext-modernui']
20:39:23-413107 INFO     Load extensions
20:39:23-981676 INFO     Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using
                         sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
20:39:24-315560 INFO     Extension: script='extensions\adetailer\scripts\!adetailer.py' [-] ADetailer initialized.
                         version: 24.5.1, num models: 25
20:39:24-315560 DEBUG    Extensions init time: total=0.90 sd-webui-agent-scheduler=0.49 adetailer=0.33
20:39:24-331258 DEBUG    Read: file="html/upscalers.json" json=4 bytes=2640 time=0.016 fn=__init__:__init__
20:39:24-331258 DEBUG    Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2693 time=0.000
                         fn=__init__:find_scalers
20:39:24-331258 DEBUG    chaiNNer models: path="F:/AI/Models\chaiNNer" defined=24 discovered=0 downloaded=2
20:39:24-331258 INFO     Available Upscalers: items=64 downloaded=13 user=0 time=0.02 types=['None', 'Resize', 'Latent',
                         'AsymmetricVAE', 'ChaiNNer', 'AuraSR', 'ESRGAN', 'RealESRGAN', 'SCUNet', 'Diffusion', 'SwinIR']
20:39:24-346970 DEBUG    UI start sequence
20:39:24-346970 INFO     UI theme: type=Standard name="black-teal" available=13
20:39:24-346970 DEBUG    UI theme: css="F:\AI\sdnext\javascript\black-teal.css" base="sdnext.css" user="None"
20:39:24-346970 DEBUG    UI initialize: txt2img
20:39:24-568870 DEBUG    Networks: page='model' items=63 subfolders=5 tab=txt2img
                         folders=['F:/AI/Models\\Stable-diffusion', 'F:/AI/Models\\Diffusers', 'models\\Reference']
                         list=0.02 thumb=0.00 desc=0.00 info=0.00 workers=8
20:39:24-568870 DEBUG    Networks: page='lora' items=2 subfolders=2 tab=txt2img folders=['F:/AI/Models\\Lora'] list=0.01
                         thumb=0.00 desc=0.00 info=0.00 workers=8
20:39:24-568870 DEBUG    Networks: page='style' items=365 subfolders=5 tab=txt2img folders=['F:/AI/Models\\styles',
                         'html'] list=0.19 thumb=0.00 desc=0.00 info=0.00 workers=8
20:39:24-568870 DEBUG    Networks: page='embedding' items=27 subfolders=1 tab=txt2img
                         folders=['F:/AI/Models\\embeddings'] list=0.02 thumb=0.00 desc=0.00 info=0.01 workers=8
20:39:24-568870 DEBUG    Networks: page='vae' items=7 subfolders=1 tab=txt2img folders=['F:/AI/Models\\VAE'] list=0.02
                         thumb=0.02 desc=0.00 info=0.00 workers=8
20:39:24-584946 DEBUG    Networks: page='history' items=0 subfolders=1 tab=txt2img folders=[] list=0.00 thumb=0.00
                         desc=0.00 info=0.00 workers=8
20:39:24-648010 DEBUG    Script: op=after-component total=0.02 scripts=['Video: LTX Video:0.02']
20:39:24-778789 DEBUG    UI initialize: img2img
20:39:24-903109 DEBUG    UI initialize: control models="F:/AI/Models\control"
20:39:25-328030 DEBUG    Read: file="ui-config.json" json=45 bytes=1984 time=0.000 fn=__init__:read_from_file
20:39:25-486470 DEBUG    Script: op=before-component total=0.02 scripts=['ResAdapter: Domain Consistent
                         Resolution:0.02']
20:39:26-120203 DEBUG    Extension list: processed=402 installed=8 enabled=6 disabled=2 visible=402 hidden=0
20:39:26-436230 DEBUG    Root paths: ['F:\\AI\\sdnext']
20:39:26-486749 INFO     Local URL: http://127.0.0.1:7860/
20:39:26-486749 DEBUG    API middleware: [<class 'starlette.middleware.base.BaseHTTPMiddleware'>, <class
                         'starlette.middleware.gzip.GZipMiddleware'>]
20:39:26-486749 DEBUG    API initialize
20:39:26-610952 INFO     [AgentScheduler] Task queue is empty
20:39:26-610952 INFO     [AgentScheduler] Registering APIs
20:39:26-912563 DEBUG    Scripts setup: time=0.300 ['K-Diffusion Samplers:0.064', 'ADetailer:0.063', 'Video: LTX
                         Video:0.016', 'XYZ Grid:0.016', 'HDR: High Dynamic Range:0.016', 'Video: CogVideoX:0.016',
                         'Mixture Tiling: Scene Composition:0.016', 'Loopback:0.016', 'Agent Scheduler:0.016',
                         'InstantIR: Image Restoration:0.016', 'Differential diffusion: Individual Pixel
                         Strength:0.016', 'Style Aligned Image Generation:0.015']
20:39:26-928403 DEBUG    Model metadata: file="metadata.json" no changes
20:39:26-928403 DEBUG    Model requested: fn=run:<lambda>
20:39:26-928403 INFO     Load model: select="2D\lastpiececore_a0751+hassakuHentaiModel_v13 [00ff6f10b1]"
Progress  6.78it/s █████████ 100% 6/6 00:00 00:00 Loading pipeline components...
20:39:27-975379 DEBUG    Setting model: pipeline=StableDiffusionPipeline config={'low_cpu_mem_usage': True,
                         'torch_dtype': torch.bfloat16, 'load_connected_pipeline': True, 'extract_ema': False, 'config':
                         'configs/sd15', 'use_safetensors': True, 'cache_dir':
                         'C:\\Users\\ChiaYen\\.cache\\huggingface\\hub'}
20:39:29-142590 DEBUG    UI: connected
20:39:29-932388 INFO     Load network: type=embeddings loaded=25 skipped=1 time=1.96
20:39:29-932388 DEBUG    Setting model: component=VAE slicing=True
20:39:29-932388 DEBUG    Setting model: attention="Scaled-Dot-Product"
20:39:29-932388 DEBUG    Setting model: offload=none limit=0.0
20:39:30-201669 DEBUG    GC: current={'gpu': 0, 'ram': 3.05, 'oom': 0} prev={'gpu': 0, 'ram': 3.05} load={'gpu': 0,
                         'ram': 5} gc={'gpu': 0, 'py': 5321} fn=reload_model_weights:load_diffuser why=force time=0.27
20:39:30-201669 INFO     Load model: time=total=3.00 embeddings=1.96 load=1.05 native=512 memory={'ram': {'used': 3.05,
                         'total': 63.65}}
20:39:30-201669 DEBUG    Script init: ['task_scheduler.py:app_started=0.32']
20:39:30-201669 INFO     Startup time: total=33.27 torch=23.09 launch=12.26 installer=12.16 checkpoint=3.29 gradio=1.68
                         libraries=1.04 extensions=0.90 ui-extensions=0.60 styles=0.44 app-started=0.36 ui-networks=0.33
                         ui-defaults=0.25 ui-settings=0.21 ui-txt2img=0.17 ui-models=0.16 ui-control=0.16
                         ui-img2img=0.10 api=0.06
20:39:30-201669 DEBUG    Save: file="config.json" json=33 bytes=1477 time=0.000
20:39:43-327991 INFO     API user=None code=200 http/1.1 GET /sdapi/v1/motd 127.0.0.1 0.5446
20:39:46-577325 INFO     API user=None code=200 http/1.1 GET /sdapi/v1/sd-models 127.0.0.1 0.0
20:39:50-113507 INFO     Browser session: user=None client=127.0.0.1 agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64;
                         rv:128.0) Gecko/20100101 Firefox/128.0
20:39:50-115251 INFO     API user=None code=200 http/1.1 GET /sdapi/v1/start 127.0.0.1 0.0017
20:39:50-115251 INFO     UI: ready time=8.846
20:39:50-210433 DEBUG    UI: connected
20:40:00-231668 DEBUG    Server: alive=True requests=166 memory=0/0 status='running' task='Load'
                         timestamp='20250208203926' id='' job=0 jobs=0 total=1 step=0 steps=0 queued=0 uptime=38
                         elapsed=33.3 eta=None progress=0
20:42:00-271000 DEBUG    Server: alive=True requests=190 memory=0/0 status='running' task='Load'
                         timestamp='20250208203926' id='' job=0 jobs=0 total=1 step=0 steps=0 queued=0 uptime=158
                         elapsed=153.34 eta=None progress=0

Answered by vladmandic

Feb 8, 2025

1.9/2.5 GB
HTTPSConnectionPool(host='download.pytorch.org', port=443): Read timed out.

you can see that torch download fails due to bad internet link after it downloaded 75%. not much i can do about that.

my custom fix for civitai can detect lora information when upload image

care to share?

View full answer

vladmandic · 2025-02-08T13:02:36Z

vladmandic
Feb 8, 2025
Maintainer

20:39:21-940899 INFO Torch: torch==2.6.0+cpu torchvision==0.21.0+cpu

seems you have torch for cpu already installed and in that case sdnext will NOT replace it.
if you want sdnext to replace it, re-run with --reinstall command line flag added.

20:38:58-088733 WARNING Modified files: ['modules/lora/extra_networks_lora.py', 'modules/lora/network.py']

why do you have this?

3 replies

ChiaYen-Kan Feb 8, 2025
Author

20:39:21-940899 INFO Torch: torch==2.6.0+cpu torchvision==0.21.0+cpu

seems you have torch for cpu already installed and in that case sdnext will NOT replace it. if you want sdnext to replace it, re-run with --reinstall command line flag added.

CUDA Torch can't install

Using VENV: F:\AI\sdnext\venv
21:06:50-125630 INFO     Starting SD.Next
21:06:50-125630 INFO     Logger: file="F:\AI\sdnext\sdnext.log" level=DEBUG size=65 mode=create
21:06:50-125630 INFO     Python: version=3.11.9 platform=Windows bin="F:\AI\sdnext\venv\Scripts\python.exe"
                         venv="F:\AI\sdnext\venv"
21:06:50-269046 INFO     Version: app=sd.next updated=2025-02-05 hash=9f122234 branch=master
                         url=https://github.com/vladmandic/sdnext/tree/master ui=main
21:06:50-955884 INFO     Platform: arch=AMD64 cpu=AMD64 Family 25 Model 97 Stepping 2, AuthenticAMD system=Windows
                         release=Windows-10-10.0.26100-SP0 python=3.11.9 docker=False
21:06:50-955884 DEBUG    Packages: venv=venv site=['venv', 'venv\\Lib\\site-packages']
21:06:50-955884 INFO     Args: ['--use-cuda', '--debug', '--models-dir', 'F:/AI/Models', '--reinstall']
21:06:50-955884 DEBUG    Setting environment tuning
21:06:50-955884 DEBUG    Torch allocator: "garbage_collection_threshold:0.80,max_split_size_mb:512"
21:06:50-963443 DEBUG    Torch overrides: cuda=True rocm=False ipex=False directml=False openvino=False zluda=False
21:06:50-963443 INFO     CUDA: nVidia toolkit detected
21:10:02-580904 ERROR    Install: pip: install --upgrade torch==2.6.0+cu126 torchvision==0.21.0+cu126 --index-url
                         https://download.pytorch.org/whl/cu126
21:10:02-580904 DEBUG    Install: pip output Looking in indexes: https://download.pytorch.org/whl/cu126
                         Collecting torch==2.6.0+cu126
                           Using cached
                         https://download.pytorch.org/whl/cu126/torch-2.6.0%2Bcu126-cp311-cp311-win_amd64.whl.metadata
                         (28 kB)
                         Collecting torchvision==0.21.0+cu126
                           Using cached
                         https://download.pytorch.org/whl/cu126/torchvision-0.21.0%2Bcu126-cp311-cp311-win_amd64.whl.met
                         adata (6.3 kB)
                         Requirement already satisfied: filelock in f:\ai\sdnext\venv\lib\site-packages (from
                         torch==2.6.0+cu126) (3.17.0)
                         Requirement already satisfied: typing-extensions>=4.10.0 in f:\ai\sdnext\venv\lib\site-packages
                         (from torch==2.6.0+cu126) (4.12.2)
                         Requirement already satisfied: networkx in f:\ai\sdnext\venv\lib\site-packages (from
                         torch==2.6.0+cu126) (3.4.2)
                         Requirement already satisfied: jinja2 in f:\ai\sdnext\venv\lib\site-packages (from
                         torch==2.6.0+cu126) (3.1.5)
                         Requirement already satisfied: fsspec in f:\ai\sdnext\venv\lib\site-packages (from
                         torch==2.6.0+cu126) (2025.2.0)
                         Requirement already satisfied: sympy==1.13.1 in f:\ai\sdnext\venv\lib\site-packages (from
                         torch==2.6.0+cu126) (1.13.1)
                         Requirement already satisfied: numpy in f:\ai\sdnext\venv\lib\site-packages (from
                         torchvision==0.21.0+cu126) (1.26.4)
                         Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in f:\ai\sdnext\venv\lib\site-packages
                         (from torchvision==0.21.0+cu126) (10.4.0)
                         Requirement already satisfied: mpmath<1.4,>=1.1.0 in f:\ai\sdnext\venv\lib\site-packages (from
                         sympy==1.13.1->torch==2.6.0+cu126) (1.3.0)
                         Requirement already satisfied: MarkupSafe>=2.0 in f:\ai\sdnext\venv\lib\site-packages (from
                         jinja2->torch==2.6.0+cu126) (2.1.5)
                         Downloading
                         https://download.pytorch.org/whl/cu126/torch-2.6.0%2Bcu126-cp311-cp311-win_amd64.whl (2496.1
                         MB)
                            -------------------------------          1.9/2.5 GB 11.1 MB/s eta 0:00:51

                         ERROR: Exception:
                         Traceback (most recent call last):
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_vendor\urllib3\response.py", line 438, in
                         _error_catcher
                             yield
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_vendor\urllib3\response.py", line 561, in read
                             data = self._fp_read(amt) if not fp_closed else b""
                                    ^^^^^^^^^^^^^^^^^^
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_vendor\urllib3\response.py", line 527, in
                         _fp_read
                             return self._fp.read(amt) if amt is not None else self._fp.read()
                                    ^^^^^^^^^^^^^^^^^^
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_vendor\cachecontrol\filewrapper.py", line 98,
                         in read
                             data: bytes = self.__fp.read(amt)
                                           ^^^^^^^^^^^^^^^^^^^
                           File "C:\Program Files\Python311\Lib\http\client.py", line 473, in read
                             s = self.fp.read(amt)
                                 ^^^^^^^^^^^^^^^^^
                           File "C:\Program Files\Python311\Lib\socket.py", line 706, in readinto
                             return self._sock.recv_into(b)
                                    ^^^^^^^^^^^^^^^^^^^^^^^
                           File "C:\Program Files\Python311\Lib\ssl.py", line 1314, in recv_into
                             return self.read(nbytes, buffer)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^
                           File "C:\Program Files\Python311\Lib\ssl.py", line 1166, in read
                             return self._sslobj.read(len, buffer)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                         TimeoutError: The read operation timed out

                         During handling of the above exception, another exception occurred:

                         Traceback (most recent call last):
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\cli\base_command.py", line 180, in
                         exc_logging_wrapper
                             status = run_func(*args)
                                      ^^^^^^^^^^^^^^^
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\cli\req_command.py", line 245, in
                         wrapper
                             return func(self, options, args)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\commands\install.py", line 377, in
                         run
                             requirement_set = resolver.resolve(
                                               ^^^^^^^^^^^^^^^^^
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\resolution\resolvelib\resolver.py",
                         line 179, in resolve
                             self.factory.preparer.prepare_linked_requirements_more(reqs)
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\operations\prepare.py", line 552, in
                         prepare_linked_requirements_more
                             self._complete_partial_requirements(
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\operations\prepare.py", line 467, in
                         _complete_partial_requirements
                             for link, (filepath, _) in batch_download:
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\network\download.py", line 183, in
                         __call__
                             for chunk in chunks:
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\cli\progress_bars.py", line 53, in
                         _rich_progress_bar
                             for chunk in iterable:
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_internal\network\utils.py", line 63, in
                         response_chunks
                             for chunk in response.raw.stream(
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_vendor\urllib3\response.py", line 622, in
                         stream
                             data = self.read(amt=amt, decode_content=decode_content)
                                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_vendor\urllib3\response.py", line 560, in read
                             with self._error_catcher():
                           File "C:\Program Files\Python311\Lib\contextlib.py", line 158, in __exit__
                             self.gen.throw(typ, value, traceback)
                           File "F:\AI\sdnext\venv\Lib\site-packages\pip\_vendor\urllib3\response.py", line 443, in
                         _error_catcher
                             raise ReadTimeoutError(self._pool, None, "Read timed out.")
                         pip._vendor.urllib3.exceptions.ReadTimeoutError:
                         HTTPSConnectionPool(host='download.pytorch.org', port=443): Read timed out.

                         [notice] A new release of pip is available: 24.0 -> 25.0
                         [notice] To update, run: F:\AI\sdnext\venv\Scripts\python.exe -m pip install --upgrade pip
21:10:02-692322 WARNING  Modified files: ['modules/lora/extra_networks_lora.py', 'modules/lora/network.py']
21:10:02-692322 INFO     Forcing reinstall of all packages
21:10:02-739770 INFO     Install: verifying requirements
21:10:08-067974 INFO     Startup: standard
21:10:08-067974 INFO     Verifying submodules
21:10:09-954697 DEBUG    Git submodule: extensions-builtin/sd-extension-chainner / main
21:10:10-002266 DEBUG    Git submodule: extensions-builtin/sd-extension-system-info / main
21:10:10-049765 DEBUG    Git submodule: extensions-builtin/sd-webui-agent-scheduler / main
21:10:10-144038 DEBUG    Git detached head detected: folder="extensions-builtin/sdnext-modernui" reattach=main
21:10:10-144038 DEBUG    Git submodule: extensions-builtin/sdnext-modernui / main
21:10:10-191179 DEBUG    Git submodule: extensions-builtin/stable-diffusion-webui-rembg / master
21:10:10-254350 DEBUG    Git submodule: modules/k-diffusion / master
21:10:10-337115 DEBUG    Git detached head detected: folder="wiki" reattach=master
21:10:10-337115 DEBUG    Git submodule: wiki / master
21:10:10-365945 DEBUG    Register paths
21:10:10-397458 DEBUG    Installed packages: 185
21:10:10-413562 DEBUG    Extensions all: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
                         'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg']
21:10:10-493522 DEBUG    Extension installer: F:\AI\sdnext\extensions-builtin\sd-webui-agent-scheduler\install.py
21:10:11-998707 DEBUG    Extension installer: F:\AI\sdnext\extensions-builtin\stable-diffusion-webui-rembg\install.py
21:10:17-829623 DEBUG    Extensions all: ['adetailer', 'ultimate-upscale-for-automatic1111']
21:10:17-829623 DEBUG    Extension force: name="adetailer" commit=a89c01d
21:10:17-866897 DEBUG    Extension installer: F:\AI\sdnext\extensions\adetailer\install.py
21:10:18-020596 INFO     Extensions enabled: ['Lora', 'sd-extension-chainner', 'sd-extension-system-info',
                         'sd-webui-agent-scheduler', 'sdnext-modernui', 'stable-diffusion-webui-rembg', 'adetailer',
                         'ultimate-upscale-for-automatic1111']
21:10:18-020596 INFO     Install: verifying requirements
21:10:18-020596 WARNING  Setup complete with errors: ['pip: torch==2.6.0+cu126 torchvision==0.21.0+cu126 --index-url
                         https://download.pytorch.org/whl/cu126']
21:10:18-020596 WARNING  See log file for more details: F:\AI\sdnext\sdnext.log
21:10:18-020596 DEBUG    Extension preload: {'extensions-builtin': 0.0, 'extensions': 0.0}
21:10:18-020596 INFO     Command line args: ['--use-cuda', '--debug', '--models-dir', 'F:/AI/Models', '--reinstall']
                         models_dir=F:/AI/Models reinstall=True use_cuda=True debug=True args=[]
21:10:18-020596 DEBUG    Env flags: []
21:10:18-020596 DEBUG    Starting module: <module 'webui' from 'F:\\AI\\sdnext\\webui.py'>
21:10:22-038976 INFO     Torch: torch==2.6.0+cpu torchvision==0.21.0+cpu
21:10:22-038976 INFO     Packages: diffusers==0.33.0.dev0 transformers==4.48.2 accelerate==1.3.0 gradio==3.43.2
21:10:22-133757 DEBUG    Read: file="config.json" json=44 bytes=2090 time=0.000 fn=<module>:load
21:10:22-403949 WARNING  Setting validation: unknown=['ad_bbox_sortby']
21:10:22-403949 INFO     Engine: backend=Backend.DIFFUSERS compute=cpu device=cpu attention="Scaled-Dot-Product"
                         mode=no_grad
21:10:22-403949 INFO     Torch parameters: backend=cpu device=cpu config=Auto dtype=torch.bfloat16 context=no_grad
                         nohalf=False nohalfvae=False upcast=False deterministic=False tunable=[False, False] fp16=pass
                         bf16=pass optimization="Scaled-Dot-Product"
21:10:22-530767 DEBUG    ONNX: version=1.20.1 provider=CPUExecutionProvider, available=['AzureExecutionProvider',
                         'CPUExecutionProvider']
21:10:22-562523 INFO     Device:
21:10:22-641368 DEBUG    Entering start sequence
21:10:22-641368 INFO     Base path: models="F:/AI/Models"
21:10:22-641368 DEBUG    Initializing
21:10:22-641368 DEBUG    Read: file="metadata.json" json=3 bytes=5904 time=0.000 fn=initialize:init_metadata
21:10:22-641368 DEBUG    Read: file="cache.json" json=2 bytes=239 time=0.000 fn=initialize:init_cache
21:10:22-641368 DEBUG    Huggingface cache: path="C:\Users\ChiaYen\.cache\huggingface\hub"
21:10:22-657123 INFO     Available VAEs: path="F:/AI/Models\VAE" items=7
21:10:22-672919 INFO     Available UNets: path="F:/AI/Models\UNET" items=0
21:10:22-672919 INFO     Available TEs: path="F:/AI/Models\Text-encoder" items=0
21:10:22-672919 INFO     Available Models: items=1 safetensors="F:/AI/Models\Stable-diffusion":1
                         diffusers="F:/AI/Models\Diffusers":0 time=0.00
21:10:22-672919 INFO     Available LoRAs: path="F:/AI/Models\Lora" items=2 folders=2 time=0.00
21:10:22-688616 INFO     Available Styles: folder="F:/AI/Models\styles" items=365 time=0.02
21:10:27-060890 INFO     Available Detailer: path="F:/AI/Models\yolo" items=10 downloaded=1
21:10:27-060890 DEBUG    Extensions: disabled=['Lora', 'sdnext-modernui']
21:10:27-060890 INFO     Load extensions
21:10:27-650710 INFO     Extension: script='extensions-builtin\sd-webui-agent-scheduler\scripts\task_scheduler.py' Using
                         sqlite file: extensions-builtin\sd-webui-agent-scheduler\task_scheduler.sqlite3
21:10:28-318013 INFO     Extension: script='extensions\adetailer\scripts\!adetailer.py' [-] ADetailer initialized.
                         version: 24.5.1, num models: 25
21:10:28-333730 DEBUG    Extensions init time: total=1.27 adetailer=0.68 sd-webui-agent-scheduler=0.51
21:10:28-333730 DEBUG    Read: file="html/upscalers.json" json=4 bytes=2640 time=0.000 fn=__init__:__init__
21:10:28-333730 DEBUG    Read: file="extensions-builtin\sd-extension-chainner\models.json" json=24 bytes=2693 time=0.000
                         fn=__init__:find_scalers
21:10:28-333730 DEBUG    chaiNNer models: path="F:/AI/Models\chaiNNer" defined=24 discovered=0 downloaded=2
21:10:28-333730 INFO     Available Upscalers: items=64 downloaded=13 user=0 time=0.00 types=['None', 'Resize', 'Latent',
                         'AsymmetricVAE', 'ChaiNNer', 'AuraSR', 'ESRGAN', 'RealESRGAN', 'SCUNet', 'Diffusion', 'SwinIR']
21:10:28-333730 DEBUG    UI start sequence
21:10:28-333730 INFO     UI theme: type=Standard name="black-teal" available=13
21:10:28-351801 DEBUG    UI theme: css="F:\AI\sdnext\javascript\black-teal.css" base="sdnext.css" user="None"
21:10:28-351801 DEBUG    UI initialize: txt2img
21:10:28-381861 DEBUG    Networks: page='model' items=1 subfolders=2 tab=txt2img
                         folders=['F:/AI/Models\\Stable-diffusion', 'F:/AI/Models\\Diffusers', 'models\\Reference']
                         list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8
21:10:28-381861 DEBUG    Networks: page='lora' items=2 subfolders=2 tab=txt2img folders=['F:/AI/Models\\Lora'] list=0.00
                         thumb=0.00 desc=0.00 info=0.00 workers=8
21:10:28-397556 DEBUG    Networks: page='style' items=365 subfolders=5 tab=txt2img folders=['F:/AI/Models\\styles',
                         'html'] list=0.02 thumb=0.02 desc=0.00 info=0.00 workers=8
21:10:28-397556 DEBUG    Networks: page='embedding' items=27 subfolders=1 tab=txt2img
                         folders=['F:/AI/Models\\embeddings'] list=0.00 thumb=0.00 desc=0.00 info=0.00 workers=8
21:10:28-397556 DEBUG    Networks: page='vae' items=7 subfolders=1 tab=txt2img folders=['F:/AI/Models\\VAE'] list=0.00
                         thumb=0.00 desc=0.00 info=0.00 workers=8
21:10:28-397556 DEBUG    Networks: page='history' items=0 subfolders=1 tab=txt2img folders=[] list=0.00 thumb=0.00
                         desc=0.00 info=0.00 workers=8
21:10:30-606022 DEBUG    UI initialize: img2img
21:10:30-733407 DEBUG    UI initialize: control models="F:/AI/Models\control"
21:10:31-147498 DEBUG    Read: file="ui-config.json" json=45 bytes=1984 time=0.000 fn=__init__:read_from_file
21:10:32-084012 DEBUG    Extension list: processed=402 installed=8 enabled=6 disabled=2 visible=402 hidden=0
21:10:32-179445 DEBUG    Root paths: ['F:\\AI\\sdnext']
21:10:32-242982 INFO     Local URL: http://127.0.0.1:7860/
21:10:32-242982 DEBUG    API middleware: [<class 'starlette.middleware.base.BaseHTTPMiddleware'>, <class
                         'starlette.middleware.gzip.GZipMiddleware'>]
21:10:32-242982 DEBUG    API initialize
21:10:32-368834 INFO     [AgentScheduler] Task queue is empty
21:10:32-368834 INFO     [AgentScheduler] Registering APIs
21:10:32-702388 DEBUG    Scripts setup: time=2.352 ['K-Diffusion Samplers:2.093', 'ADetailer:0.07', 'IP Adapters:0.032',
                         'XYZ Grid:0.032', 'ConsiStory: Consistent Image Generation:0.025', 'Regional prompting:0.016',
                         'FreeScale: Tuning-Free Scale Fusion:0.016', 'Video: AnimateDiff:0.016', 'Video:
                         CogVideoX:0.016', 'InstantIR: Image Restoration:0.016', 'Style Aligned Image Generation:0.016']
21:10:32-702388 DEBUG    Model metadata: file="metadata.json" no changes
21:10:32-702388 DEBUG    Model requested: fn=run:<lambda>
21:10:32-702388 INFO     Load model: select="2D\lastpiececore_a0751+hassakuHentaiModel_v13 [00ff6f10b1]"
21:10:32-702388 INFO     Load module: type=VAE model="F:\AI\Models\VAE\vae-ft-mse-840000-ema-pruned.safetensors"
                         source=settings config={'low_cpu_mem_usage': False, 'torch_dtype': torch.bfloat16,
                         'use_safetensors': True, 'config': 'configs/sd15\\vae'}
Progress  6.62it/s █████████ 100% 6/6 00:00 00:00 Loading pipeline components...
21:10:33-892710 DEBUG    Setting model: pipeline=StableDiffusionPipeline config={'low_cpu_mem_usage': True,
                         'torch_dtype': torch.bfloat16, 'load_connected_pipeline': True, 'extract_ema': False, 'config':
                         'configs/sd15', 'use_safetensors': True, 'cache_dir':
                         'C:\\Users\\ChiaYen\\.cache\\huggingface\\hub'}
21:10:35-748409 INFO     Load network: type=embeddings loaded=25 skipped=1 time=1.85
21:10:35-759028 DEBUG    Setting model: component=VAE name="vae-ft-mse-840000-ema-pruned.safetensors"
21:10:35-759028 DEBUG    Setting model: component=VAE slicing=True
21:10:35-759028 DEBUG    Setting model: attention="Scaled-Dot-Product"
21:10:35-764144 DEBUG    Setting model: offload=none limit=0.0
21:10:36-017625 DEBUG    GC: current={'gpu': 0, 'ram': 3.05, 'oom': 0} prev={'gpu': 0, 'ram': 3.05} load={'gpu': 0,
                         'ram': 5} gc={'gpu': 0, 'py': 5324} fn=reload_model_weights:load_diffuser why=force time=0.25
21:10:36-017625 INFO     Load model: time=total=3.06 embeddings=1.86 load=1.10 vae=0.10 native=512 memory={'ram':
                         {'used': 3.05, 'total': 63.65}}
21:10:36-017625 DEBUG    Script init: ['task_scheduler.py:app_started=0.34']
21:10:36-017625 INFO     Startup time: total=226.11 torch=211.19 launch=208.20 installer=208.12 detailer=4.37
                         checkpoint=3.32 ui-txt2img=2.18 extensions=1.27 ui-extensions=0.76 gradio=0.73 libraries=0.70
                         app-started=0.40 ui-settings=0.21 ui-networks=0.18 ui-control=0.17 ui-models=0.14
                         ui-img2img=0.10 api=0.06 ui-defaults=0.06
21:10:36-017625 DEBUG    Save: file="config.json" json=44 bytes=2025 time=0.000

20:38:58-088733 WARNING Modified files: ['modules/lora/extra_networks_lora.py', 'modules/lora/network.py']

why do you have this?

my custom fix for civitai can detect lora information when upload image

vladmandic Feb 8, 2025
Maintainer

1.9/2.5 GB
HTTPSConnectionPool(host='download.pytorch.org', port=443): Read timed out.

you can see that torch download fails due to bad internet link after it downloaded 75%. not much i can do about that.

my custom fix for civitai can detect lora information when upload image

care to share?

Answer selected by ChiaYen-Kan

ChiaYen-Kan Feb 8, 2025
Author

1.9/2.5 GB
HTTPSConnectionPool(host='download.pytorch.org', port=443): Read timed out.

you can see that torch download fails due to bad internet link after it downloaded 75%. not much i can do about that.

is my wifi problem, use wired ethernet is successed install

my custom fix for civitai can detect lora information when upload image

care to share?

patch 1 for legacy lora method
lora-hash.patch

patch 2 for new lora method
lora-hash-2.patch

i also want to fix for embeddings, but has some problem i can't do it

embeddings don't calculate hash i don't known how to add it
i use 5 embeddings, but always only 2 embeddings info save to metadata
i can't understand embeddings info is how to save to metadata

this is embeddings example

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

CUDA can't use gpu as backend #3751

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 1 comment 3 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

CUDA can't use gpu as backend #3751

ChiaYen-Kan Feb 8, 2025

Replies: 1 comment · 3 replies

vladmandic Feb 8, 2025 Maintainer

ChiaYen-Kan Feb 8, 2025 Author

vladmandic Feb 8, 2025 Maintainer

ChiaYen-Kan Feb 8, 2025 Author

ChiaYen-Kan
Feb 8, 2025

Replies: 1 comment 3 replies

vladmandic
Feb 8, 2025
Maintainer

ChiaYen-Kan Feb 8, 2025
Author

vladmandic Feb 8, 2025
Maintainer

ChiaYen-Kan Feb 8, 2025
Author