Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm) #8

Closed
RINGOLINK opened this issue Jan 21, 2025 · 2 comments

Comments

@RINGOLINK
Copy link

ComfyUI Error Report

Error Details

  • Node ID: 36
  • Node Type: SamplerCustomAdvanced
  • Exception Type: RuntimeError
  • Exception Message: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm)

Stack Trace

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 327, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 202, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy_extras\nodes_custom_sampler.py", line 651, in sample
    samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 985, in sample
    output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 111, in execute
    return self.wrappers[self.idx](self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\pulidflux.py", line 392, in pulid_outer_sample_wrappers_with_override
    out = wrapper_executor(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 103, in __call__
    return new_executor.execute(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 110, in execute
    return self.original(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 953, in outer_sample
    output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 936, in inner_sample
    samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 110, in execute
    return self.original(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 715, in sample
    samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\custom_nodes/ComfyUI-Detail-Daemon\detail_daemon_node.py", line 297, in detail_daemon_sampler
    return dds_wrapped_sampler.sampler_function(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\k_diffusion\sampling.py", line 161, in sample_euler
    denoised = model(x, sigma_hat * s_in, **extra_args)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\custom_nodes/ComfyUI-Detail-Daemon\detail_daemon_node.py", line 289, in model_wrapper
    return model(x, adjusted_sigma, **extra_args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 380, in __call__
    out = self.inner_model(x, sigma, model_options=model_options, seed=seed)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 916, in __call__
    return self.predict_noise(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 919, in predict_noise
    return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 360, in sampling_function
    out = calc_cond_batch(model, conds, x, timestep, model_options)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 196, in calc_cond_batch
    return executor.execute(model, conds, x_in, timestep, model_options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 110, in execute
    return self.original(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 309, in _calc_cond_batch
    output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\model_base.py", line 131, in apply_model
    return comfy.patcher_extension.WrapperExecutor.new_class_executor(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 111, in execute
    return self.wrappers[self.idx](self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\pulidflux.py", line 417, in pulid_apply_model_wrappers
    out = wrapper_executor(x, t, c_concat, c_crossattn, control, transformer_options, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 103, in __call__
    return new_executor.execute(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 110, in execute
    return self.original(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\model_base.py", line 160, in _apply_model
    model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float()
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\ldm\flux\model.py", line 204, in forward
    out = self.forward_orig(img, img_ids, context, txt_ids, timestep, y, guidance, control, transformer_options, attn_mask=kwargs.get("attention_mask", None))
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\PulidFluxHook.py", line 189, in pulid_forward_orig
    out = blocks_replace[("double_block", i)]({"img": img,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\PulidFluxHook.py", line 74, in __call__
    img = img + callback(temp_img,
                ^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\PulidFluxHook.py", line 33, in pulid_patch
    pulid_img = weight * pulid_model.model.pulid_ca[ca_idx](embedding, img)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\encoders_flux.py", line 52, in forward
    x = self.norm1(x)
        ^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\normalization.py", line 217, in forward
    return F.layer_norm(
           ^^^^^^^^^^^^^

  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\functional.py", line 2900, in layer_norm
    return torch.layer_norm(
           ^^^^^^^^^^^^^^^^^

System Information

  • ComfyUI Version: 0.3.12
  • Arguments: C:\Users\Administrator\AppData\Local\Programs@comfyorgcomfyui-electron\resources\ComfyUI\main.py --user-directory E:\ComfyUI V\user --input-directory E:\ComfyUI V\input --output-directory E:\ComfyUI V\output --front-end-root C:\Users\Administrator\AppData\Local\Programs@comfyorgcomfyui-electron\resources\ComfyUI\web_custom_versions\desktop_app --extra-model-paths-config C:\Users\Administrator\AppData\Roaming\ComfyUI\extra_models_config.yaml --port 8000 --listen 127.0.0.1 --cuda-device 0 --disable-cuda-malloc --cache-classic
  • OS: nt
  • Python Version: 3.12.8 (main, Dec 6 2024, 18:10:20) [MSC v.1942 64 bit (AMD64)]
  • Embedded Python: false
  • PyTorch Version: 2.5.1+cu124

Devices

  • Name: cuda:0 NVIDIA A100 80GB PCIe : native
    • Type: cuda
    • VRAM Total: 85410512896
    • VRAM Free: 42668018688
    • Torch VRAM Total: 25077743616
    • Torch VRAM Free: 66931712

Logs

2025-01-21T19:27:06.850704 - got prompt
2025-01-21T19:27:06.864717 - Failed to validate prompt for output 317:
2025-01-21T19:27:06.864717 - * (prompt):
2025-01-21T19:27:06.865718 -   - Required input is missing: images
2025-01-21T19:27:06.865718 - * PreviewImage 317:
2025-01-21T19:27:06.865718 -   - Required input is missing: images
2025-01-21T19:27:06.865718 - Output will be ignored
2025-01-21T19:27:06.865718 - Failed to validate prompt for output 331:
2025-01-21T19:27:06.865718 - * (prompt):
2025-01-21T19:27:06.865718 -   - Required input is missing: images
2025-01-21T19:27:06.865718 - * PreviewImage 331:
2025-01-21T19:27:06.865718 -   - Required input is missing: images
2025-01-21T19:27:06.865718 - Output will be ignored
2025-01-21T19:27:06.865718 - Failed to validate prompt for output 203:
2025-01-21T19:27:06.865718 - * (prompt):
2025-01-21T19:27:06.865718 -   - Required input is missing: images
2025-01-21T19:27:06.865718 - * PreviewImage 203:
2025-01-21T19:27:06.866713 -   - Required input is missing: images
2025-01-21T19:27:06.866713 - Output will be ignored
2025-01-21T19:27:06.866713 - Failed to validate prompt for output 222:
2025-01-21T19:27:06.866713 - * (prompt):
2025-01-21T19:27:06.866713 -   - Required input is missing: images
2025-01-21T19:27:06.866713 - * PreviewImage 222:
2025-01-21T19:27:06.866713 -   - Required input is missing: images
2025-01-21T19:27:06.866713 - Output will be ignored
2025-01-21T19:27:06.866713 - Failed to validate prompt for output 141:
2025-01-21T19:27:06.866713 - * (prompt):
2025-01-21T19:27:06.866713 -   - Required input is missing: images
2025-01-21T19:27:06.866713 - * PreviewImage 141:
2025-01-21T19:27:06.866713 -   - Required input is missing: images
2025-01-21T19:27:06.866713 - Output will be ignored
2025-01-21T19:27:10.742600 - Loads SAM model: C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\sams\sam_vit_b_01ec64.pth (device:Prefer GPU)2025-01-21T19:27:10.742600 - 
2025-01-21T19:27:10.756612 - Using xformers attention in VAE
2025-01-21T19:27:10.757613 - Using xformers attention in VAE
2025-01-21T19:27:10.904757 - VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
2025-01-21T19:27:11.778319 - vision_config is None, using default vision config
2025-01-21T19:27:11.947028 - Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.
2025-01-21T19:27:17.064475 - 
Loading checkpoint shards: 100%|██████████| 2/2 [00:03<00:00,  1.57s/it]2025-01-21T19:27:17.064475 - 
Loading checkpoint shards: 100%|██████████| 2/2 [00:03<00:00,  1.68s/it]2025-01-21T19:27:17.064475 - 
2025-01-21T19:27:17.144540 - E:\ComfyUI V\.venv\Lib\site-packages\transformers\models\auto\image_processing_auto.py:520: FutureWarning: The image_processor_class argument is deprecated and will be removed in v4.42. Please use `slow_image_processor_class`, or `fast_image_processor_class` instead
  warnings.warn(
2025-01-21T19:27:18.549229 - vision_config is None, using default vision config
2025-01-21T19:27:26.837220 - Applied providers: ['CUDAExecutionProvider', 'CPUExecutionProvider'], with options: {'CUDAExecutionProvider': {'device_id': '0', 'has_user_compute_stream': '0', 'cudnn_conv1d_pad_to_nc1d': '0', 'user_compute_stream': '0', 'gpu_external_alloc': '0', 'gpu_mem_limit': '18446744073709551615', 'enable_cuda_graph': '0', 'gpu_external_free': '0', 'gpu_external_empty_cache': '0', 'arena_extend_strategy': 'kNextPowerOfTwo', 'cudnn_conv_algo_search': 'EXHAUSTIVE', 'do_copy_in_default_stream': '1', 'cudnn_conv_use_max_workspace': '1', 'tunable_op_enable': '0', 'tunable_op_tuning_enable': '0', 'tunable_op_max_tuning_duration_ms': '0', 'enable_skip_layer_norm_strict_mode': '0', 'prefer_nhwc': '0', 'use_ep_level_unified_stream': '0', 'use_tf32': '1', 'sdpa_kernel': '0', 'fuse_conv_bias': '0'}, 'CPUExecutionProvider': {}}2025-01-21T19:27:26.837220 - 
2025-01-21T19:27:26.912836 - find model:2025-01-21T19:27:26.912836 -  2025-01-21T19:27:26.912836 - C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\insightface\models\antelopev2\1k3d68.onnx2025-01-21T19:27:26.912836 -  2025-01-21T19:27:26.912836 - landmark_3d_682025-01-21T19:27:26.912836 -  2025-01-21T19:27:26.912836 - ['None', 3, 192, 192]2025-01-21T19:27:26.912836 -  2025-01-21T19:27:26.912836 - 0.02025-01-21T19:27:26.912836 -  2025-01-21T19:27:26.912836 - 1.02025-01-21T19:27:26.912836 - 
2025-01-21T19:27:26.942369 - Applied providers: ['CUDAExecutionProvider', 'CPUExecutionProvider'], with options: {'CUDAExecutionProvider': {'device_id': '0', 'has_user_compute_stream': '0', 'cudnn_conv1d_pad_to_nc1d': '0', 'user_compute_stream': '0', 'gpu_external_alloc': '0', 'gpu_mem_limit': '18446744073709551615', 'enable_cuda_graph': '0', 'gpu_external_free': '0', 'gpu_external_empty_cache': '0', 'arena_extend_strategy': 'kNextPowerOfTwo', 'cudnn_conv_algo_search': 'EXHAUSTIVE', 'do_copy_in_default_stream': '1', 'cudnn_conv_use_max_workspace': '1', 'tunable_op_enable': '0', 'tunable_op_tuning_enable': '0', 'tunable_op_max_tuning_duration_ms': '0', 'enable_skip_layer_norm_strict_mode': '0', 'prefer_nhwc': '0', 'use_ep_level_unified_stream': '0', 'use_tf32': '1', 'sdpa_kernel': '0', 'fuse_conv_bias': '0'}, 'CPUExecutionProvider': {}}2025-01-21T19:27:26.942369 - 
2025-01-21T19:27:26.948375 - find model:2025-01-21T19:27:26.948375 -  2025-01-21T19:27:26.948375 - C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\insightface\models\antelopev2\2d106det.onnx2025-01-21T19:27:26.948375 -  2025-01-21T19:27:26.948375 - landmark_2d_1062025-01-21T19:27:26.948375 -  2025-01-21T19:27:26.948375 - ['None', 3, 192, 192]2025-01-21T19:27:26.948375 -  2025-01-21T19:27:26.948375 - 0.02025-01-21T19:27:26.948375 -  2025-01-21T19:27:26.948375 - 1.02025-01-21T19:27:26.948375 - 
2025-01-21T19:27:26.971902 - Applied providers: ['CUDAExecutionProvider', 'CPUExecutionProvider'], with options: {'CUDAExecutionProvider': {'device_id': '0', 'has_user_compute_stream': '0', 'cudnn_conv1d_pad_to_nc1d': '0', 'user_compute_stream': '0', 'gpu_external_alloc': '0', 'gpu_mem_limit': '18446744073709551615', 'enable_cuda_graph': '0', 'gpu_external_free': '0', 'gpu_external_empty_cache': '0', 'arena_extend_strategy': 'kNextPowerOfTwo', 'cudnn_conv_algo_search': 'EXHAUSTIVE', 'do_copy_in_default_stream': '1', 'cudnn_conv_use_max_workspace': '1', 'tunable_op_enable': '0', 'tunable_op_tuning_enable': '0', 'tunable_op_max_tuning_duration_ms': '0', 'enable_skip_layer_norm_strict_mode': '0', 'prefer_nhwc': '0', 'use_ep_level_unified_stream': '0', 'use_tf32': '1', 'sdpa_kernel': '0', 'fuse_conv_bias': '0'}, 'CPUExecutionProvider': {}}2025-01-21T19:27:26.971902 - 
2025-01-21T19:27:26.974904 - find model:2025-01-21T19:27:26.974904 -  2025-01-21T19:27:26.974904 - C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\insightface\models\antelopev2\genderage.onnx2025-01-21T19:27:26.974904 -  2025-01-21T19:27:26.974904 - genderage2025-01-21T19:27:26.974904 -  2025-01-21T19:27:26.974904 - ['None', 3, 96, 96]2025-01-21T19:27:26.974904 -  2025-01-21T19:27:26.974904 - 0.02025-01-21T19:27:26.975905 -  2025-01-21T19:27:26.975905 - 1.02025-01-21T19:27:26.975905 - 
2025-01-21T19:27:27.184655 - Applied providers: ['CUDAExecutionProvider', 'CPUExecutionProvider'], with options: {'CUDAExecutionProvider': {'device_id': '0', 'has_user_compute_stream': '0', 'cudnn_conv1d_pad_to_nc1d': '0', 'user_compute_stream': '0', 'gpu_external_alloc': '0', 'gpu_mem_limit': '18446744073709551615', 'enable_cuda_graph': '0', 'gpu_external_free': '0', 'gpu_external_empty_cache': '0', 'arena_extend_strategy': 'kNextPowerOfTwo', 'cudnn_conv_algo_search': 'EXHAUSTIVE', 'do_copy_in_default_stream': '1', 'cudnn_conv_use_max_workspace': '1', 'tunable_op_enable': '0', 'tunable_op_tuning_enable': '0', 'tunable_op_max_tuning_duration_ms': '0', 'enable_skip_layer_norm_strict_mode': '0', 'prefer_nhwc': '0', 'use_ep_level_unified_stream': '0', 'use_tf32': '1', 'sdpa_kernel': '0', 'fuse_conv_bias': '0'}, 'CPUExecutionProvider': {}}2025-01-21T19:27:27.184655 - 
2025-01-21T19:27:27.318852 - find model:2025-01-21T19:27:27.318852 -  2025-01-21T19:27:27.318852 - C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\insightface\models\antelopev2\glintr100.onnx2025-01-21T19:27:27.318852 -  2025-01-21T19:27:27.318852 - recognition2025-01-21T19:27:27.318852 -  2025-01-21T19:27:27.318852 - ['None', 3, 112, 112]2025-01-21T19:27:27.318852 -  2025-01-21T19:27:27.318852 - 127.52025-01-21T19:27:27.318852 -  2025-01-21T19:27:27.318852 - 127.52025-01-21T19:27:27.318852 - 
2025-01-21T19:27:27.368081 - Applied providers: ['CUDAExecutionProvider', 'CPUExecutionProvider'], with options: {'CUDAExecutionProvider': {'device_id': '0', 'has_user_compute_stream': '0', 'cudnn_conv1d_pad_to_nc1d': '0', 'user_compute_stream': '0', 'gpu_external_alloc': '0', 'gpu_mem_limit': '18446744073709551615', 'enable_cuda_graph': '0', 'gpu_external_free': '0', 'gpu_external_empty_cache': '0', 'arena_extend_strategy': 'kNextPowerOfTwo', 'cudnn_conv_algo_search': 'EXHAUSTIVE', 'do_copy_in_default_stream': '1', 'cudnn_conv_use_max_workspace': '1', 'tunable_op_enable': '0', 'tunable_op_tuning_enable': '0', 'tunable_op_max_tuning_duration_ms': '0', 'enable_skip_layer_norm_strict_mode': '0', 'prefer_nhwc': '0', 'use_ep_level_unified_stream': '0', 'use_tf32': '1', 'sdpa_kernel': '0', 'fuse_conv_bias': '0'}, 'CPUExecutionProvider': {}}2025-01-21T19:27:27.368081 - 
2025-01-21T19:27:27.368081 - find model:2025-01-21T19:27:27.368081 -  2025-01-21T19:27:27.368081 - C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\insightface\models\antelopev2\scrfd_10g_bnkps.onnx2025-01-21T19:27:27.368081 -  2025-01-21T19:27:27.368081 - detection2025-01-21T19:27:27.368081 -  2025-01-21T19:27:27.368081 - [1, 3, '?', '?']2025-01-21T19:27:27.368081 -  2025-01-21T19:27:27.368081 - 127.52025-01-21T19:27:27.368081 -  2025-01-21T19:27:27.368081 - 128.02025-01-21T19:27:27.368081 - 
2025-01-21T19:27:27.368081 - set det-size:2025-01-21T19:27:27.368081 -  2025-01-21T19:27:27.368081 - (640, 640)2025-01-21T19:27:27.368081 - 
2025-01-21T19:27:27.369082 - Loaded EVA02-CLIP-L-14-336 model config.
2025-01-21T19:27:27.393104 - Shape of rope freq: torch.Size([576, 64])
2025-01-21T19:27:44.545410 - Loading pretrained EVA02-CLIP-L-14-336 weights (eva_clip).
2025-01-21T19:27:45.000671 - incompatible_keys.missing_keys: ['visual.rope.freqs_cos', 'visual.rope.freqs_sin', 'visual.blocks.0.attn.rope.freqs_cos', 'visual.blocks.0.attn.rope.freqs_sin', 'visual.blocks.1.attn.rope.freqs_cos', 'visual.blocks.1.attn.rope.freqs_sin', 'visual.blocks.2.attn.rope.freqs_cos', 'visual.blocks.2.attn.rope.freqs_sin', 'visual.blocks.3.attn.rope.freqs_cos', 'visual.blocks.3.attn.rope.freqs_sin', 'visual.blocks.4.attn.rope.freqs_cos', 'visual.blocks.4.attn.rope.freqs_sin', 'visual.blocks.5.attn.rope.freqs_cos', 'visual.blocks.5.attn.rope.freqs_sin', 'visual.blocks.6.attn.rope.freqs_cos', 'visual.blocks.6.attn.rope.freqs_sin', 'visual.blocks.7.attn.rope.freqs_cos', 'visual.blocks.7.attn.rope.freqs_sin', 'visual.blocks.8.attn.rope.freqs_cos', 'visual.blocks.8.attn.rope.freqs_sin', 'visual.blocks.9.attn.rope.freqs_cos', 'visual.blocks.9.attn.rope.freqs_sin', 'visual.blocks.10.attn.rope.freqs_cos', 'visual.blocks.10.attn.rope.freqs_sin', 'visual.blocks.11.attn.rope.freqs_cos', 'visual.blocks.11.attn.rope.freqs_sin', 'visual.blocks.12.attn.rope.freqs_cos', 'visual.blocks.12.attn.rope.freqs_sin', 'visual.blocks.13.attn.rope.freqs_cos', 'visual.blocks.13.attn.rope.freqs_sin', 'visual.blocks.14.attn.rope.freqs_cos', 'visual.blocks.14.attn.rope.freqs_sin', 'visual.blocks.15.attn.rope.freqs_cos', 'visual.blocks.15.attn.rope.freqs_sin', 'visual.blocks.16.attn.rope.freqs_cos', 'visual.blocks.16.attn.rope.freqs_sin', 'visual.blocks.17.attn.rope.freqs_cos', 'visual.blocks.17.attn.rope.freqs_sin', 'visual.blocks.18.attn.rope.freqs_cos', 'visual.blocks.18.attn.rope.freqs_sin', 'visual.blocks.19.attn.rope.freqs_cos', 'visual.blocks.19.attn.rope.freqs_sin', 'visual.blocks.20.attn.rope.freqs_cos', 'visual.blocks.20.attn.rope.freqs_sin', 'visual.blocks.21.attn.rope.freqs_cos', 'visual.blocks.21.attn.rope.freqs_sin', 'visual.blocks.22.attn.rope.freqs_cos', 'visual.blocks.22.attn.rope.freqs_sin', 'visual.blocks.23.attn.rope.freqs_cos', 'visual.blocks.23.attn.rope.freqs_sin']
2025-01-21T19:27:48.254548 - Loading PuLID-Flux model.
2025-01-21T19:27:48.732682 - model weight dtype torch.float8_e5m2, manual cast: torch.bfloat16
2025-01-21T19:27:48.732682 - model_type FLUX
2025-01-21T19:27:54.834747 - Requested to load PulidFluxModel
2025-01-21T19:27:54.998079 - loaded completely 9.5367431640625e+25 1085.09765625 True
2025-01-21T19:27:56.600321 - E:\ComfyUI V\.venv\Lib\site-packages\insightface\utils\transform.py:68: FutureWarning: `rcond` parameter will change to the default of machine precision times ``max(M, N)`` where M and N are the input matrix dimensions.
To use the future default and silence this warning we advise to pass `rcond=None`, to keep using the old, explicitly pass `rcond=-1`.
  P = np.linalg.lstsq(X_homo, Y)[0].T # Affine matrix. 3 x 4
2025-01-21T19:28:01.761404 - CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
2025-01-21T19:28:05.610243 - clip missing: ['text_projection.weight']
2025-01-21T19:28:06.214502 - C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\clip\siglip-so400m-patch14-3842025-01-21T19:28:06.215512 - 
2025-01-21T19:28:08.022367 - Loading VLM's custom vision model2025-01-21T19:28:08.022367 - 
2025-01-21T19:28:08.884250 - Requested to load SiglipVisionTransformer
2025-01-21T19:28:09.006444 - loaded completely 9.5367431640625e+25 809.1729736328125 True
2025-01-21T19:28:09.157193 - Requested to load ImageAdapter
2025-01-21T19:28:09.164200 - loaded completely 9.5367431640625e+25 41.0390625 True
2025-01-21T19:28:09.165200 - Loading tokenizer2025-01-21T19:28:09.165200 - 
2025-01-21T19:28:09.651442 - Loading LLM: unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit2025-01-21T19:28:09.651442 - 
2025-01-21T19:28:09.651442 - C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\LLM\Meta-Llama-3.1-8B-Instruct-bnb-4bit2025-01-21T19:28:09.651442 - 
2025-01-21T19:28:09.652443 - Successfully modified 'base_model_name_or_path' value in 'C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\Joy_caption_two\text_model\adapter_config.json'.2025-01-21T19:28:09.652443 - 
2025-01-21T19:28:09.670460 - Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.
2025-01-21T19:28:22.459865 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json2025-01-21T19:28:22.459865 - 
2025-01-21T19:28:27.430093 - HTTP Request: POST http://127.0.0.1:11434/api/generate "HTTP/1.1 200 OK"
2025-01-21T19:28:27.430613 - [Deep Translator] Service: "GoogleTranslator"2025-01-21T19:28:27.431611 - 
2025-01-21T19:28:27.431611 - [Deep Translator] Proxy disabled or input field is empty!2025-01-21T19:28:27.431611 - 
2025-01-21T19:28:27.431611 - [Deep Translator] Authorization input field is empty!2025-01-21T19:28:27.431611 - 
2025-01-21T19:28:27.431611 - Deep Translator] Service detect language disabled! Services support: DeeplTranslator, QcriTranslator, LingueeTranslator, PonsTranslator, PapagoTranslator, BaiduTranslator, MyMemoryTranslator.
The selected service has its own way of detecting the language.
Property "detect_lang_api_key" in Authorization data is empty or incorrect!2025-01-21T19:28:27.431611 - 
2025-01-21T19:28:35.210620 - [Deep Translator] Service: "GoogleTranslator"2025-01-21T19:28:35.210620 - 
2025-01-21T19:28:35.210620 - [Deep Translator] Proxy disabled or input field is empty!2025-01-21T19:28:35.210620 - 
2025-01-21T19:28:35.210620 - [Deep Translator] Authorization input field is empty!2025-01-21T19:28:35.210620 - 
2025-01-21T19:28:35.210620 - Deep Translator] Service detect language disabled! Services support: DeeplTranslator, QcriTranslator, LingueeTranslator, PonsTranslator, PapagoTranslator, BaiduTranslator, MyMemoryTranslator.
The selected service has its own way of detecting the language.
Property "detect_lang_api_key" in Authorization data is empty or incorrect!2025-01-21T19:28:35.210620 - 
2025-01-21T19:28:38.892310 - Token indices sequence length is longer than the specified maximum sequence length for this model (167 > 77). Running this sequence through the model will result in indexing errors
2025-01-21T19:28:38.894312 - Requested to load FluxClipModel_
2025-01-21T19:28:40.516625 - loaded completely 9.5367431640625e+25 9319.23095703125 True
2025-01-21T19:28:40.723966 - Requested to load CLIPVisionModelProjection
2025-01-21T19:28:41.051860 - loaded completely 9.5367431640625e+25 787.7150573730469 True
2025-01-21T19:28:41.290616 - Requested to load PulidFluxModel
2025-01-21T19:28:41.291617 - Requested to load Flux
2025-01-21T19:28:41.449276 - loaded completely 9.5367431640625e+25 1085.09765625 True
2025-01-21T19:28:44.944883 - loaded completely 9.5367431640625e+25 11350.067443847656 True
2025-01-21T19:29:02.578633 - 
100%|██████████| 30/30 [00:17<00:00,  1.70it/s]2025-01-21T19:29:02.579634 - 
100%|██████████| 30/30 [00:17<00:00,  1.70it/s]2025-01-21T19:29:02.579634 - 
2025-01-21T19:29:02.588632 - Requested to load AutoencodingEngine
2025-01-21T19:29:02.626674 - loaded completely 9.5367431640625e+25 159.87335777282715 True
2025-01-21T19:29:03.562922 - Prepare source...2025-01-21T19:29:03.562922 - 
2025-01-21T19:29:03.562922 - Load pipeline...2025-01-21T19:29:03.562922 - 
2025-01-21T19:29:03.567926 - Uses CUDA device.2025-01-21T19:29:03.567926 - 
2025-01-21T19:29:04.798105 - 
2025-01-21T19:29:05.129538 - 0: 640x448 1 face, 139.7ms
2025-01-21T19:29:05.129538 - Speed: 8.5ms preprocess, 139.7ms inference, 4.0ms postprocess per image at shape (1, 3, 640, 448)
2025-01-21T19:29:05.129538 - w, h:(808, 1216)2025-01-21T19:29:05.129538 - 
2025-01-21T19:29:05.129538 - diff, min_diff, best_box:(77.62812805175781, 808, [246.10593, 176.67722, 406.63782, 378.62598])2025-01-21T19:29:05.129538 - 
2025-01-21T19:29:05.756859 - 
2025-01-21T19:29:05.932044 - 0: 640x480 1 face, 168.2ms
2025-01-21T19:29:05.932044 - Speed: 4.0ms preprocess, 168.2ms inference, 2.0ms postprocess per image at shape (1, 3, 640, 480)
2025-01-21T19:29:05.932044 - w, h:(1440, 1920)2025-01-21T19:29:05.932044 - 
2025-01-21T19:29:05.932044 - diff, min_diff, best_box:(100.49945068359375, 1440, [489.50757, 442.57443, 749.4935, 823.3453])2025-01-21T19:29:05.932044 - 
2025-01-21T19:29:18.547485 - 
2025-01-21T19:29:23.665575 - 0: 640x448 1 face, 2941.3ms
2025-01-21T19:29:23.666588 - Speed: 2.0ms preprocess, 2941.3ms inference, 1.0ms postprocess per image at shape (1, 3, 640, 448)
2025-01-21T19:29:29.540663 - 
2025-01-21T19:29:29.673305 - 0: 640x640 1 person, 10.0ms
2025-01-21T19:29:29.673305 - Speed: 4.0ms preprocess, 10.0ms inference, 2.0ms postprocess per image at shape (1, 3, 640, 640)
2025-01-21T19:29:31.857373 - Requested to load AutoencodingEngine
2025-01-21T19:29:31.894458 - loaded completely 9.5367431640625e+25 159.87335777282715 True
2025-01-21T19:29:32.728664 - model weight dtype torch.bfloat16, manual cast: None
2025-01-21T19:29:32.729665 - model_type FLUX
2025-01-21T19:29:45.514550 - CLIP/text encoder model load device: cuda:0, offload device: cpu, current: cpu, dtype: torch.float16
2025-01-21T19:29:45.629246 - clip missing: ['text_projection.weight']
2025-01-21T19:29:49.900745 - Requested to load FluxClipModel_
2025-01-21T19:29:51.152947 - loaded completely 9.5367431640625e+25 9319.23095703125 True
2025-01-21T19:29:51.685791 - Requested to load Flux
2025-01-21T19:29:51.685791 - Requested to load ControlNetFlux
2025-01-21T19:29:56.269683 - loaded completely 9.5367431640625e+25 22700.134887695312 True
2025-01-21T19:29:56.889849 - loaded completely 9.5367431640625e+25 3417.2158203125 True
2025-01-21T19:30:24.378562 - 
100%|██████████| 30/30 [00:27<00:00,  1.08it/s]2025-01-21T19:30:24.378562 - 
100%|██████████| 30/30 [00:27<00:00,  1.09it/s]2025-01-21T19:30:24.378562 - 
2025-01-21T19:30:27.666127 - Prompt executed in 200.78 seconds
2025-01-21T19:30:57.963694 - got prompt
2025-01-21T19:30:57.984241 - Failed to validate prompt for output 317:
2025-01-21T19:30:57.984241 - * (prompt):
2025-01-21T19:30:57.984241 -   - Required input is missing: images
2025-01-21T19:30:57.984241 - * PreviewImage 317:
2025-01-21T19:30:57.984241 -   - Required input is missing: images
2025-01-21T19:30:57.984241 - Output will be ignored
2025-01-21T19:30:57.984241 - Failed to validate prompt for output 331:
2025-01-21T19:30:57.985386 - * (prompt):
2025-01-21T19:30:57.985386 -   - Required input is missing: images
2025-01-21T19:30:57.985386 - * PreviewImage 331:
2025-01-21T19:30:57.985386 -   - Required input is missing: images
2025-01-21T19:30:57.985386 - Output will be ignored
2025-01-21T19:30:57.985386 - Failed to validate prompt for output 203:
2025-01-21T19:30:57.985386 - * (prompt):
2025-01-21T19:30:57.985386 -   - Required input is missing: images
2025-01-21T19:30:57.985386 - * PreviewImage 203:
2025-01-21T19:30:57.985898 -   - Required input is missing: images
2025-01-21T19:30:57.985898 - Output will be ignored
2025-01-21T19:30:57.985898 - Failed to validate prompt for output 222:
2025-01-21T19:30:57.985898 - * (prompt):
2025-01-21T19:30:57.985898 -   - Required input is missing: images
2025-01-21T19:30:57.985898 - * PreviewImage 222:
2025-01-21T19:30:57.985898 -   - Required input is missing: images
2025-01-21T19:30:57.985898 - Output will be ignored
2025-01-21T19:30:57.985898 - Failed to validate prompt for output 141:
2025-01-21T19:30:57.986390 - * (prompt):
2025-01-21T19:30:57.986390 -   - Required input is missing: images
2025-01-21T19:30:57.986390 - * PreviewImage 141:
2025-01-21T19:30:57.986390 -   - Required input is missing: images
2025-01-21T19:30:57.986390 - Output will be ignored
2025-01-21T19:31:11.584375 - vision_config is None, using default vision config
2025-01-21T19:31:11.593398 - Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.
2025-01-21T19:31:16.807302 - 
Loading checkpoint shards: 100%|██████████| 2/2 [00:03<00:00,  1.61s/it]2025-01-21T19:31:16.807302 - 
Loading checkpoint shards: 100%|██████████| 2/2 [00:03<00:00,  1.72s/it]2025-01-21T19:31:16.807302 - 
2025-01-21T19:31:17.917108 - vision_config is None, using default vision config
2025-01-21T19:31:22.235450 - Requested to load SiglipVisionTransformer
2025-01-21T19:31:22.360702 - loaded completely 9.5367431640625e+25 809.1729736328125 True
2025-01-21T19:31:22.398784 - Requested to load ImageAdapter
2025-01-21T19:31:22.408346 - loaded completely 9.5367431640625e+25 41.0390625 True
2025-01-21T19:31:22.410348 - Loading LLM: unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit2025-01-21T19:31:22.410348 - 
2025-01-21T19:31:22.410348 - C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\LLM\Meta-Llama-3.1-8B-Instruct-bnb-4bit2025-01-21T19:31:22.410348 - 
2025-01-21T19:31:22.411348 - Successfully modified 'base_model_name_or_path' value in 'C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\models\Joy_caption_two\text_model\adapter_config.json'.2025-01-21T19:31:22.411348 - 
2025-01-21T19:31:22.415352 - Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.
2025-01-21T19:31:42.253649 - HTTP Request: POST http://127.0.0.1:11434/api/generate "HTTP/1.1 200 OK"
2025-01-21T19:31:42.254171 - [Deep Translator] Service: "GoogleTranslator"2025-01-21T19:31:42.255358 - 
2025-01-21T19:31:42.255358 - [Deep Translator] Proxy disabled or input field is empty!2025-01-21T19:31:42.255358 - 
2025-01-21T19:31:42.255358 - [Deep Translator] Authorization input field is empty!2025-01-21T19:31:42.255358 - 
2025-01-21T19:31:42.255358 - Deep Translator] Service detect language disabled! Services support: DeeplTranslator, QcriTranslator, LingueeTranslator, PonsTranslator, PapagoTranslator, BaiduTranslator, MyMemoryTranslator.
The selected service has its own way of detecting the language.
Property "detect_lang_api_key" in Authorization data is empty or incorrect!2025-01-21T19:31:42.255358 - 
2025-01-21T19:31:45.009882 - [Deep Translator] Service: "GoogleTranslator"2025-01-21T19:31:45.009882 - 
2025-01-21T19:31:45.009882 - [Deep Translator] Proxy disabled or input field is empty!2025-01-21T19:31:45.009882 - 
2025-01-21T19:31:45.009882 - [Deep Translator] Authorization input field is empty!2025-01-21T19:31:45.009882 - 
2025-01-21T19:31:45.009882 - Deep Translator] Service detect language disabled! Services support: DeeplTranslator, QcriTranslator, LingueeTranslator, PonsTranslator, PapagoTranslator, BaiduTranslator, MyMemoryTranslator.
The selected service has its own way of detecting the language.
Property "detect_lang_api_key" in Authorization data is empty or incorrect!2025-01-21T19:31:45.009882 - 
2025-01-21T19:31:48.314635 - Requested to load FluxClipModel_
2025-01-21T19:31:49.864972 - loaded completely 9.5367431640625e+25 9319.23095703125 True
2025-01-21T19:31:50.053331 - Requested to load CLIPVisionModelProjection
2025-01-21T19:31:50.422365 - loaded completely 9.5367431640625e+25 787.7150573730469 True
2025-01-21T19:31:50.681195 - Requested to load Flux
2025-01-21T19:31:50.681195 - Requested to load PulidFluxModel
2025-01-21T19:31:53.891394 - loaded completely 9.5367431640625e+25 11350.067443847656 True
2025-01-21T19:31:54.034657 - loaded completely 9.5367431640625e+25 1085.09765625 True
2025-01-21T19:31:54.038657 - 
  0%|          | 0/30 [00:00<?, ?it/s]2025-01-21T19:31:54.052198 - 
  0%|          | 0/30 [00:00<?, ?it/s]2025-01-21T19:31:54.052198 - 
2025-01-21T19:31:54.055202 - !!! Exception during processing !!! Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm)
2025-01-21T19:31:54.060737 - Traceback (most recent call last):
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 327, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 202, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 174, in _map_node_over_list
    process_inputs(input_dict, i)
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 163, in process_inputs
    results.append(getattr(obj, func)(**inputs))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy_extras\nodes_custom_sampler.py", line 651, in sample
    samples = guider.sample(noise.generate_noise(latent), latent_image, sampler, sigmas, denoise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=noise.seed)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 985, in sample
    output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 111, in execute
    return self.wrappers[self.idx](self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\pulidflux.py", line 392, in pulid_outer_sample_wrappers_with_override
    out = wrapper_executor(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 103, in __call__
    return new_executor.execute(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 110, in execute
    return self.original(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 953, in outer_sample
    output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 936, in inner_sample
    samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 110, in execute
    return self.original(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 715, in sample
    samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\custom_nodes/ComfyUI-Detail-Daemon\detail_daemon_node.py", line 297, in detail_daemon_sampler
    return dds_wrapped_sampler.sampler_function(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\k_diffusion\sampling.py", line 161, in sample_euler
    denoised = model(x, sigma_hat * s_in, **extra_args)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\custom_nodes/ComfyUI-Detail-Daemon\detail_daemon_node.py", line 289, in model_wrapper
    return model(x, adjusted_sigma, **extra_args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 380, in __call__
    out = self.inner_model(x, sigma, model_options=model_options, seed=seed)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 916, in __call__
    return self.predict_noise(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 919, in predict_noise
    return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 360, in sampling_function
    out = calc_cond_batch(model, conds, x, timestep, model_options)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 196, in calc_cond_batch
    return executor.execute(model, conds, x_in, timestep, model_options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 110, in execute
    return self.original(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\samplers.py", line 309, in _calc_cond_batch
    output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\model_base.py", line 131, in apply_model
    return comfy.patcher_extension.WrapperExecutor.new_class_executor(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 111, in execute
    return self.wrappers[self.idx](self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\pulidflux.py", line 417, in pulid_apply_model_wrappers
    out = wrapper_executor(x, t, c_concat, c_crossattn, control, transformer_options, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 103, in __call__
    return new_executor.execute(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\patcher_extension.py", line 110, in execute
    return self.original(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\model_base.py", line 160, in _apply_model
    model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float()
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Administrator\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\ldm\flux\model.py", line 204, in forward
    out = self.forward_orig(img, img_ids, context, txt_ids, timestep, y, guidance, control, transformer_options, attn_mask=kwargs.get("attention_mask", None))
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\PulidFluxHook.py", line 189, in pulid_forward_orig
    out = blocks_replace[("double_block", i)]({"img": img,
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\PulidFluxHook.py", line 74, in __call__
    img = img + callback(temp_img,
                ^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\PulidFluxHook.py", line 33, in pulid_patch
    pulid_img = weight * pulid_model.model.pulid_ca[ca_idx](embedding, img)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\custom_nodes/ComfyUI_PuLID_Flux_ll\encoders_flux.py", line 52, in forward
    x = self.norm1(x)
        ^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\modules\normalization.py", line 217, in forward
    return F.layer_norm(
           ^^^^^^^^^^^^^
  File "E:\ComfyUI V\.venv\Lib\site-packages\torch\nn\functional.py", line 2900, in layer_norm
    return torch.layer_norm(
           ^^^^^^^^^^^^^^^^^
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm)

2025-01-21T19:31:54.064728 - Prompt executed in 56.06 seconds

Attached Workflow

Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

Workflow too large. Please manually upload the workflow from local file system.

Additional Context

(Please add any additional context or steps to reproduce the error here)

@RINGOLINK
Copy link
Author

这似乎是个比较古老的bug,我尝试按照修复ComfyUI-PuLID-Flux-Enhanced中pulidflux.py文件的方式去修复插件,但是由于两版插件代码改动较大,且我并不具备专业的编程能力,所以尝试失败了,这个bug出现的情况与之前是类似的,首次运行是没有问题的,但是在后面使用了清除VRAM等功能插件之后,第二次运行会出现这个错误,另外在我这里也同样出现了 #6 这个错误。希望作者可以关注并修复。这将对我的生产带来极大的帮助。

@RINGOLINK
Copy link
Author

这似乎是个比较古老的bug,我尝试按照修复ComfyUI-PuLID-Flux-Enhanced中 pulidflux.py 文件的方式去修复插件,但是由于两版插件代码改动较大,且我并不具备专业的编程能力,所以尝试失败了,这个bug出现的情况与之前是类似的,首次运行是没有问题的,但是在后面使用了清除VRAM等功能插件之后,第二次运行会出现这个错误,另外在我这里也同样出现了 #6 这个错误。希望作者可以关注并修复。这将对我的生产带来极大的帮助。

刚刚看到 #6 通过更新被解决了,然后尝试了一下更新,发现该问题同时被得到解决,感谢作者。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant