Skip to content

Commit

Permalink
[Bugfix][Hardware][Intel CPU] Fix unpassed multi_modal_kwargs for CPU…
Browse files Browse the repository at this point in the history
… runner (vllm-project#5956)
  • Loading branch information
Isotr0py authored and prashantgupta24 committed Jun 28, 2024
1 parent 9bafffb commit bba1cc6
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions vllm/worker/cpu_model_runner.py
Original file line number Diff line number Diff line change
Expand Up @@ -358,6 +358,7 @@ def prepare_model_input(
input_positions=input_positions,
attn_metadata=attn_metadata,
sampling_metadata=sampling_metadata,
multi_modal_kwargs=multi_modal_kwargs,
)

@torch.inference_mode()
Expand Down

0 comments on commit bba1cc6

Please sign in to comment.