Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[bugfix] fix RuntimeError on apc (#648)
This PR fixes a bug that results in the following RuntimeError when APC is enabled. ``` ERROR 12-19 02:30:05 engine.py:140] File "/workspace/vllm/worker/hpu_model_runner.py", line 854, in _prepare_prompt ERROR 12-19 02:30:05 engine.py:140] if prefix_block_list_tensor: ERROR 12-19 02:30:05 engine.py:140] RuntimeError: Boolean value of Tensor with more than one value is ambiguous ```
- Loading branch information