Skip to content

Commit

Permalink
fix mamba
Browse files Browse the repository at this point in the history
Signed-off-by: Roger Wang <[email protected]>
  • Loading branch information
ywang96 committed Nov 16, 2024
1 parent bb24c3a commit e92d165
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/model_executor/models/mamba.py
Original file line number Diff line number Diff line change
Expand Up @@ -176,7 +176,7 @@ def __init__(self, *, vllm_config: VllmConfig, prefix: str = ""):
self.sampler = get_sampler()

def get_input_embeddings(self, input_ids: torch.Tensor) -> torch.Tensor:
return self.model.get_input_embeddings(input_ids)
return self.backbone.get_input_embeddings(input_ids)

def forward(self,
input_ids: torch.Tensor,
Expand Down

0 comments on commit e92d165

Please sign in to comment.