Skip to content

Pull requests: HabanaAI/vllm-fork

New pull request New
36 Open 583 Closed
36 Open 583 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Bump jinja2 from 3.1.4 to 3.1.5 dependencies Pull requests that update a dependency file
#679 opened Jan 12, 2025 by dependabot bot Loading…
Jan 10 rebase
#677 opened Jan 10, 2025 by kzawora-intel Loading…
1
add renormalize param for FusedMOE
#671 opened Jan 9, 2025 by tangleintel Loading…
Added lora manager tests
#670 opened Jan 8, 2025 by rsshaik1 • Draft
Fix for random sampler recompilations for incomplete batches
#663 opened Dec 30, 2024 by mfylcek Loading…
3
Draft: Delayed prompts
#659 opened Dec 20, 2024 by kamil-kaczor • Draft
Chunked Prefill
#656 opened Dec 20, 2024 by hlahkar • Draft
Fix: selecting correct backend for MultiHeadAttention habana Issues or PRs submitted by Habana Labs
#645 opened Dec 18, 2024 by adobrzyniewicz-habana Loading…
2
Fix model OOM issue in llama-405 and mixtral - 2nd attempt habana Issues or PRs submitted by Habana Labs
#644 opened Dec 18, 2024 by afierka-intel Loading…
@afierka-intel
Selective merged prefill
#643 opened Dec 18, 2024 by xuechendi Loading…
4
Add exponential bucketing integration
#642 opened Dec 17, 2024 by kzawora-intel • Draft
Multimodality fix for llava habana Issues or PRs submitted by Habana Labs
#641 opened Dec 17, 2024 by adobrzyniewicz-habana Loading…
Add inc fp8 qunatization documentation
#635 opened Dec 16, 2024 by nirda7 Loading…
52
Device Type HPU support for torch.generator() API
#628 opened Dec 13, 2024 by nageshdn Loading…
1
1
[WIP] Add HPU support to vLLM v1 - cont.
#609 opened Dec 10, 2024 by kzawora-intel Loading…
21 of 23 tasks
Add in Dockerfile.hpu.ubi
#602 opened Dec 9, 2024 by Xaenalt Loading…
13
Add real BS & seq_len to profiling
#601 opened Dec 9, 2024 by kamil-kaczor Loading…
[DONNOT MERGE] [POC] Ray Compiled graphs
#593 opened Dec 5, 2024 by michalkuligowski • Draft
Multi models support for upstream
#590 opened Dec 4, 2024 by xuechendi Loading…
1
Remove assert for alibi in case of FusedSDPA.
#587 opened Dec 4, 2024 by itaraban Loading…
1
Update documentation
#555 opened Nov 26, 2024 by michalkuligowski • Draft
5
Bump aiohttp from 3.10.10 to 3.10.11 dependencies Pull requests that update a dependency file
#536 opened Nov 21, 2024 by dependabot bot Loading…
3
Clean-up LoRA flow
#518 opened Nov 18, 2024 by SanjuCSudhakaran • Draft
1.19 documentation update
#507 opened Nov 15, 2024 by kzawora-intel • Draft
Resolved ALIBI bias regression due to porting flat PA
#503 opened Nov 15, 2024 by tannervoas742 Loading…
14
ProTip! Follow long discussions with comments:>50.