Skip to content

Upstream Sync #80

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 21 commits into from
May 6, 2025
Merged

Upstream Sync #80

merged 21 commits into from
May 6, 2025

Conversation

robertgshaw2-redhat
Copy link
Collaborator

@robertgshaw2-redhat robertgshaw2-redhat commented May 6, 2025 •
edited by github-actions bot
Loading

  • Merge with main
  • Hybrid memory allocator 😨

s3woz and others added 21 commits May 6, 2025 12:00
@s3woz @bohnstingl
@DarkLight1337 @tlrmchlsmth
[Model] Add GraniteMoeHybrid 4.0 model (vllm-project#17497)
999328b 
Signed-off-by: Thomas Ortner <[email protected]>
Signed-off-by: Stanislaw Wozniak <[email protected]>
Co-authored-by: Thomas Ortner <[email protected]>
Co-authored-by: Cyrus Leung <[email protected]>
Co-authored-by: Tyler Michael Smith <[email protected]>
@zou3519
[easy] Fix logspam on PiecewiseBackend errors (vllm-project#17138)
edbf2d6 
Signed-off-by: rzou <[email protected]>
@Xarbirus
[Bugfix] Fixed prompt length for random dataset (vllm-project#17408)
dc47ba3 
Signed-off-by: Mikhail Podvitskii <[email protected]>
@DarkLight1337
[Doc] Update notes for H2O-VL and Gemma3 (vllm-project#17219)
63ced7b 
Signed-off-by: DarkLight1337 <[email protected]>
@LucasWilkinson
[Misc] Fix ScalarType float4 naming (vllm-project#17690)
6eae345 
Signed-off-by: Lucas Wilkinson <[email protected]>
@hmellor
Fix dockerfilegraph pre-commit hook (vllm-project#17698)
05e1f96 
Signed-off-by: Harry Mellor <[email protected]>
@MengqingCao
[Bugfix] Fix triton import with local TritonPlaceholder (vllm-project…
f9bc5a0 
…#17446)

Signed-off-by: Mengqing Cao <[email protected]>
@mgoin
[V1] Enable TPU V1 backend by default (vllm-project#17673)
d419aa5 
Signed-off-by: mgoin <[email protected]>
@bigPYJ1151
[V1][PP] Support PP for MultiprocExecutor (vllm-project#14219)
a6fed02 
Signed-off-by: jiang1.li <[email protected]>
Signed-off-by: jiang.li <[email protected]>
@heheda12345
[v1] AttentionMetadata for each layer (vllm-project#17394)
cba31c4 
Signed-off-by: Chen Zhang <[email protected]>
@aarnphm
[Feat] Add deprecated=True to CLI args (vllm-project#17426)
175bda6 
Signed-off-by: Aaron Pham <[email protected]>
@windsonsea
[Docs] Use gh-file to add links to tool_calling.md (vllm-project#17709)
0d11546 
Signed-off-by: windsonsea <[email protected]>
@heheda12345
[v1] Introduce KVCacheBlocks as interface between Scheduler and KVCac…
aabcd2c 
…heManager (vllm-project#17479)

Signed-off-by: Chen Zhang <[email protected]>
@reidliu41
[doc] Add RAG Integration example (vllm-project#17692)
7525d5f 
Signed-off-by: reidliu41 <[email protected]>
Co-authored-by: reidliu41 <[email protected]>
@DarkLight1337
[Bugfix] Fix modality limits in vision language example (vllm-project…
5b8c390 
…#17721)

Signed-off-by: DarkLight1337 <[email protected]>
@hmellor
Make right sidebar more readable in "Supported Models" (vllm-project#…
6115b11 
…17723)

Signed-off-by: Harry Mellor <[email protected]>
@bythew3i
[TPU] Increase block size and reset block shapes (vllm-project#16458)
621ca2c
@dtransposed
[Misc] Add Next Edit Prediction (NEP) datasets support in `benchmark_…
d456aea 
…serving.py` (vllm-project#16839)

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Signed-off-by: dtransposed <>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
@gshtras
[Bugfix] Fix for the condition to accept empty encoder inputs for mll…
de906b9 
…ama (vllm-project#17732)

Signed-off-by: Gregory Shtrasberg <[email protected]>
@tdoublep @LucasWilkinson
[Kernel] Unified Triton kernel that doesn't distinguish between prefi…
2f925e5 
…ll + decode (vllm-project#16828)

Signed-off-by: Thomas Parnell <[email protected]>
Signed-off-by: Lucas Wilkinson <[email protected]>
Co-authored-by: Lucas Wilkinson <[email protected]>
@robertgshaw2-redhat
updated
42b869e 
Signed-off-by: [email protected] <[email protected]>
@github-actions GitHub Actions
Copy link

github-actions bot commented May 6, 2025

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors. You can run other CI tests on top of those by going to your fastcheck build on Buildkite UI (linked in the PR checks section) and unblock them. If you do not have permission to unblock, ping simon-mo or khluu to add you in our Buildkite org.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can either: Add ready label to the PR or enable auto-merge.

🚀

@robertgshaw2-redhat robertgshaw2-redhat marked this pull request as ready for review May 6, 2025 22:59
@robertgshaw2-redhat robertgshaw2-redhat merged commit 76186b9 into neuralmagic:disagg_pd_dev May 6, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tlrmchlsmth tlrmchlsmth tlrmchlsmth approved these changes

@youkaichao youkaichao Awaiting requested review from youkaichao youkaichao is a code owner

@njhill njhill Awaiting requested review from njhill njhill is a code owner

@alexm-redhat alexm-redhat Awaiting requested review from alexm-redhat alexm-redhat is a code owner

@mgoin mgoin Awaiting requested review from mgoin mgoin is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.