Skip to content

Conversation

kfswain
Copy link
Collaborator

@kfswain kfswain commented Sep 4, 2025

Fixes: #1529

Adding a waitGroup should not impact prod code as we do not wait on this WG anywhere in the system, just allows unit tests to be synchronous

@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Sep 4, 2025
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: kfswain

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Sep 4, 2025
Copy link

netlify bot commented Sep 4, 2025

Deploy Preview for gateway-api-inference-extension ready!

Name Link
🔨 Latest commit caf5a8b
🔍 Latest deploy log https://app.netlify.com/projects/gateway-api-inference-extension/deploys/68b9bc52f4a4df0008603dbd
😎 Deploy Preview https://deploy-preview-1534--gateway-api-inference-extension.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@k8s-ci-robot k8s-ci-robot added the size/S Denotes a PR that changes 10-29 lines, ignoring generated files. label Sep 4, 2025
Comment on lines +225 to +228
p.wg.Add(1)
go func() {
p.indexer.Add(state.PrefixHashes, ServerID(targetPod.NamespacedName))
p.wg.Done()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mmmmmm.
this fix introduces a wg only for test purpose. the thing is we don't have access to this wg outside of prefix plugin package, so llm-d tests will fail (we test PD, where prefix is used and profile handler uses it, reads state from CycleState, but with this go routine the update is not ready on time.
it solves the issue only in prefix unit tests

@nirrozenbaum
Copy link
Contributor

as temp fix to unblock flaky tests this is good enough as we don't want to fail incoming PRs.
will keep thinking about ways to solve this elegantly.

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Sep 4, 2025
@nirrozenbaum
Copy link
Contributor

/hold

@kfswain you know what - maybe we can make the WG public? as long as we have this solution in place, I'll need to add wg.wait also in llm-d unit tests

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Sep 4, 2025
@nirrozenbaum
Copy link
Contributor

/hold

@kfswain you know what - maybe we can make the WG public? as long as we have this solution in place, I'll need to add wg.wait also in llm-d unit tests

discussed with kellen, this will be handled in a follow up.

/unhold

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Sep 4, 2025
@k8s-ci-robot k8s-ci-robot merged commit a3a3c24 into kubernetes-sigs:main Sep 4, 2025
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

flaky test in prefix plugin
3 participants