-
Notifications
You must be signed in to change notification settings - Fork 3.9k
feat: use google/genai sdk for streaming gemini & vertex responses #8907
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
Keep this PR in a mergeable state → Learn moreAll Green is an AI agent that automatically: ✅ Addresses code review comments ✅ Fixes failing CI checks ✅ Resolves merge conflicts |
|
✅ Jira ticket created with business summary 🎫 View ticket: https://continue-playground.atlassian.net/browse/CRM-14 This ticket captures the business impact and user benefits of fixing the Gemini/Vertex streaming character loss issue. |
|
Fixed an incorrect documentation change in The PR had incorrectly marked Bedrock and VertexAI adapters as unsupported (unchecked), but these adapters remain fully functional after the SDK migration. Restored the checkmarks to indicate continued support. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
No issues found across 6 files
|
@uinstinct sorry for delay on this one, could you rebase with main? |
|
🤖 All Green agent started: View agent |
Description
Use @google/genai sdk instead of fetching responses from the url. This correctly parses the response chunks without checking for json delimiterss
resolves CON-4266
closes #2651
AI Code Review
@continue-reviewChecklist
Screen recording or screenshot
before.mp4
after.mp4
Tests
[ What tests were added or updated to ensure the changes work as expected? ]
Summary by cubic
Switch Gemini and Vertex streaming to the @google/genai SDK for reliable chunk parsing and consistent streaming. Addresses Linear CON-4266 and fixes issues with JSON delimiter-based parsing.
Refactors
Dependencies
Written for commit fd793c4. Summary will update automatically on new commits.