[Bug]: Gemini CLI with LLM Proxy is not working anymore #15587
Description
What happened?
https://docs.litellm.ai/docs/tutorials/litellm_gemini_cli
i follow that guide , isntead of using claude i tested it with groq model
on the admin ui its working
here is the
config.yaml
model_list:
- model_name: groq
litellm_params:
model: groq/qwen/qwen3-32b
api_key: "os.environ/GROQ_API_KEY"
router_settings:
model_group_alias: {"gemini-2.5-pro": "groq"}
also if i test it with curl
output
{"id":"chatcmpl-7079ad90-401c-490e-984f-bd2ee8fe07e9","created":1760580006,"model":"qwen/qwen3-32b","object":"chat.completion","system_fingerprint":"fp_5cf921caa2","choices":[{"finish_reason":"stop","index":0,"message":{"content":"<think>\nOkay, the user is asking, \"What is the meaning of life?\" That's a big question. First, I need to consider that there's no one-size-fits-all answer here. Different people and cultures have various perspectives, so I should cover the main ones without getting too bogged down in any one.\n\nI should start by mentioning that the meaning of life is a philosophical question with no definitive answer. Then, break it down into different approaches. For example, religious viewpoints like Christianity or Buddhism might offer specific meanings, such as serving a higher power or achieving enlightenment. On the other hand, existentialism, as discussed by philosophers like Sartre or Camus, suggests that meaning is created by the individual.\n\nScientific perspectives could include the idea that life is the result of natural processes and that the meaning isn't inherent but discovered through our pursuit of knowledge and understanding. Then there's the idea that life has meaning through personal experiences, relationships, and contributing to others' well-being.\n\nI should also note that for some people, the search for meaning itself might be the point, like in Nietzsche's philosophy where the will to meaning is essential. It's important to highlight that it's okay if someone doesn't have a concrete answer and that the journey of seeking meaning can be as valuable as the answer.\n\nI need to present this in a clear, organized way, using bullet points or sections for each perspective. Make sure the language is accessible, not too academic. Also, acknowledge that everyone's answer might be different and there's no right or wrong. Maybe end with an encouraging note about each person's unique path.\n\nWait, I should check if there are any common pitfalls here. For example, not presenting one approach as better than others. Also, avoid making it too dry. Perhaps include examples of how people find meaning in their lives, like raising a family, creating art, helping others, etc. Keep the response open-ended to invite the user to reflect on it.\n</think>\n\nThe question \"What is the meaning of life?\" is one of humanity’s oldest and most profound inquiries. It has been explored across philosophy, religion, science, art, and personal reflection, with no single answer. Here’s a synthesis of key perspectives, acknowledging that meaning is often deeply personal and subjective:\n\n---\n\n### **1. Search for Objective Answers**\n- **Religious/Spiritual Views**: \n Many traditions propose the universe has an inherent purpose guided by a divine will. For example: \n - *Christianity*: To love and serve God, and others. \n - *Buddhism*: To transcend suffering (*dukkha*) through enlightenment (*nirvana*). \n - *Existentialist Religion* (e.g., Paul Tillich): Meaning arises from commitment to transcendent values. \n\n- **Scientific Perspectives**: \n Science focuses on *how* life exists (evolution, chemistry, physics) not *why*. Some argue meaning is an emergent property of consciousness, while others, like Richard Dawkins, see life as a \"survival machine\" driven by genetic replication.\n\n---\n\n### **2. Philosophical Takeaways**\n- **Existentialism** (Sartre, Camus): \n Humans create their own meaning in a universe devoid of inherent purpose. Camus embraced the \"absurdity\" of seeking meaning in a meaningless world, encouraging rebellion and passion as ways to affirm life. \n\n- **Stoicism** (Epictetus, Seneca): \n Meaning lies in living virtuously, cultivating resilience, and aligning with nature/logic. \n\n- **Nihilism**: \n Some (e.g., Nietzsche) argue life has no intrinsic meaning, but he also introduced the idea of the *Übermensch*—individuals who transcend nihilism by forging personal values. \n\n- **Hedonism vs. Eudaimonism**: \n The former sees meaning in pleasure; the latter (Aristotle) emphasizes fulfilling one’s potential and cultivating \"the good life.\"\n\n---\n\n### **3. Subjective and Personal Meanings**\n- **Psychological Insights**: \n Viktor Frankl’s *Man’s Search for Meaning* posits that meaning is found in love, work, or courage to endure suffering. \n - *Self-Determination Theory*: Autonomy, growth, and connection drive fulfillment. \n\n- **Human Experiences**: \n People often find purpose through: \n - Relationships (family, community). \n - Creativity/legacy (art, innovation). \n - Service (altruism, activism). \n - Personal goals (learning, travel, growth). \n\n---\n\n### **4. The Search Itself as Meaning**\n- Some argue the *journey*—curiosity, love, artistry, or exploration—is more meaningful than a fixed destination. For example: \n - *\"To ask the right question is harder than finding the answer.\"* — Stephen Hawking \n - The joy of connection, discovery, and the act of living mindfully.\n\n---\n\n### **5. No Answers? Maybe That’s Okay**\nAs Stephen Jay Gould noted, “The universe does not have a purpose; it is simply one way among many to arrange a universe.” Embracing uncertainty and crafting purpose daily can foster freedom and resilience. \n\n---\n\n### **Final Note**\nThe meaning of life may be less about a grand, universal truth and more about: \n- **What inspires your passions?** \n- **What values guide your actions?** \n- **What legacy matters to you?** \n\nUltimately, it’s a question to live with, not resolve. As Rilke wrote: *“Live the questions now, and perhaps you will gradually, without noticing it, live into the answers.”* What will your path look like? 🌱","role":"assistant"}}],"usage":{"completion_tokens":1195,"prompt_tokens":15,"total_tokens":1210,"queue_time":0.046343515,"prompt_time":0.000469034,"completion_time":4.322301983,"total_time":4.322771017},"x_groq":{"id":"req_01k7nbxr26eehafm3q1afrdr1m"},"service_tier":"auto"}% I dont know why when testing it now with gemini cli it failed
i passed in the ENV required
- GEMINI_API_KEY: sk-1234
note ive already set the auth to gemini api key on gemini before this step
after running gemini
So i dont think if this is the right place to report this , but maybe, this is...
i think google gemini cli has been updating their cli more strictly with their implemenation
as such this now is impossible to do...
Relevant log output
INFO: 127.0.0.1:65439 - "POST /v1beta/models/gemini-2.5-pro%3AstreamGenerateContent?alt=sse HTTP/1.1" 500 Internal Server Error
ERROR: Exception in ASGI application
+ Exception Group Traceback (most recent call last):
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_utils.py", line 76, in collapse_excgroups
| yield
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 177, in __call__
| async with anyio.create_task_group() as task_group:
| ^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/prisma/lib/python3.12/site-packages/anyio/_backends/_asyncio.py", line 781, in __aexit__
| raise BaseExceptionGroup(
| ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
+-+---------------- 1 ----------------
| Traceback (most recent call last):
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/uvicorn/protocols/http/h11_impl.py", line 407, in run_asgi
| result = await app( # type: ignore[func-returns-value]
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/uvicorn/middleware/proxy_headers.py", line 69, in __call__
| return await self.app(scope, receive, send)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/fastapi/applications.py", line 1054, in __call__
| await super().__call__(scope, receive, send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/applications.py", line 112, in __call__
| await self.middleware_stack(scope, receive, send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/errors.py", line 187, in __call__
| raise exc
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/errors.py", line 165, in __call__
| await self.app(scope, receive, _send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 176, in __call__
| with recv_stream, send_stream, collapse_excgroups():
| ^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/python/cpython-3.12.10-macos-aarch64-none/lib/python3.12/contextlib.py", line 158, in __exit__
| self.gen.throw(value)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_utils.py", line 82, in collapse_excgroups
| raise exc
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 178, in __call__
| response = await self.dispatch_func(request, call_next)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/proxy/middleware/prometheus_auth_middleware.py", line 47, in dispatch
| response = await call_next(request)
| ^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 156, in call_next
| raise app_exc
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 141, in coro
| await self.app(scope, receive_or_disconnect, send_no_error)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/cors.py", line 85, in __call__
| await self.app(scope, receive, send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
| await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
| raise exc
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
| await app(scope, receive, sender)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 714, in __call__
| await self.middleware_stack(scope, receive, send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 734, in app
| await route.handle(scope, receive, send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 288, in handle
| await self.app(scope, receive, send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 76, in app
| await wrap_app_handling_exceptions(app, request)(scope, receive, send)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
| raise exc
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
| await app(scope, receive, sender)
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 73, in app
| response = await f(request)
| ^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/fastapi/routing.py", line 301, in app
| raw_response = await run_endpoint_function(
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
| return await dependant.call(**values)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/proxy/google_endpoints/endpoints.py", line 89, in google_stream_generate_content
| response = await llm_router.agenerate_content_stream(**data)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 3599, in async_wrapper
| return await self._ageneric_api_call_with_fallbacks(
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 2734, in _ageneric_api_call_with_fallbacks
| raise e
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 2721, in _ageneric_api_call_with_fallbacks
| response = await self.async_function_with_fallbacks(**kwargs)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 3926, in async_function_with_fallbacks
| return await self.async_function_with_fallbacks_common_utils(
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 3884, in async_function_with_fallbacks_common_utils
| raise original_exception
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 3918, in async_function_with_fallbacks
| response = await self.async_function_with_retries(*args, **kwargs)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 4123, in async_function_with_retries
| raise original_exception
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 4014, in async_function_with_retries
| response = await self.make_call(original_function, *args, **kwargs)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 4134, in make_call
| response = await response
| ^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 2812, in _ageneric_api_call_with_fallbacks_helper
| raise e
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 2798, in _ageneric_api_call_with_fallbacks_helper
| response = await response # type: ignore
| ^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/utils.py", line 1626, in wrapper_async
| raise e
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/utils.py", line 1472, in wrapper_async
| result = await original_function(*args, **kwargs)
| ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/google_genai/main.py", line 434, in agenerate_content_stream
| raise litellm.exception_type(
| ^^^^^^^^^^^^^^^^^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2278, in exception_type
| raise e # it's already mapped
| ^^^^^^^
| File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 540, in exception_type
| raise APIConnectionError(
| litellm.exceptions.APIConnectionError: litellm.APIConnectionError: APIConnectionError: GroqException - litellm.google_genai.adapters.handler.GenerateContentToCompletionHandler.async_generate_content_handler() got multiple values for keyword argument 'stream'. Received Model Group=gemini-2.5-pro
| Available Model Group Fallbacks=None LiteLLM Retried: 1 times, LiteLLM Max Retries: 2
+------------------------------------
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/uvicorn/protocols/http/h11_impl.py", line 407, in run_asgi
result = await app( # type: ignore[func-returns-value]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/uvicorn/middleware/proxy_headers.py", line 69, in __call__
return await self.app(scope, receive, send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/fastapi/applications.py", line 1054, in __call__
await super().__call__(scope, receive, send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/applications.py", line 112, in __call__
await self.middleware_stack(scope, receive, send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/errors.py", line 187, in __call__
raise exc
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/errors.py", line 165, in __call__
await self.app(scope, receive, _send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 176, in __call__
with recv_stream, send_stream, collapse_excgroups():
^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/python/cpython-3.12.10-macos-aarch64-none/lib/python3.12/contextlib.py", line 158, in __exit__
self.gen.throw(value)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_utils.py", line 82, in collapse_excgroups
raise exc
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 178, in __call__
response = await self.dispatch_func(request, call_next)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/proxy/middleware/prometheus_auth_middleware.py", line 47, in dispatch
response = await call_next(request)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 156, in call_next
raise app_exc
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/base.py", line 141, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/cors.py", line 85, in __call__
await self.app(scope, receive, send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 714, in __call__
await self.middleware_stack(scope, receive, send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 734, in app
await route.handle(scope, receive, send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 288, in handle
await self.app(scope, receive, send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 76, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/starlette/routing.py", line 73, in app
response = await f(request)
^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/fastapi/routing.py", line 301, in app
raw_response = await run_endpoint_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
return await dependant.call(**values)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/proxy/google_endpoints/endpoints.py", line 89, in google_stream_generate_content
response = await llm_router.agenerate_content_stream(**data)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 3599, in async_wrapper
return await self._ageneric_api_call_with_fallbacks(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 2734, in _ageneric_api_call_with_fallbacks
raise e
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 2721, in _ageneric_api_call_with_fallbacks
response = await self.async_function_with_fallbacks(**kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 3926, in async_function_with_fallbacks
return await self.async_function_with_fallbacks_common_utils(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 3884, in async_function_with_fallbacks_common_utils
raise original_exception
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 3918, in async_function_with_fallbacks
response = await self.async_function_with_retries(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 4123, in async_function_with_retries
raise original_exception
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 4014, in async_function_with_retries
response = await self.make_call(original_function, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 4134, in make_call
response = await response
^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 2812, in _ageneric_api_call_with_fallbacks_helper
raise e
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/router.py", line 2798, in _ageneric_api_call_with_fallbacks_helper
response = await response # type: ignore
^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/utils.py", line 1626, in wrapper_async
raise e
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/utils.py", line 1472, in wrapper_async
result = await original_function(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/google_genai/main.py", line 434, in agenerate_content_stream
raise litellm.exception_type(
^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 2278, in exception_type
raise e # it's already mapped
^^^^^^^
File "/Users/uriah/.local/share/uv/tools/litellm/lib/python3.12/site-packages/litellm/litellm_core_utils/exception_mapping_utils.py", line 540, in exception_type
raise APIConnectionError(
litellm.exceptions.APIConnectionError: litellm.APIConnectionError: APIConnectionError: GroqException - litellm.google_genai.adapters.handler.GenerateContentToCompletionHandler.async_generate_content_handler() got multiple values for keyword argument 'stream'. Received Model Group=gemini-2.5-pro
Available Model Group Fallbacks=None LiteLLM Retried: 1 times, LiteLLM Max Retries: 2Are you a ML Ops Team?
No
What LiteLLM version are you on ?
1.78.0
Twitter / LinkedIn details
No response