[Bug]: String data:
stripped from entire content in streamed Gemini responses
#8143
Labels
data:
stripped from entire content in streamed Gemini responses
#8143
What happened?
When streaming responses from Gemini models, the string
data:
is unexpectedly removed from the entire content, not just from the SSE message prefix.Potential cause:
The issue is likely cause by from this line of code, which appears to remove all instances of
data:
from the streaming chunks:https://github.com/BerriAI/litellm/blob/v1.59.10/litellm/llms/vertex_ai/gemini/vertex_and_google_ai_studio_gemini.py#L1434
Steps to reproduce:
Non-streaming response
Output
Streaming response
Output
some abc
Relevant log output
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.59.10
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: