[Bug]: Gemini no <think> tag for reasoning models from AI Studio API

[traderpedroso]

What happened?

The tag for the reasoning models in Google AI Studio is missing. Another thing that could also be added is Grounding on Google in AI Studio."

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.59.8-stable

Twitter / LinkedIn details

No response

[krrishdholakia]

Hey @traderpedroso can you share a minimal script for repro?

And do you see the provider returning this? (Raw Response when litellm._turn_on_debug() is enabled)

[enyst]

Just to note, according to the current AI studio docs:

The Gemini API doesn't return thoughts in the response.

Also

Limitations
No JSON mode or Search Grounding

However, funnily enough, the message from flash-2.0-thinking-exp sometimes changes person, as if the thinking got mixed in:

The user asked to check the branches on GitHub. I have already listed the branches from the GitHub API and compared them to the local branches. Now I should present this information to the user. The branches on the remote repository enyst/playground on GitHub are: ...

I hope this changes and it will return a proper tag...

[krrishdholakia]

@enyst So is there a bug on our end?

[enyst]

No, I don't think so. As far as I can tell, Google doesn't expose it (yet)