fix streaming function type

[Kaushikdkrikhanu]

Title

Let function type be none to follow openai style.

Relevant issues

Fixes #8012

Type

🐛 Bug Fix

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

Will add some tests once my query is addresed. Trying to understand a comment.

How to reproduce

Open ai

import os
from openai import OpenAI

client = OpenAI(api_key="")

response = client.chat.completions.create(
    model="gpt-4-1106-preview",
    messages=[{
        "role": "user", 
        "content": "Search for recent AI breakthroughs"
    }],
    tools=[{
        "type": "function",
        "function": {
            "name": "web_search",
            "description": "Searches the web",
            "parameters": {
                "type": "object",
                "properties": {
                    "query": {"type": "string"}
                },
                "required": ["query"]
            }
        }
    }],
    stream=True
)

print("Stream output:")
for chunk in response:
    print(chunk)

Litellm

import os
from litellm import completion
import json

# Set your API key
os.environ["OPENAI_API_KEY"] = ""

# Create the chat completion request
response = completion(
    model="gpt-4-1106-preview",
    messages=[{
        "role": "user", 
        "content": "Search for recent AI breakthroughs"
    }],
    tools=[{
        "type": "function",
        "function": {
            "name": "web_search",
            "description": "Searches the web",
            "parameters": {
                "type": "object",
                "properties": {
                    "query": {"type": "string"}
                },
                "required": ["query"]
            }
        }
    }],
    stream=True
)

print("Stream output:")
for chunk in response:
    # Pretty print the chunk
    print(json.dumps(chunk, indent=2, default=str))
    print("---")  

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Feb 10, 2025 4:16am