You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The library currently supports batch operations for OpenAI, but it does not natively support Azure OpenAI. Although Azure OpenAI is accessible via the litellm backend, batch mode is not supported when using litellm. It would be highly beneficial to add a native Azure OpenAI backend that also supports batch API operations.
Current Behavior
OpenAI Batch Support: Batch operations are supported natively for OpenAI.
Azure OpenAI Integration: Azure OpenAI is only available through the litellm backend.
Limitation: Batch mode cannot be utilized with the litellm backend.
Expected Behavior
Native Integration: Provide a native backend for Azure OpenAI.
Batch API Support: The new Azure backend should support batch operations, consistent with the OpenAI implementation.
Thank you for considering this feature request.
The text was updated successfully, but these errors were encountered:
Description
The library currently supports batch operations for OpenAI, but it does not natively support Azure OpenAI. Although Azure OpenAI is accessible via the litellm backend, batch mode is not supported when using litellm. It would be highly beneficial to add a native Azure OpenAI backend that also supports batch API operations.
Current Behavior
Expected Behavior
Thank you for considering this feature request.
The text was updated successfully, but these errors were encountered: