v1.35.1

Changed

• Changed cache TTL from 1h to 24h for keys and provider settings

The full change log can be found here.

v1.34.0

Added

• Added cost tracking for gpt-4o-mini

Changed

• Removed in-memory cache of provider settings
• Removed in-memory cache of keys

The full change log can be found here.

v1.33.0

Added

• Added support for OpenAI vector store APIs
• Added support for OpenAI vector store files APIs
• Added support for OpenAI vector store batches files APIs
• Added a new env variable for removing User-Agent from http headers.

The full change log can be found here.

v1.32.0

Added

• Added Prometheus integration thanks to @GingerMoon
• Added latest models to Azure OpenAI thanks to @minhoryang

The full change log can be found here.

v1.31.1

Fixed

• Fixed OpenAI transcription endpoint not working error

The full change log can be found here.

v1.31.0

Added

• Added support for storing metadata per request via the X-METADATA header

The full change log can be found here.

v1.30.0

Added

• Added deletion endpoint for routes
• Added support for new models from OpenAI and Azure OpenAI to routes

The full change log can be found here.

v1.29.0

Added

• Added support for Anthropic sonnet 3.5
• Added retry strategy to routes
• Added support for Azure OpenAI completions endpoint

Changed

• Changed to using sha256 hashing algorithm for computing cache key within routes

The full change log can be found here.

v1.28.4

Added

• Added filtering by status code for events v2 API

The full change log can be found here.

v1.28.3

Fixed

• Removed unused logs

Fixed

• Changed from using response model to using request model as the source of truth for customized pricing

The full change log can be found here.