Add backend&subscription based AI ratelimit#2446

Merged

Tharsanan1 merged 24 commits intowso2:mainfrom Tharsanan1:aireatelimitter

Sep 19, 2024

+3,645-368

Commits on Sep 19, 2024

Enforcer initial changes
Tharsanan1
committed
Fix rl key not deleted bug
Tharsanan1
committed
Fix build
Tharsanan1
committed
add subscription based ai ratelimit functionality to adaptetr and cc
Tharsanan1
committed
Add sub based ai ratelimit feature related changes
Tharsanan1
committed
Fix intermittent ratelimit timeout in envoy
Tharsanan1
committed
Use AIProvider to extract token details from response
Tharsanan1
committed
Fix revive errors
Tharsanan1
committed
Fix ratelimittier not getting from restapi problem
Tharsanan1
committed
Fix NPE
Tharsanan1
committed
Everything works
Tharsanan1
committed
Improve subscription matching
Tharsanan1
committed
Reduce response path token count by one
Tharsanan1
committed
Move rl to vhost
Tharsanan1
committed
Add integration test for AIRL
Tharsanan1
committed
Fix test artifacts
Tharsanan1
committed
Fix formats
Tharsanan1
committed
Add tests
Tharsanan1
committed
Fix test
Tharsanan1
committed
Add artifacts
Tharsanan1
committed
Fix intermittent issue
Tharsanan1
committed
Fix nil pointer err
Tharsanan1
committed
Change app id
Tharsanan1
committed
Fix test fails
Tharsanan1
committed