feat: add support for other base urls, gpt 16k #84
Conversation
also updated openai-streams package to fix typescript errors with apiBase
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
|
nice this looks good! can you get it to build on vercel tho 😅 also i'd like to stick with npm vs pnpm here if possible
i felt the API key modal was important for the first time users interact w/ the app as otherwise they have no idea they need to enter anything and will just be annoyed their requests are failing? |
|
I have the settings modal open when no API key is set so that first time users are prompted to put in their info. I got rid of the pnpm lockfile, but that hasn't fixed the Vercel build. I don't have access to the logs, so maybe @transmissions11 could you paste them here? Or maybe make this repo public on Vercel? |
|
whoops my bad didn't know you couldn't see logs, here ya go: 
|
|
@transmissions11 I've fixed the build and merged. I'd be happy to make any other changes- I think this will be a great feature to have on flux.paradigm.xyz! |
|
can you add the api key modal back as well? |
Motivation
This allows people to use OpenAI-compatible models like LocalAI, and closes #82. Or it allows people to use their own openai proxy for api key safety or observability, or LLMOps products like Helicone or Portkey (although these services need you to pass additional headers; maybe that's the next thing to add).
Solution
Adds an API Base URL field to the settings page. I removed the API key modal because it seemed like duplicating functionality that's already in the settings modal. I do get the argument for simplicity, so maybe we could rework the settings modal UI e.g. hide extra options under a dropdown. I also put both the API key and base URL state in the same settings localStorage JSON object. I updated
openai-streamspackage to fix typescript errors on theapiBaseproperty. Also added a few missing dependencies that causedpnpmto fail.Checklist