-
I was watching the demo video from main project page and it was pretty cool :) . Whatever content you pass to llm and asked it to thought and generate, it did pretty well but when i was seeing "thinking" part i was wondering if you are using openai O1/O1 mini thinking model or latest deepseek-r1 latest open source thinking models. If you are using o1/o1 mini model then my question is will you be supporting local llm's as well ? its open source project and people including me will love to try recent top notch open source thinking models by either running locally or through api as per our requirements and capabilities. It will be best if this project can integrate or be developed in such a way that we can use Litellm which is another open source project which i suggest to alot of great open source projects like this one :-) Btw thankyou very much for this great project dev :-)) |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Hey @Greatz08, sorry I didn't get notified for this We're using Claude Sonnet by default but it's extensible to any supported provider from the AI SDK including Ollama. https://github.com/onlook-dev/onlook/blob/main/apps/studio/electron/main/chat/llmProvider.ts#L20-L31 Here's an example usage of our chat https://github.com/onlook-dev/onlook/blob/main/apps/studio/electron/main/chat/index.ts#L77-L89 You can check out prompts and tools here. Would love to hear your thoughts on how we could architect this better :) |
Beta Was this translation helpful? Give feedback.
Hey @Greatz08, sorry I didn't get notified for this
We're using Claude Sonnet by default but it's extensible to any supported provider from the AI SDK including Ollama.
https://github.com/onlook-dev/onlook/blob/main/apps/studio/electron/main/chat/llmProvider.ts#L20-L31
Here's an example usage of our chat https://github.com/onlook-dev/onlook/blob/main/apps/studio/electron/main/chat/index.ts#L77-L89
You can check out prompts and tools here. Would love to hear your thoughts on how we could architect this better :)
https://github.com/onlook-dev/onlook/blob/main/packages/ai/src