You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi I was trying to setup the extension Continue with the text-generation-webui API. It works great for the chat part. Now, there is also a fill-in-middle (FIM) and I was wondering how to make it work. Practically it is a different model that needs to be used. But the text-generation-webui API can only support one model at once, is this correct?
I saw that changing the models via API-call is possible (#1713) but this does not make much sense in a context when using FIM and the normal chat model at once, right?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi I was trying to setup the extension Continue with the text-generation-webui API. It works great for the chat part. Now, there is also a fill-in-middle (FIM) and I was wondering how to make it work. Practically it is a different model that needs to be used. But the text-generation-webui API can only support one model at once, is this correct?
I saw that changing the models via API-call is possible (#1713) but this does not make much sense in a context when using FIM and the normal chat model at once, right?
Do you see there a solution?
Beta Was this translation helpful? Give feedback.
All reactions