Streaming #29
Comments
The client, no, but the wrapper allows. But while it will be difficult to implement in the client. Because he doesn't use HTML |
|
This feature is highly important, and I sincerely hope that it can be implemented. |
|
Can you explain what you mean with streaming |
|
@Yona544 In the official client via the web, the text appears as it is generated by the neural network. It's not just animation for beauty. In the API, there are two different ways to get a response from a neural network. |
|
Thanks for the fast response.
In the feature list you write:
*Send message as assistant, user or system *
Can you explain this to me?
Alos
- GPT functions (external load from "funcs" folder)
I download a pre compiled windows version and i dont see any func folder
and is this used for
…On Thu, Jul 27, 2023 at 4:18 PM HemulGM ***@***.***> wrote:
@Yona544 <https://github.com/Yona544> In the official client via the web,
the text appears as it is generated by the neural network. It's not just
animation for beauty. In the API, there are two different ways to get a
response from a neural network.
Simple. Request - response.
streaming. Request and sequential receipt of responses from the neural
network. Usually, several tokens at a time.
In the second option, the answer comes a little faster than in the first.
Because you don’t have to wait until the neural network generates the
entire answer.
—
Reply to this email directly, view it on GitHub
<#29 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/BAFUORSTUAA3GR6OADOLNVTXSLEKRANCNFSM6AAAAAAYAGFHJY>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
*Yona Tauber | Computer Dimensions*
P 718.625.7043
*F *347.382.9340
E ***@***.***
|
|
|
@Yona544 Oh, and there is no actual build to work with the features. Not yet. This is being tested. Requires manual build. |
|
no problem, i'm a delphi developer and have the latest version
But how is this funcs folder used? what is it made for
On a side note I wish we could have Copilot in the delphi
…On Thu, Jul 27, 2023 at 5:00 PM HemulGM ***@***.***> wrote:
@Yona544 <https://github.com/Yona544> Oh, and there is no actual build to
work with the features. Not yet. This is being tested. Requires manual
assembly.
—
Reply to this email directly, view it on GitHub
<#29 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/BAFUORQRVBJ5CPSZVXNR25DXSLJINANCNFSM6AAAAAAYAGFHJY>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
*Yona Tauber | Computer Dimensions*
P 718.625.7043
*F *347.382.9340
E ***@***.***
|
|
@Yona544 If the folder exists, all dll files are loaded from it. If libraries contain a specific exportable function that returns a set of available GPT functions, then it uses those functions to work with GPT. |
|
@Yona544 And we have something like a copilot. |
|
can you please explain me how a GPT function is used
…On Thu, Jul 27, 2023 at 5:10 PM HemulGM ***@***.***> wrote:
@Yona544 <https://github.com/Yona544> If the folder exists, all dll files
are loaded from it. If libraries contain a specific exportable function
that returns a set of available GPT functions, then it uses those functions
to work with GPT.
For functions to work in GPT requests, you must enable their use in the
general settings (or chat settings) and select a model that can work with
functions. And not all models can work with them. One of the models that
can work with them is gpt-3.5-turbo-0613.
—
Reply to this email directly, view it on GitHub
<#29 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/BAFUORTXQOKRSPXU3466DY3XSLKNNANCNFSM6AAAAAAYAGFHJY>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
*Yona Tauber | Computer Dimensions*
P 718.625.7043
*F *347.382.9340
E ***@***.***
|
|
@Yona544 Next, we select a model and enable features in the chat settings. Now we can make normal neural network requests, and if it considers that one of the functions is required to complete the request, it asks to perform it. We accept the request and allow the function to be executed (or there is an auto mode). After that, the data from the function is transferred to the neural network and it, using them, answers our question |
|
Ok, thanks for the clarification.
I guess this is how plugins work on the Chatgpt web interface
…On Thu, Jul 27, 2023 at 5:21 PM HemulGM ***@***.***> wrote:
In general settings, you can see a list of loaded functions from libraries.
[image: image]
<https://user-images.githubusercontent.com/22197242/256666887-7768291d-eefa-4bc0-9327-bc1ecede6738.png>
Next, we select a model and enable features in the chat settings.
[image: image]
<https://user-images.githubusercontent.com/22197242/256667034-12601a14-252d-4b8d-b320-01fd0ae49129.png>
Now we can make normal neural network requests, and if it considers that
one of the functions is required to complete the request, it asks to
perform it.
[image: image]
<https://user-images.githubusercontent.com/22197242/256667148-2264355b-87f2-443b-a3ef-c592990ced01.png>
[image: image]
<https://user-images.githubusercontent.com/22197242/256667366-777b5933-dd96-4a0b-9179-55175f52d73b.png>
We accept the request and allow the function to be executed (or there is
an auto mode). After that, the data from the function is transferred to the
neural network and it, using them, answers our question
[image: image]
<https://user-images.githubusercontent.com/22197242/256667430-bcbb036e-d613-47e9-93a0-8c0bbf8bb513.png>
—
Reply to this email directly, view it on GitHub
<#29 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/BAFUORVW45H7SDZ6RI7FB5TXSLLUDANCNFSM6AAAAAAYAGFHJY>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
*Yona Tauber | Computer Dimensions*
P 718.625.7043
*F *347.382.9340
E ***@***.***
|
|
@Yona544
Or even edit files. Such functions can be done. |
|
Got It.
Can I write new functions in Delphi
How about integrating the Delphi IDE with ChatGPT
Me: GPT review the highlighted code and fix the problem (GPT fixes some
things but the debugger isn't happy, so GPT keeps working until it is
resolved)
…On Thu, Jul 27, 2023 at 5:27 PM HemulGM ***@***.***> wrote:
@Yona544 <https://github.com/Yona544>
Yes, but we can do much more. For example, work with a computer.
[image: image]
<https://user-images.githubusercontent.com/22197242/256668213-859dc1d9-b155-4c70-8e47-4f6ebec0d200.png>
[image: image]
<https://user-images.githubusercontent.com/22197242/256668642-5652ba0d-85a1-490d-82c3-26c7b6d5b805.png>
—
Reply to this email directly, view it on GitHub
<#29 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/BAFUORVKTQ3OMGRSIVPJMJTXSLMKNANCNFSM6AAAAAAYAGFHJY>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
*Yona Tauber | Computer Dimensions*
P 718.625.7043
*F *347.382.9340
E ***@***.***
|
|
@Yona544 |
|
I'm using it but it is not a 2-way communication with Delphi
Chat-GPT may insert code but it can not see if there are any errors in the
code and auto-fix it
…On Thu, Jul 27, 2023 at 5:38 PM HemulGM ***@***.***> wrote:
@Yona544 <https://github.com/Yona544>
I gave you a link above to an existing plugin for the environment. He does
just that.
https://github.com/AliDehbansiahkarbon/ChatGPTWizard
—
Reply to this email directly, view it on GitHub
<#29 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/BAFUORSN3OQ4BX3PEM2WBCLXSLNW5ANCNFSM6AAAAAAYAGFHJY>
.
You are receiving this because you were mentioned.Message ID:
***@***.***>
--
*Yona Tauber | Computer Dimensions*
P 718.625.7043
*F *347.382.9340
E ***@***.***
|
|
@Yona544 Take it as a basis and improve |
Impressed with your project. But currently, does it not support streaming?
The text was updated successfully, but these errors were encountered: