iOS/Safari - continue generating text when closed - mostly solved with 1.58 (run in background)

[FrostyMisa]

Do you think it will be possible (or maybe it's and I don't find how) to continue the text generation even I close Safari under iOS and Koboldcpp will continue generate the text, after it will save this text locally on the machine where is the server, so I can only open Safari, refresh the website and the generated answer will appear here?

Because now when I close Safari, the answer is lost when I don't want to wait in the web interface. Thanks, love Koboldcpp!

[LostRuins]

You should be able to minimize the browser while the generation is ongoing. However, exiting the browser would cause the response to be lost, though it should still appear in the terminal console.

What you're requesting may be possible with a third party client when using the API directly though, you just need a separate program/script to request and save the generation instead of using your browser.

[FrostyMisa]

Yeah, on windows works great! 👍 But on iOS it doesn't ask for them. Maybe the implementation will be little bit different for iOS, because all the browsers are force to use Apple WebKit.

I think how to implement it is in the link above I send before. I will send it again.

https://developer.apple.com/documentation/usernotifications/sending_web_push_notifications_in_web_apps_and_browsers

They write "You don’t need to join the Apple Developer Program to send web push notifications."

https://developer.mozilla.org/en-US/docs/Web/API/Push_API

Only Safari for iOS in the list have some special implementation.

You can ask someone you know with iOS to test it. This website push works for me, so it's not problem with settings on my phone.

https://pushalert.co/push-notifications-for-safari

Sometimes I'm angry some do some things differently, like in this case. I hope you will find some time to implement it also for iOS.

I appreciate your time you already invested in this❤️

[LostRuins]

For now, you can try enabling "Beep on Done" which will sound a tone when generation is completed. That may work in place of notifications.

[FrostyMisa]

I tried it and even beep doesn't work. I checked if I don't have silent mode.

I thinking if the problem is not SSL certificate, because I don't use it locally, but it's not, because I tried it on
https://lite.koboldai.net/
and even here it doesn't work (push and beep).

Thank you for your time. I really appreciate it!

[FrostyMisa]

I only want to say thanks for the last update! Even the notification doesn't work on iOS (works on desktop PC with chrome)(I think it will be more complicated to make it work for Apple ecosystem), the latest version 1.58 with the settings run in background works even on iOS!

I test it, when I turn it on (run in background) and type something inside Kobold lite, I can safely close the browser and use other apps, even lock the iPhone screen and when I come back, the response waiting for me here! And in command line, where KoboldCPP running, it's no longer message interrupted by user close the browser!

Now I don't need to watch opened browser on my phone to get response, when I'm running KCPP on slow machine.

So one more time thank you very much! 🙏❤️

[LostRuins]

You're welcome! Hope its useful for you