bug: on Windows, it is getting very slow

[mikbry]

Why multiple Webview threads ?

[mikbry]

Related to Webview2. clearing Users/xxx/AppData/Local/ai.opla.app/EBViewView fix a little...

[kustomzone]

Missed the precise timing when this happened as i'm testing so many chat apps.
Removing EBWebView folder and installing the latest version didn't fixed it unfortunately.
Definitely a Webview2 issue. Causes my cpu to run between 10% - 30% utilization on the offending view.
When the server does finally start the view goes to a blank page or reports the page can't load.
Most of the apps i'm testing are Electron, but ollama-grid-search also uses Rust/WV2 and is okay. (both show 6 webviews in taskmanager)

Opla Webview2
Version: 128.0.2739.79
Modified: 12/09/2024

ollama-grid-search Webview2
Version: 128.0.2739.67
Modified: 05/09/2024

[mikbry]

Thanks @kustomzone. Yes it is a WebView2 issue. On MacOs (ARM and x64) it is working correctly and memory usage is 10x lower... I see some comments about MS Office getting very slow and using a lot memory as it is also based on WebView2. Maybe it is due to latest Webview2 update. I Didn't find any relevant informations about that.
I will work on optimizing thread display.

[kustomzone]

Sadly the docs are not much help as it just says Tauri takes care of it (on Win10) without stating any method to select a specific version: "On versions older than Windows 11 the installer generated by Tauri takes care of ensuring WebView2 is installed on the system." - https://v2.tauri.app/reference/webview-versions

[mikbry]

@kustomzone I made some changes in event's handlers. Seems to work better on my low CPU PC running Win10.
Could you test again and give me your feedback thanks !

[mikbry]

But there is still a memory leak on Windows

[kustomzone]

Thanks.
I'd switched Webview2 to the one Modified: 05/09/2024, but no improvement. Still using thou.
At some point llama.cpp.server.exe said ggml.dll & llama.dll were missing so i copied those to 'Program Files\Opla'
Now it gives an Entry Point error. Wrong location?

After uninstall (+data), new install, it's stuck on "server is starting" while loading the last used model.
Interface still very slow to respond. I could download TinyLlama or select a model, but that's all atm.

[mikbry]

Ok thanks that's another problem, I see new llama.cpp.exe needs extra dll. I created #1289

[kustomzone]

"From: Georgi Gerganov [email protected]
Date: Fri, 6 Sep 2024 13:47:27 +0300
Subject: [PATCH] llama : add new llama_perf API"
https://gitea.swigg.net/dustins/llama.cpp/commit/b2fc0f8596f3f46043303e0e7c055f1ad0a8290e.patch
Around the same date. When was your last update for llama.cpp.server.exe?

[mikbry]

Yep 9 sep 2024I updated llama.cpp server

[mikbry]

@kustomzone I fixed dll problems. On my old Xiaomi laptop Win10 4 cores m3-6Y30 1.51Ghz with only 4Gb TinyLlama is running barely smoothly now.

[mikbry]

I found a strange behaviour between Opla and OpenAI providers screens. I created another issue #1295 for that

[kustomzone]

Uninstalled, removed EBWebview folder, tried both exe (Program Files/) and msi (Users/) and both crash just when opening.
The new EBWebview folders are there, about 5 have contents, but the rest are empty. Only 13mb total. The one i've backed up is 84mb. Not sure why it's part installed.

Last Version says 129.0.2792.52. So does the backup.

[mikbry]

Did you used https://github.com/Opla/opla/releases/tag/v1.0.0-alpha.230 ?
When I used exe version, install in c:/users/xxx/AppData/Local/Opla contains:

• assets
• ggml.dll
• llama.cpp.server.exe
• llama.dll
• Opla.exe
• uninstall.exe

Could you backup and delete c:/users/xxx/AppData/Roaming/Opla which contains all data. And restart and see if it works from a fresh start? Thanks

[kustomzone]

Yeh, roaming is only one i didn't remove. Will try.
Yep, same app layout here. Oh, no assests folder!
Program Files has Uninstall Opla.lnk instead of exe, but they are identical otherwise.

[mikbry]

Another hint, I use PowerShell to start Opla from c:/users/xxx/AppData/Local/Opla using this command:

& "./Opla.exe" | Out-Default

Which give me some logs and help me debug.

[mikbry]

Strange I have an older version in Program Files without the dll... But this version is not used by the system.

[kustomzone]

When people switch between exe and msi it will confuse things a bit with different re-installs in both locations.

[mikbry]

Yep I see

[kustomzone]

Still no 'assets' folder in Program Files.
Now EBWebview is 5mb so it's crashing while writing those. Plenty of hdd etc.
It created 'Roaming\Opla\workspace\project.opla' but empty with crash.

PS C:\Users\Administrator\AppData\Local\Opla> & "./Opla.exe" | Out-Default Opla setup: project path="C:\\Users\\Administrator\\AppData\\Roaming\\Opla\\workspace/project" project path="C:\\Users\\Administrator\\AppData\\Roaming\\Opla\\workspace/project"

'c:\Program Files (x86)\Microsoft\EdgeWebView\Application'
EdgeWebView: 128.0.2739.79
Application: 129.0.2792.52

[mikbry]

Oops assets wasn't present in windows bundle due to my previous changes for dll. I made a fix #1296 New release is on the way.