Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I would like to help #973

Open
cyberluke opened this issue Oct 12, 2024 · 1 comment
Open

I would like to help #973

cyberluke opened this issue Oct 12, 2024 · 1 comment
Labels
question Further information is requested

Comments

@cyberluke
Copy link

cyberluke commented Oct 12, 2024

Question

Hi, I would like to help with the project. Is there anything that needs to be done?

Currently I found an issue, probably in ONNXRuntime. I will look into it next week.

Here is example of WebGPU Whisper that works with mobile platforms including iPhone and Android: https://github.com/FL33TW00D/whisper-turbo

Current Transformers.js solution have some bugs. It will crash after model loading, page will restart on mobile device. I tried to connect remote debugging to Chrome PC via some ios remote debugging bridge, but it just restarts and I cannot get any logs. Any help how to get logs would be appreciated as I don't have much experience with iOS Safari debugging and I also happen to have Windows PC.

Here is photo from Safari - iPhone, you can see it does not support float32, but only float16. I suspect this is the issue and there are like 3 separate pull requests in ONNX to fix something around float16 support. But I did not have time to merge all current ONNX PRs and build it yet. First I would like to see some log with actual error
webgpu

This is what I will be working on next weekend.

If there is something else I should look into or help with testing, let me know.

Thank you for great project and great work! :-)

@cyberluke cyberluke added the question Further information is requested label Oct 12, 2024
@flatsiedatsie
Copy link
Contributor

flatsiedatsie commented Oct 14, 2024

but it just restarts and I cannot get any logs.

Check the 'preserve log' box:
Screenshot 2024-10-14 at 21 37 15

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants