Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port marian to WASM for inference #23

Closed
12 tasks done
abhi-agg opened this issue Mar 4, 2021 · 1 comment · Fixed by #24
Closed
12 tasks done

Port marian to WASM for inference #23

abhi-agg opened this issue Mar 4, 2021 · 1 comment · Fixed by #24
Assignees
Labels
enhancement New feature or request

Comments

@abhi-agg
Copy link

abhi-agg commented Mar 4, 2021

Merge wasm port of marian for inference to it's main branch

  • Rebase on main branch

  • Merge wasm compatible SentencePiece in marian's main branch

    • Enable (a cmake option based) decoder-only builds in SentencePiece's main branch
    • Update marian's SentencePiece submodule
  • Merge wasm compatible intgemm submodule in marian's main branch

    • Merge wormhole changes to intgemm's main branch
    • Update marian's intgemm submodule

- [ ] Enable decoder-only build capability in marian sources

  • Add onnxjs submodule (a wasm compatible SGEMM routine) in marian (this is required as long as marian can't solely use intgemm for Int-8 inference)

  • Enable try/catch free builds in marian (for fast inference)

  • Enable capability to build marian without multi-threading constructs (this is required until threading starts working in WASM)

  • Add workflow for building wasm compatible marian

  • Wasm builds: README and docker based build scripts

@abhi-agg abhi-agg self-assigned this Mar 4, 2021
@abhi-agg abhi-agg changed the title Merge wasm compatible changes to main branch Enable using marian as wasm module to perform inference Mar 4, 2021
@abhi-agg abhi-agg changed the title Enable using marian as wasm module to perform inference Port marian to WASM for inference Mar 4, 2021
@abhi-agg abhi-agg linked a pull request Mar 4, 2021 that will close this issue
4 tasks
@abhi-agg abhi-agg added the enhancement New feature or request label Mar 4, 2021
@abhi-agg
Copy link
Author

abhi-agg commented Mar 4, 2021

PR completes following sub-task

  • Merge wasm compatible intgemm submodule in marian's main branch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant