-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Resource exhaustion when compiling many functions #190
Comments
can you trace in rr or soemthing with a debug jll to ascertain what resource is failing to be allocated? |
I never fully got things setup iirc, but also in principle SetLogLevel might force a lot of debug to spew which may be helpful |
So LLDB shows some interesting info. It seems that every time we run the The question is: why the
|
Related jax-ml/jax#16272 |
Yeah we should also disable threading in our mlir contexts too -- I thought we fixed this earlier on the constructor for mlicontext, but maybe only just discussed it |
Some of my algorithms change its structure on every iteration, so I need to recompile the function on each iteration. This is sth that works well on Jax. Aside of the huge performance overhead we're now having in Reactant (which may need some refactoring on
Thunk
andcompile
to zero the amount of compilation from the Julia side to improve it), I'm getting the following error after running many compilations.Some notes:
compile
takes some resource that's it's not releasing and the resource size is constant.MWE
The text was updated successfully, but these errors were encountered: