Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[StructuredState] Provide a user option to monitor memory and truncate before OOM #116

Open
PabloAndresCQ opened this issue May 17, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@PabloAndresCQ
Copy link
Collaborator

Currently there are two truncation policies: chi and truncation_fidelity. We could add an additional one max_mem that attempts to keep the state representation below a certain memory threshold. Note that there are multiple challenges here that would need to be tackled:

  • How do we decide which bonds to truncate?
  • Can we guarantee that there will be no OOM errors? Notice that the memory required by methods such as SVD is much larger than the memory required just to store the MPS. Can we reliably predict the memory used?
  • Can we combine this policy with the other two? So that the user sets a desired policy, but may set a flag prevent_oom to allow the library to apply extra truncations in an attempt to avoid an OOM error.
@PabloAndresCQ PabloAndresCQ added the enhancement New feature or request label May 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant