Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[qsr_prob_rep] - XML memory issue with larger HMMs #194

Open
pet1330 opened this issue Sep 28, 2015 · 0 comments
Open

[qsr_prob_rep] - XML memory issue with larger HMMs #194

pet1330 opened this issue Sep 28, 2015 · 0 comments
Assignees
Labels

Comments

@pet1330
Copy link
Member

pet1330 commented Sep 28, 2015

When I tried to dump a relatively large HMM file, I used over 32GB of RAM, at which point my computer killed it. The actual HMM generation finished, but was not able to save the file. We think this is a result of the function which dumps it to a XML files found here.

We got around the issue by calling it directly, rather than using the service call, which allowed us to use numpy to dump the HMMs to 3 seperate files using np.savetxt and hmm.asMatrices

  • file**.**trans
  • file**.**emi
  • file**.**start

Using these files and gh.HMMFromMatrices we were able to recreate the HMM. However, this is a bit of a hack.

Can someone please add the label: "Reminder" and "Not Urgent" and assign to @cdondrup

@cdondrup cdondrup self-assigned this Sep 28, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants