You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Scripting suite2p on the compute nodes would not only help things go much faster in batches, but there's a lot of other really interesting things we could do for both performance and organization of different aspects of the projects.
Converting to Binary
This step appears to be single threaded, takes a substantial amount of time. Would be cool to one day just use zarrs as the underlying suite2p implementation to go from tiffs to parallelizable generation of easy to compute upon binaries. Maybe one day...
This step could be done in parallel for the several recordings that are collected each day.
Everything else
These parts all appear to be multithreaded quite nicely and use up almost all the CPU power. This part would probably be done serially in batches on a given node maybe...
The text was updated successfully, but these errors were encountered:
Scripting suite2p on the compute nodes would not only help things go much faster in batches, but there's a lot of other really interesting things we could do for both performance and organization of different aspects of the projects.
Converting to Binary
This step appears to be single threaded, takes a substantial amount of time. Would be cool to one day just use zarrs as the underlying suite2p implementation to go from tiffs to parallelizable generation of easy to compute upon binaries. Maybe one day...
This step could be done in parallel for the several recordings that are collected each day.
Everything else
These parts all appear to be multithreaded quite nicely and use up almost all the CPU power. This part would probably be done serially in batches on a given node maybe...
The text was updated successfully, but these errors were encountered: