Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fetching image data from N5 sources #238

Closed
clbarnes opened this issue Jul 14, 2023 · 2 comments
Closed

Fetching image data from N5 sources #238

clbarnes opened this issue Jul 14, 2023 · 2 comments

Comments

@clbarnes
Copy link
Collaborator

clbarnes commented Jul 14, 2023

I have an implementation which uses the metadata CATMAID stores about N5 stacks to build an xarray.DataArray (wrapping a dask.Array wrapping a zarr.Array...), which users can then query using project coordinates and fetch in parallel. Here, the heavy lifting is done by other libraries so it's only really metadata-wrangling; it can also be extended to other tile source types fairly easily (I'm working on supporting JPEG stacks, where you just need a shim which looks like a zarr.Store).

Would pymaid be the right place for this? It is obviously useful to the same people, but it also brings in some heavy dependencies: zarr, fsspec[http], pydantic>=2, xarray[parallel], imageio (these are currently tucked behind an extra, and the module isn't loaded on first import). Alternatively, I have another package which builds xarray.DataArrays out of chunked stores with different metadata standards (currently OME-NGFF zarr, bigdataviewer n5, n5-viewer, neuroglancer n5), so I could add it there, adding pymaid as a dependency. Much less discoverable for pymaid users, though, even if pointed to in the docs.

@schlegelp
Copy link
Collaborator

I think this has a place in pymaid, and not having it imported at top-level and with optional dependencies seems like the right approach.

@clbarnes
Copy link
Collaborator Author

Resolved by #235

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants