Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dependencies need version updates in BigStitcher-Spark #14

Open
kgabor opened this issue Mar 14, 2023 · 0 comments
Open

Dependencies need version updates in BigStitcher-Spark #14

kgabor opened this issue Mar 14, 2023 · 0 comments

Comments

@kgabor
Copy link
Contributor

kgabor commented Mar 14, 2023

For the records, I'm ticketing our discussion with @tpietzsch about the BigStitcher-Spark dependencies on 2023-03-09.

It seems that the dependencies of BigStitcher-Spark are getting too old... I tried to run BigStitcher-Spark main checkout as of 2023-03-08 with with a bigdataviewer-omezarr main branch build.

java -Xmx94g -cp $(cat cp.txt) -Dspark.master=local net.preibisch.bigstitcher.spark.AffineFusion 
-x /home/jupyter/data/exaSPIM_609281_2022-11-03_proc_2022-11-22/affine_ip_alignment.xml 
-o /home/jupyter/test-spark_2023-03-08 --bdv 0,0 --storage N5 
--xmlout=/home/jupyter/fusion_test_2023-03-08/dataset.xml

where cp.txt is generated from the BigStitcher-Spark build (bigdataviewer-omezarr is added manually)

mvn dependency:build-classpath -Dmdep.outputFile=cp.txt
  • maven builds bigdataviewer-omezarr with jackson 2.12.5 that is incompatible with BigStitcher-Spark
  • the moving of SharedQueue from bdv.util.volatiles.SharedQueue tobdv.cache.SharedQueue causes NoSuchMethodError at bdv.util.volatiles.VolatileViews.wrapAsVolatile(Lnet/imglib2/RandomAccessibleInterval;Lbdv/cache/SharedQueue;)Lnet/imglib2/RandomAccessibleInterval, as we understood, because bigdataviewer-omezarr is already built with the new version while BigStitcher-Spark may use the old one.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant