Using assertApproximateDataFrameEquality in a local spark cluster #110
Unanswered
miguel-figueiredo
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I trying to run my tests using a local spark cluster based on bitnami spark images (bitnami/spark:3.1.2), but one of my tests fails because it is using assertApproximateDataFrameEquality.
Spark complains with:
java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in instance of org.apache.spark.rdd.MapPartitionsRDD
Do you have any suggestions on how to fix this?
Beta Was this translation helpful? Give feedback.
All reactions