Sedona 1.4.1 with Spark 3.0, Scala 2.13 and jts-core dependency

39 Views Asked by At

I am using Sedona 1.4.1 with pyspark (spark 3.0 and scala 2.13). When doing an ST_Intersects spark sql query which is giving the following error:

java.lang.IllegalAccessError: class org.locationtech.jts.index.quadtree.IndexSerde tried to access method 'org.locationtech.jts.index.quadtree.Root org.locationtech.jts.index.quadtree.Quadtree.getRoot()' (org.locationtech.jts.index.quadtree.IndexSerde is in unnamed module of loader org.apache.spark.util.MutableURLClassLoader @6c1832aa; org.locationtech.jts.index.quadtree.Quadtree is in unnamed module of loader 'app')

I've noticed that removing jts-core package solves this, however, due to other dependencies I cannot remove it permanently. I've also tried working with versions 1.18.0, 1.18.2 and 1.19.0 of jts-core.

0

There are 0 best solutions below