Kyuubi AuthZ spark extension config location

[Miosp]

Hey. With a great amount of success I'm using Kyuubi (1.10.0) with spark (3.5.3) and so far everything seemed to be working. However, I stumbled upon a brick wall when trying to test how Ranger can be integrated.

I'm launching my engines on a Kubernetes cluster via spark-submit. They are connecting to Kyuubi normally and everything is perfectly normal. The problem is that spark-submit uses a Kubernetes configmap mounted onto ./conf directory for providing the properties file, which makes the directory read-only and overwrites its original contents. This makes the fact that the Kyuubi's Ranger extension needs the ranger-spark-security.xml file to be exactly there problematic.

I did not find any way to plug into the generated configmap directly nor to change the location where the extension is looking for config files.

Is there an already existing solution to this problem?

[thijs-s]

I have the same problem