[CI] Specify JDK 11 for spark engine on kubernetes IT

[wForget]

🔍 Description

Issue References 🔗

Spark Engine On Kubernetes Integration Test always fails after #6739

The default java version of Ubuntu 24.04 is OpenJDK 21: https://discourse.ubuntu.com/t/ubuntu-24-04-lts-noble-numbat-release-notes/39890#openjdk , this is a version higher than that supported by spark 3.5.X.

Describe Your Solution 🔧

Specify JDK 11 for spark engine on kubernetes it.

Types of changes 🔖

• Bugfix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Test Plan 🧪

test ga: https://github.com/wForget/kyuubi/actions/runs/11441231714/job/31828818049

---

Checklist 📝

• This patch was not authored or co-authored using Generative Tooling

Be nice. Be informative.

[pan3793]

I feel like that maven.compiler.release should be set to the minimal supported JDK version, for our case, it should be 8 instead of following the compile JDK version.

[wForget]

I feel like that maven.compiler.release should be set to the minimal supported JDK version, for our case, it should be 8 instead of following the compile JDK version.

Should this version be consistent with the jdk version used to build the spark image (apache/spark:3.5.2)?

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 0.00%. Comparing base (1e9d68b) to head (aee3933).
Report is 3 commits behind head on master.

Additional details and impacted files

@@          Coverage Diff           @@
##           master   #6763   +/-   ##
======================================
  Coverage    0.00%   0.00%           
======================================
  Files         684     684           
  Lines       42353   42354    +1     
  Branches     5775    5776    +1     
======================================
- Misses      42353   42354    +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[bowenliang123]

BTW, the default JDK on Ubuntu 24.04 is version 21. https://launchpad.net/ubuntu/noble/amd64/default-jdk

[bowenliang123]

I feel like that maven.compiler.release should be set to the minimal supported JDK version, for our case, it should be 8 instead of following the compile JDK version.

SGTM. Testing it in #6766.

[wForget]

I feel like that maven.compiler.release should be set to the minimal supported JDK version, for our case, it should be 8 instead of following the compile JDK version.

SGTM. Testing it in #6766.

Thank you, that's a better way, I will close this

[bowenliang123]

As #6766 requires further polishment and investigation, we still need this patch as a workaround to pass the CI tests.

[bowenliang123]

LGTM. All the tests on K8s passed.

[bowenliang123]

Thanks, merged to master (1.10.0)