Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[KYUUBI #5894] Separate closed and online sessions/statements in the SparkUI's engine tab #5946

Closed
wants to merge 8 commits into from

Conversation

beryllw
Copy link
Contributor

@beryllw beryllw commented Jan 4, 2024

Separate closed and online sessions[statements] in the SparkUI's engine tab

🔍 Description

Issue References 🔗

This pull request fixes #5894

Describe Your Solution 🔧

Separate closed and online sessions[statements] in the SparkUI's engine tab
image

Types of changes 🔖

  • Bugfix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Test Plan 🧪

Behavior Without This Pull Request ⚰️

Behavior With This Pull Request 🎉

Related Unit Tests

unit test will add soon.


Checklist 📝

Be nice. Be informative.

@cxzl25 cxzl25 changed the title [KYUUBI #5894] Separate closed and online sessions[statements] in the… [KYUUBI #5894] Separate closed and online sessions[statements] in the SparkUI's engine tab Jan 4, 2024
@codecov-commenter
Copy link

codecov-commenter commented Jan 4, 2024

Codecov Report

Attention: 126 lines in your changes are missing coverage. Please review.

Comparison is base (c6bba91) 61.16% compared to head (ade3fc1) 61.08%.
Report is 20 commits behind head on master.

Files Patch % Lines
.../scala/org/apache/spark/ui/EngineSessionPage.scala 7.50% 71 Missing and 3 partials ⚠️
...rc/main/scala/org/apache/spark/ui/EnginePage.scala 65.56% 48 Missing and 4 partials ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master    #5946      +/-   ##
============================================
- Coverage     61.16%   61.08%   -0.09%     
  Complexity       23       23              
============================================
  Files           621      622       +1     
  Lines         36864    37036     +172     
  Branches       5014     5023       +9     
============================================
+ Hits          22547    22622      +75     
- Misses        11878    11975      +97     
  Partials       2439     2439              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@pan3793
Copy link
Member

pan3793 commented Jan 5, 2024

The idea and UI LGTM (haven't gone through the code), there are compiling errors on Scala 2.13, could you please fix it?

@beryllw
Copy link
Contributor Author

beryllw commented Jan 5, 2024

The idea and UI LGTM (haven't gone through the code), there are compiling errors on Scala 2.13, could you please fix it?

I will fix it soon.

data,
"kyuubi",
UIUtils.prependBaseUri(request, parent.basePath),
s"${sessionTage}-table").table(sessionPage)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

image fix html document id duplicate

Copy link
Member

@pan3793 pan3793 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, except for the span id assignment

@pan3793 pan3793 changed the title [KYUUBI #5894] Separate closed and online sessions[statements] in the SparkUI's engine tab [KYUUBI #5894] Separate closed and online sessions/statements in the SparkUI's engine tab Jan 16, 2024
@pan3793 pan3793 added this to the v1.9.0 milestone Jan 16, 2024
@pan3793 pan3793 closed this in a4345ee Jan 16, 2024
@pan3793
Copy link
Member

pan3793 commented Jan 16, 2024

Merged to master

zhaohehuhu pushed a commit to zhaohehuhu/incubator-kyuubi that referenced this pull request Feb 5, 2024
…n the SparkUI's engine tab

Separate closed and online sessions[statements] in the SparkUI's engine tab

# 🔍 Description
## Issue References 🔗

This pull request fixes apache#5894

## Describe Your Solution 🔧
Separate closed and online sessions[statements] in the SparkUI's engine tab
![image](https://github.com/apache/kyuubi/assets/25627922/b39f9215-f629-4c5d-ac3d-9d7c4a8ebff0)

## Types of changes 🔖

- [ ] Bugfix (non-breaking change which fixes an issue)
- [x] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing functionality to change)

## Test Plan 🧪

#### Behavior Without This Pull Request ⚰️

#### Behavior With This Pull Request 🎉

#### Related Unit Tests

unit test will add soon.

---

# Checklist 📝

- [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)

**Be nice. Be informative.**

Closes apache#5946 from Kwafoor/kyuubi_5894.

Closes apache#5894

ade3fc1 [wangjunbo] fix
d71a61a [wangjunbo] rename span id
0b600f5 [wangjunbo] rename span id
f56ca7e [wangjunbo] fix code
79b8e33 [wangjunbo] delete test code
cd3ecac [wangjunbo] fix CI test, fix html document id duplicate
3a0e370 [wangjunbo] [KYUUBI apache#5894] fix scalastyle check
83c7b15 [wangjunbo] [KYUUBI apache#5894] Separate closed and online sessions[statements] in the SparkUI's engine tab

Authored-by: wangjunbo <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
zhaohehuhu pushed a commit to zhaohehuhu/incubator-kyuubi that referenced this pull request Mar 21, 2024
…n the SparkUI's engine tab

Separate closed and online sessions[statements] in the SparkUI's engine tab

# 🔍 Description
## Issue References 🔗

This pull request fixes apache#5894

## Describe Your Solution 🔧
Separate closed and online sessions[statements] in the SparkUI's engine tab
![image](https://github.com/apache/kyuubi/assets/25627922/b39f9215-f629-4c5d-ac3d-9d7c4a8ebff0)

## Types of changes 🔖

- [ ] Bugfix (non-breaking change which fixes an issue)
- [x] New feature (non-breaking change which adds functionality)
- [ ] Breaking change (fix or feature that would cause existing functionality to change)

## Test Plan 🧪

#### Behavior Without This Pull Request ⚰️

#### Behavior With This Pull Request 🎉

#### Related Unit Tests

unit test will add soon.

---

# Checklist 📝

- [ ] This patch was not authored or co-authored using [Generative Tooling](https://www.apache.org/legal/generative-tooling.html)

**Be nice. Be informative.**

Closes apache#5946 from Kwafoor/kyuubi_5894.

Closes apache#5894

ade3fc1 [wangjunbo] fix
d71a61a [wangjunbo] rename span id
0b600f5 [wangjunbo] rename span id
f56ca7e [wangjunbo] fix code
79b8e33 [wangjunbo] delete test code
cd3ecac [wangjunbo] fix CI test, fix html document id duplicate
3a0e370 [wangjunbo] [KYUUBI apache#5894] fix scalastyle check
83c7b15 [wangjunbo] [KYUUBI apache#5894] Separate closed and online sessions[statements] in the SparkUI's engine tab

Authored-by: wangjunbo <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
@beryllw beryllw deleted the kyuubi_5894 branch April 30, 2024 05:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improvement] Separate closed and online sessions[statements] in the SparkUI's engine tab
3 participants