Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [Module Name] ends a spark instance, and multiple instances unrelated to it are stopped. #16719

Closed
2 of 3 tasks
super-02 opened this issue Oct 21, 2024 · 2 comments
Closed
2 of 3 tasks
Labels
wontfix This will not be worked on

Comments

@super-02
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

我的spark程序称为程序1,中初始化了session,我使用了yarnclient并关闭,同时我还执行着别的spark程序称为程序2,当我运行了程序2并且没有运行完毕,且无bug,当我运行程序1的实例,程序1的状态一直为运行中,在cdh的yarn上面却已经结束了,当我点击实例的dolphin停止按钮,未完成的程序2也报错了,是报错Java。nio的错误,我记不清了,而且两个程序的状态同时变成失败。同时这个问题还有时候发生有时候不发生,我不知道其中发生了什么

What you expected to happen

只停止当前实例

How to reproduce

抱歉,我不知道

Anything else

No response

Version

3.1.x

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@super-02 super-02 added bug Something isn't working Waiting for reply Waiting for reply labels Oct 21, 2024
@github-actions github-actions bot changed the title [Bug] [Module Name] 结束一个spark实例,多个与他无关的实例被停止 [Bug] [Module Name] ends a spark instance, and multiple instances unrelated to it are stopped. Oct 21, 2024
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

My spark program is called program 1, and the session is initialized in it. I use yarnclient and close it. At the same time, I am also executing another spark program called program 2. When I run program 2, it does not finish running and there is no bug. When I run an instance of program 1, the status of program 1 is always running, but it has ended on the yarn of cdh. When I click the dolphin stop button of the instance, the unfinished program 2 also reports an error, which is a Java error. I can't remember the nio error clearly, and the status of both programs became failed at the same time. At the same time, this problem sometimes occurs and sometimes does not occur. I don’t know what happened.

What you expected to happen

Only stop the current instance

How to reproduce

Sorry, I don't know

Anything else

No response

Version

3.1.x

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@SbloodyS
Copy link
Member

Please using english to describe.

@SbloodyS SbloodyS added wontfix This will not be worked on and removed bug Something isn't working Waiting for reply Waiting for reply labels Oct 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

2 participants