Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] [Master,Api-server] version:3.2.1 ProcessServiceImpl.java:1964 NullPointerException #15638

Closed
2 of 3 tasks
liuchunhua opened this issue Feb 27, 2024 · 1 comment
Closed
2 of 3 tasks

[Bug] [Master,Api-server] version:3.2.1 ProcessServiceImpl.java:1964 NullPointerException #15638

liuchunhua opened this issue Feb 27, 2024 · 1 comment
Labels
bug Something isn't working Waiting for reply Waiting for reply

Comments

@liuchunhua
Copy link
Contributor

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

3.2.0升级到3.2.1后，任务执行master会报

[WI-0][TI-0] - [ERROR] 2024-02-27 01:29:00.848 +0800 o.a.d.s.m.r.MasterSchedulerBootstrap:[156] - Master handle command 6370 error 
org.apache.dolphinscheduler.server.master.exception.WorkflowCreateException: Create WorkflowExecuteRunnable failed
        at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnableFactory.createWorkflowExecuteRunnable(WorkflowExecuteRunnableFactory.java:98)
        at org.apache.dolphinscheduler.server.master.runner.MasterSchedulerBootstrap.lambda$run$0(MasterSchedulerBootstrap.java:139)
        at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
        at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290)
        at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731)
        at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
        at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401)
        at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734)
        at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159)
        at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173)
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233)
        at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
        at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:650)
        at org.apache.dolphinscheduler.server.master.runner.MasterSchedulerBootstrap.run(MasterSchedulerBootstrap.java:136)
Caused by: java.lang.NullPointerException: null
        at org.apache.dolphinscheduler.service.process.ProcessServiceImpl.transformTask(ProcessServiceImpl.java:1964)
        at org.apache.dolphinscheduler.service.process.ProcessServiceImpl$$FastClassBySpringCGLIB$$9d3e18f9.invoke(<generated>)
        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
        at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386)
        at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85)
        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704)
        at org.apache.dolphinscheduler.service.process.ProcessServiceImpl$$EnhancerBySpringCGLIB$$237be7b3.transformTask(<generated>)
        at org.apache.dolphinscheduler.server.master.graph.WorkflowGraphFactory.createWorkflowGraph(WorkflowGraphFactory.java:74)
        at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteContextFactory.createWorkflowExecuteRunnableContext(WorkflowExecuteContextFactory.java:65)
        at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnableFactory.createWorkflowExecuteRunnable(WorkflowExecuteRunnableFactory.java:83)
        ... 15 common frames omitted

该工作流首个节点状态是禁止运行，修改后保存报错：

[ERROR] 2024-02-27 01:04:00.714 +0800 o.a.d.a.s.i.ProcessDefinitionServiceImpl:[489] - Check task relation list error, meet an unknown exception, given taskRelationJson: [{"name":"","preTaskC
ode":0,"preTaskVersion":0,"postTaskCode":11299422634176,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634309,"preTaskVersion":2,"postTaskCo
de":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634049,"postTaskVersion":
2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634310,"postTaskVersion":2,"conditionType":"NONE","conditionPa
rams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634179,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11
299422634176,"preTaskVersion":1,"postTaskCode":11299422634180,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"post
TaskCode":11299422634306,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634309,"postTaskVer
sion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634048,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","condi
tionParams":{}},{"name":"","preTaskCode":11299422634049,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCo
de":11299422634177,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634178,"preTaskVersion":2
,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634179,"preTaskVersion":2,"postTaskCode":11299422634308,"postT
askVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634180,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE",
"conditionParams":{}},{"name":"","preTaskCode":11299422634304,"preTaskVersion":3,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","pre
TaskCode":11299422634305,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634306,"preTaskVers
ion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634310,"preTaskVersion":2,"postTaskCode":11299422634308,
"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634048,"postTaskVersion":2,"conditionType":"
NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634178,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"
","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634177,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTa
skVersion":1,"postTaskCode":11299422634305,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":112994226
34304,"postTaskVersion":3,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634307,"postTaskVersion":3,"conditionT
ype":"NONE","conditionParams":{}}]
java.lang.NullPointerException: null
        at org.apache.dolphinscheduler.service.process.ProcessServiceImpl.transformTask(ProcessServiceImpl.java:1964)
......
[ERROR] 2024-02-27 01:04:00.777 +0800 o.a.d.a.e.ApiExceptionHandler:[40] - org.apache.dolphinscheduler.api.controller.ProcessDefinitionController#updateProcessDefinition[12 args] Meet a ServiceException: 请求参数[{0}]无效

What you expected to happen

正常执行

How to reproduce

from 3.2.0 upgrade to 3.2.1

Anything else

Version

3.2.x

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@liuchunhua liuchunhua added bug Something isn't working Waiting for reply Waiting for reply labels Feb 27, 2024
@github-actions GitHub Actions
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

3.2.0升级到3.2.1后，任务执行master会报

[WI-0][TI-0] - [ERROR] 2024-02-27 01:29:00.848 +0800 o.a.d.s.m.r.MasterSchedulerBootstrap:[156] - Master handle command 6370 error 
org.apache.dolphinscheduler.server.master.exception.WorkflowCreateException: Create WorkflowExecuteRunnable failed
        at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnableFactory.createWorkflowExecuteRunnable(WorkflowExecuteRunnableFactory.java:98)
        at org.apache.dolphinscheduler.server.master.runner.MasterSchedulerBootstrap.lambda$run$0(MasterSchedulerBootstrap.java:139)
        at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183)
        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384)
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
        at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290)
        at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731)
        at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
        at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401)
        at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734)
        at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159)
        at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173)
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233)
        at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485)
        at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:650)
        at org.apache.dolphinscheduler.server.master.runner.MasterSchedulerBootstrap.run(MasterSchedulerBootstrap.java:136)
Caused by: java.lang.NullPointerException: null
        at org.apache.dolphinscheduler.service.process.ProcessServiceImpl.transformTask(ProcessServiceImpl.java:1964)
        at org.apache.dolphinscheduler.service.process.ProcessServiceImpl$$FastClassBySpringCGLIB$$9d3e18f9.invoke(<generated>)
        at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
        at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386)
        at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85)
        at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:704)
        at org.apache.dolphinscheduler.service.process.ProcessServiceImpl$$EnhancerBySpringCGLIB$$237be7b3.transformTask(<generated>)
        at org.apache.dolphinscheduler.server.master.graph.WorkflowGraphFactory.createWorkflowGraph(WorkflowGraphFactory.java:74)
        at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteContextFactory.createWorkflowExecuteRunnableContext(WorkflowExecuteContextFactory.java:65)
        at org.apache.dolphinscheduler.server.master.runner.WorkflowExecuteRunnableFactory.createWorkflowExecuteRunnable(WorkflowExecuteRunnableFactory.java:83)
        ... 15 common frames omitted

该工作流首个节点状态是禁止运行，修改后保存报错：

[ERROR] 2024-02-27 01:04:00.714 +0800 o.a.d.a.s.i.ProcessDefinitionServiceImpl:[489] - Check task relation list error, meet an unknown exception, given taskRelationJson: [{"name":"","preTaskC
ode":0,"preTaskVersion":0,"postTaskCode":11299422634176,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634309,"preTaskVersion":2,"postTaskCo
de":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634049,"postTaskVersion":
2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634310,"postTaskVersion":2,"conditionType":"NONE","conditionPa
rams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634179,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11
299422634176,"preTaskVersion":1,"postTaskCode":11299422634180,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"post
TaskCode":11299422634306,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634309,"postTaskVer
sion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634048,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","condi
tionParams":{}},{"name":"","preTaskCode":11299422634049,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCo
de":11299422634177,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634178,"preTaskVersion":2
,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634179,"preTaskVersion":2,"postTaskCode":11299422634308,"postT
askVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634180,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE",
"conditionParams":{}},{"name":"","preTaskCode":11299422634304,"preTaskVersion":3,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","pre
TaskCode":11299422634305,"preTaskVersion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634306,"preTaskVers
ion":2,"postTaskCode":11299422634308,"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634310,"preTaskVersion":2,"postTaskCode":11299422634308,
"postTaskVersion":1,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634048,"postTaskVersion":2,"conditionType":"
NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634178,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"
","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634177,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTa
skVersion":1,"postTaskCode":11299422634305,"postTaskVersion":2,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":112994226
34304,"postTaskVersion":3,"conditionType":"NONE","conditionParams":{}},{"name":"","preTaskCode":11299422634176,"preTaskVersion":1,"postTaskCode":11299422634307,"postTaskVersion":3,"conditionT
ype":"NONE","conditionParams":{}}]
java.lang.NullPointerException: null
        at org.apache.dolphinscheduler.service.process.ProcessServiceImpl.transformTask(ProcessServiceImpl.java:1964)
......
[ERROR] 2024-02-27 01:04:00.777 +0800 o.a.d.a.e.ApiExceptionHandler:[40] - org.apache.dolphinscheduler.api.controller.ProcessDefinitionController#updateProcessDefinition[12 args] Meet a ServiceException: 请求参数[{0}]无效

What you expected to happen

正常执行

How to reproduce

from 3.2.0 upgrade to 3.2.1

Anything else

Version

3.2.x

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working Waiting for reply Waiting for reply
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@liuchunhua