Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dolphin schedules repeated execution #15307

Closed
3 tasks done
doupengzhi opened this issue Dec 11, 2023 · 3 comments
Closed
3 tasks done

Dolphin schedules repeated execution #15307

doupengzhi opened this issue Dec 11, 2023 · 3 comments
Labels
bug Something isn't working Stale

Comments

@doupengzhi
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

3.1.8版本
举例:调度定时执行工作流(每半小时一次),但执行时偶尔一下会拉起两个任务。 在任务实例中可看到同一时间调起了两个工作流。如果是明细表,则会造成数据插入两倍。如下图所示,每半小时一次的任务,在13:30分的时候,执行了两次。
微信图片_20231211170928

What you expected to happen

查看dolphion master日志,发现确实执行了两次。
查看源码,日志打印(dolphinscheduler-scheduler-quartz , ProcessScheduleTask 64行) scheduled fire time :{}, fire time :{}, process id :{} 同一个process id 在不同的master节点都被调用了 。

How to reproduce

每天有1%左右的任务都会重复

Anything else

No response

Version

3.1.x

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@doupengzhi doupengzhi added bug Something isn't working Waiting for reply Waiting for reply labels Dec 11, 2023
@github-actions github-actions bot changed the title 海豚调度重复执行 Dolphin schedules repeated execution Dec 11, 2023
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

Version 3.1.8
For example: Schedule a scheduled execution of a workflow (once every half hour), but occasionally two tasks will be pulled up during execution. In the task instance, you can see that two workflows are launched at the same time. If it is a detailed table, data will be inserted twice. As shown in the figure below, the task that occurs every half hour is executed twice at 13:30.
WeChat picture_20231211170928

What you expected to happen

Looking at the dolphion master log, we found that it was indeed executed twice.
View the source code, log printing (dolphinscheduler-scheduler-quartz, ProcessScheduleTask line 64) scheduled fire time: {}, fire time: {}, process id: {} The same process id is called on different master nodes.

How to reproduce

About 1% of tasks are repeated every day

Anything else

No response

Version

3.1.x

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@SbloodyS SbloodyS removed the Waiting for reply Waiting for reply label Jul 17, 2024
Copy link

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the Stale label Aug 30, 2024
Copy link

github-actions bot commented Sep 6, 2024

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Sep 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Stale
Projects
None yet
Development

No branches or pull requests

2 participants