Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FIX: 使用类自带的 forward_parallel_slices 方法 #35

Open
wants to merge 1 commit into
base: dev
Choose a base branch
from

Conversation

YuChuXi
Copy link

@YuChuXi YuChuXi commented Jun 22, 2024

试试

@uniartisan
Copy link
Collaborator

uniartisan commented Jun 24, 2024

有一个问题,你这样比如分四段,就会反向传播 1+2+3+4次。
如果把loss换成加法累加的话,如果我没理解错,就是反向传播最后一次。 不过这个是小问题,已经在我的分支fix了。

您可以修改这个实现,在callback里面返回生成的loss值,然后累加结束的时候反向传播吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants