Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CNN decoder #884

Open
AbdallahNasir opened this issue Sep 30, 2021 · 2 comments
Open

CNN decoder #884

AbdallahNasir opened this issue Sep 30, 2021 · 2 comments

Comments

@AbdallahNasir
Copy link

Hello,

Is there a plan to implement fully CNN seq2seq models? like this paper from Facebook https://arxiv.org/pdf/1705.03122.pdf
I can see that there is a CNN encoder, but still not a decoder. It would be great to have it as well in OpenNMT-tf.

Thanks

@guillaumekln
Copy link
Contributor

Hi,

We would accept a contribution for this decoder, but it seems to me that this model is now superseded by the Transformer model. Are CNN encoders and decoders still used?

@AbdallahNasir
Copy link
Author

Fully CNN is doing better on some experiments on seq2seq tasks than transformers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants