New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How long is long? #12

Open

gevezex opened this issue Sep 18, 2020 · 1 comment

gevezex commented Sep 18, 2020

Is there a max token length for this long document? I mean if a document has 10k words, would it still work?

Owner

AndriyMulyar commented Sep 18, 2020

Yes - but it will of course use more memory. I'd suggest to try finetuning a pretrained longformer if your documents truly are that long.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment