Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configs to run the result on table 5.1 #3

Open
Learner23333 opened this issue Sep 20, 2024 · 4 comments
Open

Configs to run the result on table 5.1 #3

Learner23333 opened this issue Sep 20, 2024 · 4 comments

Comments

@Learner23333
Copy link

Thanks for your contribution to the great work!
Could you please provide the settings to run the results of RF-POMO in Table 5.1, are they the same as rf-100.yaml and rf-50.yaml in the config.
I have run the run.py as guided in the readme.md, training with 8 * RTX3090, 300 epoch, using the uploaded test datatset, but the result I got is much larger than the result in Table 5.1.

@fedebotu
Copy link
Member

fedebotu commented Sep 20, 2024

Could you share your current results?

Actually we found a mistake in the original code, and we fixed RF-POMO, so the results might not be exactly the same as the current shared paper

PS: in around two weeks time we should share the latest version of RouteFinder with better reproducibility and possibly the model checkpoints!

@Learner23333
Copy link
Author

Thanks for your quick reply. Looking forward to the lastest version of RouteFinder!

@fedebotu
Copy link
Member

fedebotu commented Oct 2, 2024

Hi @Learner23333 ! We have release the latest version :)
We added several new features, including checkpoints, BKS solutions to calculate gaps, testing script and more. Feel free to let us know if you encounter problems!

PS: we will also release the updated version of the paper on Arxiv - Table 5.1 will be much improved with new, more meaningful and reproducible results!

@fedebotu
Copy link
Member

Follow-up: The latest preprint is now available on Arxiv https://arxiv.org/abs/2406.15007

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants