Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About ResNet18 experiment on CIFAR 10 #2

Open
ruili-pml opened this issue Dec 11, 2023 · 0 comments
Open

About ResNet18 experiment on CIFAR 10 #2

ruili-pml opened this issue Dec 11, 2023 · 0 comments

Comments

@ruili-pml
Copy link

Hi,

Thank you for your excellent work. I have two questions about the ResNet18 experiments on CIFAR10 and would be great if you could answer them.

Question 1: I was trying to reproduce your results in PyTorch and I found that the hyperparameters you provided in paper's appendix were not the same as the ones on github. In paper's appendix priorprec is set to 10 but in the repo it's set to 40?

Question 2: I'm not very familiar with Jax so I'm not sure how did you deal with BatchNorm's running statistics during training. As b-SAM have multiple forward pass within one update, I think the running statistics needs to be turned off and turned on. I was wondering have you experimented with when to turn it on and off?

Thanks,
Rui

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant