Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
alecwangcq authored Jul 2, 2019
1 parent bc873a7 commit 25e6dbe
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ python main.py --dataset cifar10 --optimizer kfac --network vgg16_bn --epoch 10


## Performance
#### Note: for better hyparameters of K-FAC, please refer to [weight_decay](https://github.com/gd-zhang/Weight-Decay/tree/master/configs) repo. (The hyparameters is not good enough! Especially the weight decay is too small!)
#### Note: for better hyparameters of K-FAC, please refer to [weight_decay](https://github.com/gd-zhang/Weight-Decay/tree/master/configs) repo. (The hyparameters below are not good enough! Especially the weight decay is too small!)
For K-FAC and E-KFAC, the search range of learning rates, weight decay and dampings are:<br>
(1) learning rate = [3e-2, 1e-2, 3e-3] <br>
(2) weight decay = [1e-2, 3e-3, 1e-3, 3e-4, 1e-4] <br>
Expand Down

0 comments on commit 25e6dbe

Please sign in to comment.