README.md

Neural_network_project

Task: Classification

Dataset: Fation MNIST

Experiment 1: Change activation function

• Relu

• Tanh

• Sigmoid

• ELU

Activation function	Optimizer	Accuracy on test set	Loss
Relu	SGD	0.87	0.33
Tanh	SGD	0.65	0.83
ELU	SGD	0.87	0.36
Sigmoid	SGD	0.77	0.63

Experiment 2: change Optimizer

• Adam

• Nadam

• RMSprop

Activation function	Optimizer	Accuracy on test set	Loss
Relu	SGD	0.86	0.33
Relu	Adam	0.87	0.51
Relu	RMSprop	0.87	0.67
Relu	Nadam	0.84	0.52

Experiment 3: change layers and neurons number