Skip to content

MNIST digits classification using 3x3 pixels basis function

License

Notifications You must be signed in to change notification settings

shun60s/mnist-basis-function

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MNIST digits classification using 3x3 pixels basis function

There are a lot of MNIST digits classification methods in the world.
The feature of this method is use 3x3 pixels basis function.
Using basis functions aims for study to control DNN.

github repository

Description

Following are eleven 3x3 pixels basis functions in this method.

figure1

Input image is downsized from 28x28 pixels to 3x3 pixels using CNN and MaxPooling.
And, compute absolute value of difference from 3x3 pixels basis function per each CNN output layer,
concatenate them and transform to 10 digits probability using one fully-connected layer.

This network has 162090 trainable parameters.
figure2

Result

Validation accuracy reaches up to 99.4%. But, it may be difficult to exceed that with this method.

figure3

Incorrect prediction image sample

Following sample are incorrect prediction image with binarization.

figure4
figure5

Heat map of weights

Following shows weights of last fully-connected layer.
1st basis function, of which Dense inputs are 0-127, seems less effective factor.

figure6

License

MIT

About

MNIST digits classification using 3x3 pixels basis function

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published