MLP

Peek inside a neural network as it learns, layer by layer

Open the training view and you'll watch a small neural network learn to read digits, layer by layer.

4 min readMachine Learning
Peek inside a neural network as it learns, layer by layer
[P] A small MLP from scratch in NumPy with a GUI to look inside it while it trains (weight distributions, t-SNE per layer, neuron ablation...) [P]
From Machine Learning

Hi everyone, I built an educational tool that shows what happens inside a small MLP while it trains, and I'd like some feedback from people who teach ML.

Everything is plain NumPy, no autograd: manual backprop, SGD with momentum, L2, dropout, cosine decay and 4 activations. On MNIST it gets to about 98.5% with the full training set.

Read the original at Machine Learning