Training Stats

Forward time per example: 5ms
Backprop time per example: 5ms
Classification loss: 0.51438
L2 Weight decay loss: 0.00158
Training accuracy: 0.84
Validation accuracy: 0.72
Examples seen: 2002
Learning rate:
Momentum:
Batch size:
Weight decay:


Loss:

Instantiate a Network and Trainer


Network Visualization

Activations:
Activation Gradients:
input (24x24x1)
max activation: 1, min: 0
max gradient: 0.00013, min: -0.00016
Activations:
Activation Gradients:
Weights:
( )( )( )( )( )( )( )( )
Weight Gradients:
( )( )( )( )( )( )( )( )
conv (24x24x8)
filter size 5x5x1, stride 1
max activation: 2.38866, min: -3.0595
max gradient: 0.00006, min: -0.00009
parameters: 8x5x5x1+8 = 208
Activations:
Activation Gradients:
relu (24x24x8)
max activation: 2.38866, min: 0
max gradient: 0.00008, min: -0.00009
Activations:
Activation Gradients:
pool (12x12x8)
pooling size 2x2, stride 2
max activation: 2.38866, min: 0
max gradient: 0.00008, min: -0.00009
Activations:
Activation Gradients:
Weights:
( )( )( )( )( )( )( )( )( )( )( )( )( )( )( )( )
Weight Gradients:
( )( )( )( )( )( )( )( )( )( )( )( )( )( )( )( )
conv (12x12x16)
filter size 5x5x8, stride 1
max activation: 6.37392, min: -5.23381
max gradient: 0.00005, min: -0.0001
parameters: 16x5x5x8+16 = 3216
Activations:
Activation Gradients:
relu (12x12x16)
max activation: 6.37392, min: 0
max gradient: 0.00007, min: -0.0001
Activations:
Activation Gradients:
pool (4x4x16)
pooling size 3x3, stride 3
max activation: 6.37392, min: 0
max gradient: 0.00007, min: -0.0001
Activations:
Activation Gradients:
fc (1x1x10)
max activation: 8.75213, min: -6.32776
max gradient: 0.00022, min: -0.00028
parameters: 10x256+10 = 2570
Activations:
softmax (1x1x10)
max activation: 0.99972, min: 0
max gradient: 0, min: 0

Example predictions on Test set

7
2
8
7
3
5
8
4
9
5
8
6
3
5
4
0
9
7
5
4
8
2
0
3
7
9
4
4
5
6
3
1
7
7
2
8
8
4
5
4
9
5
4
9
5
7
2
3
4
9
5
5
4
8
8
5
3
3
5
8
7
0
4
6
4
0
8
2
7
0
4
3
2
3
5
4
0
6
5
3
8
9
4
7
4
9
6
4
0
6
2
8
3
4
9
7
8
4
5
9
4
7
4
9
7
4
5
8
1
7
2
0
5
4
7
3
2
4
5
9
6
4
0
4
9
7
1
4
6
7
4
8
4
5
6
4
7
9
0
4
6
1
6
4
1
7
4
0
5
6