Table 5. Validation accuracy with Leaky ReLU as activation function in the first hidden layer.

1st hidden layer	2nd hidden layer	Epoch number	Accuracy rate
Leaky ReLU	ELU	100	72.57%
		200	72.46%
		300	67.13%
		400	70.18%
Leaky ReLU	PReLU	100	64.91%
		200	77.78%
		300	79.90%
		400	79.88%
Leaky ReLU	Leaky ReLU	100	67.02%
		200	72.46%
		300	74.50%
		400	71.46%