Table 4. Validation accuracy with ELU as activation function in the first hidden layer.

1st hidden layer 2nd hidden layer Epoch number Accuracy rate
ELU ELU 100 76.67%
200 72.40%
300 70.41%
400 68.25%
ELU PReLU 100 70.35%
200 72.51%
300 75.67%
400 73.51%
ELU Leaky ReLU 100 65.03%
200 71.23%
300 72.40%
400 79.94%