Table 4. Validation accuracy with ELU as activation function in the first hidden layer.
1
st
hidden layer
2
nd
hidden layer
Epoch number
Accuracy rate
ELU
ELU
100
76.67%
200
72.40%
300
70.41%
400
68.25%
ELU
PReLU
100
70.35%
200
72.51%
300
75.67%
400
73.51%
ELU
Leaky ReLU
100
65.03%
200
71.23%
300
72.40%
400
79.94%