Table 6. Validation accuracy with PReLU as activation function in the first hidden layer.

1st hidden layer 2nd hidden layer Epoch number Accuracy rate
PReLU ELU 100 68.25%
200 72.40%
300 69.30%
400 67.08%
PReLU PReLU 100 63.98%
200 70.18%
300 75.67%
400 74.44%
PReLU Leaky ReLU 100 72.46%
200 72.34%
300 74.62%
400 72.34%