Table 1. Translation performance comparison with other models.

Method TED2013 UM-Corpus
RNN 15.7 16.8
LSTM 18.2 19.9
Transformer 20.4 21.7
S1 (Ours) 21.6 23.1