One project holds the draft, the paper, the data and the audit. Trying the tabs does not use any of your free runs.
Attention without recurrence
Vaswani et al. replace recurrence and convolution in sequence transduction with attention alone. We summarise the architecture, check the headline translation results against the paper’s own tables, and note what the evidence does not yet show.
Live co-editing · 3 editors
Model,BLEU EN-DE,BLEU EN-FR
GNMT + RL Ensemble,26.3,41.16
ConvS2S Ensemble,26.36,41.29
Transformer (base),27.3,38.1
Transformer (big),28.4,41