Introduction to the Transformer (NLP video 17) HD

We will continue on the task of language translation. We review the concept of attention as used in seq2seq models and then introduce the transformer architecture. Jupyter notebooks: https://github.com/fastai/course-nlp/blob/master/7b-seq2seq-attention-translation.ipynb https://github.com/fastai/course-nlp/blob/master/8-translation-transformer.ipynb