Large-Scale Pretraining with Transformers

English Version mxnet
#1

https://d2l.ai/chapter_attention-mechanisms-and-transformers/large-pretraining-transformers.html

#2

Fig. 11.9.7.

Je suis malade = I am sick

#3

Yes.
And “He’s calm” = “il est calme” | “Elle court” = “She’s running”