Input

Embedding

Output

Embedding

Add & Norm

Multi-Head

Attention

Add & Norm

Feed

Forward

Add & Norm

Multi-Head

Attention

Add & Norm

Masked

Multi-Head

Attention

Add & Norm

Feed

Forward

Linear

Softmax