Definition of language model

What pre-training is and how it is done.

What is a hyperparameter?

Explaining self attention, an important component of transformers.