Foundations

This part establishes the vocabulary used throughout the rest of the book. It starts with the high-level idea of GPT-style models, then introduces the compact math notation needed to read the diagrams and Python code.

• In 1  Introduction, you will see what a GPT model does and how the main pieces fit together.
• In 2  Notation and Definitions, you will learn the vector, matrix, probability, and calculus notation used in the later chapters.