Core Foundations of Generative AI

What's inside

12 topics

• 2.1Understanding Large Language Models
• 2.2How LLMs Work Under the Hood
• 2.3Deep Dive into the GPT Architecture
• 2.4Fundamentals of Tokenization in NLP
• 2.5Implementing a Custom Tokenizer in Python
• 2.6The Transformer Breakthrough: Attention
• 2.7Role of Positional Encodings in Transformers
• 2.8Understanding Multi-Head Attention
• 2.9Deep Diving into Vector Embeddings
• 2.10The Context Window Is a Budget
• 2.11Prefill, Decode and the Cost of Long Context
• 2.12What Chapter Two Constrains