System Design SpaceSystem Design Space
Back to table of contents

AI Engineering

23 chapters

This page contains all chapters in this theme. Open chapters in sequence or use this page as a section map.

1

AI Engineering: Designing LLM, Agent, and Copilot Systems

Original Contenteasy

Introductory map of AI Engineering: LLM products, RAG, agentic flows, guardrails, evaluation, cost, and the runtime around the model.

Open chapter
2

Hunting for Electric Sheep: The Big Book of Artificial Intelligence (short summary)

Book Summarymedium

A broad historical and engineering panorama of AI: from ancient computing ideas and the perceptron to AlexNet, deep learning, and foundation models, with a focus on how algorithms, infrastructure, and product practice evolved together.

Open chapter
3

Grokking Artificial Intelligence Algorithms (short summary)

Book Summaryeasy

An introductory guide to core AI algorithms: search, evolutionary methods, swarm intelligence, ML, neural networks, and Q-learning. Best read as algorithmic groundwork before newer material on LLMs and generative systems.

Open chapter
4

Deep Learning and Data Analysis: A Practical Guide (short summary)

Book Summaryeasy

A concise and practical introduction to deep learning and data analysis: fundamentals, classical machine learning algorithms, applied tasks, and hands-on work with TensorFlow, Keras, and PyTorch.

Open chapter
5

AI Engineering (short summary)

Book Summaryhard

Chip Huyen on building AI applications around foundation models: prompting, RAG, agents, finetuning, evaluation, and operations.

Open chapter
6

Hands-On Large Language Models (short summary)

Book Summarymedium

Jay Alammar and Maarten Grootendorst: a visual practical guide to LLMs with ~300 illustrations covering tokenization, embeddings, transformers, RAG, and fine-tuning.

Open chapter
7

Prompt Engineering for LLMs (short summary)

Book Summarymedium

John Berryman and Albert Ziegler on designing prompts for LLMs, assembling context, using RAG and agent patterns, and evaluating answer quality.

Open chapter
8

Agentic Workflows and Tool Calling Architecture

Original Contentmedium

How to design agentic systems: tool registries, planning and execution loops, state, approvals, and safe failure handling.

Open chapter
9

An Illustrated Guide to AI Agents (short summary)

Book Summarymedium

Jay Alammar and Maarten Grootendorst: a practical visual guide to agent systems covering memory, tools, planning, self-checking, multi-agent coordination, and engineering risks.

Open chapter
10

GenAI/RAG System Architecture

Original Contentmedium

Original chapter about production RAG architecture: ingestion, retrieval, answer orchestration, guardrails, evaluation, and SLO-versus-cost trade-offs.

Open chapter
11

LLM Guardrails, Prompt Injection, and Safety Patterns

Original Contentmedium

A practical chapter on designing LLM guardrails: prompt injection, tool abuse, output validation, policy checks, and safe degradation.

Open chapter
12

Evaluation and Observability for AI Systems

Original Contentmedium

How to measure AI systems in production: offline evaluation, online metrics, historical replays, model-based scoring, human review, and observability loops.

Open chapter
13

Enterprise AI Copilot

Case Studyhard

Practical GenAI case: a multi-tenant enterprise assistant with ACL-aware retrieval, citations, evaluation, fallback chains, and cost guardrails.

Open chapter
14

AI Coding Agent Platform

Case Studyhard

Practical AI case: a coding-agent platform with workspace isolation, tool execution, approvals, observability, and safe SDLC automation.

Open chapter
15

Developing Apps with GPT-4 and ChatGPT (short summary)

Book Summaryeasy

A concise 2023 hands-on guide to the first generation of LLM applications: OpenAI API basics, prompting, prompt-injection mitigation, fine-tuning, and early LangChain patterns.

Open chapter
16

AI Engineering Interviews (short summary)

Book Summarymedium

An Early Release O'Reilly guide to AI and GenAI interviews: 300 questions, strong answer patterns, common mistakes, and the signals interviewers expect.

Open chapter
17

Lovable: from GPT Engineer to full-stack AI builder

Original Contentmedium

Analysis of Lovable's history, business model, and conceptual architecture: from an open-source CLI to a cloud product with an agent-driven workflow.

Open chapter
18

Dyad: local AI app builder architecture

Original Contentmedium

Analysis of Dyad's architecture: multi-process Electron, a local execution stack, agent-and-tool orchestration, project templates, and checkpoints for safe rollback.

Open chapter
19

AI in SDLC: the path from assistants to agents by Alexander Polomodov

Documentarymedium

Extended talk about how engineering teams move from AI assistants to agent workflows in the SDLC: tools, protocols, governance, impact measurement, and practical adoption cases.

Open chapter
20

Programming Meanings by Alexey Gusakov (CTO Yandex)

Documentarymedium

A talk by Yandex CTO Alexey Gusakov on how AI products move from hand-coded algorithms to designing intent, constraints, evaluation loops, and useful system behavior.

Open chapter
21

PyTorch: Powering the AI Revolution

Documentaryhard

The official PyTorch documentary about how a research framework turned into one of the defining standards of modern AI engineering.

Open chapter
22

AlphaGo: The Documentary

Documentaryhard

Documentary about AlphaGo's match against Lee Sedol and the engineering system that made the breakthrough possible.

Open chapter
23

The Thinking Game: Documentary

Documentaryhard

Documentary about DeepMind's long research trajectory, from AlphaGo to AlphaFold and the next bets on the road to AGI.

Open chapter