How AI Works
Attention: How an LLM Decides Which Words Matter Right Now
A slow, number-by-number explanation of attention—from context and Query, Key and Value vectors to dot products, masking, softmax, multi-head attention and KV cache.
21 min read
TECHBYTEBYBYTE
Understand the concepts behind AI. Build with it. Learn it, byte by byte.
Your AI Learning Path
From fundamentals to production AI
1. AI Foundations
2. LLMs & Transformers
3. RAG & Agents
Learn step by step. Build as you go.
View full roadmap →LEARNING PATHS
Start with the fundamentals, understand how the pieces connect, and gradually explore modern AI, LLMs, RAG and agentic AI.
Understand AI, ML, deep learning, LLMs and how the major pieces of modern AI fit together.
Learn the algebra, vectors, probability, statistics and optimization concepts needed for AI.
Learn Python, NumPy, Pandas and the programming skills you need to build AI systems.
Understand supervised learning, unsupervised learning, algorithms, training and evaluation.
Understand neurons, weights, activation functions, forward propagation and backpropagation.
Explore CNNs, RNNs, LSTMs and the architectures behind modern deep learning.
Learn how machines represent, process and understand human language.
Understand attention, self-attention, multi-head attention and the Transformer architecture.
Understand tokens, embeddings, logits, next-token prediction, training and inference.
Learn how to communicate effectively with LLMs using structured and advanced prompting techniques.
Understand the concepts, architectures and applications behind modern generative AI.
Build AI applications with Spring Boot using ChatClient, RAG, tools, MCP and production patterns.
Learn how retrieval, embeddings, vector databases and LLMs work together to build RAG systems.
Understand agents, tools, memory, reasoning, planning and agent execution loops.
Learn the engineering practices needed to build reliable, observable and production-ready AI systems.
Understand agentic systems, planning, reasoning, memory, orchestration and autonomous workflows.
Learn how multiple specialized agents communicate, collaborate and solve complex problems.
Learn reusable patterns for designing reliable agentic AI systems.
Build LLM and agent applications using LangChain and its ecosystem.
Build stateful, controllable and production-oriented agent workflows with LangGraph.
Understand Model Context Protocol and how AI systems connect to external tools and data.
Practice frequently asked QA coding interview questions with clear, worked Java answers.
Learn modern browser automation, API testing, debugging, CI/CD and production test architecture.
Ideas behind the technology
Engineering stories and practical explanations for readers who want to understand how modern AI really works.
How AI Works
A slow, number-by-number explanation of attention—from context and Query, Key and Value vectors to dot products, masking, softmax, multi-head attention and KV cache.
21 min read
How AI Works
Follow one page from training data into tokens, gradients and model weights—and then watch those learned parameters answer a simple question.
18 min read

How AI Works
A slow, beginner-first explanation of underfitting, overfitting and generalization, with training curves, examples, diagnosis, fixes and modern AI connections.
20 min read