Posts
13 posts. browse by tag.
No posts match.
2026
- OpenSpec: spec-driven development for AI coding agents
OpenSpec, the spec-driven workflow it imposes on an AI coding agent, what each artifact file contains, and how it fits into a production harness.
- Harness engineering: the code around the model call
The production-engineering scaffolding around a hosted model: retries, structured outputs, tool dispatch, caching, observability, evals, and prompt-injection defense.
- Building an AutoGPT-style agent in Go
How to build a Plan-Execute-Reflect agent in Go, with a SQLite-backed memory store, a reflector that catches confident-hallucination failures, and the rough edges that show up at hundreds of steps.
- Building a ReAct agent in Go
A working ReAct agent in Go: the loop, concurrent tool execution, and a streaming event channel for plugging it into a CLI or HTTP server.
- Fine-tuning LLMs: what it is, when you actually need it
When fine-tuning is worth the effort over prompts and RAG, the practical flavors (LoRA, QLoRA, RLHF), and a working recipe in code.
- Chain of thought: why thinking out loud helps a model think
Why asking a model to think step by step measurably improves accuracy on reasoning tasks, and how that intuition led to today's reasoning models.
- Prompt engineering: what prompts are and how to write good ones
The patterns inside a prompt that change model behaviour the most, plus an interactive demo of how a few words shift the next-token distribution.
2025
- RAG: retrieval-augmented generation, beyond document chunks
Retrieval-augmented generation past the basic pattern: chunking, hybrid retrieval, re-ranking, HyDE, and the failure modes that show up in production.
- Context in AI: what it is and how to use it
How a model sees its context window, why position inside the prompt affects what gets used, and tactics for laying information out so the model can use it.
- Hallucinations in AI: what they are and how to prevent them
Why language models confidently make things up, what is happening at the token level when they do, and the prevention techniques worth using.
- Weights: what a language model actually 'knows'
What the billions of numbers inside a language model are, how training writes them, and what they can hold versus what has to come from context.
- Gradient descent: how a language model learns anything
The optimisation algorithm that trains every neural network, from the math up, and the modern variants (SGD, Adam) that show up in production training.
- The math behind LLMs, mostly without tears
The matrix math that runs inside a language model on each forward pass: embeddings, attention, and the softmax over the vocabulary.