GPT Series Evolution
Overview From 2018 to 2025, the GPT series went from an obscure paper to a worldchanging product in seven years. Underst...
AI
10 articles
Transformer Attention Mechanism Explained
Why We Need Attention Before Transformer, the dominant approach to sequence processing was RNN and LSTM. They processed ...
RAG Retrieval-Augmented Generation in Practice
What RAG Solves LLMs have two persistent problems: a knowledge cutoff training data only goes up to a certain date and h...
LoRA Fine-Tuning Guide
Why LoRA Full finetuning a 7B model requires 50+ GB of VRAM. LoRA reduces trainable parameters by 1000x through lowrank ...
Prompt Engineering Methodology
What Is Prompt Engineering Prompt Engineering is the practice of designing input text to guide LLMs toward desired outpu...
Agent Design Patterns
What Is an AI Agent An AI Agent is an AI system that autonomously perceives its environment, makes plans, invokes tools,...
LLM Inference Optimization
Why Inference Is Slow LLM inference is autoregressive — each token generation requires recomputing attention over the en...
The State of Multimodal LLMs
What Is Multimodal Multimodal models understand text, images, audio, and other input types simultaneously. GPT4V's relea...
AI Knowledge Management with Obsidian
Why Obsidian Obsidian is based on local Markdown files with bidirectional linking and knowledge graph support — naturall...
Building a Personal AI Second Brain
The Second Brain Concept Tiago Forte coined "Second Brain" — using external tools to extend human memory and thinking. O...