Notes
Notes on retrieval, evals, observability, and the engineering that starts once the demo is the easy part.
A practical blueprint for legal QA, shaped in part by work around the Agentic RAG Legal Challenge: document identity, hybrid retrieval, structured answers, page-level grounding, telemetry, and evals.
Query rewrite, decomposition, step-back prompting, HyDE, fusion, and when each one is worth the extra latency.
How to reduce hallucinations in LLM systems with better retrieval, abstention, verification, evals, and guardrails.
Chunking, titles, metadata, parent-child structure, reranking, and corpus QA for RAG systems.