Reality Check: Building a Personal Fact-Checking Framework

Hot takes. Plausible theories. AI-generated slop. LLM psychosis. How do you keep track of what’s actually true? Reality Check is an open-source framework for building a personal fact-checking knowledge base—using Agentic tools (Claude Code, Codex, etc) to track claims, sources, predictions, and argument chains with a LanceDB-backed semantic search.

I’ll show how the system extracts claims from articles, assigns evidence levels and credence scores, and generates analyses, but also how I went about building it, from an initial prototype to several refactors over the course of a few days.