CFPB Complaint Triage
Multi-Agent RAG System · 10/2026 – 11/2026
A multi-agent system that drafts cited, compliance-safe replies to consumer finance complaints. It searches 5,163 real CFPB complaints and 413 sections of federal Regulations E, F and Z.
- Two LangGraph workflows: a complaint-reply pipeline that waits for human approval, and a supervisor-routed analyst agent. Eight stopping conditions, enforced in code rather than the prompt, keep every run bounded.
- Layered hallucination controls: a retrieval score floor, per-claim citations, code checks, an LLM fact-checker and human approval. Zero invented rules across 153 scored runs: every failure was an incomplete answer or a hand-off to a person.
- Measured improvement: raised the pass rate from 61% to 93% on 28 test cases (3 runs each), then scored 90% on 23 new cases it was never tuned on.
- Cost-aware design: about $0.05 per request, by routing classification and planning to a small model with 20× cheaper input. Three times the context cost 40% more with no accuracy gain, so lean context stays the default.
- Python
- LangGraph
- Claude API
- pgvector
- PostgreSQL
- streamlit