Overview
About this project
Working in health tech taught me that the hard part of AI in care is trust, not fluency. This personal R&D prototype explores a narrow, safer pattern: an assistant that may only answer from a curated set of clinical guideline documents and must show the exact passages it relied on.
Documents are chunked, embedded and stored in a vector index; each question retrieves the most relevant passages, and the model is instructed to answer only from them or say it does not know. Every response carries citations back to the source document and section.
The prototype is built around evaluation: a fixed question set with expected source passages measures retrieval accuracy and answer faithfulness on every change. It is a decision-support experiment, not a diagnostic tool, and keeps a human in the loop by design.
Progress log
Recent updates
How the work is evolving — milestones, releases, and notes from the bench.
Issue
Oct 13, 2026
Refusal behaviour needs tightening
Some out-of-scope questions still get partial answers; adding stricter grounding checks.
Milestone
Sep 21, 2026
Evaluation harness added
A fixed question set scores retrieval accuracy and answer faithfulness on every change.
Milestone
Aug 12, 2026
Retrieval baseline with citations
Answers now return the guideline passages used, with document and section references.