Lab project Active 🤖 AI & NLP 🩺 Health Tech October 21, 2026
Progress 35%

Clinical Guideline Assistant (RAG Prototype)

A retrieval-augmented assistant that answers clinicians' questions from approved guidelines, always citing the passage it used.

Clinical Guideline Assistant (RAG Prototype)
Overview

About this project

Working in health tech taught me that the hard part of AI in care is trust, not fluency. This personal R&D prototype explores a narrow, safer pattern: an assistant that may only answer from a curated set of clinical guideline documents and must show the exact passages it relied on. Documents are chunked, embedded and stored in a vector index; each question retrieves the most relevant passages, and the model is instructed to answer only from them or say it does not know. Every response carries citations back to the source document and section. The prototype is built around evaluation: a fixed question set with expected source passages measures retrieval accuracy and answer faithfulness on every change. It is a decision-support experiment, not a diagnostic tool, and keeps a human in the loop by design.
Progress log

Recent updates

How the work is evolving — milestones, releases, and notes from the bench.

Issue Oct 13, 2026

Refusal behaviour needs tightening

Some out-of-scope questions still get partial answers; adding stricter grounding checks.

Milestone Sep 21, 2026

Evaluation harness added

A fixed question set scores retrieval accuracy and answer faithfulness on every change.

Milestone Aug 12, 2026

Retrieval baseline with citations

Answers now return the guideline passages used, with document and section references.