Healthcare · Canada
Generative AI for clinical decision support
The challenge
Physicians needed answers grounded in roughly 2,000 clinical guidelines and government healthcare documents, mostly PDFs with embedded charts and flowcharts. Retrieval had to stay accurate across a large knowledge base, handle questions that required calculations, and keep GPU processing cost under control.
What we built
A multimodal ingestion pipeline turned the documents, including embedded medical flowcharts, into structured knowledge using Marker, LlamaParse, Unstructured.io, and GPT-4 Vision. On top of it, an agentic RAG chatbot chose its own retrieval strategy, called tools for calculations, and queried a Neo4j knowledge graph for drug data, running independent steps in parallel on cost managed AWS GPU infrastructure.
Outcome
Live
MVP in doctor trials
~2,000
documents structured
Vision
reads flowcharts and images