Data and Analytics

An AI copilot in the ambulance improved emergency detection by 50%

A chatbot based copilot for emergency neurological and cardiac cases was upgraded with retrieval augmented generation, taking accuracy from a 0.42 F1 score to 0.72, while capturing standardized, real time data inside the ambulance with zero manual entry.

The Opportunity

Emergency neurological and cardiac cases needed standardized, real time data capture inside ambulances, but the first version of the diagnostic chatbot scored a 0.42 F1, below the threshold needed for production use.

The company needed to improve accuracy without replacing a system already built and validated in the field.

The Transformation

Rather than rebuild from scratch, the existing chatbot was upgraded with retrieval augmented generation: symptom retrieval, Azure OpenAI as the reasoning model, and text-embedding-large for indexing.

On the same test dataset, F1 score improved from 0.42 to 0.72, enough to move the system into production.

  1. Phase 1: Real Time Emergency Data Capture

    Built on Microsoft Bot Framework with Azure/AWS NLP, 3D camera algorithms, and mixed reality on HoloLens-2, the system captures standardized emergency data inside the ambulance in real time, replacing manual note taking.

  2. Phase 2: RAG Upgrade for Accuracy

    Retrieval augmented generation was added on top of the existing system: symptom retrieval, Azure OpenAI for reasoning, and text-embedding-large for indexing, lifting F1 score from 0.42 to 0.72 on the same test dataset, without replacing the system already in the field.

  3. Encrypted, Audit Ready by Design

    Every interaction is captured through encrypted logging mechanisms built for audit compliance, so the system meets healthcare data requirements from day one.

  4. Faster Handoff, Better Coordination

    Standardized, real time data capture means hospitals receive a fuller picture before the patient arrives, supporting faster handoff and better care coordination.

Impact
0.42 to 0.72

F1 score improvement from the RAG upgrade, on the same test dataset

50%

Improvement in potential heart ailment detection inside the ambulance

100%

Audit compliance with zero manual data entry

Faster

Improved hospital handoff and care coordination

Tech Stack: Microsoft Bot Framework, Azure/AWS NLP, HoloLens-2 Mixed Reality, Azure OpenAI, text-embedding-large
Let’s Talk Production