Medical Report Generation from Audio Sensor Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Radiation oncology faces significant administrative burdens due to manual and repetitive documentation of patient encounters, leading to physician burnout and incomplete or incorrect records, while existing automated solutions fail to provide comprehensible clinical notes and raise privacy concerns.
Innovation Solution
A method for generating accurate and complete medical examination reports using multi-modal abstractive meeting summarization techniques, incorporating sensor data from microphones, cameras, and motion sensors, with expert validation and patient consent, to create concise and interpretable reports stored securely in electronic health records.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If verbatim transcription of the entire dialogue is used, then completeness of information is improved, but comprehensibility and interpretability deteriorate
Solution Approach 1:
The system extracts only the clinically relevant information from the complete verbatim transcript, separating essential medical data from conversational filler and redundant dialogue. This extraction process maintains information completeness while improving comprehensibility by presenting only what is necessary for clinical decision-making.
Solution Approach 2:
The transcript is segmented into structured clinical components such as chief complaint, history of present illness, physical examination findings, and assessment. This segmentation transforms the unstructured verbatim dialogue into organized, interpretable clinical sections that maintain completeness while enhancing readability and comprehension.
2Measurement precision
If manual documentation is used, then accuracy and completeness of clinical notes are improved, but time consumption and administrative burden increase
Solution Approach 1:
The system enables self-service documentation by automatically generating accurate clinical notes from the recorded dialogue without requiring manual transcription. The automated system maintains the accuracy that physicians previously achieved through careful manual documentation while eliminating the time-consuming aspect, allowing physicians to review rather than create notes from scratch.
Solution Approach 2:
The system incorporates feedback mechanisms where physicians can review and correct the automatically generated notes, ensuring accuracy while significantly reducing the time investment required compared to pure manual documentation. The feedback loop maintains high accuracy standards while leveraging automation to reduce administrative burden.
3Productivity
If automated speech recognition is used, then time efficiency is improved, but system integration complexity and workflow adaptation barriers increase
Solution Approach 1:
The system merges speech recognition technology with existing electronic health record workflows, combining the time efficiency of automation with the familiarity of established systems. This integration reduces workflow adaptation barriers by presenting the automated output in a format that fits seamlessly into existing clinical processes rather than requiring complete workflow restructuring.
4Extent of automation
If listening-in technology is deployed, then automated transcript generation is improved, but patient privacy concerns worsen
Solution Approach 1:
The system applies local quality control by processing and storing only the clinically relevant portions of the dialogue while maintaining privacy protections. Rather than storing complete verbatim transcripts that could expose sensitive personal information, the system extracts and retains only the medically necessary information, reducing privacy risks while maintaining automation benefits.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A technique for generating a medical examination report from sensor data (316) of a medical examination is provided. Sensor data (316) from a set of sensors (310; 312) are received (S102) in relation to the medical examination (302). The sensors comprise a microphone (310). The sensor data comprise audio data (316) with utterances (308-1; 308-2) by a medical professional (304) and patient representative (306). The sensor data are processed (S104), with the audio data transformed into text (318). A verbatim report (318) of the medical examination is generating (S106). The verbatim report comprises each excerpt (322; 326) of the text assigned to the medical professional or to the patient representative. The verbatim report is converted (S108) into a summarizing medical examination report. The summary comprises vocabulary, and/or text excerpts, by accessing a predetermined ontology database (320; 324). The medical examination report is stored (S118) in an electronic medical report database.