MR Workflow Analysis with Timestamped Video Event Annotations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing medical imaging systems lack comprehensive information about human activities during the imaging process, as machine logs and DICOM data do not capture human interactions, leading to incomplete workflow analysis.

Innovation Solution

Integrate video cameras to monitor the imaging examination region and bay, extracting event annotations representing human activities, and match these with machine log entries based on timestamps, allowing for enhanced logging of patient and personnel actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If video cameras are integrated to monitor human activities during imaging examinations, then the completeness of workflow information is improved, but the device complexity and data storage requirements increase

Engineering Contradiction:
Improveworkflow information completenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces video cameras as intermediary devices that capture human activities during imaging examinations. These cameras serve as mediators between the imaging device and the workflow analysis system, providing visual evidence of operator actions, patient movements, and procedural steps that were previously unrecorded. The video data is then processed through annotation algorithms that extract meaningful events and link them to machine log entries, thereby completing the workflow information without requiring direct integration of complex monitoring systems into the imaging device itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the workflow monitoring system into independent components: video capture modules, annotation processing algorithms, timestamp synchronization mechanisms, and log integration interfaces. This segmentation allows each component to be developed, optimized, and maintained separately. The video data is segmented into discrete events through automated annotation, and the workflow information is segmented into distinct phases that can be analyzed independently, reducing the overall system complexity while maintaining information completeness.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If video data is stored and processed for workflow analysis, then the understanding of human activities is improved, but the data storage requirements and processing time increase

Engineering Contradiction:
Improvehuman activity informationVSAvoiddata storage volume
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential information from video data through automated annotation algorithms. Instead of storing and processing entire video files, the system identifies and extracts key events such as patient positioning, contrast injection timing, scan sequence execution, and operator interventions. These extracted events are represented as concise text annotations with timestamps, which are then linked to corresponding machine log entries. This extraction process retains all necessary human activity information while reducing data storage requirements from gigabytes of video to kilobytes of structured annotations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by selectively processing only the portions of video data that contain meaningful workflow information. The annotation algorithms scan video streams and process only segments where human activities occur, ignoring static periods or redundant footage. This partial processing approach maintains complete human activity information while significantly reducing the computational burden and storage requirements compared to processing entire video datasets.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If event annotations are extracted from video and matched with machine log entries, then the accuracy of workflow analysis is improved, but the processing complexity and time increase

Engineering Contradiction:
Improveworkflow analysis accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-processing video data during or immediately after the imaging examination. Annotation algorithms continuously analyze video streams in real-time or near-real-time, extracting events and generating timestamps before the workflow analysis is formally initiated. Machine log entries are also pre-synchronized with standardized timestamp formats. This preliminary preparation ensures that when workflow analysis is performed, the data is already structured and ready for rapid matching, thereby improving accuracy without significantly increasing the actual analysis time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces manual workflow analysis with automated computational systems. Instead of radiologists or technicians manually reviewing video footage and correlating it with machine logs, the system uses automated annotation algorithms and timestamp-matching mechanisms to perform the correlation. This substitution of mechanical human analysis with computational automation dramatically improves measurement precision in identifying workflow events while reducing the time required from minutes or hours of manual review to seconds of automated processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12424312B2Context-enhanced magnetic resonance (MR) workflow analysis and image reading
Publication Date: 2025.09.23 KONINKLIJKE PHILIPS NV
  • US12424312B2 patent drawing
  • US12424312B2 patent drawing
  • US12424312B2 patent drawing

AI summary

A non-transitory computer readable medium (26) stores instructions readable and executable by at least one electronic processor (20) to perform a method (100) of maintaining a machine log (30) for a medical imaging device (2). The method includes: extracting event annotations (38) from video (17, 18) acquired by at least one video camera (12, 16) positioned to image an examination region of the medical imaging device and/or an imaging bay (3) containing the medical imaging device, the event annotations representing activities occurring during a medical imaging examination performed using the medical imaging device; and recording machine log entries (32) in the machine log of the medical imaging device wherein the machine log entries are generated by the medical imaging device. The recording includes matching the extracted event annotations with machine log entries based on timestamps (40) of the event annotations and timestamps (34) of the machine log entries and annotating the machine log entries with the matched event annotations.