Augmentation Overlay Composer for Restricted Surgical Image Areas
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmentation overlay devices in digital operation rooms rely on software solutions that can lead to unintended overlay deactivation or shutdown during critical operations, posing a risk to patient safety due to software errors, especially when backup video outputs are unavailable or user access is limited.
Innovation Solution
An augmentation overlay device with a hardware-based composer device that determines and restricts overlays in critical areas of the live image data using x-y-coordinates and a mask layer, ensuring real-time processing without software errors, and requires a secure user interaction for enabling overlays in these areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a software solution with overlay-off button is used to deactivate overlays, then the device can be controlled to show main video, but software errors may cause extended blocking or complete shutdown of displayed information
Solution Approach 1:
The patent replaces the software-based overlay control mechanism with a hardware-based composer device that physically separates the overlay processing path from the main video path. The hardware composer device processes overlay data independently and combines it with the main video signal at the hardware level, ensuring that overlay deactivation cannot block or shut down the main video display. This mechanical/electrical substitution eliminates software errors that could cause extended blocking or complete shutdown.
Solution Approach 2:
The system segments the video processing into separate functional paths: a main video path and an overlay path. The hardware composer device receives both signals independently, processes them through separate channels, and combines them only at the final output stage. This segmentation ensures that failures or deactivations in the overlay path cannot affect the main video path, protecting patient safety by maintaining continuous access to critical video information.
2Reliability
If a bypass cable is provided for switching to second input, then alternative video source is available, but additional installation effort and user training are required
Solution Approach 1:
The patent merges the overlay processing function with the main video processing function within a single integrated hardware composer device. Instead of requiring separate bypass cables and additional input selectors, the hardware composer device combines both the main video signal and overlay data into one unified output path. This integration eliminates the need for complex installation of multiple cables and switches, while maintaining reliable backup capability through the hardware-based composition architecture.
3Illumination intensity
If display is mounted on ceiling or wall for better visibility, then patient and surgical team have better view, but user cannot quickly access bypass switch
Solution Approach 1:
The patent replaces the mechanical bypass switching mechanism with a hardware-based composer device that continuously outputs the main video signal independently of overlay status. The hardware composer device maintains a permanent, always-accessible main video output path that does not require physical switching or user intervention. This substitution allows the display to be optimally positioned for surgical team visibility while eliminating the need for quick manual bypass access.
4Loss of information
If overlay data is displayed in restricted areas, then additional patient information is visible, but important areas of main video may be hidden
Solution Approach 1:
The patent applies local quality by allowing overlay data to be displayed only in non-restricted areas of the video stream, while maintaining complete visibility of restricted areas. The hardware composer device processes spatial coordinates to identify restricted regions and prevents overlay composition in those specific locations. This ensures that critical surgical fields remain completely unobscured while still providing additional patient information in safe, non-critical regions of the display.
Data Source
AI summary
Provided are an augmentation overlay device and technique. The augmentation overlay device includes an image source configured for providing live image data of a region of interest in the form of a live image pixel stream; a data server configured for providing overlay data; and a composer device that is a hardware device with function implemented in hardware and configured for: providing display data in the form of the live image pixel stream by overlaying the provided live image data with the provided overlay data; determining a restricted area in the provided live image data, the provided overlay data including restricted area overlay data associated with the restricted area and free overlay data associated with an area outside of the restricted area; and restricting overlay with the restricted area overlay data. The augmentation overlay device includes a display device configured for receiving and displaying the provided display data.