Endoscope System Overlooking Detection with Dual-Screen Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In medical image processing systems, particularly in endoscope systems, there is a risk of overlooking a target of interest within a region of interest due to high movement speed, hiding behind folds, or being displayed at the edge of the screen, leading to temporary disappearance from the user's view.
Innovation Solution
A medical image processing system with an image acquisition unit, region-of-interest detection unit, overlooking determination unit, display unit, and overlooking notification control unit, which includes a second screen for displaying the region of interest and a gaze detection unit to determine user attention, ensuring the target of interest is not overlooked by providing alerts and notifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the endoscope moves at high speed to improve productivity, then examination efficiency is improved, but the target of interest may be displayed only momentarily and disappear from the screen, increasing the risk of overlooking
Solution Approach 1:
The system performs preliminary detection of the region of interest using image recognition before the user fully observes it. The detection result is prepared and held ready, allowing the system to notify the user in advance or provide confirmation mechanisms, thus preventing overlooking even when the target disappears quickly due to high movement speed
Solution Approach 2:
The system provides feedback to the user through multiple channels including visual display of the detected region, audible notifications, and haptic feedback. This multi-modal feedback ensures the user is alerted to the target of interest even when it is displayed only momentarily, resolving the contradiction between high-speed examination and reliable detection
2Area of stationary object
If the target of interest is hidden behind folds or displayed at the edge of the screen, then the display area is optimized, but the user may overlook the target as it temporarily disappears from view
Solution Approach 1:
The system performs preliminary detection and marking of the region of interest before the user completes their observation. The detected region is highlighted or marked on the display, ensuring that even if the target moves to the edge or behind folds, the user receives advance notice and can confirm the detection, preventing overlooking
Solution Approach 2:
The system provides continuous feedback through visual markers on the displayed image, audible alerts, and confirmation prompts. This feedback mechanism ensures the user is notified of the target's location even when it is partially obscured or at the screen edge, maintaining detection reliability while preserving full display area
3Reliability
If multiple notification methods (sound, message, icon, pop-up) are used to improve reliability, then the user is more likely to notice the target, but the device complexity increases
Solution Approach 1:
The system merges multiple notification functions (visual display, audible notification, haptic feedback) into an integrated notification module. This unified approach provides multi-modal notification for improved reliability while avoiding the complexity of separate independent systems, as the functions are coordinated through a single control mechanism
Solution Approach 2:
The notification system is designed with multi-functionality, where a single notification module can operate in multiple modes (visual only, audible only, or combined). This universal design allows the system to adapt to different situations and provide appropriate notification levels, improving reliability without requiring separate dedicated systems for each notification type
Data Source
AI summary
A region-of-interest detection unit detects the region of interest including the target of interest among an observation target, from the medical image. An overlooking determination unit determines whether a user overlooks the target of interest. A monitor includes a first screen which displays a video of the medical image and displays the region of interest, and a second screen which is a screen different from the first screen and displays the region of interest. An overlooking notification control unit performs a control of an overlooking occurrence notification in a case where it is determined that the target of interest is overlooked.