Endoscope Image Overlay for Stable ROI Labels and Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing medical image processing systems struggle to appropriately display recognition results of regions of interest, such as organs or blood vessels, due to interference with the user's observation, especially when the user operates the medical apparatus with both hands.
Innovation Solution
A medical image processing apparatus that includes a processor to sequentially acquire time-series medical images, recognize regions of interest, and control the display of position and type information, adjusting the position of position information with changes in the region of interest while maintaining the position of type information, thereby minimizing interference with the user's observation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the display position of type information is changed in accordance with the position of the region of interest, then the position information is displayed correctly, but the type information becomes difficult to recognize due to large position changes
Solution Approach 1:
The patent segments the information display into two independent parts: position information (coordinates) that moves with the region of interest, and type information (label) that remains at a fixed position. This segmentation allows each type of information to be optimized independently - position accuracy is maintained through dynamic positioning while type information visibility is preserved through static positioning.
Solution Approach 2:
The patent applies different display strategies to different types of information based on their local requirements. Position information requires dynamic positioning to maintain spatial accuracy, while type information requires static positioning to maintain readability. This local quality differentiation resolves the contradiction by allowing each information type to be displayed according to its specific needs.
2Loss of information
If the display position of position information is maintained regardless of region of interest position changes, then the type information remains visible, but the position information fails to display the region of interest correctly
Solution Approach 1:
The patent segments the information display into two independent parts: position information (coordinates) that moves with the region of interest, and type information (label) that remains at a fixed position. This segmentation allows each type of information to be optimized independently - position accuracy is maintained through dynamic positioning while type information visibility is preserved through static positioning.
3Ease of operation
If the recognition result is displayed on the screen, then the user is assisted in observation, but the display may interfere with the user's observation when operating with both hands
Solution Approach 1:
The patent extracts the type information from the region of interest position and places it at a fixed position away from the anatomical structures. This extraction removes the potential interference caused by moving text labels while preserving the assistive function of displaying recognition results. The position information remains near the region of interest to maintain spatial context without causing interference.
Data Source
AI summary
A medical image processing apparatus includes a processor configured to execute an image acquisition process for sequentially acquiring time-series medical images; a region-of-interest recognition process for recognizing a position and a type of a region of interest from the medical images; and a display control process for causing a display device to display position information indicating the position of the region of interest and type information indicating the type of the region of interest such that the position information and the type information are superimposed on the medical images. In the display control process, the processor changes a position at which the position information is to be displayed according to a change in the position of the region of interest over time, and maintains a position at which the type information is to be displayed regardless of a change in the position of the region of interest over time.