Endoscopic Candidate Area Display Guided by Model Suitability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing endoscopic systems lack the ability to reliably display detection results of lesion areas considering the suitability of the detection models used, leading to inconsistent and potentially unreliable outcomes.
Innovation Solution
An image processing device that evaluates the suitability of detection models for detecting lesion areas and displays candidate area information based on the evaluation results, using a display mode determined by the model's reliability, superimposing the information onto the captured image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a learned model is used to detect lesion areas from endoscopic images, then detection capability is provided, but the reliability of detection results varies depending on model suitability without indication to users
Solution Approach 1:
The system introduces feedback by evaluating the suitability of detection models for each captured image and providing this evaluation information back to the user through the display. The suitability evaluation unit assesses how appropriate each detection model is for the current image, and this information is fed back to guide the display control, ensuring users are informed about the reliability of detection results.
Solution Approach 2:
The invention introduces an intermediary element - the suitability evaluation information - that mediates between the detection model output and the final display. This intermediary provides additional context about model suitability, allowing the system to convey reliability information without directly altering the detection results themselves.
2Reliability
If detection results are displayed without considering model suitability, then display simplicity is maintained, but detection reliability cannot be properly communicated to users
Solution Approach 1:
The system applies local quality by providing different levels of information presentation based on local conditions - specifically, the suitability evaluation results for each detection model. The display control unit adjusts the presentation of candidate area information based on the locally determined model suitability for each specific image, rather than applying a uniform approach throughout.
3Measurement precision
If multiple detection models are evaluated and results displayed according to suitability, then detection accuracy improves, but processing time and system complexity increase
Solution Approach 1:
The system performs preliminary action by evaluating the suitability of detection models before displaying the final detection results. The suitability evaluation is conducted in advance to determine which detection models are appropriate for the current image, allowing the display control to efficiently present only the relevant candidate areas without unnecessary processing delays during the display phase.
Data Source
AI summary
The image processing device 1X includes a detection model evaluation means 31X and a display control means 33X. The detection model evaluation means 31X is configured to perform an evaluation on suitability of a detection model for detecting an attention area to be noted based on a captured image Ic in which an inspection target is photographed by a photographing unit provided in an endoscope. The display control means 33X is configured to display candidate area information according to a display mode determined based on a result of the evaluation, the candidate area information indicating one or more candidate areas that are one or more candidates of the attention area, the candidate areas being detected by one or more detection models included in detection model(s) subjected to the evaluation, the candidate area information being superimposed on the captured image Ic which is displayed by a display device 2X.