Display Controller Region of Interest Pre-Extraction Remote Support
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote support systems, when the operation object moves out of the camera's angle of view, it becomes difficult for assistants to monitor and support the operator, as the image may become blurred or the object may disappear from view.
Innovation Solution
An information processing apparatus that displays a captured image from an imaging device, featuring a display controller that shows the region of interest within the captured image. If the region of interest is within the frame, it displays the image as is. If it moves out of the frame, it displays the image from the preceding frame, ensuring continuous visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If real-time captured image is displayed on monitor, then assistant can grasp operation state, but operation object cannot be checked when it moves out of camera angle of view
Solution Approach 1:
The system performs preliminary action by extracting and storing the region of interest from each frame in advance. When the operation object moves out of the current frame, the pre-extracted ROI from the preceding frame is displayed, ensuring continuous visibility without complex real-time tracking computations.
Solution Approach 2:
The patent extracts the region of interest (operation object) from the captured image frame and displays it separately. This extraction allows the ROI to be displayed even when it moves out of the main frame, as the extracted region can be shown in a dedicated display area independent of the current camera view.
2Ease of operation
If camera follows operator head movement, then image capturing is hands-free, but captured image becomes blurred and operation object disappears from view
Solution Approach 1:
The system performs preliminary extraction of the region of interest from each captured frame and stores it. This allows the display to show the pre-extracted ROI from the preceding frame when the operation object moves out of view, maintaining image stability without requiring the camera to be stationary.
Solution Approach 2:
The patent introduces an intermediary processing step where the region of interest is extracted and stored as a intermediate representation. This intermediary allows the system to decouple the camera's hands-free operation from the stability of the displayed image, as the extracted ROI can be displayed independently of current camera movements.
3Reliability
If region of interest is extracted and displayed, then visibility is improved, but processing time increases when object moves out of frame
Solution Approach 1:
The system extracts and stores the region of interest from each frame in advance (preliminary action). When the operation object moves out of the current frame, the display controller can immediately show the pre-extracted ROI from the preceding frame without requiring real-time extraction, thus maintaining continuous visibility with minimal processing delay.
Data Source
AI summary
An information processing apparatus that displays a captured image captured by an imaging apparatus on a display unit, the information processing apparatus includes a display controller configured to perform display control to display an image of a region of interest included in the captured image, on the display unit, wherein, the display controller displays, in a case where the region of interest is in an angle of view of a frame of the captured image, the image of the region of interest included in the frame, and displays, in a case where the region of interest is off from the angle of view of the frame of the captured image, the image of the region of interest included in a preceding frame preceding the frame.