Remote Operator Display Layout for Gaze-Priority Delay Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing delay compensation techniques for remote operation of vehicles do not effectively address the issue of overlapping and hidden information when multiple images from different cameras are displayed, leading to reduced visibility and potential discomfort for the remote operator.
Innovation Solution
A remote operator terminal that applies homography processes to images captured by multiple cameras, prioritizes and magnifies images based on the operator's gaze direction, and adjusts image sizes to ensure clear visibility and reduce discomfort.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If homography is performed for each of the plurality of images and then a plurality of transformed images are displayed side-by-side, then delay compensation is achieved, but an overlap between adjacent transformed images occurs causing information to be hidden
Solution Approach 1:
The patent applies different processing to different regions of the display screen. The center region displays the priority image (corresponding to gaze direction) with higher quality and larger size, while peripheral regions display other images with adjusted sizes to prevent overlap. This local differentiation resolves the contradiction by ensuring the most important information is fully visible while still providing delay compensation for all images.
2Quantity of substance
If multiple transformed images are displayed side-by-side, then comprehensive visual information is provided, but overlap between adjacent images reduces the information that can be viewed
Solution Approach 1:
The patent dynamically adjusts the display size and position of each image based on the operator's gaze direction. The priority image corresponding to the gaze direction is displayed at a larger size in the center region, while other images are displayed at smaller sizes in peripheral regions. This dynamic adjustment ensures that the quantity of visual information is maximized without causing overlap that would hide information.
3Loss of information
If images are displayed without size adjustment, then all images are visible, but operator discomfort increases due to overlaps and gaps
Solution Approach 1:
The patent applies different display parameters to different images based on their importance and position. The priority image in the center region is displayed with optimal size and quality, while peripheral images are displayed with adjusted sizes. This local quality differentiation eliminates overlaps and gaps that cause discomfort, while ensuring all images remain visible and useful.
Data Source
AI summary
A remote operator terminal is used by a remote operator for a remote operation of a moving body. A first image is captured at a first timing by a camera mounted on the moving body from a first point of view. A second point of view is one at a second timing later than the first timing. A homography process converts the first image viewed from the first point of view into a second image viewed from the second point of view. The remote operator terminal acquires a plurality of second images by applying the homography process to a plurality of first images, respectively. The remote operator system displays the plurality of second images side-by-side on a display such that a priority second image corresponding to a gaze direction of the remote operator appears to be in front of the other second images.