Remote Display System for Work Site Perspective Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote operation of work machines faces challenges in effectively perceiving the perspective of a work site due to communication delays and limited line capacity, which hinders smooth operation and efficiency.
Innovation Solution
A display system that acquires images from multiple cameras, calculates the viewpoint position of the worker, and adjusts the luminance of these images to combine and display them effectively, allowing the worker to perceive the site's perspective even with limited bandwidth.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If images from a large number of cameras corresponding to a large number of viewpoints are sent to a display device at a remote place, then the worker can perceive the perspective, but it is difficult to secure a line capacity for sending a large-capacity images from a large number of cameras
Solution Approach 1:
The patent segments the multiple camera images into two groups: a first image from a first camera and a second image from a second camera. Instead of transmitting all camera images equally, only these two segmented images are transmitted to the remote display device, reducing the total data volume while maintaining perspective perception capability.
Solution Approach 2:
The patent applies different luminance characteristics to different regions of the transmitted images. The luminance adjustment unit adjusts the luminance of the first image and/or second image based on the detected head position, creating local quality variations that guide the worker's attention to relevant perspective information while reducing overall data transmission requirements.
2Loss of information
If the viewpoint of the image displayed on the display device moves in conjunction with the head of the worker, then the worker can perceive the perspective by motion stereoscopic vision, but it is difficult to present the motion parallax correctly due to communication delay
Solution Approach 1:
The patent implements preliminary action by pre-adjusting the luminance of the first and second images based on the currently detected head position before transmission. This allows the system to anticipate and prepare the appropriate image characteristics in advance, reducing the impact of communication delays on motion parallax accuracy.
Solution Approach 2:
The patent employs feedback by continuously detecting the head position of the worker and using this information to dynamically adjust the luminance of the transmitted images. This closed-loop feedback mechanism ensures that the displayed images consistently match the worker's current viewpoint, maintaining accurate motion parallax perception despite communication delays.
Data Source
AI summary
A display system includes: an image acquisition unit that acquires each of a first image of a work site imaged by a first camera and a second image of the work site imaged by a second camera; a viewpoint position calculation unit that calculates a viewpoint position of worker; a luminance adjustment unit that adjusts luminance of at least one of the first image and the second image based on the viewpoint position; and a display control unit that combines the first image and the second image having the luminance adjusted and causes a display device to display the combined image.