Construction Machine Display System for Remote Operation Perspective
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators remotely controlling construction machines face difficulties in perceiving the perspective of the work site, leading to challenges in measuring distances and lowering workability due to the display of two-dimensional images.
Innovation Solution
A display system that generates a combined image by overlapping virtual viewpoint images of the construction machine and objects with real images captured by an image capture device, using detection data from distance and posture detection devices to provide a three-dimensional perspective.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a two-dimensional image is displayed in the display device, then the system complexity is reduced, but the operator cannot obtain perspective sensation of the work place
Solution Approach 1:
The patent applies dimensionality change by generating a three-dimensional object image from two-dimensional distance detection data and combining it with the two-dimensional real image. This creates a composite display that provides perspective sensation (adding spatial dimension information) while maintaining system simplicity by using existing detection devices rather than complex 3D imaging systems.
2Device complexity
If a two-dimensional image is displayed in the display device, then the device complexity is reduced, but the operator is hard to measure distance between the construction machine and objects
Solution Approach 1:
The patent uses the generated object image as an intermediary that bridges the gap between simple 2D display and accurate distance measurement. The object image, created from distance detection data, serves as a visual mediator that helps the operator perceive and measure distances without requiring complex measurement instruments or advanced display systems.
3Device complexity
If only real images captured by image capture device are displayed, then the system complexity is reduced, but the workability of remote operation is lowered
Solution Approach 1:
The patent merges the real image captured by the image capture device with the generated object image based on distance detection data. This combination provides both the visual realism of captured images and the perspective/distance information of the generated object image, thereby improving remote operation workability while maintaining relatively simple system architecture.
Data Source
AI summary
A display device has a display screen that displays a real image captured by an image capture device mounted in a construction machine which includes working equipment, and a combined image obtained by overlapping an object image indicating a virtual viewpoint image of an object around the construction machine viewed from a virtual viewpoint of an outside of the construction machine and a construction machine image indicating a virtual viewpoint image of the construction machine viewed from the virtual viewpoint, wherein the display device displays the combined image simultaneously with the real image in a partial region of the real image displayed in the display screen.