Remote Work Machine View Overlay for Spatial Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators remotely controlling work machines face challenges in spatial recognition due to objects not being visible in captured images, leading to difficulty in recognizing the position and azimuth of the upper rotating body.
Innovation Solution
A remote operation support system that superimposes an index image corresponding to an index member in the operator's room onto a captured image, allowing the operator to use it as a reference for spatial recognition, with adjustable transparency and size to maintain visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a captured image from an imaging device is displayed for remote operation, then the operator can see the environment around the work machine, but spatial recognition accuracy deteriorates because reference objects (index members) are not visible in the captured image
Solution Approach 1:
The patent combines the captured image from the imaging device with a generated index image representing index members (reference objects) into a single composite display. This merging provides both the environmental view and spatial reference information simultaneously, resolving the contradiction between seeing the environment and maintaining spatial recognition accuracy.
Solution Approach 2:
The generated index image acts as an intermediary element that bridges the gap between the captured image and the operator's spatial understanding. By superimposing virtual index members onto the captured image, the system provides reference points that help the operator recognize positions and orientations without altering the original captured scene.
2Measurement precision
If an index image is superimposed on the captured image to improve spatial recognition, then spatial recognition accuracy improves, but visibility of the captured image deteriorates due to the overlay
Solution Approach 1:
The patent applies different transparency qualities to different regions of the index image. The index members are displayed with semi-transparent or transparent properties in regions where they overlap with important visual information in the captured image, allowing the underlying captured image to remain visible while still providing spatial reference.
Solution Approach 2:
The generated index image uses distinct color representations that differentiate it from the captured image while maintaining visibility. By using specific colors or color schemes for the index members, the system ensures they are recognizable as reference elements without completely obscuring the captured scene underneath.
Data Source
AI summary
A remote operation support system and method that can improve spatial recognition accuracy by an operator who remotely operates work machine is provided. A captured image representing a sight around work machine (40) is captured by an imaging device (412b) mounted on the work machine (40). A synthetic image is generated by superimposing an index image representing an index member positioned in a cab (454) (operator's room) of the work machine (40) in a pseudo manner on the captured image. The synthetic image is displayed on a remote output interface (220) of a remote operation device (20) that allows remote operation of the work machine (40).