Remote Excavator Imaging for Lower Body Direction Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators of work machines, such as hydraulic excavators, face difficulties in determining the forward or backward direction due to the revolvability of the upper revolving body, which complicates image processing and increases processing load, making it challenging to recognize the machine's direction accurately.
Innovation Solution
A remote operation system that includes a support processing element to generate a combined image with superimposed index images indicating the front or back direction of the lower traveling body, using imaging devices to capture the work machine's appearance and designated components, reducing processing load and enhancing direction recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the upper revolving body is made revolvable with respect to the lower traveling body, then the work machine gains operational flexibility and adaptability, but it becomes difficult for the operator to recognize the forward or backward direction of the lower traveling body
Solution Approach 1:
An index image is introduced as an intermediary visual element that is superimposed on the captured image. This index image contains directional information (such as arrow indicators) that mediates between the complex revolving mechanism and the operator's need for simple direction recognition, solving the information loss problem without restricting mechanical flexibility
Solution Approach 2:
The index image uses visual indicators (such as colored arrows or highlighted elements) that change or stand out against the background image to clearly indicate the forward and backward directions. This visual differentiation helps operators quickly grasp directional information without being confused by the revolving body's movement
2Measurement precision
If image processing is performed to estimate the relative angle of the lower traveling body, then direction information can be obtained, but the processing load increases significantly
Solution Approach 1:
Directional information is pre-calculated and embedded in the index image generation process rather than performing complex real-time image processing to estimate angles. The system uses pre-established relationships between camera positions and machine geometry to directly generate directional indicators, reducing computational load while maintaining accuracy
Solution Approach 2:
Instead of processing the original captured image to extract directional information, the system creates a simplified copy or overlay (the index image) that directly represents directional data. This index image is generated using simpler calculations based on known geometric relationships, avoiding the need for complex image analysis
Data Source
Figure 1
Figure 2
Figure 3
AI summary
To provide a remote operation system that makes it possible to reduce a processing load and indicate a front or back direction of a lower traveling body of a work machine in a simple configuration. The remote operation system has respective mutual communication functions of communicating with a work machine (40) and a remote operation apparatus (20). The work machine (40) includes a lower traveling body (430) and an upper revolving body (450). The upper revolving body (450) is revolvable with respect to the lower traveling body (430). The remote operation apparatus (20) is for remotely operating the work machine (40). The remote operation system includes a support processing element (101) configured to transmit, to the remote operation apparatus (20), a combined image in which an index image is superimposed at least partially on the work machine (40) or a region around the work machine (40) in a captured image obtained through an imaging device disposed around the work machine. The index image is generated based on a mode of appearance of the lower traveling body (430) in the captured image and a mode of appearance of a designated component in the captured image. The designated component is unevenly disposed in a front or back direction of the lower traveling body (430). The index image indicates at least one of the front and back directions of the lower traveling body (430).