Display Control Device for Work Machine Bucket Teeth Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote operation of work machines like loading excavators and wheel loaders, the teeth position image of the bucket can be obscured by shadows, making it difficult for operators to visually recognize the projected position on the construction target.
Innovation Solution
A display control device that acquires images, posture information, and topographical data to generate a projected image of the bucket's teeth, superimposing it on the captured image where the work equipment appears, allowing for clear visualization of the teeth position, including shadowed areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the teeth position image is projected on the excavation surface of the construction target, then the operator can grasp the positional relationship between the bucket and the construction target, but a part or the entirety of the projected position becomes a shadow of the bucket, making it difficult for the operator to visually recognize the teeth position image
Solution Approach 1:
The patent transitions from two-dimensional image projection on the excavation surface to three-dimensional virtual model rendering that incorporates depth information and shadow analysis. By building a 3D virtual model of the construction target and using ray-tracing techniques to determine shadow regions, the system can display teeth position information in multiple dimensions, allowing operators to view tooth positions from different angles and avoid shadowed areas.
Solution Approach 2:
The patent introduces a virtual model as an intermediary between the actual bucket teeth and the operator's visual perception. Instead of directly projecting images onto the physical excavation surface where shadows interfere, the system creates a virtual representation that can be manipulated and viewed from multiple perspectives, with shadow regions identified and compensated for through the virtual environment.
2Measurement precision
If the teeth position image is projected on the excavation surface, then the operator can grasp the positional relationship, but the projected position is obscured by the bucket shadow, reducing recognition accuracy
Solution Approach 1:
The system performs preliminary analysis by constructing a 3D virtual model of the construction target and pre-calculating shadow regions using ray-tracing techniques before displaying teeth position information. By identifying shadowed areas in advance, the system can proactively adjust the display strategy, such as highlighting tooth positions in non-shadowed areas or providing alternative viewing angles, thereby maintaining recognition accuracy despite shadow interference.
Solution Approach 2:
The system incorporates feedback mechanisms by continuously monitoring the virtual model's shadow regions and adjusting the teeth position display accordingly. When shadowed areas are detected, the system provides feedback to the operator through alternative visual representations or by suggesting optimal viewing angles, ensuring that teeth position information remains accurately recognizable regardless of shadow conditions.
Data Source
AI summary
A captured image acquisition unit acquires an image captured by an imaging device provided at a place of a work machine where a bucket is included in an imaging range. A posture acquisition unit acquires posture information of the bucket. A topography acquisition unit acquires topographical information indicating a three-dimensional shape of a construction target of the work machine. A projected image generation unit generates, based on the posture information of the bucket and the topographical information, a projected image obtained by projecting teeth of the bucket on the construction target. A display control unit outputs a display signal for displaying by superimposing the projected image on a place where at least the bucket appears, in the captured image.