Shovel Assistance Control for Real-Time Feature Collision Avoidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Operators of construction machines, such as shovels, cannot accurately determine the presence or absence of predetermined features around the shovel based on displayed three-dimensional computer graphics, and features may change unexpectedly at the construction site.
Innovation Solution
An assisting device for construction machines that includes sensors and a control system to provide real-time feedback on the location of features relative to the shovel, using sensors like cameras, LIDAR, and GNSS, and displays this information on onboard displays to guide operators.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a three-dimensional CG image of the shovel on design data is displayed, then the operator can visualize the construction site layout, but the operator cannot accurately determine the presence or absence of features around the shovel
Solution Approach 1:
The system captures images with a camera, detects features using image recognition, and feeds back the detected feature information to the display. This closed-loop feedback mechanism allows the display to show not only the CG shovel model but also actual detected features like power lines and buildings, resolving the contradiction between visualizing layout and accurately detecting features.
Solution Approach 2:
The patent introduces an image recognition system as an intermediary between the physical construction site and the display system. The image recognition device processes camera images to identify features, serving as a mediator that bridges the gap between visual display capabilities and accurate feature detection, thereby solving the information accuracy problem.
2Reliability
If the operator relies on pre-known feature locations, then operations can be planned, but feature locations may change unexpectedly at the construction site
Solution Approach 1:
The system performs preliminary image capture and feature detection before construction operations begin. By detecting features in advance and displaying them on the screen along with the CG model, the system prepares the operator with accurate, up-to-date feature location information, allowing operations to be planned based on actual site conditions rather than assumed locations.
Solution Approach 2:
The system dynamically updates feature detection results by capturing images and re-detecting features at different positions and times. This dynamic adaptation allows the system to track changes in feature locations (such as newly installed power lines or moved buildings) and reflect these changes in real-time on the display, maintaining reliability while adapting to site changes.
3Measurement precision
If sensors and image recognition systems are added to detect features, then feature location accuracy improves, but device complexity increases
Solution Approach 1:
The system uses a camera, which is a universal device already commonly found in construction equipment, to capture images for feature detection. The same camera can serve multiple purposes including safety monitoring, operation recording, and feature detection. This multi-functionality approach improves measurement precision without significantly increasing device complexity, as the camera serves multiple roles within the existing system.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A shovel assisting device (50) for supporting work performed by a shovel (100) provided with a feature data acquiring part (506) configured to, based on an output from a space recognition device (S6), acquire feature data which is data concerning a position of a predetermined feature existing at a construction site; and a combined data generating part (507) configured to, based on the feature data, associate position information with respect to a construction site with data concerning the position of the feature. The shovel assisting device (50) may be provided with a contact avoiding control part (508) configured to execute control for avoiding contact between the predetermined feature and the shovel (100) based on the combined data.