Drone Camera Control for Crane Blind-Area Tool Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing material handling and construction machines, such as cranes and excavators, face visibility issues during operations where the work tool is obstructed, leading to operators working blind and relying on external instructions, with existing camera systems providing limited assistance.
Innovation Solution
Employing a remote-controlled aerial drone equipped with imaging sensors to provide a machine operator with a three-dimensional perspective of the work tool and its surroundings from various angles, allowing for improved visualization and control, and enabling autonomous or manual control based on machine movements and environmental constraints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a downward-facing camera is mounted on the crane to provide images of the load hook, then the operator can see the load hook position, but the operator cannot obtain accurate height information and three-dimensional perspective for visualizing the work tool relative to its surroundings
Solution Approach 1:
The patent transitions from a single downward-facing camera view to a multi-dimensional imaging system. It uses at least two imaging sensors (including side-facing and upward-facing cameras) to capture images from different spatial dimensions, enabling the operator to see the load hook's position, height, and three-dimensional orientation relative to the surroundings, thereby resolving the limitation of height measurement and spatial visualization.
2Extent of automation
If a camera is mounted on the trolley looking down at the load hook, then automated image analysis can determine load hook position, but the operator cannot visualize the work tool and surroundings from an external observer's perspective
Solution Approach 1:
The patent merges automated image analysis functionality with enhanced operator visualization capabilities. While the system maintains automated determination of load hook position through image analysis, it simultaneously provides the operator with multi-angle camera views (downward, side, and upward-facing sensors) that deliver an external observer's perspective, allowing the operator to visually confirm and understand the work tool's position and orientation in three-dimensional space.
3Adaptability or versatility
If the operator relies on instructions from a signalman due to obstructed visibility, then the operator can control the work tool in blind areas, but the operator loses direct visual feedback and control precision
Solution Approach 1:
The patent introduces a multi-camera imaging system as an intermediary between the operator and the obstructed work area. Instead of relying on verbal instructions from a signalman, the operator receives real-time visual feedback through multiple camera angles transmitted to the control station. This intermediary visual information system enables direct observation and precise control of the work tool in previously blind areas, eliminating the need for external human instruction while maintaining or improving control precision.
Data Source
Figure 1
AI summary
The invention generally relates to the control of material handling machines and/or construction machines with the aid of a camera. In particular, the invention relates to a method and a device for controlling a material handling machine and/or construction machine in particular in the form of a crane, a bagger, or a crawler, wherein a machine operator and/or a machine controller (5) is provided with an image of the working tool by an imaging sensor (10). The invention further relates to a material handling machine and/or construction machine, in particular a crane, comprising a display device for displaying an image of the working tool and/or the working tool surroundings. According to the invention, a remote-controlled drone (9) equipped with at least one imaging sensor (10) is used, wherein the desired image of the working tool and/or the tool surroundings can be provided from different viewing directions by means of the drone.