Excavator Control Using Camera-Based Intentional Operation Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for preventing erroneous operations in work machines, such as excavators, face challenges in accurately detecting unintentional operations due to variations in operator handling and the time required to release hydraulic locking mechanisms, leading to reduced operability during normal operations.
Innovation Solution
A system incorporating a camera and controller that captures images of the operating member and uses image recognition technology, including artificial intelligence, to differentiate between intentional and unintentional operations, allowing for immediate validation or execution of the operator's actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a tactile sensor is mounted on the operating member to detect holding by the operator, then erroneous operation prevention is enabled, but the detection accuracy varies depending on operator's handling method
Solution Approach 1:
The patent replaces the mechanical tactile sensor system with an optical imaging system. A camera captures images of the operating member, and image processing algorithms analyze whether the operator is properly holding it. This substitution eliminates the variability of tactile sensor responses to different handling methods while maintaining reliable detection through visual recognition of proper grip patterns.
2Reliability
If the controller determines whether pressure continues for a predetermined time, then erroneous operation is prevented, but it takes time to release the hydraulic locking mechanism
Solution Approach 1:
The system performs preliminary verification by capturing images and analyzing the operator's holding status in real-time before allowing operation. The image processing continuously monitors the operating member, and when proper holding is detected, the hydraulic locking mechanism is immediately released without requiring a predetermined time delay. This preliminary visual verification enables both safety and speed.
3Measurement precision
If image recognition technology is used to detect intentional operation, then detection accuracy is improved, but system complexity increases
Solution Approach 1:
The camera system serves multiple functions: it captures images for operation verification, provides visual records for safety monitoring, and can potentially detect operator fatigue or improper positioning. By making the imaging system multi-functional, the patent justifies the added complexity through enhanced versatility and value, where a single component performs several critical safety and operational roles.
Data Source
AI summary
A camera captures an image of a region including at least a portion of an operating member and generates image data indicative of the image. A controller acquires the image data from the camera. The controller determines whether an operation of the operating member by an operator is an intentional operation or an unintentional operation based on the image. When the operation of the operating member by the operator is determined to be the intentional operation, the controller controls a work machine according to the operation of the operating member. When the operation of the operating member by the operator is determined to be the unintentional operation, the controller invalidates the operation of the operating member.