Remote Excavator Operation Using Spatial Audio Motion Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote operators of working machines, such as hydraulic excavators, experience decreased control accuracy and efficiency due to a lower perception of the revolving motion when using remote operation devices compared to being on the machine.
Innovation Solution
A remote operation assistance device that includes a state detection element and a point sound source control element, which detects the motion state of the working machine and controls sound output devices to displace a virtual point sound source along a specified path, simulating the relative motion of the machine's components, thereby enhancing the operator's perception of the motion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If remote operation is performed using a remote operation device, then the operator can operate the working machine from a distance, but the perception of motion aspect (specifically revolving motion) is reduced compared to being on the machine
Solution Approach 1:
The patent introduces sound output devices as an intermediary to transmit motion information from the working machine to the remote operator. The sound output devices convert mechanical motion into acoustic signals that convey the motion aspect of the upper revolving body, serving as a mediator that bridges the information gap between the machine and the remote operator.
Solution Approach 2:
The patent replaces direct mechanical perception (being physically on the machine to feel motion) with an acoustic field-based system. Sound output devices generate sound waves that encode motion information, substituting the mechanical vibration and motion feedback that would normally be perceived through direct contact with the machine.
2Device complexity
If remote operation is performed without motion feedback, then device complexity is reduced, but control accuracy of the upper revolving body position decreases
Solution Approach 1:
The patent implements a feedback mechanism where sound output devices provide real-time acoustic feedback about the motion state of the working machine to the remote operator. This feedback loop allows the operator to perceive the actual motion and position changes of the upper revolving body, enabling more accurate control decisions without requiring complex mechanical feedback systems.
Data Source
AI summary
There is provided a device or the like capable of causing a result of an operator, remotely operating a working machine, perceiving a motion aspect of the working machine to approximate to a result of the operator perceiving a motion aspect of the working machine when the operator gets on the working machine. When there is represented a relative motion of a first component (lower traveling body 410, upper revolving body 420) and a second component (upper revolving body 420, bucket 445 (working unit)) that constitute working machine 40, based on a result of detecting an operation aspect of a remote operation device 20, control is performed on individual sound output aspects of a plurality of sound output devices 2220, 2221 and 2222, each arranged at different locations in a remote operation space for the operator who operates the remote operation device 20.