Spatial Audio Assistance for Remote Working Machine Motion Perception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote operators of working machines, such as hydraulic excavators, experience decreased control accuracy and efficiency due to a lower perception of revolving motion when operating remotely compared to being on the machine.
Innovation Solution
A remote operation assistance device that includes a state detection element and a point sound source control element, which detects the motion state of the working machine and controls sound output devices to displace a virtual point sound source along a specified position path, simulating the relative motion of the machine's components, thereby enhancing the operator's perception of the machine's motion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If remote operation is used, then operator safety and accessibility are improved, but the perception of motion aspects deteriorates
Solution Approach 1:
The patent introduces sound output devices as an intermediary between the working machine's motion and the remote operator's perception. Multiple speakers distributed in the remote operation space reproduce motion-related sounds, serving as a mediator that transmits tactile feedback from the machine to the operator's auditory system, thereby compensating for the lack of direct physical contact with the machine.
Solution Approach 2:
The patent divides the sound reproduction system into multiple independent sound output devices (speakers) positioned at different locations in the remote operation space. Each speaker handles specific spatial audio information, allowing the operator to perceive the direction and movement of sound sources corresponding to different parts of the machine, thus segmenting the complex motion perception into manageable spatial components.
2Reliability
If remote operation is used, then operator safety is improved, but control accuracy deteriorates
Solution Approach 1:
The patent implements an auditory feedback system where motion-related sounds from the working machine are reproduced in real-time through multiple speakers. This feedback loop allows the operator to hear the machine's responses to their control inputs, such as the sound of the upper revolving body moving relative to the lower traveling body, enabling more precise control adjustments and improving overall control accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution allows remote operators to perceive the motion aspects of the working machine more accurately, approximating the experience of being on the machine, thereby improving control accuracy and operational efficiency.
Implementation Method 1
control individual sound output aspects of a plurality of sound output devices to displace a virtual point sound source along a specified position path
Data Source
Figure 1
Figure 2
Figure 3
AI summary
There is provided a device or the like capable of causing a result of an operator, remotely operating a working machine, perceiving a motion aspect of the working machine to approximate to a result of the operator perceiving a motion aspect of the working machine when the operator gets on the working machine. When there is represented a relative motion of a first component (lower traveling body 410, upper revolving body 420) and a second component (upper revolving body 420, bucket 445 (working unit)) that constitute working machine 40, based on a result of detecting an operation aspect of a remote operation device 20, control is performed on individual sound output aspects of a plurality of sound output devices 2220, 2221 and 2222, each arranged at different locations in a remote operation space for the operator who operates the remote operation device 20.