Work Machine Display Overlay for Visual Sound Source Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to visually display the source of sound in the surroundings of a work machine, limiting safety improvements when providing information to operators.
Innovation Solution
A display device that superimposes sound generation situations around a work machine on captured image information, allowing operators to recognize sound sources visually.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If sound information is provided to the operator, then operator safety is improved, but the operator cannot visually identify sound sources in the surrounding environment
Solution Approach 1:
The patent combines audio information from multiple sound collectors with visual image information from an imaging device to create a composite display. The sound generation situation is superimposed on the captured image, merging auditory and visual channels so that operators can simultaneously hear sounds and see their spatial locations, resolving the contradiction between providing sound information and enabling visual identification.
Solution Approach 2:
The display device acts as an intermediary between the sound collectors and the operator. It receives acoustic signals from multiple sound collectors, processes them to determine sound generation situations, and presents both audio and visual information through the imaging device. This intermediary function enables operators to visually identify sound sources while maintaining audio awareness.
2Measurement precision
If multiple sound collectors are used to acquire sound information, then sound source detection accuracy is improved, but device complexity increases
Solution Approach 1:
The patent divides the sound detection function into multiple independent sound collectors distributed around the work machine. Each sound collector captures local sound information, and the controller integrates these segmented measurements to determine the overall sound generation situation. This segmentation enables accurate sound source detection while maintaining modular system architecture.
Solution Approach 2:
The sound collectors serve multiple functions: they detect sound sources, determine sound directions, and provide audio feedback to the operator. The same hardware components contribute to both spatial localization and auditory awareness, reducing the need for separate specialized systems and thereby managing device complexity while improving detection accuracy.
Data Source
AI summary
A display device for use in a work machine is provided. The display device includes a controller circuit configured to: acquire image information captured by an imaging device provided in the work machine; acquire information about a sound signal acquired by each of a plurality of sound collectors provided in the work machine; and display on a display section a sound generation situation around the work machine obtained based on the information about the sound signal acquired from each of the plurality of sound collectors, the sound generation situation being superimposed on the image information.