Signal Processing Apparatus for Target Sound Detection Using Mobile Body Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In scenarios involving multiple sound sources, such as sports or plays recorded from a free viewpoint, obtaining a high-quality target sound with a high Signal-to-Noise ratio (SNR) is challenging due to complex movements of sound sources, making it difficult to isolate and record a target sound effectively.
Innovation Solution
A signal processing apparatus and method that utilize sensors and cameras attached to mobile bodies to detect time intervals of target sounds within a recording signal, integrating position, motion, and image information to distinguish and extract high-quality object sound source signals by performing signal processing techniques like sound quality correction, source separation, and noise removal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If multiple sound sources are recorded simultaneously in a free viewpoint scenario, then comprehensive sound field information is captured, but the Signal-to-Noise ratio of the target sound deteriorates due to complex movements and overlapping sounds
Solution Approach 1:
The patent segments the sound field into multiple independent sound sources by attaching identification markers to each sound source and using sound source separation processing. This allows the system to divide the mixed recording signal into individual sound source signals, enabling precise extraction of the target sound while maintaining comprehensive sound field information.
Solution Approach 2:
The patent introduces sensor signals (acceleration, angular velocity, position) as intermediary data to correlate with sound signals. By matching the temporal and spatial characteristics of sensor data with recording signals, the system can identify and extract target sound sources even in complex multi-source environments, improving Signal-to-Noise ratio without losing sound field information.
2Adaptability or versatility
If sound sources make complicated movements, then dynamic recording coverage is achieved, but the difficulty of detecting and measuring the target sound increases
Solution Approach 1:
The patent uses sensor signals from each sound source as feedback to continuously track and identify the target sound. By comparing sensor data (position, motion) with recording signals in real-time, the system can dynamically adjust to moving sound sources, maintaining accurate target sound detection even when sources make complicated movements.
Solution Approach 2:
The patent assigns unique identification characteristics (analogous to color) to each sound source through their sensor signal patterns. This allows the system to distinguish and track individual sound sources among moving targets, reducing the difficulty of detecting and measuring the target sound while preserving adaptability to various movement patterns.
3Measurement precision
If sensor signals are integrated with recording signals for time interval detection, then accurate target sound extraction is achieved, but the device complexity increases
Solution Approach 1:
The patent makes the signal processing apparatus universal by enabling it to handle multiple types of sensor signals (acceleration, angular velocity, position) and multiple sound sources simultaneously. This multi-functional design achieves accurate time interval detection through integrated processing while avoiding the need for separate specialized systems for each sensor type.
Data Source
AI summary
Provided is a signal processing apparatus which includes an interval detection unit to detect a time interval containing a sound that is emitted from a mobile body and that is included in a recording signal obtained by collecting sounds around the mobile body in a state where another mobile body is present around the mobile body, the time interval being detected on the basis of the recording signal and a sensor signal output from a sensor attached to the mobile body.