Distributed Speech Detection for Multi-Device Attention Targeting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In environments with multiple smart devices, determining the focus of a user's attention and which device a command is directed at is challenging due to the difficulty in distinguishing between microphone signals from different devices.
Innovation Solution
The system uses smart devices with microphones to analyze the frequency-dependent nature of human speech propagation to determine the user's orientation and focus of attention by comparing power levels in multiple frequency bands, utilizing spectral characteristics and neural networks for precise orientation estimation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple smart devices are deployed in an environment, then the coverage and functionality of the smart system is improved, but the difficulty of determining user focus of attention increases
Solution Approach 1:
The system divides the audio spectrum into multiple frequency bands and analyzes spectral characteristics in each band separately. By segmenting the frequency spectrum and comparing power levels across bands, the system can determine user orientation and focus of attention even in environments with multiple smart devices.
Solution Approach 2:
The system transitions from analyzing single-dimensional audio signals to analyzing multi-dimensional spectral characteristics across multiple frequency bands. This dimensional expansion allows the system to extract orientation information by comparing spectral power distributions, enabling focus detection in multi-device environments.
2Measurement precision
If spectral analysis across multiple frequency bands is performed, then the precision of orientation determination is improved, but the computational complexity increases
Solution Approach 1:
The system applies different analysis methods to different frequency bands, computing power spectra and spectral characteristics locally in each band. This localized analysis approach enables precise orientation determination by comparing spectral qualities across bands while managing computational complexity through targeted processing.
Solution Approach 2:
The system computes power spectra and compares spectral characteristics across multiple frequency bands, performing more analysis than a simple single-band approach. This partial spectral analysis provides sufficient orientation information without requiring complete spectral decomposition, balancing precision with computational feasibility.
Data Source
AI summary
A system, comprising: a plurality of distributed smart devices comprising: a first smart device having a first microphone; a second smart device having a second microphone; and processing circuitry, configured to: receive, from the first microphone, a first microphone signal comprising speech of a user; receive, from the second microphone, a second microphone signal comprising the speech of the user; determine an orientation of the user's head relative to the first smart device and the second smart device based on the first microphone signal and the second microphone signal, wherein determining the orientation of the user's head comprises comparing first power levels in a plurality of frequency bands of the first microphone signal; and controlling one or more of the plurality of distributed smart devices based on the determined orientation.