Neural Network Hotsound Detection Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing sound recognition systems face challenges in reliably detecting computer-generated 'hotsounds' without interfering with keyword or keyphrase detection, leading to issues with false triggers and computational inefficiencies.
Innovation Solution
A method that modifies a neural network trained for keyword recognition by optimizing a seed hotsound within a feature space to generate a new hotsound, using gradient descent and clustering algorithms to ensure detectability while avoiding false activations, and trains a second neural network for hotsound detection without retraining the entire system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a neural network is trained to recognize keywords or keyphrases, then keyword detection accuracy is improved, but the system cannot reliably detect computer-generated hotsounds without causing false triggers
Solution Approach 1:
The patent segments the neural network into two distinct components: a first neural network trained for keyword/keyphrase recognition and a second neural network trained for hotsound detection. This segmentation allows each network to specialize in its respective task, enabling reliable hotsound detection without interfering with keyword detection accuracy. The second network processes hotsound inputs independently while the first network continues to handle keyword recognition.
Solution Approach 2:
The patent introduces an intermediary optimization process that modifies the seed hotsound in the feature space generated by the first neural network. By using gradient descent algorithms to optimize the hotsound representation in the existing feature space, the system creates a modified hotsound that is detectable by the first network without triggering false positives from keyword patterns. This intermediary optimization step bridges the gap between the two detection tasks.
2Reliability
If the neural network is retrained to recognize hotsounds, then hotsound detection capability is improved, but computational efficiency decreases and keyword detection performance is negatively impacted
Solution Approach 1:
Instead of retraining the entire neural network, the patent segments the training process by creating a second, specialized neural network for hotsound detection. This segmentation preserves the original first network's keyword detection capabilities and training, while the second network is trained exclusively on hotsound data. The result is improved hotsound detection capability without the computational overhead of retraining the entire system.
Solution Approach 2:
The patent performs preliminary optimization of the hotsound in the feature space before training the second network. By using gradient descent to pre-optimize the modified hotsound representation in the feature space generated by the first network, the system prepares the input data in advance. This preliminary action reduces the training complexity and computational requirements for the second network, thereby maintaining computational efficiency.
3Measurement precision
If the entire neural network is retrained for hotsound recognition, then detection accuracy is improved, but training time and computational resources increase significantly
Solution Approach 1:
The patent divides the detection system into two specialized networks, allowing each to be trained independently on its specific task. The first network maintains its existing keyword detection accuracy, while the second network is trained solely for hotsound detection. This segmentation eliminates the need for time-consuming full-network retraining, as only the second network requires training on hotsound data.
Solution Approach 2:
The patent performs preliminary optimization of the hotsound representation in the feature space using gradient descent algorithms before initiating the second network's training. This preliminary action pre-processes the hotsound data to be optimally detectable, reducing the complexity and time required for the actual training phase. The modified hotsound is already aligned with the feature space structure, accelerating the training process.
Data Source
AI summary
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network. One of the methods includes accessing a first neural network that was trained to recognize a given keyword or keyphrase using a set of hotword training data, wherein the hotword training data includes positive hotword training data that correspond to utterances of the keyword or keyphrase, and negative hotword training data that corresponds to utterances of words or phrases that are other than the keyword or keyphrase, selecting a seed hotsound, mapping, to a feature space, (i) the positive hotword training data, (ii) the negative hotword training data, and (iii) the seed hotsound, performing an optimization of a position of the seed hotsound within the feature space to generate a modified seed hotsound, generating a set of hotsound training data using the modified seed hotsound, training a second neural network to recognize the modified seed hotsound using the generated set of hotsound training data, and using the trained second neural network to recognize the modified hotsound.


