Neural Network Hotsound Detection Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing sound recognition systems face challenges in reliably detecting computer-generated 'hotsounds' without interfering with keyword or keyphrase detection, leading to issues with false triggers and computational inefficiencies.

Innovation Solution

A method that modifies a neural network trained for keyword recognition by optimizing a seed hotsound within a feature space to generate a new hotsound, using gradient descent and clustering algorithms to ensure detectability while avoiding false activations, and trains a second neural network for hotsound detection without retraining the entire system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a neural network is trained to recognize keywords or keyphrases, then keyword detection accuracy is improved, but the system cannot reliably detect computer-generated hotsounds without causing false triggers

Engineering Contradiction:
Improvekeyword detection accuracyVSAvoidhotsound detection reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the neural network into two distinct components: a first neural network trained for keyword/keyphrase recognition and a second neural network trained for hotsound detection. This segmentation allows each network to specialize in its respective task, enabling reliable hotsound detection without interfering with keyword detection accuracy. The second network processes hotsound inputs independently while the first network continues to handle keyword recognition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary optimization process that modifies the seed hotsound in the feature space generated by the first neural network. By using gradient descent algorithms to optimize the hotsound representation in the existing feature space, the system creates a modified hotsound that is detectable by the first network without triggering false positives from keyword patterns. This intermediary optimization step bridges the gap between the two detection tasks.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the neural network is retrained to recognize hotsounds, then hotsound detection capability is improved, but computational efficiency decreases and keyword detection performance is negatively impacted

Engineering Contradiction:
Improvehotsound detection capabilityVSAvoidcomputational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

Instead of retraining the entire neural network, the patent segments the training process by creating a second, specialized neural network for hotsound detection. This segmentation preserves the original first network's keyword detection capabilities and training, while the second network is trained exclusively on hotsound data. The result is improved hotsound detection capability without the computational overhead of retraining the entire system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary optimization of the hotsound in the feature space before training the second network. By using gradient descent to pre-optimize the modified hotsound representation in the feature space generated by the first network, the system prepares the input data in advance. This preliminary action reduces the training complexity and computational requirements for the second network, thereby maintaining computational efficiency.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the entire neural network is retrained for hotsound recognition, then detection accuracy is improved, but training time and computational resources increase significantly

Engineering Contradiction:
Improvedetection accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the detection system into two specialized networks, allowing each to be trained independently on its specific task. The first network maintains its existing keyword detection accuracy, while the second network is trained solely for hotsound detection. This segmentation eliminates the need for time-consuming full-network retraining, as only the second network requires training on hotsound data.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary optimization of the hotsound representation in the feature space using gradient descent algorithms before initiating the second network's training. This preliminary action pre-processes the hotsound data to be optimally detectable, reducing the complexity and time required for the actual training phase. The modified hotsound is already aligned with the feature space structure, accelerating the training process.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9443517B1Generating sounds for detectability by neural networks
Publication Date: 2016.09.13 GOOGLE LLC
  • US9443517B1 patent drawing
  • US9443517B1 patent drawing
  • US9443517B1 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network. One of the methods includes accessing a first neural network that was trained to recognize a given keyword or keyphrase using a set of hotword training data, wherein the hotword training data includes positive hotword training data that correspond to utterances of the keyword or keyphrase, and negative hotword training data that corresponds to utterances of words or phrases that are other than the keyword or keyphrase, selecting a seed hotsound, mapping, to a feature space, (i) the positive hotword training data, (ii) the negative hotword training data, and (iii) the seed hotsound, performing an optimization of a position of the seed hotsound within the feature space to generate a modified seed hotsound, generating a set of hotsound training data using the modified seed hotsound, training a second neural network to recognize the modified seed hotsound using the generated set of hotsound training data, and using the trained second neural network to recognize the modified hotsound.