Acoustic Co-Processor Offloading for Speech Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Speech recognition systems place a significant load on computing resources, affecting processing speed and memory usage, especially in real-time applications and handheld devices with limited resources.

Innovation Solution

The implementation of an Acoustic Co-Processor (ACP) that offloads acoustic modeling and phoneme evaluation processes from the Central Processing Unit (CPU), using a dedicated memory device to store Gaussian probability distributions and HMM information, enabling accelerated calculations of senone and phoneme scores.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If speech recognition systems process voice signals in real-time using conventional computing resources, then recognition accuracy is improved, but processing speed and system responsiveness deteriorate due to significant computational load

Engineering Contradiction:
Improverecognition accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The system divides the speech recognition task into separate functional modules: acoustic modeling (processed by Acoustic Co-Processor), phoneme evaluation (processed by CPU), and word/language modeling (processed by CPU). This segmentation allows the computationally intensive acoustic modeling to be handled separately by a dedicated co-processor, improving overall processing speed while maintaining recognition accuracy through specialized processing at each stage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An Acoustic Co-Processor is introduced as an intermediary component between the voice signal input and the CPU-based phoneme evaluation. This co-processor acts as a mediator that performs acoustic modeling and generates phoneme scores, which are then passed to the CPU for final recognition. This intermediary architecture offloads computational burden from the CPU, enabling faster processing speeds while preserving accuracy through specialized acoustic analysis.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If speech recognition applications are deployed on handheld devices with limited memory resources, then portability and accessibility are improved, but memory capacity and processing capability are insufficient

Engineering Contradiction:
ImproveportabilityVSAvoidmemory capacity
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The acoustic modeling component is extracted from the main CPU-based speech recognition system and placed in a separate Acoustic Co-Processor with dedicated memory. This extraction allows the handheld device to have a smaller main memory footprint while still supporting accurate speech recognition. The co-processor handles the memory-intensive acoustic modeling tasks, freeing up CPU and system memory for other applications, thus enabling portable deployment without sacrificing recognition capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of requiring the full speech recognition system to run on the device's limited main memory, the system creates a simplified copy of the critical acoustic modeling functionality in a dedicated co-processor. This co-processor contains a copy of the acoustic model and processing logic, which operates independently from the main CPU memory. This copying approach allows handheld devices with limited memory to support speech recognition without needing to allocate large memory resources to the full system.

Inventive Principle:
Principle #26Copying

3Device complexity

If the CPU performs all speech recognition processing tasks, then system simplicity is maintained, but processing capability and real-time performance are compromised

Engineering Contradiction:
Improvesystem simplicityVSAvoidprocessing capability
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The speech recognition processing is segmented into two distinct parts: acoustic modeling handled by the Acoustic Co-Processor and phoneme evaluation handled by the CPU. This segmentation increases processing capability by utilizing dedicated hardware for the most demanding task, while the overall system remains relatively simple as it only adds a single co-processor component rather than requiring complete system redesign.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The Acoustic Co-Processor serves as an intermediary that handles the computationally intensive acoustic modeling tasks, freeing the CPU to focus on phoneme evaluation and higher-level recognition processing. This intermediary architecture enhances overall processing capability by distributing computational workload, while maintaining system simplicity through a clear functional separation between co-processor and CPU responsibilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9230548B2Hybrid hashing scheme for active HMMS
Publication Date: 2016.01.05 INFINEON TECHNOLOGIES AMERICAS CORP
  • US9230548B2 patent drawing
  • US9230548B2 patent drawing
  • US9230548B2 patent drawing

AI summary

Embodiments of the present invention include a data storage device and a method for storing data in a hash table. The data storage device can include a first memory device, a second memory device, and a processing device. The first memory device is configured to store one or more data elements. The second memory device is configured to store one or more status bits at one or more respective table indices. In addition, each of the table indices is mapped to a corresponding table index in the first memory device. The processing device is configured to calculate one or more hash values based on the one or more data elements.