Time-Synchronous Search Algorithm for Speech Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The long-contextual-span nature of hidden trajectory models (HTMs) in speech recognition systems presents challenges due to a dramatically increasing search space, which complicates decoding, especially when modeling longer context dependencies without introducing additional parameters.

Innovation Solution

A time-synchronous search algorithm is employed, where hypotheses are represented as traces including current and future frames, with pruning strategies applied to speed up the search, and a bi-directional filter is used to model coarticulation and context assimilated reduction, allowing for efficient computation of likelihood scores.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If long-contextual-span hidden trajectory models are used to model longer context dependencies, then modeling accuracy is improved, but search space size increases dramatically

Engineering Contradiction:
Improvemodeling accuracyVSAvoidsearch space size
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The search space is segmented by representing hypotheses as traces that include indications of current frame, previous frames, and future frames. This segmentation allows the system to handle long-context dependencies by breaking down the comprehensive search space into manageable trace segments, each representing a localized hypothesis window.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Pruning strategies are applied in advance during the decoding process to eliminate unlikely hypotheses before they expand the search space. By performing preliminary filtering on traces based on likelihood scores and contextual constraints, the system reduces the effective search space while maintaining modeling accuracy for long-span dependencies.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If pruning strategies are applied to speed up search, then decoding efficiency is improved, but search completeness may be reduced

Engineering Contradiction:
Improvedecoding efficiencyVSAvoidsearch completeness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The pruning process incorporates feedback mechanisms where hypotheses are evaluated based on likelihood scores computed from the hidden trajectory model. Traces that exceed likelihood thresholds are retained while others are pruned, allowing the system to maintain search completeness for high-probability paths while improving decoding efficiency through selective elimination of low-probability hypotheses.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If additional parameters are introduced to model longer context dependencies, then modeling capability is improved, but device complexity increases

Engineering Contradiction:
Improvemodeling capabilityVSAvoidparameter count
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The hidden trajectory model uses a universal set of context-independent parameters that serve multiple functions across different time spans and contextual scenarios. Rather than introducing separate parameters for each context length, the same parameter set models dependencies of varying spans by operating on traces that capture different temporal extents, thus maintaining modeling capability while avoiding parameter proliferation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS7877256B2Time synchronous decoding for long-span hidden trajectory model
Publication Date: 2011.01.25 MICROSOFT TECHNOLOGY LICENSING LLC
  • US7877256B2 patent drawing
  • US7877256B2 patent drawing
  • US7877256B2 patent drawing

AI summary

A time-synchronous lattice-constrained search algorithm is developed and used to process a linguistic model of speech that has a long-contextual-span capability. In the algorithm, hypotheses are represented as traces that include an indication of a current frame, previous frames and future frames. Each frame can include an associated linguistic unit such as a phone or units that are derived from a phone. Additionally, pruning strategies can be applied to speed up the search. Further, word-ending recombination methods are developed to speed up the computation. These methods can effectively deal with an exponentially increased search space.