Optimizing VoIP Test Sequences for Speech Quality Assessment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current non-intrusive speech quality assessment systems face challenges in efficiently calibrating and testing packet-based perceptual quality evaluation processors for Voice Over Internet Protocol (VOIP) networks, particularly due to varying edge-device implementations and the need to account for non-linear transmission degradation conditions like jitter and packet loss, which require extensive testing time and detailed information.

Innovation Solution

A method to define an optimized set of test sequences for packet-based perceptual quality evaluation processors, focusing on regions of interest by setting quality targets and using a two-dimensional parameter space with degradation parameters like jitter and packet loss, allowing for fewer test sequences while ensuring high resolution within these regions, using the Perceptual Evaluation of Speech Quality (PESQ) algorithm for evaluation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If exhaustive testing with pre-defined set of network conditions is performed, then measurement precision is improved, but loss of time increases significantly

Engineering Contradiction:
Improvequality assessment accuracyVSAvoidtesting duration
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the continuous parameter space of network conditions into discrete regions of interest based on degradation severity. Instead of exhaustively testing all possible conditions, the system divides the parameter space (packet loss rate, jitter, etc.) into meaningful segments and focuses testing resources on the most critical regions where quality degradation occurs, thereby reducing overall testing time while maintaining assessment accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts test parameters based on observed quality degradation patterns. By changing parameters such as packet loss rate and jitter values to focus on regions where quality targets are not met, the system optimizes the testing process to achieve comprehensive quality assessment with fewer test sequences, thus reducing time loss while preserving measurement precision.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If more test sequences are used to cover all edge-device operations, then reliability is improved, but productivity decreases

Engineering Contradiction:
Improvequality assessment coverageVSAvoidtesting efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies local quality by concentrating testing effort on specific regions of interest within the parameter space where edge-devices exhibit problematic behavior. Instead of uniformly distributing test sequences across all possible conditions, the system identifies local regions where quality degradation is most likely to occur and allocates more test sequences to these areas, achieving reliable assessment with improved overall testing efficiency.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system performs partial testing by focusing on the most critical regions of interest rather than exhaustively testing all possible network conditions. By applying excessive action locally (concentrating test sequences in problematic regions) rather than uniformly across the entire parameter space, the system achieves sufficient reliability for quality assessment while significantly improving productivity.

Inventive Principle:
Principle #16Partial or excessive action

3Ease of operation

If uniform distribution of test sequences is used, then ease of operation is improved, but manufacturing precision worsens in critical regions

Engineering Contradiction:
Improvetest sequence generation simplicityVSAvoidquality assessment resolution
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent introduces asymmetry in the distribution of test sequences by deliberately concentrating more sequences in regions of interest where quality degradation is most likely to occur. Instead of using a symmetric uniform distribution, the system creates an asymmetric distribution pattern that provides higher resolution in critical regions while maintaining ease of operation through automated parameter space analysis and region identification.

Inventive Principle:
Principle #4Asymmetry

Data Source

PatentUS8072892B2Generating test sets
Publication Date: 2011.12.06 PSYTECHNICS
  • US8072892B2 patent drawing
  • US8072892B2 patent drawing
  • US8072892B2 patent drawing

AI summary

This invention relates to a method of defining an optimised set of test sequences for use with a packet based perceptual quality evaluation processor associated with an edge-device that receives packets containing speech data and converts said packets to a speech signal, the method comprising the steps of: defining a set of quality targets which should be produced when a test sequence of packets is processed by the edge-device; determining a value for a degradation parameter for each quality target wherein a test sequence having a degradation according to said value will substantially produce said quality target when said test sequence is processed by the edge-device.