Automated Speech Proficiency Evaluation Using Suprasegmental Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for evaluating language proficiency in speech rely heavily on human evaluators, which are costly, time-consuming, and prone to inconsistency, and struggle with accurately assessing unconstrained speech due to its irregular nature.

Innovation Solution

An automated system using a microphone and computing device to process audio signals, recognizing phones and pauses, dividing them into tone units, identifying prominent syllables and tone choices, and calculating suprasegmental parameters to determine language proficiency, leveraging machine learning classifiers and speech corpora for improved accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If human evaluators are used to assess language proficiency, then the evaluation can be performed with current technology, but the process is costly, time-consuming, and prone to inconsistency

Engineering Contradiction:
Improveevaluation consistencyVSAvoidevaluation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces the mechanical system of human evaluators with an automated computational system. The system uses automatic speech recognition to transcribe speech, extracts suprasegmental features (stress, pitch, rhythm), and applies machine learning models to assess proficiency, eliminating the need for human raters and achieving consistent, scalable evaluation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system performs self-service by automatically processing speech evaluations without requiring external human intervention. The automated pipeline handles the entire evaluation process from speech input to proficiency scoring, making the system independent and scalable.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If human evaluators assess unconstrained speech, then the evaluation can be performed, but accuracy is reduced due to the irregular nature of unconstrained speech

Engineering Contradiction:
Improveproficiency assessment accuracyVSAvoidevaluation system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the evaluation process into distinct analytical stages: speech transcription, suprasegmental feature extraction (stress, pitch, rhythm), and proficiency assessment. This segmentation allows the system to handle the complexity of unconstrained speech through systematic decomposition into manageable analysis components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes the evaluation parameters from segmental accuracy (word-level recognition) to suprasegmental features (stress, pitch, rhythm patterns). These parameter changes enable the system to assess proficiency based on prosodic characteristics that remain stable even in unconstrained speech, improving measurement precision.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If automated systems are used to provide quick and consistent ratings, then evaluation efficiency improves, but the system complexity increases

Engineering Contradiction:
Improveevaluation speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system achieves multi-functionality by integrating multiple capabilities into a single unified platform: automatic speech recognition, suprasegmental feature extraction, machine learning-based proficiency assessment, and feedback generation. This universal system handles diverse evaluation tasks efficiently while managing complexity through integrated design.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9947322B2Systems and methods for automated evaluation of human speech
Publication Date: 2018.04.17 ARIZONA BOARD OF REGENTS ACTING FOR & ON BEHALF OF NORTHERN ARIZONA UNIV
  • US9947322B2 patent drawing
  • US9947322B2 patent drawing
  • US9947322B2 patent drawing

AI summary

Systems and methods for evaluating human speech. Implementations may include: a microphone coupled with a computing device comprising a microprocessor, a memory, and a display operatively coupled together. The microphone may be configured to receive an audible unconstrained speech utterance from a user whose proficiency in a language is being tested and provide a corresponding audio signal to the computing device. The microprocessor and memory may receive the audio signal and process the audio signal by recognizing a plurality of phones and a plurality of pauses and calculate a plurality of suprasegmental parameters using the plurality of pauses and the plurality of phones. The microprocessor and memory may use the plurality of suprasegmental parameters to calculate a language proficiency rating for the user and display the language proficiency rating of the user on the display associated with the computing device.