Real-Time Language Skill Assessment Using Parallel ML Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current language learning systems fail to provide real-time feedback on spoken and written responses during conversations, leading to delayed assessment results and limited opportunities for effective speaking practice, with a lack of objective and timely evaluation of language proficiency.

Innovation Solution

A real-time open activity response assessment system that uses multiple machine learning models to process and assess written and spoken responses in real-time, providing immediate and objective feedback, and allowing for the selection of specific models based on assessment types and scenarios.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If multiple machine learning models are used to process open response assessments in real-time, then assessment speed and responsiveness are improved, but system complexity increases

Engineering Contradiction:
Improveassessment speedVSAvoidsystem complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The system divides the assessment task into multiple independent assessments (grammar, vocabulary, pronunciation, fluency, coherence) processed by separate machine learning models. Each model handles a specific aspect of language evaluation, enabling parallel processing and real-time feedback while maintaining manageable complexity through functional decomposition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system employs multiple machine learning models that can be selectively applied based on the type of open response assessment needed. These models serve universal purposes across different assessment scenarios, allowing the system to handle various language evaluation tasks with a shared set of computational resources and algorithms.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of time

If real-time processing of open responses is implemented, then feedback timeliness is improved, but computational resource consumption increases

Engineering Contradiction:
Improvefeedback delayVSAvoidcomputational resource consumption
Core Design Contradiction:
Loss of timeVSUse of energy by moving object

Solution Approach 1:

The machine learning models are pre-trained on extensive language datasets before deployment. This preliminary training phase allows the models to perform assessments in real-time with minimal computational resources during actual use, as the heavy lifting of pattern recognition and language understanding has already been established during the training phase.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies only the necessary subset of assessment models based on the specific response type and assessment goals, rather than running all possible assessments on every input. This selective application of computational resources provides timely feedback while avoiding unnecessary processing overhead.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240221725A1System and method for artificial intelligence-based language skill assessment and development
Publication Date: 2024.07.04 PEARSON EDUCATION INC
  • US20240221725A1 patent drawing
  • US20240221725A1 patent drawing
  • US20240221725A1 patent drawing

AI summary

Systems and methods for dynamic open activity response assessment provide for: receiving an open activity response from a client device of a user; in response to the open activity response, providing the open activity response to multiple machine learning models to process multiple open response assessments in real time; receiving multiple assessment scores from the multiple machine learning models; and providing multiple assessment results to the client device of the user based on the multiple assessment scores corresponding to the multiple open response assessments associated with the open activity response.