Translation Quality Assessment via Pattern Model S-Score

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing translation workflows require extensive and costly human review to ensure accuracy, as they involve processing and verifying numerous segments of translated text, which is time-consuming and resource-intensive.

Innovation Solution

A method that evaluates text segments using a pattern model to generate an s-score, allowing for auto-substitution and bypassing human review if the s-score exceeds a predefined threshold, thereby flagging segments for auto-substitution with machine-translated text.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If human editors review all translated segments to ensure accuracy, then translation quality is maintained, but time consumption and cost increase significantly

Engineering Contradiction:
Improvetranslation qualityVSAvoidpost-editing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system employs automated quality assessment where machine translation models generate translations and pattern models automatically evaluate them against source text patterns, enabling the translation system to self-assess quality without mandatory human review for all segments

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Human editorial review is replaced with automated pattern matching algorithms that compare source text patterns with translation patterns, using computational methods to substitute manual quality checking processes

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If human editors review all translated segments, then translation accuracy is verified, but resource consumption and cost increase

Engineering Contradiction:
Improvetranslation accuracyVSAvoidcost efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The translation system performs self-quality assessment using pattern models that automatically evaluate translation accuracy by comparing linguistic patterns, eliminating the need for costly human review of all segments

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Manual editorial verification is replaced with automated pattern recognition systems that use algorithmic analysis to assess translation accuracy, reducing resource consumption while maintaining quality standards

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If machine translation is used for all segments, then productivity increases, but translation quality and accuracy decrease

Engineering Contradiction:
Improvetranslation speedVSAvoidtranslation quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

Different quality assurance approaches are applied to different segments: high-confidence machine translations with strong pattern matches proceed automatically, while segments with weaker pattern matches receive enhanced review, creating localized quality control strategies

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system implements feedback loops where pattern model assessments inform subsequent processing decisions, allowing the system to learn from quality outcomes and adjust automated review thresholds based on performance data

Inventive Principle:
Principle #23Feedback

4Manufacturing precision

If extensive human review is performed on all segments, then translation precision is ensured, but process complexity increases

Engineering Contradiction:
Improvetranslation precisionVSAvoidworkflow complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The translation workflow is segmented into distinct automated evaluation stages using pattern models, where segments are processed through standardized automated checks before human review, reducing overall workflow complexity through systematic division

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically adjusts review thresholds and processing parameters based on pattern match confidence levels, automatically modifying workflow intensity to match segment complexity and reducing unnecessary processing steps

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10599782B2Analytical optimization of translation and post editing
Publication Date: 2020.03.24 KYNDRYL INC
  • US10599782B2 patent drawing
  • US10599782B2 patent drawing
  • US10599782B2 patent drawing

AI summary

Improved translation operations are disclosed. A first segment of text in a first language is received, to be translated into a second language. The first segment is evaluated, by operation of one or more processors, of text using the pattern model to generate a first s-score. A second segment of text in the second language is generated based on processing the first segment of text using a machine translation model. Upon determining that the first s-score exceeds a predefined threshold, the first segment of text is flagged for auto-substitution with the second segment of text, such that the first segment of text is not reviewed by a human editor.