Simultaneous Translation Chunk Decoding for Real-Time Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing machine translation devices struggle with simultaneous translation, as they often lag behind the speaker due to sentence-by-sentence translation and lack real-time accuracy, especially when dealing with input from voice recognition systems that lack punctuation.

Innovation Solution

A simultaneous translation device that performs chunk-by-chunk translation using an encoder-decoder architecture, where previously translated chunks are treated as a fixed context, and includes mechanisms for detecting chunk and sentence ends, with a decoding process that utilizes a translation word sequence storage to enhance real-time accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If sentence-by-sentence translation is used, then translation accuracy is improved, but translation speed and real-time performance deteriorate

Engineering Contradiction:
Improvetranslation accuracyVSAvoidtranslation speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the input word sequence into multiple chunks smaller than a complete sentence. The encoder processes the entire sentence to generate intermediate representations, while the decoder translates chunk-by-chunk by sequentially inputting each chunk and using previously translated chunks as context. This segmentation allows the system to output translations in real-time before the complete sentence is available, improving translation speed while maintaining accuracy through the use of intermediate representations and contextual information from previously translated portions.

Inventive Principle:
Principle #1Segmentation

2Productivity

If chunk-by-chunk translation is used, then translation speed is improved, but translation accuracy deteriorates

Engineering Contradiction:
Improvetranslation speedVSAvoidtranslation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary encoding of the entire input sentence to generate intermediate language representations before translation begins. This preliminary action allows the decoder to access comprehensive contextual information from the complete sentence while translating chunk-by-chunk. The intermediate representations serve as a pre-processed foundation that contains semantic and grammatical information needed for accurate chunk-level translation, ensuring that speed improvements do not compromise accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback mechanisms where previously translated chunks are fed back as context into the decoder for subsequent chunk translations. The decoder sequentially processes each chunk while incorporating information from intermediate representations of the complete sentence and context from already translated portions. This feedback loop ensures consistency and accuracy across chunk boundaries, maintaining high translation quality even when translating in smaller units for real-time performance.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12614040B2Simultaneous translation device and computer program
Publication Date: 2026.04.28 NAT INST OF INFORMATION & COMM TECH
  • US12614040B2 patent drawing
  • US12614040B2 patent drawing
  • US12614040B2 patent drawing

AI summary

A simultaneous translation system includes: an encoder encoding an input word sequence to an intermediate language representation; a chunk-end detecting device detecting an end of a chunk in the word sequence; a word vector reading unit inputting a partial word sequence up to the chunk-end detected by the chunk-end detecting device to the encoder; a decoder and a translated word searching unit receiving the intermediate language representation from encoder as an input, for outputting a translation word sequence corresponding to the partial word sequence; and a translated word sequence storage unit storing the translation word sequences output by decoder and translated word searching unit.