Compound Word Splitting for Machine Translation Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Machine translation systems face difficulties in handling compound words, particularly when translating between languages that generate compound words and those that do not, as the morphological operations required to split these words are complex and challenging for machines to perform.

Innovation Solution

A compound splitting system is developed to decompound words into their constituents using word frequency lists and multilingual phrase tables, which identifies candidate sub-words and required morphological operations, including the use of non-dictionary words, to determine the optimal split points and transform the words, thereby improving translation quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a phrase-based statistical process is used to align source and target phrases using a phrase table, then machine translation can be performed efficiently, but alignment of source and target phrases becomes difficult or impossible when one language generates compound words and the other does not

Engineering Contradiction:
Improvemachine translation efficiencyVSAvoidphrase alignment accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies segmentation by dividing compound words into their constituent parts (morphemes) before translation. The system identifies split points in compound words and separates them into individual components, allowing each component to be translated independently. This resolves the alignment problem by transforming a single compound word token into multiple translatable units, enabling the phrase-based statistical process to handle compound words effectively while maintaining translation efficiency.

Inventive Principle:
Principle #1Segmentation

2Speed

If compound words are translated as single units, then translation speed is maintained, but translation quality deteriorates when the target language does not use compound words

Engineering Contradiction:
Improvetranslation speedVSAvoidtranslation quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The patent implements a dynamic translation approach where the system adaptively determines whether to translate compound words as single units or split them into components based on the target language characteristics. The system dynamically adjusts its processing mode: for languages that use compound words, it maintains single-unit translation for speed; for languages that don't use compound words, it automatically segments and translates components separately, thereby optimizing both speed and quality based on the specific translation context.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If morphological operations are applied to split compound words, then translation accuracy improves, but system complexity increases due to the need to identify and apply multiple morphological operations

Engineering Contradiction:
Improvetranslation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent implements a self-service mechanism where the system automatically learns and stores morphological operations from parallel corpora during training. The system independently identifies common morphological patterns (such as linking elements, prefixes, and suffixes) and creates a lookup table of these operations. During translation, the system simply queries this pre-computed table rather than performing complex real-time analysis, thereby achieving high translation accuracy while keeping the operational complexity low through automated self-learning and caching.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9075792B2Compound splitting
Publication Date: 2015.07.07 GOOGLE LLC
  • US9075792B2 patent drawing
  • US9075792B2 patent drawing
  • US9075792B2 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for decompounding compound words are disclosed. In one aspect, a method includes obtaining a token that includes a sequence of characters, identifying two or more candidate sub-words that are constituents of the token, and one or more morphological operations that are required to transform the sub-words into the token, where at least one of the morphological operations involves a use of a non-dictionary word, and determining a cost associated with each sub-word and a cost associated with each morphological operation.