Sign Language Translation via Emphasis-Based Rephrasing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Deaf individuals face challenges in understanding audio-visual content like news or movies due to the limitations of existing sign languages and the high cost of human interpreters, leading to feelings of loneliness and isolation.

Innovation Solution

An electronic device that predicts an emphasis score for each word in a natural language input, rephrases sentences based on these scores, and delivers sign language through a three-dimensional model with facial expressions and sound direction indicators to enhance understanding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing sign language systems are used, then deaf people can communicate basic ideas, but they cannot clearly understand the intent of sentences

Engineering Contradiction:
Improveunderstanding precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the translation process into multiple stages: acoustic feature extraction, emphasis score prediction for each word, sentence rephrasing based on emphasis patterns, and sign language character generation. This segmentation allows the system to capture nuanced intent while managing complexity through modular processing steps.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary rephrasing stage that transforms the original sentence into an emphasized version before converting to sign language. This intermediary step acts as a mediator that preserves the original meaning while highlighting key intent, enabling more accurate sign language translation without directly complicating the core translation mechanism.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If human interpreters are used for audio-visual conversion, then accurate sign language translation is achieved, but the cost becomes expensive and accessibility challenging

Engineering Contradiction:
Improvetranslation accuracyVSAvoidsystem accessibility
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The system enables self-service automatic translation by equipping electronic devices with acoustic analysis and natural language processing capabilities. The device independently extracts acoustic features, predicts emphasis scores, rephrases sentences, and generates sign language characters without requiring human interpreter intervention, making the service accessible and cost-effective while maintaining reliability through automated accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical system of human interpreters with an automated electronic system that uses acoustic feature extraction, machine learning-based emphasis prediction, and algorithmic sentence rephrasing. This substitution eliminates the need for human physical presence while maintaining translation accuracy through computational analysis of acoustic patterns and linguistic structures.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If static sign language delivery is used, then basic information is conveyed, but user understanding of sentence intent is limited

Engineering Contradiction:
Improveintent information retentionVSAvoiduser experience quality
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system transforms static sign language delivery into a dynamic process by incorporating emphasis score-based rephrasing that adapts the sentence structure based on predicted important words. The dynamic rephrasing adjusts the information presentation to highlight intent, ensuring that the generated sign language characters convey not just literal meaning but also the speaker's intended emphasis and nuance.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11610356B2Method and electronic device for providing sign language
Publication Date: 2023.03.21 SAMSUNG ELECTRONICS CO LTD
  • US11610356B2 patent drawing
  • US11610356B2 patent drawing
  • US11610356B2 patent drawing

AI summary

A method for providing sign language is disclosed. The method includes receiving, by an electronic device, a natural language information input from at least one source for conversion into sign language. The natural language information input includes at least one sentence. The method further includes predicting, by the electronic device, an emphasis score for each word of the at least one sentence based on acoustic components. The method further includes rephrasing, by the electronic device, the at least one sentence based on the emphasis score of each of the words. The method further includes converting, by the electronic device, the at least one rephrased sentence into the sign language. The method further includes delivering, by the electronic device, the sign language.