Gesture Selection for Immersive Language Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computerized linguistic learning software has not fully utilized the multimedia capabilities of devices to provide an engaging method for learning foreign languages, relying on traditional digitized exercises rather than immersive pedagogical assistance.

Innovation Solution

A language learning system that includes multilingual content in text and audio, correlating these with translation capabilities, using a computing device with a general user interface to select and translate native language content into a secondary language, and employing a gesture selection module for interactive learning through touchscreen gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional digitized language-learning exercises are used, then the software structure is simple and easy to implement, but the user engagement and learning effectiveness are insufficient

Engineering Contradiction:
Improveuser engagementVSAvoidsoftware structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent combines multiple multimedia elements (text, audio, images, video) and interaction methods (voice recognition, gesture recognition, touchscreen input) into a unified language-learning system. This integration creates an immersive pedagogical environment that significantly enhances user engagement compared to traditional text-only exercises, while the system manages the complexity through modular architecture.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The language-learning system is designed to perform multiple functions: presenting linguistic content, translating text and audio, recognizing voice and gestures, providing pedagogical assistance, and enabling interactive exercises. This multi-functionality allows a single system to replace multiple separate tools, improving engagement without proportionally increasing operational complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If multimedia capabilities are fully utilized for immersive language learning, then learning effectiveness improves, but the device complexity and development difficulty increase

Engineering Contradiction:
Improvelearning effectivenessVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the language-learning system into distinct functional modules: content presentation module, translation module, voice recognition module, gesture recognition module, and pedagogical assistance module. Each module handles a specific aspect of language learning, allowing the system to leverage full multimedia capabilities while managing complexity through modular design and independent development of each component.

Inventive Principle:
Principle #1Segmentation

3Ease of operation

If touchscreen gestures are implemented for content selection, then ease of operation improves, but the risk of unintended selections increases

Engineering Contradiction:
Improvecontent selection easeVSAvoidselection accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements feedback mechanisms in the gesture recognition system: visual indicators show detected gestures before execution, confirmation prompts appear for critical selections, and the system provides haptic or audio feedback when gestures are recognized. This feedback loop allows users to verify gesture recognition and correct unintended selections, maintaining ease of operation while improving selection accuracy and reliability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11645946B2Method of gesture selection of displayed content on a language learning system
Publication Date: 2023.05.09 ZING TECH INC
  • US11645946B2 patent drawing
  • US11645946B2 patent drawing
  • US11645946B2 patent drawing

AI summary

A language learning system is provided and includes multilingual content in both text and audio versions, a means for correlating the multilingual content with a translation of the text and audio version, and a computing device. The computing device includes a general user interface permitting a user to choose a specific subset of the multilingual content and a central processing unit to translate native language of the specific subset to a selected language translation.