Gesture Recognition in Touch Displays via Preliminary Trajectory Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Large-sized touch display devices require extensive user movement, leading to fatigue and an unpleasant user experience due to the need for wide-ranging touch operations to recognize and execute gestures.

Innovation Solution

A method and system for real-time gesture recognition in touch display devices that anticipates and displays matching gesture inputs based on trajectory features, allowing users to select and execute functions before completing touch inputs, thereby reducing the need for extensive movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the touch display device is made large-sized to provide bigger display area, then the display area is increased, but the user has to move widely across the screen to activate functions, causing user fatigue and disagreeable user experience

Engineering Contradiction:
Improvedisplay areaVSAvoiduser fatigue
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The system performs preliminary gesture recognition by analyzing touch trajectory features in real-time and predicting possible gesture inputs before the user completes the full touch motion. This allows the system to prepare and display matching gesture options in advance, enabling users to activate functions with reduced movement distance on large screens without causing fatigue

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the system waits for complete touch input before recognizing gesture, then the gesture recognition accuracy is improved, but the user has to complete full touch trajectory which requires wide movement on large screens, increasing operation time and fatigue

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoidoperation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary gesture recognition by analyzing touch trajectory features in real-time and predicting possible gesture inputs before the user completes the full touch motion. This allows the system to prepare and display matching gesture options in advance, enabling users to activate functions with reduced movement distance on large screens without causing fatigue

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides real-time feedback by displaying predicted gesture options as the user performs the touch input. This feedback mechanism allows users to see matching gestures during the input process and adjust or confirm their selection, improving both recognition accuracy and reducing the time needed to complete the full gesture trajectory

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10318147B2Method and system of gesture recognition in touch display device
Publication Date: 2019.06.11 TCL CHINA STAR OPTOELECTRONICS TECHNOLOGY CO LTD
  • US10318147B2 patent drawing
  • US10318147B2 patent drawing

AI summary

Disclosed is a method and system of gesture recognition in a touch display device, which is able to predetermine gesture inputs possibly to be made by a user prior to the completion of the user's touch input, and enable a display unit to display all possible similar gesture inputs so as to provide an instruction (or navigation guidance) for the user. Thus, when using a large-sized touch display device, the user does not have to perform touch operations widely throughout the screen of the display device, because the system can recognize the similar gesture inputs in advance, which renders it easier for the user to operate on the touch display device, thereby obtaining a better user experience.