Wearable Device Touch Response Using Binocular Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wearable devices, such as smart watches, face challenges in providing accurate and real-time feedback for touch operations due to small screen sizes, leading to low control accuracy and inadvertent clicks.

Innovation Solution

A method and apparatus utilizing binocular recognition to acquire position information of a target fingertip within a set touch action occurrence area, determining a mapping point on the screen, and displaying a cursor to enable real-time feedback and improve touch accuracy by establishing a mapping relationship between the fingertip position and the screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If a small screen is used in wearable devices, then the device size is reduced and wearing comfort is improved, but touch accuracy and control precision deteriorate

Engineering Contradiction:
Improvedevice sizeVSAvoidtouch accuracy
Core Design Contradiction:
Volume of moving objectVSMeasurement precision

Solution Approach 1:

The patent introduces spatial dimension by using binocular cameras to capture 3D fingertip position information, mapping it to the 2D screen coordinate system. This allows precise touch control without increasing screen size, resolving the contradiction between small device volume and high touch accuracy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If traditional touch screen is used, then device simplicity is maintained, but real-time feedback and control precision deteriorate

Engineering Contradiction:
Improvedevice simplicityVSAvoidcontrol precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent implements real-time feedback by displaying a cursor that dynamically follows the mapped fingertip position on the screen. This visual feedback mechanism provides immediate confirmation of touch operations, improving control precision while maintaining relatively simple device architecture.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If finger touches the screen directly, then operation simplicity is maintained, but touch position accuracy deteriorates due to finger obscuring icons

Engineering Contradiction:
Improveoperation simplicityVSAvoidtouch position accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces a cursor as an intermediary element between the user's finger and the screen icons. The cursor serves as a visual mediator that indicates the exact touch position and target, allowing users to accurately select icons without the finger obscuring them, thus improving touch position accuracy while maintaining simple touch operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances touch accuracy and user experience by allowing real-time feedback of touch operations, reducing misoperations, and enabling precise control on wearable devices.

Implementation Method 1

acquire position information of a target fingertip collected by binocular recognition means

Methodology Applied
Scientific EffectBinocular recognition: Parallax

Data Source

PatentUS10185433B2Method and apparatus for touch responding of wearable device as well as wearable device
Publication Date: 2019.01.22 BOE TECHNOLOGY GROUP CO LTD
  • US10185433B2 patent drawing
  • US10185433B2 patent drawing
  • US10185433B2 patent drawing

AI summary

The present disclosure relates to a method and apparatus for touch responding of a wearable device, and the wearable device. The method for touch responding of the wearable device comprises: acquiring position information of a target fingertip collected by binocular recognition means in a set touch action occurrence area; determining a mapping point mapped on a screen of the wearable device for the target fingertip based on the position information of the target fingertip; and displaying a cursor at the mapping point on the screen of the wearable device. The wearable device according to the present disclosure feeds back effect of touch operations to the user in real time, and thus improves touch accuracy of the wearable device.