Wearable Terminal Gesture Control via Dynamic Sensor Sampling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wearable terminal devices, such as smart watches, face challenges in user interaction due to their small touchscreen size and placement on the wrist, making it difficult for users to perform touch operations, especially when carrying objects with the same hand.

Innovation Solution

Incorporating motion sensors and gesture detection technology that allows users to control the device through gestures and sensitivity modes, enabling operation without direct touch input, by determining sampling rates based on user movements and screen content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If the touchscreen size is made small to fit wearable device form factor, then the device can be worn on the wrist, but the number and type of touch operations become limited and difficult to perform

Engineering Contradiction:
Improvedevice sizeVSAvoidtouch operation capability
Core Design Contradiction:
Volume of moving objectVSEase of operation

Solution Approach 1:

The patent introduces motion sensors as an intermediary input method between the user and the device functionality. Instead of directly touching the small screen, users perform gestures in space that are detected by motion sensors, serving as a mediator that translates physical movements into device commands without requiring direct screen contact.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical touch input system with a motion-based detection system. Rather than relying on finger touches on the touchscreen surface, the system uses motion sensors to detect gestures in three-dimensional space, substituting the mechanical interaction paradigm with a motion recognition paradigm that works well for wearable devices.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If the user carries objects in the hand, then the hand is occupied, but the user becomes unable to perform touch operations on the smart watch

Engineering Contradiction:
Improvehand usage flexibilityVSAvoidtouch operation capability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

Motion sensors serve as an intermediary that allows hand operation without direct screen contact. Users can perform gestures with their hand while carrying objects, and the motion sensors detect these gestures in space, translating them into device commands without requiring the hand to be free for touchscreen interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent moves the input interface from two-dimensional touchscreen surface to three-dimensional space. Gestures are detected in three-dimensional space around the device, allowing users to interact with the device using hand movements that do not require direct contact with the screen, thus enabling operation while carrying objects.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If the sampling rate of motion sensor is increased to improve gesture detection accuracy, then gesture recognition becomes more accurate, but power consumption increases

Engineering Contradiction:
Improvegesture detection accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic adjustment of sampling rate based on detected motion activity. The sampling rate is not fixed but adapts to the current situation - higher rates when gestures are detected or expected, lower rates during periods of inactivity. This dynamic approach maintains gesture detection accuracy when needed while minimizing power consumption during normal operation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the sampling rate parameter based on operational conditions. By adjusting this key parameter dynamically rather than maintaining a constant high sampling rate, the system achieves high measurement precision when required while significantly reducing average power consumption, directly addressing the contradiction between accuracy and energy use.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3009912B1Terminal device and method for controlling operations
Publication Date: 2019.07.03 SONY GROUP CORP
  • EP3009912B1 patent drawingFigure 1
  • EP3009912B1 patent drawingFigure 2
  • EP3009912B1 patent drawingFigure 3~4

AI summary

A device includes circuitry configured to acquire detection data from at least one sensor device corresponding to movement of the device. The circuitry is also configured to control at least one sensitivity detection mode of the at least one sensor device and determine a sampling rate for the at least one sensor device based on the at least one sensitivity detection mode. The circuitry is also configured to determine gestures performed by a user based on the detection data from the at least one sensor device and control operation of the device based on the gestures performed by the user.