Handheld Gesture Macro System Using Multi-Panel Touch and Inertial Sensors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Handheld devices lack efficient multi-modal input methods that integrate touch-sensitive panels and inertial movements to trigger user-defined macros and tasks, limiting user interaction and functionality.

Innovation Solution

Implementing a system with multiple touch-sensitive panels on a handheld device that detects and processes first and second gestures, combining inputs from these panels and inertial movements to trigger specific tasks or macros, allowing users to define and execute complex interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple touch-sensitive panels and inertial sensors are integrated into the handheld device, then the versatility and functionality of user interactions are improved, but the device complexity increases

Engineering Contradiction:
Improveuser interaction versatilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple touch-sensitive panels (first and second touch-sensitive panels) with inertial measurement units into a unified gesture recognition system. The processor integrates signals from all these components to detect complex gestures, enabling versatile user interactions while managing the complexity through coordinated operation of existing components.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The gesture recognition system serves multiple functions: it can detect various types of gestures (single touch, multi-touch, sliding, tapping), identify user intentions, and trigger different macros or tasks. This multi-functionality approach allows the same hardware components to handle diverse interaction modes, improving versatility without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If gesture-based macro execution is implemented, then the ease of operation is improved by reducing the number of steps required, but the difficulty of detecting and measuring gestures accurately increases

Engineering Contradiction:
Improveease of operationVSAvoidgesture detection difficulty
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The gesture detection process is segmented into distinct phases: detecting the first gesture that initiates macro mode, monitoring for the second gesture within a time window, and executing the corresponding macro. This segmentation allows the system to handle complex gesture sequences systematically, making accurate detection more manageable while presenting simple operation to the user.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by establishing a time window parameter when the first gesture is detected. This pre-configured time window guides subsequent gesture detection, helping to filter out spurious inputs and focus on relevant second gestures. This preliminary setup simplifies the overall detection process while maintaining ease of operation.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive and versatile user interactions by allowing users to create and execute macros using multiple touch points and device movements, enhancing game and software functionality without requiring extensive user effort.

Implementation Method 1

a first touch sensitive panel attached to a first surface of the housing, a second touch sensitive panel attached to a second surface of the housing

Methodology Applied
Scientific EffectTouch sensitivity:

Implementation Method 2

an inertial movement of the handheld device

Methodology Applied
Scientific EffectInertial movement sensing:

Data Source

PatentUS8797283B2Method and apparatus for performing user-defined macros
Publication Date: 2014.08.05 SONY INTERACTIVE ENTERTAINMENT LLC
  • US8797283B2 patent drawing
  • US8797283B2 patent drawing
  • US8797283B2 patent drawing

AI summary

A method and apparatus for performing a task at a handheld device. The method includes detecting a first gesture at a handheld device, monitoring for a second gesture in response to detecting the first gesture, detecting the second gesture at the handheld device, determining whether the second gesture corresponds to a task and performing the task when it is determined that the second gesture corresponds to the task.