AR Gesture Input Speed Threshold Command Differentiation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality (AR) interfaces on mobile devices are cumbersome due to limited input options and screen space, requiring multiple gestures for interactions with virtual objects, which breaks immersion and increases processing power consumption.

Innovation Solution

The system utilizes intrinsic physical gesture parameters, such as speed and direction, to differentiate and command various functions in an AR scene, allowing for more intuitive and efficient interactions by reducing the need for visual displays of options and minimizing the number of required gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple gesture inputs are used to interact with virtual objects in AR scene, then the number of available commands increases, but the complexity of operation increases and immersion is broken

Engineering Contradiction:
Improvenumber of available commandsVSAvoidcomplexity of gesture inputs
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent applies parameter changes by utilizing different physical parameters of the same gesture type (speed, direction, pressure) to differentiate between multiple commands. For example, a swipe gesture can indicate different functions based on its speed threshold - slower swipes for navigation and faster swipes for other operations. This allows the system to expand command versatility without requiring users to learn multiple gesture types, thereby maintaining ease of operation while increasing adaptability.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If visual displays of options are shown to help user selection, then ease of operation improves, but screen real estate is consumed and AR immersion is broken

Engineering Contradiction:
Improveease of selectionVSAvoidscreen real estate
Core Design Contradiction:
Ease of operationVSArea of stationary object

Solution Approach 1:

The patent extracts the selection interface from the visual display domain and transfers it to the gesture parameter domain. Instead of displaying visual menus or option lists that consume screen real estate, the system encodes multiple selection options within the parameters of a single gesture type. The system processes different gesture parameters (speed, direction, pressure) to determine user intent, thereby providing ease of selection without requiring visual displays of options, thus preserving screen real estate for the AR scene and maintaining immersion.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If multiple gestures are required for different functions, then command versatility increases, but processing power consumption increases

Engineering Contradiction:
Improvecommand versatilityVSAvoidprocessing power consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent implements universality by designing a single gesture type (swipe) to serve multiple functions through parameter variation. Instead of creating separate gesture mechanisms for each command, the system makes the swipe gesture multi-functional by interpreting its parameters (speed, direction, pressure) to trigger different operations. This reduces the total number of gesture recognition algorithms that need to be processed, thereby decreasing processing power consumption while maintaining command versatility. The system processes one gesture type with multiple parameter interpretations rather than multiple gesture types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12111973B2System and method to manipulate virtual model based on physical parameters of gesture input
Publication Date: 2024.10.08 SHOPIFY INC
  • US12111973B2 patent drawing
  • US12111973B2 patent drawing
  • US12111973B2 patent drawing

AI summary

The present disclosure provides AR systems and methods. The computer-implemented method comprises displaying, on a mobile device, a rendered virtual object in an augmented reality (AR) scene, and detecting, using an input device of the mobile device, a gesture having a detected speed. The method further includes identifying the gesture, wherein the gesture is identified as a first command to implement a first function related to the virtual object responsive to the detected speed of the gesture being less than a speed threshold, and the gesture is identified as a second command to implement a second function related to the virtual object responsive to the detected speed of the gesture being greater than the speed threshold. The second command and second function are different from the first command and the first function, respectively. The identified gesture is then processed.