Hand Object Gesture Control for VR System Activation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual reality (VR) systems lack intuitive gesture-based controls for activating system functions, as existing VR content is not well-suited for pinch motions and requires dedicated buttons, making it difficult for users to learn and remember multiple gestures.

Innovation Solution

A method that tracks hand gestures to render hand objects with icons corresponding to system functions, allowing users to activate these functions by performing specific gestures, such as a pinch motion, within the VR environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture-based controls are used in VR systems, then ease of operation is improved, but device complexity increases due to the need for multiple gesture recognition systems

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The hand object in the VR system serves multiple functions: it acts as both a visual representation of the user's hand and as an interactive control interface. By making the hand object itself the control mechanism rather than adding separate controllers, the system achieves multi-functionality without increasing device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The hand object automatically displays relevant icons and controls based on the user's gesture context. The system detects hand gestures and autonomously presents appropriate interaction options, eliminating the need for separate control devices or complex gesture recognition systems

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If multiple gestures are required for different functions, then adaptability is improved, but ease of operation deteriorates due to the difficulty of learning and remembering gestures

Engineering Contradiction:
ImproveadaptabilityVSAvoidease of operation
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system proactively displays relevant control icons on the hand object before the user needs to perform actions. By anticipating user needs and presenting controls in advance, the system eliminates the need for users to remember multiple gestures while maintaining adaptability to different interaction scenarios

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Different icons and control options are displayed at specific locations on the hand object based on the current context and user intent. This localized presentation of controls allows the system to adapt to different functions without requiring users to learn multiple gestures, as the relevant controls are always visible at the appropriate location

Inventive Principle:
Principle #3Local quality

3Ease of operation

If pinch motion is used for VR content operation, then ease of operation is improved for simple interactions, but adaptability deteriorates as it cannot suit existing VR content requiring dedicated buttons

Engineering Contradiction:
Improveease of operationVSAvoidadaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The hand object dynamically changes its displayed icons and controls based on the current VR context and user actions. This dynamic adaptation allows the same hand-based interface to provide both simple pinch gestures for basic interactions and button-like controls for complex operations, resolving the contradiction between ease of operation and adaptability

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11775077B2Method for activating system function in response to triggered icon on hand object, host, and computer readable storage medium
Publication Date: 2023.10.03 HTC CORP
  • US11775077B2 patent drawing
  • US11775077B2 patent drawing
  • US11775077B2 patent drawing

AI summary

The embodiments of the disclosure provide a method for activating a system function, a host, and a computer readable storage medium. The method includes: tracking a hand gesture and accordingly rendering a hand object in a visual content, wherein the hand object comprises one or more finger object; in response to determining that the hand gesture satisfies a predetermined condition, showing at least one icon on the one or more finger object on the hand object, wherein the at least one icon respectively corresponds to at least one system function; and in response to determining that a first icon among the at least one icon is triggered, activating a first system function corresponding to the first icon.