Adaptive Gesture Trigger Control for Head-Mounted Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies for gesture operations in head-mounted displays (HMDs) lack efficiency in determining trigger gestures, leading to reduced operability and increased physical burden on users, especially considering varying user postures and environments.

Innovation Solution

An information processing apparatus with a physical information acquisition unit, gesture information acquisition unit, determination condition setting unit, and control unit that sets and controls trigger gestures based on physical and environmental information, such as posture and field-of-view features, to improve gesture recognition and reduce user effort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture operations are implemented in HMDs without considering user posture, then gesture operation functionality is provided, but operability is reduced and physical burden on users increases

Engineering Contradiction:
Improvegesture operation operabilityVSAvoidgesture determination system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making the gesture determination conditions adaptive rather than fixed. The system dynamically adjusts determination thresholds and trigger criteria based on real-time detection of user posture (standing, sitting, lying down) and environmental context. This allows the gesture recognition system to adapt to varying user states, improving operability without requiring a completely separate system for each posture.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters of the gesture determination system based on detected user posture and environment. Specifically, it modifies determination thresholds, trigger sensitivity, and gesture recognition criteria according to the user's physical state. For example, when the user is detected as sitting or lying down, the system adjusts the thresholds to account for reduced head movement range, thereby maintaining high operability across different postures.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If fixed determination conditions are used for trigger gestures, then system complexity is reduced, but unintended gesture recognition increases and operability decreases

Engineering Contradiction:
Improvegesture recognition accuracyVSAvoiddetermination condition complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-defining multiple sets of determination conditions corresponding to different user postures and environmental scenarios. Before gesture recognition occurs, the system detects the user's current posture and selects the appropriate pre-configured determination condition set. This preparation in advance allows the system to switch between different recognition criteria instantly, improving accuracy without adding complex real-time adjustment mechanisms.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If gesture thresholds are set low for sensitive detection, then gesture responsiveness is improved, but unintended gestures are more likely to be recognized

Engineering Contradiction:
Improvegesture operation responsivenessVSAvoidgesture recognition reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies local quality by setting different determination thresholds and sensitivity levels for different user postures and gesture types. Instead of using a uniform threshold across all scenarios, the system configures localized threshold values appropriate for each specific context (e.g., standing vs. sitting, different gesture categories). This allows high responsiveness where needed while maintaining reliability by raising thresholds in contexts where false detection is more likely.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11835727B2Information processing apparatus and information processing method for controlling gesture operations based on postures of user
Publication Date: 2023.12.05 SONY GROUP CORP
  • US11835727B2 patent drawing
  • US11835727B2 patent drawing
  • US11835727B2 patent drawing

AI summary

An information processing apparatus according to an embodiment of the present technology includes a physical information acquisition unit, a gesture information acquisition unit, a determination condition setting unit, and a control unit. The physical information acquisition unit acquires physical information of a user wearing a head-mounted casing. The gesture information acquisition unit acquires gesture information regarding a gesture of the user. The determination condition setting unit sets, on the basis of the physical information, a determination condition for determining a trigger gesture that is a trigger for an operation input by the gesture of the user. The control unit determines, on the basis of the gesture information and the determination condition, whether or not the trigger gesture is performed and controls, on the basis of a result of the determination, an output corresponding to the trigger gesture.