HMD Session Termination via Sensor Gesture Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented and virtual reality systems lack efficient methods to automatically detect the end of a user's session, leading to unutilized idle time and reduced productivity as supplemental tasks are not initiated without specific user intervention.

Innovation Solution

A system and method that utilize sensors in head-mounted displays and external devices to detect natural gestures, such as removal or reorientation of the HMD, to automatically initiate supplemental tasks related to the user's actions during the virtual session, without requiring additional user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the system waits for specific user intervention to initiate supplemental tasks, then the user can maintain focus on the virtual environment without distraction, but idle time is wasted and productivity is reduced

Engineering Contradiction:
ImproveproductivityVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system automatically detects session endings through sensor data analysis and initiates supplemental tasks without requiring user intervention. The head-mounted display device monitors its own operational state and autonomously transitions to supplemental tasks, making the system self-serving and eliminating wasted idle time.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary detection of session ending gestures before the user would naturally initiate supplemental tasks. By detecting patterns such as removal of the HMD or reorientation to a predetermined orientation, the system prepares and initiates supplemental tasks in advance, maximizing the utilization of idle time.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If the system automatically detects session endings and initiates supplemental tasks, then productivity is enhanced by utilizing idle time, but the risk of false detection and inappropriate task initiation increases

Engineering Contradiction:
ImproveproductivityVSAvoiddetection accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system continuously monitors sensor data and provides feedback loops to verify detected gestures before initiating supplemental tasks. Multiple sensor inputs (accelerometer, gyroscope, magnetometer) are cross-validated to confirm the session ending gesture, reducing false detections and ensuring reliable automatic task initiation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system monitors changes in multiple parameters simultaneously (orientation, acceleration, magnetic field) to detect session ending gestures. By analyzing patterns across multiple parameters rather than relying on a single threshold, the system achieves more accurate detection and reduces false positives while maintaining high productivity.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If sensors continuously monitor for session ending gestures, then automatic detection accuracy is improved, but energy consumption increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system employs periodic sampling of sensor data rather than continuous monitoring. Sensors are activated at intervals to detect session ending gestures, reducing energy consumption while maintaining sufficient detection accuracy. The periodic action allows the system to balance monitoring precision with power efficiency in the head-mounted display device.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentEP3548995B1End of session detection in an augmented and/or virtual reality environment
Publication Date: 2023.11.01 GOOGLE LLC
  • EP3548995B1 patent drawingFigure 1
  • EP3548995B1 patent drawingFigure 2A~2B
  • EP3548995B1 patent drawingFigure 3

AI summary

In an augmented reality and/or a virtual reality system, termination of a virtual session, and/or suspension of a virtual session, may be detected based on detection of a position and/or orientation of a head mounted display device, and/or movement and position/orientation of the head mounted display device worn by the user. Follow on processing, and/or supplemental tasking, associated with the recently terminated virtual session, may be automatically initiated in response to the detection of the termination and/or suspension of the virtual session, without user intervention and/or manual input of a command instructing the system to initiate processing.