VR Headset Hand Detection via Color Pixel Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current virtual reality head-mounted display systems lack an efficient and intuitive method for user interaction, relying on bulky controllers and not effectively utilizing hand presence and gestures for control within virtual environments.

Innovation Solution

A VR HMD system and method that divides free space into zones, detects hand presence through color pixel analysis, and uses alpha-blending with virtual reality backgrounds to enable hand control via gestures and movements, allowing users to interact with virtual objects and GUIs in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If bulky gamepad controllers and touch pads are used for user operation, then the system can provide control functionality, but the device complexity and ease of operation deteriorate due to the need for additional hardware and less natural interaction

Engineering Contradiction:
Improveuser interaction naturalnessVSAvoidcontroller hardware requirements
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the hand detection functionality from traditional controllers and implements it directly within the VR HMD system using onboard image sensors. This eliminates the need for separate bulky controllers while maintaining control capabilities through hand gesture recognition in the virtual environment.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces mechanical control interfaces (gamepad, touch pad) with an optical/electromagnetic system using image sensors to capture hand movements. The system processes visual data to detect hand presence and gestures, substituting physical mechanical inputs with visual recognition and digital signal processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If hand presence and gestures are detected using image sensors, then the ease of operation improves through more natural interaction, but the measurement precision and reliability may worsen due to challenges in accurately detecting hand movements in 3D space

Engineering Contradiction:
Improvegesture-based controlVSAvoidhand position and gesture detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors hand position and gestures through image sensors, processes this visual information to identify control intentions, and provides real-time feedback to the virtual environment. This iterative feedback loop enhances detection accuracy by adapting to user actions and environmental conditions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent transitions from 2D image sensor data to 3D spatial understanding by processing hand gesture information across multiple dimensions. The system maps hand movements in the physical world to corresponding virtual space coordinates, enabling precise gesture recognition and control in the virtual environment through dimensional transformation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10497179B2Apparatus and method for performing real object detection and control using a virtual reality head mounted display system
Publication Date: 2019.12.03 HONG KONG APPLIED SCI & TECH RES INST
  • US10497179B2 patent drawing
  • US10497179B2 patent drawing
  • US10497179B2 patent drawing

AI summary

An apparatus and method for performing real object detection and control using a Virtual Reality Head Mounted Display System, and more particularly, when the real object detection and control are detecting hand presence and control in free space, in a virtual reality environment, the control being, for example, gestures or movement, in the free space.