VR Gesture Control via Camera Superimposition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users of low-price virtual reality devices face difficulties in interacting with their surroundings due to the obstruction caused by helmets, making it hard to accurately move their hands for gesture recognition by cameras.

Innovation Solution

A method and device that display a second image in response to a gesture detecting signal, recognize actual gestures, and convert them into graphic pointers for interaction, allowing users to control virtual reality interactions with ease by superimposing the first image onto the second image using Alpha Blending and preprocessing techniques like zooming and de-noising.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a helmet is worn for virtual reality immersion, then virtual reality interaction capability is improved, but the user's ability to acknowledge the surrounding environment and accurately position their hand for gesture recognition deteriorates

Engineering Contradiction:

Improvevirtual reality interaction capabilityVSAvoidhand positioning accuracy for gesture recognition

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent introduces a camera as an intermediary device to capture the user's hand gestures. Instead of relying on the user's direct visual feedback (which is blocked by the helmet), the camera acts as a mediator to detect and recognize gestures, converting physical hand movements into controllable inputs for the virtual reality system.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy of the user's hand gesture through camera imaging. The captured image of the hand is processed and displayed back to the user, allowing them to see their gesture without removing the helmet. This copying mechanism enables closed-loop feedback for gesture control while maintaining immersive VR experience.

Inventive Principle:

Principle #26Copying

2Device complexity

If no additional hardware is added to Hand Gesture for Mobile VR, then device complexity is reduced, but the user cannot accurately move their hand into a detectable region due to helmet obstruction

Engineering Contradiction:

Improvehardware configurationVSAvoidgesture detection accuracy

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

The camera serves multiple functions: it captures the user's hand gestures for recognition, provides visual feedback to the user about their gesture positioning, and enables interaction control. This multi-functionality allows the system to achieve accurate gesture detection without adding dedicated sensors or tracking devices, thereby maintaining low device complexity while improving measurement precision.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS10168790B2Method and device for enabling virtual reality interaction with gesture control

Publication Date: 2019.01.01 ARCSOFT CORP LTD

AI summary

The present invention is a method for enabling virtual reality interaction with gesture control, comprising the following steps: displaying a photographed second image in response to a gesture detecting signal; recognizing an actual gesture action in the second image and converting the same into a graphic pointer; and displaying a first image and displaying the graphic pointer at a position corresponding to the first image for interaction. A user may conduct control directly with a gesture to enable virtual reality, thereby solving the problem where the user cannot see an actual scenario as well as increasing the ease of use for virtual reality.