VR AR Hand Interaction Neutral Zone Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional user interfaces for Virtual Reality (VR) and Augmented Reality (AR) environments are difficult to use, especially for new users, as they lack intuitiveness when interacting with objects, often resulting in accidental movements and non-intuitive interactions.

Innovation Solution

A method and device that render an overlay on a display, calculating the position of a centre indicator based on user hand positions and enabling actions relative to a neutral zone, allowing users to perform specific actions like zooming, rotating, or moving objects by detecting hand movements and gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional user interfaces are used for VR/AR object interaction, then basic functionality is provided, but the interface becomes difficult to use and non-intuitive especially for new users

Engineering Contradiction:
Improveintuitiveness of object interactionVSAvoidcomplexity of interaction system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a neutral zone as an intermediary element between the user's hand and the virtual object. This neutral zone acts as a mediator that provides visual feedback and defines interaction boundaries, making the interaction more intuitive. The neutral zone is displayed on the overlay and shows where the user's hand should be positioned to perform actions, serving as a guide for users without requiring them to understand complex interaction mechanics.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system provides continuous visual feedback through the overlay display showing the user's hand position relative to the neutral zone. This feedback mechanism helps users understand their interaction state and adjust their hand position accordingly. The neutral zone visually indicates when actions will be triggered, providing predictive feedback that enhances intuitiveness without increasing system complexity.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If hand-based interaction is enabled in VR/AR, then natural interaction is achieved, but accidental movements and non-intuitive interactions occur

Engineering Contradiction:
Improvenaturalness of interactionVSAvoidaccuracy of intended action
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The neutral zone acts as a preliminary anti-action mechanism by requiring the user's hand to be positioned within a specific zone before triggering an action. This prevents accidental movements from activating unintended actions, as the system checks whether the hand is within the neutral zone boundaries before executing commands. The neutral zone creates a buffer that counteracts unintended interactions.

Inventive Principle:
Principle #9Preliminary anti-action

Solution Approach 2:

The overlay with the neutral zone serves as an intermediary layer between the user's natural hand movements and the system's action execution. This intermediary provides a visual reference that helps users understand the relationship between their hand position and the actions that will be triggered, reducing accidental movements while maintaining natural interaction paradigms.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If visual overlay is displayed to show hand position, then interaction guidance is provided, but user experience may be obscured

Engineering Contradiction:
Improveinteraction guidanceVSAvoidobscuration of VR/AR environment
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The overlay is designed with local quality by displaying information only in specific regions where it is most useful - primarily around the neutral zone and hand position indicators. The overlay does not uniformly cover the entire view but concentrates visual information where needed for interaction guidance, minimizing obscuration of the VR/AR environment while providing necessary guidance.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system applies partial action by displaying only the essential elements of the overlay (neutral zone, hand position indicators) without showing all possible interaction information simultaneously. This selective display provides sufficient guidance for interaction while avoiding excessive visual information that could obscure the VR/AR environment and overwhelm the user.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11762476B2Device and method for hand-based user interaction in VR and AR environments
Publication Date: 2023.09.19 INTERDIGITAL CE PATENT HOLDINGS SAS
  • US11762476B2 patent drawing
  • US11762476B2 patent drawing
  • US11762476B2 patent drawing

AI summary

A virtual reality (VR) or augmented reality (AR) system detects through a camera when a user's hand positions match a predefined position and in response thereto renders an overlay including a crown with which the user can interact to lock onto an object or scene. The system then detects and renders a centre indicator of the crown, tracking the user's hands, enables or disables actions depending on the position of the centre indicator relative to a neutral zone, responds to user hand movement to implement actions, and also detects unlock of the object or scene.