Visual Indicators for Hand Tracking in Virtual Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in judging the distance and interacting with virtual content in augmented reality environments, often inadvertently interacting with incorrect virtual objects due to the complexity of multiple virtual objects in their field of view.

Innovation Solution

A system that includes image-forming components, hand tracking devices, and physical processors to provide visual indicators, such as a virtual cursor linked with the user's hand, to aid in interacting with specific virtual objects by correlating hand location and pose with virtual objects and modifying images accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multiple virtual objects are displayed in the field of view, then the information richness is improved, but the difficulty of detecting and measuring distance increases

Engineering Contradiction:
Improvenumber of virtual objectsVSAvoiddistance judgment difficulty
Core Design Contradiction:
Quantity of substanceVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces visual indicators (highlighting, bounding boxes, distance markers) as intermediary elements between the user's hand and virtual objects. These indicators mediate the distance judgment process by providing explicit visual cues about which virtual object is nearest to the hand, eliminating the need for users to directly estimate distances in complex scenes with multiple objects.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs color changes and visual modifications to virtual objects based on their distance from the user's hand. Virtual objects are highlighted or outlined with different colors or intensities to indicate proximity, allowing users to quickly identify the nearest interactable object without having to mentally calculate distances.

Inventive Principle:
Principle #32Color changes

2Ease of operation

If visual indicators are added to indicate nearest virtual objects, then the ease of operation is improved, but the device complexity increases

Engineering Contradiction:
Improveinteraction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically determines which virtual object is nearest to the user's hand and applies appropriate visual indicators without requiring manual configuration or complex user input. The hand tracking device and processing system work together to self-determine interaction targets based on real-time hand position data, simplifying the user's task while managing system complexity through automated algorithms.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10515484B1Systems and methods to facilitate interactions with virtual content in an interactive space using visual indicators
Publication Date: 2019.12.24 META COMPANY
  • US10515484B1 patent drawing
  • US10515484B1 patent drawing
  • US10515484B1 patent drawing

AI summary

A system configured to facilitate interactions with virtual content in an interactive space may comprise one or more of a hand tracking device, a light source, an optical element, one or more physical processors, non-transitory electronic storage, and/or other components. The hand tracking device may be configured to generate output signals conveying ranges of surfaces and/or objects present in the real world. A hand of a user may be identified and tracked through three-dimensional space. A virtual cursor may be presented as positionally linked with the hand. The virtual cursor may be modified to reflect change in hand pose. As the hand comes close to virtual objects, an individual virtual object may be modified to reflect which virtual object is closest to the hand.