VR Terminal Sensor Fusion for Line-of-Sight Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current interactive systems in the virtual reality industry have limited accuracy due to restricted data sources, leading to inadequate line-of-sight tracking and interaction in virtual scenes.

Innovation Solution

The use of multiple sensors to acquire various aspects of feature data, including biological and environmental data, which are analyzed to generate action instructions for improved interactive control, enhancing the accuracy and realism of virtual interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors are used to acquire diverse feature data, then measurement precision and interaction accuracy are improved, but device complexity increases

Engineering Contradiction:
Improveline-of-sight tracking accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensor types (cameras, gyroscopes, accelerometers, barometers, humidity sensors, temperature sensors) into an integrated sensor system within the VR glasses. These sensors are merged to collectively capture comprehensive feature data including line-of-sight information, head movement, environmental temperature, and humidity, thereby improving measurement precision while managing device complexity through integration.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensor system is designed with multi-functionality to serve multiple purposes: cameras capture line-of-sight and environmental images, gyroscopes and accelerometers track head movement, while environmental sensors monitor temperature and humidity. This universal sensor platform improves various measurement accuracies simultaneously without requiring separate dedicated systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If environmental feature data is incorporated into interactive control, then interaction accuracy is improved, but data processing complexity increases

Engineering Contradiction:
Improveinteractive control accuracyVSAvoiddata processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The data processing system is segmented into specialized modules: a sensor data acquisition module collects raw data from multiple sensors, a feature data processing module extracts relevant features, and an interactive control module generates control instructions. This segmentation allows the system to handle complex environmental and biological data through distributed processing, improving interactive control accuracy while managing overall system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary processing layer that receives raw feature data from sensors, processes and integrates this data, and then outputs refined information to the interactive control system. This intermediary module acts as a mediator between complex sensor inputs and control outputs, enhancing processing accuracy while abstracting the complexity of handling multiple data sources.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11562271B2Control method, terminal, and system using environmental feature data and biological feature data to display a current movement picture
Publication Date: 2023.01.24 HUAWEI TECH CO LTD
  • US11562271B2 patent drawing
  • US11562271B2 patent drawing
  • US11562271B2 patent drawing

AI summary

A control method includes obtaining feature data using at least one sensor, the feature data being acquired by the terminal using the at least one sensor, generating an action instruction based on the feature data and a decision-making mechanism of the terminal, and executing the action instruction. In this application, various aspects of feature data are acquired using a plurality of sensors, data analysis is performed on the feature data, and a corresponding action instruction is then generated based on a corresponding decision-making mechanism to implement interactive control.