VR Controller Sensor Triangulation for Finger Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing handheld controllers for VR/AR systems lack sufficient immersion, impacting user experience due to inadequate sensor capabilities for precise interaction with virtual environments.

Innovation Solution

The implementation of multiple sensors on handheld controllers, including capacitive and inductive sensing, along with haptic feedback, to detect finger position, pressure, and hovering, enabling more precise control and interaction within VR/AR environments by using geometric patterns and aggregate sensor data for triangulation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors are added to improve sensing precision, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvesensing precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The controller surface is divided into multiple discrete sensor regions arranged in geometric patterns, with each sensor detecting specific spatial zones. This segmentation enables precise finger position detection through triangulation while maintaining manageable system complexity through modular sensor placement

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from traditional 2D touch detection to 3D spatial sensing by using multiple sensors in geometric arrangements that enable triangulation. This dimensional enhancement allows determination of finger position in three-dimensional space relative to the controller surface, significantly improving measurement precision

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If geometric patterns and triangulation are used to improve finger position detection, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvefinger position detection accuracyVSAvoidsensor arrangement complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Sensors are pre-arranged in specific geometric patterns (circles, hexagons, triangles) during manufacturing, establishing fixed spatial relationships before use. This preliminary configuration enables immediate triangulation calculations without requiring complex real-time sensor positioning, improving detection accuracy while managing system complexity

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If aggregate sensor data is combined to improve sensing accuracy, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvesensing accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system continuously processes aggregate data from multiple sensors to determine finger position, providing real-time feedback control. This feedback mechanism refines position accuracy by combining information from all active sensors while using established triangulation algorithms to manage computational complexity

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user control and immersion by accurately sensing finger positions and forces, allowing for detailed interaction with virtual objects and improved realism through haptic feedback.

Implementation Method 1

at least one of sensors is a hover or touch sensor using capacitive sensing to sense the position of the user's hand or one or more fingers

Methodology Applied
Scientific EffectCapacitive sensing: Capacitance

Implementation Method 2

at least one of the sensors is a force/pressure sensor using inductive sensing to sense when the user's hand or one or more fingers is in contact with the force/pressure sensor

Methodology Applied
Scientific EffectInductive sensing: Electromagnetic Induction

Data Source

PatentEP4180924A1Virtual reality / augmented reality handheld controller sensing
Publication Date: 2023.05.17 GOOGLE LLC
  • EP4180924A1 patent drawingFigure 1
  • EP4180924A1 patent drawingFigure 2
  • EP4180924A1 patent drawingFigure 3

AI summary

A method that includes employing several sensors [110] associated with a handheld controller [132], where each of the sensors is made of one of a hover, touch, and force/pressure sensor, and generating, by one or more of the sensors, sensor data associated with the position of a user's hand and finger in relation to the handheld controller. The method continues with combining the sensor data from several sensors to form aggregate sensor data, sending the aggregate sensor data to a processor, and generating an estimated position of the user's hand and fingers based on the aggregate sensor data.