Haptic Retargeting for Enhanced Reality Input Arms

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented and virtual reality systems face challenges in providing realistic haptic feedback for users interacting with virtual objects, as active force feedback implementations are costly and complex.

Innovation Solution

An enhanced reality system with an input device comprising a pair of elongated arms, a tracking system, and a haptic retargeting module that simulates the touching of virtual objects by adjusting the spacing between the arms, providing haptic feedback that translates physical interactions into virtual touching, using sensors and haptic feedback devices to mimic the feel of real objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If active force feedback is used to provide realistic haptic feedback for virtual objects, then the haptic realism is improved, but the device complexity and cost increase

Engineering Contradiction:
Improvehaptic feedback realismVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses visual copying to create the illusion of haptic feedback. Instead of implementing complex active force feedback systems, the system creates a visual copy of the input device within the virtual environment that mimics the physical device's appearance and movement. This visual representation is positioned and oriented to match the physical device, providing the user with a realistic perception of interacting with virtual objects through purely visual means rather than complex mechanical haptic systems.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces mechanical haptic feedback systems with a visual-based solution. Instead of using motors, springs, or other mechanical components to provide force feedback, the system substitutes these mechanical elements with visual rendering techniques. The visual output device displays a virtual representation of the input device and its interaction with virtual objects, eliminating the need for complex mechanical haptic feedback mechanisms while maintaining the user's perception of realistic interaction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If active force feedback is implemented to simulate touching virtual objects, then the user experience is improved, but the manufacturing cost increases

Engineering Contradiction:
Improveuser experienceVSAvoidmanufacturing cost
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The system creates a visual copy of the physical input device within the virtual environment. This virtual copy includes the same appearance, structure, and spatial relationships as the physical device, allowing users to perceive their actions as if they are directly manipulating virtual objects. The visual copying approach provides an enhanced user experience without requiring expensive haptic feedback hardware, thereby reducing manufacturing costs.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The visual representation of the input device serves as an intermediary between the physical device and the virtual objects. This visual mediator creates the perceptual bridge that allows users to feel as though they are touching virtual objects, when in reality they are only moving the physical device in air. This intermediary visual layer provides realistic user experience while avoiding the need for expensive direct haptic feedback mechanisms.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If the virtual representation of arms converges at the same rate as physical arms, then the tracking accuracy is improved, but the haptic illusion of touching virtual objects is reduced

Engineering Contradiction:
Improvetracking accuracyVSAvoidhaptic illusion
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements dynamic adjustment of the virtual arms' convergence behavior based on the operational context. When the physical arms are moving apart, the virtual arms follow with accurate tracking. When the physical arms converge toward each other, the virtual arms converge at a slower rate, creating dynamic adaptation that maintains the haptic illusion. This dynamic behavior allows the system to switch between accurate tracking and illusion-preserving modes depending on the arm positions and movements.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the convergence rate parameter of the virtual arms based on their spatial relationship. When virtual arms are far apart, they track physical arms at the same rate for accurate representation. When virtual arms approach each other, the convergence rate is reduced to prevent the visual representation from showing the arms touching, thereby maintaining the haptic illusion that the user is touching a virtual object. This parameter adjustment preserves both tracking accuracy and haptic realism.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11226674B2Enhanced reality system with haptic retargeting
Publication Date: 2022.01.18 HEWLETT PACKARD DEVELOPMENT COMPANY LP
  • US11226674B2 patent drawing
  • US11226674B2 patent drawing
  • US11226674B2 patent drawing

AI summary

An enhanced reality system, in an example, includes an input device, the input device including a first arm and a second arm configured to be held together by a user; a sensor to sense, at least, a relative position of at least a portion of the first and second arms; wherein sensing, at least, the relative position of the first and second arms comprises a haptic retargeting process that simulates a touching of ends of the first and second arms to the outer surface of a virtual object presented in the enhanced reality environment.