Haptic Feedback Using Field of View Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Many display devices and virtual reality systems lack haptic feedback capabilities, failing to provide immersive experiences by not offering tactile sensations relevant to the content or interactions within the user's field of view.

Innovation Solution

A system and method that utilize sensors to detect a user's field of view and eye gaze, determining haptic effects based on the content within the view, distance, and eye movement, transmitting signals to a processor which then outputs appropriate haptic feedback through haptic output devices, such as smartwatches or wearable devices, to simulate tactile interactions with virtual objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If haptic feedback capabilities are added to display devices, then user immersion and engagement are improved, but device complexity increases

Engineering Contradiction:
Improvehaptic feedback capabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies multi-functionality by enabling display devices to perform both visual display and haptic feedback functions through integrated sensors and processors. The system uses existing display device components (sensors, processors) to detect user gaze and generate haptic effects, allowing one device to serve multiple purposes without requiring entirely separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements nesting by embedding haptic feedback functionality within the existing display device architecture. Sensors and processors are integrated into the display device structure, with haptic output devices positioned to deliver feedback in conjunction with the display elements, creating a layered functional integration.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Adaptability or versatility

If haptic feedback is provided for all content on display, then user engagement is improved, but energy consumption increases

Engineering Contradiction:
Improvehaptic feedback coverageVSAvoidenergy consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent applies local quality by providing haptic feedback selectively based on the user's field of view and gaze direction rather than uniformly across all display content. The system determines which specific content elements warrant haptic feedback by analyzing sensor data about user attention, concentrating energy expenditure on locally relevant interactions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by generating haptic effects only for content within the user's field of view or that the user is actively gazing at, rather than providing feedback for all displayed content simultaneously. This selective approach reduces overall energy consumption while maintaining engagement for relevant content.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If multiple sensors are integrated to detect field of view and eye gaze, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvefield of view detection accuracyVSAvoidsensor integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies merging by combining multiple sensor types (cameras, gyroscopes, accelerometers) into an integrated sensor system within the display device. These sensors work together to detect field of view and eye gaze directions, with their data processed by a unified processor to determine haptic feedback parameters, reducing overall system complexity through integration.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3343326B1Haptic feedback using a field of view
Publication Date: 2021.11.17 IMMERSION CORP
  • EP3343326B1 patent drawingFigure 1
  • EP3343326B1 patent drawingFigure 2
  • EP3343326B1 patent drawingFigure 3

AI summary

One illustrative system disclosed herein includes a computing device in communication with a display device and a sensor. The display device is configured to display a plurality of content and the sensor is configured to detect a field of view of a user of the computing device relative to the display device. The sensor can transmit a signal associated with the field of view to a processor in communication with the sensor. The processor is configured to determine a direction of the field of view of the user based on the signal. The processor is also configured to determine that a content displayed by the display device and associated with a haptic effect is within the field of view of the user. The processor is also configured to determine a haptic effect associated with the content and transmit a haptic signal associated with the haptic effect. The illustrative system also includes a haptic output device configured to receive the haptic signal and output the haptic effect.