Gaze-Based Audio Adjustment via Eye Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current viewing equipment does not utilize a user's gaze point to adjust the visual and audio properties of video content, limiting the ability for users to dynamically control which elements of a scene are emphasized during video playback.

Innovation Solution

A system that automatically adjusts audio and visual settings, such as volume and focus, based on a user's gaze point by comparing gaze point coordinates to boundaries of display elements, allowing for user-specific control over the viewing experience through eye tracking technology.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If current viewing equipment is used without gaze point integration, then the device complexity remains low, but the adaptability to user preferences deteriorates

Engineering Contradiction:
Improveadaptability to user preferencesVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

An eye tracking device serves as an intermediary between the user and the video playback system. The eye tracking device captures gaze point data and transmits it to the video playback device, which then adjusts audio and visual settings based on the received gaze information. This intermediary approach enables adaptability without requiring direct integration of eye tracking functionality into the core playback device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements a feedback loop where the eye tracking device continuously monitors the user's gaze point, and the video playback device adjusts audio and visual properties in real-time based on this feedback. The system compares the gaze point coordinates to boundaries of display elements and dynamically modifies the presentation to emphasize the element the user is viewing, creating a closed-loop adaptive system.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If gaze point tracking is integrated into viewing equipment, then the adaptability to user interests improves, but the device complexity increases

Engineering Contradiction:
Improvedynamic control capabilityVSAvoidsystem structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system is divided into separate functional modules: an eye tracking device for capturing gaze data, a video playback device for processing and adjusting content, and associated processors for comparing gaze coordinates to display element boundaries. This segmentation allows each component to perform its specific function without requiring all features to be integrated into a single complex device.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The video playback device serves multiple functions: it plays back video content, receives and processes gaze point data from the eye tracking device, compares gaze coordinates to display element boundaries, and dynamically adjusts audio and visual properties. This multi-functionality reduces the need for separate dedicated devices for each task.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If audio and visual properties are dynamically adjusted based on gaze point, then the user viewing experience improves, but the ease of operation deteriorates

Engineering Contradiction:
Improveuser control effortVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system enables self-service operation where the user's natural eye movements automatically control the audio and visual properties of the video content. The eye tracking device captures gaze point data, and the video playback device automatically adjusts settings without requiring the user to manually intervene or make operational decisions. The system serves itself by using the user's inherent viewing behavior as the control input.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical control (buttons, remote controls, sliders) with an optical-based eye tracking system. Instead of requiring physical interaction to adjust audio and visual properties, the system uses optical sensors to detect gaze point coordinates and automatically translates this information into playback parameter adjustments, substituting mechanical control with optical detection and automated processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS8854447B2Systems and methods for automatically adjusting audio based on gaze point
Publication Date: 2014.10.07 ADEIA GUIDES INC
  • US8854447B2 patent drawing
  • US8854447B2 patent drawing
  • US8854447B2 patent drawing

AI summary

Embodiments provide methods and systems for adjusting audio output based on eye tracking input. In some embodiments, a memory stores data defining a boundary based on a coordinate system. The boundary corresponds to a display element of displayed content. An input receives data indicating coordinates of a gaze point location of a user viewing the displayed content. A processor compares the received coordinates of the gaze point location to the boundary corresponding to the display element to determine whether the gaze point location is inside the boundary corresponding to the display element. In response to determining that the gaze point location is inside the boundary corresponding to the display element, the processor adjusts an audio setting of the displayed content.