Gaze-Controlled Image Sound Output Device with Dynamic Mode Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image sound output devices lack an efficient mechanism to adjust the timing of changing the sound output mode in response to a user's gaze direction, which limits their effectiveness in synchronized image and sound presentations.

Innovation Solution

An image sound output device comprising a display screen, a sound output device, a gaze point detector, an area setting unit, a determination unit, and an output controller that adjusts the sound output mode based on the user's gaze position within a specific area on the screen or image, allowing for synchronized and dynamic control of image and sound presentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If gaze detection technology is applied to adjust sound output timing, then the synchronization and engagement of image and sound presentations is enhanced, but the device complexity increases due to additional components like gaze point detector, area setting unit, determination unit, and output controller

Engineering Contradiction:
Improvesynchronization efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The gaze detection device integrates multiple functions including image display, sound output, gaze point detection, area setting, determination, and output control into a single system. This multi-functionality allows the device to enhance synchronization efficiency while managing complexity by consolidating control capabilities rather than adding separate independent systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The determination unit acts as an intermediary that receives gaze position data and sound output requests, processes this information against stored determination criteria, and generates control signals for the output controller. This intermediary layer manages the complexity by centralizing the decision-making logic for synchronizing sound output with user gaze, rather than requiring direct complex interactions between all system components.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If the system continuously monitors gaze position to adjust sound output, then the responsiveness to user attention is improved, but the processing time and computational load increase

Engineering Contradiction:
ImproveresponsivenessVSAvoidprocessing time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system performs preliminary actions by storing determination criteria in advance in the determination unit's storage. These pre-stored criteria include conditions for adjusting sound output based on gaze position. By having these decision rules prepared beforehand, the system can quickly compare real-time gaze data against predefined conditions without performing complex computations during real-time operation, thus improving responsiveness while minimizing processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements partial monitoring by focusing gaze detection on specific areas of interest rather than continuously analyzing the entire display area. The area setting unit defines specific regions where gaze detection is performed, allowing the system to maintain responsiveness to user attention in critical areas while reducing the overall computational load and processing time required for comprehensive monitoring.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient adjustment of sound output timing and mode in response to user gaze, enhancing the synchronization and engagement of image and sound presentations.

Implementation Method 1

The corneal reflection technique applies infrared light that is emitted from light sources to a subject, images, with cameras, the eyes of the subject to which the infrared light is applied, detects the positions of the pupils with respect to corneal reflection images that are reflected images of the light sources on the cornel surfaces

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS10691203B2Image sound output device, image sound output method and image sound output program
Publication Date: 2020.06.23 JVC KENWOOD CORP
  • US10691203B2 patent drawing
  • US10691203B2 patent drawing
  • US10691203B2 patent drawing

AI summary

A gaze detection device includes a display screen configured to display an image; a sound output device configured to output a sound; a gaze point detector configured to detect a position of a point of gaze of an observer observing the display screen; an area setting unit configured to set a specific area on the display screen or part of the image; a determination unit configured to, when the specific area is set on the display screen or the image, determine whether the point of gaze is within the specific area on the basis of a result of the detecting the position of the point of gaze; and an output controller configured to cause the display screen to display the image and cause the sound output device to output the sound and adjust at least a mode in which the sound is output.