Auditory Attention Estimation Using Visual Stimulus Pupil Correlation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is no established method to estimate the destination of auditory attention based on pupil diameter changes, specifically for auditory stimuli, as the relationship between auditory attention and pupil diameter changes is unknown.
Innovation Solution
A method is developed to estimate the destination of auditory attention by obtaining a feature quantity from the correlation between different visual stimulus patterns and pupil diameter changes, using a system that includes learning and auditory attention state estimation apparatuses to determine the sound source to which a user is paying attention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a method to estimate auditory attention destination based on pupil diameter changes is developed, then the capability to estimate auditory attention is improved, but the technical knowledge base and established methods are lacking
Solution Approach 1:
The patent introduces visual stimulus patterns as an intermediary element to bridge the gap between auditory attention and pupil diameter measurements. By presenting visual stimuli synchronized with auditory inputs and measuring corresponding pupil diameter changes, the system creates a measurable pathway to infer auditory attention destinations without direct auditory-pupil relationship knowledge
Solution Approach 2:
The patent uses visual stimulus patterns that copy or represent the temporal and spatial characteristics of auditory inputs. By creating visual representations of auditory signals and measuring pupil responses to these visual copies, the system indirectly captures auditory attention information through a well-understood visual-pupil relationship
2Measurement precision
If visual stimulus patterns are used to estimate auditory attention, then the estimation capability is improved, but the system complexity increases
Solution Approach 1:
The patent employs a multi-functional system where the same apparatus generates both visual stimuli and auditory stimuli, and the same measurement system captures both visual and physiological responses. This universal approach allows the system to perform multiple functions (stimulus presentation, response measurement, correlation analysis) using integrated components, thereby managing complexity while enabling cross-sensory attention estimation
3Measurement precision
If correlation analysis between visual stimulus patterns and pupil diameter changes is performed, then the feature quantity for estimation is improved, but the data processing complexity increases
Solution Approach 1:
The patent utilizes periodic visual stimulus patterns with specific frequencies to elicit measurable pupil diameter oscillations. By employing periodic stimulation and analyzing the frequency-domain characteristics of pupil responses, the system extracts meaningful feature quantities through rhythmic patterns that amplify attention-related signals while filtering out noise, thereby simplifying the correlation analysis process
Data Source
AI summary
A feature quantity based on the strength of a correlation between each of a plurality of different visual stimulus patterns corresponding to a plurality of different sound sources and a pupil diameter change amount of a user is obtained, and a destination to which the user pays auditory attention for a sound from the sound source is estimated using the feature quantity.