Gaze-Synchronized Speech Attention Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current information processing systems fail to effectively analyze and associate user attention degrees from gaze data with speech data, leading to inadequate understanding of important speech periods and corresponding image attention areas.
Innovation Solution
An information processing apparatus that analyzes gaze data to determine attention degrees and assigns important degrees to speech data, synchronizing both with a time axis for recording, allowing for the generation and display of gaze mapping data to highlight important speech and image areas.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If gaze data and speech data are processed separately without association, then processing simplicity is maintained, but the understanding of important speech periods and corresponding image attention areas is inadequate
Solution Approach 1:
The patent combines gaze data and speech data into a unified processing framework by associating them through time axis alignment. The gaze mapping data generation unit integrates both data types to create a combined representation that links speech content with visual attention patterns, thereby preventing information loss while maintaining manageable complexity through systematic integration.
Solution Approach 2:
The patent introduces gaze mapping data as an intermediary element that bridges speech data and image data. This mapping data serves as a mediator that connects the temporal information from speech with the spatial attention information from gaze, enabling the system to understand important speech periods without directly complexly processing all raw data simultaneously.
2Measurement precision
If attention degree analysis is performed on all gaze data, then comprehensive understanding of user attention is achieved, but processing time and computational resources increase
Solution Approach 1:
The patent extracts only the essential attention degree information from gaze data that is relevant to speech periods. Rather than analyzing all gaze data comprehensively, the system focuses on extracting attention metrics during periods when speech is detected, thereby achieving sufficient measurement precision for the intended application while reducing overall processing time.
Solution Approach 2:
The patent applies partial action by performing attention degree analysis selectively rather than continuously on all gaze data. The system conducts detailed attention analysis during speech periods and uses simpler processing during non-speech periods, achieving adequate precision for understanding user attention dynamics without the computational cost of exhaustive analysis.
3Ease of operation
If gaze mapping data is generated and displayed, then intuitive understanding of user attention dynamics is improved, but system complexity and data processing requirements increase
Solution Approach 1:
The patent creates a simplified representation (gaze mapping data) that copies and visualizes the essential patterns of user attention dynamics. This mapping provides an intuitive visual copy of attention behavior that is easier to interpret than raw gaze coordinates, improving ease of operation while managing system complexity through effective data representation rather than complex processing.
Data Source
AI summary
An information processing apparatus is disclosed which includes a hardware processor configured to, analyze an attention degree of a gaze of a user, on the basis of gaze data in which the gaze of the user is detected, the gaze data being input externally, and assign an important degree according to the attention degree that is analyzed with respect to speech data of the user, the speech data being input externally, and is associated with a time axis that is a same as that of the gaze data to be recorded in a memory.