Gaze Tracking for Social Situation Recognition Assessment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing tools lack the ability to accurately assess and train children with autism to recognize and cope with various social situations due to varying factors in emotional responses and social situation patterns.
Innovation Solution
A cognitive ability analysis device that utilizes eye tracking to analyze gaze information, combined with pre-designated clue areas and neural network models, to determine cognitive abilities in social situations by evaluating gaze duration and response to questions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional assessment tools are used to evaluate social situation recognition, then the assessment process is simple, but the measurement precision is insufficient to accurately assess cognitive abilities in various social situations
Solution Approach 1:
The assessment system is segmented into multiple independent modules: gaze tracking module, facial expression recognition module, voice analysis module, and situation judgment module. Each module independently processes specific aspects of social cognition, allowing comprehensive assessment while maintaining modular complexity that can be adjusted based on assessment needs.
Solution Approach 2:
The patent introduces a computer-based assessment system as an intermediary between the child and the assessment process. This intermediary objectively captures gaze patterns, facial expressions, and voice characteristics, transforming subjective social cognition assessment into measurable data without requiring direct human observation and interpretation.
2Measurement precision
If comprehensive gaze tracking data is collected to improve assessment accuracy, then the measurement precision increases, but the loss of time increases due to extensive data collection and processing
Solution Approach 1:
The system pre-designates specific clue areas within social situation images before presentation to the child. These pre-defined regions of interest guide the gaze tracking analysis, allowing the system to focus computational resources on critical areas rather than analyzing the entire image, thus reducing processing time while maintaining assessment accuracy.
Solution Approach 2:
The system collects gaze data at high frequency (every 10ms) and analyzes multiple parameters (gaze position, duration, sequence), which appears excessive. However, this excessive data collection enables the system to identify subtle gaze patterns that indicate social cognition abilities, with the benefit that not all data points are equally weighted in the final assessment.
3Measurement precision
If multiple parameters including gaze duration and sequence are analyzed to improve cognitive ability assessment, then the measurement precision improves, but the device complexity increases due to multiple sensors and processing requirements
Solution Approach 1:
The computer system serves multiple functions: it presents social situation images, tracks gaze movements, recognizes facial expressions, analyzes voice characteristics, and integrates all this data to assess cognitive abilities. This multi-functionality consolidates what would otherwise require multiple separate devices into a single universal assessment platform.
Solution Approach 2:
The system automatically processes and integrates data from multiple sources (gaze tracking, facial recognition, voice analysis) without requiring manual intervention. The computer autonomously correlates gaze patterns with facial expressions and voice characteristics to generate comprehensive cognitive ability assessments, reducing the need for manual data processing and analysis.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate evaluation of social situation recognition and provides a training tool for children with autism to improve their social skills by identifying deceptive situations and reactions to clue information areas.
Implementation Method 1
a gaze acquisition unit that acquires gaze information of a point where a user gazes at the content
Data Source
AI summary
A cognitive ability analysis device according to an embodiment may include a content unit that provides content in which an area that serves as a clue for determining social situations is pre-designated; a gaze acquisition unit that acquires gaze information of a point where a user gazes at the content; a query unit that presents a question related to the content and acquires an answer from the user; a determination unit that determines user's cognitive ability for social situations based on the gaze information and answer from the user.