Sightline Detection for User State Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods lack an effective way to estimate the state of a mobile terminal user, particularly their attention function, which is crucial for improving the functionality of mobile devices.
Innovation Solution
A state estimation device and method that detects a user's sightline and estimates their state, including attention function degradation, by analyzing motion with respect to the displayed image, using processing circuitry to determine top-down and bottom-up attention indices and execute appropriate estimation processing based on the user's task and environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sightline detection and motion analysis are implemented to estimate user state, then measurement precision of user attention state is improved, but device complexity increases due to additional detection sections and processing circuitry
Solution Approach 1:
The sightline detection section and processing circuitry serve multiple functions: detecting sightline position, analyzing motion characteristics, calculating attention indices, and estimating user state. This multi-functionality reduces the need for separate dedicated components for each function, thereby improving measurement precision while limiting the increase in device complexity.
Solution Approach 2:
The processing circuitry acts as an intermediary between the sightline detection section and the user state estimation. It calculates top-down and bottom-up attention indices as intermediate metrics that bridge the raw sightline motion data and the final user state determination, enabling accurate estimation without requiring direct complex mapping.
2Measurement precision
If top-down and bottom-up attention indices are calculated based on sightline motion, then measurement precision of attention function is improved, but loss of time increases due to additional calculation processing
Solution Approach 1:
The system pre-calculates and stores the top-down index based on sightline motion relative to points of interest, and the bottom-up index based on saliency distribution, before final user state estimation is required. This preliminary calculation of attention indices enables faster real-time user state assessment without sacrificing measurement precision.
3Reliability
If sightline motion analysis is used to detect attention function degraded state, then reliability of user state estimation is improved, but difficulty of detecting and measuring increases due to subtle motion patterns
Solution Approach 1:
The system transforms the complex, multi-dimensional sightline motion data into simplified parametric representations through the top-down and bottom-up attention indices. These indices condense subtle motion patterns into quantifiable metrics that maintain reliability in user state estimation while reducing the analytical complexity required to interpret the data.
Data Source
AI summary
A state of a user of a mobile terminal having a display for displaying an image may be estimated. A sightline detection detector detects a user's sightline of a mobile terminal that has a display for displaying an image. Processing circuitry is configured to estimate a state of the user including an attention function degraded state based on motion of the user's sightline with respect to the image displayed on the display of the mobile terminal.