Human State Estimation Using Microsaccade Profile Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing human state estimation devices, such as those based on fixational eye movement, cannot accurately identify psychological, emotional, and thinking states, particularly in contexts like operating electronic devices, where states like confusion, irritation, or pleasure/displeasure are not effectively determined.

Innovation Solution

A human state estimating device that uses high-resolution video of eyeball movement to extract microsaccade components, incorporating personal attribute information like age and visual acuity, to generate accurate profiles for estimating psychological, emotional, and thinking states by matching reference data, improving accuracy through frequency analysis and dynamic characteristics analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If fixational eye movement checking device is used to determine brain function-related disorders, then abnormality detection capability is improved, but human state identification capability deteriorates

Engineering Contradiction:
Improveabnormality detection capabilityVSAvoidhuman state identification capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The invention segments the fixational eye movement into multiple components (microsaccade horizontal component, microsaccade vertical component, drift, tremor) and analyzes each component separately. This segmentation allows the system to distinguish between pathological abnormalities and normal variations in eye movement, thereby improving both abnormality detection capability and human state identification capability simultaneously

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention adds multiple dimensions of analysis to eye movement measurement by incorporating not only the traditional abnormality detection but also personal attribute information (age, visual acuity, illness state) and multiple eye movement components. This dimensional expansion enables the system to identify diverse human states including psychological, emotional, and thinking states alongside brain function disorders

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If conventional fixational eye movement analysis is used, then device complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improveanalysis system complexityVSAvoidhuman state estimation accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The invention performs preliminary actions by pre-storing reference data that maps eye movement profiles to human states and personal attributes. This pre-prepared reference database allows the system to achieve high measurement precision through pattern matching without requiring complex real-time analysis algorithms, thus maintaining relatively simple device complexity while improving human state estimation accuracy

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8790280B2Human state estimating device and method
Publication Date: 2014.07.29 PANASONIC HOLDINGS CORP
  • US8790280B2 patent drawing
  • US8790280B2 patent drawing
  • US8790280B2 patent drawing

AI summary

To provide a human state estimating device which accurately estimates a human state. The human state estimating device includes: a storage unit (16) which stores reference data (17) in which a human state and a reference profile including a horizontal component of a standard microsaccade in the human state are corresponded to each other, for each of plural personal attribute information; a video obtaining unit (11) which obtains video of a user's eyeball, with an eyeball rotation angle accuracy of 0.05 degrees or higher, and a measuring speed of 120 samples per second or higher; an analyzing unit (12) which generates an actual-measurement profile including the horizontal component of the microsaccade, from fixational eye movement shown in the video; a personal attribute information obtaining unit (13) which obtains the user's personal attribute information; and an analyzing unit which estimates the human state by searching, in the reference data (17), for a reference profile that corresponds to the obtained personal attribute information and is closest to the actual-measurement profile.