Event Detection Device for True Smile Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging technologies struggle to accurately distinguish between true smiles and other types of smiles, such as fake or forced smiles, due to the subtle differences in expression.

Innovation Solution

An imaging apparatus and method that utilize an event detection device to generate an event signal from temporal changes in pixel signals, allowing for the detection of expressions by analyzing the motion of facial features, specifically determining if a smile is true based on the timing of mouth and eye movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional smile detection methods are used, then the system can detect whether a subject has a smile, but it cannot accurately distinguish true smiles from fake or forced smiles due to subtle differences

Engineering Contradiction:
Improveexpression detection accuracyVSAvoiddifficulty in distinguishing subtle expression differences
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent segments the smile detection task into multiple independent analysis components: mouth region detection, eye region detection, and temporal sequence analysis. By dividing the facial expression analysis into distinct spatial and temporal segments, the system can evaluate each component separately and combine the results to distinguish true smiles from fake smiles with higher accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a temporal dimension to the smile detection process by analyzing the sequence and timing of facial movements. Instead of only analyzing static or simultaneous facial features, the system examines the temporal order in which mouth and eye movements occur, adding a time-based dimension that enables differentiation between genuine and artificial smiles.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If the system analyzes only static facial features, then the detection process is simple, but it cannot capture the temporal dynamics that differentiate true smiles from other expressions

Engineering Contradiction:
Improveexpression type discrimination accuracyVSAvoidcomplexity of temporal analysis system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by pre-defining the expected temporal sequence of facial movements for different expression types. The system establishes reference patterns for true smiles (where mouth movement precedes eye movement) before actual detection occurs, allowing for efficient comparison and classification during real-time operation without requiring complex real-time computation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the detection parameter from static spatial features alone to include temporal parameters such as movement timing and sequence. By incorporating time-based parameters into the detection framework, the system can distinguish between expression types based on the temporal dynamics of facial muscle movements, thereby improving discrimination accuracy.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12022181B2Imaging apparatus and method of detecting expression
Publication Date: 2024.06.25 SONY GROUP CORP
  • US12022181B2 patent drawing
  • US12022181B2 patent drawing
  • US12022181B2 patent drawing

AI summary

An imaging apparatus according to an embodiment of the disclosure includes: an event detection device that outputs an event signal corresponding to a temporal change of a first pixel signal, the first pixel signal being obtained by imaging; and an expression detector that detects an expression on a basis of the event signal to be outputted from the event detection device.