Skin Luminosity Analysis for Emotion Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for measuring psychophysiological responses to choices are cumbersome and require specialized sensors, making them impractical for everyday use and decision-making support.

Innovation Solution

A system utilizing a standard camera on portable devices to capture images of a user's skin, analyzing luminosity values to determine heart rate peaks and converting them into frequency data, providing feedback on which choice is linked to a more positive mood state without the need for additional sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If specialized sensors are used to measure psychophysiological responses, then measurement precision is improved, but device complexity and cost increase

Engineering Contradiction:
Improvepsychophysiological response measurementVSAvoidsensor requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a standard camera to capture video of skin color changes as a copy or proxy for direct physiological measurement. Instead of using specialized sensors to directly measure heart rate or emotional state, the system captures optical changes in skin luminosity that correlate with these physiological parameters, thereby achieving measurement precision without specialized sensors.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical/specialized sensor system with an optical system using a standard camera. The camera captures video frames that record subtle color and luminosity changes in the skin, which are then processed to extract psychophysiological information. This substitution eliminates the need for specialized sensors while maintaining measurement capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If direct biological measurement devices are coupled to the user, then measurement precision is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvebiological response measurementVSAvoiduser convenience
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

Instead of requiring direct physical coupling with biological measurement devices, the system uses a camera to optically capture skin color changes. This indirect measurement method eliminates the need for wrist straps or other contact-based sensors, making the system as easy to use as holding a smartphone while maintaining measurement precision through optical detection of physiological changes.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical coupling of biological sensors with an optical detection system. The camera records subtle changes in skin luminosity and color that occur during emotional or physiological responses, eliminating the need for physical contact with specialized measurement devices and thereby improving ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Loss of information

If multiple types of analysis are provided, then information completeness is improved, but device complexity increases

Engineering Contradiction:
Improveanalysis comprehensivenessVSAvoidprocessing requirements
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the psychophysiological analysis into multiple distinct computational components: extracting luminosity values from video frames, detecting heart rate peaks from luminosity variations, calculating mean time between peaks, performing Fast Fourier Transform for frequency analysis, and determining emotional valence. Each segment processes a specific aspect of the data, and together they provide comprehensive analysis without requiring a single complex monolithic system.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides unobtrusive, efficient, and cost-effective feedback on emotional responses, enhancing decision-making by analyzing psychophysiological data within the user's device without sharing data with external entities, offering private analysis and insights into mood preferences.

Implementation Method 1

capture a video... determine whether said series of images depicts a test subject and extrapolate the emotional response of a detected test subject to choices displayed on the display device during a time period encompassed by said series of images wherein the extrapolation of the emotional response measures the subject's time between heart rate peaks

Methodology Applied
Scientific EffectPhotoplethysmography: Photoelectric Effect

Data Source

PatentUS9668688B2Methods and systems for content response analysis
Publication Date: 2017.06.06 MOSSBRIDGE INST LLC
  • US9668688B2 patent drawing
  • US9668688B2 patent drawing
  • US9668688B2 patent drawing

AI summary

A data processing device controls the image-recording device to capture a video, turn the video into a time series of luminance values, and analyzes the frequency spectrum of this time series. The device determines whether said series of images depicts a test subject. The device extrapolates the emotional response of a detected test subject to choices displayed on the display device during a time period encompassed by said series of images. The extrapolation of the emotional response measures the subject's time between heart rate events, the associated frequency spectrum, and where said captured video comprises a close-up depiction of a region of the subject's exposed skin.