Non-contact Sleep State Detection Using Facial Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current home network systems lack an effective method for determining and managing a user's sleep state and providing corresponding control over home appliances in a non-contact manner.

Innovation Solution

A user terminal and sleep management method that utilize a sleep data acquisition apparatus to detect heart rate, respiration rate, and movement, generating sleep data which is then used to determine the sleep state and provide sleep information, allowing for the control of home appliances based on the user's sleep state.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If contact-based sleep detection methods are used, then measurement precision is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvesleep state detection accuracyVSAvoiduser convenience
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces contact-based mechanical sensors with optical sensors (camera) to detect sleep states. The camera captures facial images non-contactly, and image processing algorithms analyze facial muscle movements, eye closure, and other physiological indicators to determine sleep stages, thereby maintaining measurement precision while improving ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary image processing system that mediates between the user and the detection system. The processing unit analyzes facial images to extract sleep-related information without requiring direct contact with the user's body, thus achieving both accurate sleep state detection and non-intrusive operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple sensors are deployed to improve sleep detection accuracy, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvesleep information accuracyVSAvoidsystem configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the camera serve multiple functions: it captures facial images for sleep detection, records video for later analysis, and can potentially monitor other physiological parameters. This multi-functionality allows the system to achieve comprehensive sleep monitoring without adding dedicated sensors for each function, thereby reducing device complexity while maintaining measurement precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines multiple detection capabilities into a single imaging system. By merging sleep stage detection, sleep duration measurement, and sleep quality assessment into one integrated camera-based system with centralized image processing, the patent reduces the number of separate components needed while maintaining comprehensive and accurate sleep monitoring.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentEP3345534B1User terminal and sleep management method
Publication Date: 2022.10.19 SAMSUNG ELECTRONICS CO LTD
  • EP3345534B1 patent drawingFigure 1
  • EP3345534B1 patent drawingFigure 2
  • EP3345534B1 patent drawingFigure 3

AI summary

Disclosed herein are a sleep management method includes obtaining sleep data of a user, obtaining a sleep state of the user on the basis of the sleep data, and controlling at least one home appliance on the basis of the sleep state of the user, and the sleep data includes signals corresponding to a heart rate, respiration rate, and movement of the user detected by a piezoelectric sensor.