Person State Detection Using Skeletal Height Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for detecting a person's state from images struggle with accuracy, especially when the person is not standing upright and when only two-dimensional images are used, lacking reliable methods to estimate height and detect posture accurately.

Innovation Solution

A person state detection apparatus and method that acquires a two-dimensional image, detects a skeletal structure, estimates the height of a person standing upright based on the skeletal structure, and detects the person's state by comparing the estimated height with the height of the person's area in the image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the posture of the person is detected based on a change of the image area of the person, then the detection process is simple, but it is not possible to accurately detect the posture of the person depending on the posture of the person

Engineering Contradiction:
Improvedetection process complexityVSAvoidposture detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the person's body into multiple key points (joints, head, etc.) and connects them to form a skeletal structure. This segmentation allows accurate detection of various postures by analyzing the spatial relationships between body parts, resolving the contradiction between simple detection process and accurate posture detection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent estimates the third dimension (depth/height) from two-dimensional image data by using the skeletal structure and geometric relationships. This dimensionality transformation enables accurate height estimation and posture detection in 3D space while processing only 2D images, improving measurement precision without requiring complex 3D imaging equipment.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If three-dimensional information of the distance image is acquired to determine the posture of a person, then the posture detection accuracy is improved, but it requires complex three-dimensional imaging equipment and processing

Engineering Contradiction:
Improveposture detection accuracyVSAvoidimaging equipment complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses the detected skeletal structure as an intermediary to bridge 2D image data and 3D posture information. By extracting key body points and their relationships from the 2D image, then using geometric calculations to estimate 3D coordinates, the system achieves accurate posture detection without requiring complex 3D imaging equipment.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces complex mechanical 3D imaging systems with computational methods. Instead of using multiple cameras or depth sensors to directly capture 3D information, the system uses 2D image processing combined with skeletal model-based geometric calculations to infer 3D posture, significantly reducing device complexity while maintaining accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If only two-dimensional image data is used to detect the state of the person, then the system is simple and cost-effective, but it is difficult to accurately detect the state of the person

Engineering Contradiction:
Improvesystem complexityVSAvoidstate detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent changes the parameters used for detection from simple image area metrics to skeletal structure parameters (coordinates of key points, distances between joints, angles of body segments). This parameter transformation enables accurate state detection from 2D images by leveraging the geometric information embedded in the skeletal structure.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent effectively adds a dimensional aspect to 2D image analysis by estimating depth information through skeletal geometry. By calculating the spatial relationships between body joints and projecting them into 3D space, the system extracts height and posture information from 2D images, improving state detection accuracy while maintaining system simplicity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS12236704B2Person state detection apparatus, person state detection method, and non-transitory computer readable medium storing program
Publication Date: 2025.02.25 NEC CORP
  • US12236704B2 patent drawing
  • US12236704B2 patent drawing
  • US12236704B2 patent drawing

AI summary

A person state detection apparatus (10) according to the present disclosure includes an acquisition unit (11) for acquiring a two-dimensional image obtained by capturing a person, a skeletal structure detection unit (12) for detecting a two-dimensional skeletal structure of the person based on the acquired two-dimensional image, an estimation unit (13) for estimating a height of the person standing upright in a two-dimensional image space based on the detected two-dimensional skeletal structure, and a state detection unit (14) for detecting the state of the person based on a height of an area where the person is present in the two-dimensional image.