Image Processing Apparatus for Simultaneous Whole Body and Small Motion Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies fail to simultaneously obtain information on the motion of a whole body and small motions of a subject using range images, such as those from range image sensors, which is essential for human behavior analysis.

Innovation Solution

An image processing apparatus that includes components to obtain first and second part information from range images of different areas, generate a transformation function to align these images in a common coordinate system, and combine the information for comprehensive analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a single range image sensor is used to capture the whole body, then the coverage area is sufficient, but the measurement precision of small body parts is insufficient

Engineering Contradiction:
Improvecoverage areaVSAvoidmeasurement precision of small body parts
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent divides the imaging task into two segments: a first range image sensor captures the whole body at a larger area, while a second range image sensor captures a specific body part at a smaller, higher-resolution area. This segmentation allows each sensor to be optimized for its specific function, resolving the contradiction between coverage area and measurement precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by using a second range image sensor with higher measurement precision specifically for capturing detailed information of a particular body part, while the first sensor maintains broader coverage. The combined information integrates the high-quality local data with the global context.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If multiple range image sensors are used to capture both whole body and small motions, then the measurement precision improves, but the device complexity increases

Engineering Contradiction:
Improvemeasurement precision of small body partsVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an information combination unit as an intermediary that integrates the first part information from the whole body image with the second part information from the close-up image. This intermediary component coordinates the data from multiple sensors, managing the complexity by providing a structured approach to data fusion.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The information combination unit serves multiple functions: it aligns coordinate systems, integrates data from different sensors, and produces combined information that captures both global and local motion. This multi-functionality reduces the need for separate processing systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If high-performance sensors are used to capture detailed small motions, then the measurement precision improves, but the cost increases

Engineering Contradiction:
Improvemeasurement precision of small body partsVSAvoidcost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

Instead of using a single high-performance sensor for the entire field of view, the patent segments the imaging function so that only a specific region is captured with high precision by the second sensor. This allows the use of lower-cost sensors for the majority of the coverage area while maintaining high precision where needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by concentrating high measurement precision capabilities only in the region of interest (specific body part), while other regions are captured with standard precision. This localized approach to quality reduces the overall system cost while maintaining the required measurement precision for critical areas.

Inventive Principle:
Principle #3Local quality

Data Source

PatentEP3336799B1Image processing apparatus and image processing method combining views of the same subject taken at different ranges
Publication Date: 2020.02.12 HITACHI LG DATA STORAGE INC
  • EP3336799B1 patent drawingFigure 1
  • EP3336799B1 patent drawingFigure 2
  • EP3336799B1 patent drawingFigure 3~4

AI summary

To simultaneously figure out information on a motion of the whole body of a subject and information on a small motion of a certain part of the subject by using range images obtained by imaging the subject, an image processing apparatus 100 is configured to obtain first part information from a first range image obtained by imaging a first area of the subject, the first part information being information on a part of the subject, to obtain second part information from a second range image obtained by imaging a second area of the subject smaller than the first area, the second part information being information on a part of the subject, to find a transformation function based on the first part information and the second part information, the transformation function being a function that performs coordinate transformation between a first coordinate system in the first part information and a second coordinate system in the second part information, and to generate combined part information based on the transformation function, the combined part information being information representing the first part information and the second part information in the common coordinate system.