Image Processing Apparatus 3D Body Estimation Masking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques fail to accurately mask individuals within specified regions due to camera or target position issues, leading to unintended individuals being included in the mask.

Innovation Solution

An image processing apparatus comprising image data acquisition, mask region setting, identification, body estimation, and determination units, which acquires and processes camera data to identify and mask individuals within predetermined regions by estimating body positions and determining inclusion in the mask region.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a mask region is set in a captured image to mask a person, then the person in the specified region can be masked, but an unintended person may be included in the mask target depending on camera position or capturing target position

Engineering Contradiction:
Improvemasking accuracyVSAvoidmasking reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent transitions from two-dimensional image space masking to three-dimensional space modeling. By constructing a three-dimensional space model from multiple captured images and defining the mask region in 3D space, the system accurately identifies and masks only the intended person's body across different camera positions and angles, preventing unintended persons from being included in the mask target.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a three-dimensional space model as an intermediary between the captured images and the mask region. This 3D space model serves as a mediator that integrates information from multiple camera views and enables precise determination of whether a person's body is within the mask region, resolving the contradiction between masking accuracy and reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If only person image identification is performed without body estimation, then processing is simpler, but accurate determination of whether the person's body is included in the mask region cannot be achieved

Engineering Contradiction:
Improveprocessing complexityVSAvoidbody inclusion determination accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the person detection process into two distinct stages: person image identification and body estimation. The body estimation stage further segments the body into multiple body parts, allowing precise determination of body inclusion in the mask region while maintaining organized and manageable processing complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary body estimation before conducting the final determination of whether the person's body is included in the mask region. By estimating the body and its parts in advance, the system prepares necessary information for accurate inclusion determination, improving measurement precision without excessively increasing processing complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240054804A1Image processing apparatus, image processing method, and non-transitory computer-readable medium
Publication Date: 2024.02.15 NEC CORP
  • US20240054804A1 patent drawing
  • US20240054804A1 patent drawing
  • US20240054804A1 patent drawing

AI summary

An image processing apparatus includes at least one memory storing instructions, and at least one processor. The at least one processor is configured to execute the instructions to acquire image data of a predetermined space captured by a camera, set a mask region in the space, identify a person image being an image of a person included in the image data, estimate a body of the person, based on the person image, perform determination on whether the body of the person with respect to the person image is included in the mask region, perform processing of masking the person, based on a result of the determination by a determination means.