3D Posture Estimation via 2D Projection for Unit Element Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in accurately specifying the posture of objects in a virtual space, particularly when objects are represented by sets of unit elements like face or volume elements, as it is difficult to determine the overall shape or posture from individual element positions.

Innovation Solution

An information processing apparatus and method that acquires unit element information, draws a space image using this information, and employs a posture estimation process on a two-dimensional image to specify the posture of objects in a three-dimensional space, integrating distance image data to determine joint positions and create a three-dimensional skeleton model.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Shape

If objects are represented by sets of unit elements (face elements or volume elements), then the object representation in virtual space becomes detailed and flexible, but it becomes difficult to specify the overall shape or posture of the object from individual element positions

Engineering Contradiction:
Improveobject representation detailVSAvoidposture specification difficulty
Core Design Contradiction:
ShapeVSDifficulty of detecting and measuring

Solution Approach 1:

The patent projects three-dimensional unit element data onto a two-dimensional plane to create a projected image. This dimensionality reduction transforms the complex 3D posture specification problem into a 2D image analysis problem, where standard posture estimation techniques can be effectively applied. The projected image preserves sufficient spatial relationships to enable accurate posture detection while simplifying the computational complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a projected image as an intermediary representation between the raw unit element data and the final posture specification. This intermediate 2D representation serves as a bridge that translates complex 3D spatial information into a format suitable for posture estimation algorithms, enabling accurate posture detection without directly processing the full 3D unit element set.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If posture estimation is performed directly on three-dimensional unit element data, then the theoretical accuracy should be high, but the computational complexity and processing difficulty increase significantly

Engineering Contradiction:
Improveposture estimation accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent reduces the problem from three-dimensional space to two-dimensional projection, transforming complex 3D posture estimation into a more manageable 2D image analysis task. This dimensionality reduction maintains essential spatial relationships while significantly reducing computational complexity and making the system more practical to implement.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent creates a two-dimensional projected copy of the three-dimensional unit element data. This projected image serves as a simplified representation that retains the necessary information for posture estimation while being computationally easier to process. The copy approach allows standard 2D image processing techniques to be applied effectively.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11250592B2Information processing apparatus
Publication Date: 2022.02.15 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11250592B2 patent drawing
  • US11250592B2 patent drawing
  • US11250592B2 patent drawing

AI summary

An information processing apparatus acquires, in regard to a subject in a three-dimensional space, unit element information including information regarding a position, in the space, of each of plural unit elements configuring the subject, draws a space image indicative of a state of a virtual space in which the plural unit elements are arranged using the unit element information, and specifies a posture of the subject in the three-dimensional space on the basis of a result obtained by executing a posture estimation process targeting a two-dimensional image for the drawn space image.