3D Shape Estimation Using Polarized Light Region Division

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for estimating the three-dimensional shape of objects in real space face high processing loads and increased data amounts, often struggle with recognizing physical boundaries, leading to reduced accuracy in shape estimation.

Innovation Solution

An information processing device that divides the image plane into regions based on geometric structure information from polarized light, acquires orientation information, and estimates the object's shape in these regions, using multiple viewing points to improve accuracy and reduce processing load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional methods are used to estimate three-dimensional shape of objects, then processing can be performed, but processing load is high and data amount increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddata amount
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The image plane is divided into multiple regions based on geometric structure information distribution, and only specific regions (regions of interest) are selected for processing. This segmentation approach reduces the amount of data that needs to be processed while maintaining estimation accuracy, directly addressing the contradiction between processing efficiency and data amount.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If conventional methods are used to estimate three-dimensional shape, then processing can be performed, but physical boundaries are difficult to recognize leading to reduced accuracy

Engineering Contradiction:
Improveshape estimation accuracyVSAvoidphysical boundary recognition
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent utilizes polarized light information to detect physical boundaries, which is analogous to using optical property changes to enhance detection. By analyzing geometric structure information derived from polarized light, the system can effectively identify physical boundaries that are difficult to detect with conventional methods, thereby improving shape estimation accuracy.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent changes the detection parameter from conventional intensity-based imaging to geometric structure information based on polarized light. This parameter change enables better detection of physical boundaries and improves the accuracy of three-dimensional shape estimation by providing additional structural information about the object surfaces.

Inventive Principle:
Principle #35Parameter changes

3Area of stationary object

If the entire image plane is processed, then complete coverage is achieved, but processing load increases

Engineering Contradiction:
Improveimage plane coverageVSAvoidprocessing complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent extracts only the necessary regions (regions of interest) from the entire image plane based on geometric structure information distribution. By taking out only the relevant portions for processing while maintaining complete coverage where needed, the system reduces processing complexity without sacrificing essential information.

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables more accurate and efficient estimation of the three-dimensional shape of objects in real space by effectively recognizing physical boundaries and reducing data processing requirements.

Implementation Method 1

the geometric structure information is information corresponding to a detection result of each of a plurality of pieces of polarized light having different polarization directions

Methodology Applied
Scientific EffectPolarized light detection: Polarisation

Data Source

PatentUS11189042B2Information processing device, information processing method, and computer program
Publication Date: 2021.11.30 SONY GROUP CORP
  • US11189042B2 patent drawing
  • US11189042B2 patent drawing
  • US11189042B2 patent drawing

AI summary

There is provided an information processing device to enable a three-dimensional shape of an object in a real space to be estimated in a more preferred manner, the information processing device including: a division unit configured to divide, into one or more regions, an image plane corresponding to a viewing point in a real space on which geometric structure information is mapped in accordance with distribution of the geometric structure information; an acquisition unit configured to acquire orientation information indicating at least one of a position and an orientation of the viewing point; an extracting unit configured to extract, as a region of interest, at least part of the regions obtained by dividing the image plane; and an estimation unit configured to estimate a shape of an object in the real space based on the geometric structure information in regions of interest on image planes respectively corresponding to a plurality of different viewing points associated with each other among the viewing points, wherein the geometric structure information is information corresponding to a detection result of each of a plurality of pieces of polarized light having different polarization directions.