Polarization Image Analysis for Subject Position and Posture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Image analysis based on polarized light faces challenges with degraded computation accuracy due to specular and diffuse reflections, limiting its application and requiring high processing loads, especially in scenarios needing high response speed.

Innovation Solution

An information processing apparatus and method that acquire polarization images from multiple azimuths, identify pixels with high polarization, and determine subject state information using polarization luminance, allowing for efficient acquisition of subject position and posture in a world coordinate system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image analysis is performed on observed light including specular reflection and diffuse reflection, then computation accuracy is improved, but processing load increases significantly

Engineering Contradiction:
Improvecomputation accuracyVSAvoidprocessing load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the observed light into two distinct components: specular reflection light and diffuse reflection light. By separating these components and processing them through different analysis paths (specular reflection analysis for position, diffuse reflection analysis for posture), the system achieves accurate computation without the overwhelming processing load of analyzing all light components simultaneously. This segmentation allows selective processing based on the specific information needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts specific polarization components from the observed light - specifically extracting the polarization state of specular reflection light and diffuse reflection light separately. By taking out only the relevant polarization information needed for position and posture determination, rather than processing all light components, the system reduces processing complexity while maintaining measurement accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If image analysis is performed on observed light including both specular and diffuse reflection, then measurement capability is improved, but response speed decreases due to high processing load

Engineering Contradiction:
Improvemeasurement capabilityVSAvoidresponse speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent divides the measurement task into two independent segments: position measurement using specular reflection light polarization and posture measurement using diffuse reflection light polarization. This segmentation allows parallel processing of position and posture determination, significantly improving response speed while maintaining the capability to measure both parameters accurately.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by selectively analyzing only the polarization components necessary for the desired measurements. Instead of performing exhaustive analysis on all light components, the system focuses specifically on specular reflection polarization for position and diffuse reflection polarization for posture, achieving sufficient measurement capability with reduced processing time.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If polarization image analysis is used, then robustness to surrounding brightness and feature points is improved, but computation accuracy degrades due to reflection types

Engineering Contradiction:
Improverobustness to surrounding brightnessVSAvoidcomputation accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent segments the polarization analysis into two distinct pathways: one for specular reflection light and another for diffuse reflection light. Each pathway is optimized for its specific reflection type, allowing the system to maintain computation accuracy by applying appropriate analysis methods to each segment while preserving the robustness benefits of polarization imaging against varying brightness conditions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different analysis qualities to different light components based on their reflection characteristics. Specular reflection light undergoes specific polarization analysis suitable for position determination, while diffuse reflection light undergoes different polarization analysis suitable for posture determination. This local quality approach ensures optimal computation accuracy for each reflection type while maintaining overall system robustness.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables rapid and accurate acquisition of subject information by selecting pixels with high polarization, reducing processing complexity and enhancing response speed while maintaining robustness against environmental changes.

Implementation Method 1

acquire data of polarization images in a plurality of azimuths captured by an imaging apparatus

Methodology Applied
Scientific EffectPolarization: Polarisation

Data Source

PatentUS11276197B2Information processing apparatus and subject information acquisition method
Publication Date: 2022.03.15 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11276197B2 patent drawing
  • US11276197B2 patent drawing
  • US11276197B2 patent drawing

AI summary

A captured image acquisition section of an information processing apparatus acquires polarization image data including polarization information in a plurality of azimuths. An imaging apparatus information acquisition section acquires information regarding a position and posture of an imaging apparatus. A viewpoint control section of a subject information acquisition section controls a plurality of viewpoints from which polarization images are captured. A point-of-interest information acquisition section sets a pixel of interest having a degree of polarization equal to or higher than a threshold in a polarization image of a first viewpoint, identifies a pixel representing the same point of interest in a polarization image of a second viewpoint, and then obtains a line of intersection between incident planes acquired for the respective viewpoints as a normal vector. An output data generation section generates output data based on results thereof and outputs the data.