Image Processing Rear-Face Projection for 3D Region Coverage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The 2D depth technique for representing a three-dimensional structure using texture images and depth images from multiple viewpoints cannot effectively represent regions that are not perspectively projected, leading to increased data requirements as the number of viewpoints increases.

Innovation Solution

An image processing apparatus and method that generate texture and depth images by projecting the rear face of a polygon from two opposing viewpoints to a projection face perpendicular to the sight line direction, allowing for the representation of a greater number of regions with reduced data requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the number of viewpoints for perspective projection is increased to represent more regions, then the number of representable regions increases, but the data amount necessary to represent the three-dimensional structure increases

Engineering Contradiction:
Improvenumber of representable regionsVSAvoiddata amount
Core Design Contradiction:
Area of stationary objectVSQuantity of substance

Solution Approach 1:

The patent projects the rear face of polygons to a projection face perpendicular to the sight line direction, transitioning from traditional front-face projection to rear-face projection. This dimensional change in projection approach allows the system to capture regions that would otherwise be occluded, enabling more regions to be represented with the same number of viewpoints without increasing data amount

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

Instead of projecting the front face of polygons as in conventional techniques, the patent inverts the projection approach by projecting the rear face of polygons. This inversion allows viewpoints to capture regions that are normally occluded from the front, thereby increasing the number of representable regions while maintaining the same data amount

Inventive Principle:
Principle #13The other way round (Inversion)

2Area of stationary object

If texture images and depth images from multiple viewpoints are used to represent three-dimensional structure, then regions can be represented, but regions not perspectively projected cannot be represented

Engineering Contradiction:
Improvenumber of representable regionsVSAvoidunrepresented regions
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

By changing the projection dimension from front-face to rear-face projection onto a perpendicular projection face, the patent captures regions that are occluded in traditional projection methods, eliminating information loss for those regions

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent inverts the conventional projection method by projecting rear faces instead of front faces, which allows viewpoints to capture previously occluded regions and eliminates the problem of unrepresented regions

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS10950029B2Image processing apparatus and image processing method
Publication Date: 2021.03.16 SONY GROUP CORP
  • US10950029B2 patent drawing
  • US10950029B2 patent drawing
  • US10950029B2 patent drawing

AI summary

The present disclosure relates to an image processing apparatus and an image processing method which make it possible to generate an image using texture images and depth images of two viewpoints that represent a three-dimensional structure of a greater number of regions. A drawing section generates a texture image of a predetermined viewpoint using a texture image obtained by perspectively projecting, to a perspective projection face perpendicular to a sight line direction heading from each of two viewpoints which are opposed to each other across a center of a polygon, toward the center of the polygon, a rear face of the polygon and a depth image corresponding to the texture image of each of the viewpoints. The present disclosure can be applied, for example, to a display apparatus and the like.