Multi-Layer Texture Depth Image Processing for Wide Brightness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies fail to generate high-quality texture images from omnidirectional images, particularly when the subject's brightness range is wide, leading to inadequate expression of details.

Innovation Solution

An image processing apparatus and method that utilize a combination of texture and depth images from multiple layers, where the pixel value range differs between layers, to generate a display image from a predetermined viewpoint, effectively capturing varying brightness ranges and enhancing image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a single-layer texture image and depth image from an omnidirectional image are used to generate a display image, then the device complexity is low, but the picture quality is insufficient when the subject has a wide brightness range

Engineering Contradiction:
Improvepicture qualityVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the omnidirectional image information into multiple layers, where each layer contains texture images and depth images with different pixel value ranges. This segmentation allows the system to process and combine multiple specialized representations to achieve high picture quality across wide brightness ranges without requiring a single overly complex processing pipeline.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a layer dimension to the traditional single-layer representation by creating multiple layers with different pixel value ranges. This dimensional expansion enables the system to capture and reproduce a wider brightness range by combining information from multiple layers, effectively solving the picture quality limitation without increasing horizontal complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If multiple layers with different pixel value ranges are used to generate the display image, then the representation of subjects with wide brightness ranges is improved, but the device complexity increases

Engineering Contradiction:
Improveinformation representationVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies local quality by assigning different pixel value ranges to different layers, where each layer is optimized for specific brightness characteristics. This allows the system to preserve information quality in different brightness regions without requiring a uniform increase in complexity across the entire system, as each layer handles only its specialized range.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent combines multiple texture and depth image layers with different pixel value ranges to create a composite representation of the omnidirectional scene. This composite approach enables the system to capture and reproduce wide brightness ranges by integrating information from multiple specialized layers, achieving superior information representation while managing complexity through structured composition.

Inventive Principle:
Principle #40Composite materials

3Loss of information

If the pixel value range is extended to capture wide brightness ranges, then the information completeness is improved, but the processing complexity increases

Engineering Contradiction:
Improveinformation completenessVSAvoidprocessing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the brightness range information across multiple layers, with each layer handling a specific pixel value range. This segmentation allows the system to achieve complete information representation across wide brightness ranges while managing processing complexity by dividing the task into smaller, specialized processing units rather than handling all ranges in a single complex process.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11087480B2Image processing apparatus and image processing method
Publication Date: 2021.08.10 SONY GROUP CORP
  • US11087480B2 patent drawing
  • US11087480B2 patent drawing
  • US11087480B2 patent drawing

AI summary

Provided is a drawing section that generates a display image from a predetermined viewpoint by using a texture image and a depth image of a first layer and using a texture image and a depth image of a second layer in which a range of information indicated by a pixel value is different from at least one of the texture image or the depth image of the first layer.