Tiled 3D Image Depth Border Consistency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for generating three-dimensional image representations struggle with providing sufficient information for all viewpoints and directions, leading to suboptimal image quality, increased complexity, and resource demands, especially in applications like virtual reality where dynamic and omnidirectional views are required.

Innovation Solution

A tiled three-dimensional image representation system that modifies depth values across neighboring tiles to reduce inconsistencies, using a processor to adjust depth values in border regions to ensure consistency and improve image quality, allowing for efficient communication, storage, and processing while supporting flexible view generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple tiles are used to represent different view directions, then coverage of viewing directions is improved, but inconsistencies at tile borders degrade image quality

Engineering Contradiction:
Improvecoverage of viewing directionsVSAvoidimage quality at tile borders
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent applies local quality by modifying depth values specifically in border regions of tiles rather than uniformly across all tiles. The processing identifies border pixels and adjusts their depth values based on neighboring tiles, applying different processing rules to border regions versus interior regions. This localized approach maintains image quality at critical transition zones while preserving the multi-tile structure for comprehensive view direction coverage.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If depth values are modified to reduce inconsistencies, then image quality is improved, but processing complexity increases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the processing into distinct stages: identifying border regions, retrieving depth values from neighboring tiles, comparing depth values, and conditionally modifying them. This segmentation allows the complex depth modification process to be broken down into manageable steps, reducing overall processing complexity while maintaining image quality improvements at tile borders.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses self-service by automatically retrieving depth values from neighboring tiles and using them to guide modifications in border regions. The process is self-regulating, where the depth modification is driven by the actual depth relationships between adjacent tiles rather than requiring external intervention or complex manual processing.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If high-resolution depth maps are used for all tiles, then image quality is improved, but data storage and transmission requirements increase

Engineering Contradiction:
Improveimage qualityVSAvoiddata storage requirements
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent applies partial action by modifying depth values only in border regions of tiles rather than processing all depth values in all tiles. This selective approach maintains high image quality at critical transition zones while significantly reducing the total amount of depth data that requires storage and transmission, as interior regions of tiles can use standard depth map resolution without modification.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3659337B1Apparatus and method for generating a tiled three-dimensional image representation of a scene
Publication Date: 2022.05.11 KONINKLIJKE PHILIPS NV
  • EP3659337B1 patent drawingFigure 1
  • EP3659337B1 patent drawingFigure 2
  • EP3659337B1 patent drawingFigure 3

AI summary

An apparatus for generating a three-dimensional image representation of a scene comprises a receiver (301) receiving a tiled three-dimensional image representation of a scene from a first viewpoint, the representation comprising a plurality of interconnected tiles, each tile comprising a depth map and a texture map representing a viewport of the scene from the first viewpoint and the tiles forming a tiling pattern. A first processor (311) determines neighboring border regions in at least a first tile and in a second tile in response to the tiling pattern. A second processor (309) modifies at least a first depth value of a first border region of the first tile in response to at least a second depth value in a second border region of the second tile, the border regions being neighboring regions. The modified depth maps may be used to generate a mesh based on which images may be generated.