Omni-directional Image Padding for Seamless Boundary Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for processing omni-directional images often result in discontinuity between two-dimensional images, leading to non-smooth rendering and quality issues, particularly when mapping three-dimensional spatial images to two-dimensional planes.

Innovation Solution

An image processing device and method that includes a receiver for input frames with image areas and metadata, using padding information to determine padding areas and render boundaries between concatenated image areas, thereby minimizing distortion and maintaining Quality of Service (QoS).

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If three-dimensional omni-directional images are mapped to two-dimensional images for compression, then data transmission efficiency is improved, but image distortion and discontinuity occur at boundaries

Engineering Contradiction:
Improvedata transmission efficiencyVSAvoidimage rendering quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by inserting padding areas into the two-dimensional image areas before rendering. This pre-processing step prepares the image data by creating buffer zones at boundaries, which prevents discontinuity and distortion during the final rendering process. The padding areas are strategically placed based on metadata information about the original three-dimensional geometry, ensuring that when images are concatenated, smooth transitions occur without visible seams or distortions.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If multiple two-dimensional images are concatenated to form omni-directional images, then complete 360-degree coverage is achieved, but discontinuity and non-smooth rendering occur at boundaries

Engineering Contradiction:
Improveomni-directional coverageVSAvoidboundary smoothness
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patent uses padding areas as intermediary elements between adjacent two-dimensional image areas. These padding regions act as buffer zones that mediate the transition between different image segments. By introducing this intermediary layer, the patent eliminates direct boundary contacts that cause discontinuity, allowing for smooth blending and continuous rendering across the entire 360-degree omni-directional image while maintaining complete spherical coverage.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11017598B2Method for processing omni-directional image using padding area and apparatus supporting the same
Publication Date: 2021.05.25 SAMSUNG ELECTRONICS CO LTD
  • US11017598B2 patent drawing
  • US11017598B2 patent drawing
  • US11017598B2 patent drawing

AI summary

An image processing apparatus is disclosed. The image processing apparatus comprises: a receiver configured to receive an input frame including a plurality of image regions, corresponding to a plurality of faces of a three-dimensional polyhedron, and metadata; and a processor configured to render an output frame including at least one a part of the input frame, on the basis of padding information included in the metadata. Here, the processor may be configured to identify, on the basis of the padding information, a padding region included in at least one of the plurality of image regions, and render, on the basis of the determined padding region, a boundary between at least one face of the plurality of faces and another face of the plurality of faces adjoining the at least one face of the polyhedron.