360-Degree Image Encoding Region Resolution Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video compression methods for 360-degree images distort pixel distribution, leading to excessive compression quality in certain regions and reduced overall efficiency due to poor prediction accuracy caused by rearranging and down-sampling two-dimensional planar images.

Innovation Solution

A 360-degree image encoding apparatus that divides the input image into regions with varying resolutions, maintaining pixel continuity by adjusting down-sampling and up-sampling ratios based on distortion levels, ensuring all regions have the same resolution for predictive image generation and residue image encoding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If 360-degree visual information is projected to a two-dimensional rectangular plane using polar coordinate projection method, then the image can be compressed using existing video compression technique, but the area of upper and lower regions is distorted and increased, leading to excessive compression quality in those regions

Engineering Contradiction:
ImprovecompressibilityVSAvoidprojection distortion
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent divides the 360-degree image into multiple regions (e.g., upper, middle, lower regions) and applies different down-sampling ratios to each region. This segmentation allows the distorted upper and lower regions to be down-sampled more aggressively while the middle region maintains higher quality, thereby resolving the projection distortion issue while maintaining overall compressibility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different down-sampling ratios to different regions of the image based on their distortion characteristics. The upper and lower regions with higher distortion receive higher down-sampling ratios, while the middle region with less distortion receives lower down-sampling ratios. This local quality approach ensures that each region is compressed appropriately for its specific characteristics.

Inventive Principle:
Principle #3Local quality

2Quantity of substance

If the two-dimensional planar image is rearranged and down-sampled, then the file size is reduced, but the pixel continuity is disrupted, causing poor prediction accuracy and reduced compression efficiency

Engineering Contradiction:
Improvefile sizeVSAvoidcompression efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent dynamically adjusts the down-sampling ratio for each region based on its distortion characteristics and position in the image. This dynamic approach allows the system to optimize both file size reduction and prediction accuracy by maintaining appropriate pixel continuity in each region while applying selective down-sampling.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the down-sampling parameter (ratio) according to the region's distortion level and position. By varying this parameter across different regions rather than applying a uniform down-sampling ratio, the system achieves both file size reduction and maintained prediction accuracy.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If uniform down-sampling is applied to all regions, then the processing is simplified, but the prediction accuracy deteriorates in regions with high distortion

Engineering Contradiction:
Improveprocessing complexityVSAvoidprediction accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies different down-sampling ratios to different regions based on their specific distortion characteristics. The upper and lower regions with higher distortion receive higher down-sampling ratios, while the middle region with less distortion receives lower down-sampling ratios. This local quality approach ensures that each region is processed with appropriate complexity to maintain prediction accuracy.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs preliminary analysis of the image to identify regions with different distortion characteristics before applying down-sampling. This preliminary action allows the system to pre-determine the appropriate down-sampling ratio for each region, thereby maintaining prediction accuracy without excessive processing complexity during the actual compression.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10986342B2360-degree image encoding apparatus and method, and recording medium for performing the same
Publication Date: 2021.04.20 FOUND FOR RES & BUSINESS SEOUL NAT UNIV OF SCI & TECH
  • US10986342B2 patent drawing
  • US10986342B2 patent drawing
  • US10986342B2 patent drawing

AI summary

Provided is a 360-degree image encoding apparatus and method, and a recording medium for performing the same function. The 360-degree image encoding apparatus divides an input image to be encoded into a plurality of regions in a vertical direction and encodes the divided regions while changing resolutions thereof so that all regions have the same resolution to maintain pixel continuity among the regions when a predictive image is generated and the regions have resolutions changed according to the degree of distortion of the regions when a residue image is encoded.