360-Degree Image Encoding and Decoding Using Projection-Aware Block Division

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems struggle with the massive data generated by 360-degree images for virtual and augmented reality, necessitating improved performance in image encoding and decoding, particularly for 360-degree images.

Innovation Solution

A method for decoding 360-degree images involves generating a predicted image using syntax information, combining it with a residual image, and reconstructing the image based on projection formats like ERP, CMP, OHP, and ISP, with image expansion and rearrangement based on partitioning units and motion information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional image encoding/decoding methods are used for 360-degree images, then the processing can be performed with standard algorithms, but the performance is insufficient for handling the massive data volume generated by 360-degree images

Engineering Contradiction:
Improveimage processing performanceVSAvoiddata volume
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent divides the 360-degree image into multiple projection formats (ERP, CMP, OHP, ISP) and processes each format separately with format-specific optimization. The decoding process is segmented into distinct stages: syntax information extraction, predicted image generation, residual image processing, and format-specific reconstruction. This segmentation allows the system to handle massive data volumes by processing different portions of the image data through specialized pipelines optimized for their respective projection characteristics.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the processing approach by introducing projection format as an additional dimension for organizing and processing 360-degree image data. Instead of treating all pixel data uniformly, the system reorganizes the massive data volume according to projection geometry (e.g., cube faces for CMP, spherical coordinates for ERP), enabling more efficient memory access patterns and parallel processing strategies that improve overall productivity despite the large data quantity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If image expansion and rearrangement are performed based on partitioning units, then the compression performance is enhanced, but the processing complexity increases

Engineering Contradiction:
Improvecompression performanceVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the image into partitioning units and processing each unit independently through expansion and rearrangement operations. Each partitioning unit is handled with format-specific rules, allowing the complex processing to be broken down into manageable, repeatable steps that can be parallelized, thereby improving compression performance without overwhelming the processing system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements local quality by applying different expansion and rearrangement strategies to different regions of the image based on their projection format characteristics. For example, cube map projections may use face-based partitioning while equirectangular projections use latitude-longitude grid partitioning. This localized processing approach optimizes compression for each region's specific geometric properties while keeping the overall processing complexity manageable through consistent local rules.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If multiple projection formats are supported, then the adaptability for different VR/AR applications is improved, but the device complexity increases

Engineering Contradiction:
Improveprojection format compatibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent achieves universality by designing a single decoding apparatus that can handle multiple projection formats (ERP, CMP, OHP, ISP) through a unified architecture. The system uses format identification syntax information to route data through appropriate processing pipelines, allowing one device to serve multiple VR/AR application requirements without requiring separate specialized hardware for each projection type, thus improving adaptability while controlling complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent applies preliminary action by extracting and identifying the projection format from syntax information at the beginning of the decoding process. This early format identification allows the system to pre-configure the appropriate processing pipeline and parameters before actual image reconstruction begins, enabling multi-format support without requiring complex real-time format switching or multiple complete decoding chains, thereby reducing overall system complexity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12432381B2Image data encoding/decoding method and apparatus
Publication Date: 2025.09.30 INST OF IMAGE TECH INC
  • US12432381B2 patent drawing
  • US12432381B2 patent drawing
  • US12432381B2 patent drawing

AI summary

Disclosed are methods and apparatuses for image data encoding/decoding. A method of decoding an image includes receiving a bitstream in which the image is encoded; obtaining index information for specifying a block division type of a current block in the image; and determining the block division type of the current block from a candidate group pre-defined in the decoding apparatus. The candidate group includes a plurality of candidate division types, including at least one of a non-division, a first quad-division, a second quad-division, a binary-division or a triple-division. The method also includes dividing the current block into a plurality of sub-blocks; and decoding each of the sub-blocks with reference to syntax information obtained from the bitstream.