Multi-Plane Spherical Harmonic Image Encoding for Motion Parallax

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for encoding and decoding omnidirectional images do not effectively support motion parallax for rotation and translation motions, limiting the immersion and realism of virtual reality experiences.

Innovation Solution

A method for encoding and decoding spherical harmonic functions using multi-layer structure images, where vertices on a three-dimensional space form reference planes, with each layer image containing coefficient values and transparency information, and metadata encoding directional image configuration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If omnidirectional images are encoded using traditional methods, then the encoding process is simple, but motion parallax for rotation and translation motions is not supported

Engineering Contradiction:

Improvemotion parallax supportVSAvoidencoding method complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The omnidirectional image is divided into multiple layer images, each representing different depth planes. This segmentation allows the system to handle rotation and translation motions independently for each layer, enabling motion parallax while maintaining manageable encoding complexity through structured organization of image data

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent transitions from traditional 2D image encoding to a multi-layer 3D structure where images are organized along the depth dimension. By adding this spatial dimension and organizing images in layers with associated metadata, the system achieves motion parallax capability while the structured approach prevents exponential complexity increase

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Measurement precision

If all coefficient values of spherical harmonic functions are encoded, then complete directional image information is achieved, but data amount increases

Engineering Contradiction:

Improvedirectional image information accuracyVSAvoiddata amount

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

Different regions of the omnidirectional image are assigned different numbers of layer images and coefficient values based on their importance. Areas requiring higher directional accuracy (such as regions with significant motion parallax) receive more coefficients, while less critical areas use fewer coefficients, optimizing the balance between precision and data quantity

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts the number of spherical harmonic coefficients used for different layers and regions based on scene complexity and motion characteristics. By changing this parameter adaptively rather than using a fixed number of coefficients throughout, the system achieves high directional accuracy where needed while reducing overall data amount

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS20250240452A1Method for encoding/decoding multi-plane structure images and recording medium storing instructions for executing the encoding method

Publication Date: 2025.07.24 ELECTRONICS & TELECOMM RES INST

AI summary

An image encoding method according to the present disclosure may include deriving coefficients of a spherical harmonic function for a plurality of vertices on a three-dimensional space; generating a plurality of layer images based on the coefficients; and encoding the plurality of layer images. In this case, each of the plurality of layer images may include a coefficient value in order corresponding to the spherical harmonic function.