Omnidirectional Image Storage Reduction via Viewing Direction Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for storing and reproducing omnidirectional images require significant storage capacity due to the need to store images in all possible line-of-sight directions, making them inefficient in terms of storage size.

Innovation Solution

An image processing apparatus and method that reduce the storage size by accepting and processing omnidirectional images projected onto 2D planes, acquiring and recording viewing direction information, and dynamically adjusting image storage based on user viewing logs, allowing for reduced resolution and compression of images not frequently viewed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If omnidirectional images are stored in all possible line-of-sight directions, then complete coverage of all viewing directions is achieved, but storage size becomes excessively large

Engineering Contradiction:
Improvecoverage of viewing directionsVSAvoidstorage size
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The omnidirectional image is segmented into multiple planar projections (e.g., front, back, left, right, top, bottom views). Instead of storing the complete omnidirectional image in its entirety, only the necessary planar segments corresponding to actual viewing directions are stored and transmitted, significantly reducing storage requirements while maintaining complete directional coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the omnidirectional space are treated differently based on their importance. Frequently viewed directions (such as front, back, left, right) are stored in high resolution, while less frequently viewed directions (such as top, bottom) are stored in lower resolution or omitted entirely. This local differentiation optimizes storage allocation according to actual usage patterns.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If high resolution is maintained for all omnidirectional images, then image quality is preserved, but storage capacity requirements increase significantly

Engineering Contradiction:
Improveimage qualityVSAvoidstorage capacity
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent applies different resolution qualities to different planar projections based on their viewing frequency and importance. High-resolution images are stored for directions that are frequently viewed (front, back, left, right), while lower-resolution or compressed images are used for less frequently viewed directions (top, bottom). This selective quality approach maintains overall image quality where needed while dramatically reducing total storage capacity requirements.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The resolution parameter is dynamically adjusted for different planar projections. Instead of using a uniform high resolution for all directions, the system varies the resolution parameter based on the specific viewing direction and its importance, optimizing the balance between image quality and storage capacity.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If complete omnidirectional image data is stored, then all viewing directions are available, but storage efficiency decreases

Engineering Contradiction:
Improveavailability of viewing directionsVSAvoidstorage efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The complete omnidirectional image data is divided into discrete planar projection segments. The system stores only the essential segments that correspond to actual viewing directions, eliminating redundant data. This segmentation approach maintains full availability of all necessary viewing directions while dramatically improving storage efficiency by removing unnecessary information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and stores only the essential components of omnidirectional image data - the planar projections corresponding to actual viewing directions - while discarding redundant or unnecessary data. This extraction process retains all necessary viewing information while optimizing storage efficiency.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11138784B2Image processing apparatus and image processing method
Publication Date: 2021.10.05 SONY GROUP CORP
  • US11138784B2 patent drawing
  • US11138784B2 patent drawing
  • US11138784B2 patent drawing

AI summary

Provided are an image processing apparatus and an image processing method that make it possible to reduce a storage capacity necessary for an omnidirectional image. Of a plurality of images generated by perspectively projecting an omnidirectional image mapped to a 3D model onto a plurality of two-dimensional planes, an image corresponding to a viewing direction of a user and an omnidirectional image reduced in resolution are accepted, and a drawing block generates a display image on the basis of at least one of the accepted image and the accepted omnidirectional image reduced in resolution. A viewing direction acquisition block acquires viewing direction information related with the viewing direction of the user, and a sending block sends a viewing direction log recorded on the basis of the acquired viewing direction information.