360-Degree Image Processing via 2D Projection and Metadata
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies lack efficient methods for compressing, storing, and transmitting 360-degree image content, which is essential for immersive media services over legacy ultra-HD displays, particularly in virtual reality applications.
Innovation Solution
A method and apparatus for converting 360-degree images into 2D images, creating metadata for these conversions, and restoring 2D images back into 360-degree images, utilizing a device with components like a mapper, converter, encoder, storage unit, decoder, inverse-converter, and playback unit to minimize image distortion and optimize data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If 360-degree image content is transmitted directly, then image quality is preserved, but data transmission size is excessive and transmission efficiency is low
Solution Approach 1:
The patent divides the 360-degree spherical image into multiple equirectangular image sets corresponding to different view angles. Each equirectangular image is then further divided into multiple view angle regions, allowing selective transmission of only the regions needed for the user's current viewing direction, thereby reducing overall data size while maintaining image quality where required.
Solution Approach 2:
The patent transforms the 360-degree spherical image into a 2D equirectangular projection format, enabling efficient compression and transmission. The spherical coordinates are converted to rectangular coordinates, allowing standard 2D image processing and compression techniques to be applied, thus reducing data volume while preserving visual information.
2Productivity
If 360-degree image is converted to 2D format for transmission, then data transmission efficiency is improved, but image distortion occurs
Solution Approach 1:
The patent segments the 360-degree image into multiple equirectangular image sets, each corresponding to a specific view angle range. By processing and transmitting these segmented regions independently, the system minimizes distortion in each segment while maintaining overall image quality, as each segment can be optimized for its specific viewing perspective.
Solution Approach 2:
The patent employs parameter changes in the conversion process from spherical to equirectangular coordinates, using mathematical transformations that adjust pixel positioning and scaling. By carefully controlling conversion parameters and using multiple equirectangular representations, the system reduces geometric distortion while maintaining transmission efficiency.
3Adaptability or versatility
If multiple equirectangular image sets are generated for different view angles, then transmission flexibility is improved, but processing complexity increases
Solution Approach 1:
The patent performs preliminary processing by pre-generating multiple equirectangular image sets from the original 360-degree image, each optimized for different view angle ranges. This preliminary segmentation and preparation allows the system to quickly select and transmit appropriate image sets without complex real-time processing, reducing operational complexity while maintaining flexibility.
Solution Approach 2:
The patent divides the 360-degree image into multiple equirectangular image sets, each corresponding to different view angles. This segmentation allows the system to manage complexity by processing smaller, standardized regions rather than the entire spherical image, making the overall system more manageable while maintaining transmission flexibility for different viewing conditions.
Data Source
Figure 1
Figure 2A~2B
Figure 2C
AI summary
Provided is a method for processing 360-degree multi-view images, the method comprising identifying media data for a two-dimensional, 2D, image which is generated based on projecting a three-dimensional, 3D, image to a planar space, and metadata related to the media data; and transmitting the identified media data and the identified metadata, wherein the 3D image is generated based on the 360-degree multi-view images, and wherein the metadata comprises information indicating a 3D model for mapping the 2D image to the 3D model, among a plurality of 3D models , and information indicating a rotating angle according to each of an x-axis, a y-axis, and a z-axis for the 3D image. A device for processing 360-degree multi-view images.