Omni-directional Video Image Processing for Six Degrees of Freedom
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 360-degree video technologies limit user viewing freedom to three degrees of freedom, restricting the ability to freely move and view in three-dimensional space, and face challenges with high complexity and large data requirements in expressing light field and point cloud images.
Innovation Solution
An image processing method and apparatus that maps image and depth information of omni-directional videos to a three-dimensional coordinate system, allowing for six degrees of freedom viewing by expressing image information as pixel values on a virtual three-dimensional sphere and depth information as distance values inward from the sphere, enabling transformation and reconstruction of images for various projection formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional 360-degree video technology is used, then image information can be captured in multiple directions, but user viewing freedom is limited to three degrees of freedom
Solution Approach 1:
The patent transitions from conventional 2D image representation to 3D spatial representation by mapping image information onto a three-dimensional coordinate system. This dimensional change enables six degrees of freedom viewing (rotation about three axes plus translation along three axes) instead of the limited three degrees of freedom in conventional systems, thereby increasing viewing freedom while managing complexity through structured spatial organization
2Adaptability or versatility
If light field and point cloud images are used to express depth information, then six degrees of freedom viewing is enabled, but data requirements and processing complexity increase
Solution Approach 1:
The patent extracts and separates image information from depth information, representing them in different spatial layers. Image information is mapped to pixel values on a three-dimensional sphere surface, while depth information is represented by distance values from the sphere center. This extraction allows selective processing and storage of only the necessary information for each viewing function, reducing overall data requirements compared to storing complete light field or point cloud data
Solution Approach 2:
The patent segments the three-dimensional space into multiple spherical shells at different radial distances from the center. Each shell can independently store image information for objects at corresponding depth ranges. This segmentation enables efficient data organization where only the spherical shells relevant to current viewing needs need to be processed, reducing processing complexity and data handling requirements
Data Source
AI summary
Disclosed is an apparatus and method of providing an image processing. An image processing method according to the present disclosure includes: obtaining at least one of image information and depth information of an omni-directional video; and mapping the obtained information to a three-dimensional coordinate system based on a particular three-dimensional figure.