Spherical Video Projection Boundary Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for processing spherical video data into 2D rectangular frames introduce artificial pixel region boundaries, leading to reduced coding performance and visual quality due to indiscriminate projection and mapping, which interfere with encoding schemes like H.264/AVC or HEVC, causing increased entropy and restricted motion vectors.
Innovation Solution
The method involves shifting and rotating pixel regions in projected video frames before encoding to minimize the impact of artificial boundaries, using image analysis algorithms to select optimized frames that enhance encoding efficiency and visual quality, and storing rendering information for post-decoding adjustments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If spherical video data is projected onto 2D rectangular frames using conventional projection models, then the video data can be processed by existing encoding systems, but artificial pixel region boundaries are introduced that reduce coding performance and visual quality
Solution Approach 1:
The patent applies preliminary action by performing image analysis and optimizing pixel region arrangements before the encoding process. The system analyzes the projected video frame to identify artificial boundaries and pre-adjusts the pixel regions to minimize their impact on coding performance, ensuring that when the data enters the existing encoding system, it is already optimized for better compression efficiency and visual quality
Solution Approach 2:
The patent applies local quality by treating different pixel regions differently based on their specific characteristics. Instead of uniform processing, the system identifies regions with artificial boundaries and applies localized adjustments to those specific areas, such as modifying the arrangement or properties of pixel regions near boundaries to reduce their detrimental effects on encoding performance
2Productivity
If indiscriminate projection and mapping are used to transform spherical video data, then processing is simplified and faster, but encoding efficiency decreases due to increased entropy and restricted motion vectors
Solution Approach 1:
The system performs preliminary analysis of the projected video frame to identify problematic artificial boundaries before encoding. By pre-processing the data to detect and mark regions with high entropy or restricted motion vectors, the system can apply targeted optimizations that improve encoding efficiency without requiring complete re-projection, thus maintaining processing speed while reducing information loss
Solution Approach 2:
The patent applies parameter changes by modifying properties of pixel regions such as their arrangement, size, or positional parameters based on the analysis results. The system adjusts these parameters to minimize the creation of artificial boundaries that would otherwise increase entropy and restrict motion vectors during encoding, thereby preserving more information while maintaining fast processing
Data Source
AI summary
A method for processing spherical video data is described including a data processor providing spherical video data in the form of projected video frames to an input of an encoder process, a projected video frame including one or more pixel regions, the one or more pixel regions representing pixels of spherical video data projected onto one or more 2D projection surfaces of a projection model, preferably an equirectangular or a 3D polyhedron projection model, for projecting spherical video data onto a rectangular 2D surface of a video frame; wherein the providing of spherical video data may comprise: generating a set of modified projected video frames on the basis of a projected video frame, the generating including applying different shift and/or rotation operations to pixels, preferably one or more pixel regions, of the selected projected video frame; applying an image analysis algorithm to the modified projected video frames, the image analysis algorithm determining an image analysis parameter for a least part of the modified projected video frames, the image analysis parameter being indicative for the encoding efficiency and/or image quality; and, selecting a modified projected video frame from the set of modified projected video frames, the selected modified projected video frame being associated with an image analysis parameter indicative of the best encoding efficiency and/or image quality.