Panoramic Video Rendering with Viewpoint-Based Resolution Scaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current panoramic video rendering technologies, such as WebGL, lack adaptability in different presentation modes and suffer from high rendering performance consumption, failing to effectively utilize interaction manners of various client devices.
Innovation Solution
A method and system for rendering panoramic video that involves determining a viewpoint region based on a perspective camera's field of view, rendering image pixels outside this region at a lower resolution than within, constructing a spherical rendering model, and projecting the three-dimensional image onto a two-dimensional screen, while adapting to interactive operations and canvas size changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If WebGL is used for panoramic video rendering, then basic 3D graphics drawing capability is provided, but adaptability to different presentation modes and client devices is poor
Solution Approach 1:
The panoramic video rendering is segmented into multiple resolution levels. The video is divided into a viewpoint region (high-resolution) and peripheral regions (low-resolution), allowing different parts of the same video to be rendered at different qualities based on user attention and device capabilities.
Solution Approach 2:
The rendering system dynamically adjusts the field of view threshold and resolution levels based on real-time detection of client device types (mobile, tablet, PC) and interaction modes (immersive, presentation, casual). This allows the system to adapt to different presentation modes and device characteristics without requiring separate rendering pipelines.
2Measurement precision
If high resolution is used for all image pixels, then video quality is maintained, but rendering performance consumption increases
Solution Approach 1:
Different regions of the panoramic video are assigned different resolution qualities based on their importance. The viewpoint region, which contains the user's current focus, is rendered at high resolution, while peripheral regions are rendered at lower resolution. This local differentiation maintains visual quality where needed while reducing overall computational load.
Solution Approach 2:
Instead of rendering the entire panoramic video at high resolution, the system applies high-resolution rendering only to the necessary viewpoint region. The field of view threshold is used to define this region, and only pixels within this threshold are rendered at full quality, while others use lower resolution, thus performing partial action rather than excessive action.
3Productivity
If uniform resolution is applied to all regions, then rendering process is simple, but playback freezing occurs due to high computational load
Solution Approach 1:
The system changes the resolution parameter dynamically based on the region being rendered. By adjusting the resolution parameter from high (viewpoint region) to low (peripheral regions), the system achieves both improved rendering efficiency and maintained playback stability. The field of view threshold serves as the parameter that controls this resolution differentiation.
Data Source
AI summary
The present application discloses a method for rendering a panoramic video. The method includes obtaining a current frame of image from a video source, and generating texture map data, where the generating texture map data comprises determining a viewpoint region based on a field of view of a perspective camera, and rendering image pixels outside the viewpoint region at a lower resolution than rendering image pixels within the viewpoint region; mapping the current frame of image to a three-dimensional image based on a spherical rendering model the texture map data; and projecting the three-dimensional image onto a two-dimensional screen.