Volumetric Video Visibility Analytics via Texture Atlas Heat Maps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video analytics methods are limited to traditional video formats and do not effectively support volumetric video, which requires new techniques to capture and analyze viewer interactions in three-dimensional spaces.
Innovation Solution
A processor-implemented method for generating three-dimensional volumetric video with an overlay representing visibility counts per pixel of a texture atlas, using viewer telemetry data to determine pixel visibility and generate heat maps, allowing for the creation of curated selections of volumetric content based on viewer interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional video analytics methods are used, then the analysis process is simple and familiar, but they cannot effectively support volumetric video or capture viewer interactions in three-dimensional spaces
Solution Approach 1:
The patent extends traditional 2D video analytics to 3D volumetric video analytics by introducing depth dimension through texture atlas mapping. Viewer telemetry data is projected onto a 3D texture atlas that represents the volumetric scene, enabling analytics in three-dimensional space while building upon existing 2D analysis techniques.
Solution Approach 2:
The system creates a universal analytics framework that can handle both traditional 2D video and 3D volumetric video through a common texture atlas-based approach. The same analytics engine processes viewer interactions regardless of whether the source is conventional video or volumetric content, achieving multi-functionality.
2Loss of information
If detailed viewer telemetry data is captured in volumetric video, then viewer engagement insights are improved, but data processing and storage requirements increase
Solution Approach 1:
The system extracts only the essential viewer interaction information needed for analytics by projecting 3D viewer positions and camera orientations onto a 2D texture atlas. This extraction process converts complex volumetric telemetry data into a condensed representation that retains meaningful engagement patterns while reducing data volume.
Solution Approach 2:
Instead of storing and processing all raw 3D viewer telemetry data, the system creates a simplified copy or representation of the data in the form of visibility counts and heat maps on the texture atlas. This copied representation captures the essential analytics information in a more compact and manageable format.
Data Source
AI summary
A processor-implemented method of generating a three-dimensional (3D) volumetric video with an overlay representing visibility counts per pixel of a texture atlas, associated with a viewer telemetry data is provided. The method includes (i) capturing the viewer telemetry data, (ii) determining a visibility of each pixel in the texture atlas associated with a 3D content based on the viewer telemetry data, (iii) generating at least one visibility counts per pixel of the texture atlas based on the visibility of each pixel in the texture atlas, and (iv) generating one of: the 3D volumetric video with the overlay of at least one heat map associated with the viewer telemetry data, using the at least one visibility counts per pixel and a curated selection of the 3D volumetric content based on the viewer telemetry data, using the visibility counts per pixel.