Volumetric Video Processing System for Smooth Editing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for interfacing with volumetric video struggle to facilitate smooth, consistent, and reliable editing and distribution, often resulting in choppy content and an inability to adjust volumetric captures to fit artistic and production goals.
Innovation Solution
A method and system that utilize a processor to receive and process volumetric data, determining points of interest, generating skeletal structures, stabilizing meshes, and adaptive streaming to ensure seamless editing and distribution of volumetric content across various platforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If existing systems process volumetric video content, then content can be distributed, but the processing is slow and produces choppy content
Solution Approach 1:
The system segments volumetric video processing into distinct stages: mesh extraction from point clouds, UV map generation, texture mapping, and skeletal structure creation. Each stage processes specific data elements independently, allowing parallel computation and reducing overall processing time while maintaining output quality.
Solution Approach 2:
The system performs preliminary processing by extracting mesh structures and generating UV maps from raw volumetric captures before final rendering. This pre-processing organizes complex 3D data into structured formats, enabling faster subsequent processing and smoother playback without compromising reliability.
2Ease of operation
If volumetric captures are manipulated for artistic goals, then creative control is improved, but processing complexity increases
Solution Approach 1:
The system introduces intermediate representations including mesh structures, UV coordinate systems, and skeletal hierarchies as mediators between raw volumetric captures and final rendered output. These intermediaries provide structured data formats that are easier to manipulate artistically while maintaining efficient processing pipelines.
Solution Approach 2:
The system enables creative control by allowing manipulation of key parameters such as skeletal joint positions, mesh density, UV mapping coordinates, and texture properties. By exposing these specific parameters for adjustment, artists can achieve desired creative effects without needing to understand the full complexity of the underlying processing system.
3Reliability
If smooth and consistent editing is achieved, then content quality is improved, but processing time increases
Solution Approach 1:
The system creates simplified copy representations including low-resolution mesh approximations and downsampled UV maps that can be processed quickly for preview and editing purposes. These copies maintain the essential structural information needed for consistent editing while requiring minimal processing time, allowing artists to make adjustments without waiting for full-resolution processing.
Data Source
AI summary
Various post-production and distribution tools for volumetric video data are enabled. For instance, a method comprises receiving, by a device comprising a processor, a group of images, determining, by the device, first points of interest of a first image of the group of images and second points of interest of a second image of the group of images, comparing, by the device, the first points of interest to the second points of interest, and determining, by the device, from the first points of interest and the second points of interest and based on a result of the comparing, sets of candidate coordinate positions of a joint of a character represented in the first image and the second image.