Volumetric Video Generation via Distributed Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing volumetric video technologies struggle to generate renditions suitable for various content types like music live shows, sports events, and academic classes, and face challenges with real-time processing and increased processing loads, especially when using limited resources like personal computers.
Innovation Solution
An information processing system that distributes processing across multiple computers, utilizing high-performance computing and efficient data transmission methods to generate volumetric videos in real-time, allowing for flexible development environments and reduced latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If volumetric video is generated by superimposing a three-dimensional object on a background object, then the video can be created using existing technology, but the rendition is not suitable for a wide variety of video content types
Solution Approach 1:
The system divides the video generation process into separate functional modules: a generation unit that creates the three-dimensional object from captured images, a rendering unit that handles background composition, and a superimposition unit that combines them. This segmentation allows each module to be optimized independently for different content types while maintaining overall system versatility.
Solution Approach 2:
The information processing device is designed with multi-functional capabilities to handle diverse video content types including music live shows, sports events, lectures, and academic classes. The rendering unit can adaptively adjust background composition and superimposition parameters based on the content type, enabling a single system to serve multiple purposes effectively.
2Productivity
If real-time volumetric video processing is performed on personal computers with limited resources, then development efficiency can be maintained, but processing load increases and latency occurs
Solution Approach 1:
The system performs preliminary processing of captured images to generate the three-dimensional object model before the actual video rendering is needed. By pre-computing the three-dimensional representation and storing it in a optimized format, the system reduces the computational burden during real-time video generation, enabling personal computers to handle the processing load effectively.
Solution Approach 2:
The rendering unit dynamically adjusts processing parameters based on available computational resources and performance requirements. When processing load is high, the system adapts by optimizing rendering quality and frame rate dynamically, allowing real-time performance on personal computers while managing power consumption and processing load effectively.
3Manufacturing precision
If high-quality volumetric video rendering is performed, then video quality is improved, but processing time increases and real-time performance is compromised
Solution Approach 1:
The system employs parameter optimization techniques where rendering quality parameters such as resolution, texture detail, and lighting complexity are dynamically adjusted based on the specific content type and performance requirements. This allows the system to maintain high video quality when needed while reducing processing time for less demanding content, achieving a balance between manufacturing precision and time efficiency.
Data Source
AI summary
There is provided an information processing device to generate a video to which a wide range of renditions are applied from a three-dimensional object generated by a volumetric technology. The information processing device includes a first generation unit (134) that generates, based on a three-dimensional model of a subject generated by using a plurality of captured images obtained by imaging the subject and based on a two-dimensional image, a video in which a subject generated from the three-dimensional model, and the two-dimensional image, are simultaneously present.