Free Viewpoint Video Switching for Transmission Failures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Volumetric capture technologies face issues where incomplete or delayed transmission of camera images from multiple viewpoints can result in a deformed or non-displayable free viewpoint moving image, degrading the user experience.
Innovation Solution
An information processing system that determines whether a free viewpoint moving image has been successfully generated and controls the transmission of either a free viewpoint moving image or a real camera viewpoint moving image based on this determination, ensuring continuous and high-quality image display by switching between the two if necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a free viewpoint moving image is generated using multiple camera moving images, then the user experience of viewing from arbitrary positions is improved, but the system becomes vulnerable to transmission failures and generation errors
Solution Approach 1:
The system dynamically switches between free viewpoint moving image mode and real camera viewpoint moving image mode based on generation success. When free viewpoint image generation fails due to transmission issues, the system automatically transitions to using real camera viewpoint images, making the system adaptable to different operational conditions while maintaining reliability.
Solution Approach 2:
The system prepares multiple image sources (both free viewpoint moving images and real camera viewpoint moving images) in advance. When transmission or generation issues occur with the primary free viewpoint images, pre-prepared real camera viewpoint images serve as a backup, cushioning against failures and ensuring continuous display.
2Manufacturing precision
If all camera moving images are transmitted for free viewpoint generation, then the quality of the free viewpoint moving image is improved, but the transmission load and complexity increase
Solution Approach 1:
The system transmits camera moving images selectively rather than always transmitting all images. Free viewpoint moving images are generated and transmitted only when sufficient camera images are successfully received. When transmission conditions are poor, the system falls back to transmitting real camera viewpoint moving images, avoiding the excessive complexity of always transmitting and processing all camera feeds.
3Speed
If real-time transmission of multiple camera images is performed, then the interactivity of communication is improved, but the susceptibility to transmission failures increases
Solution Approach 1:
The system uses disposable fallback mechanisms where real camera viewpoint moving images serve as temporary substitutes when free viewpoint image transmission fails. These backup images are used only when necessary to maintain real-time communication, then discarded once the primary free viewpoint transmission is restored, balancing speed and reliability.
Data Source
AI summary
There is provided an information processing device, an information processing method, a program, and an information processing system capable of providing a user who views a free viewpoint moving image with better user experience. The information processing device of the present technology includes: a transmission unit that transmits a moving image; and a control unit that controls the transmission unit to transmit a free viewpoint moving image or a real camera viewpoint moving image on the basis of a result of determination on whether or not the free viewpoint moving image has been successfully generated, the free viewpoint moving image being a moving image generated by using a plurality of camera moving images generated by imaging a subject by using a plurality of cameras and viewed from an arbitrary position and direction, the real camera viewpoint moving image being a moving image generated from a camera moving image generated by imaging the subject by using a camera and viewed from a position and direction of the camera. The present technology is applicable to a real-time volumetric system that transmits a free viewpoint moving image in real time.