Virtual Viewpoint Image Generation Speed Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The generation of virtual viewpoint contents in free-viewpoint video systems is prone to image quality deterioration due to increased data transmission and instrument complexity, leading to potential system failures and reduced viewer satisfaction.
Innovation Solution
An image processing apparatus that includes a data acquisition unit, a parameter acquisition unit, and a viewpoint acquisition unit, which generates virtual viewpoint images based on acquired image data and viewpoint information, adjusting the moving speed of the virtual viewpoint to maintain image quality by correcting the virtual camera path and interlacing single camera images with virtual viewpoint content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple cameras are used to generate virtual viewpoint content, then the sense of realism and viewer satisfaction improve, but the amount of data transmission and system complexity increase, leading to potential failures and image quality deterioration
Solution Approach 1:
The patent extracts and utilizes only the necessary portions of captured images to generate virtual viewpoint content. By selectively using image data from multiple cameras only when needed for virtual viewpoint generation, the system reduces unnecessary data transmission while maintaining image quality, thus resolving the contradiction between reliability and device complexity
Solution Approach 2:
The patent creates virtual viewpoint images as copies that simulate the effect of multiple cameras without actually requiring multiple physical cameras for every viewpoint. The virtual viewpoint content is generated by processing and synthesizing image data, producing copies of the viewing experience that reduce the need for complex multi-camera setups
2Reliability
If the number of captured images is reduced to avoid system failures, then data transmission amount decreases and system reliability improves, but image quality of virtual viewpoint content deteriorates
Solution Approach 1:
The patent changes the parameter of image processing by generating virtual viewpoint content through computational methods rather than direct capture. This allows the system to maintain image quality by using algorithms to synthesize high-quality virtual viewpoints from fewer actual captured images, thus improving system stability without sacrificing image quality
3Reliability
If the amount of image data is reduced to prevent system failures, then data transmission decreases and system reliability improves, but viewer satisfaction decreases due to image quality deterioration
Solution Approach 1:
The patent introduces virtual viewpoint generation as an intermediary process between captured images and final content delivery. This intermediary computational step allows the system to maintain high image quality by synthesizing virtual viewpoints from reduced sets of captured images, preventing information loss while improving system reliability through reduced data transmission
Data Source
AI summary
An image processing apparatus generates a plurality of virtual viewpoint images being temporally consecutive, and includes a data acquisition unit, a parameter acquisition unit, a viewpoint acquisition unit, and a generation unit. The data acquisition unit is configured to acquire image data that is obtained by capturing images in a plurality of directions by a plurality of image capturing devices. The parameter acquisition unit is configured to acquire a parameter related to the acquired image data and related to quality of the plurality of virtual viewpoint images. The viewpoint acquisition unit is configured to acquire viewpoint information representing a moving path of a virtual viewpoint. The generation unit is configured to generate the plurality of virtual viewpoint images according to a virtual viewpoint having a moving speed based on the acquired image data. The moving speed being determined based on the acquired parameter and the acquired viewpoint information.