Virtual Viewpoint Image Generation Method Switching Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating virtual viewpoint images, such as MBR and IBR, face challenges in maintaining image quality and continuity when switching rendering methods, leading to potential visual incongruities due to differences in three-dimensional shape restoration and perspective transformation.
Innovation Solution
A system that includes a generation unit, a changing unit, and a control unit to dynamically determine and switch between rendering methods like IBR and MBR, while controlling the change to suppress significant image quality variations, using camera parameters and virtual camera path information to ensure continuity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If rendering methods are switched dynamically to adapt to different situations, then adaptability is improved, but image quality continuity deteriorates
Solution Approach 1:
The patent implements a feedback mechanism where the determination unit continuously monitors image quality metrics and switching conditions, using this information to decide whether to switch rendering methods. This feedback loop ensures that switching occurs only when beneficial and maintains image quality continuity by preventing switches during critical moments.
Solution Approach 2:
The patent performs preliminary evaluation of switching conditions before actually switching rendering methods. The determination unit assesses multiple parameters and predicts the outcome of potential switches, only proceeding with switching when the evaluation confirms it will improve adaptability without compromising continuity.
2Adaptability or versatility
If MBR method is used for high viewpoint freedom, then adaptability is improved, but manufacturing precision deteriorates
Solution Approach 1:
The patent dynamically selects between MBR and IBR methods based on real-time requirements. When viewpoint freedom is prioritized, MBR is selected; when precision is critical, IBR is chosen. This dynamic adaptation allows the system to optimize for different priorities without being constrained by the limitations of a single method.
Solution Approach 2:
The patent changes the operational parameters by switching between different rendering methodologies. By adjusting which method is active based on scene requirements, the system can achieve high viewpoint freedom when needed while maintaining precision when required, effectively managing the trade-off through parameter changes.
3Manufacturing precision
If IBR method is used for high realism, then manufacturing precision is improved, but adaptability deteriorates
Solution Approach 1:
The system dynamically switches between IBR and MBR based on the specific requirements of each scene or time period. When high realism is needed for static scenes, IBR is used; when viewpoint freedom is required for dynamic viewing, MBR takes over. This dynamic approach allows the system to maximize realism when possible while maintaining adaptability when needed.
Data Source
AI summary
A generation apparatus that generates a virtual viewpoint image based on a plurality of captured images obtained by a plurality of cameras and virtual viewpoint information, and includes: a generation unit configured to generate a virtual viewpoint image by a generation method determined from a plurality of generation methods for generating a virtual viewpoint image: a changing unit configured to change the generation method for generating a virtual viewpoint image from a first generation method to a second generation method; and a control unit configured to perform control to restrain a change of the generation method by the changing unit.