Tiered Virtual Viewpoint Image Generation for Lower Processing Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual viewpoint image generation techniques face increased processing loads when multiple virtual viewpoints are specified and a specific one is selected, necessitating the generation and presentation of multiple images, which is inefficient and demands higher quality images.
Innovation Solution
An information processing apparatus and method that includes separate image generation units to handle multiple virtual viewpoints, with one unit generating lower-quality images for display and another generating higher-quality images based on user selection, synchronized by a time control unit to reduce processing load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple virtual viewpoint images are generated to allow user selection, then the user can select from multiple viewpoints, but the processing load increases significantly
Solution Approach 1:
The patent divides the image generation process into two separate units: a first image generation unit that generates lower-quality virtual viewpoint images for display, and a second image generation unit that generates higher-quality images for selected viewpoints. This segmentation allows the system to maintain multiple viewpoint options while managing processing load by only generating high-quality images for the final selected viewpoint rather than all possible viewpoints.
Solution Approach 2:
The patent applies different quality levels to different viewpoints based on their selection status. Lower-quality images are generated for multiple viewpoints for preview purposes, while higher-quality images are generated only for the ultimately selected viewpoint. This local quality differentiation reduces overall processing load while maintaining user experience.
2Manufacturing precision
If high-quality virtual viewpoint images are generated, then image quality improves, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary generation of lower-quality virtual viewpoint images first, allowing users to select a viewpoint before committing to high-quality image generation. This preliminary action enables the system to prepare multiple options quickly at lower quality, then focus computational resources on generating one high-quality image only after user selection, thereby reducing total processing time.
Solution Approach 2:
The patent generates lower-quality images for all possible viewpoints (excessive action at low quality) rather than attempting to generate high-quality images for all viewpoints simultaneously. This partial quality approach ensures users have multiple options to choose from while avoiding the excessive processing time that would result from generating high-quality images for every possible viewpoint.
3Ease of operation
If multiple virtual viewpoint images are generated for user selection, then user can choose the best viewpoint, but the device complexity increases
Solution Approach 1:
The patent segments the image generation functionality into two distinct units with different quality levels and purposes. The first unit handles multiple viewpoints at lower quality for user selection, while the second unit handles the final selected viewpoint at high quality. This segmentation simplifies the overall system architecture by clearly defining separate responsibilities for each unit, making the system easier to manage despite supporting multiple viewpoints.
Solution Approach 2:
The first image generation unit serves a universal purpose by generating preview images for all possible viewpoints, which are then used for user selection regardless of which specific viewpoint is ultimately chosen. This multi-functional approach allows a single unit to handle multiple viewpoints without requiring separate dedicated systems for each viewpoint, thereby reducing overall device complexity.
Data Source
Figure 1
Figure 2A~2B
Figure 3
AI summary
In an information processing apparatus (6), a viewpoint information acquisition unit (61) acquires viewpoint information representing a position of a virtual viewpoint and a line-of-sight direction from the virtual viewpoint used for generating a virtual viewpoint image based on a plurality of images captured by a plurality of imaging apparatus. A viewpoint information output unit (63) outputs a plurality of pieces of viewpoint information obtained based on a plurality of operations to first generation means (8a) configured to generate a plurality of virtual viewpoint images according to a condition regarding first quality based on the viewpoint information. The viewpoint information output unit also outputs one or more pieces of viewpoint information selected from among the plurality of pieces of viewpoint information to second generation means (8b) configured to generate a virtual viewpoint image according to a condition regarding second quality higher than the first quality based on viewpoint information.