3D Shape and Image Quality Mapping for Virtual Viewpoint Evaluation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating virtual viewpoint images face challenges in evaluating image quality at each viewpoint, leading to inefficient and time-consuming processes that often require dedicated apparatuses.
Innovation Solution
An information processing apparatus that associates image quality information with three-dimensional shape information, allowing for quality evaluation of virtual viewpoint images using general-purpose computer graphics tools, and assigns textures or region information based on image quality to facilitate high-quality virtual viewpoint generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If dedicated apparatuses are used for quality evaluation of virtual viewpoint images, then measurement precision is improved, but device complexity and cost increase
Solution Approach 1:
The patent creates a virtual copy of the image quality evaluation function by representing image quality information as data that can be processed by general-purpose computers. Instead of requiring dedicated physical evaluation apparatuses, the system copies the evaluation function into software that runs on standard computing hardware, thereby reducing device complexity while maintaining evaluation precision.
Solution Approach 2:
The patent replaces mechanical/dedicated evaluation hardware with computational methods. Image quality evaluation that traditionally required specialized equipment is substituted with algorithms and data processing techniques that can be executed on general-purpose computers, eliminating the need for complex dedicated apparatuses.
2Manufacturing precision
If dedicated apparatuses are used for virtual viewpoint image generation, then manufacturing precision is improved, but ease of manufacture deteriorates
Solution Approach 1:
The patent makes the image quality information representable on general-purpose computers, allowing standard computing systems to perform functions previously requiring dedicated apparatuses. This universality enables any computer with appropriate software to generate and evaluate virtual viewpoint images, significantly improving ease of manufacture and deployment.
Solution Approach 2:
By copying the image quality evaluation function into data structures and algorithms that can be implemented on general-purpose systems, the patent eliminates the need for expensive dedicated hardware. The evaluation capability is copied as software functionality, making the system easier to manufacture, deploy, and modify.
3Productivity
If image quality information is associated with three-dimensional shape information, then productivity is improved, but device complexity increases
Solution Approach 1:
The patent merges image quality information with three-dimensional shape information into a unified data structure. By combining these two types of information, the system can efficiently process and generate virtual viewpoint images without requiring separate complex systems for shape representation and quality evaluation, thereby improving productivity.
Solution Approach 2:
The patent creates a universal data structure that can represent both three-dimensional shape information and image quality information simultaneously. This multi-functional data structure allows general-purpose computers to handle complex image generation tasks efficiently, improving productivity without requiring specialized complex hardware.
Data Source
AI summary
An information processing apparatus is provided. Three-dimensional shape information indicating a three-dimensional shape of an object is acquired. The three-dimensional shape information is for generating a virtual viewpoint image of the object. Image quality of the object in a captured image of the object obtained by an image capturing apparatus is specified. Information indicating the image quality of the object and the three-dimensional shape information of the object are output.