Virtual Viewpoint Image Generation with Scene Metadata Preservation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a demand to identify the scene in a virtual viewpoint image and generate new virtual viewpoint images corresponding to different viewpoints, while existing technologies do not provide sufficient information about the original scene or generated images.
Innovation Solution
An information processing apparatus that captures images of products generated from 3D models, uses this data to obtain information about the scene, and outputs a virtual viewpoint image corresponding to the product, utilizing a database to manage 3D model information and generate virtual viewpoint images based on captured image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual viewpoint images are generated from captured images, then the ability to view scenes from different viewpoints is improved, but information about the original scene and product identity is lost
Solution Approach 1:
The system performs preliminary actions by capturing the original image and extracting product information, scene information, and拍摄 information before generating the virtual viewpoint image. This stored information is then used to enrich the virtual viewpoint image with metadata about the original scene, product identity, and capture conditions, ensuring information is preserved alongside the transformed viewpoint.
2Manufacturing precision
If 3D models are used to generate products and virtual viewpoint images, then the ability to create realistic representations is improved, but the connection between the original captured image and generated content is weakened
Solution Approach 1:
The system implements feedback by using the captured image information as a reference to validate and enrich the generated 3D model and virtual viewpoint image. The original image data, product information, and scene information are fed back into the system to ensure the generated content remains faithful to the original capture while adding value through multiple viewpoints and detailed metadata.
Data Source
AI summary
An information processing apparatus obtains information corresponding to a scene in a virtual viewpoint image to be generated. The information is information based on a captured image including a product generated based on the scene in the virtual viewpoint image. The information processing apparatus outputs, based on the obtained captured image, a virtual viewpoint image of the scene corresponding to the product.