Virtual Viewpoint Image Generation with Embedded Camera Parameters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face difficulties in efficiently managing and handling virtual viewpoint images, including searching, sorting, displaying viewpoint information, and editing, especially when multiple images are generated simultaneously or stored in a single folder.
Innovation Solution
A generation apparatus that obtains and stores virtual viewpoint parameters, such as position, direction, and viewing angle, within image data files, allowing for the generation, assignment, and display of virtual viewpoint image data, enabling easier identification, visualization, and editing of virtual viewpoint images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple virtual viewpoint images are generated simultaneously from the same scene, then the user can view highlight scenes from various angles, but it becomes difficult to search for and identify particular virtual viewpoint images
Solution Approach 1:
The patent applies preliminary action by embedding viewpoint information (position, direction, camera parameters) into the image data at the time of generation. This allows the images to be automatically tagged and organized before storage, enabling efficient later retrieval without manual sorting or searching.
Solution Approach 2:
The patent introduces viewpoint information as an intermediary data structure that mediates between the generated images and the user's search/identification needs. This intermediary contains metadata about camera position, direction, and parameters, allowing users to easily identify and search for specific virtual viewpoint images.
2Device complexity
If multiple virtual viewpoint image files are stored in a single folder, then storage is simplified, but it becomes difficult to sort them according to user intention
Solution Approach 1:
The system performs preliminary organization by embedding sorting-relevant viewpoint information into each image file during generation. This allows images to be automatically categorized by viewpoint parameters without requiring complex folder structures or manual sorting operations later.
Solution Approach 2:
The patent changes the organizational approach from physical folder structures to parameter-based organization. By storing viewpoint parameters (position, direction, camera settings) within the image data, the system enables flexible sorting and filtering based on these parameters rather than requiring rigid directory hierarchies.
3Device complexity
If virtual viewpoint images are generated without embedded viewpoint information, then generation processing is simpler, but it becomes impossible to display viewpoint information on the images
Solution Approach 1:
The patent merges viewpoint information with the image data by embedding camera parameters, position, and direction data directly into the image file. This combination allows the image and its metadata to be stored and processed together, enabling viewpoint information to be displayed and used without separate data structures.
4Productivity
If virtual viewpoint images are generated without embedded parameters, then generation is faster, but it becomes difficult to edit the virtual viewpoint
Solution Approach 1:
The system performs preliminary embedding of editable viewpoint parameters during the image generation process. By pre-storing camera position, direction, and other parameters within the image data, the system enables fast generation while simultaneously providing the foundation for efficient later editing without requiring regeneration of entire image sequences.
Data Source
AI summary
A generation apparatus according to the present invention is a generation apparatus for generating a media file storing virtual viewpoint image data generated based on pieces of image data of an object captured from a plurality of directions with a plurality of cameras, and obtains a virtual viewpoint parameter to be used to generate virtual viewpoint image data. Further, the generation apparatus generates a media file storing the obtained virtual viewpoint parameter and virtual viewpoint image data generated based on the virtual viewpoint parameter. In this way, the generation apparatus can improve usability related to a virtual viewpoint image.