Virtual Viewpoint Image Superimposition Using Reference Imaging Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing information processing systems face challenges in reducing the difference in visual field between images captured by reference imaging devices and virtual viewpoint images, leading to potential visual discomfort and inefficiencies in image quality and device management.
Innovation Solution
An information processing apparatus that acquires and utilizes reference imaging device information, including position, imaging direction, and angle of view, to generate virtual viewpoint images, allowing for real-time adjustments and superimposition with reference images, while continuously updating and optimizing image quality and device settings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If virtual viewpoint images are generated from multiple reference images, then image quality and visual field consistency are improved, but device complexity and processing requirements increase
Solution Approach 1:
The patent creates a virtual imaging device that copies the optical characteristics (focal length, sensor size, angle of view) of reference imaging devices to generate virtual viewpoint images. This copying approach allows high-quality image synthesis without requiring physically complex multi-camera systems, resolving the contradiction between image quality and device complexity
Solution Approach 2:
The patent introduces an intermediary processing system that mediates between multiple reference images and the final virtual viewpoint image. This intermediary layer consolidates multiple reference images through coordinated processing, reducing the complexity burden on individual components while maintaining image quality consistency
2Measurement precision
If reference imaging device information is continuously updated, then image quality and visual field alignment are improved, but data transmission and processing load increase
Solution Approach 1:
The patent performs preliminary actions by pre-acquiring and storing reference imaging device information (position, angle of view, focal length) before actual image generation. This preliminary data preparation allows rapid virtual viewpoint image generation without time-consuming real-time measurements, improving alignment precision while reducing processing time
Solution Approach 2:
The patent implements feedback mechanisms where the system continuously monitors and updates reference imaging device information to maintain accurate visual field alignment. This feedback loop ensures precise image quality consistency while optimizing processing efficiency through intelligent data management
Data Source
AI summary
An information processing apparatus includes a processor which acquires reference imaging device information corresponding to a position, an imaging direction, and an angle of view of a reference imaging device, and on a condition that an instruction to start generating a virtual viewpoint image based on a plurality of images obtained by imaging an imaging region with a plurality of imaging devices is given, generates the virtual viewpoint image by using the reference imaging device information as a reference, acquires image quality information indicating an image quality of a first reference image obtained by imaging the imaging region with the reference imaging device, and outputs a superimposed image in which the virtual viewpoint image is superimposed on a second reference image obtained by imaging the imaging region with the reference imaging device, on a condition that the instruction is given.