Free Viewpoint Movement Display Device Using Camera Vector Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current free viewpoint display technologies using computer graphics (CG) suffer from distortion and information omission when changing viewpoints, especially if the CG is coarse, and cannot accurately represent real-world scenes without adding or omitting information.
Innovation Solution
A free viewpoint movement display device that uses camera vector (CV) video acquisition, virtual three-dimensional space disposition, viewpoint movement path selection, and continuous image generation to move viewpoints smoothly between images without relying on CG, by selecting the closest image frames and adjusting enlargement and viewpoint direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If CG is used to create free viewpoint display, then viewpoint movement can be achieved, but image distortion and information omission occur
Solution Approach 1:
The patent uses actual captured images from multiple viewpoints as direct copies of real-world scenes, rather than creating synthetic CG models. By selecting and displaying actual images taken from different positions, the system preserves all original information without the distortion and information loss inherent in CG reconstruction.
Solution Approach 2:
The patent divides the viewing experience into discrete captured images from multiple viewpoints, then selects appropriate segments (images) based on the desired viewpoint position. This segmentation approach allows smooth viewpoint transitions by selecting images in sequence while maintaining information integrity.
2Manufacturing precision
If CG is thoroughly created to match reality, then accurate shape representation is achieved, but information omission and addition of erroneous information still occur
Solution Approach 1:
Instead of creating CG models that attempt to replicate reality, the patent directly uses captured images as accurate representations. Each image is an authentic copy of the scene from a specific viewpoint, eliminating all information omission and erroneous information problems inherent in CG modeling.
Solution Approach 2:
The captured images themselves serve the dual purpose of both being the source data and the final display content. The images automatically contain all necessary geometric and photometric information without requiring additional CG processing, making the system self-sufficient.
3Loss of information
If multiple images are used for free viewpoint display, then information completeness is improved, but device complexity increases
Solution Approach 1:
The patent introduces a viewpoint-position-based selection mechanism as an intermediary between the multiple captured images and the display. This mediator automatically selects the appropriate image based on the desired viewpoint position, simplifying the system compared to complex CG rendering while maintaining information completeness.
Data Source
AI summary
In the invention, a CV (camera vector) video acquisition unit generates a CV video obtained by adding a CV value to a target video on which a CV calculation is performed to obtain the CV value representing three-dimensional coordinate values of a camera position and posture of the target video. A virtual three-dimensional space disposition unit disposes, in a virtual space, a plurality of CV-value-added CV videos in accordance with the three-dimensional coordinates. A viewpoint movement path image selection unit selects, from among the plurality of CV videos, a plurality of image frames closest to scheduled viewpoint movement coordinates in a suitable interval. A starting point/ending point continuous image display unit converts a viewpoint direction and a viewpoint movement direction of the plurality of image frames to match a scheduled direction, and sequentially combines the plurality of image frames to generate a continuous image.