Reference Image Data Generation for Free Viewpoint Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image display systems with free point of view require high responsiveness and enhanced resolution to maintain a sense of presence, but current technologies struggle to balance responsiveness with complex calculations, often resulting in delayed image rendering and impaired immersion.
Innovation Solution
An image generating apparatus that uses pre-rendered reference images from multiple viewpoints, selecting valid pixel values based on the actual viewpoint and combining them for accurate and responsive image rendering, while deleting redundant data to manage computational load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If complex calculations are performed to enhance resolution and sense of presence, then image quality is improved, but processing time increases and responsiveness decreases
Solution Approach 1:
The patent pre-calculates and stores pixel values for multiple reference viewpoints before actual image generation. When a target viewpoint is requested, the system retrieves pre-computed reference images and combines them through simple interpolation rather than performing complex real-time calculations. This preliminary action resolves the contradiction by shifting computational burden from runtime to preprocessing phase.
Solution Approach 2:
The patent divides the viewing space into multiple discrete reference viewpoints and pre-computes pixel values for each. Instead of calculating all possible viewpoints continuously, the space is segmented into reference points, allowing efficient retrieval and combination of pre-computed data. This segmentation reduces real-time computational load while maintaining image quality.
2Speed
If real-time image rendering is performed for every viewpoint change, then responsiveness is improved, but computational load increases and image quality may deteriorate
Solution Approach 1:
The system performs preliminary rendering of reference images at multiple viewpoints before runtime. These pre-rendered images are stored and quickly retrieved during actual operation. This approach achieves high responsiveness because the computationally intensive rendering work is completed in advance, leaving only simple interpolation operations for real-time viewpoint changes.
Solution Approach 2:
The patent creates copies of scene data from multiple reference viewpoints and stores them for rapid access. Instead of regenerating image data from scratch for each viewpoint change, the system copies and combines relevant portions of pre-rendered reference images. This copying mechanism reduces computational load while maintaining responsiveness.
3Manufacturing precision
If reference images are stored for all possible viewpoints, then image quality is maintained, but data storage requirements increase
Solution Approach 1:
The patent segments the continuous viewpoint space into discrete reference points and only stores data for these specific viewpoints. By dividing the viewing sphere into a finite set of reference directions, the system reduces storage requirements compared to storing all possible viewpoints, while still maintaining adequate image quality through interpolation between reference points.
Solution Approach 2:
The system stores complete image data only at reference viewpoints, while intermediate viewpoints are generated through local interpolation. This local quality approach means high-quality pre-computed data is stored only where needed (at reference points), reducing overall storage requirements while maintaining image quality through localized reconstruction of intermediate views.
Data Source
AI summary
With respect to a space including an object 40 of a display target, images of the space viewed from reference points 42a to 42c of view are created as reference images 46a, 46b, and 46c in advance and they are synthesized according to a position of an actual point of view to render a display image. In the certain reference image 46b, data other than a part 48 represented only in it is deleted. At the time of rendering of the deleted part, the other reference images 46a and 46c are used.