Multi-View Rendering via Reference Hole Aggregation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Inconsistent image quality in multi-view 3D displays due to holes in interpolated and extrapolated images, where background colors are inaccurately represented across consecutive images, as existing methods fail to consider all available pixel data when inpainting these holes.
Innovation Solution
A rendering apparatus and method that generates predicted views by rendering reference views, detects holes, aggregates these holes into a reference hole layer, inpaints the reference hole using known pixel information, and inserts the inpainted reference hole into each predicted view to remove holes, ensuring consistent image representation across multiple viewpoints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If individual hole inpainting is performed for each predicted view, then the processing complexity is reduced, but image quality deteriorates due to inconsistency between views
Solution Approach 1:
The patent merges hole inpainting operations across multiple predicted views by aggregating holes into a single reference hole layer. Instead of processing each view independently, the system combines all hole locations from interpolated and extrapolated views, performs unified inpainting on the aggregated reference hole, and then distributes the inpainted results back to individual views. This merging approach ensures consistency across views while maintaining processing efficiency.
Solution Approach 2:
The patent performs preliminary aggregation of holes from all predicted views before executing the inpainting operation. By pre-identifying and combining all hole locations into a reference hole layer, the system prepares a comprehensive inpainting template that can be efficiently applied to multiple views simultaneously, avoiding repeated individual processing and ensuring consistent results across all views.
2Manufacturing precision
If more predicted views are generated, then the multi-view 3D display quality improves, but the number of holes and processing load increases
Solution Approach 1:
The patent combines hole aggregation and unified inpainting operations to handle multiple predicted views efficiently. By merging all hole information from interpolated and extrapolated views into a single reference hole layer and performing one unified inpainting operation, the system reduces the processing load that would otherwise scale linearly with the number of views, while still delivering high-quality consistent multi-view output.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A rendering apparatus and method for generating multi-views are provided. A rendering unit may generate a plurality of predicted views by rendering one or more reference views, and a hole aggregating unit may generate a reference hole representing an aggregation of holes existing in each of the predicted views. A hole inpainting unit may inpaint the reference hole, and a multi-view generating unit may remove the holes existing in each of the predicted views using the inpainted reference hole.