Continuous Depth-Ordered Image Compositing with 3D Fragment Thickness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image compositing techniques inaccurately cluster fragments, leading to abrupt changes in pixel colors during scene animation, causing spatial inconsistencies in 2D images and temporal inconsistencies in videos, resulting in artifacts and flickering.
Innovation Solution
Assign a finite thickness to each fragment to convert them into 3D fragments, determining how to group fragments based on these thicknesses to maintain continuous compositing, ensuring accurate pixel colors by analyzing their color contributions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional image compositing techniques are used to combine image fragments, then the compositing process is simple and fast, but the fragment order changes abruptly causing spatial artifacts and temporal flickering
Solution Approach 1:
The patent extends 2D image fragments into 3D space by assigning depth values and thicknesses to fragments. This dimensional transformation creates volume spans that represent the spatial extent of fragments along the viewing direction, enabling continuous compositing by comparing overlapping volumes rather than discrete 2D fragments.
Solution Approach 2:
The patent introduces thickness as a new parameter for fragments, transforming them from 2D surfaces to 3D volumes. By defining volume spans with start and end depth values, the system changes the compositing parameters from simple fragment ordering to continuous volume-based ordering, preventing abrupt transitions.
2Productivity
If fragments are composited in discrete order, then the processing is computationally efficient, but small errors in surface positions cause abrupt fragment order changes
Solution Approach 1:
The patent preemptively assigns thickness to fragments and creates volume spans that overlap in depth space. This cushioning effect ensures that even if surface positions have small errors, the volume spans maintain their ordering relationship, preventing abrupt changes in fragment order during compositing.
Solution Approach 2:
The patent introduces volume spans as an intermediary representation between 2D fragments and the final compositing operation. These volume spans serve as mediators that smooth out discontinuities by representing fragments as continuous 3D entities with overlapping depth ranges, stabilizing the compositing process.
3Measurement precision
If 2D fragments are used for compositing, then the data representation is compact, but the compositing results are discontinuous and inaccurate
Solution Approach 1:
The patent enhances 2D fragment representation by adding the depth dimension, creating 3D volume spans. This dimensional augmentation provides more accurate spatial information for compositing while maintaining data compactness by representing each fragment as a defined volume with start and end depth values rather than storing multiple 2D slices.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system creates an output image of a scene using two-dimensional (2D) images of the scene. For a pixel in the output image, the system identifies, in the output image, 2D fragments that correspond to the pixel. The system converts the 2D fragments into three dimensional (3D) fragments, creates volume spans for the pixel based on the 3D fragments, determines a color of a volume span based on color contribution of respective one or more of the 3D fragments for the volume span, and determines a color of the pixel for the output image from determined colors of the volume spans.