Multi-view Image Warping for 3D Display Artifact Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multi-view 3D display systems require large amounts of input data, leading to increased complexity and potential image quality issues due to depth/binocular disparity errors, which can result in artifacts and reduced immersion for viewers.
Innovation Solution
An image processing apparatus and method that generates multiple images from a small number of reference views using depth/binocular disparity information, employing foreground-first and background-first warping units to minimize errors and blend images effectively, thereby reducing artifacts and maintaining image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple images are displayed for different viewpoints in multi-view scheme, then the immersion and reality of 3D environment is increased, but the amount of input data required increases significantly
Solution Approach 1:
The patent segments the image processing into two distinct parts: foreground warping and background warping. By dividing the warping process and applying different strategies to foreground objects and background areas, the system efficiently generates multi-view images from limited input data while maintaining high immersion quality without requiring excessive input data quantity
Solution Approach 2:
The patent performs preliminary classification of pixels into foreground and background categories before executing the warping operation. By pre-identifying error suspicious areas and determining their classification, the system prepares the necessary processing structure in advance, enabling efficient generation of multiple viewpoint images from limited input data
2Manufacturing precision
If depth/binocular disparity information is used for view synthesis, then image quality at object boundaries may be improved, but depth disparity errors can cause artifacts and reduce image quality
Solution Approach 1:
The patent applies different quality processing strategies to different regions of the image. Error suspicious areas at object boundaries are identified and handled with specialized foreground-first warping, while other areas use standard background-first warping. This localized quality enhancement improves boundary accuracy without propagating depth disparity errors throughout the entire image
Solution Approach 2:
The patent converts the potentially harmful depth disparity errors into beneficial processing information by identifying error suspicious areas and using them to guide the foreground-background classification. Rather than letting these errors degrade image quality, the system leverages them to improve object boundary accuracy through targeted foreground-first warping in those specific regions
Data Source
AI summary
A method and apparatus for generating multi-view images are provided. An error suspicious area may be detected from a reference view image. A foreground-first image may be generated by foreground-first warping including regarding the error suspicious area as a foreground, and a background-first image may be generated by background-first warping including regarding the error suspicious area as a background. The foreground-first image and the background-first image may be blended, and an output view image in a predetermined viewpoint may be generated.