A Free Viewpoint Image Synthesis Method Introducing Color Correction
A viewpoint image and color correction technology, applied in the field of image processing, can solve the problems of incomplete and ideal filling methods, ignoring the necessity of filling holes in the background, blurring edges of filling areas, etc., so as to improve viewing comfort, accurate and reasonable color differences, The effect of improving image quality
Active Publication Date: 2018-03-13
XIDIAN UNIV
View PDF5 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
K.J.Oh proposed that the hole comes from the background (K.J.Oh, S.Yea and Y.S.Ho, Hole filling method using depth based in-painting for view synthesis in free viewpoint television and 3-d video, Proc. PictureCoding Symposium, 1–4, 2009), And separate the foreground and background according to the depth information, and then use the background information to fill the hole, but the specific filling method is not exhaustive and ideal
M.Solh proposed a simple and efficient layer-by-layer hole filling method (M.Solh and G.AlRegib, Hierarchical hole-filling for depth-based views synthesis in FTV and 3D video, IEEE Journal on Selected Topics in Signal Processing, 6, 495–504, 2012), its disadvantage is that it ignores the necessity of the background filling the hole, resulting in blurred edges of the filled area
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
specific Embodiment approach
[0039] refer to figure 1 , the specific embodiment of the present invention is as follows:
[0040] Step 1, input the left and right viewpoint views and their corresponding depth maps and perform 3D conversion.
[0041] 1a) Input the left-viewpoint view L to be synthesized and its corresponding left-viewpoint depth map L D , the right-viewpoint view R and its corresponding right-viewpoint depth map R D ;
[0042] 1b) Perform 3D inverse transformation on them based on the positional relationship and projection equation, and project the left viewpoint view L to the middle viewpoint plane to obtain the left virtual view W L , project the right viewpoint view R to the middle viewpoint plane to obtain the right virtual view W R , the left-view depth map L D Project to the middle viewpoint plane to get the left virtual depth map D L , the right-view depth map R D Project to the middle viewpoint plane to get the right virtual depth map D R .
[0043] The left and right viewp...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a free viewpoint image synthetic method introducing color correction and mainly solves the problems in an existing viewpoint synthetic technology that a synthetic image is discontinuous in color and is fuzzy in cavity edge. The method comprises the realization steps of: input left and right viewpoint views and corresponding depth images thereof, and by means of 3D conversion, obtaining left and right virtual views; according to a position relation, synthesizing the left and right virtual views into a non-blocked region of an intermediate virtual view; utilizing color differences among background regions of the virtual view to replace the color differences among blocked regions of the virtual view, and utilizing a histogram matching algorithm to obtain the blocked regions subjected to color correction; fusing the non-blocked region and the blocked regions subjected to color correction, and obtaining an intermediate viewpoint image having hollow points; and carrying out cavity filling layer by layer on the intermediate viewpoint image having the hollow points, and obtaining a final synthetic virtual image. According to the invention, the quality of the synthetic virtual image is improved, the watching comfort of a 3D video is improved, and the method can be applied to stereo multimedia.
Description
technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a free viewpoint image synthesis method, which can be used for stereoscopic multimedia. Background technique [0002] Since stereoscopic multimedia 3DTV can provide a more realistic, natural, and lifelike visual environment, it has been recognized by consumers in recent years and has gradually penetrated into the multimedia market. Free viewpoint synthesis, as the core technology in the field of 3DTV, has been studied and studied by researchers. Since 3D video has requirements for viewing positions, that is, different positions should receive different disparity or depth information, which means that each viewing position should have a corresponding camera position for scene shooting. Due to the high cost of stereo cameras And shooting conditions are limited, it is too difficult to achieve all-round shooting. Free-viewpoint image synthesis effectively solves...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/122
CPCH04N13/111H04N13/122
Inventor 焦李成乔伊果侯彪杨淑媛刘红英曹向海马文萍马晶晶张丹霍丽娜
Owner XIDIAN UNIV