Optical field image super-resolution and depth estimation method and device based on trans-scale resolution
A high-resolution image and light-field image technology, applied in the field of computer vision, can solve the problems of high cost, low spatial resolution, and large volume, and achieve the effect of strong robustness, fast calculation speed, and reduced equipment overhead.
Active Publication Date: 2018-05-18
TSINGHUA UNIV
View PDF5 Cites 3 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] However, due to the limitation of the sensor in the light field, the spatial and angular resolutions are mutually restricted. For example, a commercial light field camera, which is composed of multiple micro-lens arrays, is easy to carry, but its spatial resolution is very low, which is difficult to meet the demand; One way is a multi-camera array, but this implementation method is expensive, bulky, and needs to be solved
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0034] The following describes in detail the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the present invention and should not be construed as limiting the present invention.
[0035] The following describes the cross-scale resolution light field image super-resolution and depth estimation method according to the embodiment of the present invention with reference to the accompanying drawings. First, the cross-scale resolution light field image super-resolution method according to the embodiment of the present invention will be described Resolution and depth estimation means.
[0036] figure 1 It is a flowchart of a method for super-resolution and depth estimat...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an optical field image super-resolution and depth estimation method and device based on a trans-scale resolution. The method comprises the following steps that: through a single image super-resolution SISR (Semantic Interpretation For Speech Recognition) method, carrying out upsampling; after a high-resolution image positioned in a middle visual angle is subjected to downsampling, utilizing the SISR method to carry out upsampling, and obtaining an error graph; obtaining a disparity map, utilizing an optical field inherent attribute to carry out global optimization on the disparity map, and meanwhile, carrying out a hole filling operation to enable an area which can not be estimated by the disparity map to be estimated again; utilizing a global disparity map to transfer the error graph to enable the image to recover high-resolution image to realize image super-resolution reconstruction; and according to the super-resolution optical field image, carrying out the deep estimation of a scene to obtain a deep estimation result. By use of the method, the global disparity map can be used for transferring the error graph, so that the image recovers the high-resolution image, the scene depth information is obtained through a high-resolution optical field, in addition, robustness is improved, and calculation speed is high.
Description
technical field [0001] The invention relates to the technical field of computer vision, in particular to a method and device for super-resolution and depth estimation of light field images with cross-scale resolution. Background technique [0002] Light field imaging is a brand-new means to record the three-dimensional information of the scene. Different from traditional imaging methods, the light field can not only record the intensity information of light at a certain position, but also record the distribution of light from a certain angle range at this position, so two-dimensional plane imaging is transformed into four-dimensional light field imaging, Includes two spatial dimensions and two angular dimensions. [0003] However, due to the limitation of the sensor in the light field, the spatial and angular resolutions restrict each other. For example, a commercial light field camera, which is composed of multiple micro-lens arrays, is easy to carry, but its spatial resol...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06T7/50G06T5/00
CPCG06T3/4053G06T7/50G06T2207/20228G06T2207/10052G06T2207/10024G06T5/70
Inventor 刘烨斌赵漫丹戴琼海
Owner TSINGHUA UNIV