Unlock instant, AI-driven research and patent intelligence for your innovation.

A Zoom Image Generation Method Combining Block Matching and Neural Networks

A neural network and image generation technology, applied in the field of zoom image generation combining block matching and neural network, can solve problems such as expensive time cost, low output image quality, and inability to guarantee estimation accuracy, and achieve the effect of improving visual effects

Active Publication Date: 2021-03-30
ZHEJIANG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although it has fast processing time at low computational complexity, the step-by-step approach cannot guarantee accurate estimation, especially in the presence of noise
Some literatures propose to use the method of optical flow matching to fuse images of different focal lengths, but the quality of the output image is not high due to the expensive time cost and the problem that the optical flow matching cannot be fully registered.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Zoom Image Generation Method Combining Block Matching and Neural Networks
  • A Zoom Image Generation Method Combining Block Matching and Neural Networks
  • A Zoom Image Generation Method Combining Block Matching and Neural Networks

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0047] The specific implementation of the present invention includes three stages of image feature extraction, image feature fusion and image reconstruction. In the feature extraction stage, the long-focus pictures and short-focus pictures are input into the Unet network, such as figure 2 As shown, the image is convolved with two convolution kernels with a step size of 1 and a size of 3*3*64, and then the image is convolved with a convolution kernel with a step size of 2 and a size of 3*3*128. At this time, the image size is reduced to 1 / 2 of the original image size. Then use two convolution kernels with a step size of 1 and a size of 3*3*128 to convolve the image, and then use a convolution kernel with a step size of 2 and a size of 3*3*256 to convolve the image. At this time, the image size is reduced to 1 / 4 of the original image size.

[0048] In the feature fusion stage, the feature map of the telephoto image and the feature map of the short-focus image are first convolv...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a zoom image generation method that combines block matching and neural networks. At the same time, the telephoto lens and the short focus lens of the bifocal camera are used to shoot the same shooting scene or object under the same optical axis to obtain the telephoto image and the short focus image; the Unet neural network structure is established, and the Unet neural network structure includes convolution In the partial deconvolution part, both the telephoto image and the short-focus image are input to the convolution part for image feature extraction, thereby obtaining the high-frequency detail feature structure of the telephoto image and the short-focus image; a block matching algorithm is used to combine the telephoto image and the short-focus image. The high-frequency detail feature structure of the focal image is matched and fused to obtain a cascade image; the cascade image is then input into the deconvolution part of the Unet neural network structure for reconstruction to obtain a zoom image. Based on the requirement of continuous zooming of digital images, the present invention realizes continuous zooming of digital images at any magnification through the structure of image cropping and image deconvolution.

Description

technical field [0001] The invention belongs to a digital image zoom algorithm in the technical field of digital imaging, and in particular relates to a zoom image generation method combined with block matching and neural network. [0002] technical background [0003] It is well known that high-resolution images can provide more details than their low-resolution counterparts. These details should be crucial in all fields such as remote sensing, medical diagnosis, intelligent monitoring, etc. Due to the limitations of optical zoom, digital zoom has been widely used in many imaging devices. Digital zoom digitally enlarges the image without changing the focal length of the lens, thus resulting in a loss of image quality: however, image processing algorithms such as image interpolation used in digital zoom systems, in addition to jaggies and blurring artifacts Does not produce high-quality pictures. To solve this problem, many improved algorithms have been proposed in the pas...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/00G06T5/50
CPCG06T5/50G06T2207/10004G06T2207/20084G06T2207/20021G06T2207/10148G06T2207/20221G06T5/77
Inventor 冯华君杨一帆徐之海李奇陈跃庭
Owner ZHEJIANG UNIV