Image restoration method and device and electronic equipment

A repair method and image technology, applied in the field of deep learning, can solve problems such as inability to perform image repair well, and achieve the effect of reducing the possibility of semantic information loss and accurate images

Pending Publication Date: 2019-12-06
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF4 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, if too much information is missing in the current image, it is difficult to effectively extract the semantic information of the image with existing methods, and it may not be possible to perform image restoration well.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image restoration method and device and electronic equipment
  • Image restoration method and device and electronic equipment
  • Image restoration method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0076] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention.

[0077] see figure 1 , figure 1 Shown is a schematic flow chart of the image restoration method provided by the embodiment of the present invention, which may include:

[0078] S101. Using a convolution kernel with a preset size, perform partial convolution kernel processing on the image to be repaired to obtain a feature map of the repaired image.

[0079] The feature map is a two-dimensional image used to represent the features of the image to be repaired, and the pixel value of each pixel in the feature map is used to represent the image feature of an image region or a pixel in the image to be repaired. In the embodiment of the present invention, the principle of the partial convolution is the same as the principle of the partial convolution in the related art, so it will ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiments of the invention provide an image restoration method and device and electronic equipment. The method comprises the following steps: carrying out partial convolution processing on a to-be-restored image by utilizing a convolution kernel with a preset size to obtain a feature map of the to-be-restored image; downsampling the feature map of the to-be-restored image to a first resolution through partial convolution processing: carrying out the partial convolution processing of the feature map of the to-be-restored image through employing the plurality of cavity convolution kernelswith different sizes, and obtaining feature maps corresponding to the plurality of cavity convolution kernels with different sizes; fusing the feature maps corresponding to all the cavity convolutionkernels of different sizes to obtain a fusion result, and taking the fusion result as a new feature map of the to-be-restored image; and through partial convolution processing, downsampling the feature map of the to-be-restored image to a second resolution: performing deconvolution processing on the feature map of the to-be-restored image to obtain an image with the same resolution as the to-be-restored image, and taking the image as a restored image. The restored image can be more accurate.

Description

technical field [0001] The present invention relates to the technical field of deep learning, in particular to an image restoration method, device and electronic equipment. Background technique [0002] Part of the image information may be missing in some images. For example, due to the occlusion of billboards, the images of some scenes are missing in the captured landscape photos, which affects the visual effect of the image. In related technologies, a neural network obtained by deep learning can be used to restore missing image information in an image. [0003] However, related methods of image restoration in the prior art are usually a process of adding information to an image based on existing information in the current image. Therefore, if too much information is missing in the current image, it is difficult to effectively extract the semantic information of the image by existing methods, and it may not be possible to perform image restoration well. Contents of the i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06K9/62G06N3/04G06N3/08
CPCG06T5/005G06N3/08G06T2207/20081G06T2207/20084G06N3/045G06F18/253
Inventor 夏清沛杨东孙华超
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap