Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image processing method and device, equipment and storage medium

An image processing and image technology, applied in image data processing, image enhancement, neural learning methods, etc., can solve problems such as limited repair effect, inability to reasonably fill in the missing areas of the image, and difficulty in meeting users' needs for image repair effects, etc. To achieve the effect of filling and repairing reasonable and improving sensitivity

Pending Publication Date: 2020-10-09
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current image restoration technology has limited repair effects, and often cannot reasonably fill the missing areas in the image, so it is difficult to meet the needs of users for image restoration effects.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image processing method and device, equipment and storage medium
  • Image processing method and device, equipment and storage medium
  • Image processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0100] In one embodiment, the down-sampling module includes:

[0101] The third convolution sub-module is used to use each convolution layer to determine the convolution kernel of each convolution window when the first image input to this layer is input for convolution by using the mask image input to this layer.

[0102] In one embodiment, the image processing device also includes:

[0103] The convolution module is configured to use the convolution layer of the i-th layer to perform a convolution operation on the first image obtained after the convolution operation to obtain a second feature map.

[0104] The sending module is used to input the second feature map into the deconvolution layer of the i-th layer of the decoding network.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image processing method and device, equipment and a storage medium, and relates to the technical field of artificial intelligence, deep learning and image processing. The method comprises the following steps: inputting a mask image and a first image into a coding network; downsampling the first image by using each convolution layer of the coding network; enabling at least one convolution layer to determine a convolution kernel of each convolution window when a first image input into the convolution layer is subjected to convolution by inputting a mask image of the convolution layer; inputting a second image into a decoding network; and upsampling the second image by using each deconvolution layer of the decoding network, and outputting an image after the target area is filled. According to the embodiment of the invention, the convolution kernel of each convolution window during convolution of the first image in the same layer is determined through the mask image, so the method and the device can better adapt to the feature extraction of effective pixels in different convolution windows through employing the dynamic calculation convolution kernel, improvethe sensitivity of feature extraction, and finally enable the filling and restoration of an image missing area to be more reasonable.

Description

technical field [0001] This application relates to the field of computer technology, especially to the fields of artificial intelligence, deep learning, and image processing technology. Background technique [0002] When taking pictures, unwanted people or objects often appear in the image, so it is necessary to remove the unwanted content in the image and repair and reconstruct the image. When reconstructing the blank area generated by removing the unwanted content in the image, it is necessary to make a more natural filling according to the image color, texture, content and other information around the blank area in order to achieve a better image restoration. Rebuild effect. However, the current image inpainting technology has limited inpainting effects, and often cannot reasonably fill in the missing areas in the image, so it is difficult to meet the needs of users for image inpainting effects. Contents of the invention [0003] The present application provides an im...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06T11/40G06K9/46G06N3/04G06N3/08
CPCG06T11/40G06N3/08G06V10/44G06V10/56G06N3/045G06T5/77
Inventor 何栋梁李甫李超张赫男孙昊
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products