Neural network training and image processing methods and apparatuses, electronic device and storage medium

A neural network training and neural network technology, applied in biological neural network models, neural architecture, character and pattern recognition, etc., can solve problems such as loss, regardless of image degradation reasons, enhancement, etc., to improve the effect of dehazing and denoising , to avoid the effect of image noise overfitting

Active Publication Date: 2018-06-29
SENSETIME GRP LTD
View PDF10 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method does not consider the cause of image degradation, and has a wide range of applications. It can effectively improve the contrast of foggy images and improve the visual effect of images, but it will cause a certain loss of information on prominent parts.
Dehazing algorithms based on image restoration, such as dehazing algorithms based on prior information, include: dark channel dehazing algorithm, algorithm that assumes that object shadows and reflectance are locally uncorrelated, etc., these algorithms can get better dehazing effects , but need to use prior information to estimate, and enhance the noise in the original image and other unnatural information in the process of defogging
[0005] It can be seen that the existing natural image defogging methods will have a considerable impact on the information in the original image, and cannot achieve the natural image defogging process well.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network training and image processing methods and apparatuses, electronic device and storage medium
  • Neural network training and image processing methods and apparatuses, electronic device and storage medium
  • Neural network training and image processing methods and apparatuses, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] refer to figure 1 , shows a flowchart of steps of a neural network training method according to Embodiment 1 of the present invention.

[0049] The neural network training method of the present embodiment comprises the following steps:

[0050] Step S102: Obtain a noisy sample image and a corresponding noise-free sample image.

[0051] In the embodiment of the present invention, the noise-free sample image may be any image, and the noisy sample image is an image obtained by adding noise to the noise-free sample image. Wherein, the noise-adding processing performed on the noise-free sample image includes, but is not limited to, processing such as adding fog effects and adding noise, and this embodiment does not limit specific methods of processing such as adding fog effects and adding noise. Optionally, adding fog effects can be performed through fog effect simulation processing. For example, the noise-free sample image is obtained by performing fog effect simulation ...

Embodiment 2

[0060] refer to figure 2 , shows a flowchart of steps of a neural network training method according to Embodiment 2 of the present invention.

[0061] The neural network training method of the present embodiment comprises the following steps:

[0062] Step S202: Obtain a noise-free sample image, and perform a first fog effect simulation process on the noise-free sample image.

[0063] In the embodiment of the present invention, the noise-free sample image can be one or more random images without noise and fog. Effective simulation processing. That is to say, in this embodiment, a foggy image is obtained by performing fog effect simulation processing on a noiseless sample image, so as to train a neural network capable of performing image defogging processing.

[0064] In an optional implementation manner, according to the physical model of atmospheric scattering, the fog effect simulation process is performed on the noise-free sample image by using the transmittance paramet...

Embodiment 3

[0103] refer to Figure 4 , shows a flowchart of steps of an image processing method according to Embodiment 3 of the present invention.

[0104] The image processing method of the present embodiment includes the following steps:

[0105] Step S302: Acquire the original image.

[0106] In the embodiment of the present invention, the original image may be any natural image. The original image usually contains fog effects, noise, etc. For example, in the atmospheric scattering physical model, the original image is composed of the attenuated light of the actual scene scattered by the fog and the ambient light scattered by the fog itself (ie, atmospheric light), and the proportion of the actual scene after attenuation is called the transmittance . Original images generally have white fog, especially images taken in foggy weather.

[0107] Step S304: Based on the neural network, perform denoising processing on the original image to obtain a first denoising image.

[0108]Wher...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Embodiments of the invention provide neural network training and image processing methods and apparatuses, an electronic device and a storage medium. The neural network training method comprises the steps of obtaining a noisy sample image and a corresponding noiseless sample image; based on a neural network, generating a noiseless estimation image corresponding to the noisy sample image; and according to the noiseless estimation image and the noiseless sample image, training the neural network, wherein the neural network is a bilinear neural network. By adopting the technical scheme, the problem of high possibility of image noise over-fitting in neural network training can be avoided, so that the influence of the trained neural network on information in the images is ensured; and the neural network trained by the neural network training method can realize defogging and denoising processing performed for foggy and noisy natural images, and effectively improves the defogging and denoising effect.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of artificial intelligence, and in particular to a neural network training and image processing method, device, electronic equipment, and storage medium. Background technique [0002] With the development of computer technology and image processing technology, image recognition is widely used in many fields, such as video surveillance, face recognition and so on. Image recognition can identify various target objects by processing, analyzing and understanding images. When performing image recognition, the higher the clarity of the image, the higher the accuracy of recognition. [0003] However, the captured image will be affected by the environment and the air, especially in the case of fog, haze, rain and other bad weather conditions, it is impossible to capture a clear image that is easy for subsequent identification. For this reason, the dehazing technology of natural images cam...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06K9/40G06N3/04
CPCG06V10/30G06N3/045G06F18/214
Inventor 孙文秀杨慧戴宇荣严琼任思捷
Owner SENSETIME GRP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products