Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Neural network training and image processing method, device, electronic device and storage medium

A neural network training and neural network technology, applied in biological neural network models, neural architecture, character and pattern recognition, etc., can solve problems such as loss, regardless of image degradation reasons, enhancement, etc., to improve the effect of dehazing and denoising , to avoid the effect of image noise overfitting

Active Publication Date: 2021-12-28
SENSETIME GRP LTD
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method does not consider the cause of image degradation, and has a wide range of applications. It can effectively improve the contrast of foggy images and improve the visual effect of images, but it will cause a certain loss of information on prominent parts.
Dehazing algorithms based on image restoration, such as dehazing algorithms based on prior information, include: dark channel dehazing algorithm, algorithm that assumes that object shadows and reflectance are locally uncorrelated, etc., these algorithms can get better dehazing effects , but need to use prior information to estimate, and enhance the noise in the original image and other unnatural information in the process of defogging
[0005] It can be seen that the existing natural image defogging methods will have a considerable impact on the information in the original image, and cannot achieve the natural image defogging process well.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network training and image processing method, device, electronic device and storage medium
  • Neural network training and image processing method, device, electronic device and storage medium
  • Neural network training and image processing method, device, electronic device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] refer to figure 1 , shows a flowchart of steps of a neural network training method according to Embodiment 1 of the present invention.

[0049] The neural network training method of the present embodiment comprises the following steps:

[0050] Step S102: Obtain a noisy sample image and a corresponding noise-free sample image.

[0051] In the embodiment of the present invention, the noise-free sample image may be any image, and the noisy sample image is an image obtained by adding noise to the noise-free sample image. Wherein, the noise-adding processing performed on the noise-free sample image includes, but is not limited to, processing such as adding fog effects and adding noise, and this embodiment does not limit specific methods of processing such as adding fog effects and adding noise. Optionally, adding fog effects can be performed through fog effect simulation processing. For example, the noise-free sample image is obtained by performing fog effect simulation ...

Embodiment 2

[0060] refer to figure 2 , shows a flowchart of steps of a neural network training method according to Embodiment 2 of the present invention.

[0061] The neural network training method of the present embodiment comprises the following steps:

[0062] Step S202: Obtain a noise-free sample image, and perform a first fog effect simulation process on the noise-free sample image.

[0063] In the embodiment of the present invention, the noise-free sample image can be one or more random images without noise and fog. Effective simulation processing. That is to say, in this embodiment, a foggy image is obtained by performing fog effect simulation processing on a noiseless sample image, so as to train a neural network capable of performing image defogging processing.

[0064] In an optional implementation manner, according to the physical model of atmospheric scattering, the fog effect simulation process is performed on the noise-free sample image by using the transmittance paramet...

Embodiment 3

[0103] refer to Figure 4 , shows a flowchart of steps of an image processing method according to Embodiment 3 of the present invention.

[0104] The image processing method of the present embodiment includes the following steps:

[0105] Step S302: Acquire the original image.

[0106] In the embodiment of the present invention, the original image may be any natural image. The original image usually contains fog effects, noise, etc. For example, in the atmospheric scattering physical model, the original image is composed of the attenuated light of the actual scene scattered by the fog and the ambient light scattered by the fog itself (ie, atmospheric light), and the proportion of the actual scene after attenuation is called the transmittance . Original images generally have white fog, especially images taken in foggy weather.

[0107] Step S304: Based on the neural network, perform denoising processing on the original image to obtain a first denoising image.

[0108]Wher...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the present invention provide a neural network training method, device, electronic device and storage medium, and an image processing method, device, electronic device and storage medium. Among them, the neural network training method includes: obtaining a noisy sample image and a corresponding noise-free sample image; based on the neural network, generating a noise-free estimated image corresponding to the noisy sample image; according to the noise-free estimated image and the noise-free sample image, The neural network is trained; wherein, the neural network is a bilinear neural network. By adopting the technical scheme of the present invention, the problem of image noise overfitting that is prone to occur during neural network training can be avoided, thereby ensuring the influence of the trained neural network on the information in the image, and training through the neural network training method of this embodiment The obtained neural network can realize the defog and denoise processing of the natural image with fog and noise, and effectively improve the defog and denoise effect.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of artificial intelligence, and in particular to a neural network training and image processing method, device, electronic equipment, and storage medium. Background technique [0002] With the development of computer technology and image processing technology, image recognition is widely used in many fields, such as video surveillance, face recognition and so on. Image recognition can identify various target objects by processing, analyzing and understanding images. When performing image recognition, the higher the clarity of the image, the higher the accuracy of recognition. [0003] However, the captured image will be affected by the environment and the air, especially in the case of fog, haze, rain and other bad weather conditions, it is impossible to capture a clear image that is easy for subsequent identification. For this reason, the dehazing technology of natural images cam...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62G06K9/40G06N3/04
CPCG06V10/30G06N3/045G06F18/214
Inventor 孙文秀杨慧戴宇荣严琼任思捷
Owner SENSETIME GRP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products