Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Underwater image restoration method based on cyclic generative adversarial network

An underwater image and image generation technology, applied in the field of image processing, can solve the problems of difficult realization, poor generalization, under-enhanced image enhancement, etc., to achieve the effect of increasing robustness, good recovery, and ensuring diversity

Active Publication Date: 2020-06-12
NANJING UNIV OF INFORMATION SCI & TECH
View PDF4 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the complex physical and optical factors underwater, these traditional methods are difficult to realize
At the same time, due to the lack of rich training data, these methods have poor generalization in different underwater environments, and the enhanced images of some scenes often have a tendency to over-enhance or under-enhance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Underwater image restoration method based on cyclic generative adversarial network
  • Underwater image restoration method based on cyclic generative adversarial network
  • Underwater image restoration method based on cyclic generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0034] This embodiment proposes a recurrent generative adversarial network based on perceptual loss, and uses the network to restore underwater images. The method does not require paired datasets, but only a set of clear aerial images and a set of distorted underwater images, and the two sets of images do not need to have the same structure. The steps are as follows:

[0035] Step 1: Prepare the training data set

[0036] The recurrent generative adversarial network based on perceptual loss proposed in this example mainly includes two sets of data sets, one set is undistorted air images, and the other set is distorted underwater images. These two sets of images do not need to have the same structure , that is, the unpaired data set.

[0037] The undistorted images come from a subset of the ImageNet image set, and the distorted underwater images are the underwater images of different scenes downloaded by the author himself from the Internet. These images are resized to 256×2...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an underwater image restoration method based on a cyclic generative adversarial network, and the method builds a cyclic generative adversarial network (CycleGAN-VGG) based onperception loss, the network is an end-to-end network architecture, and a restored image is directly obtained through an inputted distorted underwater image. According to the invention, the cyclic consistency loss is reduced; vGG perception loss is added to enhance the structure of the CycleGAN, the overall structure of the input image is reserved by optimizing the cyclic consistency loss, and thedifference of the image feature space is compared by perception loss, so that the network can better recover the detail information of the underwater image, perform underwater image recovery and increase the definition of the image. According to the method, the framework of the Wasserstein GAN is adopted, so that the robustness of the method is improved. Meanwhile, in the training and testing stages, the method does not need paired distortion and real image samples, and does not need any underwater image imaging model parameters.

Description

technical field [0001] The invention relates to an underwater image restoration method based on a cyclic generation confrontation network, and belongs to the technical field of image processing. Background technique [0002] In recent years, ocean engineering and research have increasingly relied on underwater imagery taken by autonomous and remotely operated underwater vehicles. However, due to wavelength-dependent light absorption and scattering and the influence of low-end optical imaging equipment, underwater images often suffer from degradations such as insufficient contrast, dispersion, and noise. In addition, the magnitude of light absorption and scattering depends on several complex factors, including water temperature and salinity, and the type and amount of particulate matter in the water. Severe degradation makes it difficult to restore the appearance and color of underwater images. However, color is very important for the study of underwater vision tasks. Ther...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06N3/04G06N3/08
CPCG06N3/08G06T2207/20081G06T2207/20084G06N3/045G06T5/00
Inventor 王鹏陈海秀金肃钦许炜华
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products