Unlock instant, AI-driven research and patent intelligence for your innovation.

A Multi-style Generative Adversarial Network for Underwater Image Synthesis and Its Application

A technology of underwater image and synthesis method, which is applied in the directions of image enhancement, image analysis, image data processing, etc., and can solve problems such as high requirements for synthetic image conditions, inability to synthesize multi-style underwater images, and few synthesis methods

Active Publication Date: 2021-06-08
OCEAN UNIV OF CHINA
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a multi-style generative confrontation network underwater image synthesis method and its application to solve the problem that the existing underwater image synthesis methods are few, and the conditions for synthesizing images are relatively high, and multi-style underwater images cannot be synthesized. Technical issues, the synthesis method converts land images into underwater images of different styles, and estimates the depth of underwater scenes, which provides a basis for further research on the water environment, such as based on the depth estimation of underwater scenes, And then provide a basis for the research of underwater robot path navigation and 3D reconstruction of underwater scenes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Multi-style Generative Adversarial Network for Underwater Image Synthesis and Its Application
  • A Multi-style Generative Adversarial Network for Underwater Image Synthesis and Its Application
  • A Multi-style Generative Adversarial Network for Underwater Image Synthesis and Its Application

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0038] The embodiments of the present application are preferred embodiments of the present application.

[0039] An underwater image synthesis method based on a multi-style generative confrontation network, using a small number of unpaired land domain images and real multi-style underwater domain images of different styles (the unpaired here refers to the number of land images corresponding to several water images). Under the image, but do not need to satisfy the image structure content and quantity one-to-one correspondence between them), through the unsupervised deep learning method, the land domain image is converted into a synthesized multi-style underwater domain image, and the synthesized multi-style underwater domain image The domain image contains features such as texture and color of the underwater real image, and the method includes the following steps:

[0040] First, use devices that can obtain depth information images, such as Kinect units (somatosensory game devi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a multi-style generation confrontation network underwater image synthesis method and its application, collecting RGB-D images on land, constructing a land RGB-D image data set, and collecting underwater images of different styles as a real multi-style For underwater domain images, build a generation confrontation network model based on CycleGAN, input land domain images and underwater domain images into the network model, and convert land domain images into synthetic multi-style underwater domain images through training and iterative feedback. The synthesized multi-style underwater domain images contain features such as texture and color of underwater real images. In addition, the present invention inputs the synthesized multi-style underwater domain image and the land depth image in the RGB-D image data set as an underwater RGB-D training data set into a supervised depth estimation network to obtain an underwater scene depth estimate, It provides a basis for further research on the water environment.

Description

technical field [0001] The invention relates to the technical field of underwater computer vision, in particular to an underwater image synthesis method of a multi-style generation confrontation network and its application. Background technique [0002] Underwater vision is the basis for the study of oceans, lakes and other waters. In a complex water environment, it is difficult to obtain image datasets with water information with equipment. Due to the strong absorption and scattering effects, underwater imaging and analysis have certain limitations, which restricts the development of underwater visual depth estimation and other technologies. [0003] Synthesizing an underwater dataset of specific water quality parameters from a land dataset matched with depth information plays a vital role in underwater vision research. However, there are currently few underwater image synthesis methods, and the conditions for synthesizing underwater images require corresponding water qua...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/50G06T7/50G06T7/90G06T11/00
CPCG06T5/50G06T11/001G06T2207/20221G06T7/50G06T7/90
Inventor 俞智斌李娜郑海永郑冰
Owner OCEAN UNIV OF CHINA