A Method for Simultaneous Super-resolution and Colorization of Satellite Imagery Based on Multi-task Deep Neural Networks

A deep neural network and satellite image technology, applied in the field of simultaneous super-resolution and coloring of satellite images, can solve problems such as network incompatibility, complex, variable, and multi-task incompatibility, and achieve enhanced details, shortened execution time, and broad application prospects Effect

Active Publication Date: 2021-05-25
ANHUI UNIVERSITY OF TECHNOLOGY
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In order to overcome the inability to deal with complex and changeable problems in reality and the possible incompatibility between multi-tasks in the above-mentioned prior art; the present invention proposes a simultaneous super-resolution and coloring of satellite images based on a multi-task deep neural network Method; the present invention not only carries out multi-task learning to two completely different aspects, but also solves the problem of incompatibility between networks, and satisfies complex requirements in reality

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method for Simultaneous Super-resolution and Colorization of Satellite Imagery Based on Multi-task Deep Neural Networks
  • A Method for Simultaneous Super-resolution and Colorization of Satellite Imagery Based on Multi-task Deep Neural Networks
  • A Method for Simultaneous Super-resolution and Colorization of Satellite Imagery Based on Multi-task Deep Neural Networks

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0066] combine figure 1 , a method for simultaneous super-resolution and coloring of satellite images based on a multi-task deep neural network of the present embodiment, specifically comprising the following steps:

[0067] Step 1. Utilize commonly used data sets, such as satellite data sets such as ImageNet and AID, to make high-resolution image block training sets and low-resolution image block training sets. The specific steps are as follows figure 2 As shown, namely:

[0068] For each color image in a commonly used dataset (such as the AID satellite image dataset), the high-resolution image is first subjected to two bicubic interpolation (the first bicubic downsampling interpolation, the second bicubic upsampling interpolation ), to obtain a low-resolution image of the same size corresponding to the high-resolution image;

[0069] Cut each high-resolution image and low-resolution image into multiple 93*93 image blocks (the image blocks cut into 93*93 contain features t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for simultaneous super-resolution and coloring of satellite images based on a multi-task deep neural network, belonging to the technical field of image processing. The present invention mainly comprises the following steps: 1, making high-resolution and low-resolution grayscale image block training sets; 2, constructing a multi-task deep neural network for model training; 3, based on the constructed deep network and the produced The training set trains the network model; 4. According to the learned model parameters, a low-resolution grayscale image is input, and the output obtained is a reconstructed high-resolution color image. By combining the deep super-resolution network and coloring network with excellent performance, the present invention not only enhances the details of the satellite image, but also colorizes the grayscale image at the same time so that it automatically generates a realistic color satellite image, and reduces the The steps and time of execution have broad application prospects in grayscale image coloring, satellite remote sensing and telemetry and other fields.

Description

technical field [0001] The invention belongs to the technical field of image processing, and more specifically relates to a method for simultaneous super-resolution and coloring of satellite images based on a multi-task deep neural network. Background technique [0002] As the performance of the network with a single function becomes stronger, people's demand for a network capable of handling complex multi-tasks is also increasing. The traditional approach is to use the output of one network as the input of another network to get the final result. Because this method not only requires manual interaction, but also wastes a lot of time to execute one by one, and also considers whether there are compatibility issues between the two networks, so people have to seek other methods. [0003] Existing networks need to have two very important functions, super-resolution and colorization. In terms of super-resolution, reconstruction techniques can be divided into different types, ma...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T3/40G06T11/00G06N3/04G06N3/08
CPCG06N3/08G06T3/4046G06T3/4053G06T11/001G06N3/045
Inventor 刘恒伏自霖
Owner ANHUI UNIVERSITY OF TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products