Aurora motion characterization method based on unsupervised deep optical flow network

An unsupervised, aurora technology, applied in the field of video analysis, which can solve the problems of difficulty in manually labeling pixel-level aurora optical flow fields, inability to manually estimate aurora motion methods, and inability to obtain accurate aurora optical flow fields.

Pending Publication Date: 2021-05-11
SHAANXI NORMAL UNIV
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method has the following problems: First, their optical flow field calculation is based on the classic assumption of invariant brightness, that is, the brightness of the observed object remains constant during motion, and the moving object is assumed to be rigid, and there is a stable and prominent However, such a stable observation object does not exist in most aurora images, and the shape, brightness, and volume of the aurora will change during the evolution process, so the aurora data does not satisfy the assumption of constant brightness
[0005] (1) The all-sky imager acquires millions of aurora images every year. Faced with years of accumulated aurora observation data, artificial estimation of aurora motion is becoming more and more inadequate;
[0006] (2) The aurora does not have the property of a rigid body, and its shape, brightness, and volume will change during its evolution, so the aurora data do not satisfy the assumption of constant brightness of the variational optical flow method;
However, during the evolution of the aurora, the motion between two frames may contain different motion scales, and this solution method cannot obtain an accurate aurora light flow field;
[0008] (4) It is extremely difficult to manually mark the pixel-level aurora optical flow field, and it is difficult to provide a large amount of training data required by the supervised deep optical flow model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Aurora motion characterization method based on unsupervised deep optical flow network
  • Aurora motion characterization method based on unsupervised deep optical flow network
  • Aurora motion characterization method based on unsupervised deep optical flow network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0048] Below in conjunction with accompanying drawing, implementation steps and technical effects of the present invention are described in further detail:

[0049] A method for characterization of aurora motion based on an unsupervised deep optical flow network, comprising the following steps:

[0050] Step 1: Extract each frame of the original aurora image in the aurora observation video, preprocess each frame of the original aurora image, sort the preprocessed aurora images by time, and obtain a continuous all-sky aurora image sequence;

[0051] Step 2: The optical flow network is trained using a continuous sequence of all-sky aurora images.

[0052] 2.1) Input two consecutive frames of all-sky aurora image I 1 and I 2 , using the same feature pyramid extraction network to extract the feature maps of the two images respectively. The first-level feature map of the feature pyramid extraction network is the input image, and the number of channels is 3; the number of channel...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an aurora motion characterization method for an unsupervised deep optical flow network, and the method comprises the implementation steps: 1, taking two adjacent preprocessed all-sky aurora images as input, and calculating a bidirectional optical flow through an optical flow network; 2, calculating a bidirectional warping image by using the all-sky aurora image and the bidirectional light flow; 3, reasoning a bidirectional deformation graph by using the bidirectional optical flow; 4, constructing a loss function by using the all-sky aurora image, the warping image and the bidirectional deformation image so as to optimize and train the optical flow network; and 5, after the training is completed, extracting a pixel-level aurora optical flow field of the aurora observation video by using the optical flow network as an aurora motion representation. The method solves the problem that the aurora data does not meet the brightness consistency assumption of the optical flow and lacks training data, has the advantages of high precision and strong robustness, and can be used for performing aurora event identification and detection from a complex aurora observation video.

Description

technical field [0001] The invention belongs to the technical field of video analysis, and further relates to a characterization method of aurora movement, which can be used to identify and detect aurora events from complex aurora observation videos. Background technique [0002] The aurora is a colorful and gorgeous geophysical phenomenon that occurs at the high altitudes of the north and south poles of the earth. It is a luminous phenomenon that is excited by the high-energy charged particles carried by the solar wind moving to the sky above the earth's north and south poles along with the magnetic field lines, and colliding with particles in the upper atmosphere. The best window to study solar storms. At present, there are many ways to observe the aurora, such as optical imaging observation, radar observation and magnetometer observation. Among them, the optical observation represented by the all-sky imager has a high temporal and spatial resolution, and the aurora obser...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/269G06N3/08G06K9/00
CPCG06T7/269G06N3/084G06N3/088G06T2207/10016G06T2207/20016G06T2207/20081G06T2207/20084G06V20/44G06V20/42
Inventor 杨秋菊向晗韩鹏
Owner SHAANXI NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products