Method and device for realizing multi-scale optical flow pixel transformation by utilizing dilution convolution

A multi-scale, optical flow technology, applied in the field of image processing, can solve problems affecting prediction accuracy, subsequent use of unfavorable prediction results, pixel blurring, etc., to avoid information loss, good prediction effect, and improve prediction accuracy

Active Publication Date: 2020-02-04
深圳地平线机器人科技有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the process of scaling these images, pixels will inevitably be blurred, which will affec

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for realizing multi-scale optical flow pixel transformation by utilizing dilution convolution
  • Method and device for realizing multi-scale optical flow pixel transformation by utilizing dilution convolution
  • Method and device for realizing multi-scale optical flow pixel transformation by utilizing dilution convolution

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] Hereinafter, exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. It should be understood that the present application is not limited by the exemplary embodiments described here. Note that the figures are not drawn to scale.

[0036] figure 2 A schematic diagram illustrating a training process of an image prediction method according to an exemplary embodiment of the present invention, Figure 4 A schematic diagram showing a prediction process of an image prediction method according to an exemplary embodiment of the present invention. In the image prediction method of the present invention, the idea of ​​optical flow pyramid is adopted. Specifically, in figure 2 In the example of , a layer 1 optical flow estimator 10 a , a layer 2 ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and a device for realizing multi-scale optical flow pixel transformation by utilizing dilution convolution. According to an embodiment, the invention provides a method for realizing multi-scale optical flow pixel transformation by using dilution convolution for a pyramid optical flow estimator. The pyramid optical flow estimator comprises at least two layers of optical flow estimators, and the method comprises: enabling each layer of optical flow estimator to use a known image frame and an upper layer of prediction image frame generated by an upper layer of optical flow estimator as input to estimate a current layer of optical flow field with a current layer of working scale; determining a current layer convolution kernel corresponding to the current layeroptical flow field; diluting the convolution kernel of the current layer to obtain a diluted convolution kernel of the current layer; and performing optical flow pixel transformation processing on the prediction image frame of the previous layer by using the dilution convolution kernel of the current layer so as to obtain the prediction image frame of the current layer, wherein the prediction image frame of the previous layer used as the input of the optical flow estimator of the first layer is zero, and the working scales of the optical flow fields of each layer are different from each other.

Description

technical field [0001] The present invention generally relates to the field of image processing, and more particularly, to a method and device for realizing multi-scale optical flow pixel transformation using dilute convolution for an optical flow field pyramid, and an electronic device. Background technique [0002] Video prediction can be widely used in various fields, for example, it can be used in assisted driving to predict the future driving environment based on the current driving environment, so as to take corresponding driving strategies in advance. A commonly used video prediction method involves the use of optical flow fields, which describe the displacement vectors of corresponding pixels between adjacent image frames in an image sequence, Figure 1A An exemplary posterior optical flow field is shown, Figure 1B An exemplary prior optical flow field is shown. like Figure 1A As shown, when the previous image frame 1 and the next image frame 2 are known, the opti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/207G06T7/262G06T7/277
CPCG06T7/207G06T7/277G06T7/262
Inventor 刘景初
Owner 深圳地平线机器人科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap