Optical flow-based gigapixel video alignment method and device, and medium

A one-gigapixel, video pairing technology, applied in image enhancement, image analysis, image data processing, etc., can solve problems such as rough image deformation alignment process and discontinuous seams

Pending Publication Date: 2020-11-13
西安拙河安见信息科技有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the alignment operation in gigapixel video is mostly based on grid-like image deformation. However, due to insufficient feature point extraction, the image deformation alignment process is relatively rough, resulting in discontinuity at seams in the process of stitching gigapixel videos. and other defects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Optical flow-based gigapixel video alignment method and device, and medium
  • Optical flow-based gigapixel video alignment method and device, and medium
  • Optical flow-based gigapixel video alignment method and device, and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to make the purpose, technical solutions and advantages of the embodiments of this paper clearer, the technical solutions in the embodiments of this paper will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of this paper. Obviously, the described embodiments are the Some, but not all, embodiments. Based on the embodiments herein, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts fall within the scope of protection herein. It should be noted that, in the case of no conflict, the embodiments herein and the features in the embodiments can be combined arbitrarily with each other.

[0046] The gigapixel video alignment scheme in the related art is to divide a local image into multiple grids, and perform homography matrix estimation and image deformation operations on each grid, which leads to the limitation of deformation. When faced with complex scenes,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an optical flow-based gigapixel video alignment method and device and a medium, and relates to a billion pixel video technology. The gigapixel video alignment method based onoptical flow comprises the following steps: determining a global image block corresponding to a local image in to-be-processed video data; inputting the local image and the corresponding global imageblock into a deep learning network to obtain a super-resolution region image, the deep learning network being used for performing optical flow estimation, optical flow super-resolution and image deformation processing on the input image; superposing the obtained super-resolution region image on the corresponding image region of the corresponding global image to obtain a super-resolution global image; and generating a gigapixel video according to the super-resolution global image. According to the invention, the deformed optical flow is guided pixel by pixel and a deep learning network based onbig data is utilized to realize fine difference resolution and alignment between images of different viewpoints, and the alignment quality of a billion-pixel video is improved.

Description

technical field [0001] This article relates to gigapixel video technology, in particular to a gigapixel video alignment method, device, and medium based on optical flow. Background technique [0002] Gigapixel video is an important problem in the field of computer vision. With the introduction of 5G communication, the medium of information dissemination is developing rapidly towards larger capacity and higher speed. The birth has a non-negligible positive impact on the live broadcast of large-scale events and the security control of large-scale scenes. The gigapixel video system uses video acquisition devices with different focal lengths to collect the global image of the large scene and the high-definition image of the region of interest, and then uses an algorithm to fuse it so that people can watch the super-high-resolution region of interest in real time. Applications such as sports events, large-scale cultural programs, and security pursuits provide better support. A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/33G06T3/40
CPCG06T3/4053G06T2207/10016G06T2207/20081G06T2207/20084G06T7/337
Inventor 郝梁袁潮温建伟刘烨斌周玥眉赵月峰
Owner 西安拙河安见信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products