Real-time video stitching algorithm based on optimal stitching line updating

An optimal suture and real-time video technology, applied in computing, computer components, image data processing, etc., to achieve the effects of ensuring real-time performance, facilitating parallel processing, and reducing processing time

Active Publication Date: 2020-08-18
SOUTHEAST UNIV
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the existing video stitching algorithms are difficult to provide good panoramic image output under the premise of ensuring real-time performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time video stitching algorithm based on optimal stitching line updating
  • Real-time video stitching algorithm based on optimal stitching line updating
  • Real-time video stitching algorithm based on optimal stitching line updating

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0109] Example 1: Real-time mosaic of fisheye lens video stream with binocular fixed 3840×2160

[0110] The fisheye lens has serious lens distortion and cannot be directly used for subsequent image registration and image fusion operations. Therefore, it is necessary to perform distortion correction on each frame of video image first. To prevent moving objects from passing through the seam, a real-time optimal seam update strategy based on background removal is proposed. First, through the background elimination algorithm based on the mixed Gaussian model, the background is eliminated for each frame of the image, and the foreground area is calibrated. Then use the optimal seam search based on dynamic programming according to the corresponding loss function, and finally use the MVC fusion algorithm based on the convolutional pyramid to first obtain the seams generated by the optimal seam fusion. Such as figure 1 The specific implementation steps of the real-time stitching syst...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time video stitching algorithm based on optimal stitching line updating, and belongs to the technical field of digital image processing. According to the real-time videostitching scheme provided by the invention, an image registration technology based on feature points is used, and internal and external parameters of each camera are estimated through matching feature points of different view angle images. When image fusion is carried out between different visual angles, an image fusion algorithm based on an optimal suture line is adopted, and a background elimination algorithm based on KNN and a suture line updating algorithm based on dynamic programming are used for avoiding discontinuity and ghosting caused by the fact that a moving object penetrates through the suture line in order to solve the problems of ghosting and discontinuity possibly generated by the moving object. And finally, splicing seams are eliminated by using an image fusion algorithm based on a convolution pyramid. By adopting the video stitching scheme designed by the invention, a good large-view-field image can be provided under the condition of ensuring the stitching real-time performance.

Description

technical field [0001] The invention belongs to the technical field of digital image processing, and in particular relates to a real-time video mosaic algorithm based on an optimal suture line update. Background technique [0002] As an important part of human information resources, visual information plays an indispensable and important role in the information society. In today's society, digital video cameras, photography and other technologies have entered people's lives and become a must for every family. Multimedia information such as video and images also plays an important role in many fields such as science and technology, military affairs, and medical treatment. Most of the video acquisition is carried out by a single device, and the field of view that can be captured is relatively small, far less than the field of view of the human eye, and it is difficult to meet the needs of large field of view and high-resolution video application scenarios. Therefore, image s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40G06T5/00G06T7/11G06T7/194G06T7/33G06K9/46
CPCG06T3/4038G06T5/006G06T7/11G06T7/194G06T7/33G06T2207/10016G06T2207/20084G06V10/462Y02T10/40
Inventor 俞菲李航刘闯陈康黄永明
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap