Double-camera panoramic video splicing method based on suture line space-time optimization

A panoramic video and dual-camera technology, which is applied in the field of video processing, can solve problems such as large differences in image shapes, different transformation matrices, and damage to image structures, achieving good results, easy splicing, and cost reduction

Active Publication Date: 2018-01-12
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for video splicing, the transformation matrix of each frame is different, and the shape of the deformed image is quite different, which destroys the continuity between video frame

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Double-camera panoramic video splicing method based on suture line space-time optimization
  • Double-camera panoramic video splicing method based on suture line space-time optimization
  • Double-camera panoramic video splicing method based on suture line space-time optimization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] This embodiment describes the specific implementation process of a two-camera panoramic video splicing method based on the spatio-temporal optimization of suture lines in the present invention. figure 1 It is a schematic diagram of a dual-camera panoramic video stitching method based on space-time optimization of suture lines and the implementation flow of this embodiment in the present invention.

[0051] figure 2 It is a schematic diagram of two cameras placed back to back in the vertical direction.

[0052] from figure 1 It can be seen that the specific implementation steps of the present invention and this embodiment are as follows:

[0053] Step A, video frame pre-alignment;

[0054] Specifically in this embodiment, for the input two-way video to be spliced, use the SIFT algorithm to detect the feature points of two corresponding video frames at a certain moment, then match the feature points, and then use RANSAC to filter the feature point pairs; calculate the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a video splicing method based on suture line space-time optimization and belongs to the field of video processing. The method comprises the following steps of detecting feature points through a SIFT algorithm and aligning the feature points, optimizing the feature points with RANSAC, and calculating the tie distance of the feature point pairs in the vertical direction, andpre-aligning a video frame; and based on a graph cutting algorithm, and constraints such as foreground, edge, parallax and the like, calculating the optimal suture line; smoothing the suture line sequence by means of the foreground detection and Gaussian filter; and performing quality evaluation on the suture line sequence; performing linear fusion on images on the two sides of the suture line byutilizing the quality of the suture line to obtain a panoramic video. Compared with methods in the prior art, the method reduces ghost images of the panoramic video, maintains the frame continuity ofthe video, and improves the visual quality of the video.

Description

technical field [0001] The invention relates to a video splicing method, in particular to a two-camera panoramic video splicing method based on the space-time optimization of suture lines, and belongs to the field of video processing. Background technique [0002] Due to the limitation of camera angle of view, traditional videos are shot within a certain range of angle of view. The viewer cannot see the scene outside the perspective. Different from traditional video, panoramic video can break the limitation of viewing angle and provide viewers with a full range of visual experience. Use a panoramic camera composed of multiple cameras to shoot real scenes, and then stitch and fuse multiple videos into one panoramic video. Users can wear a helmet-mounted display to watch panoramic videos, and interact with panoramic videos through head, body, gesture and other motion estimation to watch videos from different perspectives; they can also watch panoramic videos through smart te...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N5/265H04N5/262H04N5/232H04N5/247H04N5/14H04N5/21
Inventor 张磊苏向阳黄华
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products