Rapid and automatic mosaic technology of aerial video in search and tracking system

An automatic stitching, AVIC technology, applied in image enhancement, image analysis, instruments, etc., can solve the problems of reduced image stitching accuracy, interruption of image stitching process, etc., to improve accuracy and robustness, improve accuracy, and solve procedures. effect of interruption

Inactive Publication Date: 2014-04-23
NANJING UNIV OF SCI & TECH
View PDF5 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has a good stitching effect for image sequences with a small number of frames, but as the number of frames in the video sequence increases, the geometric transformation matrix of image stitching will accumulate and magnify errors due to

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rapid and automatic mosaic technology of aerial video in search and tracking system
  • Rapid and automatic mosaic technology of aerial video in search and tracking system
  • Rapid and automatic mosaic technology of aerial video in search and tracking system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0084] In this embodiment, a 24-bit true-color image collected by a basler camera is used, and the image size is 640*480. In order to make the acquired true-color image sequences have enough overlapping information, the acquisition frame rate is set to 10 frames / s.

[0085] The background of the video sequence in this embodiment is mostly vegetation and roads and the outline line is very strong. According to the characteristics of the video, the threshold of image trivaluation is set to [0.40.65], and the threshold of the edge detection of the sobel operator is [0.20.3] , based on which the Harris corner detection is performed. In order to reduce the calculation amount of the algorithm under the premise of ensuring the accuracy of the algorithm, the window of Harris corner detection is selected as 5*5, the number of layers of the image pyramid is selected as 3, and the window size of KLT optical flow calculation is set to 7*7. The number of frame intervals of the correction m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention brings forward a rapid and automatic mosaic technology of aerial video in a search and tracking system. The technology provided by the invention comprises the following steps: two continuous frames of color images in an aerial video sequence are converted to grayscale images; three-valued processing is carried out on the grayscale images by an image three-valued method, edge feature information images are extracted by an edge detection sobel operator and feature points are extracted by an Harris algorithm; feature point matching is completed by an optical flow pyramid algorithm; optimal homography matrix of the color images is calculated by combining a DLT algorithm and a RANSAC algorithm; panoramic image mosaics is completed after image correction of the color images by correction geometric transition matrix; and dynamic regulation of image three-valued upper and lower thresholds and a threshold of the edge detection sobel operator is carried out during the process of panoramic image mosaics. According to the invention, image mosaic accuracy and robustness are raised.

Description

technical field [0001] The invention belongs to the technical field of automatic image splicing, and in particular relates to a fast automatic splicing technology of aerial video in a search and track system. Background technique [0002] The most critical step in image stitching is to find and match image feature points. Yang Tao et al. (Real-time Registration Algorithm for Aerial Video Based on Scene Complexity and Invariant Features. Acta Electronics, 2010.5, Volume 5, Volume 38) proposed a method of image matching using the combination of Harris corners and SIFT descriptors, ensuring The algorithm has good rotation, scale, brightness invariance and registration accuracy. However, due to the large number of feature points extracted in the early stage, the amount of calculation in the later stage is too large, and the real-time performance of image stitching cannot be truly realized. To solve this problem, it is necessary to optimize the algorithm by simplifying the extr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/50G06T3/40G06T7/00
Inventor 顾国华韩鲁刘恒建刘琳廖逸琪钱惟贤任侃
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products