Sequence image splicing method and system of low-altitude unmanned vehicle

A technology of unmanned aerial vehicles and sequence images, which is applied in image communication, TV system components, TV, etc., and can solve the problems of sequence image error accumulation and so on

Active Publication Date: 2011-06-08
CAPITAL NORMAL UNIVERSITY
View PDF4 Cites 71 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The object of the present invention is to provide a method and system dedicated to splicing sequence images of unmanned aerial vehicles, which can seamlessly splice images from a large area of ​​unmanned

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sequence image splicing method and system of low-altitude unmanned vehicle
  • Sequence image splicing method and system of low-altitude unmanned vehicle
  • Sequence image splicing method and system of low-altitude unmanned vehicle

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0042] Example one

[0043] In this embodiment, SURF feature points and HARRIS-AFFINE feature points, as well as the RANSAC fault-tolerant algorithm and epipolar geometric constraints are used to solve the homography matrix to improve the quality of splicing.

[0044] figure 1 Shown is a flowchart of a method for splicing a sequence image of a low-altitude unmanned aerial vehicle according to the first embodiment of the present invention, including:

[0045] Step 11: Correction of camera distortion.

[0046] Step 12, the unmanned aerial vehicle sequence image acquisition.

[0047] Step 13, image correction, determining the homography matrix between adjacent images, including the following sub-steps:

[0048] Step 131, feature extraction, extract SURF feature points and HARRIS-AFFINE feature points from the sequence image;

[0049] Step 132, image matching, includes the following sub-steps:

[0050] Step 1321: Use Mahalanobis distance to calculate the similarity of feature points between ad...

Example Embodiment

[0136] Example two

[0137] The difference from the first embodiment is that the second embodiment adds a matching verification step. Although the first embodiment calculates the homography matrix and matches the image, whether the matching result is correct requires further verification. Especially for the image sequence acquired by the aircraft, bad images such as complete yaw are mixed inside, which need to be automatically removed during stitching.

[0138] figure 2 Shown is a flowchart of a method for splicing serial images of a low-altitude unmanned aerial vehicle according to the second embodiment of the present invention, including:

[0139] Step 21: Correction of camera distortion.

[0140] Step 22: Acquire serial images of the unmanned aerial vehicle.

[0141] Step 23, select an image in the sequence of images.

[0142] Step 24, image correction, determining the homography matrix between adjacent images, includes the following sub-steps:

[0143] Step 241, feature extraction, ...

Example Embodiment

[0166] Example three

[0167] The difference from the second embodiment is that the third embodiment further adds the steps of global optimization and adjustment of the homography matrix.

[0168] image 3 Shown is a flowchart of a method for splicing a sequence image of a low-altitude unmanned aerial vehicle according to the third embodiment of the present invention, including:

[0169] Step 31: Correction of camera distortion.

[0170] Step 32, the unmanned aerial vehicle sequence image acquisition.

[0171] Step 33: Select an image in the sequence of images.

[0172] Step 34, image correction, determining the homography matrix between adjacent images, includes the following sub-steps:

[0173] Step 341, feature extraction, extract SURF features and HARRIS-AFFINE features from the sequence image;

[0174] Step 342, image matching, includes the following sub-steps:

[0175] Step 3421: Use Mahalanobis distance to calculate the similarity of feature points between adjacent images for initial...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a sequence image splicing method of a low-altitude unmanned vehicle, comprising the following steps: acquiring sequence images, and correcting camera distortion; extracting characteristic points, and matching the images; generating an image splicing sequence; carrying out global optimization splicing, and splicing the images in accordance with splicing strategies; and carrying out global error compensation. A sequence image splicing system of a low-altitude unmanned vehicle comprises a characteristic point extraction module, an image matching module, a splicing sequencegeneration module and an image splicing module, wherein the characteristic point extraction module is used for extracting SURF characteristic points and HARRIS-AFFINE characteristic points of the sequence images; the image matching module is used for calculating a homography matrix between adjacent images in accordance with the characteristic points, and eliminating deteriorated images which are off-course completely; the splicing sequence generation module is used for determining the splicing sequence of the sequence images; and the image splicing module is used for carrying out splicing andglobal error compensation in accordance with the splicing sequence.

Description

technical field [0001] The invention belongs to the technical field of computer vision image processing, and in particular relates to a method and system for automatic splicing of aerial sequence images based on an unmanned aerial vehicle. Background technique [0002] Digital aerial photography based on unmanned aerial vehicles has been widely used in remote sensing, surveying and mapping, computer vision and pattern recognition and other fields. Automatic stitching of aerial image sequences is the process of automatically stitching aerial images with a certain overlapping area into a ground panorama image with a larger field of view. The content has a more comprehensive and intuitive understanding. [0003] Unmanned aerial vehicles, also known as unmanned aerial vehicles, mainly include unmanned airships, unmanned helicopters and unmanned fixed-wing aircraft. Since it is difficult for unmanned aerial vehicles to carry large loads, they are generally only equipped with lo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N5/262
Inventor 张爱武宫辉力胡少兴王书民崔营营乔警卫
Owner CAPITAL NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap