Image stitching and deduplication method and device based on video frame extraction

An image stitching and frame image technology, applied in the field of computer vision and machine learning, can solve the problems of object recognition accuracy decline, increase labor costs, high requirements, etc., achieve the effect of reducing repeated detection and missing recognition, and saving labor costs

Inactive Publication Date: 2021-03-05
GUANGZHOU XUANWU WIRELESS TECH CO LTD
View PDF3 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this method can avoid manual deduplication of the recognition results, since the entire scene image obtained by splicing often has a large resolution, the target detection model needs to consume more time when recognizing objects in large-resolution images. Hardware resources and processing time. At the same time, this kind of splicing recognition has high requirements for shooting each image. It is necessary to check the overlapping area and shooting angle of the two before and after each photo when shooting, which increases the labor cost.
In addition, although reducing the recognition of large-resolution images can reduce the consumption of hardware resources, it can easily lead to a decrease in the accuracy of object recognition. Therefore, this method often fails to achieve the best balance between resource consumption, time efficiency and recognition accuracy. its use is limited

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image stitching and deduplication method and device based on video frame extraction
  • Image stitching and deduplication method and device based on video frame extraction
  • Image stitching and deduplication method and device based on video frame extraction

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0056] Such as figure 1 As shown, an image splicing and deduplication method based on video frame extraction in an embodiment of the present invention at least includes the following steps:

[0057] S1. Obtain video data in the target area, and extract frames from the video data to obtain a set of key frame images of the video data;

[0058] It should be noted that the specific method for extracting frames from the video data is as follows:

[0059] S11, mark the first frame as a key frame by default, and use the first frame and the second frame in the video frame as two images to be processed;

[0060] S12. Use a feature extraction method to extract feature points from the two images to be processed. The feature extraction method includes but is not limited to the SIFT (Scale Invariant Feature Transform) method;

[0061] S13. Perform feature matching on the two sets of feature points extracted from the two images to be processed, and use the successfully matched feature poi...

no. 2 example

[0129] Such as figure 2 As shown, an image splicing and deduplication device 200 based on video frame extraction provided by an embodiment of the present invention includes: a frame extraction module 201, a splicing module 202, a target detection module 203, and a coordinate transformation and deduplication module 204, wherein,

[0130] The frame extraction module 201 is configured to obtain video data of the target area, and perform frame extraction on the video data to obtain a set of key frame images of the video data;

[0131] The stitching module 202 is configured to input the set of key frame images into a preset stitching library, and obtain a panoramic image corresponding to the set of key frame images and a homography of each key frame image in the set of key frame images sex transformation matrix;

[0132] The target detection module 203 is configured to input the key frame image set into a preset target detection model, and obtain the target detection result of ea...

no. 3 example

[0135] An embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored, wherein when the computer program is executed by a processor, the image splicing based on video frame extraction as described in any one of the above items is realized with deduplication method.

[0136] It should be noted that the computer program can be divided into one or more modules / units (such as computer programs, computer programs), and the one or more modules / units are stored in the memory and controlled by the The processor executes to complete the present invention. The one or more modules / units may be a series of computer program instruction segments capable of accomplishing specific functions, and the instruction segments are used to describe the execution process of the computer program in the terminal device.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image stitching and deduplication method based on video frame extraction. The method comprises the following steps: acquiring video data of a target area, and extracting frames from the video data to obtain a key frame image set of a group of video data; inputting the key frame image set into a preset stitching library to obtain a panoramic image corresponding to the keyframe set and a homography transformation matrix of each key frame image in the key frame set; inputting the key frame set into a preset target detection model to obtain a target detection result ofeach key frame image in the key frame image set; and performing coordinate transformation and deduplication on the target detection result of each key frame image in the key frame image set, and outputting the panoramic image and the target detection deduplication result of the panoramic image. According to the invention, the manpower consumption for shooting a plurality of scene photos can be avoided by automatically extracting the key frame, and meanwhile, the time and the manpower cost can be saved and the identification efficiency and the identification precision can be improved by identifying the key frame and automatically de-duplicating the identification result.

Description

technical field [0001] The present invention relates to the technical field of computer vision and machine learning, in particular to an image splicing and deduplication method, device and computer-readable storage medium based on video frame extraction. Background technique [0002] In real life, panoramic image stitching and target detection deduplication play a vital role in object recognition and scene understanding in large scenes. It is widely used in robot navigation, intelligent traffic monitoring, industrial inspection, aerospace, etc. In the field, this technology can reduce the consumption of labor costs, which has important practical significance. [0003] At present, there are mainly two types of commonly used scene target detection. The first one is to identify by taking multiple scene photos, and then count the recognition results of all photos, manually deduplicate the repeatedly recognized targets in the photos, and finally get the whole scene. object ident...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06T3/40H04N5/262
CPCG06T3/4038H04N5/2624G06T2200/32G06V20/46G06V10/462G06F18/214
Inventor 丁明李海荣陈永辉
Owner GUANGZHOU XUANWU WIRELESS TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products