Unlock instant, AI-driven research and patent intelligence for your innovation.

Video key frame extraction method based on parallax tracking

A technology of video key frame and extraction method, which is applied in the direction of instruments, character and pattern recognition, computer components, etc., and can solve the problems of poor automatic extraction accuracy, time-consuming and labor-intensive video key frames, etc.

Pending Publication Date: 2020-12-29
CHINA UNIV OF MINING & TECH (BEIJING)
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The technical problem to be solved by the present invention is to design a video key frame extraction method based on parallax tracking for the manual extraction of video key frames in narrow and long underground spaces such as pipelines and roadways is too time-consuming and laborious, and the accuracy of automatic extraction is poor.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video key frame extraction method based on parallax tracking
  • Video key frame extraction method based on parallax tracking
  • Video key frame extraction method based on parallax tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] 1. Rough key frame extraction based on image blur evaluation

[0028] In the rough key frame extraction stage, use the Tenengrad evaluation function to evaluate the blurriness of video frames, obtain the interception frequency of the initial frame set, and remove severely blurred images. The specific implementation methods are as follows:

[0029] Step 1: The ambiguity evaluation method adopted in the present invention is a gradient-based Tenengrad evaluation function. First, the function uses the Sobel operator to extract the gradient values ​​in the vertical and horizontal directions, and calculates the gradient S(x,y) of the image at the point (x,y), as shown in formula (1).

[0030]

[0031] Among them, G x , G y Represents the horizontal and vertical convolution kernels of the Sobel operator, I (x,y) Represents a 3*3 pixel gray value matrix centered on point (x, y). Calculate the average gray value of the image after convolution processing, denoted as T en ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a video key frame extraction method based on parallax analysis, which focuses on monocular video three-dimensional reconstruction requirements of underground long and narrow closed spaces such as pipelines, roadways and the like, and designs a video key frame extraction method based on parallax tracking aiming at the problems of low efficiency and poor automatic extractionprecision of traditional manual video frame extraction. According to the method, a coarse-to-fine key frame extraction strategy is adopted. In the coarse extraction stage, based on a Tengram evaluation function, ambiguity evaluation is carried out on video frames, seriously blurred images are eliminated, self-adaptive frame taking parameters are introduced, extraction of blurred redundant video frame images is avoided, and the reasonability of coarse extraction is improved; in the fine extraction stage, a feature matching algorithm of a grid motion statistical strategy is adopted, real-time high-precision matching of a large number of feature points is achieved, camera motion information is obtained through parallax analysis to classify video frames, redundant frames such as static framesand rotating frames are removed, and the video frames are extracted. Finally, a key frame image set which is reasonable in spatial position and suitable for the three-dimensional reconstruction requirement of inner walls of pipelines is acquired.

Description

technical field [0001] The invention relates to the technical field of spatial information applications, in particular to a video key frame extraction method based on parallax tracking. Background technique [0002] Urban underground pipeline is an important infrastructure for urban water supply and sewage discharge, which is related to the sustainable development of the city and people's daily life. The 3D reconstruction of narrow and long confined spaces such as pipelines and roadways based on Structure from Motion (SfM) can simultaneously obtain 3D geometric structure and color texture information, which can timely and accurately grasp the quality of important underground infrastructure and comprehensively clarify its operating status Provide accurate digital models. Video key frame optimization is the primary key technology to determine the accuracy and integrity of video 3D reconstruction models. It is a complex decision-making process that takes into account multiple ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00
CPCG06V20/41G06V20/46Y02T10/40
Inventor 许志华逯行政徐二帅杨峰
Owner CHINA UNIV OF MINING & TECH (BEIJING)
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More