Method for deleting video big data redundancy based on information divergence

A technology of information divergence and deletion method, which is applied in the field of redundancy deletion

Active Publication Date: 2017-08-11
NAT UNIV OF DEFENSE TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Whether it is source and target redundant data deletion, offline, near-line and online deletion, file-level and block-level deletion, or primary storage and secondary storage deletion, the object of redundant data deletion is almost all deduplication. Repeated and associated redundant data means that a data object can be represented by other data objects, and the above-mentioned various data deletion technologies are helpless

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for deleting video big data redundancy based on information divergence
  • Method for deleting video big data redundancy based on information divergence
  • Method for deleting video big data redundancy based on information divergence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] figure 1 It is an overall flow chart of the present invention, and its specific implementation steps are as follows:

[0067] The first step is to normalize the video big data. The specific method is as follows:

[0068] 1.1 The video big data is represented by the video big data set V,

[0069] V ∈ R L×N , video big data is presented in digital form, R means real number, R L×N Represents a real number matrix with a scale of L×N, each video is composed of multiple video image frames, N is the number of videos in V, L is the maximum number of video image frames in N videos in V, Both L and N are positive integers, V i Represents the vector set composed of the i-th video image frame of N videos in V, referred to as video image frame vector, 1≤i≤L, V i =[v i1 ,v i2 ,...v ij ,...v iN ],v ij means V i In the i-th video image frame of the j-th video, v ij is a real number, 1≤j≤N;

[0070] 1.2 Put V in V 1 ,V 2 ,...,V i ,...V L Perform normalization to obta...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for deleting video big data redundancy based on information divergence, and is aimed at providing a redundant video data deleting method, saving storage capacity, reducing the analysis time of video big data, improving the efficiency of maintenance and management of video big data. According to the technical scheme, first video big data are expressed with a video big data set V; the V is normalized; then the K-L divergence for a video image frame vector and an information quantity distribution matrix M_L are defined; the contribution of each video image frame vector to the information quantity of the V is confirmed; a redundant video image frame making the smallest contribution to the information quantity is deleted from the V. The method can alleviate the storage pressure of video data, improve the storage efficiency of video data, speed up the calculation and analysis rate of video big data, and improve the operational efficiency of the whole big data video application system.

Description

technical field [0001] The invention relates to a redundancy deletion method, in particular to a redundancy deletion method of video big data in the information field. Background technique [0002] With the continuous advancement of social informatization, the application field of information storage has become more and more extensive. In the past five years, the amount of global digital information has grown rapidly, from the previous TB level to PB level, or even EB level. With the advent of the era of big data, data growth will be the biggest challenge for large-scale enterprises to deploy IT facilities. Operating costs will also increase significantly. [0003] Studies have shown that up to 80% to 90% of the data stored in application systems such as backup and archive storage are redundant, and the proportion of redundant data will continue to rise over time. Therefore, the problem of high data redundancy in storage systems has attracted more and more researchers' att...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N5/76H04N5/91
CPCH04N5/76H04N5/91
Inventor 甘新标刘杰杨灿群徐涵胡庆丰龚春叶李胜国邹丹晏益慧黄嘉昆熊成伟
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap