Mass data-based distributed video processing system
A distributed video and mass data technology, applied in the field of video analysis, can solve the problems of insufficient storage capacity and processing capacity of centralized video processing, and non-scalability, so as to overcome the lack of storage and analysis capabilities and non-scalability, and improve efficiency. Effect
Inactive Publication Date: 2016-01-13
MERIT DATA CO LTD
View PDF4 Cites 12 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0008] The purpose of the present invention is to provide a distributed video processing system based on massive data, which solves the problems of insufficient storage capacity and processing capacity and unexpandable problems of traditional centralized video processing. Expansion to realize distributed processing and analysis of massive video
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0028] In order to make the technical means, creative features, goals and effects achieved by the present invention easy to understand, the present invention will be further described below in conjunction with specific illustrations.
[0029] The overall process of distributed video analysis and processing is as follows: figure 1 As shown, it mainly includes: video reading part (including video segmentation and reading, key-value pair design), video analysis algorithm packaging, result integration and storage, as follows:
[0030] When starting to execute the video analysis task, it is necessary to obtain the video file under the corresponding path from HDFS, and divide, read, and encapsulate the video file (in the form of key-value pairs) according to the settings.
[0031] The overall process of this part is as follows figure 2 shown. First, you need to design the encapsulation form of the video segment, that is, Value in the key-value pair. Value refers to the encapsulat...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a mass data-based distributed video processing system, which comprises the following steps: (1) reading, partitioning and packaging of a video, firstly, obtaining a video file in a corresponding path from an HDFS distributed file system, carrying out reading and partitioning on the video file, and packaging the partitioned video segment data into an object for carrying out a transmission on a video envelop; (2) video analysis algorithm packaging, namely adopting a video analysis algorithm for finishing analysis processing on the video segment data, and carrying out an interaction on the video analysis algorithm and a Hadoop platform through a JNI interface; and (3) result integration and storage, calling packaged video analysis algorithm on each node to finish video analysis processing by the Hadoop platform, and integrating the video segment data into an intact video. According to the mass data-based distributed video processing system, the problems that traditional concentrated video processing is inadequate in storage capacity and processing capacity cannot be expanded are solved; and distributed processing and analysis of massive videos are achieved through expansion of a data structure and related interfaces of a MapReduce computing framework in the Hadoop platform.
Description
technical field [0001] The invention belongs to the technical field of video analysis, and relates to a system for realizing distributed processing of massive data by using big data processing technology. Background technique [0002] With the rapid growth of video data volume, a series of practical problems have been brought to video surveillance: tight network bandwidth, huge storage space, exponential growth in performance requirements, high investment and maintenance costs, pressure on system expansion and upgrade, etc. The traditional centralized video processing has the shortcomings of insufficient storage capacity and data processing capacity, and the storage capacity and processing capacity cannot be expanded. [0003] Distributed computing is a new computing method proposed in recent years. As an emerging scientific field, it mainly studies how to divide a large problem that requires a lot of computing power to be solved into several small problems, and then divide ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F17/30
CPCG06F16/182G06F16/438
Inventor程宏亮卢耀宗罗艺闯强劲张小平
OwnerMERIT DATA CO LTD