Unlock instant, AI-driven research and patent intelligence for your innovation.

Metadata service system and working method for randomly reading distributed video frames

A metadata service and distributed video technology, applied in the direction of video data indexing, video data retrieval, etc., can solve the problems of time overhead, data transmission overhead, and the inability to directly use traditional methods to randomly read video frames. Improve the efficiency of reading and writing, ensure the effect of load balancing and scalability

Active Publication Date: 2022-03-29
SOUTH CHINA UNIV OF TECH
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The distributed storage system solves the storage problem of large video data, but also makes it impossible to directly use the traditional method to achieve random reading of video frames, because it needs to traverse the video data frequently, which will bring a lot of problems to the processing of each node. time overhead, and at the same time bring data transmission overhead between nodes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata service system and working method for randomly reading distributed video frames

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0048] as attached figure 1 As shown, the metadata service system for randomly reading distributed video frames disclosed in this embodiment includes: a task distribution module, a task processing module, an address mapping module, a metadata IO and preprocessing module, a metadata storage module, and a metadata reprocessing module. A distribution module, wherein the task processing module includes a metadata application module and a metadata generation module. The entire system interacts with the distributed storage system (HDFS in this system) and the client externally. The metadata storage module includes at least three storage units, and the storage units in the metadata redistribution module and the metadata storage module are connected to the zookeeper component, and the zookeeper component monitors the working conditions of the storage unit through heartbeat , if a storage unit is removed or added, the zookeeper component will be triggered and the metadata redistributi...

Embodiment 2

[0058] Based on the metadata service system for random reading of distributed video frames disclosed in the above embodiments, this embodiment discloses a working method of a metadata service system for random reading of distributed video frames, including random reading of frames and video Upload request, the following is a detailed introduction to the random reading of frames and the processing flow of video upload requests:

[0059] Wherein, the random reading of the frame includes the following steps:

[0060] S1. After receiving the request, the system buffers, schedules, and distributes it to the task processing module;

[0061] S2, the task processing module starts the metadata application module and imports the video address and the frame number or time of the frame to be read;

[0062] S3. The metadata application module receives a request to start the frame positioning unit;

[0063] S4. The frame alignment unit sends a metadata read request to the metadata IO and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a metadata service system and working method for randomly reading distributed video frames. The system is composed of six modules: task distribution module, task processing module, address mapping module, metadata IO and preprocessing module, A metadata storage module and a metadata redistribution module, wherein the task processing module includes a metadata application module and a metadata generation module. In order to efficiently realize the random positioning of video frames in a distributed video storage environment and avoid the time overhead of a single node and the network overhead between nodes, the system proposes a random frame reading strategy based on the I-frame dictionary.

Description

technical field [0001] The invention relates to the technical field of distributed video big data processing, in particular to a metadata service system and working method for random reading of distributed video frames. Background technique [0002] With the advent of the video "big data" era, how to store, mine, and utilize the potential information value of videos has become a demand. Most video data mining involves indexing and positioning of video content, specifically, random reading of video frames. Pick. The distributed storage system solves the storage problem of large video data, but also makes it impossible to directly use the traditional method to achieve random reading of video frames, because it needs to traverse the video data frequently, which will bring a lot of problems to the processing of each node. time overhead, and at the same time bring data transmission overhead between nodes. [0003] According to the current mainstream decoding standards based on ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/71
Inventor 徐杨邵贤鹏高勒李东
Owner SOUTH CHINA UNIV OF TECH