System and method for controlling streaming data storage

Abstract

The invention discloses a system and a method for controlling streaming data storage. The system comprises a redundant array of independent disks (RAID) control module, a logical volume management module, a streaming data storage interface module, a time index and space management module and a host interface drive module, wherein the RAID control module is used for mapping the memory space of a disk into a plurality of RAID spaces; the logical volume management module is used for dividing the RAID spaces into a plurality of logical volumes and providing a memory interface; the streaming data storage interface module is used for analyzing streaming data and control command thereof, calling a memory address and calling the memory interface for storing the streaming data; the time index and space management module is used for maintaining a time index for each path of streaming data and periodically writing the time index back into the disk according to the memory interface; the host interface drive module is used for acquiring the streaming data and sending the streaming data and the control command thereof; and furthermore, the streaming data storage interface module takes the time as an index to continuously store the streaming data in a physical volume or a logical volume ofwith a continuous physical address space. The system is used for overcoming the problem that a conventional file system has low streaming data storage efficiency.

Description

technical field [0001] The invention belongs to the technical field of computer information storage, and in particular relates to a flow data storage control system and a method thereof. Background technique [0002] Streaming data is a set of sequential, massive, fast, and continuous arrival data sequences, which are widely used in network monitoring, sensor networks, aerospace, weather monitoring, and financial services. Through the study of convective data, satellite cloud image detection and stock market trends can be carried out. Analysis, network attack judgment, etc. Compared with traditional data services, streaming data has the characteristics of real-time arrival of data, independent arrival order, not controlled by application system, large data scale and unpredictable maximum value, thus affecting the storage system capacity, performance, stability, etc. There are special and strict requirements. [0003] However, existing storage systems generally store and ma...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a stream data storage control system and its method, the purpose is to overcome the problem of low efficiency of traditional file system storage stream data, change the traditional file system-based stream data storage method, and construct a stream data dedicated The storage structure ensures fast and efficient read, write, query, and delete operations of high-bandwidth streaming data

Images