Performance improvement method for multi-channel storage streaming media data

Abstract

The invention provides a performance improvement method for multi-channel storage streaming media data. The method comprises the following steps: when a storage device is initialized, clearing original fragments of the storage device, and calculating the size and quantity of each video file according to the storage capacity and set recording time and code rate; creating a corresponding number of streaming media files for each channel, and allocating the storage space according to the size of each video file; directly selecting one oldest streaming media file for renaming for cyclic coverage when the storage space is full; and when writing data, firstly copying the data to a buffer pool of application management, creating a background thread which is responsible for directly writing the data back to the storage device in a direct-io mode by directly bypassing the cache of an operating system at the right time, and then improving the performance by supplementing 0 and modifying the filesize.

Description

technical field [0001] The invention relates to the field of multi-channel streaming media storage, in particular to a method for improving the performance of multi-channel storage streaming media data. Background technique [0002] The existing multi-channel streaming media storage is stored to the storage medium through the file interface provided by the operating system. Each file usually only stores streaming media data for a fixed time (adjustable), and the oldest file will be deleted when the space is full. files to free up storage space, this approach has the following disadvantages: [0003] 1. Due to multiple concurrent writes, storage space must be allocated for each write, which leads to concurrent allocation of storage space, which in turn leads to file fragmentation, and file fragmentation will reduce performance; [0004] 2. After the storage space is full, old files need to be deleted to free up space, which may cause deletion and writing to occur concurrentl...

AI Technical Summary

Problems solved by technology

[0003] 1. Due to multiple concurrent writes, storage space must be allocated for each write, which leads to concurrent allocation of storage space, which in turn leads to file fragmentation, and file fragmentation will reduce performance;

[0004] 2. After the storage space is full, old files need to be deleted to free up space, which may cause deletion and writing to occur concurrently, resulting in file fragmentation and performance degradation;

[0005] 3. When allocating and releasing disk space concurrently, in order to ensure data consistency, mutual exclusion is required, and the uncontrollable mutual exclusion (it is impossible to determine which way the mutual exclusion is executed first) leads to uncontrollable performance;

[0006] 4. When the performance drops, the cache usage of the file system will increase, which means that the cost will increase under the embedded platform;

[0007] 5. Streaming media data will pass through the file cache of the operating system, because the operating system will only write back to the memory when certain conditions are met, and this write-back mechanism may not be able to meet the requirements of multi-channel concurrent streaming media;

[0008] 6. When the operating system writes back the cache, there are two types of data: file system metadata (mainly the index or bitmap generated when allocating storage space, such as the fat table in the fat file system and the bitmap in the ntfs file system) And streaming media data, these two types of data are usually far away from each other. In the case of cross writing of these two kinds of data, many storage devices cannot achieve the best performance (hard disk needs to seek overhead; flash storage has mapping and garbage collection overhead

[0009] As disclosed on 2014-04-02, the Chinese invention with the publication number CN103702057A discloses a block storage algorithm suitable for multi-channel concurrent writing of streaming media data. This method bypasses the file system, so the final streaming media file It can only be accessed through its specially developed software, which is inconvenient to view, play and distribute, and has poor compatibility; in addition, this method must divide a fixed-size area on the storage device, and this area can only be used for video recording and cannot be used. for other purposes

[0010] The Chinese invention disclosed on 2014-11-19 with the publication number CN104159058A discloses an efficient method for simultaneous video recording of multiple media streams, which also results in poor compatibility due to bypassing the file system

[0011] As disclosed on 2010-06-16, the Chinese invention whose publication number is CN101742263A_ discloses a method for storing video surveillance video data. The data format of the file is special, and only special software can be accessed. Three-party application; in addition, the recording time of each file in this method is fixed and cannot be switched; the last one does not consider the situation of multi-channel concurrency and cache controllable write-back

Images