A streaming data storage method, reading method, device and readable storage medium
A streaming data, data frame technology, applied in the field of data processing, can solve the problem of heavy metadata management pressure, occupying a large number of files, unable to write files, etc.
Active Publication Date: 2021-02-19
ZHEJIANG DAHUA TECH CO LTD
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
This kind of file will occupy the number of large files in the underlying storage. After the number of large files reaches the upper limit of the underlying storage, it will not be able to write to the file.
Massive small files also bring heavy metadata management pressure, and even affect the performance of the entire underlying storage system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0066] The solutions of the embodiments of the present application will be described in detail below in conjunction with the accompanying drawings.
[0067] In the following description, for purposes of illustration rather than limitation, specific details, such as specific system architectures, interfaces, and techniques, are set forth in order to provide a thorough understanding of the present application.
[0068] The term "and / or" in this article is just an association relationship describing associated objects, which means that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist simultaneously, and there exists alone B these three situations. In addition, the character " / " in this article generally indicates that the contextual objects are an "or" relationship. In addition, "many" herein means two or more than two. In addition, the term "at least one" herein means any one of a variety or any combination of at least two of th...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present application discloses a streaming data storage method, reading method, device and readable storage medium. The streaming data storage method includes: creating a continuous streaming data file, wherein the continuous streaming data file at least includes several data frame; when the continuous streaming data file is closed and reopened, a hole information frame is created behind the continuous streaming data file, wherein the hole information frame records the file information offset address of the continuous streaming data file; after creating the hole information frame , continue to write data frames to form another continuous streaming data file; combine continuous continuous streaming data files into a streaming data storage file. The above solution can gather a large number of continuous streaming data files into one streaming data storage file, so as to achieve the purpose of reducing the total number of files.
Description
technical field [0001] The present application relates to the technical field of data processing, in particular to a streaming data storage method, reading method, device and readable storage medium. Background technique [0002] Summary of the current video storage methods, usually a video file is produced at intervals, and each video file is continuous in time under normal circumstances. If the recording is interrupted due to network jitter or other reasons, the file will be closed immediately. At this time, the time range of the file may be less than the preset time length. After the recording is resumed, it is stored in another file, then the files before and after the recording interruption are interrupted in time. [0003] In this way, if the network jitter is frequent, the following process will be repeated: create a large file, write data, close the file, and the data of each file is small, but a large number of small files occupying large file handles will be gener...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/13G06F16/172
CPCG06F16/13G06F16/172G06F16/71H04N21/8456H04L65/70H04N21/816H04L65/612H04N21/84
Inventor 罗心江文龙
Owner ZHEJIANG DAHUA TECH CO LTD