CSV file storage method and device and computer device
A file storage and file technology, applied in the field of CSV file storage methods, devices and computer equipment, can solve the problems of slow writing time, unable to store files, unable to meet system storage usage requirements, etc., and achieve the effect of shortening the time
Active Publication Date: 2019-08-30
WUHAN BESTER COMM GRP CO LTD
View PDF7 Cites 2 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, in the prior art, when a CSV file with a large amount of data is stored in the database, the writing time is very slow, and in severe cases, the transaction timeout occurs. When the transaction timeout occurs, the storage transaction will stop and return to the database. Rolling to the state before storage causes the files to fail to be stored, which seriously affects the availability of the system and cannot meet the storage usage requirements of the system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0024] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with this specification. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present specification as recited in the appended claims.
[0025] The terms used in this specification are for the purpose of describing particular embodiments only, and are not intended to limit the specification. As used in this specification and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the t...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a CSV file storage method and device, and the method comprises the steps of reading the to-be-stored data from a CSV file, and storing the to-be-stored data in a temporary datatable; determining a plurality of threshold segmentation points based on the specified time interval, the specified time interval being the shortest time interval of each time of data storage of the database, and the threshold segmentation points being data segmentation positions determined by the specified time interval and the integer line number of the maximum number of character strings storedeach time; dividing the temporary data table into a plurality of sub-temporary data tables by using the threshold dividing points; and storing the to-be-stored data in the sub temporary data tables into a database. Therefore, it is ensured that each storage process is in an efficient and rapid storage state when the system runs in the storage process, the time for storing the data of the CSV fileinto the database is greatly shortened, and the situation that the file data cannot be stored due to the fact that the storage transaction stops and rolls back to the state before storage due to transaction timeout, is avoided.
Description
technical field [0001] This specification relates to the technical field of file storage, and in particular to a CSV file storage method, device and computer equipment. Background technique [0002] In this era of big data, in order to count data information, a large number of data files need to be stored in the database for later management and use. However, in the prior art, when a CSV file with a large amount of data is stored in the database, the writing time is very slow, and in severe cases, the transaction timeout occurs. When the transaction timeout occurs, the storage transaction will stop and return to the database. Rolling to the state before storage, the file cannot be stored, which seriously affects the availability of the system and cannot meet the storage usage requirements of the system. Contents of the invention [0003] In order to overcome the problems existing in related technologies, this specification provides a CSV file storage method, device and co...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/11G06F16/172G06F16/22
CPCG06F16/116G06F16/172G06F16/2282
Inventor 张建伟陈剑华
Owner WUHAN BESTER COMM GRP CO LTD