Data file merging method
A data file and file technology, which is applied in electrical digital data processing, special data processing applications, error detection of redundant data in operations, etc. To achieve the effect of reducing the amount of calculation
Active Publication Date: 2008-05-07
北京和利时系统集成有限公司
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
2. There may be a small number of record omissions in a certain file
3. In rare cases, a file may lack a large section of records
A server is suspended due to hardware failure or other human reasons, resulting in the loss of a large section of records on the server
4. There are many records in it, possibly tens of thousands
This merging method will require a very large amount of calculation and take a long time, which will increase the system load during the merging process and affect the stability of the entire system.
Therefore, for the merging of data files with a large amount of data, most of the records are the same, and sometimes a few data inconsistencies or large sections of data are missing, how to provide a fast and reliable data file merging method has become an urgent problem to be solved. question
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0027] Below take the merging method of the data file of redundant double machine in the rail transit integrated monitoring system as example, the present invention is described in detail, as shown in Figure 1, the present embodiment method comprises the following steps:
[0028] Step 101: setting the first record of the first data file and the second data file as the current record;
[0029] Step 102: Calculate the number of remaining records of the first data file and the second data file, judge whether the smaller number of remaining records is greater than zero, if yes, execute the next step, otherwise perform abnormal processing (can not jump from here under normal circumstances Turn), end;
[0030] Step 103: In the first data file, search for the same record as the current record of the second data file from the current record of the first data file, if found, perform step 104, otherwise, perform step 105;
[0031] Step 104: If the current record of the first data file ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
A method for combining data file includes searching the first identical record of two data files starting from current record, copying current record in relevant file and all records between current record and the first identical record on object file, setting the identical record to be new current record of two data files, realizing large block identical record combination for the rest of data starting from current record by applying internal memory comparison mode, applying said method cyclically to finalize file combination.
Description
technical field [0001] The invention relates to data file processing technology, in particular to a data file merging method. Background technique [0002] At present, many monitoring systems, such as rail transit integrated monitoring systems, generally require dual-machine redundant configuration, and data such as events, alarms, and operation logs need to be stored for a long time. In this way, there are two record files in the two redundant servers. Due to some abnormal factors such as server maintenance or network failure, the records in the two servers may be inconsistent. And when the operator makes a query, he must provide a complete and unique data, so the two files need to be merged. [0003] According to the actual situation, it can be seen that the redundant dual-machine data file has the following characteristics: 1. There are a large number of identical records. Most of the time, the records of the two files are exactly the same. 2. There may be a small num...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30G06F11/14
Inventor 张亚栋赵云飞
Owner 北京和利时系统集成有限公司