International freight rate data storage method and system
A freight and data technology, applied in file systems, electronic digital data processing, digital data information retrieval, etc., can solve the problems of poor space utilization and slow data update speed, save space overhead, reduce service costs, guarantee Effect of Quote Accuracy
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0048] This embodiment provides a storage method for international freight rate data, such as Figure 1-2 shown, including:
[0049]Step 101, merging the newly issued FTP file of ATPTO;
[0050] That is, they are merged into the same batch of tasks. This FTP file contains international freight rate data.
[0051] Step 102, analyzing the merged FTP file;
[0052] Identify the operation type of data in the FTP file, and store the FTP file in a centralized relational database.
[0053] Step 103, generating an NSD file from the analyzed FTP file, and storing the NSD file in a distributed file system;
[0054] The distributed file system may be CEPH (a distributed storage system) or HDFS (a distributed file system).
[0055] NSD file is the file format used by ATPCO to distribute freight rate data, including file header, data area and index area. The NSD file format is defined in Table 1:
[0056] Table 1 NSD file format
[0057]
[0058]
[0059] The file header stor...
Embodiment 2
[0112] This embodiment provides a storage system for international freight rate data, such as figure 2 shown, including:
[0113] A merging module 1, used for merging the newly issued FTP files of ATPTO;
[0114] An analysis module 2, used to analyze the merged FTP file;
[0115] An NSD file generating module 3, for generating an NSD file from the analyzed FTP file, and storing the NSD file in a distributed file system;
[0116] A data distribution module 4, configured to receive a message describing the NSD file, and verify the consistency of the NSD file in the distributed file system with the message, and send the message when the current cluster version is not the latest version The NSD file is distributed to each node of a tariff service cluster;
[0117] An updating module 5 is used for judging whether the local memory data is up-to-date, and updating the NSD file into a memory database when the judging result is no.
[0118] The storage system of this embodiment ca...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More 


