Historical data storage method and system

A historical data and data technology, applied in the field of historical data storage methods and systems, can solve the problems of large storage resource consumption and high storage costs, and achieve the effects of reducing storage consumption, data volume, and storage costs

Active Publication Date: 2014-10-15
AGRICULTURAL BANK OF CHINA
View PDF8 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the object of the present invention is to provide a historical data storage method and syste

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Historical data storage method and system
  • Historical data storage method and system
  • Historical data storage method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Embodiment 1 of the present invention discloses a historical data storage method, which is suitable for long-term storage of massive historical data, please refer to figure 1 , the above method includes the following steps:

[0043] S1: Screen the structured historical data generated by the information system according to a pre-established screening strategy to obtain the structured historical data to be archived, and the structured historical data to be archived includes at least one type of data table.

[0044] For large enterprises, such as large financial enterprises such as banks, the data volume of structured historical data and the daily data increment are very large (occupancy exceeds TB), and there are often some unimportant and low-value data in these data. Archiving and saving all the data will cause unnecessary waste of resources. In view of this situation, this embodiment formulates a screening strategy in advance to filter the data with low value and initi...

Embodiment 2

[0060] The second embodiment describes the storage device used for storing text data.

[0061] Specifically, the present invention uses a disk storage device to store the extracted text data. Different from existing storage media, the present invention uses disk storage devices to have the following advantages:

[0062] 1) Efficient

[0063] In practical applications, large-scale historical data are generally stored in online databases in a short period of time (such as within three years), and are generally transferred from online databases to tape libraries for storage after a certain period of time. However, the efficiency of saving and accessing historical data in tape libraries is low. The invention adopts the disk storage device, which improves the efficiency of data storage and access.

[0064] 2) safety

[0065] The historical data of large enterprises, especially the financial industry, often contain more sensitive information and have higher security requirements....

Embodiment 3

[0071] This embodiment three continues to supplement the historical data storage method disclosed in the above embodiments, please refer to figure 2 , the method also includes:

[0072] S6: Configure metadata for the text file where the incremental data is located and the text file where the full amount of data is located, and the metadata records attribute information of the text file.

[0073] Among them, the important attribute information of the file is recorded in the metadata, including the city code, table name, date, size, storage period, etc., so as to facilitate subsequent management of the saved data files.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a historical data storage method and system. The method develops a screening strategy in advance by aiming at a phenomenon that historical data contains data with low value so as to filter the data with the low value; structured data is converted into unstructured text data, and a data extraction strategy and two corresponding extraction modes of increment and total-volume extraction are developed in order to avoid storage waste caused by the repeated extraction of data in parts of sheets in each extraction period; for example, a detailed sheet exhibits big data volume, big increment and time fields, data extraction can be carried out in an increment way, only increment data is stored, and other data is processed in a total-volume way to finally obtain the extraction data in a text format; and the extraction data in the text format is stored to storage equipment. Obviously, the data with the low value is filtered by data screening, meanwhile, only the increment data is stored, the structured data is converted into the unstructured text data, the data volume which needs to be stored is greatly reduced, and storage cost is lowered.

Description

technical field [0001] The invention belongs to the technical field of data storage and management, and in particular relates to a historical data storage method and system. Background technique [0002] With the continuous development of information technology applications, the historical data generated by the information systems of large enterprises, especially the financial industry, is becoming larger and larger, and the amount of historical data is growing faster and faster. [0003] The historical data of large enterprises, especially the financial industry, contains a lot of important and sensitive information, such as customer data in the banking system. Based on the company's own business needs or regulatory needs, historical data cannot be easily deleted. storage of historical data. Traditionally, a structured storage method is generally adopted, and the full backup of structured historical data is stored in a specially built database, data table, or in an additio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F3/0674G06F16/254G06F16/258
Inventor 杨亮王晶
Owner AGRICULTURAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap