Unlock instant, AI-driven research and patent intelligence for your innovation.

Novel library structure data processing method

A data processing and library structure technology, applied in the field of data processing, can solve the problems of low efficiency of data import and export, achieve the effect of improving speed and saving storage space

Inactive Publication Date: 2018-09-28
亳州中药材商品交易中心有限公司
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Patent No. of the prior art: 201610889114.5, which discloses a data integration structure of a relational database, provides a data integration structure of a relational database, and realizes convenient and fast transfer from MySQL database to MySQL database, from Oracle database to The data integration of the MySQL database reduces the workload of importing and exporting data, making data synchronization easier and more controllable; Patent No.: 201410818000.2, which discloses a mixed data storage method in the database, for column storage in complex application scenarios The database provides a method to effectively solve the low materialization efficiency of the select* application model, which improves the query efficiency of the column-storage database for the select* type, expands the scope of application of the column-storage database, and reduces the occupation of the existing row-column hybrid storage method. space, and data compression efficiency is similar to that of column storage
In the existing technology, relational data is still stored and processed through row storage, and it still needs to be collected across multiple systems, and the efficiency of data import and export is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Novel library structure data processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] A new type of database structure data processing method, constructing a "vertical structure database", using the latest vertical storage technology. The vertical structure database will be used as the shared database of the business department. Analysts only need to conceive relevant ideas and select the keywords they need on the "vertical structure database" to summarize relevant data. If you suddenly find that some fields are omitted or some fields are not needed, you only need to re-check the relevant fields. Due to the high efficiency of the vertical storage database, the process of re-selecting fields for processing is very fast, and the required data or list can be re-output in a very short time.

[0063] Step 1. Establish a mapping vertical table of at least one keyword and at least one classification identifier.

[0064] Obtain at least one keyword and at least one category identifier, and establish a mapping vertical table according to the rule that one catego...

Embodiment 2

[0076] A new type of database structure data processing method, constructing a "vertical structure database", using the latest vertical storage technology. The vertical structure database will be used as the shared database of the business department. Analysts only need to conceive relevant ideas and select the keywords they need on the "vertical structure database" to summarize relevant data. If you suddenly find that some fields are omitted or some fields are not needed, you only need to re-check the relevant fields. Due to the high efficiency of the vertical storage database, the process of re-selecting fields for processing is very fast, and the required data or list can be re-output in a very short time. The data processing methods of the vertical structure database include:

[0077] S1: Use the storage format to store the first-level value corresponding to the first-level classification identifier;

[0078] S2: Subdivide the data in each category identifier column into...

Embodiment 3

[0098] A novel database structure data processing method, the hash index method in the vertical structure database also includes a multi-hash mapping index method, including:

[0099] 1) The first layer of hash mapping is done on the vertical structure database, and all written data is assigned to a specific hash bucket after being mapped by the first layer of hash function through the classification identifier;

[0100] 2) Build a B+ tree on the value space of the first-level hash. The original linear search time complexity is O(n), and it is optimized to tree search. The tree search time complexity is O(log n), and the hash map is optimized value search;

[0101] 3) Hash-mapping the first-level hash buckets again through the second-level hash function, that is, re-dividing the first-level hash buckets to reduce the data capacity in the hash buckets;

[0102]4) Pointer connections are established between two adjacent layers of hash buckets. The next layer of hashes is a subd...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a novel library structure data processing method, which comprises a vertical structure database. The method is characterized in that the vertical structure database establishesa mapping vertical table according to a rule that one piece of classification identification corresponds to one keyword. The data processing method for the vertical structure database comprises the following steps that: S1: storing a first-class value corresponding to first-class classification identification in a storage format; and S2: subdividing data in each classification identification column into data packages, and packaging repeated first-class values in the column to be stored as second-class classification identification. The novel library structure data processing method has the beneficial effects that the problem that all data needs to be extracted again when missing data is extracted when an existing computer platform system processes data can be solved, data processing speedand platform system reliability are improved, and storage space is saved through a vertical storage technology.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a novel database structure data processing method. Background technique [0002] With the implementation of the Smart China strategy, big data has a profound impact on various industries. Based on the needs of dealer segmentation and refined marketing of dealers, it has gradually become the main means of reforming the Chinese herbal medicine market. At present, for the data management and marketing needs of the bulk trading platform, the business department usually analyzes various business indicators, screens out the business indicators that need attention, and then submits a specific list of relevant business fields collected by the technical department, and finally the technical department based on According to the plan proposed by the business department, the relevant data is manually analyzed and the results are output. Based on the current data analysis process, it is neces...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 怀化
Owner 亳州中药材商品交易中心有限公司