Unlock instant, AI-driven research and patent intelligence for your innovation.

Novel database structure data screening and combining method

A technology of data screening and library structure, applied in the field of data processing, can solve the problems of low data import and export efficiency, and achieve the effect of improving speed and saving storage space

Inactive Publication Date: 2018-09-28
亳州中药材商品交易中心有限公司
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Patent No. of the prior art: 201610889114.5, which discloses a data integration structure of a relational database, provides a data integration structure of a relational database, and realizes convenient and fast transfer from MySQL database to MySQL database, from Oracle database to The data integration of the MySQL database reduces the workload of importing and exporting data, making data synchronization easier and more controllable; Patent No.: 201410818000.2, which discloses a mixed data storage method in the database, for column storage in complex application scenarios The database provides a method to effectively solve the low materialization efficiency of the select* application model, which improves the query efficiency of the column-storage database for the select* type, expands the scope of application of the column-storage database, and reduces the occupation of the existing row-column hybrid storage method. space, and data compression efficiency is similar to that of column storage
In the existing technology, relational data is still stored and processed through row storage, and it still needs to be collected across multiple systems, and the efficiency of data import and export is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Novel database structure data screening and combining method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0062] A new type of database structure data screening and merging method to build a "vertical structure database", using the latest vertical storage technology. The vertical structure database will be used as the shared database of the business department. Analysts only need to conceive relevant ideas and select the keywords they need on the "vertical structure database" to summarize relevant data. If you suddenly find that some fields are omitted or some fields are not needed, you only need to re-check the relevant fields. Due to the high efficiency of the vertical storage database, the process of re-selecting fields for processing is very fast, and the required data or list can be re-output in a very short time.

[0063] Step 1. Establish a mapping vertical table of at least one keyword and at least one classification identifier.

[0064] Obtain at least one keyword and at least one category identifier, and establish a mapping vertical table according to the rule that one ...

Embodiment 2

[0076] A new type of database structure data screening and merging method to build a "vertical structure database", using the latest vertical storage technology. The vertical structure database will be used as the shared database of the business department. Analysts only need to conceive relevant ideas and select the keywords they need on the "vertical structure database" to summarize relevant data. If you suddenly find that some fields are omitted or some fields are not needed, you only need to re-check the relevant fields. Due to the high efficiency of the vertical storage database, the process of re-selecting fields for processing is very fast, and the required data or list can be re-output in a very short time. The data screening and merging methods of the vertical structure database include:

[0077] S1: Use the storage format to store the first-level value corresponding to the first-level classification identifier;

[0078] S2: Subdivide the data in each category ident...

Embodiment 3

[0098] A novel method for filtering and merging library structure data, the hash index method in the vertical structure database also includes a multi-hash mapping index method, including:

[0099] 1) The first layer of hash mapping is done on the vertical structure database, and all written data is assigned to a specific hash bucket after being mapped by the first layer of hash function through the classification identifier;

[0100] 2) Build a B+ tree on the value space of the first-level hash. The original linear search time complexity is O(n), and it is optimized to tree search. The tree search time complexity is O(log n), and the hash map is optimized value search;

[0101]3) Hash-mapping the first-level hash buckets again through the second-level hash function, that is, re-dividing the first-level hash buckets to reduce the data capacity in the hash buckets;

[0102] 4) Pointer connections are established between two adjacent layers of hash buckets. The next layer of ha...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a novel database structure data screening and combining method. The method involves a vertical structure database. The method is characterized in that the vertical structure database establishes a mapping vertical table according to a rule that a classification identifier corresponds to a keyword. The data screening and combining method for the vertical structure database comprises the steps of S1: storing a primary value corresponding to a primary classification identifier in a storage format; and S2: for data in each classification identifier column, performing subdivision to obtain a data package, packaging the repeated primary value in the column and performing re-storage as a secondary classification identifier. The method has the beneficial effects that the problem that an existing computer platform system needs to re-extract all data for extracting missing data during data processing is solved; the data processing speed and the reliability of the platformsystem are improved; and the storage space is saved through a vertical storage technology.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a novel method for screening and merging library structure data. Background technique [0002] With the implementation of the Smart China strategy, big data has a profound impact on various industries. Based on the needs of dealer segmentation and refined marketing of dealers, it has gradually become the main means of reforming the Chinese herbal medicine market. At present, for the data management and marketing needs of the bulk trading platform, the business department usually analyzes various business indicators, screens out the business indicators that need attention, and then submits a specific list of relevant business fields collected by the technical department, and finally the technical department based on According to the plan proposed by the business department, the relevant data is manually analyzed and the results are output. Based on the current data analysis proces...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 怀化
Owner 亳州中药材商品交易中心有限公司