Unlock instant, AI-driven research and patent intelligence for your innovation.

Method for loading and inquiring magnanimity data

A mass data and query method technology, applied in the computer field, can solve problems such as slow loading speed and low loading speed, and achieve the effect of increasing query speed

Active Publication Date: 2010-04-21
RUN TECH CO LTD BEIJING
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing technology, the index is also built when the data is loaded, so as the amount of loaded data increases, the loading speed becomes smaller and smaller. When inserting a piece of data, these indexes need to be maintained, so the loading speed is constantly declining

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for loading and inquiring magnanimity data
  • Method for loading and inquiring magnanimity data
  • Method for loading and inquiring magnanimity data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] This embodiment uses the relational database oracle 10g to implement, other relational databases are also applicable; the operating system adopts RedFlag DC 5.0; the hardware environment adopts the DELL 2850 standard server, the specific configuration is shown in Table 1, and indexes are established on this table according to business requirements. In addition, in order to ensure the legitimacy of the data, a primary key index needs to be established on the temporary table; under the above conditions, the loading effect of the direct entry to the ordinary table and the direct entry to the temporary table plus indexing plus data transfer scheme is shown in Table 2. , And at the same time, query and compare the 100 million pieces of data that have been accumulated according to a known condition, as shown in Table 3. From the data in the table, it can be seen that the loading speed is increased by about 10 times on the basis of the relatively stable query speed.

[0025] Tabl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the computer field, in particular relating to a method for processing mass data loading and inquiry. The invention uses a temporary list with proper granularity to buffer dataof various time slices; no index is established on the temporary list or a master key index is established on the temporary list; after the data of various time slices is processed, indexes are established unitarily for the data of the time slices and then the data is transferred to a partition table. The method for processing mass data loading and inquiry improves the inquiry speed by combinationof the data of the partition list according to business requirements, is only related to the data quantity in the buffer time slices and can meet the high-speed mass data loading environment and theb usiness requirements provided with related inquiries.

Description

Technical field [0001] The invention belongs to the computer field, and specifically relates to a method for loading and querying massive data. Background technique [0002] With the rapid development of enterprise informatization and the Internet, massive data processing has become a top priority, especially in the telecommunications industry and the Internet industry. Some special methods must be used to process massive data. Based on this, the present invention provides a method that can quickly load massive data and can be queried at the same time. [0003] Under normal circumstances, the way to improve the query speed is to build an index to exchange space for time. This has little or no effect on small batches of data. But when the amount of data is very large, the contradiction is more obvious, which seriously affects the loading speed. Of course, if you use better hardware, there will be a lot of improvement. For example, using a supercomputer is much faster than using D...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 朱贺军
Owner RUN TECH CO LTD BEIJING