Method for loading and inquiring magnanimity data

A mass data and query method technology, applied in the computer field, can solve problems such as slow loading speed and low loading speed, and achieve the effect of increasing query speed

Active Publication Date: 2008-08-27
RUN TECH CO LTD BEIJING
View PDF0 Cites 34 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing technology, the index is also built when the data is loaded, so as the amount of loaded data increases, the loading speed becomes smaller and smaller. When inserting a piece of data, these indexes need to be maintained, so the loading speed is constantly declining

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for loading and inquiring magnanimity data
  • Method for loading and inquiring magnanimity data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] This embodiment is implemented using the relational database oracle 10g, and other relational databases are also applicable; the operating system adopts RedFlag DC 5.0; the hardware environment adopts DELL 2850 standard server, and the specific configuration is shown in Table 1, and an index is established on the table according to business requirements. In addition, in order to ensure the legitimacy of the data, it is necessary to establish a primary key index on the temporary table; under the above conditions, the loading effect of directly entering the ordinary table and directly entering the temporary table plus indexing and transferring data is shown in Table 2. , and at the same time query and compare the accumulated 100 million pieces of data according to a known condition, as shown in Table 3. From the data in the table, it can be seen that on the basis of relatively stable query speed, the loading speed increases by about 10 times.

[0025] Table 1 Structure ta...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the computer field, in particular relating to a method for processing mass data loading and inquiry. The invention uses a temporary list with proper granularity to buffer data of various time slices; no index is established on the temporary list or a master key index is established on the temporary list; after the data of various time slices is processed, indexes are established unitarily for the data of the time slices and then the data is transferred to a partition table. The method for processing mass data loading and inquiry improves the inquiry speed by combination of the data of the partition list according to business requirements, is only related to the data quantity in the buffer time slices and can meet the high-speed mass data loading environment and the business requirements provided with related inquiries.

Description

technical field [0001] The invention belongs to the field of computers, and in particular relates to a method for loading and querying massive data. Background technique [0002] With the rapid development of enterprise informatization and the Internet, massive data processing has become a top priority, especially in the telecommunications industry and the Internet industry. Some special methods must be used to process massive data. Based on this, the present invention proposes a method capable of quickly loading massive amounts of data and enabling queries at the same time. [0003] Usually, the way to improve query speed is to build indexes and trade space for time. This has little or no impact on small batches of data. But when the amount of data is very large, the contradiction is more obvious, seriously affecting the loading speed. Of course, if better hardware is used, there will be a great improvement. For example, using a supercomputer is much faster than using a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 朱贺军
Owner RUN TECH CO LTD BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap