Unlock instant, AI-driven research and patent intelligence for your innovation.

Splitting and merging method and system for mass data loading

A technology with a large amount of data and data, applied in the computer field, can solve the problems of reduced processing efficiency, increased cost burden, high pressure on database servers, etc., to achieve the effect of improving performance, avoiding excessive pressure, and reducing hardware input costs

Inactive Publication Date: 2013-09-11
SERVYOU SOFTWARE GRP
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] When the amount of concurrent data in the database server is large, it will cause excessive pressure on the database server, resulting in a significant decline in the performance of the data analysis application system and a reduction in processing efficiency
Therefore, in order to ensure the stable performance of the data analysis application system, the performance of the data analysis application system can only be improved by increasing the database hardware, such as adding more cpu or increasing memory, etc., which will lead to an increase in the cost burden

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Splitting and merging method and system for mass data loading
  • Splitting and merging method and system for mass data loading

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0039] Embodiments of the present invention provide a splitting and merging method and system for loading large amounts of data, so as to ensure stable performance of the data analysis application system and reduce the investment cost of database hardware equipment.

[0040] Since there are many ways to implement the splitting and merging method and system for the above-mentioned large amount of data loading, the following will describe in detail through specif...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a splitting and merging method and system for mass data loading. According to the scheme provided by the invention, an analysis request is split into a plurality of analysis sub-requests before a database server is inquired; and as part of the analysis request, each analysis sub-request acquires a very small amount of data relative to the analysis request, so that when the database server processes the analysis sub-requests, the processing pressure is not too high. Moreover, the database server doesn't need to process the whole analysis request as well as the splitting process of the analysis request, so that compared with the prior art, the scheme provided by the invention can avoid overhigh pressure on the database server, thereby improving the system performance and reducing the hardware investment cost of the database server.

Description

technical field [0001] The present invention relates to the field of computer technology, more specifically, to a splitting and merging method and system for loading large amounts of data. Background technique [0002] The data analysis application system refers to a software platform for processing, computing, summarizing, screening and other operations on various business data such as production transactions. [0003] Usually, the data analysis application system will receive the query and other instructions sent by the user, and edit the SQL query statement or stored procedure in the database server according to the instruction to retrieve the required data. [0004] During the research and practice of the prior art, the inventors of the present invention have found that the prior art has the following problems: [0005] When the amount of concurrent data in the database server is large, the pressure on the database server will be too high, resulting in a significant dro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 陈宏仁
Owner SERVYOU SOFTWARE GRP