Method for exporting mass of data in distributed environment

A technology for exporting data in a distributed environment, which is applied in the field of data processing, can solve the problems that are not conducive to improving the speed of data export, database query time, etc., and achieve the effects of shortening the waiting time, speeding up the export speed, and reducing the load

Active Publication Date: 2018-03-13
SICHUAN CHANGHONG ELECTRIC CO LTD
View PDF15 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the traditional way of exporting tables is not conducive to improving data export speed and reducing database query time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for exporting mass of data in distributed environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0026] Such as figure 1 As shown, a method for exporting data in large batches in a distributed environment, which specifically includes the following process steps:

[0027] S101: the conditions for sending the data to be exported by the web front end;

[0028] S102: The web front end sends the data acquisition request with export conditions to the controller method corresponding to the background interface, and then queries the total number of data pieces to be exported according to the export conditions;

[0029] S103: According to the total number of queries, calculate how many threads need to be divided into single table export. When calculating, the number of threads = total number of items / total number of items exported by each thread, and the total number of items that can be completed by each thread is passed through the program. Just test how many items can be queried under the maximum load, and put the created multiple threads, that is, query tasks, into the thread...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for exporting mass of data in a distributed environment. In the method, improvement is made aiming at the shortages existing in a traditional method for exporting data. The method comprises the steps that firstly, multi-thread single-table lookup is conducted; secondly, the inquired data is subjected to multi-thread table lookup again. Therefore, the effects that the data export speed is increased and the waiting time of a user is shortened are achieved. In the method, the multi-thread technology is employed many times, and the load of a database server and anapplication server is reduced while the waiting time of the user is shortened.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for exporting data in large batches in a distributed environment. Background technique [0002] With the continuous upgrading of software, the demand is gradually increasing. The traditional design method can no longer meet the business needs. Therefore, a distributed development method must be adopted to split the business. The database layer design adopts multi-database and multi-table design. Cloud platform operators or enterprise managers need to export and analyze operational data at any time. Although software developers can develop functions that meet the requirements according to the needs of data analysts. However, from the request to the online use, there will be a series of tedious processes such as requirement analysis, outline design, code writing, testing, bug modification, and release. However, the market is often changing, and opportunities ar...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F9/50
CPCG06F9/5083G06F2209/5011G06F2209/5018G06F16/2471G06F16/258
Inventor 李波岳永胜
Owner SICHUAN CHANGHONG ELECTRIC CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap