Method for downloading mass data on data platform

A technology with a large amount of data and a data platform, applied in the fields of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of large data downloads, system crashes, rising costs, etc., to improve memory usage efficiency, Improve stability and reduce occupancy

Inactive Publication Date: 2015-08-26
上海宝钢国际经济贸易有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At this time, the available memory will be reduced, which will affect other work of the system server. When the amount of data is too large, it will cause memory overflow and cause the system to crash.
One solution i

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for downloading mass data on data platform
  • Method for downloading mass data on data platform
  • Method for downloading mass data on data platform

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0030] reference figure 1 As shown, the present invention discloses a method for downloading a large amount of data on a data platform, for downloading a large amount of data from a database to a local WEB application server, the method includes the following steps:

[0031] 102. In the data query step, the system server queries the database for the number of data items that meet the conditions according to the query conditions entered by the user. In one embodiment, in the data query step 102, the query condition entered by the user is a SQL statement containing an ID number, and the system server queries the database for the number of data items that meet the conditions according to the ID number in the SQL statement. For data items that meet the query conditions, an exception report is output.

[0032] 104. In the TXT file calculation step, the system server divides the eligible data items into pages, and the system server determines the file format of the TXT file according to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for downloading mass data on a data platform, which is suitable for downloading the mass data. The method comprises the following steps of a data query step that a system server queries a number of data items which conform to the conditions in a database; a TXT file computing step that the system server pages the data items and determines a file format of TXT files according to the total number of the data items and the number of the TXT files corresponding to each page; a TXT file generation step that the TXT files are generated on a local WEB application server according to the file format of TXT files, the system server writes the data items into the TXT files and releases the memory resources of the system server after writing; an output flow writing step that an output stream is formed in an internal memory of the system server, the output stream is data flow, the data items in the TXT files are circularly read from the local WEB application server and the output stream is written; and a data export step that the data items are exported from the output stream, and the internal memory resources of the system server are released after exporting.

Description

technical field [0001] The invention relates to network data transmission technology, in particular to a method for downloading a large amount of data on a data platform. Background technique [0002] For large enterprises or network platforms, there are often a large number of data reports that need to be transmitted, especially for enterprises using data platforms such as ERP, users often need to download a large number of data reports to the local machine for subsequent processing. [0003] The currently used transmission method is that the user initiates a request from his own client, and the system server processes the request in its memory, queries the database according to the request, caches the data items obtained from the query in the memory of the system server, and waits for the query to be completed before retrieving it from the The system server's memory is sent to the user's client. During this process, all the work is done in the memory of the system server....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 严鸽群李燕秋王莘舒畅许磊蒋卓婕甘鸿琨张顺孔晓苏
Owner 上海宝钢国际经济贸易有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap