Data extracting and processing method supporting high-concurrency large-volume data

A technology of data extraction and large amount of data, applied in electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of cumbersome process and insufficient stability.

Inactive Publication Date: 2013-08-07
INSPUR COMMON SOFTWARE
View PDF1 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In enterprise decision-making, there is a strong statistical demand for the purchase, sales and inventory data of the enterprise's products among downstream distributors. How to stably obta...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] The specific procedures for data collection on the client side and data processing on the server side are given below:

[0030] 1. Client:

[0031] 1.1 The rule log cache class, which provides log cache and regularly saves logs to files:

[0032] public class TableLogBuffer: ThreadTaskBase

[0033] {

[0034] / / / Regular execution log save

[0035] protected override void TaskWorkFunc()

[0036] {

[0037] lock (_lock)

[0038] {

[0039] / / If the memory has not changed, it does not need to be saved to a file

[0040] if (!_ismodified)

[0041] return;

[0042] if (!Directory.Exists(LocalPath.LogPath))

[0043] Directory.CreateDirectory(LocalPath.LogPath);

[0044] / / Get the byte stream of format information

[0045] string strResult = Serializer.XmlSerialize(_logList);

[0046] string strPath = LocalPath.LogPa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of data acquisition and statistics, particularly to a data extracting and processing method supporting high-concurrency large-volume data. By defining an acquisition scheme flexibly; client software defines an acquisition SQL (structured query language) and an acquisition frequency for acquiring data at a fixed time, and a server module provides security login, data importing and business logic processing triggering, so that mass data can be stably acquired into an enterprise database to provide a data source for enterprise decision analysis.

Description

Technical field [0001] The invention relates to the technical field of data collection and statistics, in particular to a data extraction processing method supporting high concurrency and large data volume. Background technique [0002] In corporate decision-making, there is a strong statistical need for downstream distributors’ product purchase, sales and inventory data. How to obtain massive amounts of data from a large number of distributors will become the key to the problem. The current collection methods are independent The process is cumbersome and not stable enough. Summary of the invention [0003] In order to solve the problems of the prior art, the present invention provides a data extraction processing method that supports high concurrency and large data volume. By flexibly defining a collection scheme, the client software defines the collection of SQL, collection frequency and timing collection of data, and the server component provides security Login, data import, a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 付传伟
Owner INSPUR COMMON SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap