Check patentability & draft patents in minutes with Patsnap Eureka AI!

Distributed data processing device and method

A technology of distributed data and processing device, applied in the direction of electronic digital data processing, special data processing application, structured data retrieval, etc., can solve the problem of database server hardware limitation, affecting network transmission efficiency, high server load, etc., to reduce The effect of information transmission volume, good scalability, and good security

Inactive Publication Date: 2017-12-01
TIANJIN TONGYANG TECH DEV
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] (1) Restricted by the hardware conditions of the database server
[0005] A server's memory, CPU, I / O throughput, etc. are all prioritized. Executing a large amount of data queries will occupy the server's memory and other resources, which will overload the server and cause slow execution speed.
[0006] (2) Restricted by network conditions
[0007] The query results of the database need to be sent from the server to the client through the network. If the amount of data is too large, it will occupy network resources and affect the efficiency of network transmission.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data processing device and method
  • Distributed data processing device and method
  • Distributed data processing device and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] In an environmental quality monitoring system, there are hundreds of monitoring points to monitor the value of PM2.5 in the air. Each monitoring point corresponds to a business server. The monitoring point will generate a piece of monitoring data every minute and store it in the business database. In this way, one year The amount of data will reach billions.

[0059] The distributed data processing device needs to provide users with functions such as adding, deleting, modifying and checking monitoring data, importing and exporting, and statistical analysis. There are not only single-site data queries, but also multi-site cross-database comparative statistics. Moreover, it is required to ensure that the system has security, stability, and rapid response capabilities in the case of hundreds of millions of data volumes, in order to have a good user experience.

[0060] This system adopts SqlServer database, uses ASP.net platform for program development, and the background...

Embodiment 2

[0065] An automobile manufacturing head office has many factories all over the world, and each factory has many production lines, and each production line will upload the parameters of the production line (including output, scrap quantity, etc.) to the database in real time. The head office has a production monitoring platform (ie the core server of the present invention), which can check the production situation of each factory at any time.

[0066] This system adopts SqlServer database, uses ASP.net platform for program development, and the background service is written by C# language.

[0067] Each branch factory has its own database server (i.e. the business server of the present invention) installed, and the production data of the factory will only be stored in the database of the factory. The core database of the head office will store all branch factory information and all business database information. Associate the unique ID of each branch with the connection string ...

Embodiment 3

[0072] In the same distributed data processing device, both the environmental quality inspection system and the automobile manufacturing head office, the core server of the environmental quality inspection system and the core server of the automobile manufacturing head office can be connected to each business database, and thus Realize the operation of each monitoring point and automobile branch factory. The specific situation of this embodiment is similar to that of Embodiment 1 and Embodiment 2, and will not be repeated here.

[0073] To sum up, according to the database deployment method and the database operation algorithm of the present invention, the business requirements that cannot be met by a stand-alone database are solved. In the era of big data, in the face of ever-increasing massive data, using the present invention can improve the access speed of the database, cope with high concurrency, and have stronger scalability.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a distributed data processing device, comprising a core server and at least one business server; the core server is electrically coupled to the at least one business server, wherein core server is used for storing business databases of the at least one business server electrically coupled to the core server and parameters associated with the business databases, and generating a connection character string according to the parameters; the business servers are used for storing at least one business database, and each business server corresponds to one sub-thread; the business servers are also used for connecting the corresponding business databases via the sub-threads according to the connection character string so as to process the business databases. In addition, the invention also provides a distributed data processing method. The distributed data processing device and method have the advantages of high response speed, good economy, high reliability, good extensibility, and good convenience of operation.

Description

technical field [0001] The invention relates to the field of database distributed storage and multi-thread program development, in particular to a distributed data processing device and method. Background technique [0002] When the amount of data in a system is very large, such as tens of millions or even hundreds of millions of data, if the storage method of a single database is still adopted, the speed of accessing data will be extremely slow. As a result, the application program cannot perform operations such as adding, deleting, modifying, and checking normally, and even causes the system to crash. [0003] When the amount of data is large, the main reasons for the slow data access speed are: [0004] (1) Restricted by the hardware conditions of the database server [0005] A server's memory, CPU, I / O throughput, etc. are prioritized. Executing a large amount of data queries will occupy resources such as the server's memory, which will overload the server and cause sl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/21G06F16/27
Inventor 陈文亮王小蒙刘洪涛张金永高静明张顺平孙朝霞
Owner TIANJIN TONGYANG TECH DEV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com