Distributed cloud data centralized processing method

A centralized processing and distributed technology, applied in special data processing applications, database models, database indexes, etc., can solve problems such as inability to effectively process existing data, and achieve the effect of improving processing capacity and processing speed

Pending Publication Date: 2021-01-15
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the context of rapid business growth, the relevant data tables are at the terabyte level, with tens of millions of new daily additions. The demand for centralized data processing of MBSS as a whole is very large. However, the existi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed cloud data centralized processing method
  • Distributed cloud data centralized processing method
  • Distributed cloud data centralized processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments, so that those skilled in the art can better understand the present invention and implement it, but the examples given are not intended to limit the present invention.

[0031] The present invention provides a method for centralized processing of distributed cloud data: using the vertical and horizontal expansion of Mysql to split and store data, so that the database clusters process the data of related classifications respectively,

[0032] Use Canal to deploy data collection nodes to the distributed cloud for automatic incremental data collection, and real-time data transmission through kafka, and realize automatic data classification by distinguishing different data types.

[0033] The asynchronous notification of automatically classified and processed data is distributed to different nodes of the distributed cloud for parallel multi-threaded da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed cloud data centralized processing method, and relates to the technical field of data processing. According to the method, data splitting and storage are performedin longitudinal and transverse expansion forms of Mysql, so that database clusters respectively process related classified data, data acquisition nodes are deployed to distributed cloud by using Canal to perform automatic incremental acquisition of the data, real-time transmission of the data is performed through kafka, and automatic classification of the data is realized by distinguishing different data types. The asynchronous notification of the data subjected to automatic classification processing are allocated to different nodes of the distributed cloud for parallel multi-thread data calculation.

Description

technical field [0001] The invention discloses a processing method and relates to the technical field of data processing, in particular to a centralized processing method for distributed cloud data. Background technique [0002] Cloud computing business support system (Business Support Systems, referred to as BSS), is a kind of business middle platform, which connects with IaaS and PaaS applications internally, and serves enterprise users, individual users, and government users externally. With the rapid development of cloud computing in recent years, the cloud system has developed from a single private cloud to a public cloud, and finally to a distributed cloud. Cloud, Industrial Internet, etc.), a centralized central node management system (MBSS for short) has emerged, which is responsible for unified management of standard data, collecting business data, and undertaking the function of the business brain. [0003] Database technology and message communication technology ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F16/22G06F16/28
CPCG06F16/27G06F16/2282G06F16/285
Inventor 谷润东
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap