Monitoring method and device, data processing method and device, and distributed computing system

A technology of distributed computing and monitoring device, applied in the field of data processing, can solve problems such as the inability to realize real-time processing of massive data, and achieve the effect of eliminating tasks that cannot be processed in time, eliminating time delays, and realizing real-time processing.

Inactive Publication Date: 2014-02-12
BEIJING OAK PACIFIC NETSCAPE TECH DEV
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in this processing method, real-time processing of massive data cannot be realized

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monitoring method and device, data processing method and device, and distributed computing system
  • Monitoring method and device, data processing method and device, and distributed computing system
  • Monitoring method and device, data processing method and device, and distributed computing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0021] figure 1 A schematic diagram of a distributed computing system capable of computing massive data according to an embodiment of the present invention is shown.

[0022] Such as figure 1 As shown, the distributed computing system may include at least one computing node (for the sake of brevity, only three computing nodes are exemplarily shown in the figure, and those skilled in the art can understand that the number of computing nodes can be any positive integer) and monitoring devices. The computing nodes can sequentially acquire data processing tasks from the task sequence, and the monitoring device communicates with each computing node to monitor the processing status of the data processing tasks of each computing node and perform the processing according to the status of the data processing tasks of each computing node. Generate corresponding...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to a monitoring method and device, a data processing method and device, and a distributed computing system in distributed computing. The monitoring method comprises the steps that each computing node receives state information related to current task processing of the corresponding computing node, a task execution instruction is generated based on the state information received by each computing node for the corresponding node, and the task execution instruction is sent to the corresponding computing node, so as to execute corresponding subsequent processing, so that the real-time processing on massive data is realized.

Description

technical field [0001] The present invention relates to the field of data processing, and more specifically, to a distributed data processing method and device for massive data processing. Background technique [0002] With the development of Internet technology, the processing of massive data has gradually become a hot issue. Generally speaking, people use distributed computing to perform massive data processing. [0003] In an existing distributed computing of massive data, processing is performed through the following steps: according to the position of the massive data in the storage device, the massive data within a long period of time (for example, one day, one hour) is divided into individual data block; each data block is sent to each working computing node in the computing system; each working computing node processes the received data block and outputs the processing result; the processing result output by each working computing node is output by the main computin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/30G06F9/46
Inventor 严岩
Owner BEIJING OAK PACIFIC NETSCAPE TECH DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap