Data processing method and device

A data processing and processor technology, applied in the field of data processing methods and devices, can solve the problems of manual processing consumption, untimely processing, unreliable distributed system resource request service, etc., and achieve the effect of improving efficiency and accurate and reliable detection results

Active Publication Date: 2020-03-24
ALIBABA GRP HLDG LTD
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, once the resource scheduler is unavailable, the entire distributed system cannot make resource requests, which may cause serious consequences for distributed systems
[0003] Even if it is found that the resource scheduler cannot provide services normally, when the problem needs to be found, it can only be found and handled manually
The process of manual processing is more difficult, not only because the working principle of the res

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] In order to enable those skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described The embodiments are only some of the embodiments of the present application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0019] As can be seen from the above, it is often time-consuming and labor-intensive to find problems on the resource scheduler in the prior art, and in a distributed system, the reliability of behavior on the resource scheduler is highly required. If the resource scheduler cannot provide reliable services, it is very difficult to find an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data processing method and device, and the method comprises the steps that a scheduler detection module obtains an operation index of a resource scheduler in a distributed system, and the scheduler detection module is coupled with the resource scheduler; and it is determined that the resource scheduler is abnormal under the condition that the operation index exceeds a preset range. Through the method provided by the embodiment of the invention, whether the resource scheduler is abnormal or not can be determined according to the real-time operation index of the resource scheduler under the condition of not influencing the normal operation of the resource scheduler. In this way, an accurate and reliable detection result can be obtained, the detection result can be rapidly obtained, and the exception handling efficiency of the resource manager is improved.

Description

technical field [0001] The present application relates to the technical field of software development, in particular to a data processing method and device. Background technique [0002] The resource scheduler is an important role in a distributed system and is used to manage all resource nodes in the entire distributed system. The resource manager can acquire resources of each resource node, and perform resource scheduling according to a resource scheduling request (such as a CPU request, a memory request) sent by a user. In practical applications, the resource scheduler is often a single-point role. It not only needs to manage thousands of resource nodes running on physical nodes, but also needs to undertake tens of thousands of resource scheduling requests per second, and needs to respond to the Resource scheduling request, query resource availability at the frequency of second level. Therefore, once the resource scheduler is unavailable, the entire distributed system c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50G06F11/30
CPCG06F9/5027G06F11/302
Inventor 欧阳晋冯亦挥王家忙
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products