Resource scheduling method and system, computing device and storage medium
A resource scheduling and computing resource technology, applied in the resource scheduling method and system, computing equipment and storage media, can solve problems such as slow execution, extended query execution time, and uncontrollable data time consumption, so as to save network overhead and realize dynamic The effect of distribution
Active Publication Date: 2022-02-11
BEIJING OCEANBASE TECH CO LTD
View PDF4 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0002] The parallel query system of the distributed relational database (OceanBase) executes data table scanning (TableScan). When the query encounters a data skew scenario, for example, there is less data on machine A, and the scan is faster, while there is more data on machine B, and the scan is faster. In the slow scenario, when the task on machine A is completed, it will be idle, while the task on machine B needs to continue to execute slowly. Even if there are enough idle computing resources on machine A, it cannot be fully utilized, resulting in query (Query ) execution time is extended, but after the task execution on machine A is completed, the workload of machine B is shared by remotely reading the task data on machine B, which will introduce network overhead. When the bandwidth is insufficient, reading machine B The time consumption of uploading data is uncontrollable, and it may even happen that the work on machine B has been completed, while machine A is still stuck reading the data on machine B.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0023] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the application. However, the present application can be implemented in many other ways different from those described here, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.
[0024] Terms used in one or more embodiments of this specification are for the purpose of describing specific embodiments only, and are not intended to limit one or more embodiments of this specification. As used in one or more embodiments of this specification and the appended claims, the singular forms "a", "said" and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present sp...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
A resource scheduling method and system, a computing device, and a storage medium provided in the present application, wherein the method includes the first server acquiring the target business and computing resources, and determining the second server and the third server that process the target business server; process the first service and the third server process the service allocation information of the second service, and determine the resource allocation information of the computing resources of the second server and the third server; according to the service The allocation information and the resource allocation information control the second server and the third server to receive and process the first service and the second service; the second server completes the first service, and the When the third server has not completed the second business, allocate the remaining computing resources of the second server to the third server; realize dynamic allocation of computing resources, save network overhead and processing consumption of the target business Time.
Description
technical field [0001] The present application relates to the technical field of computer data processing, and in particular to a resource scheduling method and system, a computing device and a storage medium. Background technique [0002] The parallel query system of the distributed relational database (OceanBase) executes data table scanning (TableScan). When the query encounters a data skew scenario, for example, there is less data on machine A, and the scan is faster, while there is more data on machine B, and the scan is faster. In the slow scenario, when the task on machine A is completed, it will be idle, while the task on machine B needs to continue to execute slowly. Even if there are enough idle computing resources on machine A, it cannot be fully utilized, resulting in query (Query ) execution time is extended, but after the task execution on machine A is completed, the workload of machine B is shared by remotely reading the task data on machine B, which will intr...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50G06F16/2453
CPCG06F9/5027G06F16/24532G06F16/27G06F16/284Y02D10/00
Inventor 余璜潘毅
Owner BEIJING OCEANBASE TECH CO LTD