A method and device for dynamically adjusting task-level parameters of a distributed system architecture
A distributed system and dynamic adjustment technology, applied in the field of cloud computing, can solve the problem that parameter configuration cannot be adjusted according to user needs, and achieve the effect of online performance optimization.
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0017] Embodiment 1, a method for dynamically adjusting task-level parameters of a distributed system architecture, such as figure 1 shown, including:
[0018] Step 1, create a configuration service thread when the job object is initialized, and this thread checks whether there is a new p group configuration every predetermined time;
[0019] Specifically, the technical solution of the present invention creates a separate configuration service thread, and sets every second or other predetermined time, such as N seconds, to monitor the update of the configuration file at the user's given location and whether the job is completed. Among them, p is a positive integer.
[0020] Step 2, if there are resources, allocate resources to them first;
[0021] Specifically, the technical solution of the present invention designs a resource re-application mechanism. Assuming that the user provides p groups (p, and the data structure is set as Config. The resource re-application mechanis...
Embodiment 2
[0024] Embodiment 2, a method for dynamically adjusting task-level parameters of a distributed system architecture, based on Embodiment 1, as follows Figures 2 to 3 shown, including:
[0025] More preferably, the step 1, if there is one, assign resources to it preferentially. Specifically, when the p group configuration parameters are updated, then notify the job assignment object, and the job assignment object includes a resource re-application mechanism, and the resource re-application The application mechanism resubmits to the resource scheduler a resource application with a priority higher than the task priority of the non-dynamic configuration according to the parameter value of the task resource allocation in the p group configuration, and the resource scheduler will give priority to the resource scheduler after receiving the application. p resource requests to allocate resources.
[0026] More preferably, when the step-p group of configurations is updated, it is assum...
Embodiment 3
[0042] Embodiment 3, a device for dynamically adjusting task-level parameters of a distributed system architecture, such as Figure 4 As shown, it includes: a configuration service module, which is used to create a configuration service thread when the job object is initialized, and the thread checks whether there is a new p-group configuration every predetermined time; a resource re-application module, which is used if there is a new p-group The configuration assigns resources to it first; the second configuration module is used for each task to complete the configuration of the second parameter when the task is initialized after retrieving its own configuration through its own id.
[0043] More preferably, the configuration service module, if there is a new p-group configuration, then preferentially allocate resources to it. Specifically, when the p-group configuration parameters are updated, then notify the job assignment object, and the job assignment object includes resour...
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More