Scheduling method and device based on data calculation and analysis and storage medium

A technology of data computing and scheduling methods, applied in computing, digital data processing, resource allocation, etc., can solve problems such as high configuration costs, and achieve the effects of reasonable allocation, reduced cluster configuration, and rational application and high efficiency.

Pending Publication Date: 2020-11-06
广东好太太智能家居有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

A cluster has hundreds or thousands of servers, and each server requires high configuration costs, as well as electricity, computer room, operation and maintenance costs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Scheduling method and device based on data calculation and analysis and storage medium
  • Scheduling method and device based on data calculation and analysis and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] Such as figure 1 , 2 As shown, the present invention provides a scheduling method based on data calculation and analysis, comprising the following steps:

[0030] Step S1. Collect the status and load information of different resources in the resource pool, and save them in the database; collect the status and load information of different resources in the resource pool, and store them in the database, as the execution basis for subsequent resource scheduling. The status and load information of different resources in the resource pool are collected, and the specific resources include CPU, memory, network, and virtual resources; the status and load information of the resources include the total capacity, usage and utilization rate of resources. Save the above information in the table of the database, update and query in real time, so as to facilitate timely mobilization of resources.

[0031] Step S2. Integrate the status and load information of different resources in t...

Embodiment 2

[0040] The present invention also provides an electronic device, including a memory, a plurality of processors, and a program stored in the memory. The program is configured to be executed by the processor. When the plurality of processors execute the program, the above-mentioned one based on Steps of a scheduling method for data computation and analysis.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a scheduling method based on data calculation and analysis, and the method comprises the following steps: S1, collecting the states and load information of different resourcesin a resource pool, and storing the states and load information in a database; s2, integrating the states and the load information of different resources in the database, and performing resource cooperative scheduling on the data by the states and the load information of different resources according to a preset scheduling strategy and scheduling priority; and S3, enabling the big data computing platform to dynamically allocate and analyze the resources according to a resource cooperative scheduling result, and output data indexes. The big data analysis process is subjected to dynamic scheduling processing according to the preset scheduling strategy and priority, resource consumption is reduced, cluster configuration is reduced under the condition that service requirements are kept, reasonable application and efficient data analysis of server resources are achieved, and the method has positive significance in enterprise compression cost.

Description

technical field [0001] The invention relates to the technical field of big data computing and processing, in particular to a scheduling method, device, and storage medium based on data computing and analysis. Background technique [0002] With the development of big data technology, the computing engine is continuously optimized and updated, and the improvement of computing efficiency in technology selection is close to the limit. With the increase of data volume, the pressure of data calculation and analysis carried by the computing resources of the big data platform is increasing. Computing resources include CPU, memory, disk throughput, bandwidth and other hardware; in the field of big data, resource consumption is very huge. A cluster has hundreds or thousands of servers, and each server requires high configuration costs, as well as costs such as electricity bills, computer rooms, and operation and maintenance. [0003] Computing resources are highly variable, users' r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5011G06F9/5027
Inventor 沈汉标王妙玉邓建平吴宁泉周小桥
Owner 广东好太太智能家居有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap