A method and device for scheduling batch computing jobs
By determining the target cloud server from multiple cloud servers and creating a computing environment server cluster, the problem of insufficient batch computing job resources is solved, and the computing resources are fully utilized, avoiding progress impact and task interruptions.
Patent Information
- Application Number
- CN201910577604.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-06-28
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2039-06-28
AI Technical Summary
In the prior art, batch computing jobs rely on cloud server resources from a single source, resulting in the calculation progress or task interruption when resources are insufficient, and multiple cloud server resources cannot be effectively utilized.
By obtaining the batch computing jobs to be calculated, identifying the target cloud servers from multiple sources, creating a cluster of computing environment servers for computing, ensuring sufficient computing resources.
It effectively avoids the impact of batch computing job progress caused by insufficient computing resources, improves the utilization rate of computing resources, and ensures the stability and efficiency of computing tasks.
Smart Images

Figure CN110298586B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing, and in particular to a method and device for scheduling batch computing jobs. Background Art
[0002] Since batch computing jobs usually have a large amount of computing, a computing environment server cluster is generally used to perform offline computing on them. Batch computing jobs usually include multiple tasks, such as genetic data analysis, animation rendering, big data computing, video transcoding, etc. The computing environment server cluster includes multiple cloud servers.
[0003] Currently, when users need to perform batch computing jobs, they can only use cloud servers from one source to create a computing environment server cluster, and then perform batch computing jobs based on the created computing environment server cluster. In this way, when the cloud server resources of this source are insufficient, the computing progress of the batch computing job will be affected, and even the task of the batch computing job will be interrupted. Summary of the invention
[0004] In order to solve the above technical problems, the present application provides a batch computing job scheduling method and device, which can ensure sufficient computing resources, thereby avoiding problems such as affecting the progress of batch computing jobs caused by insufficient computing resources.
[0005] The embodiments of the present application disclose the following technical solutions:
[0006] In a first aspect, an embodiment of the present application provides a method for scheduling batch computing jobs, the method comprising:
[0007] Get the batch computing jobs to be calculated;
[0008] According to the batch computing job, determining a target cloud server from a plurality of source cloud servers;
[0009] A computing environment server cluster for computing the batch computing job is created according to the target cloud server.
[0010] In a second aspect, an embodiment of the present application provides a batch computing job scheduling device, the device comprising an acquisition unit, a determination unit, and a creation unit:
[0011] The acquisition unit is used to acquire the batch computing job to be calculated;
[0012] The determining unit is used to determine a target cloud server from a plurality of source cloud servers according to the batch computing job;
[0013] The creation unit is used to create a computing environment server cluster for computing the batch computing job according to the target cloud server.
[0014] In a third aspect, an embodiment of the present application provides a device for batch computing job scheduling, the device comprising a processor and a memory:
[0015] The memory is used to store program code and transmit the program code to the processor;
[0016] The processor is used to execute the batch computing job scheduling method as described in the first aspect according to the instructions in the program code.
[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store program code, and the program code is used to execute the batch computing job scheduling method as described in the first aspect.
[0018] It can be seen from the above technical solution that after obtaining the batch computing job to be calculated, the target cloud server can be determined from the cloud servers of multiple sources according to the obtained batch computing job. Thus, a computing environment server cluster for computing the batch computing job is created according to the determined target cloud server. It can be seen that this method combines cloud servers of multiple sources, so that when determining the target cloud server for the batch computing job, it can ensure sufficient computing resources, thereby avoiding problems such as affecting the progress of the batch computing job caused by insufficient computing resources. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0020] Figure 1 A schematic diagram of an application scenario of a batch computing job scheduling method provided in an embodiment of the present application;
[0021] Figure 2 A flow chart of a batch computing job scheduling method provided in an embodiment of the present application;
[0022] Figure 3 A structural diagram of a batch computing job scheduling system provided in an embodiment of the present application;
[0023] Figure 4 A flowchart of a working method of a multi-cloud resource management module provided in an embodiment of the present application;
[0024] Figure 5a A schematic diagram of the structure of a batch computing job scheduling device provided in an embodiment of the present application;
[0025] Figure 5b A schematic diagram of the structure of a batch computing job scheduling device provided in an embodiment of the present application;
[0026] Figure 6 A structural diagram of a batch computing job scheduling device provided in an embodiment of the present application;
[0027] Figure 7 A structural diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION
[0028] The embodiments of the present application are described below in conjunction with the accompanying drawings.
[0029] Currently, users can only use cloud servers from one source to create a computing environment server cluster for batch computing jobs. In this way, when the cloud server resources from this source are insufficient, the batch computing job's computing progress will be affected, and even the batch computing job's tasks will be interrupted.
[0030] To this end, an embodiment of the present application provides a batch computing job scheduling method, the core idea of which is: based on cloud servers from multiple sources, a target server for creating a computing environment server cluster is determined for a batch computing job. Thus, by combining cloud servers from multiple different sources, sufficient computing resources can be guaranteed, thereby avoiding problems such as insufficient computing resources that affect the progress of batch computing jobs.
[0031] First, the application scenario of the embodiment of the present application is introduced. The batch computing job scheduling method can be applied to a server, which can be a dedicated server used only for batch computing job scheduling, or a public server that also includes other data processing functions, which is not limited by the embodiment of the present application.
[0032] In order to facilitate understanding of the technical solution of the present application, the batch computing job scheduling method provided by the embodiment of the present application is introduced below by taking a server as an example in combination with actual application scenarios.
[0033] See also Figure 1 , Figure 1 A schematic diagram of an application scenario of a batch computing job scheduling method provided in an embodiment of the present application. The application scenario includes a server 101, in which cloud server resources from multiple different sources may be pre-integrated, wherein the source of the cloud server may refer to the controller of the cloud server, for example, the source of the cloud server may be the supplier of the cloud server.
[0034] Thus, the server 101 can obtain the batch computing jobs to be calculated. The batch computing jobs to be calculated can be computing jobs that need to be calculated and have a large amount of calculation.
[0035] After obtaining the batch computing job to be calculated, a target cloud server can be determined from multiple source cloud servers according to the batch computing job, thereby creating a computing environment server cluster for calculating the obtained batch computing job according to the determined target cloud server.
[0036] It can be seen that this method combines cloud servers from multiple sources, so that when determining the target cloud server for batch computing jobs, it can ensure sufficient computing resources, thereby avoiding problems such as insufficient computing resources that affect the progress of batch computing jobs.
[0037] Next, the batch computing job scheduling method provided in the embodiment of the present application will be introduced with reference to the accompanying drawings.
[0038] See also Figure 2 , which shows a flow chart of a batch computing job scheduling method provided by an embodiment of the present application, such as Figure 2 As shown, the method may include:
[0039] S201: Obtain a batch computing job to be calculated.
[0040] When a user needs to calculate a batch computing job, the user can send the batch computing job to be calculated. Thus, the batch computing job sent by the user can be received.
[0041] S202: Determine a target cloud server from a plurality of source cloud servers according to the batch computing job.
[0042] In the embodiment of the present application, multiple cloud servers from different sources may be pre-integrated. The source of the cloud server may be the controller of the cloud server. For example, the source of cloud server A may be cloud server provider B.
[0043] After receiving the batch computing job to be calculated, a target cloud server can be determined from the integrated cloud servers of multiple sources according to the batch computing job. The target cloud server here can be a cloud server required to create a computing environment server cluster for the batch computing job.
[0044] It should be noted that the determined target server may be one cloud server or multiple cloud servers.
[0045] S203: Creating a computing environment server cluster for computing the batch computing job according to the target cloud server.
[0046] Thus, a computing environment server cluster for computing batch computing jobs can be created according to the determined target cloud server.
[0047] It can be seen from the above technical solution that after obtaining the batch computing job to be calculated, the target cloud server can be determined from the cloud servers of multiple sources according to the obtained batch computing job. Thus, a computing environment server cluster for computing the batch computing job is created according to the determined target cloud server. It can be seen that this method combines cloud servers of multiple sources, so that when determining the target cloud server for the batch computing job, it can ensure sufficient computing resources, thereby avoiding problems such as affecting the progress of the batch computing job caused by insufficient computing resources.
[0048] For the computing environment server cluster used to calculate batch computing jobs, the cloud server therein is usually a public cloud server. The public cloud server may be a cloud server provided by a cloud service provider to a user. Based on this, in a possible implementation, the cloud servers from multiple sources may also include a private cloud server, wherein the private cloud server may be a cloud server provided to a user for separate use, and the private cloud server may be built by the user himself or by a cloud server provider. In this way, sufficient available cloud server resources are further guaranteed.
[0049] When the cloud servers from multiple sources include a private cloud server, the method for determining a target cloud server from the cloud servers from multiple sources according to the batch computing job in S202 may include:
[0050] S301: before determining a private cloud server as a target cloud server from the plurality of source cloud servers according to the batch computing job, authenticating the private cloud server.
[0051] It can be understood that if the cloud servers from multiple sources include a private cloud server, when determining the target cloud server from the cloud servers from the multiple sources according to the batch computing job, it is possible to determine the private cloud server from the cloud servers from the multiple sources as the target cloud server. Therefore, when the private cloud server is determined from the cloud servers from the multiple sources as the target cloud server, the private cloud server can be authenticated to ensure the security and other performance of the private cloud server.
[0052] S302: After the private cloud server passes the authentication, the private cloud server is determined to be a target cloud server.
[0053] In this way, the private cloud server is determined as the target cloud server only when it passes the authentication, which can effectively ensure the stability and security of the computing environment server cluster created in the next S203.
[0054] It is understandable that by executing S203, a computing environment server cluster for computing batch computing jobs can be created. Based on this, after creating the computing environment server cluster, in a possible implementation, the method further includes:
[0055] S401: Calculate the batch computing job through the computing environment server cluster.
[0056] Through this method, the batch computing jobs of the user can be calculated according to the created computing environment server cluster, thereby completing the calculation of the batch computing jobs of the user.
[0057] In an embodiment of the present application, in order to reduce the operational complexity of a user computing a batch computing job through a computing environment server cluster, in a possible implementation, with respect to S401, that is, a method for computing the batch computing job through the computing environment server cluster, may include:
[0058] S501: Generate application programming interface API call requests corresponding to target cloud servers from different sources in the computing environment server cluster according to the batch computing job.
[0059] In the embodiment of the present application, the application programming interfaces (API) from the multiple sources (such as multiple different suppliers) may be pre-integrated.
[0060] It can be understood that the created computing environment server cluster may include target cloud servers from different sources, so that API call requests corresponding to target cloud servers from different sources in the computing environment server cluster can be generated accordingly according to batch computing jobs.
[0061] S502: When a target cloud server in the computing environment server cluster needs to be called, the target cloud server is called according to an API call request corresponding to the target cloud server.
[0062] Therefore, in the process of performing batch computing jobs through the computing environment server cluster, when it is necessary to call any target cloud server in the computing environment server, the target cloud server can be called according to the API call request corresponding to the target cloud server.
[0063] In this way, the complexity of multiple source APIs can be shielded for users, simplifying user operations so that users only need to focus on each task in the batch computing job.
[0064] It should be noted that the embodiment of the present application does not limit the method of determining the target cloud server from multiple source cloud servers according to the batch computing job in S202, and a suitable method can be selected to determine the target cloud server according to actual needs.
[0065] In a possible implementation, the method of determining a target cloud server from a plurality of source cloud servers according to the batch computing job in S202 may include:
[0066] S601: Determine a target cloud server from the plurality of source cloud servers according to a target condition of the batch computing job, wherein the target condition includes one or more of the number of central processing units (CPUs), the amount of memory, or the number of cloud servers.
[0067] In an embodiment of the present application, a batch computing job may correspond to a target condition, wherein the target condition may include one or more of the number of central processing units (CPUs), the amount of memory, or the number of cloud servers.
[0068] Based on this, the target server can be determined from cloud servers from multiple sources according to the target conditions of the batch computing job.
[0069] In addition, with respect to the method for determining a target cloud server from a plurality of source cloud servers according to the batch computing job in S202, in a possible implementation manner, the method further includes:
[0070] S701: Determine a target cloud server from the plurality of source cloud servers according to the batch computing job and the resource values of the cloud servers, so that the total resource value corresponding to the determined target cloud server is the lowest.
[0071] The resource value of the cloud server may be, for example, the cost that a user needs to pay when using the cloud server. In a specific implementation, the price of the corresponding cloud server may be obtained through a price query interface of each source.
[0072] In this way, a target cloud server may be determined from the plurality of source cloud servers according to the batch computing job and the resource values of the cloud servers, so that the total resource value corresponding to the determined target cloud server is the lowest.
[0073] It can be seen that when determining the target cloud server from cloud servers of multiple sources, this method can use the resource value of the cloud server as a determining factor in addition to the batch computing job, thereby reducing the cost of the user's batch computing job.
[0074] The present application also provides a batch computing job scheduling system. Figure 3 , which shows a structure diagram of a batch computing job scheduling system provided by an embodiment of the present application. Figure 3 As shown, the batch computing job scheduling system may include an API service module, a multi-cloud resource management module, a job task scheduling module, and a batch computing program (Agent) download module.
[0075] The API service module can be used to receive batch computing jobs submitted by users. The module integrates APIs corresponding to multiple different cloud server providers. In this way, it can generate API call requests corresponding to target cloud servers from different sources in the computing environment server cluster based on batch computing jobs.
[0076] The multi-cloud resource management module can be used to query multiple cloud server suppliers and private cloud servers for cloud server models and prices that meet the CPU quantity and memory quantity requirements according to the number of CPUs, memory quantity and cloud servers in the batch computing job, and calculate the cloud server combination with the lowest cost, wherein the cloud server combination with the lowest cost may include public cloud servers and private cloud servers (i.e., target cloud servers), and thereby create a computing environment server cluster, and release the cloud servers in the computing environment server cluster after completing the batch computing job.
[0077] The job task scheduling module can be used to schedule multiple computing tasks in a batch computing job to be executed on idle cloud servers in a computing environment server cluster, and record task execution results.
[0078] The batch computing agent download module can be used to provide a function of downloading a batch computing agent, wherein the batch computing agent can be a program running in a cloud server of a computing environment server cluster, for executing computing job tasks submitted by users.
[0079] The working process of the batch computing job scheduling system is introduced below.
[0080] like Figure 3 As shown, when a user needs to perform a batch computing job, the batch computing job can be submitted to the batch computing job scheduling system.
[0081] Then, after receiving the batch computing job, the API service module may store it in the database.
[0082] Next, the multi-cloud resource management module may query multiple cloud server providers for available quantities of cloud servers and corresponding costs.
[0083] Next, the multi-cloud resource management module may determine a target cloud server from one or more suppliers based on the cost of the cloud server and the target condition of the batch computing job. The target condition of the batch computing job may include one or more of the number of central processing units (CPUs), the amount of memory, or the number of cloud servers. It is understood that the target cloud server may include a public cloud server or a private cloud server.
[0084] Thus, a computing environment server cluster is created according to the determined target cloud server.
[0085] After the computing environment server cluster is created, the batch computing Agent may be downloaded from the batch computing Agent download module and installed for each target cloud server therein.
[0086] Then, the multi-cloud resource management module can save the information related to the computing environment server cluster into a database.
[0087] Next, the job task scheduling module can read the batch computing job from the database, schedule each task in the batch computing job, and allocate these tasks to the idle cloud servers of the computing environment server cluster for execution.
[0088] Finally, when the calculation of the batch computing job is completed, the multi-cloud resource management module can release the cloud server in the computing environment server cluster.
[0089] Next, the working method of the multi-cloud resource management module in the batch computing job scheduling system is introduced in detail. Figure 4 , which shows a flow chart of a working method of a multi-cloud resource management module provided in an embodiment of the present application.
[0090] like Figure 4As shown, based on the number of CPUs and memory in the batch computing job, multiple cloud server suppliers can be queried for cloud server models and corresponding price information. Then, based on the following conditions, a cloud server model that meets the condition can be selected: the condition is that the number of CPUs and memory of the cloud server model is greater than or equal to the number of CPUs and memory in the batch computing job. Next, based on the cloud server model and the corresponding price selected in the previous step, and the number of cloud servers specified in the batch computing job, the cloud server combination with the lowest cost (i.e., the target cloud server) is calculated. Next, based on the target cloud server with the lowest cost in the previous step, a computing environment server cluster is created. Thus, the batch computing job is calculated through the created computing environment server cluster. Finally, after the computing environment server cluster completes the calculation of the batch computing job, the cloud servers in the computing environment server cluster can be released.
[0091] Based on the batch computing job scheduling method provided in the above embodiment, the present application embodiment also provides a batch computing job scheduling device, see Figure 5a , which shows a schematic diagram of the structure of a batch computing job scheduling device provided in an embodiment of the present application, wherein the device includes an acquisition unit 501, a determination unit 502, and a creation unit 503:
[0092] The acquisition unit 501 is used to acquire the batch computing job to be calculated;
[0093] The determining unit 502 is used to determine a target cloud server from a plurality of source cloud servers according to the batch computing job;
[0094] The creation unit 503 is used to create a computing environment server cluster for computing the batch computing job according to the target cloud server.
[0095] Optionally, the cloud servers from multiple sources include private cloud servers.
[0096] Optionally, the determining unit 502 is specifically configured to:
[0097] Before determining the private cloud server as the target cloud server from the plurality of source cloud servers according to the batch computing job, authenticating the private cloud server;
[0098] When the private cloud server passes the authentication, the private cloud server is determined as the target cloud server.
[0099] Optional, see Figure 5b , which shows a schematic diagram of the structure of a batch computing job scheduling device provided in an embodiment of the present application, wherein the device further includes a computing unit 504, wherein the computing unit 504 is used to:
[0100] Generate application programming interface API call requests corresponding to target cloud servers from different sources in the computing environment server cluster according to the batch computing job;
[0101] When it is necessary to call a target cloud server in the computing environment server cluster, the target cloud server is called according to an API call request corresponding to the target cloud server.
[0102] Optionally, the determining unit 502 is further specifically configured to:
[0103] According to the target condition of the batch computing job, a target cloud server is determined from the cloud servers of the multiple sources, wherein the target condition includes one or more of the number of central processing units (CPUs), the amount of memory, or the number of cloud servers.
[0104] Optionally, the determining unit 502 is further specifically configured to:
[0105] According to the batch computing job and the resource value of the cloud server, a target cloud server is determined from the plurality of source cloud servers, so that the total resource value corresponding to the determined target cloud server is the lowest.
[0106] It can be seen from the above technical solution that after obtaining the batch computing job to be calculated, the target cloud server can be determined from the cloud servers of multiple sources according to the obtained batch computing job. Thus, a computing environment server cluster for computing the batch computing job is created according to the determined target cloud server. It can be seen that this method combines cloud servers of multiple sources, so that when determining the target cloud server for the batch computing job, it can ensure sufficient computing resources, thereby avoiding problems such as affecting the progress of the batch computing job caused by insufficient computing resources.
[0107] The present application embodiment also provides a device for batch computing job scheduling. The following is an introduction to the device for batch computing job scheduling in conjunction with the accompanying drawings. Figure 6 As shown, the embodiment of the present application provides a device 600 for batch computing job scheduling, and the device 600 may also be a terminal device, and the terminal device may be any intelligent terminal including a mobile phone, a tablet computer, a personal digital assistant (PDA), a point of sales (POS), a vehicle-mounted computer, etc., and the terminal device is a mobile phone as an example:
[0108] Figure 6 FIG. 1 is a block diagram showing a partial structure of a mobile phone related to a terminal device provided in an embodiment of the present application. Figure 6The mobile phone includes: a radio frequency (RF) circuit 610, a memory 620, an input unit 630, a display unit 640, a sensor 650, an audio circuit 660, a wireless fidelity (WiFi) module 670, a processor 680, and a power supply 690. Those skilled in the art will understand that Figure 6 The mobile phone structure shown in the figure does not constitute a limitation on the mobile phone, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0109] Combine the following Figure 6 A detailed introduction to the various components of the mobile phone:
[0110] The RF circuit 610 can be used for receiving and sending signals during the process of sending and receiving information or making calls. In particular, after receiving the downlink information of the base station, it is sent to the processor 680 for processing; in addition, the designed uplink data is sent to the base station. Usually, the RF circuit 610 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, referred to as LNA), a duplexer, etc. In addition, the RF circuit 610 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communication can use any communication standard or protocol, including but not limited to the Global System of Mobile communication (Global System of Mobile communication, referred to as GSM), General Packet Radio Service (General Packet Radio Service, referred to as GPRS), Code Division Multiple Access (Code Division Multiple Access, referred to as CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, referred to as WCDMA), Long Term Evolution (Long Term Evolution, referred to as LTE), email, Short Messaging Service (Short Messaging Service, referred to as SMS), etc.
[0111] The memory 620 can be used to store software programs and modules. The processor 680 executes various functional applications and data processing of the mobile phone by running the software programs and modules stored in the memory 620. The memory 620 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 620 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0112] The input unit 630 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile phone. Specifically, the input unit 630 may include a touch panel 631 and other input devices 632. The touch panel 631, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 631 or near the touch panel 631 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch panel 631 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the processor 680, and can receive and execute commands sent by the processor 680. In addition, the touch panel 631 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 631, the input unit 630 may also include other input devices 632. Specifically, the other input devices 632 may include but are not limited to one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, etc.
[0113] The display unit 640 can be used to display information input by the user or information provided to the user and various menus of the mobile phone. The display unit 640 may include a display panel 641. Optionally, the display panel 641 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch panel 631 may cover the display panel 641. When the touch panel 631 detects a touch operation on or near it, it is transmitted to the processor 680 to determine the type of touch event. Subsequently, the processor 680 provides a corresponding visual output on the display panel 641 according to the type of touch event. Although in Figure 6 In the embodiment, the touch panel 631 and the display panel 641 are used as two independent components to realize the input and output functions of the mobile phone, but in some embodiments, the touch panel 631 and the display panel 641 can be integrated to realize the input and output functions of the mobile phone.
[0114] The mobile phone may also include at least one sensor 650, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 641 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 641 and / or the backlight when the mobile phone is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the mobile phone, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.
[0115] The audio circuit 660, the speaker 661, and the microphone 662 can provide an audio interface between the user and the mobile phone. The audio circuit 760 can transmit the received audio data to the speaker 661 after converting the electrical signal, which is converted into a sound signal for output; on the other hand, the microphone 662 converts the collected sound signal into an electrical signal, which is received by the audio circuit 660 and converted into audio data, and then the audio data is output to the processor 680 for processing, and then sent to another mobile phone through the RF circuit 610, or the audio data is output to the memory 620 for further processing.
[0116] WiFi is a short-range wireless transmission technology. The mobile phone can help users send and receive emails, browse web pages and access streaming media through the WiFi module 670. It provides users with wireless broadband Internet access. Figure 6A WiFi module 670 is shown, but it is understandable that it is not an essential component of the mobile phone and can be omitted as needed without changing the essence of the invention.
[0117] The processor 680 is the control center of the mobile phone. It uses various interfaces and lines to connect various parts of the entire mobile phone. It executes various functions of the mobile phone and processes data by running or executing software programs and / or modules stored in the memory 620, and calling data stored in the memory 620. Optionally, the processor 680 may include one or more processing units; preferably, the processor 680 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 680.
[0118] The mobile phone also includes a power supply 690 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 680 through a power management system, so that the power management system can manage charging, discharging, power consumption and other functions.
[0119] Although not shown, the mobile phone may also include a camera, a Bluetooth module, etc., which will not be described in detail here.
[0120] In this embodiment, the processor 680 included in the terminal device also has the following functions:
[0121] Get the batch computing jobs to be calculated;
[0122] According to the batch computing job, determining a target cloud server from a plurality of source cloud servers;
[0123] A computing environment server cluster for computing the batch computing job is created according to the target cloud server.
[0124] The batch computing job scheduling device provided in the embodiment of the present application may be a server. Figure 7 As shown, Figure 7The structural diagram of the server 700 provided in the embodiment of the present application, the server 700 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 722 (for example, one or more processors) and a memory 732, and one or more storage media 730 (for example, one or more mass storage devices) storing application programs 742 or data 744. Among them, the memory 732 and the storage medium 730 can be temporary storage or permanent storage. The program stored in the storage medium 730 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Furthermore, the central processing unit 722 can be configured to communicate with the storage medium 730 and execute a series of instruction operations in the storage medium 730 on the server 700.
[0125] The server 700 may also include one or more power supplies 726, one or more wired or wireless network interfaces 750, one or more input and output interfaces 758, and / or one or more operating systems 741, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
[0126] The steps performed by the server in the above embodiment can be based on the Figure 7 The server structure shown.
[0127] The CPU 722 is used to execute the following steps:
[0128] Get the batch computing jobs to be calculated;
[0129] According to the batch computing job, determining a target cloud server from a plurality of source cloud servers;
[0130] A computing environment server cluster for computing the batch computing job is created according to the target cloud server.
[0131] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0132] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0133] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0134] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0135] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0136] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.
[0137] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A batch computing job scheduling method, characterized in that: The method comprises: Get the batch computing jobs to be calculated; According to the number of CPUs, memory and cloud servers of the batch computing job, multiple cloud server suppliers and private cloud servers are queried for cloud server models and prices that meet the requirements of the number of CPUs and memory, and a cloud server combination with the lowest cost is determined from cloud servers from multiple sources as the target cloud server; the cloud servers from multiple sources include cloud servers from multiple different suppliers; the cloud servers include public cloud servers and private cloud servers; the private cloud servers also include private cloud servers built by users; In the process of determining the cloud server combination with the lowest cost as the target cloud server from the cloud servers of multiple sources, if a private cloud server is determined from the cloud servers of the multiple sources, the determined private cloud server is authenticated, and after the determined private cloud server passes the authentication, the determined private cloud server is determined as the target cloud server; the target cloud server includes a public cloud server and a private cloud server; According to the target cloud server, a computing environment server cluster is created for computing the batch computing job, and a batch computing program is downloaded and installed for each target cloud server in the computing environment server cluster; The multiple computing tasks in the batch computing job are dispatched to idle cloud servers in the computing environment server cluster for execution.
2. The method according to claim 1, characterized in that The method further comprises: Generate application programming interface API call requests corresponding to target cloud servers from different sources in the computing environment server cluster according to the batch computing job; When it is necessary to call a target cloud server in the computing environment server cluster, the target cloud server is called according to an API call request corresponding to the target cloud server.
3. A batch computing job scheduling device, characterized in that: The device comprises an acquisition unit, a determination unit and a creation unit: The acquisition unit is used to acquire the batch computing job to be calculated; The determination unit is used to query multiple cloud server suppliers and private cloud servers for cloud server models and prices that meet the CPU quantity and memory quantity requirements according to the CPU quantity, memory quantity and cloud server quantity of the batch computing job, and determine the cloud server combination with the lowest cost as the target cloud server from cloud servers of multiple sources; the cloud servers of multiple sources include cloud servers of multiple different suppliers; the cloud servers include public cloud servers and private cloud servers; the private cloud servers also include private cloud servers built by users; in the process of determining the cloud server combination with the lowest cost as the target cloud server from cloud servers of multiple sources, if a private cloud server is determined from the cloud servers of multiple sources, the determined private cloud server is authenticated, and after the determined private cloud server passes the authentication, the determined private cloud server is determined as the target cloud server; the target cloud server includes public cloud servers and private cloud servers; The creation unit is used to create a computing environment server cluster for computing the batch computing job according to the target cloud server; The device is also used to download and install a batch computing program for each target cloud server in the computing environment server cluster; The multiple computing tasks in the batch computing job are dispatched to idle cloud servers in the computing environment server cluster for execution.
4. The device according to claim 3, characterized in that The device further comprises a computing unit, wherein the computing unit is configured to: Generate application programming interface API call requests corresponding to target cloud servers from different sources in the computing environment server cluster according to the batch computing job; When it is necessary to call a target cloud server in the computing environment server cluster, the target cloud server is called according to an API call request corresponding to the target cloud server.
5. A device for batch computing job scheduling, characterized in that: The device comprises a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is used to execute the batch computing job scheduling method as described in any one of claims 1-2 according to the instructions in the program code.
6. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program code, and the program code is used to enable a computer device to execute the batch computing job scheduling method as described in any one of claims 1-2.
