Method for accelerating creation of computing power operation task area meta-information by intelligent computing center

Abstract

The invention provides a method for accelerating creation of computing power operation task area meta-information by an intelligent computing center, which comprises the following steps of: S1, configuring a first thread which is used for monitoring the creation progress of at least one second thread for currently operating a creation area meta-information task, the first thread is also used for quitting under the condition that all the second threads are monitored to complete the region meta-information creating task; and S2, responding to exit of the first thread, controlling a plurality of working threads to call computing power resources of an intelligent computing center, and running a data recovery task corresponding to the region meta-information created by the second thread in parallel. According to the invention, the rate of creating the region meta-information is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent computing centers, smart computing centers and computing power infrastructure, and in particular to a method for accelerating the creation of metadata of computing power operation task areas in an intelligent computing center. Background Art

[0002] With the rapid development of artificial intelligence technology, "intelligent computing centers" and "intelligent computing centers" have emerged.

[0003] An "Intelligent Computing Center" is a facility that uses large-scale heterogeneous computing resources, including general-purpose and intelligent computing power, to provide the computing power, data, and algorithms required for AI applications (such as AI deep learning model development, model training, and model inference). The Intelligent Computing Center encompasses facilities, hardware, and software, and provides a full stack of capabilities, from bottom-level computing power to top-level application enablement.

[0004] “Intelligent Computing Center” includes but is not limited to “Smart Computing Center”.

[0005] "Intelligent Computing Center" refers to an artificial intelligence computing center. It is a type of computing power infrastructure that is based on artificial intelligence theory, adopts artificial intelligence computing architecture, and provides computing power services, data services, and algorithm services required for artificial intelligence applications.

[0006] "Computing power" is the core of "intelligent computing center" and "intelligent computing center". It is the ability of computer equipment or computing / data center to process information. It is the ability of computer hardware and software to work together to perform certain computing needs. It is the computing power to achieve target result output by processing information data. It is a new type of productivity that integrates information computing power, network carrying capacity, and data storage capacity. It mainly provides services to society through computing power infrastructure.

[0007] Since the emergence of intelligent computing centers, the slow creation of metadata for computing power task zones has been a challenge. The existing method for creating zone metadata relies on multiple threads creating it individually and then waiting for it to complete. This asynchronous approach results in a slow creation rate. Summary of the Invention

[0008] This invention provides a method for accelerating the creation of metadata for computing power execution task regions in an intelligent computing center. This method addresses the slow creation of metadata for computing power execution task regions, a problem that has plagued the development of intelligent computing centers. Existing methods for creating regional metadata rely on multiple threads creating metadata independently and waiting for completion, resulting in asynchronous threads and a low creation rate.

[0009] In order to solve the above-mentioned technical problems, the present invention is achieved as follows:

[0010] In a first aspect, the present invention provides a method for accelerating the creation of metadata of a computing power operation task area in an intelligent computing center, comprising:

[0011] Step S1: configuring a first thread, wherein the first thread is configured to monitor the creation progress of at least one second thread currently running a task of creating regional metadata, and the first thread is further configured to exit when monitoring that all the second threads have completed the task of creating regional metadata;

[0012] Step S2: In response to the exit of the first thread, control multiple working threads to call computing resources of the intelligent computing center and run data recovery tasks corresponding to the regional metadata created by the second thread in parallel.

[0013] Optionally, the data recovery task includes a full database recovery task of the Dingo Store system;

[0014] The task of creating regional metadata includes:

[0015] According to the create zone meta information instruction sent by the coordinator node in the Dingo Store system, create a zone meta information definition.

[0016] Optionally, the multiple worker threads are created by the main thread;

[0017] During the parallel execution of the data recovery task, each of the worker threads executes at least one computing power execution subtask of the data recovery task;

[0018] The step S2 includes:

[0019] Step S21: During the parallel execution of the data recovery task, the main thread is instructed to monitor the fault mark of each of the worker threads; if a fault mark is detected in any of the worker threads, the main thread is controlled to exit, and the worker threads are controlled to exit the execution of the computing power operation subtask; if a fault mark is not detected in any of the worker threads, the main thread is instructed to control the multiple worker threads to exit the execution of the computing power operation subtask after all the computing power operation subtasks are completed.

[0020] Optionally, the step S21 includes:

[0021] Step S211: determining whether the monitoring time for the main thread to monitor the fault flag of each worker thread exceeds a preset monitoring time threshold;

[0022] Step S212: If no fault mark of the working thread is detected after the monitoring time threshold is exceeded, and the computing power running subtask in the working thread has not been fully executed, control the main thread to exit, and control the working thread to exit executing the computing power running subtask.

[0023] In a second aspect, the present invention provides a device for accelerating the creation of metadata of a computing power operation task area in an intelligent computing center, comprising:

[0024] a configuration module, configured to configure a first thread, the first thread being configured to monitor the creation progress of at least one second thread currently running a task of creating regional metadata, the first thread being further configured to exit upon monitoring that all of the second threads have completed the task of creating regional metadata;

[0025] An execution module is used to control multiple working threads to call computing resources of an intelligent computing center in response to the exit of the first thread, and to run data recovery tasks corresponding to the regional metadata created by the second thread in parallel.

[0026] Optionally, the multiple worker threads are created by the main thread;

[0027] During the parallel execution of the data recovery task, each of the worker threads executes at least one computing power execution subtask of the data recovery task;

[0028] The execution module is also used to instruct the main thread to monitor the fault mark of each of the working threads during the parallel execution of the data recovery task; if a fault mark is detected in any of the working threads, the main thread is controlled to exit, and the working threads are controlled to exit the execution of the computing power operation subtask; if a fault mark is not detected in any of the working threads, the main thread is controlled to control the multiple working threads to exit the execution of the computing power operation subtask after all the computing power operation subtasks are completed.

[0029] Optionally, the execution module is further configured to determine whether a monitoring time duration for the main thread to monitor the fault flag of each worker thread exceeds a preset monitoring time duration threshold;

[0030] The execution module is also used to control the main thread to exit and control the worker thread to exit executing the computing power running subtask if no fault mark of the worker thread is detected after exceeding the monitoring time threshold, and the computing power running subtask in the worker thread is not fully executed.

[0031] In a third aspect, the present invention provides an electronic device comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor. When the program or instruction is executed by the processor, the steps in the method for accelerating the creation of computing power operation task area metadata in an intelligent computing center as described in any one of the first aspects are implemented.

[0032] In a fourth aspect, the present invention provides a readable storage medium storing a program or instruction. When the program or instruction is executed by a processor, the steps in the method for accelerating the creation of computing power operation task area metadata of an intelligent computing center as described in any one of the first aspects are implemented.

[0033] In a fifth aspect, the present invention provides a computer program product comprising computer instructions, which, when executed by a processor, implement the steps of the method for accelerating the creation of computing power operation task area metadata in an intelligent computing center as described in any one of the first aspects.

[0034] In the present invention, through step S1: configuring a first thread, the first thread is used to monitor the creation progress of at least one second thread currently running the task of creating regional metadata, and the first thread is also used to exit when it is monitored that all second threads have completed the task of creating regional metadata; step S2: in response to the exit of the first thread, controlling multiple working threads to call the computing resources of the intelligent computing center, and running the data recovery task corresponding to the regional metadata created by the second threads in parallel. The present invention changes the existing asynchronous thread in which each thread waits separately for the creation of the region to be created into a synchronous thread in which the first thread is set to trigger the working thread to run the data recovery task in parallel when it is monitored that all second threads have completed the task of creating regional metadata, thereby improving the rate of creating regional metadata. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the preferred embodiment below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the present invention. The same reference symbols are used throughout the drawings to represent the same components. In the drawings:

[0036] Figure 1 This is a diagram of the process of creating a region in the Dingo Store system;

[0037] Figure 2 Schematic diagram for creating region meta information for existing multithreading;

[0038] Figure 3 A flow chart of a method for accelerating the creation of metadata of computing power operation task areas in an intelligent computing center according to the present invention;

[0039] Figure 4 Schematic diagram of the principle of accelerating the creation of regions;

[0040] Figure 5 This is a structural diagram of the thread pool;

[0041] Figure 6 A block diagram of the principle of the device for accelerating the creation of metadata of computing power operation task areas in the intelligent computing center of the present invention;

[0042] Figure 7 This is a principle block diagram of the electronic device of the present invention. DETAILED DESCRIPTION

[0043] The following will clearly and completely describe the technical solutions of the present invention in conjunction with the accompanying drawings. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.

[0044] The terms "first", "second", etc. in the present invention are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable under appropriate circumstances, so that the present invention can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are generally of the same type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "or" in the present invention represents at least one of the connected objects. For example, "A or B" covers three options, namely, option one: including A but not including B; option two: including B but not including A; option three: including both A and B. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0045] In addition, the technical features involved in the different embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0046] First, the technical terms involved in the present invention are briefly explained below.

[0047] The "computing power" mentioned in the present invention refers to: the ability of computer equipment or computing / data centers to process information, the ability of computer hardware and software to work together to execute certain computing requirements, and the computing power to achieve target result output by processing information data. It is a new type of productivity that integrates information computing power, network carrying capacity, and data storage capacity, and mainly provides services to society through computing power infrastructure.

[0048] The "computing power" (CP) mentioned in the present invention refers to: the ability of a data center server to process data and output results. It is a comprehensive indicator to measure the computing power of a data center, including general computing power, supercomputing power and intelligent computing power. The commonly used unit of measurement is the number of floating-point operations performed per second (FLOPS, 1EFLOPS=10^18FLOPS). The larger the value, the stronger the comprehensive computing power. According to calculations, 1EFLOPS is approximately the computing power output of 5 Tianhe-2A or 500,000 mainstream server CPUs or 2 million mainstream laptops. The calculation formula is: CP=CP general + CP intelligent + CP super.

[0049] The "carrying capacity" (Network Power, NP) mentioned in the present invention refers to: it is the performance of the data transmission capability of the computing power facility, which includes comprehensive capabilities such as network architecture, network bandwidth, transmission latency, intelligent management and scheduling, etc. It involves network transmission within and between data centers, and is a comprehensive indicator for measuring network transmission scheduling capabilities.

[0050] The "Storage Power" (SP) described in this invention refers to the comprehensive capabilities of a data center in terms of data storage capacity, performance, security and reliability, and environmental friendliness. It is a comprehensive indicator for measuring a data center's data storage capacity, encompassing both external storage devices such as storage arrays and server-internal storage. Storage capacity is commonly measured in exabytes (EB, 1EB = 2^60 bytes), while performance is commonly measured in IOPS / TB (Input / Output Operations Per Second / TB). Disaster recovery ratio is a key indicator of security and reliability.

[0051] The "computing power infrastructure" mentioned in the present invention refers to a new type of information infrastructure that integrates information computing power, network carrying capacity, and data storage capacity, and can realize the centralized calculation, storage, transmission and application of information.

[0052] The "new information infrastructure" mentioned in the present invention refers to: mainly including network infrastructure such as 5G networks, fiber-optic broadband networks, backbone networks, international communication networks, satellite Internet, computing power infrastructure such as data centers, general computing power centers, intelligent computing centers, supercomputing centers, and new technology facilities such as artificial intelligence, blockchain, and quantum computing.

[0053] The "computing power" mentioned in the present invention includes: general computing power, intelligent computing power and super computing power.

[0054] The "general computing power" mentioned in the present invention refers to the computing power provided by servers based on CPU (Central Processing Unit) chips, which is used to support basic general computing such as cloud computing and edge computing.

[0055] The "intelligent computing power" mentioned in this invention refers to: a computing platform based on specialized chips such as GPU (Graphics Processing Unit), FPGA (Field Programmable Gate Array), and ASIC (Application Specific Integrated Circuit) for various innovative artificial intelligence applications, such as natural language processing and machine vision.

[0056] The "supercomputing power" mentioned in the present invention refers to the computing power provided by high-performance computing clusters such as supercomputers. It utilizes the centralized computing resources of multiple computer systems working in parallel and uses a dedicated operating system to handle extremely complex or data-intensive problems. It is mainly used for calculations in cutting-edge scientific fields, such as planetary simulation, drug molecule design, genetic analysis, etc.

[0057] The "intelligent computing center" described in this article refers to a facility that provides the computing power, data, and algorithms required for artificial intelligence applications (such as AI deep learning model development, model training, and model inference) by utilizing large-scale heterogeneous computing resources, including general-purpose computing power (CPU) and intelligent computing power (GPU, FPGA, ASIC, etc.). The intelligent computing center encompasses facilities, hardware, and software, and can provide a full stack of capabilities, from bottom-level computing power to top-level application enablement.

[0058] The "intelligent computing center" mentioned in the present invention includes but is not limited to the "intelligent computing center".

[0059] The "intelligent computing center" mentioned in the present invention is an artificial intelligence computing center, which is a type of computing power infrastructure based on artificial intelligence theory, adopts artificial intelligence computing architecture, and provides computing power services, data services and algorithm services required for artificial intelligence applications.

[0060] The "computing power center" mentioned in the present invention refers to: a facility that is mainly composed of infrastructure such as wind, fire, water, electricity, and IT hardware and software equipment, and has computing power, transportation capacity, and storage capacity, including general data centers, intelligent computing centers, supercomputing centers, etc.

[0061] The "supercomputing center" mentioned in the present invention refers to: a supercomputing data center, which is a data center based on a supercomputer or a large-scale computing cluster, which can provide large-scale computing, storage and network services and other functions, and is widely used in application scenarios such as aerospace, national defense, oil exploration, climate modeling and genome sequencing.

[0062] The "computing resources" mentioned in the present invention refer to: technologies and facilities with information computing, transmission, storage and application capabilities required for the development of a digital society, including but not limited to computing resources such as CPUs and GPUs, network resources such as switches and routers, storage resources such as storage arrays and distributed storage, security resources such as firewalls and intrusion detection systems, and supporting and guarantee resources such as wind, fire, water and electricity.

[0063] The "computing power operation task" mentioned in the present invention refers to: a specific workload or job executed on computing power resources that requires a certain amount of computing power support, usually involving complex data processing, numerical calculations, model training or simulation scenarios.

[0064] The "Dingo Store" mentioned in the present invention refers to: an open source distributed key-value storage system that aims to provide high-performance, high-availability and scalable storage solutions, and is generally used in scenarios that require fast data access and high concurrency processing.

[0065] The "area" mentioned in the present invention is the smallest unit of Dingo Store scheduling and storage.

[0066] The data recovery task in the present invention can be specifically a full database recovery task in the Dingo Store system. The full database recovery task is used for empty databases and needs to recover data as quickly as possible. Using multiple threads to run the full database recovery task in parallel can significantly improve the efficiency of data recovery.

[0067] Specifically, the full database recovery task may include: restoring data of a specified region to the store / index / document node of Dingo Store.

[0068] The Dingo Store system includes dingodb_br nodes, coordinator nodes (i.e., coordinator nodes), store nodes, index nodes, and document nodes.

[0069] Taking the Dingo Store system as an example, regional metadata is also called region. Figure 1 As shown, Figure 1The following is a diagram of the region creation process in the DingoStore system. After the coordinator node in Dingo Store receives the region creation instruction ("CreateRegionRequest") sent by the dingodb_br node, it returns the region creation completion result ("CreateRegionResponse") to the dingodb_br node. However, the region creation is not actually completed at this time. Afterwards, the coordinator node sends the real region creation instruction ("RealCreateRegionRequest") to the store node, index node, and document node respectively. After each node in the store node, index node, and document node completes the region creation, the coordinator node receives the real region creation completion result ("RealCreateRegionResponse") returned by the corresponding node. Until the coordinator node receives all the real region creation completion results ("RealCreateRegionResponse"), it means that all the required regions to be created have been created.

[0070] During the region creation process for store nodes, index nodes, and document nodes, multiple threads are used to create regions in order to quickly restore data. Figure 2 As shown, Figure 2 A schematic diagram of existing multi-threaded region metadata creation, where threads 1-4 independently create regions, wait for the regions to be created, and then independently send region creation instructions to the corresponding node (e.g., coordinator node), resulting in a low creation rate.

[0071] The present invention provides a method for accelerating the creation of metadata of computing power operation task area in intelligent computing center, see Figure 3 As shown, Figure 3 This is a flow chart of a method for accelerating the creation of metadata about a computing power operation task area by an intelligent computing center according to the present invention. The method for accelerating the creation of metadata about a computing power operation task area by an intelligent computing center includes:

[0072] Step S1: configuring a first thread, the first thread being used to monitor the creation progress of at least one second thread currently running a task of creating regional metadata, and the first thread being used to exit when monitoring that all second threads have completed the task of creating regional metadata;

[0073] Step S2: In response to the exit of the first thread, control multiple working threads to call computing resources of the intelligent computing center and run the data recovery tasks corresponding to the regional metadata created by the second thread in parallel.

[0074] Taking the Dingo Store system as an example, regional metadata is also called region. Figure 4 As shown in the figure, the principle diagram of accelerating region creation is shown. Threads 1-4 are all second threads, and threads 1-4 run the task of creating regions respectively. Thread 5 is the first thread, which monitors the creation progress of threads 1-4. After monitoring that threads 1-4 have completed region creation, thread 5 exits and triggers multiple worker threads to call the computing power resources of the intelligent computing center to run the data recovery task corresponding to the region metadata created by the second thread in parallel. In other words, compared with Figure 1 Compared with the prior art shown in the figure, the present invention changes the asynchronous thread in which each thread waits separately for the completion of the creation of the region to be created into a synchronous thread in which the first thread triggers the working thread to run the data recovery task in parallel when monitoring that all the second threads have completed the task of creating the region metadata, thereby improving the rate of creating the region metadata.

[0075] In the present invention, through step S1: configuring a first thread, the first thread is used to monitor the creation progress of at least one second thread currently running the task of creating regional metadata, and the first thread is also used to exit when it is monitored that all second threads have completed the task of creating regional metadata; step S2: in response to the exit of the first thread, controlling multiple working threads to call the computing resources of the intelligent computing center, and running the data recovery task corresponding to the regional metadata created by the second threads in parallel. The present invention changes the existing asynchronous thread in which each thread waits separately for the creation of the region to be created into a synchronous thread in which the first thread is set to trigger the working thread to run the data recovery task in parallel when it is monitored that all second threads have completed the task of creating regional metadata, thereby improving the rate of creating regional metadata.

[0076] In some embodiments of the present invention, optionally, see Figure 1 and Figure 3 As shown, the data recovery task includes the full database recovery task of the Dingo Store system;

[0077] The task of creating regional metadata includes:

[0078] According to the create zone meta information instruction sent by the coordinator node in the Dingo Store system, create a zone meta information definition.

[0079] In the present invention, according to the create zone meta information instruction sent by the coordinator node in the Dingo Store system, the zone meta information definition is created, see Figure 1 As shown, the coordinator node sends a real create region instruction ("RealCreateRegionRequest") to the store node, index node, and document node respectively.

[0080] In some embodiments of the present invention, optionally, the multiple worker threads are created by a main thread;

[0081] During the parallel execution of the data recovery task, each of the worker threads executes at least one computing power execution subtask of the data recovery task;

[0082] The step S2 includes:

[0083] Step S21: During the parallel execution of the data recovery task, the main thread is instructed to monitor the fault mark of each of the worker threads; if a fault mark is detected in any of the worker threads, the main thread is controlled to exit, and the worker threads are controlled to exit the execution of the computing power operation subtask; if a fault mark is not detected in any of the worker threads, the main thread is instructed to control the multiple worker threads to exit the execution of the computing power operation subtask after all the computing power operation subtasks are completed.

[0084] See also Figure 5 As shown, the main thread is responsible for starting and managing the execution of worker threads, including assigning tasks, scheduling the execution order of tasks, and monitoring the status of tasks. In multi-threaded parallel computing, the main thread also needs to coordinate data sharing and communication between different worker threads to ensure data consistency and correctness. The main thread is also responsible for capturing and processing faults or exceptions that occur in worker threads to ensure system stability. The worker thread executes the specific computing tasks assigned to it, including but not limited to data recovery and data backup. By having multiple worker threads execute tasks in parallel, computing efficiency can be significantly improved and task completion time can be shortened. During the execution of tasks, the worker thread can also capture and report faults or exceptions so that the main thread can perform corresponding processing. After completing the task, the worker thread usually returns the calculation results to the main thread or stores them in a shared data structure for subsequent processing or aggregation, thereby optimizing resource utilization and execution efficiency.

[0085] In the present invention, the fault mark helps the main thread to promptly discover abnormal or error conditions in the working thread, prevent the expansion of potential problems, ensure the stability of the system, and improve the reliability of the overall system. The main thread can decide whether to perform error handling or take other measures by checking the fault mark without having to deeply analyze the status of each thread, making the code clearer and easier to maintain, quickly responding to faults and providing feedback, and more effectively utilizing computing resources to avoid idle or wasted resources due to faults.

[0086] In some embodiments of the present invention, optionally, step S21 includes:

[0087] Step S211: determining whether the monitoring time for the main thread to monitor the fault flag of each worker thread exceeds a preset monitoring time threshold;

[0088] Step S212: If no fault mark of the working thread is detected after the monitoring time threshold is exceeded, and the computing power running subtask in the working thread has not been fully executed, control the main thread to exit, and control the working thread to exit executing the computing power running subtask.

[0089] In the present invention, the monitoring duration threshold can be set by the user according to his / her actual needs, and the present invention does not impose any limitation on this.

[0090] In the present invention, by setting the listening time, it is possible to ensure that the main thread exits within a reasonable time, thereby releasing resources, avoiding the system from losing response due to long waiting times, and improving the overall availability of the system. After the timeout, the monitoring and alarm mechanism can also be triggered to promptly notify the operation and maintenance personnel to deal with potential problems, ensuring that the system can continue to process other tasks and avoiding the overall performance being affected by the delay of a certain thread.

[0091] The present invention provides a device for accelerating the creation of metadata of computing power operation task area in intelligent computing center, see Figure 6 As shown, Figure 6 This is a block diagram of the principle of the device for accelerating the creation of metadata of a computing power operation task area in an intelligent computing center according to the present invention. The device 60 for accelerating the creation of metadata of a computing power operation task area in an intelligent computing center includes:

[0092] Configuration module 61, configured to configure a first thread, the first thread being configured to monitor the creation progress of at least one second thread currently executing a task of creating regional metadata, the first thread being further configured to exit upon monitoring that all second threads have completed the task of creating regional metadata;

[0093] The execution module 62 is used to control multiple working threads to call the computing resources of the intelligent computing center in response to the exit of the first thread, and run the data recovery task corresponding to the regional metadata created by the second thread in parallel.

[0094] In some embodiments of the present invention, optionally,

[0095] The data recovery task includes the full database recovery task of the Dingo Store system;

[0096] The task of creating regional metadata includes:

[0097] According to the create zone meta information instruction sent by the coordinator node in the Dingo Store system, create a zone meta information definition.

[0098] In some embodiments of the present invention, optionally, the multiple worker threads are created by a main thread;

[0099] During the parallel execution of the data recovery task, each of the worker threads executes at least one computing power execution subtask of the data recovery task;

[0100] The execution module 62 is also used to instruct the main thread to monitor the fault mark of each of the working threads during the parallel execution of the data recovery task; if a fault mark is detected in any of the working threads, the main thread is controlled to exit, and the working threads are controlled to exit the execution of the computing power operation subtask; if a fault mark is not detected in any of the working threads, the main thread is controlled to control the multiple working threads to exit the execution of the computing power operation subtask after all the computing power operation subtasks are completed.

[0101] In some embodiments of the present invention, optionally,

[0102] The execution module 62 is further configured to determine whether a monitoring time duration of the main thread monitoring the fault flag of each worker thread exceeds a preset monitoring time duration threshold;

[0103] The execution module 62 is also used to control the main thread to exit and control the working thread to exit executing the computing power running subtask if no fault mark of the working thread is detected after exceeding the monitoring time threshold, and the computing power running subtask in the working thread has not been fully executed.

[0104] The device provided by the present invention for accelerating the creation of computing power operation task area metadata in the intelligent computing center can achieve Figures 1 to 5 The various processes implemented by the method embodiment achieve the same technical effect and are not described here again to avoid repetition.

[0105] The present invention provides an electronic device 70, see Figure 7 As shown, Figure 7 This is a principle block diagram of the electronic device 70 of the present invention, including a processor 71, a memory 72, and a program or instruction stored in the memory 72 and executable on the processor 71. When the program or instruction is executed by the processor, any step in the method of accelerating the creation of computing power operation task area metadata in an intelligent computing center of the present invention is implemented.

[0106] The present invention provides a readable storage medium, which stores programs or instructions. When the programs or instructions are executed by a processor, the various processes of the embodiments of the method for accelerating the creation of computing power operation task area metadata in an intelligent computing center as described above are implemented, and the same technical effects can be achieved. To avoid repetition, they will not be described here.

[0107] The readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk. In some examples, the readable storage medium may be a non-transitory readable storage medium.

[0108] The present invention also provides a computer program product, including computer instructions, which, when executed by a processor, implement the various processes of any of the above-mentioned methods for accelerating the creation of computing power operation task area metadata in an intelligent computing center, and can achieve the same technical effect. To avoid repetition, they will not be described here.

[0109] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0110] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0111] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are protected by the present invention.

Claims

1. A method for accelerating the creation of metadata of computing power operation task areas in an intelligent computing center, characterized in that: include: Step S1: configuring a first thread, wherein the first thread is configured to monitor the creation progress of at least one second thread currently running a task of creating regional metadata, and the first thread is further configured to exit when monitoring that all the second threads have completed the task of creating regional metadata; Step S2: In response to the exit of the first thread, control multiple working threads to call computing resources of the intelligent computing center and run data recovery tasks corresponding to the regional metadata created by the second thread in parallel.

2. The method for accelerating the creation of computing power operation task area metadata in an intelligent computing center according to claim 1, characterized in that: The data recovery task includes the full database recovery task of the Dingo Store system; The task of creating regional metadata includes: According to the create zone meta information instruction sent by the coordinator node in the Dingo Store system, create a zone meta information definition.

3. The method for accelerating the creation of computing power operation task area metadata in an intelligent computing center according to claim 1, characterized in that: The multiple worker threads are created by the main thread; During the parallel execution of the data recovery task, each of the worker threads executes at least one computing power execution subtask of the data recovery task; The step S2 includes: Step S21: During the parallel execution of the data recovery task, the main thread is instructed to monitor the fault mark of each of the worker threads; if a fault mark is detected in any of the worker threads, the main thread is controlled to exit, and the worker threads are controlled to exit the execution of the computing power operation subtask; if a fault mark is not detected in any of the worker threads, the main thread is instructed to control the multiple worker threads to exit the execution of the computing power operation subtask after all the computing power operation subtasks are completed.

4. The method for accelerating the creation of computing power operation task area metadata in an intelligent computing center according to claim 3, characterized in that: The step S21 includes: Step S211: determining whether the monitoring time for the main thread to monitor the fault flag of each worker thread exceeds a preset monitoring time threshold; Step S212: If no fault mark of the working thread is detected after the monitoring time threshold is exceeded, and the computing power running subtask in the working thread has not been fully executed, control the main thread to exit, and control the working thread to exit executing the computing power running subtask.

5. A device for accelerating the creation of metadata of computing power operation task areas in an intelligent computing center, characterized in that: include: a configuration module, configured to configure a first thread, the first thread being configured to monitor the creation progress of at least one second thread currently running a task of creating regional metadata, the first thread being further configured to exit upon monitoring that all of the second threads have completed the task of creating regional metadata; An execution module is used to control multiple working threads to call computing resources of an intelligent computing center in response to the exit of the first thread, and to run data recovery tasks corresponding to the regional metadata created by the second thread in parallel.

6. The device for accelerating the creation of computing power operation task area metadata in an intelligent computing center according to claim 5, characterized in that: The multiple worker threads are created by the main thread; During the parallel execution of the data recovery task, each of the worker threads executes at least one computing power execution subtask of the data recovery task; The execution module is further configured to instruct the main thread to monitor the fault mark of each of the worker threads during the parallel execution of the data recovery task; if a fault mark is detected in any of the worker threads, the main thread is controlled to exit, and the worker threads are controlled to exit the execution of the computing power operation subtask; If no fault mark is detected in any of the worker threads, after waiting for all computing power running subtasks to be executed, the main thread is instructed to control the multiple worker threads to exit the execution of the computing power running subtasks.

7. The device for accelerating the creation of computing power operation task area metadata in an intelligent computing center according to claim 6, characterized in that: The execution module is further configured to determine whether a monitoring time duration for the main thread to monitor the fault flag of each worker thread exceeds a preset monitoring time duration threshold; The execution module is also used to control the main thread to exit and control the worker thread to exit executing the computing power running subtask if no fault mark of the worker thread is detected after exceeding the monitoring time threshold, and the computing power running subtask in the worker thread is not fully executed.

8. An electronic device, characterized in that: It includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor. When the program or instruction is executed by the processor, the steps in the method for accelerating the creation of computing power operation task area metadata in an intelligent computing center as described in any one of claims 1 to 4 are implemented.

9. A readable storage medium, characterized in that: The readable storage medium stores programs or instructions, which, when executed by a processor, implement the steps in the method for accelerating the creation of computing power operation task area metadata in an intelligent computing center as described in any one of claims 1 to 4.

10. A computer program product, characterized in that The method comprises computer instructions, which, when executed by a processor, implement the steps of the method for accelerating the creation of computing power operation task area metadata of an intelligent computing center as described in any one of claims 1 to 4.

Images