Data processing system, method and device, electronic equipment and storage medium
By deploying dual clusters and control centers of data processing systems in different computer rooms, automatic switching of user requests and data synchronization is achieved, efficient disaster recovery problems when cluster operation is abnormal, and maintenance costs and user impact are reduced.
Patent Information
- Application Number
- CN202410983756.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-22
- Publication Date
- 2024-11-26
AI Technical Summary
The prior art is difficult to achieve efficient disaster recovery when clusters are running abnormally, resulting in data processing abnormalities, affecting user experience, and the disaster recovery process is complex, increasing maintenance costs.
Design a data processing system to ensure that when the first host fails, the user requests to switch to the second host by deploying the first cluster and the second cluster in different computer rooms, and implementing automatic switching and data synchronization in the control center. To achieve efficient disaster recovery in dual computer rooms and reduce the impact on user experience.
It realizes rapid switching and data recovery in the event of cluster failure, reduces the complexity and maintenance costs of the disaster recovery process, improves the convenience and efficiency of disaster recovery, and reduces the impact on user experience.
Smart Images

Figure CN119025332A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of big data technology, and in particular to a data processing system, method, device, electronic device and storage medium. Background Art
[0002] In order to improve data processing efficiency, more and more companies use clusters to process various data requests. Clusters usually rely on computer rooms to improve power and network support. If the power and network of the computer room fail, the cluster will operate abnormally. In order to avoid large-scale data processing abnormalities caused by abnormal operation of the cluster, it is usually necessary to perform disaster recovery on the cluster.
[0003] Disaster recovery, also known as disaster recovery (DR), refers to a plan and practice process to ensure business continuity and data security when sudden disasters or accidents occur. Disaster recovery plans include disaster recovery design, backup, recovery, testing, and other aspects of systems, data, and business processes. Summary of the invention
[0004] In view of this, embodiments of the present invention provide a data processing system, method, device, electronic device and storage medium to achieve efficient disaster recovery for a cluster.
[0005] According to one aspect of the present invention, a data processing system is provided, the system comprising: a first cluster and a second cluster; the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, and the second cluster comprises a plurality of second hosts;
[0006] The first host is configured to, upon receiving a data request, change the target data included in the data request according to the data request; and send a change request to a second host corresponding to the first host according to the change of the target data; the change request includes the target data;
[0007] The second host is configured to change the target data according to the directory where the target data is located when receiving the change request.
[0008] In a possible embodiment, the system further includes: a control center;
[0009] The control center is used to receive a user request from a target user, wherein the user request includes information about a first target host targeted by the user request; in the event that a computer room where the first target host is located fails, determine a second target host corresponding to the first target host; and call the second target host to respond to the user request.
[0010] In a possible embodiment, the control center is configured to allocate a first target host to the target user when receiving a user request from the target user for the first time; and store a corresponding relationship between the target user and the first target host.
[0011] In a possible embodiment, the control center is used to modify the correspondence between the target user and the first target host to the correspondence between the target user and the second target host when a computer room where the first target host is located fails.
[0012] According to another aspect of the present invention, a data processing method is provided, which is applied to a control center of a data processing system, wherein the data processing system further includes a first cluster and a second cluster; the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; the method includes:
[0013] receiving a user request of a target user, wherein the user request includes information of a first target host targeted by the user request; the first target host is the first host or the second host;
[0014] In the event that the computer room where the first target host is located fails, determining a second target host corresponding to the first target host; the second target host corresponding to the first target host stores the full amount of data of the first host;
[0015] The second target host is called to respond to the user request.
[0016] In a possible embodiment, the method further includes:
[0017] When receiving a user request of the target user for the first time, allocating a first target host to the target user;
[0018] The corresponding relationship between the target user and the first target host is stored.
[0019] In a possible embodiment, the method further includes:
[0020] In the case that the computer room where the first target host is located fails, the corresponding relationship between the target user and the first target host is modified to be the corresponding relationship between the target user and the second target host.
[0021] According to another aspect of the present invention, a data processing method is provided, characterized in that it is applied to a first host in a first cluster of a data processing system; the data processing system further includes: a second cluster, the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; the method includes:
[0022] When receiving a data request, changing the target data included in the data request according to the data request;
[0023] According to the change of the target data, a change request is sent to the second host corresponding to the first host; the change request includes the target data; so that the second host corresponding to the first host changes the target data according to the directory where the target data is located.
[0024] According to another aspect of the present invention, a data processing method is provided, which is applied to a second host in a second cluster in a data processing system, wherein the data processing system further comprises: a first cluster, wherein the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, and the second cluster comprises a plurality of second hosts; the method comprises:
[0025] receiving a change request sent by the first host, wherein the change request is that the first host changes target data included in the data request according to the data request when receiving the data request; and sends the change request to the second host according to the change of the target data; the change request includes the target data;
[0026] The target data is changed according to the directory where the target data is located.
[0027] In a possible embodiment, the data processing system further includes a control center, and the method further includes:
[0028] receiving a call request sent by the control center; the call request is a user request received by the control center from a target user, wherein the user request includes information about a first target host targeted by the user request; and in the event that a computer room where the first target host is located fails, the control center determines a second target host corresponding to the first target host and sends the call request;
[0029] In response to the call request, the user request is processed.
[0030] According to another aspect of the present invention, a data processing device is provided, which is applied to a control center of a data processing system, wherein the data processing system further includes a first cluster and a second cluster; the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; the device includes:
[0031] A first receiving module is used to receive a user request of a target user, wherein the user request includes information of a first target host targeted by the user request; the first target host is the first host or the second host;
[0032] a determination module, configured to determine a second target host corresponding to the first target host in the event that a computer room where the first target host is located fails; the second target host corresponding to the first target host stores the full amount of data of the first target host;
[0033] A calling module is used to call the second target host to respond to the user request.
[0034] According to another aspect of the present invention, a data processing device is provided, which is applied to a first host in a first cluster of a data processing system; the data processing system further includes: a second cluster, the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; the device includes:
[0035] A first changing module is used to change the target data included in the data request according to the data request when receiving the data request;
[0036] A sending module is used to send a change request to a second host corresponding to the first host according to the change of the target data; the change request includes the target data; so that the second host corresponding to the first host changes the target data according to the directory where the target data is located.
[0037] According to another aspect of the present invention, a data processing device is provided, which is applied to a second host in a second cluster in a data processing system, wherein the data processing system further comprises: a first cluster, wherein the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, and the second cluster comprises a plurality of second hosts; the device comprises:
[0038] A second receiving module is used to receive a change request sent by the first host, wherein the change request is that the first host changes the target data included in the data request according to the data request when receiving the data request; and sends the change request to the second host according to the change of the target data; the change request includes the target data;
[0039] The second changing module is used to change the target data according to the directory where the target data is located.
[0040] According to another aspect of the present invention, there is provided an electronic device, comprising:
[0041] Processor; and
[0042] Memory for storing programs,
[0043] The program includes instructions, which, when executed by the processor, enable the processor to perform any of the above-mentioned data processing methods.
[0044] According to another aspect of the present invention, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable a computer to execute any of the above-mentioned data processing methods.
[0045] One or more technical solutions provided in the embodiments of the present invention specify a corresponding second host in another computer room for the first host in one computer room, and synchronize the change to the second host when the data of the first host changes. When the first cluster fails and cannot work, the user request for the first cluster can be switched to the second cluster for normal processing, thereby realizing efficient disaster recovery of the dual computer rooms and reducing the impact on the user experience. In addition, since there is no need to create a new database to store the data of the first computer room, there is no need to increase additional maintenance costs, which improves the convenience of disaster recovery. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Further details, features and advantages of the invention are disclosed in the following description of exemplary embodiments in conjunction with the accompanying drawings, in which:
[0047] Figure 1 A schematic diagram of the structure of a data processing system provided by an embodiment of the present invention;
[0048] Figure 2 A schematic diagram of a process for performing data disaster recovery in a data processing system provided by an embodiment of the present invention;
[0049] Figure 3 A schematic diagram of a processing flow of a data processing system provided by an embodiment of the present invention;
[0050] Figure 4A schematic diagram of a flow chart of a data processing method provided by an embodiment of the present invention;
[0051] Figure 5 A schematic diagram of another flow chart of a data processing method provided by an embodiment of the present invention;
[0052] Figure 6 A schematic diagram of another flow chart of a data processing method provided by an embodiment of the present invention;
[0053] Figure 7 A schematic diagram of the structure of a data processing device provided by an embodiment of the present invention;
[0054] Figure 8 A schematic diagram of another structure of a data processing device provided by an embodiment of the present invention;
[0055] Fig. 9 A schematic diagram of another structure of a data processing device provided by an embodiment of the present invention;
[0056] Fig.10 A block diagram of an exemplary electronic device that can be used to implement an embodiment of the present invention is shown. DETAILED DESCRIPTION
[0057] Embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present invention. It should be understood that the drawings and embodiments of the present invention are only for exemplary purposes and are not intended to limit the scope of protection of the present invention.
[0058] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.
[0059] The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the following description. It should be noted that the concepts of "first", "second", etc. mentioned in the present invention are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0060] It should be noted that the modifications of "one" and "plurality" mentioned in the present invention are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0061] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are only used for illustrative purposes, and are not used to limit the scope of these messages or information.
[0062] In order to achieve efficient disaster recovery, the present invention provides a data processing system, method, device, electronic device and storage medium. The scheme of the present invention is described below with reference to the accompanying drawings:
[0063] Figure 1 A structural diagram of a data processing system provided in an embodiment of the present invention, the system may include: a first cluster 110 and a second cluster 120; the first cluster 110 and the second cluster 120 are respectively deployed in different computer rooms; the first cluster 110 includes a plurality of first hosts 111, and the second cluster 120 includes a plurality of second hosts 121;
[0064] The first host 111 is used to change the target data included in the data request according to the data request when receiving the data request; send a change request to the second host 121 corresponding to the first host 111 according to the change of the target data; the change request includes the target data and the directory where the target data is located;
[0065] The second host 121 is configured to change the target data according to the directory where the target data is located when receiving the change request.
[0066] By applying the embodiment of the present invention, a corresponding second host is designated for the first host in one computer room in another computer room, and when data changes occur in the first host, the changes are synchronized to the second host. When the first cluster fails and cannot work, user requests for the first cluster can be switched to the second cluster for normal processing, thereby achieving efficient disaster recovery for the dual computer rooms and reducing the impact on user experience. In addition, since there is no need to create a new database to store the data in the first computer room, there is no need to increase additional maintenance costs, thereby improving the convenience of disaster recovery.
[0067] The first host and the second host may be any electronic device with data processing function, and the electronic device may be a computer, a server or a mobile terminal, etc.
[0068] The first cluster and the second cluster can be clusters that implement any functions. In a possible embodiment, the first cluster and the second cluster can be Jupyterhub dual clusters. Jupyterhub is a multi-user server based on JupyterNotebook (interactive notebook), which supports many users to edit and run notebooks through web browsers, and can implement simple distributed computing and collaborative work to ensure high availability and fault tolerance of the system.
[0069] The above-mentioned first cluster and second cluster are deployed in dual computer rooms. Dual computer room deployment refers to installing electronic equipment in two different locations, each of which has independent power, network, air conditioning and other infrastructure, and can operate independently. Such a design can ensure that when a single data center fails, the system can quickly switch to the backup data center to continue service. The first cluster can refer to any cluster in the dual computer room deployment cluster. This is only for distinction and no specific limitation is made. In an embodiment of the present invention, the two clusters in the dual computer room can be used as the first cluster in turn, and the above steps can be executed to achieve mutual disaster recovery of the dual computer room cluster.
[0070] The first host to be backed up can be selected according to actual needs. In a possible embodiment, all the first hosts in the first cluster can be determined as the first hosts to be backed up. In a possible embodiment, the first hosts to be backed up can be determined according to the data processing tasks performed by each first host. As a possible implementation method, the first host that performs the data processing task more than a preset number of times can be determined as the first host to be backed up. The above preset number of times can be set according to actual needs, such as 100 times, 200 times, etc., and the present invention does not specifically limit this.
[0071] The second host corresponding to the first host can also be selected according to actual needs. In one possible embodiment, a second host can be randomly selected for the first host as the second host corresponding to the first host. In another possible embodiment, numbers can be set for the first host and the second host. For example, the numbers of the first hosts can be set to 1-1, 1-2, 1-3, etc., and the numbers of the second hosts can be set to 2-1, 2-2, 2-3, etc., and the second host with the same number as the first host can be selected as the second host corresponding to the first host. Exemplarily, if the first host is numbered 1-3, the second host numbered 2-3 can be selected as the second host corresponding to the first host.
[0072] In a possible embodiment, the correspondence between the first host and the second host may be stored. The correspondence may be stored in each of the first host and the second host, or may be stored in a cluster database, which is not specifically limited in the present invention. As a possible implementation, the corresponding second host information may be stored in each first host, such as the number and location of the second host.
[0073] The first host can synchronize the on-board data to its corresponding second host in real time. In a possible embodiment, the first backup data can send a change request to its corresponding second host after receiving the data request and changing the corresponding data according to the data request. The above data request may include the target data identifier to be changed and the change type, etc. The above target data identifier may be the name, storage path, etc. of the target data, and the above change type may be addition, modification, deletion, etc. The change request sent by the first host to the second host may include the identifier of the target data to be changed and the change type, and the identifier of the target data to be changed may be the name, code, etc. of the target data, and the above change type is the change type performed by the first host on the target data, which is the same as the change type contained in the data request received by the first host. After receiving the change request, the second host can determine the target data identifier contained in the change request, determine the storage directory of the corresponding target data in the second host, and make corresponding changes to the target data according to the directory.
[0074] As a possible implementation, the two tools rsync and inotify-tools can be installed and deployed in the first host and its corresponding second host. inotify-tools is an open source tool set that provides a user space interface for the inotify mechanism in the Linux kernel, allowing users to monitor file system events, such as creating, modifying, deleting and moving files, etc. rsync is an open source tool for file transfer and synchronization, and its main function is to efficiently copy, backup and synchronize files between local or remote systems.
[0075] As a possible implementation method, inotify-tools can be used to monitor user requests, user data, and various events on each directory in the first host in real time, such as file creation, modification, deletion, and movement. When the above events are monitored, rsync is called to perform incremental synchronization of data, and synchronize the monitored events to the corresponding second host.
[0076] In a possible embodiment, the data synchronized from the first host to the corresponding second host can be stored in the same directory in the first host. Exemplarily, if data a is stored in directory A in the first host, when data a is synchronized to the second host, data a can be stored in directory A of the second host. In another possible embodiment, after the first host synchronizes the data to the second host, the second host can arbitrarily specify a directory to store the data synchronized by the first host, and the present invention does not specifically limit this.
[0077] In a possible embodiment, the first host and the second host may store data of different users in different directories. For example, the data of user A may be stored in directory a, and the data of user B may be stored in directory b. Accordingly, the data of different users synchronized from the first host to the second host are also stored in different directories of the second host.
[0078] like Figure 2 As shown, computer room A includes hosts a1, a2, and a3, and computer room B includes hosts b1, b2, and b3. During data disaster recovery, host a1 backs up to host b1, host b1 backs up to host a1, host a2 backs up to host b2, host b2 backs up to host a2, and so on.
[0079] During the backup process, taking host a1 as an example, if the directory where user c's data is stored is / home / c / , if files are created, modified, deleted, or moved in / home / c / , they will be monitored by inotify, and the changes will be synchronized to the corresponding directory of host b1 in real time. Other files that have not changed will not be synchronized, reducing the amount of data disaster recovery.
[0080] In a possible embodiment, the data processing system may further include a control center. The control center may be an external interface of the cluster, which may receive user requests and send them to the corresponding host. As a possible implementation, when the first cluster and the second cluster are Jupyterhub dual-computer room clusters, the control center may be an Nginx proxy service. The Nginx (engine x) service is a high-performance HTTP and reverse proxy web server.
[0081] The control center can receive a user request from a target user, wherein the user request is for a first target host; in the event of a failure in a computer room where the first target host is located, determine a second target host corresponding to the first target host; and call the second target host to respond to the user request.
[0082] The first target host is an execution machine for executing the user request of the target user, which can be the first host or the second host, and can be determined according to actual needs.
[0083] The failure of the computer room where the first target host is located may be due to power failure, network failure, etc. in the computer room, which makes the computer room paralyzed, making the first target host unable to perform the corresponding data processing task. In this case, the user request for the first target host can be switched to the corresponding second target host for execution.
[0084] In a possible embodiment, the user request may include a target user identifier, a request type, a target data identifier, etc. The target user identifier may be a user ID, a user device code, etc. The request type may include query, add, delete, and modify, etc. The target data identifier may be a target data code, name, etc. The control center may determine the host storing the target user based on the target user identifier. In a possible embodiment, a correspondence between a user and a first target host may be pre-stored, and the control center may determine the first target host that processes the target user request from the correspondence based on the target user identifier.
[0085] When the above-mentioned user request is directed to the first target host and the first target host fails, the control center can determine the second target host corresponding to the first target host based on the correspondence between the first host and the second host, and forward the user request of the target user to the second target host. The second target host processes the user request of the target user based on the data in the backup first target host.
[0086] In a possible embodiment, the control center may also determine whether the target user sends a user request for the first time when receiving a user request from the target user. If the target user sends a user request for the first time, a first target host may be assigned to the target user, and the correspondence between the target user and the first target host may be stored.
[0087] As a possible implementation, the target user's identifier can be queried in each first host. If the target user identifier is found, it means that the target user is not making a first request. If it is not found, it means that the target user is making a first request. As another possible implementation, the control center can store the target user identifier when receiving the user request of the target user. Therefore, if the target user identifier is found in the stored user identifiers, it means that the target user is not making a first request. If it is not found, it means that the target user is making a first request.
[0088] In the case of the target user's initial request, the control center may allocate a first host to the target user as the first target host to execute the user request of the target user. The control center may allocate the first target host to the target user according to any rule. In a possible embodiment, the control center may randomly allocate the first target host to the target user. In a possible embodiment, the control center may allocate the first target host to the target user according to the numbering sequence of the first host and the second host.
[0089] After the first target host is allocated to the target user, the corresponding relationship between the target user and the first target host may be stored in the database of the first cluster and / or the second cluster.
[0090] In a possible implementation, in the event of a failure in the computer room where the first target host is located, if the control center receives a user request for the first target host, it can determine the first target host corresponding to the target user according to the identifier of the target user who sent the user request, and determine the second target host corresponding to the target user based on the stored correspondence between the first host and the second host. Afterwards, the correspondence between the target user and the first target host can be deleted, and the correspondence between the target user and the second target host can be stored until the first target host can process the user request normally. In this way, during the failure of the first target host, the second target host that performs real-time disaster recovery for the first target host can be used to process user requests that need to be executed by the first target host, thereby ensuring the normal execution of user requests, and since there is no need to migrate the data in the first target host after the failure of the first target host, the service recovery process is short in time, reducing the impact on user experience.
[0091] Figure 3 A processing flow diagram of a data processing system provided by an embodiment of the present invention may include the following steps:
[0092] 1. User c initiates a request to the Nginx proxy service.
[0093] 2. The Nginx proxy service determines whether user c is entering for the first time. If user c is entering for the first time, execute step 3. If user c is not entering for the first time, execute step 5.
[0094] 3. Allocate an execution machine to user c.
[0095] That is, the first target host or the second target host is allocated to the user.
[0096] 4. Save the relationship between the user and the execution machine to the database.
[0097] 5. Query the database to obtain the correspondence between user c and the execution machine.
[0098] If a computer room, such as computer room B, is unavailable due to force majeure, the mapping relationship between users and execution machines in the database can be modified, and the machines in computer room B can be replaced with machines in computer room A. For example, if the original execution machine corresponding to user c is host b1, that is, user c→machine b1, it can be changed to user c→host a1.
[0099] 6. Return the execution machine data corresponding to user c to the Nginx proxy service.
[0100] 7. The Nginx proxy service forwards the request of user c to the execution machine corresponding to user c.
[0101] 8. The execution machine returns the execution result to the nginx proxy service.
[0102] 9. The Ngnix proxy service returns the execution result to user c.
[0103] In the embodiment of the present invention, in view of the related technology, Jupyterhub dual-computer room cluster deployment, when a certain computer room faces force majeure and cannot provide services, the service recovery speed is slow and user data cannot be restored in time, a targeted design architecture is carried out, and rsync and inotify-tools are used to perform real-time incremental disaster recovery for user data, which effectively improves the backup efficiency. At the same time, the data is directly backed up to the machine where the service is restored. When the service is restored, the user can directly use the data without using other means and taking a long time to restore the service. The mapping relationship between the user and the execution machine is maintained through the original database of the cluster. When restoring the service, only the mapping relationship needs to be modified, and the user logs in again, and the service can be restored.
[0104] Among them, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved in the present invention are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.
[0105] According to another aspect of the present invention, a data processing method is provided, which is applied to a control center of a data processing system, wherein the data processing system further includes a first cluster and a second cluster; the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; Figure 4 As shown, the method may include:
[0106] S401, receiving a user request of a target user, wherein the user request includes information of a first target host targeted by the user request; the first target host is the first host or the second host;
[0107] S402: When a computer room where the first target host is located fails, determine a second target host corresponding to the first target host; the second target host corresponding to the first target host stores full data of the first host;
[0108] S403: Call the second target host to respond to the user request.
[0109] In a possible embodiment, the method may further include:
[0110] When receiving a user request of the target user for the first time, allocating a first target host to the target user;
[0111] The corresponding relationship between the target user and the first target host is stored.
[0112] In a possible embodiment, the method further includes:
[0113] In the case that the computer room where the first target host is located fails, the corresponding relationship between the target user and the first target host is modified to be the corresponding relationship between the target user and the second target host.
[0114] According to another aspect of the present invention, a data processing method is provided, characterized in that it is applied to a first host in a first cluster of a data processing system; the data processing system further includes: a second cluster, the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, the second cluster includes a plurality of second hosts; Figure 5 As shown, the method may include:
[0115] S501: upon receiving a data request, changing target data included in the data request according to the data request;
[0116] S502. According to the change of the target data, a change request is sent to the second host corresponding to the first host; the change request includes the target data; so that the second host corresponding to the first host changes the target data according to the directory where the target data is located.
[0117] According to another aspect of the present invention, a data processing method is provided, which is applied to a second host in a second cluster in a data processing system, wherein the data processing system further comprises: a first cluster, wherein the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, and the second cluster comprises a plurality of second hosts; Figure 6 As shown, the method may include:
[0118] S601, receiving a change request sent by a first host, wherein the change request is that the first host changes target data included in the data request according to the data request when receiving the data request; and sends the change request to the second host according to the change of the target data; the change request includes the target data;
[0119] S602: Change the target data according to the directory where the target data is located.
[0120] In a possible embodiment, the data processing system further includes a control center, and the method further includes:
[0121] receiving a call request sent by the control center; the call request is a user request received by the control center from a target user, wherein the user request includes information about a first target host targeted by the user request; and in the event that a computer room where the first target host is located fails, the control center determines a second target host corresponding to the first target host and sends the call request;
[0122] In response to the call request, the user request is processed.
[0123] According to another aspect of the present invention, a data processing device is provided, which is applied to a control center of a data processing system, wherein the data processing system further includes a first cluster and a second cluster; the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; Figure 7 As shown, the apparatus 700 may include:
[0124] A first receiving module 701 is configured to receive a user request from a target user, wherein the user request includes information about a first target host targeted by the user request; the first target host is the first host or the second host;
[0125] The determination module 702 is used to determine a second target host corresponding to the first target host when a computer room where the first target host is located fails; the second target host corresponding to the first target host stores the full amount of data of the first target host;
[0126] The calling module 703 is used to call the second target host to respond to the user request.
[0127] According to another aspect of the present invention, a data processing device is provided, which is applied to a first host in a first cluster of a data processing system; the data processing system further includes: a second cluster, the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, the second cluster includes a plurality of second hosts; Figure 8 As shown, the apparatus 800 may include:
[0128] A first changing module 801 is used for, upon receiving a data request, changing target data included in the data request according to the data request;
[0129] The sending module 802 is used to send a change request to the second host corresponding to the first host according to the change of the target data; the change request includes the target data; so that the second host corresponding to the first host changes the target data according to the directory where the target data is located.
[0130] According to another aspect of the present invention, a data processing device is provided, which is applied to a second host in a second cluster in a data processing system, wherein the data processing system further comprises: a first cluster, wherein the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, and the second cluster comprises a plurality of second hosts; Fig. 9 As shown, the apparatus 900 may include:
[0131] The second receiving module 901 is used to receive a change request sent by the first host, wherein the change request is that the first host changes the target data included in the data request according to the data request when receiving the data request; and sends the change request to the second host according to the change of the target data; the change request includes the target data;
[0132] The second changing module 902 is used to change the target data according to the directory where the target data is located.
[0133] The exemplary embodiment of the present invention further provides an electronic device, comprising: at least one processor; and a memory connected to the at least one processor in communication. The memory stores a computer program that can be executed by the at least one processor, and the computer program is used to enable the electronic device to perform a method according to an embodiment of the present invention when executed by the at least one processor.
[0134] Exemplary embodiments of the present invention also provide a non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor of a computer, is used to cause the computer to perform a method according to an embodiment of the present invention.
[0135] An exemplary embodiment of the present invention further provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor of a computer, the computer is used to enable the computer to perform a method according to an embodiment of the present invention.
[0136] refer to Fig.10 , a block diagram of an electronic device 1000 that can be used as a server or client of the present invention will now be described, which is an example of a hardware device that can be applied to various aspects of the present invention. The electronic device is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.
[0137] like Fig.10 As shown, the electronic device 1000 includes a computing unit 1001, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1002 or a computer program loaded from a storage unit 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the electronic device 1000 can also be stored. The computing unit 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.
[0138] A plurality of components in the electronic device 1000 are connected to the I / O interface 1005, including: an input unit 1006, an output unit 1007, a storage unit 1008, and a communication unit 1009. The input unit 1006 may be any type of device capable of inputting information to the electronic device 1000, and the input unit 1006 may receive input digital or character information, and generate key signal inputs related to user settings and / or function control of the electronic device. The output unit 1007 may be any type of device capable of presenting information, and may include but is not limited to a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The storage unit 1008 may include but is not limited to a disk, an optical disk. The communication unit 1009 allows the electronic device 1000 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks, and may include but is not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a Bluetooth™ device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.
[0139] The computing unit 1001 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1001 performs the various methods and processes described above. For example, in some embodiments, the above-mentioned data processing method may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 1008. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 1000 via the ROM 1002 and / or the communication unit 1009. In some embodiments, the computing unit 1001 may be configured to perform the above-mentioned data processing method by any other appropriate means (e.g., by means of firmware).
[0140] The program code for implementing the method of the present invention can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code can be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.
[0141] In the context of the present invention, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0142] As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.
[0143] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0144] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0145] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.
Claims
1. A data processing system, characterized in that: The system includes: a first cluster and a second cluster; the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; The first host is configured to, upon receiving a data request, change the target data included in the data request according to the data request; and send a change request to a second host corresponding to the first host according to the change of the target data; the change request includes the target data; The second host is configured to change the target data according to the directory where the target data is located when receiving the change request.
2. The system according to claim 1, characterized in that The system also includes: a control center; The control center is used to receive a user request from a target user, wherein the user request includes information about a first target host targeted by the user request; in the event that a computer room where the first target host is located fails, determine a second target host corresponding to the first target host; and call the second target host to respond to the user request.
3. The system according to claim 2, characterized in that The control center is used to allocate a first target host to the target user when receiving a user request of the target user for the first time; and store the corresponding relationship between the target user and the first target host.
4. The system according to claim 3, characterized in that The control center is used to modify the corresponding relationship between the target user and the first target host to the corresponding relationship between the target user and the second target host when a computer room where the first target host is located fails.
5. A data processing method, characterized in that: A control center applied to a data processing system, wherein the data processing system further comprises a first cluster and a second cluster; the first cluster and the second cluster are respectively deployed in different computer rooms; The first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; and the method includes: receiving a user request of a target user, wherein the user request includes information of a first target host targeted by the user request; the first target host is the first host or the second host; In the event that the computer room where the first target host is located fails, determining a second target host corresponding to the first target host; the second target host corresponding to the first target host stores the full amount of data of the first host; The second target host is called to respond to the user request.
6. The method according to claim 5, characterized in that The method further comprises: When receiving a user request of the target user for the first time, allocating a first target host to the target user; The corresponding relationship between the target user and the first target host is stored.
7. The method according to claim 6, characterized in that The method further comprises: In the case that the computer room where the first target host is located fails, the corresponding relationship between the target user and the first target host is modified to be the corresponding relationship between the target user and the second target host.
8. A data processing method, characterized in that: A first host in a first cluster of a data processing system; the data processing system further comprises: a second cluster, the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, and the second cluster comprises a plurality of second hosts; the method comprises: When receiving a data request, changing the target data included in the data request according to the data request; According to the change of the target data, a change request is sent to the second host corresponding to the first host; the change request includes the target data; so that the second host corresponding to the first host changes the target data according to the directory where the target data is located.
9. A data processing method, characterized in that: The method is applied to a second host in a second cluster in a data processing system, wherein the data processing system further comprises: a first cluster, wherein the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, and the second cluster comprises a plurality of second hosts; and the method comprises: receiving a change request sent by the first host, wherein the change request is that the first host changes target data included in the data request according to the data request when receiving the data request; and sends the change request to the second host according to the change of the target data; the change request includes the target data; The target data is changed according to the directory where the target data is located.
10. The method according to claim 9, characterized in that The data processing system further includes a control center, and the method further includes: receiving a call request sent by the control center; the call request is a user request received by the control center from a target user, wherein the user request includes information about a first target host targeted by the user request; and in the event that a computer room where the first target host is located fails, the control center determines a second target host corresponding to the first target host and sends the call request; In response to the call request, the user request is processed.
11. A data processing device, characterized in that: A control center applied to a data processing system, wherein the data processing system further comprises a first cluster and a second cluster; the first cluster and the second cluster are respectively deployed in different computer rooms; The first cluster includes a plurality of first hosts, and the second cluster includes a plurality of second hosts; and the device includes: A first receiving module is used to receive a user request of a target user, wherein the user request includes information of a first target host targeted by the user request; the first target host is the first host or the second host; a determination module, configured to determine a second target host corresponding to the first target host in the event that a computer room where the first target host is located fails; the second target host corresponding to the first target host stores the full amount of data of the first target host; A calling module is used to call the second target host to respond to the user request.
12. A data processing device, characterized in that: A first host in a first cluster of a data processing system; the data processing system further comprises: a second cluster, the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, the second cluster comprises a plurality of second hosts; the device comprises: A first changing module is used to change the target data included in the data request according to the data request when receiving the data request; A sending module is used to send a change request to a second host corresponding to the first host according to the change of the target data; the change request includes the target data; so that the second host corresponding to the first host changes the target data according to the directory where the target data is located.
13. A data processing device, characterized in that: The device is applied to a second host in a second cluster in a data processing system, wherein the data processing system further comprises: a first cluster, wherein the first cluster and the second cluster are respectively deployed in different computer rooms; the first cluster comprises a plurality of first hosts, and the second cluster comprises a plurality of second hosts; and the device comprises: A second receiving module is used to receive a change request sent by the first host, wherein the change request is that the first host changes the target data included in the data request according to the data request when receiving the data request; and sends the change request to the second host according to the change of the target data; the change request includes the target data; The second changing module is used to change the target data according to the directory where the target data is located.
14. An electronic device comprising: processor; as well as Memory for storing programs, The program comprises instructions which, when executed by the processor, cause the processor to perform the method according to any one of claims 5-7 or 8 or 9-10.
15. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to make a computer execute the method according to any one of claims 5-7 or 8 or 9-10.
