A data request processing method, a quasi-state data storage system, a medium and a product
By storing data identifier mapping relationships separately in each meta-service within a simulated data storage system and using a distribution arbitrator to identify external attacks, the problem that traditional network defense methods cannot cope with complex network attacks is solved, thus improving the security defense capabilities of the data storage system.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- PURPLE MOUNTAIN LAB
- Filing Date
- 2026-03-03
- Publication Date
- 2026-06-02
AI Technical Summary
Traditional network defense methods are unable to effectively deal with increasingly complex network attacks, leading to an increase in business interruptions and data loss.
In the mimicry data storage system, data identifier mapping relationships are stored in each meta-service. Security isolation between meta-services is achieved through a distribution arbitrator. External attacks are identified based on the request arbitration results of request-response messages, ensuring the correctness of the request-response message content.
It achieves secure isolation between meta services, prevents the spread of external attacks, ensures the security defense capabilities of the data storage system, and improves the security defense capabilities of the data storage system.
Smart Images

Figure CN122137616A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data security technology, and in particular to a data request processing method, a mimicry data storage system, a medium, and a product. Background Technology
[0002] With the development of internet technology, network applications have penetrated into many aspects of people's daily lives. While bringing convenience, these applications have also brought certain security risks. To improve the security of network applications, traditional network security prioritizes internal network security, passively isolating external network threats and preventing attacks through firewalls, information encryption, and access control. However, with the technological advancements and diversification of network attacks, traditional network defense methods are no longer effective in dealing with increasingly complex attacks, leading to a rise in business interruptions and data loss caused by network attacks. Therefore, there is an urgent need to develop a data storage system that can enhance defense capabilities against network attacks. Summary of the Invention
[0003] This application provides a data request processing method, a mimicry data storage system, a medium, and a product, which stores data identifier mapping relationships in each meta-service, achieving secure isolation between meta-services, thereby enabling the identification of external attacks targeting the mapping relationships and improving the security defense capabilities of the data storage system.
[0004] To achieve the above objectives, the main technical solutions adopted in this application include: In a first aspect, embodiments of this application provide a data request processing method, applied to any one of multiple online meta-services in a mimicry data storage system, wherein the mimicry data storage system further includes a distribution arbitrator, and the method includes: Obtain a data request message requesting the first target data, and perform local identifier replacement on the data request message based on the data identifier mapping relationship to obtain a local replacement message; The local replacement message is processed to obtain a request-response message for the first target data, and then sent to the distribution arbitrator. Obtain the request adjudication result of the distribution adjudicator for the request response message, and update the data identifier mapping relationship according to the request adjudication result.
[0005] The data request processing method proposed in this application stores data identifier mapping relationships in multiple online meta-services of a mimicry data storage system. Upon receiving a distributed data request message, based on the locally stored data identifier mapping relationship of any online meta-service, the data request message undergoes local identifier replacement to obtain a locally replaced message. This allows the online meta-service to identify and process the first target data. After message processing is complete, a request-response message for the first target data is sent to the distribution arbitrator, and the data identifier mapping relationship is updated in real time based on the request arbitrator's feedback. Compared with related technologies, this application stores data identifier mapping relationships independently in each meta-service, achieving secure isolation between meta-services. If any meta-service is attacked and its data identifier mapping relationship is tampered with, the attack cannot spread to other meta-services, ensuring that other meta-services can correctly process messages. Furthermore, based on the distribution arbitrator's request arbitration result for the request-response message, external attacks targeting the mapping relationship are identified, thereby ensuring the correctness of the request-response message content and improving the security defense capability of the data storage system.
[0006] Optionally, the step of performing local identifier replacement on the data request message based on the data identifier mapping relationship to obtain a local replacement message includes: The data request message is parsed to obtain the request identifier of the first target data; based on the data identifier mapping relationship, the request identifier is locally mapped to obtain the first local identifier of the first target data. The request identifier is replaced with the first local identifier, and the replaced data request message is re-encapsulated to obtain the local replacement message.
[0007] Optionally, the requested adjudication result includes a first adjudication identifier and a first local identifier of the first target data; updating the data identifier mapping relationship according to the requested adjudication result includes: The request adjudication result is parsed to obtain the first adjudication identifier and the first local identifier of the first target data; wherein, the first adjudication identifier is obtained by the distribution adjudicator based on the first local identifier of the respective responses of the multiple online meta-services; The first adjudication identifier is used as the mapping index, and the first local identifier is used as the mapping result. The mapping index and the mapping result are combined to update the data identifier mapping relationship.
[0008] Optionally, the method further includes: Obtain the storage request message for storing the second target data; The storage request message is processed to obtain a storage response message for the second target data, and then sent to the distribution arbitrator. Obtain the storage arbitration result of the distribution arbitrator for the storage response message, and construct a new mapping pair based on the storage arbitration result to update the data identifier mapping relationship.
[0009] Optionally, the storage adjudication result includes a second adjudication identifier and a second local identifier of the second target data; the step of constructing a new mapping pair based on the storage adjudication result to update the data identifier mapping relationship includes: The stored decision result is parsed to obtain the second decision identifier and the second local identifier of the second target data; wherein, the second decision identifier is obtained by the distribution arbitrator based on the second local identifier of the responses of the multiple online meta-services; The second adjudication identifier is used as the mapping index, and the second local identifier is used as the mapping result. The mapping index and the mapping result are combined to update the data identifier mapping relationship.
[0010] Optionally, the method further includes: Obtain a meta-service scheduling instruction; wherein, the meta-service scheduling instruction is obtained based on the request adjudication result of the request response message, and the request adjudication result is obtained by the distribution adjudicator adjudicating the request response messages of the multiple online meta-services; The service status is adjusted according to the meta-service scheduling instruction to change the online status of any online meta-service.
[0011] Optionally, the plurality of online meta-services includes a primary meta-service and a plurality of secondary meta-services; the step of adjusting the service status according to the meta-service scheduling instruction to change the online status of any of the online meta-services includes: If the request ruling indicates that any of the online meta-services is abnormal and requires meta-service scheduling, and if the online meta-service is a primary meta-service, service degradation is performed according to the meta-service scheduling instruction to downgrade the online meta-service to a secondary meta-service, and data synchronization is performed based on the metadata of the primary meta-service being upgraded; wherein, the upgrade of the primary meta-service is obtained by upgrading any one of the multiple secondary meta-services; Alternatively, if any of the online meta-services is a slave meta-service, the online status is adjusted according to the meta-service scheduling instruction to adjust any of the online meta-services to a standby state and perform cleaning and restoration.
[0012] Secondly, embodiments of this application provide a mimicry data storage system, the system including a client, a distribution arbitrator, multiple online meta-services, a meta-service scheduler, and a block data service, the distribution arbitrator being connected to the multiple online meta-services, the meta-service scheduler, and the block data service respectively, the meta-service scheduler being connected to the multiple online meta-services, and the multiple online meta-services being used to execute the method described in any one of the above embodiments.
[0013] Thirdly, embodiments of this application provide a computer-readable storage medium storing computer instructions, which are used to cause a computer to perform the method described in any one of the above embodiments.
[0014] Fourthly, embodiments of this application provide a computer program product, including computer instructions, which are used to cause a computer to perform the method described in any of the above embodiments. Attached Figure Description
[0015] To more clearly illustrate the technical solutions in the specific embodiments of this application or the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.
[0016] Figure 1 A flowchart illustrating the steps of a data request processing method provided in this application embodiment; Figure 2 This is a block diagram of the mimicry data storage system in the embodiments of this application; Figure 3 This is a timing flowchart of the read operation in the embodiments of this application; Figure 4 This is a diagram illustrating the steps of local identifier replacement in an embodiment of this application; Figure 5 This is a diagram illustrating the steps of updating the data identifier mapping relationship in an embodiment of this application; Figure 6 This is a diagram illustrating the steps after obtaining the storage request message in an embodiment of this application; Figure 7 This is a timing flowchart of the write operation in the embodiments of this application; Figure 8 This is a timing flowchart of uploading block data in an embodiment of this application; Figure 9 This is a diagram illustrating the steps of updating the data identifier mapping relationship in an embodiment of this application; Figure 10This is a flowchart illustrating the steps of meta-service scheduling in an embodiment of this application; Figure 11 This is a schematic diagram of the modules of the mimicry data storage system in the embodiments of this application; Figure 12 This is a timing flowchart of the meta-service scheduling in the embodiments of this application; Figure 13 This is a timing flowchart of the meta-service scheduling in the embodiments of this application; Figure 14 A block diagram of a data request processing apparatus provided in the embodiments of this application; Figure 15 This is a timing flowchart of block service status reporting in an embodiment of this application; Figure 16 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation
[0017] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0018] With the development of internet technology, network applications have penetrated into many aspects of people's daily lives. While bringing convenience, these applications have also brought certain security risks. To improve the security of network applications, traditional network security prioritizes internal network security, passively isolating external network threats and preventing attacks through firewalls, information encryption, and access control. However, with the technological advancements and diversification of network attacks, traditional network defense methods are no longer effective in dealing with increasingly complex attacks, leading to a rise in business interruptions and data loss caused by network attacks. Therefore, there is an urgent need to develop a data storage system that can enhance defense capabilities against network attacks.
[0019] To address the aforementioned issues, this application provides a data request processing method, a biomimetic data storage system, a medium, and a product, applicable to any one of the multiple online meta-services in the biomimetic data storage system. The biomimetic data storage system further includes a distribution arbitrator. The method involves: acquiring a data request message requesting first target data; performing local identifier replacement on the data request message based on a data identifier mapping relationship to obtain a local replacement message; processing the local replacement message to obtain a request response message for the first target data, and sending it to the distribution arbitrator; acquiring the request arbitrator's decision result for the request response message, and updating the data identifier mapping relationship based on the request arbitrator's decision result.
[0020] The data request processing method provided in this application stores data identifier mapping relationships in multiple online meta-services of a mimicry data storage system. After receiving a distributed data request message, the method performs local identifier replacement on the data request message based on the data identifier mapping relationship stored locally in any online meta-service to obtain a local replacement message, enabling any online meta-service to identify and process the first target data. After completing the message processing, the method sends a request response message for the first target data to the distribution arbitrator and updates the data identifier mapping relationship in real time based on the request arbitration result fed back by the distribution arbitrator.
[0021] Compared to related technologies, this application stores data identifier mapping relationships independently in each meta-service, achieving secure isolation between meta-services. If any meta-service is attacked and its data identifier mapping relationship is tampered with, this attack cannot spread to other meta-services, ensuring that other meta-services can process messages correctly. Furthermore, based on the request adjudication result of the dispatch adjudicator for request-response messages, external attacks targeting the mapping relationship are identified, thereby ensuring the correctness of the request-response message content and improving the security defense capabilities of the data storage system.
[0022] According to an embodiment of this application, a data request processing method embodiment is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.
[0023] Reference Figure 1 As shown, this embodiment provides a data request processing method, applied to any one of the multiple online meta-services in a mimicry data storage system. The mimicry data storage system further includes a distribution arbitrator. The method includes: S100. Obtain the data request message requesting the first target data, and perform local identifier replacement on the data request message based on the data identifier mapping relationship to obtain the local replacement message.
[0024] S200. Process the local replacement message to obtain a request response message for the first target data, and send it to the distribution arbitrator.
[0025] S300. Obtain the request arbitration result of the dispatch arbitrator for the request response message, and update the data identifier mapping relationship according to the request arbitration result.
[0026] The first target data can be the data that the user needs to obtain, stored in a simulated data storage system. The storage location index of the first target data is stored in multiple online meta-services. The data identifier mapping relationship can be a data identifier mapping relationship stored in each meta-service, used to map and convert the request identifier in the data request message that points to the first target data, so as to obtain a first local identifier that each meta-service can recognize. It can be understood that the data identifier mapping relationship for the same target data should be the same in each meta-service. If there are different data identifier mapping relationships between meta-services, it indicates that the corresponding meta-service may be under external attack.
[0027] Reference Figure 2 As shown, the biomimetic data storage system provided in this embodiment includes a client, a distribution arbitrator, multiple heterogeneous meta-services, a meta-service scheduler, and a block data service. The client is communicatively connected to the distribution arbitrator, which is communicatively connected to the multiple heterogeneous meta-services, the meta-service scheduler, and the block data service, respectively. The meta-service scheduler is communicatively connected to the multiple heterogeneous meta-services. The client interacts with the user, receives data operation instructions from the user, and generates corresponding request messages based on the data operation instructions to operate on the data stored in the system. For example, the data operation instructions can be operation instructions on files or directories, including operations such as creating, modifying, uploading, downloading, or deleting files or directories.
[0028] The heterogeneous meta-services include multiple online meta-services and standby meta-services. Online meta-services are those that are active and interact with the dispatcher in real time, and their stored metadata may change. Standby meta-services are those that are offline and do not interact with external modules; their stored metadata remains unchanged. It should be noted that the meta-services also deploy meta-service proxies and lightweight databases. The meta-service proxies receive data request messages distributed to the meta-services and perform local identifier replacement on these messages based on data identifier mapping relationships to obtain locally replaced messages that the meta-services can recognize. The lightweight database stores data identifier mapping relationships. The meta-service proxies can call the lightweight database to obtain the corresponding mapping relationships when local identifier replacement is needed. After receiving the request adjudication result, the meta-service proxies can also call the lightweight database to update the data identifier mapping relationships based on the request adjudication result, ensuring the correctness and real-time performance of the data identifier mapping relationships.
[0029] The distribution arbitrator connects to the client, metadata service, and block data service respectively to establish communication isolation between these modules and avoid direct connections between them. The distribution arbitrator may include a distribution unit and an adjudication unit. The distribution unit is connected to each online meta-service and is used to distribute request messages to each online meta-service. Before distributing messages, the distribution unit can perform anomaly filtering on the messages to reduce the probability of attacks on the metadata service and improve system security. The adjudication unit is also connected to each online meta-service and is used to receive response messages from each online meta-service based on the request messages and to adjudicate the response messages.
[0030] Reference Figure 3As shown, in the aforementioned mimicry data storage system, when a user requests the first target data, they send a data request message to the system through a client. The distribution arbitrator receives the data request message through the established link with the client. After receiving the data request message through the distribution unit, the distribution arbitrator obtains the client's source address contained in the data request message. After obtaining the source address, the distribution unit sends the data request message to each online meta-service using the client's source address. Similarly, when the requesting end is a block data service, the block data service actively establishes a link with the distribution arbitrator and sends a data request message to the distribution arbitrator. After receiving the data request message, the distribution arbitrator obtains the block data service's source address contained in the data request message. After obtaining the source address, the distribution unit sends the data request message to each online meta-service using the block data service's source address. Understandably, the dispatcher is used to forward messages between the client, the meta service, and the block data service. In order to distinguish the request messages from different requesters, the dispatcher retains the initial source address of the request message during forwarding, so that the meta service can distinguish the requester and use it as the target address for subsequent response messages.
[0031] Furthermore, for any one of the multiple online meta-services, a data request message is received and distributed through a meta-service proxy, and a lightweight database is invoked to obtain a data identifier mapping relationship. Based on the data identifier mapping relationship, the data request message is replaced with a local identifier, converting the data identifier in the data request message that points to the first target data into a form that the online meta-service can recognize, thus obtaining a local replacement message. This enables the online meta-service to process the message based on the recognizable data identifier.
[0032] It should be noted that in related technologies, the dispatch arbitrator used for distributing messages also undertakes the task of identifier conversion. After receiving a data request message sent by a user, the dispatch arbitrator calls the data identifier mapping relationship to perform local identifier replacement on the data request message, obtaining a local replacement message, and then distributes the local replacement message to each online meta-service. However, when handling high-frequency data requests from multiple users, the dispatch arbitrator bears significant processing pressure, affecting its processing efficiency and message distribution efficiency, thereby limiting the data transmission efficiency of the mimicry data storage system. Compared to the aforementioned related technologies, this embodiment decouples the message distribution process and the local identifier replacement process. The data request message is distributed by the dispatch arbitrator, and the local identifier replacement is performed by the meta-service proxy in each online meta-service, thereby effectively reducing the processing pressure on the dispatch arbitrator and significantly improving its processing efficiency.
[0033] Furthermore, within any of these online meta-services, the meta-service proxy sends the local replacement message to the metadata service section, which then processes the local replacement message to obtain a request-response message for the first target data. Upon receiving the request-response message, the metadata service section sends it to the meta-service proxy, which in turn sends it to the distribution arbitrator for message adjudication.
[0034] It should be noted that in related technologies, data identifier mapping relationships are typically stored in a separate database for the distribution arbiter to call during local identifier replacement. However, under external attacks, the data identifier mapping relationships stored in this database may be deleted or cracked, preventing the distribution arbiter from performing local identifier replacement correctly. This results in online meta-services being unable to identify the target data pointed to by data request messages, leading to the collapse of the mimicry data storage system. Considering the above problems, this embodiment deploys a meta-service proxy and a lightweight database in each meta-service. Each lightweight database stores data identifier mapping relationships for the meta-service proxy to call and use as the basis for local identifier replacement. Compared to related technologies, this embodiment achieves secure isolation between meta-services through decentralized storage. Even if any meta-service is attacked and its data identifier mapping relationship is tampered with, or even if the data identifier mapping relationship is cracked or tampered with, other unattacked online meta-services can still process messages normally and return correct request-response messages, thereby mitigating the negative impact of external attacks on the normal operation of the mimicry data storage system.
[0035] Furthermore, this embodiment can also use a distribution arbitrator to adjudicate request and response messages from multiple online meta-services, accurately identify anomalies in the request and response messages, and determine the security status of each online meta-service while obtaining the correct response result. This enables targeted handling of online meta-services subjected to external attacks, eliminates the impact of external attacks, and ensures the secure operation of the mimicry data storage system.
[0036] Furthermore, after the dispatcher completes the message adjudication, each online meta-service receives the request adjudication result distributed by the dispatcher through the meta-service proxy. It is understood that the request adjudication result includes the data identifier of the first target data determined after message adjudication, and the first local identifier of the first target data in each online meta-service; a mapping relationship exists between the two. Upon receiving the request adjudication result, the meta-service proxy updates the data identifier mapping relationship stored in each lightweight database according to the identifier in the request adjudication result to ensure the correctness and real-time nature of the data identifier mapping relationship and to ensure the consistency of the identifier mapping.
[0037] The data request processing method provided in this embodiment stores data identifier mapping relationships in multiple online meta-services of the mimicry data storage system. After receiving a distributed data request message, the method performs local identifier replacement on the data request message based on the data identifier mapping relationship stored locally in any online meta-service to obtain a local replacement message, enabling any online meta-service to identify and process the first target data. After completing the message processing, the method sends a request response message for the first target data to the distribution arbitrator and updates the data identifier mapping relationship in real time based on the request arbitration result fed back by the distribution arbitrator.
[0038] Compared to related technologies, this application stores data identifier mapping relationships independently in each meta-service, achieving secure isolation between meta-services. If any meta-service is attacked and its data identifier mapping relationship is tampered with, this attack cannot spread to other meta-services, ensuring that other meta-services can process messages correctly. Furthermore, based on the request adjudication result of the dispatch adjudicator for request-response messages, external attacks targeting the mapping relationship are identified, thereby ensuring the correctness of the request-response message content and improving the security defense capabilities of the data storage system.
[0039] Reference Figure 4 As shown, in one embodiment of this application, a local identifier replacement is performed on the data request message based on the data identifier mapping relationship to obtain a local replacement message, including: S110. Parse the data request message to obtain the request identifier of the first target data; based on the data identifier mapping relationship, perform local mapping on the request identifier to obtain the first local identifier of the first target data.
[0040] S120. Replace the request identifier with the first local identifier, and re-encapsulate the replaced data request message to obtain the local replacement message.
[0041] Specifically, after receiving a data request message, any online meta-service parses the message through a meta-service proxy to obtain the request identifier pointing to the first target data. It is understood that the request identifier can be a globally unique identifier pointing to the first target data, generated based on distributed files and directories within the mimicry data storage system, representing the storage path of the first target data within the mimicry data storage system. In some embodiments, the request identifier can also be any data pointing information in the data request message pointing to the first target data, obtained through parsing the data request message by the meta-service proxy, enabling the online meta-service to understand the user's data request and respond with the corresponding first local identifier.
[0042] Furthermore, the metaservice proxy invokes the lightweight database of any online metaservice to retrieve the stored data identifier mapping relationship. Based on this mapping relationship, it performs a local mapping on the request identifier to determine the first local identifier corresponding to the request identifier, thereby obtaining the first local identifier of the first target data. After obtaining the first local identifier, it replaces the request identifier in the data request message with the first local identifier and re-encapsulates the replaced data request message to obtain a local replacement message.
[0043] Understandably, based on the first local identifier in the local replacement message, any online meta-service can accurately point to the metadata record corresponding to the first target data within the system and obtain the storage location information of the first target data, thereby guiding the user to interact with the block data service and complete the user's data request for the first target data.
[0044] Reference Figure 5 As shown, in one embodiment of this application, the requested adjudication result includes a first adjudication identifier and a first local identifier of the first target data; updating the data identifier mapping relationship according to the requested adjudication result includes: S310. Parse the message of the requested adjudication result to obtain the first adjudication identifier and the first local identifier of the first target data; wherein, the first adjudication identifier is obtained by the distributor adjudicator adjudicating according to the first local identifier of the responses of multiple online meta-services.
[0045] S320. Use the first adjudication identifier as the mapping index and the first local identifier as the mapping result, and combine the mapping index and the mapping result to update the data identifier mapping relationship.
[0046] Specifically, after any online meta-service receives the request adjudication result, it parses the request adjudication result through a meta-service proxy to obtain the first adjudication identifier pointing to the first target data, and the first local identifier used by each online meta-service to identify the first target data. It can be understood that the first adjudication identifier can be obtained by the distributing adjudicator based on the first local identifiers of the responses from multiple online meta-services. The generation process of the first adjudication identifier can be either regenerated based on multiple first local identifiers, or it can be obtained by mapping multiple first local identifiers based on an existing mapping relationship. There is a correspondence between the first adjudication identifier and the first local identifier.
[0047] Furthermore, after any online meta-service obtains the first adjudication identifier and the first local identifier of the first target data through the meta-service proxy, it uses the first adjudication identifier as a mapping index (Key) and the first local identifier as a mapping result (Value). A mapping pair is constructed based on the first adjudication identifier and the first local identifier to update the data identifier mapping relationship stored in that online meta-service. It is understood that after obtaining the first adjudication identifier, the dispatch adjudicator feeds it back to the client, allowing the user to point to the first target data through the first adjudication identifier in subsequent data requests, thus improving data request efficiency. When a user generates a data request message based on the first adjudication identifier to request the first target data, the meta-service proxy of each online service element queries the data identifier mapping relationship based on the first adjudication identifier and obtains the same first local identifier based on the previous update result. This ensures the consistency and correctness of the identifier mapping, while also achieving effective reuse of identifiers and improving data request efficiency.
[0048] Reference Figure 6 As shown in one embodiment of this application, the method further includes: S410. Obtain the storage request message for storing the second target data.
[0049] S420. Process the storage request message to obtain a storage response message for the second target data, and send it to the distribution arbitrator.
[0050] S430. Obtain the storage arbitration result of the distribution arbitrator for the storage response message, construct a new mapping pair based on the storage arbitration result, and update the data identifier mapping relationship.
[0051] Specifically, the second target data can be external data that the user needs to store. Since the second target data is not stored in the mimicry data storage system, the request identifier for the second target data in the storage request message can be other data pointing information besides the second ruling identifier. (See reference...) Figure 7 As shown, when a user needs to store second target data in the mimicry data storage system, the client sends a storage request message to the system. The distribution arbitrator receives the storage request message through the established link with the client. After receiving the storage request message through the distribution unit, the distribution arbitrator obtains the client's source address contained in the storage request message. After obtaining the source address, the distribution unit sends the storage request message to each online meta-service using the client's source address.
[0052] Furthermore, for any one of the multiple online meta-services, a storage request message is received and distributed through a meta-service proxy. Since the storage request message does not contain a data identifier pointing to the second target data, the meta-service proxy directly sends the storage request message to the metadata service portion of that online meta-service. The metadata service portion then processes the storage request message to obtain a storage response message for the second target data. It is understood that during the processing of the storage request message, that online meta-service generates a second local identifier for the second target data and generates a storage response message based on the second local identifier.
[0053] Furthermore, upon receiving the storage response message, the metadata service sends the message to the metaservice broker, which then forwards it to the distribution arbitrator for adjudication. The distribution arbitrator generates a second adjudication identifier corresponding to the second target data based on the second local identifiers returned by multiple online metaservices. It then generates a storage adjudication result based on this second adjudication identifier and distributes it to each online metaservice. Understandably, the distribution arbitrator also generates a storage response message based on the second adjudication identifier and sends it to the client to guide the user's interaction with the block data service and complete the user's storage request for the second target data.
[0054] Furthermore, each online meta-service receives the storage adjudication result distributed by the distribution adjudicator through the meta-service proxy. The storage adjudication result includes the data identifier of the first target data determined after message adjudication, and the first local identifier of the first target data in each online meta-service, with a mapping relationship between the two. After receiving the storage adjudication result, the meta-service proxy updates the data identifier mapping relationship stored in each lightweight database according to the identifier in the storage adjudication result to ensure the correctness and real-time performance of the data identifier mapping relationship and ensure the consistency of the identifier mapping.
[0055] Reference Figure 8 As shown, after receiving the storage response message, the user uploads the second target data to the system based on the second adjudication identifier contained therein. Upon receiving the second target data, the distribution adjudicator establishes a connection with the corresponding block data service based on the second adjudication identifier. After the connection is established, the distribution adjudicator sends the second target data to the corresponding block data service through the distribution unit. The block data service stores the second target data upon receipt and feeds back the storage result to the distribution adjudicator. The distribution adjudicator then feeds back the storage result to the client through the adjudication unit to display the storage result of the second target data to the user.
[0056] Reference Figure 9As shown, in one embodiment of this application, the stored adjudication result includes a second adjudication identifier and a second local identifier of the second target data; constructing a new mapping pair based on the stored adjudication result to update the data identifier mapping relationship includes: S432. Parse the stored decision result to obtain the second decision identifier and the second local identifier of the second target data; wherein, the second decision identifier is obtained by the distributor making a decision based on the second local identifier of the responses of multiple online meta-services.
[0057] S434. Use the second adjudication identifier as the mapping index and the second local identifier as the mapping result, and combine the mapping index and the mapping result to update the data identifier mapping relationship.
[0058] Specifically, after any online meta-service receives the storage adjudication result, it parses the storage adjudication result through the meta-service proxy to obtain the second adjudication identifier pointing to the second target data, and the second local identifier used by each online meta-service to identify the second target data. It can be understood that the second adjudication identifier can be obtained by the distributing adjudicator based on the second local identifiers of the responses from multiple online meta-services, and the generation process of the second adjudication identifier can be based on multiple second local identifiers; there is a correspondence between the second adjudication identifier and the second local identifier.
[0059] Furthermore, after any online meta-service obtains the second adjudication identifier and the second local identifier of the second target data through the meta-service proxy, it uses the second adjudication identifier as a mapping index and the second local identifier as the mapping result. A mapping pair is constructed based on the second adjudication identifier and the second local identifier to update the data identifier mapping relationship stored in that online meta-service. It is understood that after obtaining the second adjudication identifier, the dispatch adjudicator can feed it back to the client, allowing the user to point to the second target data through the second adjudication identifier in subsequent data requests, thus improving data request efficiency. When a user generates a data request message based on the second adjudication identifier to request the second target data, the meta-service proxy of each online service element queries the data identifier mapping relationship based on the second adjudication identifier and obtains the same second local identifier based on the previous update result. This ensures the consistency and correctness of the identifier mapping, while also achieving effective reuse of identifiers and improving data request efficiency.
[0060] Reference Figure 10 As shown in one embodiment of this application, the method further includes: S510. Obtain the meta-service scheduling instruction; wherein, the meta-service scheduling instruction is obtained based on the request adjudication result of the request response message, and the request adjudication result is obtained by the dispatch adjudicator adjudicating the request response messages of multiple online meta-services.
[0061] S520. Adjust the service status according to the meta-service scheduling instruction to change the online status of any online meta-service.
[0062] Specifically, after receiving the request-response messages from each online meta-service, the dispatcher adjudicates the messages to obtain the request adjudication result, and sends the result to the meta-service scheduler. Based on the request adjudication result, the meta-service scheduler performs anomaly diagnosis on multiple online meta-services. If any online meta-service is determined to be abnormal, the scheduler sends a meta-service scheduling instruction to that service to adjust its service status.
[0063] Furthermore, upon receiving a meta-service scheduling instruction, any online meta-service adjusts its service status accordingly, changing its online status and thus altering the operating mode of the mimicry data storage system. It is understandable that when a request for adjudication indicates that any online meta-service is affected by an external attack and exhibits abnormalities, the meta-service scheduling instruction is used to take that online meta-service offline to mitigate the impact on the normal operation of the mimicry data storage system and prevent the external attack from spreading to other online meta-services.
[0064] As one embodiment of this application, multiple online meta-services include a primary meta-service and multiple secondary meta-services; adjusting the service status according to meta-service scheduling instructions to change the online status of any online meta-service includes: S522. If the request for adjudication indicates that any online meta-service is abnormal and requires meta-service scheduling, and if any online meta-service is a primary meta-service, service degradation shall be performed according to the meta-service scheduling instruction to downgrade any online meta-service to a secondary meta-service, and data synchronization shall be performed according to the metadata of the primary meta-service; wherein, upgrading the primary meta-service is obtained by upgrading any one of the multiple secondary meta-services.
[0065] Alternatively, if any online meta-service is a slave meta-service, its online status can be adjusted according to the meta-service scheduling instruction to put any online meta-service into standby mode and perform cleaning and restoration.
[0066] Reference Figure 11As shown, multiple online meta-services can include a primary meta-service and multiple secondary meta-services. The primary and secondary meta-services have different security levels, with the primary meta-service having a higher decision-making weight and greater influence on message decision-making results. During meta-service scheduling, the primary and secondary meta-services also have different scheduling methods. The primary meta-service has a higher priority for going online than the secondary meta-services. When the primary meta-service is functioning normally, it is designated as an online meta-service, and two normally functioning secondary meta-services are randomly selected from among the multiple secondary meta-services as online meta-services.
[0067] In this embodiment, the distribution unit of the distribution arbitrator is connected to the primary meta-service and multiple secondary meta-services respectively, for distributing messages to the primary meta-service and multiple secondary meta-services. Similarly, the adjudication unit of the distribution arbitrator is connected to the primary meta-service and multiple secondary meta-services respectively, for receiving response messages from the primary meta-service and multiple secondary meta-services. In this embodiment, when constructing the mimicry data storage system, the primary meta-service is brought online as the primary meta-service, and any two heterogeneous meta-services are selected from multiple heterogeneous meta-services and brought online sequentially as secondary meta-services. After multiple secondary meta-services are brought online, the meta-service scheduler controls the secondary meta-services to synchronize data with the primary meta-service sequentially based on their online order, ensuring that the secondary meta-services and the primary meta-service store the same metadata.
[0068] Reference Figure 12 As shown, after determining that the request adjudication result is abnormal, the adjudication unit of the distribution adjudicator sends the abnormal request adjudication result to the meta-service scheduler. Upon receiving the request adjudication result, if the result indicates an abnormality in the primary meta-service, the meta-service scheduler sends a service degradation meta-service scheduling instruction to that primary meta-service to downgrade it to a secondary meta-service. After downgrading the abnormal primary meta-service, the meta-service scheduler selects any one of the multiple secondary meta-services and sends a service upgrade meta-service scheduling instruction to that secondary meta-service to upgrade it to a new primary meta-service, which is then designated as the upgraded primary meta-service. Based on the metadata of the upgraded primary meta-service, data synchronization is performed on all current secondary meta-services to ensure data consistency among online metadata. It can be understood that after completing the service status adjustment, the meta-service scheduler sends the scheduling result to the distribution adjudicator, enabling the distribution adjudicator to grasp the service status of each heterogeneous meta-service.
[0069] Furthermore, after the primary meta-service is downgraded to a secondary meta-service, this secondary meta-service is treated as a degraded secondary meta-service. The meta-service scheduler continuously monitors the message adjudication results for the degraded secondary meta-service to obtain the adjudication monitoring results. If the adjudication monitoring results indicate that the degraded secondary meta-service continues to exhibit anomalies, it is determined that the degraded secondary meta-service meets the meta-service offline conditions, and a meta-service scheduling instruction for scheduling offline is sent to the degraded secondary meta-service. Upon receiving the meta-service scheduling instruction, the degraded secondary meta-service adjusts to an offline state according to the instruction and performs cleaning and repair to eliminate the impact of external attacks. For example, the meta-service offline condition can be that the number of times the degraded secondary meta-service exhibits anomalies reaches a preset threshold within a preset time window. The length of the preset time window and the preset threshold can be determined according to actual requirements. The cleaning and repair process can include operations such as image restoration, snapshot recovery, and disk formatting.
[0070] Furthermore, after a downgraded meta-service goes offline, the meta-service scheduler selects any standby meta-service from the remaining operational standby meta-services to bring it online. Upon going online, this standby meta-service synchronizes its data with the primary meta-service to ensure data consistency. After data synchronization is complete, this standby meta-service is officially online as a new meta-service, and the meta-service scheduler notifies the distribution arbitrator of this new online status.
[0071] Reference Figure 13 As shown, after receiving the request adjudication result, if the result indicates that any slave meta-service has malfunctioned and meets the meta-service offline conditions, the meta-service scheduler sends a scheduling instruction to that slave meta-service to take it offline. Upon receiving the scheduling instruction, the slave meta-service adjusts to an offline state and performs cleaning and repair to eliminate the impact of external attacks. After the cleaning and repair of the slave meta-service is completed, it is kept in standby mode as a standby meta-service, to be rescheduled back online when needed.
[0072] Furthermore, after any slave meta-service goes offline, the meta-service scheduler selects any standby meta-service from the list of normally functioning standby meta-services to bring it online. Upon going online, this standby meta-service synchronizes its data with the primary meta-service to ensure data consistency. After data synchronization is complete, this standby meta-service is officially online as a new slave meta-service, and the meta-service scheduler notifies the distribution arbitrator of this new slave meta-service's online status.
[0073] In some embodiments, a timed offline policy can be set for online meta-services, which takes any heterogeneous meta-service offline within a set time period and selects any heterogeneous meta-service from standby meta-services to bring online.
[0074] Accordingly, please refer to Figure 14 This application provides a data request processing apparatus, applied to any one of the multiple online meta-services in a mimicry data storage system. The mimicry data storage system further includes a distribution arbitrator. The apparatus includes: The local identifier replacement module 1410 is used to obtain a data request message requesting the first target data, and perform local identifier replacement on the data request message based on the data identifier mapping relationship to obtain a local replacement message.
[0075] The message processing response module 1420 is used to process the local replacement message, obtain a request response message for the first target data, and send it to the distribution arbitrator.
[0076] The mapping relationship update module 1430 is used to obtain the request adjudication result of the dispatch adjudicator for the request response message, and update the data identifier mapping relationship according to the request adjudication result.
[0077] In some alternative implementations, the local identifier replacement module 1410 includes: The identifier resolution and mapping unit is used to parse the data request message to obtain the request identifier of the first target data; based on the data identifier mapping relationship, the request identifier is localized to obtain the first local identifier of the first target data.
[0078] The identifier replacement encapsulation unit is used to replace the request identifier with the first local identifier and re-encapsulate the replaced data request message to obtain a local replacement message.
[0079] In some optional implementations, the mapping update module 1430 includes: The adjudication message parsing unit is used to parse the request adjudication result to obtain the first adjudication identifier and the first local identifier of the first target data; wherein, the first adjudication identifier is obtained by the dispatch adjudicator based on the first local identifier of the responses of multiple online meta-services.
[0080] The mapping combination update unit is used to combine the first adjudication identifier as the mapping index and the first local identifier as the mapping result to update the data identifier mapping relationship.
[0081] In some alternative embodiments, the device further includes a data storage module, comprising: The request message acquisition unit is used to acquire the storage request message for storing the second target data.
[0082] The message processing response unit is used to process the storage request message, obtain the storage response message for the second target data, and send it to the distribution arbitrator.
[0083] The mapping relationship construction unit is used to obtain the storage adjudication result of the distribution adjudicator for the storage response message, and construct new mapping relationship pairs based on the storage adjudication result to update the data identifier mapping relationship.
[0084] In some optional implementations, the mapping relationship construction unit includes: The adjudication message parsing subunit is used to parse the stored adjudication results to obtain the second adjudication identifier and the second local identifier of the second target data; wherein, the second adjudication identifier is obtained by the dispatch adjudicator based on the second local identifier of the responses of multiple online meta-services.
[0085] The mapping combination update subunit is used to combine the second adjudication identifier as the mapping index and the second local identifier as the mapping result to update the data identifier mapping relationship.
[0086] In some alternative implementations, the apparatus further includes a meta-service scheduling module, comprising: The scheduling instruction acquisition unit is used to acquire meta-service scheduling instructions; wherein, the meta-service scheduling instructions are obtained based on the request adjudication result of the request response message, and the request adjudication result is obtained by the dispatch adjudicator adjudicating the request response messages of multiple online meta-services.
[0087] The service status adjustment unit is used to adjust the service status according to the meta-service scheduling instructions, so as to change the online status of any online meta-service.
[0088] In some optional implementations, the service status adjustment unit includes: The status adjustment subunit is used when the request adjudication result indicates that any online meta-service has an anomaly and meta-service scheduling is required. If any online meta-service is a primary meta-service, the subunit performs service degradation according to the meta-service scheduling instruction to downgrade any online meta-service to a secondary meta-service, and performs data synchronization based on the metadata of the primary meta-service. The primary meta-service is obtained by upgrading any one of the multiple secondary meta-services.
[0089] Alternatively, if any online meta-service is a slave meta-service, its online status can be adjusted according to the meta-service scheduling instruction to put any online meta-service into standby mode and perform cleaning and restoration.
[0090] Further functional descriptions of the above modules and units are the same as those in the corresponding embodiments described above, and will not be repeated here.
[0091] In this embodiment, the data request processing device is presented in the form of a functional unit. Here, a unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that execute one or more software or fixed programs, and / or other devices that can provide the above functions.
[0092] Reference Figure 2 As shown, this application also provides a mimicry data storage system, including a client, a distribution arbitrator, multiple heterogeneous meta-services, a meta-service scheduler, and a block data service. The client is communicatively connected to the distribution arbitrator, which is communicatively connected to the multiple heterogeneous meta-services, the meta-service scheduler, and the block data service, respectively. The meta-service scheduler is communicatively connected to the multiple heterogeneous meta-services. The client interacts with the user, receives data operation instructions from the user, and generates corresponding request messages based on the data operation instructions to operate on the data stored in the system. For example, the data operation instructions can be instructions for operating on files or directories, including operations such as creating, modifying, uploading, downloading, or deleting files or directories. It is understood that in the system provided in this embodiment, the client is only directly connected to the distribution arbitrator and not connected to the meta-services or block data services. Furthermore, during the data operation request process, the request messages issued by the client are relayed through the distribution arbitrator and sent to the data service, thereby providing effective communication isolation between the client and the data service. This prevents malicious objects from directly attacking the meta-services or block data services from the client, reducing the risk of network attacks on the meta-services and block data services.
[0093] Multiple heterogeneous meta-services are used to run metadata management programs, storing and managing metadata. These meta-services may use different hardware, differing in CPU architecture, server vendor, and server model; they may also use different software, differing in operating system and storage software version, but each meta-service possesses the same service functionality. These heterogeneous meta-services include multiple online meta-services and standby meta-services. Online meta-services are those that are actively engaged, interacting with the dispatcher in real-time, and their stored metadata may change. Standby meta-services are those that are offline and do not interact with external modules; their stored metadata remains unchanged. It is important to note that all online meta-services store the same metadata to enable metadata backup between online meta-services and ensure interchangeability. If any online meta-service fails, a standby meta-service can be brought online to take over, preventing service interruptions and ensuring system service continuity. When a standby meta-service goes live, it synchronizes data with any online meta-service to acquire and store the necessary metadata, reducing the risk of metadata loss. At least three online meta-services are required to provide multi-level redundancy and improve reliability. Understandably, the number of online meta-services also affects the accuracy of message adjudication results. A smaller number of online meta-services means less data available for message adjudication, potentially leading to incorrect or abnormal judgments. Therefore, the number of online meta-services should be determined based on the specific requirements of the scenario to ensure the normal operation of the meta-services.
[0094] The distribution arbitrator connects to the client, meta-service, and block data service respectively to establish communication isolation between these modules and avoid direct connections between them. The distribution arbitrator has a request listening port to receive request messages sent by the client and forward them. The distribution arbitrator includes a distribution unit and an arbitration unit. The distribution unit connects to each online meta-service and distributes request messages to each online meta-service. Before distributing messages, the distribution unit can perform anomaly filtering to reduce the probability of attacks on meta-services and improve system security. The arbitration unit connects to each online meta-service and receives response messages from each online meta-service based on the request messages, and arbitrates the response messages. When an anomaly is found in the arbitration result of a response message, the arbitration unit sends the anomaly arbitration result to the meta-service scheduler, thereby monitoring the online meta-services for anomalies and ensuring their normal operation. It should be noted that the adjudication unit is also used to send the response message from the online meta-service to the corresponding receiving end. Both the distribution unit and the adjudication unit can modify and replace the content of the received message, so that the message forwarded by the distribution adjudicator can be correctly identified and sent to the correct receiving end. For example, modifying and replacing the message content may include modifying the source address and destination address of the message.
[0095] It is understood that in the system provided in this embodiment, the distribution arbitrator is connected to the client, multiple heterogeneous meta-services, and block data services respectively, and forwards packets between these modules. The routing information of the multiple heterogeneous meta-services is modified to send packets destined for the client or block data service to the distribution arbitrator, so that the distribution arbitrator can relay packets between the client, block data service, and meta-service. The above connection method avoids direct connections between modules in the mimicry data storage system, enhancing the isolation between modules. Based on the enhanced isolation between modules, the attack path from the client to the meta-service or block data service is effectively cut off, reducing the risk of the meta-service and block data service being directly attacked by the client, and also preventing attack propagation between the meta-service and block data service, thus improving the system's defense capability against network attacks.
[0096] The metaservice scheduler connects to the distribution arbitrator and multiple heterogeneous metaservices. Based on the decision results of messages sent by the distribution arbitrator, it diagnoses anomalies in online metaservices. When any online metaservice is found to be abnormal, it schedules the online metaservices to go online or offline, taking the abnormal online metaservice offline and bringing the standby metaservice online as a new online metaservice. The metaservice scheduler also obtains the running status of each metaservice through the metadata management program in each metaservice and sends the running status to the distribution arbitrator. This allows the distribution arbitrator to distinguish between online and standby metaservices based on their running status and establish a connection with the online metaservices for message exchange. The metaservice scheduler connects to the metaservice monitoring page, which displays the running status of each metaservice and shows alarm information when any online metaservice is abnormal, enabling users to promptly detect metaservice anomalies.
[0097] The block data service runs the block data management program to store and manage block data. There can be one or more block data services; each service can store the same or different block data. The block data service connects to the distributor / arbitrator, exchanges messages with it, and uses the distributor / arbitrator to provide feedback on block data requested by users. Furthermore, the block data service sends its service status to the distributor / arbitrator, which then distributes this status to the online meta-service to notify it to update its service status.
[0098] In some embodiments, the method for constructing a mimicry data storage system includes: establishing communication connections with clients, a distribution arbitrator, multiple heterogeneous meta-services, a meta-service scheduler, and a block data service; running all meta-services and the meta-service scheduler, with each meta-service actively connecting to the meta-service scheduler and reporting its own running status; selecting any one meta-service as the primary meta-service and bringing it online; selecting any two meta-services from among the multiple heterogeneous meta-services (excluding the primary meta-service) and bringing them online as secondary meta-services, so as to obtain online meta-services based on the primary and secondary meta-services, and setting the unselected meta-services to a standby state; controlling the secondary meta-services to synchronize data with the primary meta-service through the meta-service scheduler, so that the secondary meta-services and the primary meta-service store the same metadata; running the distribution arbitrator, which receives the running status of the meta-services sent by the meta-service scheduler; running the block data service, with each block data service actively connecting to the distribution arbitrator and sending its own service status; and the distribution arbitrator sending the service status of the block data service to the online meta-services to notify the online meta-services to update the service status of the block data service.
[0099] Reference Figure 15As shown, during the construction of the mimicry data storage system, each block data service actively establishes a connection with the distribution arbitrator after startup and sends its service status to the distribution arbitrator. The service status can include the block data service's heartbeat and block data status, etc. After receiving the service status of the block data service, the distribution arbitrator sends the service status to each online meta-service through the distribution unit to notify the online meta-services to update the service status of the block data service. After completing the block service status update, the online meta-service sends a response message indicating the update result back to the distribution arbitrator. The distribution arbitrator, through the arbitration unit, arbitrates the response messages of all online meta-services to determine the final response message, and sends the final response message to the block data service to notify the block data service of the update result from the online meta-services.
[0100] Please see Figure 16 , Figure 16 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application, such as... Figure 16 As shown, the computer device includes one or more processors 10, memory 20, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The components communicate with each other via different buses and can be mounted on a common motherboard or otherwise installed as needed. The processors can process instructions executed within the computer device, including instructions stored in or on memory to display graphical information of a GUI on external input / output devices (such as display devices coupled to the interfaces). In some alternative implementations, multiple processors and / or multiple buses can be used with multiple memories and multiple memory modules, if desired. Similarly, multiple computer devices can be connected, each providing some of the necessary operations (e.g., as a server array, a group of blade servers, or a multiprocessor system). Figure 16 Take a processor 10 as an example.
[0101] Processor 10 may be a central processing unit, a network processor, or a combination thereof. Processor 10 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The programmable logic device may be a complex programmable logic device (CAMP), a field-programmable gate array (FPGA), a general-purpose array logic (GDA), or any combination thereof.
[0102] The memory 20 stores instructions executable by at least one processor 10 to cause the at least one processor 10 to perform the method shown in the above embodiments.
[0103] The memory 20 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the computer device. Furthermore, the memory 20 may include high-speed random access memory and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some alternative embodiments, the memory 20 may optionally include memory remotely located relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
[0104] The memory 20 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as flash memory, hard disk or solid-state drive; the memory 20 may also include a combination of the above types of memory.
[0105] The computer device also includes a communication interface 30 for communicating with other devices or communication networks.
[0106] This application also provides a computer-readable storage medium. The methods described in this application can be implemented in hardware or firmware, or implemented as recordable on a storage medium, or implemented as computer code downloaded over a network and originally stored on a remote storage medium or a non-transitory machine-readable storage medium and subsequently stored on a local storage medium. Thus, the methods described herein can be processed by software stored on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. The storage medium can be a magnetic disk, optical disk, read-only memory, random access memory, flash memory, hard disk, or solid-state drive, etc.; further, the storage medium can also include combinations of the above types of memory. It is understood that computers, processors, microprocessor controllers, or programmable hardware include storage components capable of storing or receiving software or computer code. When the software or computer code is accessed and executed by the computer, processor, or hardware, the methods shown in the above embodiments are implemented.
[0107] This application provides a computer program product including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method of any embodiment of this application.
[0108] Although embodiments of this application have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of this application, and all such modifications and variations fall within the scope defined by the appended claims.
[0109] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.
[0110] For ease of description, the above devices are described separately by function as various units. Of course, in implementing this application, the functions of each unit can be implemented in one or more software and / or hardware.
[0111] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0112] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0113] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1The function specified in one or more boxes.
[0114] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0115] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0116] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.
[0117] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.
[0118] Although embodiments of this application have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of this application, and such modifications and variations all fall within the scope defined by the appended claims.
Claims
1. A data request processing method, characterized in that, The method includes applying any one of multiple online meta-services in a mimicry data storage system, wherein the mimicry data storage system further includes a distribution arbitrator, and the method comprises: Obtain a data request message requesting the first target data, and perform local identifier replacement on the data request message based on the data identifier mapping relationship to obtain a local replacement message; The local replacement message is processed to obtain a request-response message for the first target data, and then sent to the distribution arbitrator. Obtain the request adjudication result of the distribution adjudicator for the request response message, and update the data identifier mapping relationship according to the request adjudication result.
2. The method according to claim 1, characterized in that, The local identifier replacement of the data request message based on the data identifier mapping relationship to obtain a local replacement message includes: The data request message is parsed to obtain the request identifier of the first target data; based on the data identifier mapping relationship, the request identifier is locally mapped to obtain the first local identifier of the first target data. The request identifier is replaced with the first local identifier, and the replaced data request message is re-encapsulated to obtain the local replacement message.
3. The method according to claim 1, characterized in that, The requested adjudication result includes a first adjudication identifier and a first local identifier for the first target data; updating the data identifier mapping relationship according to the requested adjudication result includes: The request adjudication result is parsed to obtain the first adjudication identifier and the first local identifier of the first target data; wherein, the first adjudication identifier is obtained by the distribution adjudicator based on the first local identifier of the respective responses of the multiple online meta-services; The first adjudication identifier is used as the mapping index, and the first local identifier is used as the mapping result. The mapping index and the mapping result are combined to update the data identifier mapping relationship.
4. The method according to claim 1, characterized in that, The method further includes: Obtain the storage request message for storing the second target data; The storage request message is processed to obtain a storage response message for the second target data, and then sent to the distribution arbitrator. Obtain the storage arbitration result of the distribution arbitrator for the storage response message, and construct a new mapping pair based on the storage arbitration result to update the data identifier mapping relationship.
5. The method according to claim 4, characterized in that, The storage adjudication result includes a second adjudication identifier and a second local identifier of the second target data; the step of constructing a new mapping pair based on the storage adjudication result to update the data identifier mapping relationship includes: The stored decision result is parsed to obtain the second decision identifier and the second local identifier of the second target data; wherein, the second decision identifier is obtained by the distribution arbitrator based on the second local identifier of the responses of the multiple online meta-services; The second adjudication identifier is used as the mapping index, and the second local identifier is used as the mapping result. The mapping index and the mapping result are combined to update the data identifier mapping relationship.
6. The method according to claim 1, characterized in that, The method further includes: Obtain a meta-service scheduling instruction; wherein, the meta-service scheduling instruction is obtained based on the request adjudication result of the request response message, and the request adjudication result is obtained by the distribution adjudicator adjudicating the request response messages of the multiple online meta-services; The service status is adjusted according to the meta-service scheduling instruction to change the online status of any online meta-service.
7. The method according to claim 6, characterized in that, The multiple online meta-services include a primary meta-service and multiple secondary meta-services; the step of adjusting the service status according to the meta-service scheduling instruction to change the online status of any of the online meta-services includes: If the request ruling indicates that any of the online meta-services is abnormal and requires meta-service scheduling, and if the online meta-service is a primary meta-service, service degradation is performed according to the meta-service scheduling instruction to downgrade the online meta-service to a secondary meta-service, and data synchronization is performed based on the metadata of the primary meta-service being upgraded; wherein, the upgrade of the primary meta-service is obtained by upgrading any one of the multiple secondary meta-services; Alternatively, if any of the online meta-services is a slave meta-service, the online status is adjusted according to the meta-service scheduling instruction to adjust any of the online meta-services to a standby state and perform cleaning and restoration.
8. A biomimetic data storage system, characterized in that, The system includes a client, a distribution arbitrator, multiple online meta-services, a meta-service scheduler, and a block data service. The distribution arbitrator is connected to the multiple online meta-services, the meta-service scheduler, and the block data service, respectively. The meta-service scheduler is connected to the multiple online meta-services. The multiple online meta-services are used to execute the method of any one of claims 1 to 7.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions for causing the computer to perform the method of any one of claims 1 to 7.
10. A computer program product, characterized in that, Includes computer instructions for causing a computer to perform the method of any one of claims 1 to 7.