Data processing method, device and equipment and computer storage medium

By introducing the identification information key-value pair module in the information service system, the problem of data loading errors when cached into memory is solved, the cached data is accurately obtained, and the system management and operation and maintenance complexity is reduced.

CN119441297APending Publication Date: 2025-02-14CHINA CONSTRUCTION BANK +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411538216.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-31
Publication Date
2025-02-14

AI Technical Summary

Technical Problem

In the prior art, data may have loading errors when cached into memory, and operation and maintenance personnel find it difficult to determine whether the cached data is loaded correctly, resulting in high system management complexity. Cache data of different data types requires independent operation and maintenance services, which adds Operation and maintenance cost and complexity.

Method used

By introducing the identification information key-value pair module in the system, the corresponding identification information key-value pair is obtained using the target identification information, thereby determining the target second identification information, and obtaining the corresponding cached data information in memory based on the identification information.

Benefits of technology

It realizes accurate acquisition of cached data, reduces the system's management complexity and operation and maintenance complexity, and ensures the correctness of data loading.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119441297A_ABST
    Figure CN119441297A_ABST
Patent Text Reader

Abstract

The invention discloses a data processing method, device and equipment and a computer storage medium, and is applied to the field of big data processing. According to the method, the identification information key value pair is obtained according to the first request information, and then the target second identification information is determined according to the identification information key value pair, so that the information of the cache data in the memory of the third module corresponding to the target second identification information is obtained, and the management complexity and the operation and maintenance complexity of the system can be reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of big data processing, and in particular to a method, device, equipment, computer storage medium and computer program product for data processing. Background Art

[0002] Information service systems can provide users with a variety of services. In order to improve the service efficiency of information service systems, in related technologies, data required for services are usually loaded into memory for caching, so that when users access the data, they can obtain the cached data from the memory, thereby reducing the time to obtain the cached data.

[0003] However, when data is cached in memory, data loading errors may occur because the operation and maintenance personnel do not know whether the data in the cache is loaded correctly. When problems occur in subsequent system services, the operation and maintenance personnel can only locate the problems by guessing and inferring, making the system management complex. In addition, in related technologies, a set of corresponding operation and maintenance services must be provided for cached data of different data types, which increases the operation and maintenance costs and complexity. Summary of the invention

[0004] The embodiments of the present disclosure provide a data processing method, apparatus, device, computer storage medium, and computer program product, which can reduce the management complexity and operation and maintenance complexity of the system.

[0005] In a first aspect, an embodiment of the present disclosure provides a data processing method, which is applied to a first system, and the method includes:

[0006] Using a first module of the first system to obtain first request information, the first request information including target first identification information and parameter information;

[0007] According to the target first identification information in the first request information, obtaining an identification information key-value pair from the second module of the first system, where the identification information key-value pair is used to record the correspondence between the first identification information and the second identification information, and the second identification information is used to identify the third module of the first system;

[0008] Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair;

[0009] Based on the parameter information of the first request information, information of cached data corresponding to the parameter information is obtained from the memory of the third module corresponding to the target second identification information.

[0010] In an achievable implementation, when the parameter information of the first request information includes memory type parameter information, service type parameter information, and cache data identification parameter information, based on the parameter information of the first request information, obtaining information of cache data corresponding to the parameter information from the memory of the third module corresponding to the target second identification information includes:

[0011] Determine, according to the memory type parameter information, a third module corresponding to the memory type parameter information;

[0012] The cache data information is obtained from the memory of the third module according to the service type parameter information and the cache data identification parameter information.

[0013] In an achievable implementation, after obtaining the first request information by using the first module of the first system, the data processing method further includes:

[0014] When the parameter information of the first request information is empty, obtaining first target module information corresponding to the first module;

[0015] or

[0016] In a case where the parameter information of the first request information includes memory type parameter information, determining a third module corresponding to the memory type parameter information according to the memory type parameter information;

[0017] Second target module information corresponding to the third module is acquired, where the second target module information includes first identification information corresponding to fourth modules of the plurality of first systems.

[0018] In an achievable implementation, before using the first module of the first system to obtain the first request information, the data processing method further includes:

[0019] Acquire second request information, where the second request information includes target first identification information, where the target first identification information is used to identify a fourth module of the first system;

[0020] Acquire the identification information key-value pair from the second module according to the target first identification information in the second request information;

[0021] Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair;

[0022] Based on the parameter information of the second request information, acquiring cache data from a fourth module corresponding to the target first identification information;

[0023] The cache data is loaded into the memory of the third module corresponding to the target second identification information.

[0024] In an achievable implementation, the memory in the third module includes a local memory, and after the cache data is loaded into the memory in the third module corresponding to the target second identification information, the data processing method further includes:

[0025] Using the first module to send a first instruction to the fifth module of the first system, the first instruction is used to load cache data;

[0026] After receiving the first instruction, the fifth module converts the first instruction and the data information corresponding to the first instruction into a first message;

[0027] A first message is sent to a fifth module of the second system.

[0028] In an achievable implementation, after the cache data is loaded into the memory of the third module corresponding to the target second identification information, the data processing method further includes:

[0029] Acquire third request information, where the third request information includes target first identification information;

[0030] According to the target first identification information in the third request information, obtaining the identification information key-value pair from the second module;

[0031] Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair;

[0032] Based on the parameter information of the third request information, determining the cache data to be uninstalled according to the fourth module corresponding to the target first identification information;

[0033] The cache data to be unloaded is unloaded from the memory in the third module corresponding to the target second identification information.

[0034] In an achievable implementation, the memory in the third module includes a local memory, and after the cache data to be unloaded is unloaded from the memory in the third module corresponding to the second identification information, the data processing method further includes:

[0035] Using the first module to send a second instruction to the fifth module of the first system, the second instruction is used to unload the cache data;

[0036] After receiving the second instruction, the fifth module converts the second instruction and the data information corresponding to the second instruction into a second message;

[0037] A second message is sent to the fifth module of the second system.

[0038] In a second aspect, an embodiment of the present disclosure provides a data processing device, which is applied to a first system, and the device includes:

[0039] An acquisition module, used to acquire first request information by using a first module of the first system, where the first request information includes target first identification information and parameter information;

[0040] The acquisition module is further used to acquire an identification information key-value pair from the second module of the first system according to the target first identification information in the first request information, the identification information key-value pair being used to record the corresponding relationship between the first identification information and the second identification information, and the second identification information being used to identify the third module of the first system;

[0041] A determination module, the determination module is used to determine the target second identification information corresponding to the target first identification information from the identification information key-value pair;

[0042] The acquisition module is also used to acquire information of cached data corresponding to the parameter information from the memory of the third module corresponding to the target second identification information based on the parameter information of the first request information.

[0043] In a third aspect, an embodiment of the present disclosure provides a data processing device, the device comprising a processor and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement a data processing method as described in any one of the first aspects.

[0044] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, a method for data processing as described in any one of the first aspects is implemented.

[0045] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which implements the data processing method as described in any one of the first aspects when the computer program is executed by a processor.

[0046] The embodiments of the present disclosure provide a method, device, equipment, computer storage medium and computer program product for data processing. The method uses a first module of a first system to obtain a first request information; according to the target first identification information in the first request information, obtain an identification information key-value pair from the second module of the first system; and determine the target second identification information corresponding to the target first identification information from the identification information key-value pair. By managing the target first identification information and the target second identification information through the identification information key-value pair, and accurately obtaining the cached data, the operation and maintenance complexity of the system can be reduced. Based on the parameter information of the first request information, the information of the cached data corresponding to the parameter information is obtained from the memory of the third module corresponding to the target second identification information. By obtaining the information of the cached data, it is possible to determine whether the data in the cache is loaded correctly based on the information of the cached data, thereby reducing the management complexity of the system. Therefore, the present disclosure obtains the identification information key-value pair according to the first request information, and then determines the target second identification information according to the identification information key-value pair, thereby obtaining the information of the cached data in the memory of the third module corresponding to the target second identification information, which can reduce the management complexity and operation and maintenance complexity of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solution of the embodiment of the present invention, the following is a brief introduction to the drawings required for use in the embodiment of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0048] Figure 1 is a flowchart of a data processing method provided by an embodiment of the present disclosure;

[0049] Figure 2 It is a flowchart of a method for obtaining cache data information provided by an embodiment of the present disclosure;

[0050] Figure 3 is a flowchart of a method for obtaining module information provided by an embodiment of the present disclosure;

[0051] Figure 4 It is a flowchart of a method for loading cache data provided by an embodiment of the present disclosure;

[0052] Figure 5 It is a flowchart of a method for synchronously loading cache data provided by an embodiment of the present disclosure;

[0053] Figure 6 It is a flowchart of a method for unloading cache data provided by an embodiment of the present disclosure;

[0054] Figure 7 It is a flowchart of a method for synchronously unloading cache data provided by an embodiment of the present disclosure;

[0055] Figure 8 is a schematic diagram of a first system provided by an embodiment of the present disclosure;

[0056] Fig. 9 is a structural diagram of data processing provided by an embodiment of the present disclosure;

[0057] Fig.10 It is a structural diagram of data processing provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0058] The features and exemplary embodiments of various aspects of the present invention will be described in detail below. In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present invention, rather than to limit the present invention. For those skilled in the art, the present invention can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present invention by illustrating examples of the present invention.

[0059] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0060] It should be noted that the acquisition, storage, use and processing of data in the embodiments of the present application are in compliance with the relevant provisions of national laws and regulations.

[0061] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0062] Before describing the technical solutions provided by the embodiments of the present disclosure, in order to facilitate understanding of the embodiments of the present disclosure, the present disclosure specifically describes the problems existing in the related technologies:

[0063] Information service systems can provide users with a variety of services. In order to improve the service efficiency of information service systems, in related technologies, data required for services are usually loaded into memory for caching, so that when users access the data, they can obtain the cached data from the memory, thereby reducing the time to obtain the cached data.

[0064] However, when data is cached in memory, data loading errors may occur, because the operation and maintenance personnel do not know whether the data in the cache is loaded correctly. When problems occur in subsequent system services, the operation and maintenance personnel can only locate the problems by guessing and inferring, which makes the system management complex. In addition, in related technologies, since different services rely on different data types and data structures, developing and providing operation and maintenance interfaces for the cache data of each service separately will increase the system development cost, system complexity and operation and maintenance complexity.

[0065] The embodiments of the present disclosure provide a data processing method, apparatus, device, computer storage medium, and computer program product, which can solve technical problems existing in related technologies.

[0066] The disclosed embodiment utilizes the first module of the first system to obtain the first request information; obtains the identification information key-value pair from the second module of the first system according to the target first identification information in the first request information; and determines the target second identification information corresponding to the target first identification information from the identification information key-value pair. By managing the target first identification information and the target second identification information through the identification information key-value pair, and accurately obtaining the cached data, the operation and maintenance complexity of the system can be reduced. Based on the parameter information of the first request information, the information of the cached data corresponding to the parameter information is obtained from the memory of the third module corresponding to the target second identification information. By obtaining the information of the cached data, it is possible to determine whether the data in the cache is loaded correctly based on the information of the cached data, thereby reducing the management complexity of the system. Therefore, the disclosed embodiment obtains the identification information key-value pair according to the first request information, and then determines the target second identification information according to the identification information key-value pair, thereby obtaining the information of the cached data in the memory of the third module corresponding to the target second identification information, which can reduce the management complexity and operation and maintenance complexity of the system.

[0067] The following is an introduction to the data processing method provided by the embodiments of the present disclosure.

[0068] Figure 1 FIG. 1 is a flow chart showing a method for data processing provided by an embodiment of the present disclosure. Figure 1 The method is executed by the first system and includes steps S110-S140.

[0069] S110: Acquire first request information using a first module of the first system.

[0070] The first system is a system for processing cache data. The first system is used to provide external services such as cache data viewing service, cache data loading service and cache data unloading service. The first request information represents cache data viewing request information, and the first request information includes target first identification information and parameter information.

[0071] In this embodiment, the first system obtains the first request information through an internal first module.

[0072] In one example, a user sends a first request message to a first system through an operation and maintenance program to view information about cached data, and the first system obtains the first request message using an internal first module.

[0073] S120: Acquire an identification information key-value pair from a second module of the first system according to the target first identification information in the first request information.

[0074] The identification information key-value pair is used to record the corresponding relationship between the first identification information and the second identification information, and the second identification information is used to identify the third module of the first system.

[0075] In this embodiment, after receiving the first request information, the first system obtains the identification information key-value pair from the second module of the first system according to the target first identification information in the first request information.

[0076] S130: Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair.

[0077] After the identification information key-value pair is obtained, the target second identification information corresponding to the target first identification information is determined according to the correspondence between the first identification information and the second identification information recorded in the identification information key-value pair.

[0078] S140: Based on the parameter information of the first request information, obtain information of cached data corresponding to the parameter information from the memory of the third module corresponding to the target second identification information.

[0079] The memory of the third module may include local memory or Redis distributed memory. The number of the third modules is not fixed, and may be one, two, or other numbers.

[0080] After determining the target second identification information, information of cache data corresponding to the parameter information is obtained from the memory of the third module corresponding to the target second identification information according to the parameter information of the first request information.

[0081] In one example, when the first module is initialized, it can scan all third modules in the first system and record them in the form of key-value pairs, where the key represents the identification information of the third module and the value represents the reference of the third module.

[0082] The disclosed embodiment obtains an identification information key-value pair based on the first request information, and then determines the target second identification information based on the identification information key-value pair, thereby obtaining information on cached data in the memory of the third module corresponding to the target second identification information, which can reduce the management complexity and operation and maintenance complexity of the system.

[0083] In one embodiment, when the parameter information of the first request information includes memory type parameter information, service type parameter information, and cache data identification parameter information, based on the parameter information of the first request information, information of cache data corresponding to the parameter information is obtained from the memory of the third module corresponding to the target second identification information, such as Figure 2 As shown, it may include step S141 and step S142.

[0084] S141: Determine, according to the memory type parameter information, a third module corresponding to the memory type parameter information.

[0085] A third module corresponding to the memory type parameter information is determined according to the memory type parameter information in the parameter information of the first request information.

[0086] In an example, if the memory type parameter information in the parameter information of the first request information is local memory, it is determined that a third module including the local memory is obtained.

[0087] S142: Obtain cache data information from the memory of the third module according to the service type parameter information and the cache data identification parameter information.

[0088] After the third module is determined, the cache data to be viewed is determined according to the service type parameter information, and the cache data to be viewed is determined according to the cache data identification parameter information. The cache data information is obtained from the memory of the third module.

[0089] The information of the cached data may include attribute information of the cached data.

[0090] In one example, the service type parameter information of the parameter information in the first request information is viewing data, and the cache data identification parameter information of the parameter information in the first request information is student S. The information of student S is obtained from the memory of the third module according to the service type parameter information and the cache data identification parameter information.

[0091] The embodiment of the present disclosure can accurately obtain information about cache data in the memory through the memory type parameter information, service type parameter information and cache data identification parameter information in the first request information.

[0092] In one embodiment, after obtaining the first request information using the first module of the first system, Figure 3 As shown, the data processing method also includes steps S150-S170.

[0093] S150: When the parameter information of the first request information is empty, obtain first target module information corresponding to the first module.

[0094] After the first request information is acquired by using the first module of the first system, if the parameter information in the first request information is empty, first target module information corresponding to the first module is acquired.

[0095] The first target module information includes module information managed by the first module.

[0096] S160: When the parameter information of the first request information includes memory type parameter information, determine a third module corresponding to the memory type parameter information according to the memory type parameter information.

[0097] After receiving the first request information, if the parameter information in the first request information includes memory type parameter information, a third module corresponding to the memory type parameter information is determined according to the memory type parameter information.

[0098] S170: Acquire second target module information corresponding to the third module.

[0099] The second target module information includes first identification information corresponding to the fourth modules of the plurality of first systems.

[0100] After the third module is determined, second target module information corresponding to the third module is acquired.

[0101] The embodiment of the present disclosure can obtain corresponding information by receiving first request information carrying different parameters, thereby reducing the complexity of system management.

[0102] In one embodiment, before obtaining the first request information using the first module of the first system, Figure 4 As shown, the data processing method also includes steps S210-S250.

[0103] S210: Obtain second request information.

[0104] The second request information includes target first identification information, and the target first identification information is used to identify the fourth module of the first system.

[0105] The fourth module is used to provide cache data, and the number of the fourth modules is not fixed, and may be one, two, or another number.

[0106] In this embodiment, the second request information is obtained through the first module of the first system.

[0107] In one example, a user sends second request information to the first system through an operation and maintenance program for loading cache data, and the first system obtains the second request information using an internal first module.

[0108] S220: Acquire an identification information key-value pair from the second module according to the target first identification information in the second request information.

[0109] In this embodiment, after receiving the second request information, the first system obtains the identification information key-value pair from the second module of the first system according to the target first identification information in the second request information.

[0110] S230: Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair.

[0111] After the identification information key-value pair is obtained, the target second identification information corresponding to the target first identification information is determined according to the correspondence between the first identification information and the second identification information recorded in the identification information key-value pair.

[0112] S240: Based on the parameter information of the second request information, obtain cache data from a fourth module corresponding to the target first identification information.

[0113] After determining the target second identification information, the cache data is obtained from the fourth module corresponding to the target first identification information according to the parameter information of the second request information.

[0114] S250: Load the cache data into the memory of the third module corresponding to the target second identification information.

[0115] After the cache data is acquired, the acquired cache data is loaded into the memory in the third module corresponding to the target second identification information.

[0116] The third module records the information of the fourth module in the form of a key-value pair, wherein the key represents the identification information of the fourth module and the value represents the reference to the fourth module instance. The third module can also record the information between the fourth module and the cached data in the form of a key-value pair, wherein the key represents the identification information of the fourth module and the value represents the reference to the cached data.

[0117] The disclosed embodiment uses the obtained identification information key-value pair to determine the target second identification information, so that based on the target first identification information and the target second identification information, the cache data of the fourth module can be obtained and loaded into the memory of the third module, so that the system cache data loading service can be realized. By centrally processing the cache data of the fourth module, the operation and maintenance complexity of the system can be reduced.

[0118] In one embodiment, the memory in the third module includes local memory, such as Figure 5 As shown, after the cache data is loaded into the memory in the third module corresponding to the target second identification information, the data processing method further includes steps S260-S280.

[0119] S260: Use the first module to send a first instruction to the fifth module of the first system.

[0120] The fifth module of the first system is used to synchronize cache data processing information to the second system of other hosts. The second system has the same functions and modules as the first system. The first instruction is used to load cache data.

[0121] If it is detected that the cache data of the fourth module is loaded into the memory of the third module, the first module is used to send a first instruction to the fifth module of the first system.

[0122] S270: After receiving the first instruction, the fifth module converts the first instruction and the data information corresponding to the first instruction into a first message.

[0123] In this embodiment, after the fifth module receives the first instruction, the format of the first instruction and the data information corresponding to the first instruction is converted into a message format to obtain a first message.

[0124] S280: Send a first message to the fifth module of the second system.

[0125] After the first message is obtained through conversion, the first message is sent to the fifth module of the second system.

[0126] In an example, the first message may be sent to the fifth module of the second system via Hyper Text Transfer Protocol (HTTP).

[0127] In one example, after receiving the first message, the fifth module of the second system parses the first message to obtain a first instruction, and sends the first instruction to the first module of the second system, so as to process the data information corresponding to the first instruction for loading cache data.

[0128] In an example, the fifth module can obtain the server IP and service address in the database or configuration file to send the first message to the second system according to the IP information and address information.

[0129] In another example, if the first system is a system with a microservice architecture, the fifth module of the first system can obtain the server IP and service address information from the registration center to send the first message to the second system according to the IP information and address information.

[0130] The disclosed embodiment sends a first message to a second system through a first system, can perform the same data loading process on the same cache data on different systems, can realize synchronous processing of cache data by multiple systems, and thus reduce the operation and maintenance complexity of the system.

[0131] In one embodiment, after the cache data is loaded into the memory of the third module corresponding to the target second identification information, as shown in FIG. Figure 6 As shown, the data processing method also includes steps S310-S350.

[0132] S310: Obtain third request information.

[0133] The third request information includes the target first identification information.

[0134] In this embodiment, the third request information is obtained through the first module of the first system.

[0135] In one example, a user sends third request information to the first system through an operation and maintenance program for unloading cache data, and the first system obtains the third request information using an internal first module.

[0136] S320: Acquire an identification information key-value pair from the second module according to the target first identification information in the third request information.

[0137] In this embodiment, after receiving the third request information, the first system obtains the identification information key-value pair from the second module of the first system according to the target first identification information in the third request information.

[0138] S330: Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair.

[0139] After the identification information key-value pair is obtained, the target second identification information corresponding to the target first identification information is determined according to the correspondence between the first identification information and the second identification information recorded in the identification information key-value pair.

[0140] S340: Based on the parameter information of the third request information, determine the cache data to be uninstalled according to the fourth module corresponding to the target first identification information.

[0141] After determining the target second identification information, the cache data to be uninstalled is determined from the fourth module corresponding to the target first identification information according to the parameter information of the third request information.

[0142] S350: Unload the cache data to be unloaded from the memory in the third module corresponding to the target second identification information.

[0143] After determining the cache data to be unloaded, the cache data to be unloaded is unloaded from the memory in the third module corresponding to the target second identification information.

[0144] The disclosed embodiment uses the obtained identification information key-value pair to determine the target second identification information, and can determine the cache data of the fourth module and unload the corresponding cache data in the memory of the third module based on the target first identification information and the target second identification information, thereby realizing the system cache data unloading service. By centrally processing the cache data of the fourth module, the operation and maintenance complexity of the system can be reduced.

[0145] In one embodiment, the memory in the third module includes a local memory. After the cache data to be unloaded is unloaded from the memory in the third module corresponding to the second identification information, as follows: Figure 7 As shown, the data processing method also includes steps S360-S380.

[0146] S360: Use the first module to send a second instruction to the fifth module of the first system.

[0147] The second instruction is used to unload cache data.

[0148] If it is detected that the cache data in the memory of the third module has been unloaded, the first module is used to send a second instruction to the fifth module of the first system.

[0149] S370: After receiving the second instruction, the fifth module converts the second instruction and the data information corresponding to the second instruction into a second message.

[0150] In this embodiment, after the fifth module receives the second instruction, the format of the second instruction and the data information corresponding to the second instruction is converted into a message format to obtain a second message.

[0151] S380: Send a second message to the fifth module of the second system.

[0152] After the second message is obtained through conversion, the second message is sent to the fifth module of the second system.

[0153] In one example, after receiving the second message, the fifth module of the second system parses the second message to obtain a second instruction, and sends the second instruction to the first module of the second system, so as to process the data information corresponding to the second instruction for unloading cache data.

[0154] In an example, the fifth module can obtain the server IP and service address in the database or configuration file to send the second message to the second system according to the IP information and address information.

[0155] In another example, if the first system is a system with a microservice architecture, the fifth module of the first system can obtain the server IP and service address information from the registration center to send a second message to the second system according to the IP information and address information.

[0156] The disclosed embodiment sends the second message to the second system through the first system, so as to perform the same data offloading processing on the same cache data on different systems, and realize the synchronous processing of cache data by multiple systems, thereby reducing the operation and maintenance complexity of the system.

[0157] In one example, a schematic diagram of the first system is as follows Figure 8 As shown, the first system includes a first module 801, a second module 802, a plurality of third modules 803, a plurality of fourth modules 804, and a fifth module 805. Each third module 803 includes a plurality of memories 806.

[0158] like Fig. 9 As shown, the embodiment of the present disclosure further provides a data processing device 900, and the data processing device 900 includes:

[0159] An acquisition module 901 is used to acquire first request information by using a first module of a first system, where the first request information includes target first identification information and parameter information;

[0160] The acquisition module 901 is further used to acquire an identification information key-value pair from the second module of the first system according to the target first identification information in the first request information, where the identification information key-value pair is used to record the corresponding relationship between the first identification information and the second identification information, and the second identification information is used to identify the third module of the first system;

[0161] A determination module 902, the determination module is used to determine the target second identification information corresponding to the target first identification information from the identification information key-value pair;

[0162] The acquisition module 901 is further used to acquire information of cached data corresponding to the parameter information from the memory of the third module corresponding to the target second identification information based on the parameter information of the first request information.

[0163] The disclosed embodiment obtains an identification information key-value pair based on the first request information, and then determines the target second identification information based on the identification information key-value pair, thereby obtaining information on cached data in the memory of the third module corresponding to the target second identification information, which can reduce the management complexity and operation and maintenance complexity of the system.

[0164] In some embodiments, the determination module 902 is specifically configured to:

[0165] Determine, according to the memory type parameter information, a third module corresponding to the memory type parameter information;

[0166] The cache data information is obtained from the memory of the third module according to the service type parameter information and the cache data identification parameter information.

[0167] In some embodiments, the acquisition module 901 is specifically used to:

[0168] When the parameter information of the first request information is empty, obtaining first target module information corresponding to the first module;

[0169] or

[0170] In a case where the parameter information of the first request information includes memory type parameter information, determining a third module corresponding to the memory type parameter information according to the memory type parameter information;

[0171] Second target module information corresponding to the third module is acquired, where the second target module information includes first identification information corresponding to fourth modules of the plurality of first systems.

[0172] In some embodiments, the acquisition module 901 is specifically used to:

[0173] Acquire second request information, where the second request information includes target first identification information, where the target first identification information is used to identify a fourth module of the first system;

[0174] Acquire the identification information key-value pair from the second module according to the target first identification information in the second request information;

[0175] Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair;

[0176] Based on the parameter information of the second request information, acquiring cache data from a fourth module corresponding to the target first identification information;

[0177] The cache data is loaded into the memory of the third module corresponding to the target second identification information.

[0178] In some embodiments, the data processing device 900 includes a sending module, and the sending module is specifically used to:

[0179] Using the first module to send a first instruction to the fifth module of the first system, the first instruction is used to load cache data;

[0180] After receiving the first instruction, the fifth module converts the first instruction and the data information corresponding to the first instruction into a first message;

[0181] A first message is sent to a fifth module of the second system.

[0182] In some embodiments, the acquisition module 901 is specifically used to:

[0183] Acquire third request information, where the third request information includes target first identification information;

[0184] According to the target first identification information in the third request information, obtaining the identification information key-value pair from the second module;

[0185] Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair;

[0186] Based on the parameter information of the third request information, determining the cache data to be uninstalled according to the fourth module corresponding to the target first identification information;

[0187] The cache data to be unloaded is unloaded from the memory in the third module corresponding to the target second identification information.

[0188] In some embodiments, the data processing device 900 includes a sending module, and the sending module is specifically used to:

[0189] Using the first module to send a second instruction to the fifth module of the first system, the second instruction is used to unload the cache data;

[0190] After receiving the second instruction, the fifth module converts the second instruction and the data information corresponding to the second instruction into a second message;

[0191] A second message is sent to the fifth module of the second system.

[0192] Fig. 9 Each module / unit in the device shown has the function of realizing Figures 1 to 7 The functions of each step executed by the application system in the present invention can achieve the corresponding technical effects. For the sake of brevity, they will not be repeated here.

[0193] Fig.10 A schematic diagram of the hardware structure of data processing provided by an embodiment of the present disclosure is shown.

[0194] The data processing device may include a processor 1001 and a memory 1002 storing computer program instructions.

[0195] Specifically, the processor 1001 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0196] The memory 1002 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 1002 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 1002 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 1002 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 1002 is a non-volatile solid-state memory.

[0197] The memory 1002 may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical / tangible memory storage device. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to one aspect of the present disclosure.

[0198] The processor 1001 implements any one of the data processing methods in the above embodiments by reading and executing computer program instructions stored in the memory 1002 .

[0199] In one example, the data processing device may further include a communication interface 1003 and a bus 1004. Fig.10 As shown, the processor 1001, the memory 1002, and the communication interface 1003 are connected via a bus 1004 and communicate with each other.

[0200] The communication interface 1003 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0201] Bus 1004 includes hardware, software or both, and couples the components of online data flow billing equipment to each other. For example, but not limitation, the bus may include Accelerated Graphics Port (AGP) or other graphics bus, Enhanced Industry Standard Architecture (EISA) bus, Front Side Bus (FSB), Hyper Transport (HT) interconnection, Industry Standard Architecture (ISA) bus, InfiniBand interconnection, Low Pin Count (LPC) bus, Memory bus, Micro Channel Architecture (MCA) bus, Peripheral Component Interconnect (PCI) bus, PCI-Express (PCI-X) bus, Serial Advanced Technology Attachment (SATA) bus, Video Electronics Standards Association Local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 1004 may include one or more buses. Although the embodiment of the present invention describes and shows a specific bus, the present invention considers any suitable bus or interconnection. In addition, in conjunction with the method for data processing in the above-mentioned embodiment, the embodiment of the present application also provides a computer storage medium to realize. The computer storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the data processing methods in the above embodiments is implemented.

[0202] An embodiment of the present application also provides a computer program product, including a computer program, which implements any one of the data processing methods in the above embodiments when the computer program is executed by a processor.

[0203] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present invention.

[0204] The functional blocks shown in the above structural block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), appropriate firmware, plug-in, function card, etc. When implemented in software, the elements of the present invention are programs or code segments used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or communication link by a data signal carried in a carrier. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, read-only memory (Read-Only Memory, ROM), flash memory, erasable read-only memory (Erasable ReadOnly Memory, EROM), floppy disks, compact disc read-only memory (Compact Disc Read-Only Memory, CD-ROM), optical discs, hard disks, optical fiber media, radio frequency (Radio Frequency, RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0205] It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiments, or in a different order from the embodiments, or several steps can be performed simultaneously.

[0206] Aspects of the present disclosure are described above with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the embodiment of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0207] The above is only a specific implementation of the present invention. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the system, module and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. It should be understood that the protection scope of the present invention is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be covered within the protection scope of the present invention.

Claims

1. A method for data processing, characterized in that: Applied to the first system, the method comprises: Using the first module of the first system to obtain first request information, the first request information including target first identification information and parameter information; According to the target first identification information in the first request information, obtaining an identification information key-value pair from the second module of the first system, the identification information key-value pair being used to record the correspondence between the first identification information and the second identification information, the second identification information being used to identify the third module of the first system; Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair; Based on the parameter information of the first request information, information of cached data corresponding to the parameter information is obtained from the memory of the third module corresponding to the target second identification information.

2. The method according to claim 1, characterized in that: In a case where the parameter information of the first request information includes memory type parameter information, service type parameter information, and cache data identification parameter information, the acquiring, based on the parameter information of the first request information, information of cache data corresponding to the parameter information from the memory of the third module corresponding to the target second identification information includes: Determining, according to the memory type parameter information, a third module corresponding to the memory type parameter information; The cache data information is acquired from the memory of the third module according to the service type parameter information and the cache data identification parameter information.

3. The method according to claim 1, characterized in that After acquiring the first request information by using the first module of the first system, the method further includes: When the parameter information of the first request information is empty, obtaining first target module information corresponding to the first module; or In a case where the parameter information of the first request information includes memory type parameter information, determining a third module corresponding to the memory type parameter information according to the memory type parameter information; Second target module information corresponding to the third module is acquired, where the second target module information includes first identification information corresponding to a plurality of fourth modules of the first system.

4. The method according to claim 1, characterized in that Before acquiring the first request information by using the first module of the first system, the method further includes: Acquire second request information, where the second request information includes the target first identification information, where the target first identification information is used to identify a fourth module of the first system; According to the target first identification information in the second request information, acquiring the identification information key-value pair from the second module; Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair; Based on the parameter information of the second request information, acquiring the cache data from a fourth module corresponding to the target first identification information; The cache data is loaded into the memory of the third module corresponding to the target second identification information.

5. The method according to claim 4, characterized in that The memory in the third module includes a local memory. After the cache data is loaded into the memory in the third module corresponding to the target second identification information, the method further includes: Using the first module to send a first instruction to a fifth module of the first system, where the first instruction is used to load cache data; After the fifth module receives the first instruction, converting the first instruction and data information corresponding to the first instruction into a first message; The first message is sent to a fifth module of the second system.

6. The method according to claim 4, characterized in that After loading the cache data into the memory of the third module corresponding to the target second identification information, the method further includes: Acquire third request information, where the third request information includes the first identification information of the target; According to the target first identification information in the third request information, acquiring the identification information key-value pair from the second module; Determine the target second identification information corresponding to the target first identification information from the identification information key-value pair; Based on the parameter information of the third request information, determining the cache data to be uninstalled according to the fourth module corresponding to the target first identification information; The cache data to be unloaded is unloaded from the memory in the third module corresponding to the target second identification information.

7. The method according to claim 6, characterized in that The memory in the third module includes a local memory. After the cache data to be unloaded is unloaded from the memory in the third module corresponding to the second identification information, the method further includes: Using the first module to send a second instruction to a fifth module of the first system, where the second instruction is used to unload cache data; After the fifth module receives the second instruction, converting the second instruction and data information corresponding to the second instruction into a second message; The second message is sent to the fifth module of the second system.

8. A data processing device, characterized in that: Applied to the first system, the device comprises: an acquisition module, the acquisition module being used to acquire first request information by using the first module of the first system, the first request information including target first identification information and parameter information; The acquisition module is further used to acquire an identification information key-value pair from the second module of the first system according to the target first identification information in the first request information, wherein the identification information key-value pair is used to record the corresponding relationship between the first identification information and the second identification information, and the second identification information is used to identify the third module of the first system; A determination module, the determination module is used to determine the target second identification information corresponding to the target first identification information from the identification information key-value pair; The acquisition module is further used to acquire, based on the parameter information of the first request information, information of cached data corresponding to the parameter information from the memory of the third module corresponding to the target second identification information.

9. A data processing device, characterized in that: The device comprises: a processor and a memory storing computer program instructions; the processor reads and executes the computer program instructions to implement the data processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the method for data processing according to any one of claims 1 to 7 is implemented.

11. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, implements the data processing method according to any one of claims 1 to 7.