Data management method, device, equipment, system and computer-readable storage medium
Through Zookeeper, the access system is monitored and registered and updated with data templates, and the notification message is pushed to the client, which solves the network overhead and pressure problems of the data management platform, realizes efficient data management, and avoids the risk of platform crash.
Patent Information
- Application Number
- CN201910772396.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-08-19
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2039-08-19
AI Technical Summary
In the existing data management process, there are problems such as large network overhead and high pressure on the data management platform, especially when there are many access systems or large requests, it is easy to cause the platform to collapse.
Zookeeper performs monitoring registration and data template modification and update of the target access system. If the modified and updated data template belongs to the target access system, a notification message will be sent to the client to make the client update the local cache, thereby reducing the data management platform network request.
It greatly saves network overhead, avoids the pressure caused by the unavailability of the data management platform and excessive access systems, and prevents the platform from crashing.
Smart Images

Figure CN110471884B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of financial technology (Fintech), and in particular to a data management method, device, equipment, system and computer-readable storage medium. Background Art
[0002] With the development of computer technology, more and more technologies (big data, distributed, blockchain, artificial intelligence, etc.) are being applied in the financial field. The traditional financial industry is gradually transforming to financial technology (Fintech). However, due to the security and real-time requirements of the financial industry, higher requirements are also placed on technology.
[0003] In recent years, with the continuous development of Fintech, especially Internet technology finance, the business systems of banks and other financial institutions have continued to increase, and the corresponding data has also continued to increase. It is usually necessary to build a special data management platform to manage the data of each business system. For example, taking copywriting management as an example, at present, the copywriting of each business system is stored in the copywriting management platform. When each business system receives a business processing request, it processes the corresponding business logic of the business, and then queries the corresponding copywriting from the copywriting management platform according to the processing result. Every time a query request is initiated, it is a network request, and the network overhead is large. In addition, when there are many business systems connected or the number of requests to the access system is large, the copywriting management platform will become a bottleneck. Once the copywriting management platform becomes a bottleneck, it will affect other access systems and cause an avalanche. Therefore, in the existing data management process, there is a problem of large network overhead and high pressure on the data management platform. Summary of the invention
[0004] The main purpose of the present invention is to provide a data management method, device, equipment, system and computer-readable storage medium, aiming to solve the problem of large network overhead and high pressure on the data management platform in the existing data management process.
[0005] To achieve the above object, the present invention provides a data management method, the data management method comprising:
[0006] When receiving the monitoring request, obtaining the target access system according to the monitoring request, and performing monitoring registration on the target access system through Zookeeper;
[0007] When receiving a data template modification request, modify and update the corresponding target data template according to the data template modification request, and detect through the Zookeeper whether the modified and updated target data template belongs to the target access system;
[0008] If the modified and updated target data template belongs to the target access system, a notification message is sent to the client corresponding to the monitoring request through the Zookeeper, so that the client updates the local cache of the target access system according to the notification message.
[0009] Optionally, upon receiving the data template modification request, modifying and updating the corresponding target data template according to the data template modification request, and detecting through the Zookeeper whether the modified and updated target data template belongs to the target access system, includes:
[0010] When receiving a data template modification request, obtaining a target data template and modification information according to the data template modification request;
[0011] Modifying and updating the target data template based on the modification information, and storing the modified and updated target data template in the Zookeeper;
[0012] The Zookeeper is used to detect whether the modified and updated target data template belongs to the target access system.
[0013] Optionally, before the step of modifying and updating the corresponding target data template according to the data template modification request, the step further includes:
[0014] Acquire modification request initiator information according to the data template modification request;
[0015] Detecting whether the initiator of the modification request has modification authority according to the modification request initiator information;
[0016] If the initiator of the modification request has the modification authority, the steps are executed: modifying and updating the corresponding target data template according to the data template modification request;
[0017] If the modification request initiator does not have the modification authority, a prompt message indicating that there is no modification authority is generated and returned to the modification request initiator corresponding to the data template modification request.
[0018] Optionally, the data management method includes:
[0019] When receiving the data template error information reported by the client, obtaining the last modification party information of the data template corresponding to the data template error information;
[0020] Generate corresponding prompt information and send it to the terminal corresponding to the information of the last modifier to notify the last modifier to perform error detection.
[0021] Optionally, the data management method further includes:
[0022] When receiving the data template acquisition request of the target access system sent by the client, the data template corresponding to the target access system is called from the Zookeeper and returned to the client, so that the client stores the data template in the local cache of the target access system.
[0023] In addition, to achieve the above object, the present invention further provides a data management device, the data management device comprising:
[0024] A registration module, configured to, upon receiving a monitoring request, obtain a target access system according to the monitoring request, and perform monitoring registration on the target access system through Zookeeper;
[0025] A detection module, configured to modify and update the corresponding target data template according to the data template modification request when receiving the data template modification request, and detect through the Zookeeper whether the modified and updated target data template belongs to the target access system;
[0026] The notification module is used to send a notification message to the client corresponding to the monitoring request through the Zookeeper if the modified and updated target data template belongs to the target access system, so that the client updates the local cache of the target access system according to the notification message.
[0027] In addition, to achieve the above-mentioned purpose, the present invention also provides a data management device, which includes: a memory, a processor, and a data management program stored in the memory and executable on the processor, and the data management program implements the steps of the data management method described above when executed by the processor.
[0028] In addition, to achieve the above-mentioned purpose, the present invention also provides a data management system, which includes a data management device and a client; wherein,
[0029] The data management device is the data management device as described above;
[0030] The client is used to obtain the updated data template according to the notification message when receiving the notification message of the data template update returned by the data management device through Zookeeper, and update the local cache of the target access system according to the updated data template.
[0031] Optionally, the client is further used for:
[0032] intercepting the processing result generated by the target access system through a preset interceptor, and obtaining a template code and result parameters from the processing result;
[0033] Acquire a data template corresponding to the template code from a local cache of the target access system, and generate corresponding data information according to the data template and the result parameter;
[0034] The data information is returned to the target access system, so that the target access system feeds back the data information to the corresponding processing request initiator.
[0035] In addition, to achieve the above-mentioned purpose, the present invention further provides a computer-readable storage medium, on which a data management program is stored, and when the data management program is executed by a processor, the steps of the data management method described above are implemented.
[0036] The present invention provides a data management method, device, equipment, system and computer-readable storage medium. When a monitoring request is received, a target access system is obtained according to the monitoring request, and then the target access system is monitored and registered through Zookeeper; when a data template modification request is received, the corresponding target data template can be modified and updated according to the data template modification request, and Zookeeper is used to detect whether the modified and updated target data template belongs to the target access system; if it belongs, a notification message is sent to a client that initiates the monitoring request through Zookeeper, so that the client updates the local cache of the target access system according to the notification message, so that when the subsequent client intercepts the processing result of the target access system, the data template can be directly obtained from the local cache of the target access system according to the template code in the processing result, without initiating a network request to a data management platform to call the data template. Compared with the prior art, the network overhead in the present invention is only that the data management platform pushes the modified and updated data template (i.e., the notification message). Therefore, the present invention can greatly save network overhead. At the same time, the present invention can also avoid the situation where the access system is affected by the unavailability of the data management platform, and can also avoid the data management platform being under great pressure or even crashing due to too many access systems or a large number of access system requests. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 A schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention;
[0038] Figure 2 It is a flowchart of the first embodiment of the data management method of the present invention;
[0039] Figure 3 It is a schematic diagram of functional modules of the first embodiment of the data management device of the present invention.
[0040] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0041] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.
[0042] Reference Figure 1 , Figure 1 The figure is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.
[0043] The data management device in the embodiment of the present invention may be a smart phone, or may be a terminal device such as a PC (Personal Computer), a tablet computer, or a portable computer.
[0044] like Figure 1 As shown, the data management device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the user interface 1003 may optionally include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory, or it may be a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.
[0045] Those skilled in the art will understand that Figure 1 The data management device structure shown in the figure does not constitute a limitation on the data management device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0046] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a data management program.
[0047] exist Figure 1 In the terminal shown, the network interface 1004 is mainly used to connect to the backend server and perform data communication with the backend server; the user interface 1003 is mainly used to connect to the client and perform data communication with the client; and the processor 1001 can be used to call the data management program stored in the memory 1005 and perform the following operations:
[0048] When receiving the monitoring request, obtaining the target access system according to the monitoring request, and performing monitoring registration on the target access system through Zookeeper;
[0049] When receiving a data template modification request, modify and update the corresponding target data template according to the data template modification request, and detect through the Zookeeper whether the modified and updated target data template belongs to the target access system;
[0050] If the modified and updated target data template belongs to the target access system, a notification message is sent to the client corresponding to the monitoring request through the Zookeeper, so that the client updates the local cache of the target access system according to the notification message.
[0051] Further, the processor 1001 may call the data management program stored in the memory 1005, and further perform the following operations:
[0052] When receiving a data template modification request, obtaining a target data template and modification information according to the data template modification request;
[0053] Modifying and updating the target data template based on the modification information, and storing the modified and updated target data template in the Zookeeper;
[0054] The Zookeeper is used to detect whether the modified and updated target data template belongs to the target access system.
[0055] Further, the processor 1001 may call the data management program stored in the memory 1005, and further perform the following operations:
[0056] Acquire modification request initiator information according to the data template modification request;
[0057] Detecting whether the initiator of the modification request has modification authority according to the modification request initiator information;
[0058] If the initiator of the modification request has the modification authority, the corresponding target data template is modified and updated according to the data template modification request;
[0059] If the modification request initiator does not have the modification authority, a prompt message indicating that there is no modification authority is generated and returned to the modification request initiator corresponding to the data template modification request.
[0060] Further, the processor 1001 may call the data management program stored in the memory 1005, and further perform the following operations:
[0061] When receiving the data template error information reported by the client, obtaining the last modification party information of the data template corresponding to the data template error information;
[0062] Generate corresponding prompt information and send it to the terminal corresponding to the information of the last modifier to notify the last modifier to perform error detection.
[0063] Further, the processor 1001 may call the data management program stored in the memory 1005, and further perform the following operations:
[0064] When receiving the data template acquisition request of the target access system sent by the client, the data template corresponding to the target access system is called from the Zookeeper and returned to the client, so that the client stores the data template in the local cache of the target access system.
[0065] Based on the above hardware structure, various embodiments of the data management method of the present invention are proposed.
[0066] The invention provides a data management method.
[0067] Reference Figure 2 , Figure 2 FIG. 1 is a flow chart of a first embodiment of a data management method according to the present invention.
[0068] In this embodiment, the data management method includes:
[0069] Step S10, when receiving the monitoring request, obtaining the target access system according to the monitoring request, and performing monitoring registration on the target access system through Zookeeper;
[0070] The data management method of this embodiment is implemented by a data management device, which is described by taking a server as an example. The server is equipped with a data management platform, wherein the data management platform uses Zookeeper technology, so that the data templates of each access system can be distributedly stored through Zookeeper, and the update operation of the data template of the access system that has been monitored and registered can also be notified through Zookeeper, so that the local cache of the access system is synchronously updated to ensure data consistency. Among them, the data template can be a copy template, a report template, etc.
[0071] In this embodiment, when the access system needs to access the data management platform, the corresponding data management platform client package can be introduced through the client, and the data management platform address can be configured at the same time. When the access system starts the service, the client will be initialized, and the client can initiate a monitoring request. At this time, when the data management platform receives the monitoring request, it obtains the target access system according to the monitoring request, and then monitors and registers the target access system through Zookeeper.
[0072] Step S20, when receiving the data template modification request, modify and update the corresponding target data template according to the data template modification request, and detect whether the modified and updated target data template belongs to the target access system through the Zookeeper;
[0073] When the data template of the access system needs to be modified, product managers and other staff can enter the corresponding modification information in the corresponding software or App (Application) through the management terminal (such as PC, smart phone, etc.), thereby triggering a data template modification request. At this time, when the data management platform receives the data template modification request, it can modify and update the corresponding target data template according to the data template modification request, and detect through Zookeeper whether the modified and updated target data template belongs to the target access system.
[0074] Specifically, step S20 includes:
[0075] Step a1, when a data template modification request is received, obtaining a target data template and modification information according to the data template modification request;
[0076] When a data template modification request is received, the target data template and modification information are obtained according to the data template modification request, wherein the target data template may be the name or number of the data template to be modified, and the modification information may include but is not limited to the modification type (such as deletion, modification, addition, etc.), modification content (such as the specific content of the data template to be modified before and after modification, the newly added data template content, etc.).
[0077] Step a2, modifying and updating the target data template based on the modification information, and storing the modified and updated target data template in the Zookeeper;
[0078] After obtaining the target data template and modification information, the target data template is modified and updated, and the modified and updated target data template is stored in Zookeeper for distributed storage.
[0079] Step a3: Detecting through the Zookeeper whether the modified and updated target data template belongs to the target access system.
[0080] Then, Zookeeper is used to detect whether the modified and updated target data template belongs to the target access system.
[0081] Furthermore, to ensure that the modifying party has modification authority and the modification is legal, before the above step of "obtaining the target data template and modification information according to the data template modification request", it also includes:
[0082] Step a4, obtaining information of a modification request initiator according to the data template modification request;
[0083] Step a5, detecting whether the initiator of the modification request has modification authority according to the information of the initiator of the modification request;
[0084] When receiving a data template modification request, it is possible to first detect whether the modifier has the modification authority. Specifically, the modification request initiator information can be obtained according to the data template modification request, wherein the modification request initiator information may include but is not limited to: account information, account level, etc. Then, it is detected whether the modification request initiator has the modification authority according to the modification request initiator information. For example, it can be detected by detecting whether the account information is in the preset authority list, or by detecting whether the account level is the preset authority level.
[0085] Of course, it is understandable that in a specific embodiment, different modification permissions can be set for different modification parties. For example, the scope of data templates allowed to be modified is different, and the scope of operations allowed to be performed on the data templates is different (such as only having one or more of the operation scopes of deletion, modification, and addition). At this time, when a data template modification request is received, in addition to obtaining the modification request initiator information, it is also necessary to obtain the target data template and modification information, and then detect whether the modification request initiator has the modification permission based on the modification request initiator information, the target data template and the modification information.
[0086] If the initiator of the modification request has the modification authority, the steps are executed: modifying and updating the corresponding target data template according to the data template modification request;
[0087] If it is detected that the initiator of the modification request has the modification authority, the corresponding target data template is modified and updated according to the data template modification request, and then the subsequent steps are continued.
[0088] Step a6: If the modification request initiator does not have the modification authority, a prompt message indicating that there is no modification authority is generated and returned to the modification request initiator corresponding to the data template modification request.
[0089] If it is detected that the initiator of the modification request does not have the modification authority, a prompt message indicating that there is no modification authority is generated and returned to the modification request initiator corresponding to the data template modification request. Of course, when it is detected multiple times (a preset number of times) that the data template modification requests initiated by the same modification request initiator do not have the operation authority, a corresponding prompt message can also be sent to the preset management end to inform the management that someone is trying to modify the data template that is not within the scope of authority.
[0090] Step S30: If the modified and updated target data template belongs to the target access system, a notification message is sent to the client corresponding to the monitoring request through the Zookeeper, so that the client updates the local cache of the target access system according to the notification message.
[0091] If it is detected that the modified and updated target data template belongs to the target access system, a notification message is sent to the client that initiated the monitoring request through Zookeeper, so that the client updates the local cache of the target access system according to the notification message. Among them, the local cache of the target access system is used to store the data template of the target access system for direct call by the client, and then generate the corresponding data information, so that there is no need to initiate a network request to the data management platform to call the data template, which can save network overhead. At the same time, it can avoid the situation where the access system is affected by the unavailability of the data management platform, and it can also avoid the data management platform from being under great pressure or even crashing due to too many access systems or a large number of access system requests.
[0092] In the data management process of financial institutions such as banks, the present invention takes document management as an example. When the document management platform receives a monitoring request, it obtains the target access system according to the monitoring request, and monitors and registers the target access system through Zookeeper; then, when the document template of the target access system is updated, the corresponding notification message is sent through Zookeeper in time, so that the local cache of the target access system is also synchronized and updated in time. When the subsequent client intercepts the processing result of the target access system, it can directly obtain the corresponding document template from the local cache of the target access system, and then generate the document information without obtaining it from the document management platform, which can save network overhead. At the same time, it can also avoid the document management platform from being overloaded or even crashing due to too many access systems or a large number of access system requests.
[0093] The embodiment of the present invention provides a data management method. When a monitoring request is received, a target access system is obtained according to the monitoring request, and then the target access system is monitored and registered through Zookeeper; when a data template modification request is received, the corresponding target data template can be modified and updated according to the data template modification request, and Zookeeper is used to detect whether the modified and updated target data template belongs to the target access system; if it does, a notification message is sent to a client that initiates the monitoring request through Zookeeper, so that the client updates the local cache of the target access system according to the notification message, so that when the subsequent client intercepts the processing result of the target access system, the data template can be directly obtained from the local cache of the target access system according to the template code in the processing result, without initiating a network request to the data management platform to call the data template. Compared with the prior art, the network overhead in the embodiment of the present invention is only that the data management platform pushes the modified and updated data template (i.e., the notification message). Therefore, the embodiment of the present invention can greatly save network overhead, and at the same time, it can avoid the situation where the access system is affected by the unavailability of the data management platform, and it can also avoid the data management platform being under great pressure or even crashing due to too many access systems or a large number of access system requests.
[0094] Based on the above first embodiment, it should be noted that, in a specific embodiment, the data management platform can also realize the synchronous update of the data template of the target access system in the following manner. Specifically, when the data management platform receives a data template modification request, it obtains the target data template and modification information according to the data template modification request; then the target data template is modified and updated based on the modification information, and the modified and updated target data template is stored in a preset database; then the data template in the preset database is synchronized to the corresponding target access system at regular intervals to update the local cache of the target access system. Through the above manner, network overhead can also be saved. At the same time, it can avoid the situation where the access system is affected by the unavailability of the data management platform, and it can also avoid the data management platform being under great pressure due to too many access systems or a large number of access system requests. However, compared with the above first embodiment, this scheme has the defect that the data template in the local cache of the access system is not updated in time.
[0095] Further, based on Figure 2 The first embodiment shown provides a second embodiment of the data management method of the present invention.
[0096] In this embodiment, the data management method further includes:
[0097] Step A, upon receiving the data template error information reported by the client, obtaining the last modification information of the data template corresponding to the data template error information;
[0098] In this embodiment, when the client generates data information based on the data template in the local cache of the target access system and the result parameters in the intercepted processing result, if it is found that the parameters to be filled in the data template do not match the result parameters, the data template error information can be reported to the data management platform. At this time, when the data management platform receives the data template error information reported by the client, it obtains the last modification information of the data template corresponding to the data template error information, that is, determines the reported data template according to the data template error information, and then obtains the last modification information of the data template (that is, the modification information of the last modification of the data template) according to the stored modification record, wherein the last modification information includes but is not limited to account information, name of the modifier, contact information of the modifier, etc.
[0099] Step B, generating corresponding prompt information and sending it to the terminal corresponding to the information of the last modifier to notify the last modifier to perform error detection.
[0100] Then, a corresponding prompt message is generated and sent to a terminal corresponding to the last modifying party information to notify the last modifying party to perform error detection. Correspondingly, the sending method of the prompt message can be preset, for example, the prompt can be sent by email, phone, text message, etc.
[0101] Through the above method, when an error occurs in the data template, the corresponding modifier can be found in time, and then the modifier can be reminded to perform error detection.
[0102] Furthermore, the data management method also includes:
[0103] When receiving the data template acquisition request of the target access system sent by the client, the data template corresponding to the target access system is called from the Zookeeper and returned to the client, so that the client stores the data template in the local cache of the target access system.
[0104] In this embodiment, when the target access system just starts to access the data management platform, a data template acquisition request can be sent to the data management platform through the client to obtain the data template set of the target access system from the data management platform. Specifically, when the data management platform receives the data template acquisition request of the target access system sent by the client, it calls the data template corresponding to the target access system from Zookeeper and returns it to the client, so that the client stores the data template in the local cache of the target access system for subsequent calls.
[0105] The present invention also provides a data management system, which includes a data management device and a client. Figure 1 The file operation device shown is used to execute the various steps in the above data management method embodiment. The specific functions and implementation processes can refer to the above embodiment and will not be described in detail here.
[0106] The client is used to obtain the updated data template according to the notification message when receiving the notification message of the data template update returned by the data management device through Zookeeper, and update the local cache of the target access system according to the updated data template.
[0107] In this embodiment, when the data management platform detects through Zookeeper that there is an update to the data template of the target access system, it will send a notification message to the corresponding client. At this time, when the client receives the notification message of the data template update returned by the data management device through Zookeeper, it can obtain the updated data template according to the notification message, and update the local cache of the target access system according to the updated data template, thereby ensuring data consistency.
[0108] Furthermore, the client is also used for:
[0109] intercepting the processing result generated by the target access system through a preset interceptor, and obtaining a template code and result parameters from the processing result;
[0110] Acquire a data template corresponding to the template code from a local cache of the target access system, and generate corresponding data information according to the data template and the result parameter;
[0111] The data information is returned to the target access system, so that the target access system feeds back the data information to the corresponding processing request initiator.
[0112] In this embodiment, when the target access system receives a data processing request, it will perform corresponding data processing, and generate a processing result after the processing is completed. Before returning the processing result to the initiator of the data processing request, the client will intercept the processing result generated by the target access system through a preset interceptor. Among them, the specific interception method can be achieved by re-implementing the doDispatch method in Spring (an open source framework) DispatcherServlet (front controller). Compared with the conventional AOP (Aspect Oriented Programming) to achieve interception, rewriting the doDispatch entry point is more accurate, and doDispatch does not need to specify a specific interception object, which can avoid the situation where conventional AOP misses interception.
[0113] After intercepting the processing result, first obtain the template code (megcode, messagecode, used to represent the data template key in the request result, represented by a string of characters) and result parameters from the processing result, then obtain the data template corresponding to the template code from the local cache of the target access system, and generate corresponding data information based on the data template and result parameters, and then return the data information to the target access system, so that the target access system feeds back the data information to the corresponding processing request initiator.
[0114] Of course, it should be noted that in a specific embodiment, it is not necessary to intercept the processing result with the help of the client to obtain the data template to generate data information. Instead, the target access system directly obtains the template code and result parameters from the processing result, and then obtains the data template corresponding to the template code from the local cache of the target access system, and generates corresponding data information according to the data template and result parameters, and then feeds the data information back to the corresponding processing request initiator. However, the implementation of this solution requires modifying the code of each target access system. Compared with the above embodiment, the development workload of this solution is relatively large.
[0115] The present embodiment provides a data management system, which includes a data management device and a client, wherein the data management device is equipped with a data management platform, and the data management platform uses Zookeeper technology. By constructing the above data management system, the data management platform can monitor and register the target access system through Zookeeper, and then when the data template of the target access system is updated, the corresponding notification message is sent to the client through Zookeeper in time, so that the client updates the local cache of the target access system in time. When the client intercepts the processing result of the target access system, it can directly obtain the data template from the local cache of the target access system according to the template code in the processing result, without initiating a network request to the data management platform to call the data template. Compared with the prior art, the network overhead in the present system is only that the data management platform pushes the modified and updated data template (i.e., the notification message). Therefore, the construction of the present system can greatly save network overhead. At the same time, it can avoid the situation where the access system is affected by the unavailability of the data management platform, and it can also avoid the data management platform being under great pressure or even crashing due to too many access systems or a large number of access system requests.
[0116] The invention also provides a data management device.
[0117] Reference Figure 3 , Figure 3 It is a schematic diagram of functional modules of the first embodiment of the data management device of the present invention.
[0118] like Figure 3 As shown, the data management device includes:
[0119] The registration module 10 is used to obtain the target access system according to the monitoring request when receiving the monitoring request, and monitor and register the target access system through Zookeeper;
[0120] The detection module 20 is used to modify and update the corresponding target data template according to the data template modification request when receiving the data template modification request, and detect whether the modified and updated target data template belongs to the target access system through the Zookeeper;
[0121] The notification module 30 is used to send a notification message to the client corresponding to the monitoring request through the Zookeeper if the modified and updated target data template belongs to the target access system, so that the client updates the local cache of the target access system according to the notification message.
[0122] Furthermore, the detection module 20 includes:
[0123] A first acquisition unit, configured to acquire a target data template and modification information according to the data template modification request when receiving the data template modification request;
[0124] A modification and updating unit, configured to modify and update the target data template based on the modification information, and store the modified and updated target data template in the Zookeeper;
[0125] The first detection unit is used to detect through the Zookeeper whether the modified and updated target data template belongs to the target access system.
[0126] Furthermore, the detection module 20 also includes:
[0127] A second acquisition unit, configured to acquire information about a modification request initiator according to the data template modification request;
[0128] A second detection unit, used to detect whether the modification request initiator has modification authority according to the modification request initiator information;
[0129] The modification and updating unit is specifically used to execute the steps of: modifying and updating the corresponding target data template according to the data template modification request if the initiator of the modification request has the modification authority;
[0130] The prompt unit is used to generate a prompt message of no modification authority if the modification request initiator does not have the modification authority, and return it to the modification request initiator corresponding to the data template modification request.
[0131] Furthermore, the data management device also includes:
[0132] an acquisition module, configured to, upon receiving data template error information reported by the client, acquire last modified party information of the data template corresponding to the data template error information;
[0133] The sending module is used to generate corresponding prompt information and send it to the terminal corresponding to the information of the last modifier to notify the last modifier to perform error detection.
[0134] Furthermore, the data management device also includes:
[0135] The return module is used to call the data template corresponding to the target access system from the Zookeeper when receiving the data template acquisition request of the target access system sent by the client, and return it to the client, so that the client stores the data template in the local cache of the target access system.
[0136] Among them, the functional implementation of each module in the above-mentioned data management device corresponds to each step in the above-mentioned data management method embodiment, and its functions and implementation processes are no longer repeated here.
[0137] The present invention also provides a computer-readable storage medium on which a data management program is stored. When the data management program is executed by a processor, the steps of the data management method described in any of the above embodiments are implemented.
[0138] The specific embodiments of the computer-readable storage medium of the present invention are substantially the same as the embodiments of the above-mentioned data management method, and are not described in detail herein.
[0139] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
[0140] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.
[0141] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present invention.
[0142] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A data management method, characterized in that: The data management method comprises: When receiving the monitoring request, obtaining the target access system according to the monitoring request, and performing monitoring registration on the target access system through Zookeeper; When receiving a data template modification request, modify and update the corresponding target data template according to the data template modification request, and detect whether the modified and updated target data template belongs to the target access system through the Zookeeper; the target data template includes: the name or number of the data template; If the modified and updated target data template belongs to the target access system, sending a notification message to the client corresponding to the monitoring request through the Zookeeper, so that the client updates the local cache of the target access system according to the notification message; Among them, when receiving the data template modification request, modifying and updating the corresponding target data template according to the data template modification request, and detecting through the Zookeeper whether the modified and updated target data template belongs to the target access system, includes: When receiving a data template modification request, obtaining a target data template and modification information according to the data template modification request; the modification information includes a modification type and a modification content; Modifying and updating the target data template based on the modification information, and storing the modified and updated target data template in the Zookeeper; Detecting, by the Zookeeper, whether the modified and updated target data template belongs to the target access system; Wherein, the data management method further includes: When receiving the data template error information reported by the client, obtaining the last modifier information of the data template corresponding to the data template error information; the last modifier information is the modifier information of the last modification of the data template; Generate corresponding prompt information and send it to the terminal corresponding to the information of the last modifying party to notify the last modifying party to perform error detection; Wherein, when receiving the data template error information reported by the client, obtaining the last modified party information of the data template corresponding to the data template error information includes: In the process of generating data information according to the data template in the local cache of the target access system and the result parameters in the intercepted processing result, if the client finds that the parameters to be filled in the data template do not match the result parameters, then reporting data template error information; Determine the reported data template according to the data template error information, and obtain the last modification party information of the data template according to the stored modification record; the last modification party information includes at least one of the following: account information, name of the modifier, and contact information of the modifier; Wherein, before the step of modifying and updating the corresponding target data template according to the data template modification request, the method further includes: Acquire information about a modification request initiator according to the data template modification request; the initiator information includes at least one of the following: account information and account level; Detecting whether the initiator of the modification request has modification authority according to the modification request initiator information; specifically, detecting whether the account information is in a preset authority list, or detecting whether the account level is a preset authority level; If the modification request initiator has modification authority, the following steps are performed: modifying and updating the corresponding target data template according to the data template modification request; different modification request initiators set different modification authorities; different modification authorities allow different ranges of data templates to be modified, and different ranges of operations allowed to be performed on the data template; If the initiator of the modification request does not have the modification permission, a prompt message of no modification permission is generated and returned to the modification request initiator corresponding to the data template modification request; in addition, when it is detected multiple times that the data template modification requests initiated by the same modification request initiator have no operation permission, a corresponding prompt message is sent to the preset management end to inform the management personnel that someone is trying to modify the data template that is not within the scope of permission.
2. The data management method according to claim 1, characterized in that: The data management method further comprises: When receiving the data template acquisition request of the target access system sent by the client, the data template corresponding to the target access system is called from the Zookeeper and returned to the client, so that the client stores the data template in the local cache of the target access system.
3. A data management device, characterized in that: The data management device comprises: A registration module, configured to, upon receiving a monitoring request, obtain a target access system according to the monitoring request, and perform monitoring registration on the target access system through Zookeeper; The detection module is used to modify and update the corresponding target data template according to the data template modification request when receiving the data template modification request, and detect whether the modified and updated target data template belongs to the target access system through the Zookeeper; the target data template includes: the name or number of the data template; A notification module, configured to send a notification message to a client corresponding to the monitoring request through the Zookeeper if the modified and updated target data template belongs to the target access system, so that the client updates the local cache of the target access system according to the notification message; Among them, in the aspect of modifying and updating the corresponding target data template according to the data template modification request when receiving the data template modification request, and detecting whether the modified and updated target data template belongs to the target access system through the Zookeeper, the detection module is specifically used for: When receiving a data template modification request, obtaining a target data template and modification information according to the data template modification request; the modification information includes a modification type and a modification content; Modifying and updating the target data template based on the modification information, and storing the modified and updated target data template in the Zookeeper; Detecting, by the Zookeeper, whether the modified and updated target data template belongs to the target access system; Wherein, the data management device is also specifically used for: When receiving the data template error information reported by the client, obtaining the last modifier information of the data template corresponding to the data template error information; the last modifier information is the modifier information of the last modification of the data template; Generate corresponding prompt information and send it to the terminal corresponding to the information of the last modifying party to notify the last modifying party to perform error detection; Wherein, in the aspect of obtaining the last modified party information of the data template corresponding to the data template error information when receiving the data template error information reported by the client, the data management device is further specifically used for: In the process of generating data information according to the data template in the local cache of the target access system and the result parameters in the intercepted processing result, if the client finds that the parameters to be filled in the data template do not match the result parameters, then reporting data template error information; Determine the reported data template according to the data template error information, and obtain the last modification party information of the data template according to the stored modification record; the last modification party information includes at least one of the following: account information, name of the modifier, and contact information of the modifier; Before the step of modifying and updating the corresponding target data template according to the data template modification request, the data management device is further specifically used to: Acquire information about a modification request initiator according to the data template modification request; the initiator information includes at least one of the following: account information and account level; Detecting whether the initiator of the modification request has modification authority according to the modification request initiator information; specifically, detecting whether the account information is in a preset authority list, or detecting whether the account level is a preset authority level; If the modification request initiator has modification authority, the following steps are performed: modifying and updating the corresponding target data template according to the data template modification request; different modification request initiators set different modification authorities; different modification authorities allow different ranges of data templates to be modified, and different ranges of operations allowed to be performed on the data template; If the initiator of the modification request does not have the modification permission, a prompt message of no modification permission is generated and returned to the modification request initiator corresponding to the data template modification request; in addition, when it is detected multiple times that the data template modification requests initiated by the same modification request initiator have no operation permission, a corresponding prompt message is sent to the preset management end to inform the management personnel that someone is trying to modify the data template that is not within the scope of permission.
4. A data management device, characterized in that: The data management device comprises: a memory, a processor, and a data management program stored in the memory and executable on the processor, wherein the data management program implements the steps of the data management method according to claim 1 or 2 when executed by the processor.
5. A data management system, characterized in that: The data management system includes a data management device and a client; wherein, The data management device is the data management device according to claim 4; The client is used to obtain the updated data template according to the notification message when receiving the notification message of the data template update returned by the data management device through Zookeeper, and update the local cache of the target access system according to the updated data template.
6. The data management system according to claim 5, characterized in that: The client is also used to: intercepting the processing result generated by the target access system through a preset interceptor, and obtaining a template code and result parameters from the processing result; Acquire a data template corresponding to the template code from a local cache of the target access system, and generate corresponding data information according to the data template and the result parameter; The data information is returned to the target access system, so that the target access system feeds back the data information to the corresponding processing request initiator.
7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a data management program, and when the data management program is executed by the processor, the steps of the data management method according to claim 1 or 2 are implemented.
