Distributed cache-based monitoring method, device and equipment and storage medium
By using a monitoring method based on distributed caching, information is input into the dispatch center for unified processing, which solves the problem of monitoring only some important data in existing technologies. This enables timely monitoring and feedback of all information, helping operating companies to stop losses in a timely manner.
Patent Information
- Application Number
- CN202111524831.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-14
- Publication Date
- 2025-12-23
- Estimated Expiration
- 2041-12-14
AI Technical Summary
In existing technologies, operating companies only continuously monitor some important data, which makes it impossible to stop losses in time when problems occur and lacks specificity.
A monitoring method based on distributed caching is adopted. After information is input into the distributed cache, it is processed uniformly by the scheduling center to obtain secondary information and execute the target operation at a predetermined time, such as outputting information or setting decision tasks. When the predetermined conditions are met, an anomaly is alerted.
It enables full-process monitoring and detection of all information in the distributed cache, timely feedback of minor issues, and helps operating companies to stop losses in a timely manner.
Smart Images

Figure CN114048107B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] Embodiments of the present application relate to the field of risk data analysis, and in particular to a monitoring method and device based on distributed cache, equipment and storage medium. BACKGROUND
[0002] At present, after an operation company accesses data information of various data products in the market, it needs to continuously monitor the data information of various products, that is, continuously perform statistics, analysis and processing, so that the operation company can be fed back in the first time when the operation of various data products does not meet the operation standard of the company, so as to be processed in time by the operation company.
[0003] In related technologies, the operation company usually sets an operation baseline standard to continuously monitor part of important data, and timely warns the operation company when the part of important data does not meet the baseline standard.
[0004] However, only part of important data is continuously monitored, which has the problem of insufficient pertinence. When the operation company receives the warning, the operation process may have already appeared an irreparable problem, thereby making the operation company unable to stop loss in time. SUMMARY
[0005] Embodiments of the present application provide a monitoring method, device, equipment and storage medium based on distributed cache, which can continuously monitor product data more comprehensively, thereby feeding back to the operation company in time when the product has a slight problem, and helping the operation company to stop loss in time.
[0006] To solve the above technical problems, an embodiment of the present application adopts one technical solution: providing a monitoring method based on distributed cache, comprising: inputting first information to a distributed cache; inputting the first information to a dispatch center; processing the first information at a predetermined time to obtain second information, the first information being effective data collected by a front end of the distributed cache; performing a target operation according to the second information; the target operation includes at least one of the following: outputting the second information to the distributed cache; if the second information meets a predetermined condition, setting a decision task, the decision task being used to warn that the second information is abnormal, and the predetermined condition being a warning index.
[0007] Optionally, in the case that the second data meets the predetermined condition, the decision task is set, and in the monitoring method based on distributed cache provided in the present application, the method comprises: calculating a target value corresponding to the second information; comparing the target value with a predetermined threshold value; and in the case that the target value meets the predetermined condition, setting the decision task.
[0008] Optionally, before the inputting the first information, the monitoring method based on the distributed cache provided in the application comprises: collecting the first information in a predetermined format, and inputting the first information into the distributed cache.
[0009] Optionally, the front end of the distributed cache comprises a buried point, and the collecting the first information in a predetermined format and inputting the first information into the distributed cache comprises: the buried point collecting the first information in a predetermined format; and the buried point establishing a connection with the distributed cache and inputting the first information into the distributed cache.
[0010] Optionally, in the case that the target operation comprises outputting the second information to the distributed cache, after the performing the target operation according to the second information, the monitoring method based on the distributed cache provided in the application further comprises: destroying the first information at a first time when the second information is output to the distributed cache.
[0011] Optionally, before the processing the first information at a predetermined time to obtain the second information (m-hhss), the monitoring method based on the distributed cache provided in the application comprises: calibrating the processing time of the first information to determine the predetermined time.
[0012] Optionally, the processing the first information at a predetermined time to obtain the second information comprises: screening valid information in the first information at the predetermined time, the valid information being used for comparison with a warning index, and the valid information being the second information.
[0013] To solve the above technical problems, the embodiment of the application further provides a monitoring device based on a distributed cache, comprising: an input module configured to input first information into a distributed cache; the input module is further configured to input the first information input by the input module into a dispatch center, and the first information is valid data collected by a front end of the distributed cache; an acquisition module configured to process the first information input by the input module at a predetermined time to obtain second information; and an execution module configured to perform a target operation on the second information obtained by the acquisition module; the target operation comprises at least one of the following: outputting the second information to the distributed cache; and setting a decision task if the second information meets a predetermined condition, the decision task being used for warning that the second information is abnormal, and the predetermined condition being a warning index.
[0014] Optionally, the monitoring device based on the distributed cache further comprises: a calculation module configured to calculate a target value corresponding to the second information; a comparison module configured to compare the target value calculated by the calculation module with a predetermined threshold value; and the execution module is specifically configured to set the decision task if the target value meets a predetermined condition.
[0015] Optionally, the input module is configured to collect the first information in a predetermined format and input the first information into the distributed cache.
[0016] Optionally, the front end of the distributed cache comprises a buried point, and the monitoring device based on the distributed cache further comprises a collection module configured to collect the first information in a predetermined format; and the input module is further configured to establish a connection with the distributed cache and input the first information into the distributed cache.
[0017] Optionally, when the target operation comprises outputting the second information to the distributed cache, the execution module is specifically configured to destroy the first information at a first time point when the second information is output to the distributed cache.
[0018] Optionally, the monitoring device based on the distributed cache further comprises a determination module configured to calibrate a processing time of the first information and determine the predetermined time point.
[0019] Optionally, the monitoring device based on the distributed cache further comprises a screening module configured to screen valid information in the first information at the predetermined time point, wherein the valid information is used for comparison with a warning index, and the valid information is the second information.
[0020] To solve the above technical problems, an embodiment of the present application further provides a computer device comprising a memory and a processor, wherein the memory stores computer readable instructions, and the computer readable instructions are executed by the processor to make the processor execute the steps of the monitoring method based on the distributed cache.
[0021] To solve the above technical problems, an embodiment of the present application further provides a storage medium storing computer readable instructions, wherein the computer readable instructions are executed by one or more processors to make the one or more processors execute the steps of the monitoring method based on the distributed cache.
[0022] The beneficial effects of the embodiment of the present application are: after inputting the first information into the distributed cache, the first information can be input into the dispatch center, and the first information will be uniformly processed at a predetermined time in the dispatch center, so as to obtain the second information, and the target operation is performed on the second information, wherein the target operation includes at least one of the following: outputting the second information to the distributed cache, and / or setting a decision task in the case that the second information meets a predetermined condition. In this way, by inputting all the information (i.e. the first information) in the distributed cache into the dispatch center, and processing the first information at a predetermined time, the information actually and truly needed to be used and detected (i.e. the second information) is generated, and then the second information is output to the distributed cache, and the decision task is set for the second information meeting the warning index, so as to timely remind the operation company, and all the information in the distributed cache during the operation process can be conveniently monitored, processed and detected, instead of only part of important information, so as to timely feedback to the operation company when the product has a slight problem, and help the operation company to stop loss in time. BRIEF DESCRIPTION OF DRAWINGS
[0023] The above and / or additional aspects and advantages of the present application will become apparent and more readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
[0024] Figure 1 The basic flow diagram of the monitoring method based on the distributed cache for one specific embodiment of the present application;
[0025] Figure 2 The basic structure diagram of the monitoring device based on the distributed cache for one embodiment of the present application;
[0026] Figure 3 The basic structure block diagram of the computer device for one embodiment of the present application. DETAILED DESCRIPTION
[0027] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, in which the same or similar notations represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be interpreted as a limitation on the present application.
[0028] Those skilled in the art can understand that, unless specifically stated, the singular forms "a", "an" and "the" used herein also include the plural forms. It should be further understood that the phrase "comprising" used in the specification of the present application means that the features, integers, steps, operations, elements and / or components exist, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.
[0029] As those skilled in the art will readily appreciate from the disclosure of the present application, functions, methods, concepts and / or operations described herein can be implemented in software, hardware, or a combination of software and / or firmware stored in computer readable medium if appropriate. In one example, the computer readable medium can include a floppy disk, RAM, hard disk, EEPROM, flash memory, or a compact disk. The software can cause a processor to carry out functions, methods, concepts and / or operations described herein. The software can be stored on a computer readable medium, such as the storage devices described above, including a floppy disk device, a hard disk device, an EEPROM, a compact disk, a RAM device, and / or a flash memory device. The software can also be propagated or transferred by way of an electrical medium, such as a telephone line, wireless link, cables, and / or the Internet. Note that the software can cause a processor to carry out functions, methods, concepts and / or operations described herein without using software constraints traditional by some viewpoints.
[0030] As those skilled in the art will readily appreciate from the disclosure of the present application, functions, methods, concepts and / or operations described herein can be implemented in software, hardware, or a combination of software and / or firmware stored in computer readable medium if appropriate. In one example, the computer readable medium can include a floppy disk, RAM, hard disk, EEPROM, flash memory, or a compact disk. The software can cause a processor to carry out functions, methods, concepts and / or operations described herein. The software can be stored on a computer readable medium, such as the storage devices described above, including a floppy disk device, a hard disk device, an EEPROM, a compact disk, a RAM device, and / or a flash memory device. The software can also be propagated or transferred by way of an electrical medium, such as a telephone line, wireless link, cables, and / or the Internet. Note that the software can cause a processor to carry out functions, methods, concepts and / or operations described herein without using software constraints traditional by some viewpoints.
[0031] The following terms that appear in the embodiments of the present application are explained as follows:
[0032] 1. Distributed cache
[0033] Distributed cache is to solve the data transmission bottleneck between database server and web server, when a website traffic is very large, this data transmission bottleneck will be very obvious, the time consuming of each database query is very long. In the related art, for the site which update speed is not very fast, static processing can be used to avoid too much data query, for example, a specific template engine can be used to realize page static. However, for the site which update data speed is second level, static processing is not ideal, in this case, distributed cache can be used to solve.
[0034] At present, distributed cache is mainly aimed at Internet application or e-commerce application. In Internet or e-commerce application system, business demand is complex, and the whole business system must be vertically split to ensure that each business module is clear and provides services to the outside. Because the user group of Internet application is extensive, there is a problem of high concurrency of data transmission. If the system is deployed on a single node server, it will inevitably cause great access pressure on the single server, so the system needs to be deployed on different nodes, and different data also needs to be dispersed to different nodes.
[0035] 2. JAR file (Java Archive file)
[0036] JAR file is a software package file format, which is usually used to aggregate a large number of Java class files, related metadata and resource (text, picture, etc.) files into one file, so as to develop Java platform application software or library. JAR file is an archive file, which is built in ZIP format and has a file extension of.jar.
[0037] 3. Application Programming Interface (API)
[0038] API is a set of pre-defined interfaces (such as functions, HTTP interfaces), or refers to the convention for the connection of different components of a software system, which is used to provide a set of routines for application programs to access based on certain software or hardware, without accessing the source code or understanding the details of the internal working mechanism.
[0039] Please refer to Figure 1 , Figure 1 is a basic flowchart of the monitoring method based on distributed cache of the embodiment, which includes S201 to S204:
[0040] S201, input first information to the distributed cache.
[0041] Exemplarily, the distributed cache can refer to the foregoing content, which will not be described here.
[0042] Exemplarily, the first information is valid data collected by the front end of the distributed cache.
[0043] Exemplarily, the first information is various data generated during the operation of the product, for example, hhss-key.
[0044] It can be understood that the first information described above does not only include a single piece of information, but can include multiple pieces of information. Generally, whether the first information includes a single piece of information or multiple pieces of information, each piece of information contains multiple data, that is, each piece of information can be composed of a group of data.
[0045] Exemplarily, due to the variety of products, and each product needs to perform data transmission during operation, the data generated in the data transmission process is large in amount, therefore, the data is input into the distributed cache, so as to be further used subsequently.
[0046] It should be noted that not all data in the process of transmitting data by the product needs to be used in the subsequent steps, therefore, if the input distributed cache is directly transmitted to the subsequent step, a large amount of processing resources, for example, network transmission resources, will be wasted, and the transmission speed will be slowed down.
[0047] S202, input the first information into the scheduling center.
[0048] Exemplarily, the scheduling center is part of the monitoring device based on the distributed cache, which is used to process information and scheduling information.
[0049] Exemplarily, the scheduling center can be used for timing, and the first information is processed in a predetermined manner.
[0050] S203, process the first information at a predetermined time to obtain second information.
[0051] Exemplarily, the predetermined time is the time set by the monitoring device based on the distributed cache in the scheduling center for the first information.
[0052] Further, the predetermined time is the predetermined time calculated by the scheduling center of the monitoring device using a preset algorithm in combination with the input time of the first information.
[0053] In one example, the input time of the first information is t1 seconds, and the preset algorithm of the predetermined time is (61-t1) seconds, i.e., the first information is processed after (61-t1) seconds, i.e., the first information is processed at the first second of the next minute after the first information is received. For example, if the time of receiving the first information is X hour X minute 59 seconds, the second-level time of this time, i.e., 59 seconds, is extracted, and then the algorithm of the predetermined time is used: (61-59) seconds=2 seconds, i.e., the first information is processed 2 seconds after the dispatch center receives the first information, i.e., the first information is processed at X hour X+1 minute 1 second.
[0054] It can be understood that when the first information includes multiple pieces of sub-information, the aforementioned multiple pieces of sub-information are not necessarily input to the dispatch center at the same time, and can be input to the dispatch center at different times. The dispatch center sets a predetermined time corresponding to each piece of sub-information.
[0055] For example, the preset algorithm for calculating the predetermined time is the aforementioned preset algorithm, the first information includes three pieces of sub-information, the time of inputting the first piece of sub-information to the dispatch center is X hour X minute 3 seconds, the time of inputting the second piece of sub-information to the dispatch center is X hour X minute 45 seconds, and the time of inputting the third piece of sub-information to the dispatch center is X hour X+1 minute 2 seconds. The dispatch center uses the preset algorithm to set the predetermined time for the three pieces of sub-information. The predetermined time of the first piece of sub-information is X hour X+1 minute 1 second, i.e., the first piece of sub-information is processed after (61-3) seconds=58 seconds, the predetermined time of the second piece of sub-information is X hour X+1 minute 1 second, i.e., the second piece of sub-information is processed after (61-45) seconds=16 seconds, and the predetermined time of the third piece of sub-information is X hour X+2 minute 1 second, i.e., the third piece of sub-information is processed after (61-2) seconds=59 seconds. It can be seen that when the preset algorithm is (61-t1) seconds, the dispatch center can simultaneously process multiple pieces of sub-information at the same time every minute.
[0056] For example, the dispatch center of the monitoring system can be used to screen the actual effective content in the first information, such as performing a cleaning task. By screening the actual effective content in the first information, the second information can be obtained.
[0057] For example, the second information is the actual effective information in the first information.
[0058] In one example, the actual effective data in the first information selected after screening is added with identification information for marking the effective data, for example, the original first information is hhss-key, and the second information is M-hhss-key.
[0059] It can be understood that:
[0060] Firstly, the first information is composed of N data, and after the cleaning task is completed, the first information can be composed of M data, N is a positive integer, and M is a positive integer less than or equal to N.
[0061] Secondly, when the first information includes multiple pieces of sub-information, each piece of sub-information can be composed of multiple data, and after the cleaning task is completed, the amount of data of each piece of sub-information can be reduced or can remain unchanged.
[0062] S204, performing a target operation on the second information.
[0063] Exemplarily, the target operation includes at least one of the following: outputting the second information to the distributed cache; and setting a decision task if the second information meets a predetermined condition.
[0064] Exemplarily, after the second information is obtained, the second information is output to the original distributed cache.
[0065] Exemplarily, the predetermined condition can be pre-set or user-defined, and embodiments of the present application do not limit the same.
[0066] Exemplarily, the decision task is used to alert that the second information is abnormal, and the predetermined condition is a warning index.
[0067] Exemplarily, after the scheduling center screens the actual effective content in the first information (i.e., the second information), the scheduling center can also be used to detect whether the second information is abnormal, for example, an analysis task; and the scheduling center can also draw a final conclusion after detecting the second information, for example, a decision task. The final conclusion can be that there is an abnormality or that there is no abnormality.
[0068] It should be noted that:
[0069] Firstly, the scheduling center has a certain logical relationship when performing the three functions of screening the actual effective content in the first information (i.e., the second information), detecting whether the content of the first information is abnormal, and drawing a final conclusion after detecting the content of the first information. That is, the scheduling center can only detect whether the actual effective content of the first information is abnormal after screening the actual effective content in the first information, and can only draw a conclusion on whether the final abnormality exists after detecting the actual effective content. That is, the cleaning task, the analysis task, and the decision task are three functions with a logical sequence relationship.
[0070] Secondly, the dispatching center has multiple functions, but it does not necessarily perform all of them. For example, the dispatching center can only perform the cleaning task, but does not perform the analysis task and the decision task. The three tasks are not sticky, but the analysis task and the decision task need to be performed in series, that is, after the analysis task is performed, the decision task will be performed in series subsequently.
[0071] Thirdly, the purpose of the embodiment of the application is to detect abnormal content in the first information, so the dispatching center in the embodiment of the application will perform the three functions it has.
[0072] It should be noted that when the first information includes multiple sub-information, the dispatching center independently performs related functions for each sub-information. For example, the dispatching center independently performs the cleaning task, the analysis task and the decision task for multiple sub-information.
[0073] For example, after the dispatching center screens the second information, it will also detect whether the second information is abnormal, and obtain the final conclusion after detecting the content of the second information. For example, the dispatching center performs the analysis task and the decision task on the second information after screening the first information to obtain the second information.
[0074] For example, the dispatching center detects the second information, and if the second information meets the predetermined condition, it can be considered that the final conclusion is that the second information is abnormal, and the decision task needs to be set for the second information.
[0075] It can be understood that in the dispatching center, the second information is detected, and if the second information does not meet the predetermined condition, it can be considered that the final conclusion is that the second information is normal, and the decision task does not need to be set for the second information.
[0076] Optionally, in the embodiment of the application, the setting of the decision task includes at least one of the following: setting channel flow limiting, setting channel flow reduction, setting channel closing, and setting communication alarm.
[0077] For example, the setting of the decision task includes setting channel flow limiting, setting channel flow reduction, and setting channel closing, which can hinder subsequent network data transmission, so that the task being executed cannot continue to be executed. The setting of the decision task in the setting of the communication alarm can notify the relevant user that the task being executed is abnormal, and remind the relevant personnel that the task has a problem.
[0078] It can be understood that the multiple setting decision tasks can be combined to execute, for example, setting channel flow limiting and setting communication alarm at the same time, which can prevent the execution of the abnormal task while informing the reason why the current task cannot be executed.
[0079] In the method for monitoring based on the distributed cache provided in the embodiments of the present application, after the first information is input into the distributed cache, the first information can be input into the dispatch center, and the first information is uniformly processed at a predetermined time in the dispatch center, so as to obtain the second information, and the target operation is performed on the second information, wherein the target operation comprises at least one of the following: outputting the second information to the distributed cache, and / or setting a decision task in the case that the second information meets a predetermined condition. In this way, by inputting all the information (i.e. the first information) in the distributed cache into the dispatch center, and processing the first information at a predetermined time to generate the information (i.e. the second information) that actually needs to be used and detected, and then outputting the second information to the distributed cache, and setting a decision task for the second information that meets the warning index, the operation company can be timely reminded, so that the all-process monitoring, processing and detection of all the information in the distributed cache during the operation process can be facilitated, instead of only for some important information, so that the operation company can be timely fed back when the product has a slight problem, and the operation company can be helped to timely stop loss.
[0080] Optionally, in the embodiments of the present application, in the case that the second information meets the predetermined condition, the method for monitoring based on the distributed cache provided in the embodiments of the present application can comprise the following steps A1 to A3:
[0081] Step A1: calculating a target value corresponding to the second information.
[0082] Step A2: comparing the target value with a predetermined threshold value.
[0083] Step A3: setting a decision task in the case that the target value meets a predetermined condition.
[0084] Exemplarily, the manner of calculating the second information can be preset or customized by a user, which is not limited in the embodiments of the present application.
[0085] Exemplarily, the format of the target value is the same as that of the predetermined threshold value, that is, the target value and the predetermined threshold value are in a value format that can be directly compared.
[0086] Exemplarily, the predetermined threshold value can be preset or customized by a user, which is not limited in the embodiments of the present application.
[0087] Exemplarily, the predetermined condition and the decision task can refer to the foregoing content, which is not limited herein.
[0088] In this way, after the second information is obtained, that is, after the second information is calculated, it is judged whether the second information is abnormal, so as to determine whether the decision content needs to be set subsequently, so that the decision process of setting the decision content can be more conveniently and quickly completed.
[0089] Optionally, before the step S201, the method for monitoring based on the distributed cache provided in the embodiment of the present application can further include the following step B:
[0090] Step B: collecting the first information according to a predetermined format, and inputting the first information into the distributed cache.
[0091] Exemplarily, the predetermined format can be preset or customized, and the embodiment of the present application does not limit this.
[0092] In an example, the predetermined format is a predetermined format obtained by the monitoring device based on the distributed cache through an application program interface (API) of a computer file format, and the data, i.e., the first information, can be collected according to the predetermined format.
[0093] Optionally, in the embodiment of the present application, the front end of the distributed cache includes a burying point, and in the step B, the method for monitoring based on the distributed cache provided in the embodiment of the present application includes the following steps C1 and C2:
[0094] Step C1: the burying point collects the first information according to the predetermined format.
[0095] Step C2: the burying point establishes a connection with the distributed cache, and inputs the first information into the distributed cache.
[0096] Exemplarily, in the front end of the distributed cache, effective burying points are needed to collect all data generated by the front end.
[0097] In an example, the front end collects the first information according to the predetermined format through an application program interface (API) of a computer file format.
[0098] Exemplarily, the connection between the burying point and the distributed cache means that the burying point needs to establish a connection capable of inputting information into the distributed cache.
[0099] Exemplarily, after collecting the first information and connecting the distributed cache, the step S201 can be executed subsequently.
[0100] Optionally, in the embodiment of the present application, in the case where the target operation includes outputting the second information to the distributed cache, in the step S204, the method for monitoring based on the distributed cache provided in the embodiment of the present application can include the following step D:
[0101] Step D: destroying the first information at the first moment when the second information is output to the distributed cache.
[0102] Exemplarily, the first time point can be understood as the same time point when the second information is output to the distributed cache.
[0103] It can be understood that in the embodiment of the present application, when the second information is output to the distributed cache, the operation of destroying the original first data is automatically started in the distributed cache.
[0104] In this way, only the actually valid information can be retained, the workload of subsequent information processing can be greatly reduced, the resources for processing information can be saved while completing the process of monitoring all information, and the efficiency of subsequent information processing can be improved.
[0105] Optionally, before the step S203, the monitoring method based on the distributed cache provided by the embodiment of the present application further includes the following step E:
[0106] Step E: calibrating the processing time of the first information to determine the predetermined time point.
[0107] Exemplarily, the calibration of the processing time of the first information can refer to the algorithm for presetting the predetermined time point.
[0108] In this way, by calibrating the processing time of the first information, the first information input to the dispatch center in the same unit time can be uniformly and synchronously processed at the predetermined time point, so that the processing of the first information can be stably completed without affecting the process of the previous information, and the resources for processing the first information can be saved and the efficiency of processing the first information can be improved.
[0109] Optionally, in the step 203, the monitoring method based on the distributed cache provided by the embodiment of the present application can include the following step F:
[0110] Step F: screening the valid information in the first information at the predetermined time point.
[0111] Exemplarily, the valid information is used for comparison with the warning index, and the valid information is the second information.
[0112] Exemplarily, the predetermined time point can refer to the foregoing content, which will not be described here.
[0113] It can be understood that the first information contains a large amount of information content, and the information that can effectively represent the relationship between the first information and the warning index is only a part of the information. Therefore, the valid information in the first information, i.e., the information that can be used for comparison with the warning index, can be screened through the screening process, and then compared with the warning information.
[0114] Exemplarily, the process of screening the valid information in the first information can be completed by a cleaning task.
[0115] Exemplarily, the cleaning task can refer to the foregoing content, which will not be described here again.
[0116] In this way, by screening all the information in the first information in advance, the valid information that can be used for comparison with the warning information is selected, the time in the subsequent comparison process can be greatly reduced, the resources of the comparison process are saved, and the efficiency of detecting the anomaly is improved.
[0117] To solve the above technical problems, the embodiment of the present application also provides a monitoring device based on distributed cache. For details, please refer to Figure 2 , Figure 2 The basic structure diagram of the monitoring device based on distributed cache of the present embodiment is shown.
[0118] As shown in Figure 2 , a monitoring device based on distributed cache comprises: an input module 301 configured to input first information to a distributed cache; the input module 301 is also configured to input the first information input by the input module 301 to a dispatch center; an acquisition module 302 configured to process the first information input by the input module 301 at a predetermined time, and acquire second information, wherein the first information is valid data collected by a front end of the distributed cache; an execution module 303 configured to perform a target operation on the second information acquired by the acquisition module 302; the target operation comprises at least one of the following: outputting the second information to the distributed cache; if the second information meets a predetermined condition, setting a decision task, wherein the decision task is used to warn that the second information has an anomaly, and the predetermined condition is a warning index.
[0119] After the monitoring device based on distributed cache inputs the first information to the distributed cache, the first information can be input to the dispatch center, and the first information is uniformly processed at a predetermined time in the dispatch center, so as to acquire the second information, and perform a target operation on the second information, wherein the target operation comprises at least one of the following: outputting the second information to the distributed cache, and / or setting a decision task in the case that the second information meets a predetermined condition. In this way, by inputting all the information (i.e., the first information) in the distributed cache to the dispatch center, and processing the first information at a predetermined time to generate the information that actually needs to be used and detected (i.e., the second information), and then outputting the second information to the distributed cache, and setting a decision task for the second information that meets the warning index, the operation company can be timely reminded, the whole process monitoring, processing and detection of all the information in the distributed cache during the operation process can be facilitated, and it is not necessary to only aim at part of important information, so that the operation company can be timely fed back when the product has a slight problem, and the operation company can be helped to stop loss in time
[0120] In some embodiments, the distributed cache-based monitoring device further comprises a calculation module 304 configured to calculate a target value corresponding to the second information; a comparison module 305 configured to compare the target value calculated by the calculation module 304 with a predetermined threshold value; and the execution module 303 is specifically configured to set a decision task when the target value meets a predetermined condition.
[0121] In some embodiments, the input module 301 is further configured to collect the first information in a predetermined format and input the first information into the distributed cache.
[0122] In some embodiments, the front end of the distributed cache comprises a buried point, and the distributed cache-based monitoring device further comprises a collection module 306 configured to collect the first information in a predetermined format; and the input module 301 is further configured to establish a connection with the distributed cache and input the first information into the distributed cache.
[0123] In some embodiments, when the target operation comprises outputting the second information to the distributed cache, the execution module 303 is specifically configured to destroy the first information at a first time point when the second information is output to the distributed cache.
[0124] In some embodiments, the distributed cache-based monitoring device further comprises a determination module 307 configured to calibrate a processing time of the first information and determine the predetermined time point.
[0125] In some embodiments, the distributed cache-based monitoring device further comprises a screening module 308 configured to screen valid information in the first information at the predetermined time point, the valid information is used to compare with a warning index, and the valid information is the second information.
[0126] To solve the above technical problems, the embodiment of the present application further provides a computer device. For details, please refer to Figure 3 , Figure 3 The basic structure block diagram of the computer device of the present embodiment is shown in FIG. 1.
[0127] As shown in FIG. 1, the computer device of the present embodiment comprises a processor 1001, a memory 1002, a communication interface 1003 and a power supply 1004. Figure 3As shown in the internal structure diagram of the computer device. The computer device includes a processor, a non-volatile storage medium, a memory and a network interface connected by a system bus. Among them, the non-volatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequence, and the computer readable instructions are executed by the processor to enable the processor to realize a data relationship reconstruction method. The processor of the computer device is used to provide computing and control capability to support the operation of the whole computer device. The memory of the computer device can store computer readable instructions, and the computer readable instructions are executed by the processor to enable the processor to execute a data relationship reconstruction method. The network interface of the computer device is used to connect and communicate with the terminal. Those skilled in the art can understand, Figure 3 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.
[0128] The processor in the embodiment is used to execute Figure 2 The memory stores the program codes and various data required to execute the above-mentioned modules. The network interface is used for data transmission between the user terminal or the server. The memory in the embodiment stores the program codes and data required to execute all sub-modules in the data relationship reconstruction device, and the server can call the program codes and data of the server to execute the functions of all sub-modules.
[0129] The computer device constructs the data relationship between the collected transaction nodes into a node feature graph and a corresponding adjacency matrix, and uses a graph neural network to extract features from the node feature graph and the adjacency matrix. According to the extracted features, the relationship is reconstructed. When the relationship is reconstructed, the graph neural network reconstructs the data based on the learned hidden logical relationship between the data. The process of relationship reconstruction is the process of restoring the data node feature graph and the adjacency matrix. In the process of dispersing and recombining the data node feature graph and the adjacency matrix, the graph neural network verifies the correctness of the hidden relationship between the transaction nodes learned by it. Then, the learned hidden relationship is used to reconstruct the relationship between the transaction nodes, and the target transaction nodes that meet the conditions are selected for subsequent use. Through the graph processing technology, the logical relationship behind the data is deeply interpreted, and the depth and efficiency of data analysis are improved.
[0130] The present application also provides a storage medium storing computer readable instructions, which are executed by one or more processors to enable one or more processors to execute the steps of the data relationship reconstruction method of any of the above embodiments.
[0131] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer readable storage medium. When the program is executed, it can include the processes of the above-mentioned embodiment methods. The storage medium can be a non-volatile storage medium such as a magnetic disc, an optical disc, a read-only memory (ROM), or a random access memory (RAM).
[0132] The application further provides a storage medium storing computer readable instructions, which, when executed by one or more processors, cause the one or more processors to perform the steps of the data relationship reconstruction method of any of the above-mentioned embodiments.
[0133] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer readable storage medium. When the program is executed, it can include the processes of the above-mentioned embodiment methods. The storage medium can be a non-volatile storage medium such as a magnetic disc, an optical disc, a read-only memory (ROM), or a random access memory (RAM).
[0134] Those skilled in the art can understand that the steps, measures, and schemes in the various operations, methods, and processes discussed in the present application can be alternated, changed, combined, or deleted. Further, other steps, measures, and schemes in the various operations, methods, and processes discussed in the present application can also be alternated, changed, rearranged, decomposed, combined, or deleted. Further, the steps, measures, and schemes in the prior art with the various operations, methods, and processes disclosed in the present application can also be alternated, changed, rearranged, decomposed, combined, or deleted.
[0135] The above-mentioned is only some embodiments of the present application. It should be noted that those skilled in the art can make several improvements and refinements without departing from the principles of the present application, and these improvements and refinements should also be considered as the protection scope of the present application.
Claims
1. A method for monitoring based on distributed cache, characterized in that, The method comprises the following steps: inputting first information to a distributed cache; inputting the first information to a dispatch center, the first information being valid data collected by a front end of the distributed cache, the first information being various data generated during product operation; the dispatch center performing a cleaning task to process the first information at a predetermined time to obtain second information, the second information being actual valid information in the first information; performing a target operation on the second information; destroying the first information at a first time when the second information is output to the distributed cache; the target operation comprising at least one of the following: outputting the second information to the distributed cache; and if the second information meets a predetermined condition, setting a decision task, the decision task being used to alert that the second information is abnormal, the predetermined condition being a warning index; wherein, before the first information is input, the method further comprises: collecting the first information in a predetermined format and inputting the first information to the distributed cache; the front end of the distributed cache comprising a buried point, and the collecting of the first information in a predetermined format and the inputting of the first information to the distributed cache comprising: the buried point collecting the first information in a predetermined format; the buried point establishing a connection with the distributed cache and inputting the first information to the distributed cache.
2. The method of claim 1, wherein, if the second information meets a predetermined condition, setting a decision task, comprising: calculating a target value corresponding to the second information; comparing the target value with a predetermined threshold value; if the target value meets a predetermined condition, setting a decision task.
3. The method of claim 1, wherein, before the processing of the first information at a predetermined time to obtain second information, the method further comprises: calibrating the processing time of the first information to determine the predetermined time.
4. The method of claim 1, wherein, the processing of the first information at a predetermined time to obtain second information comprising: screening valid information in the first information at the predetermined time, the valid information being used to compare with a warning index, and the valid information being the second information.
5. A monitoring device based on distributed cache, characterized in that, The method comprises the following steps: an input module, configured to input first information to a distributed cache; the input module is further configured to input the first information input by the input module to a dispatch center, the first information being various data generated during product operation; an acquisition module, configured to control the dispatch center to perform a cleaning task to process the first information input by the input module and to obtain second information at a predetermined time, the second information being actual valid information in the first information; an execution module, configured to perform a target operation on the second information acquired by the acquisition module; the execution module is further configured to destroy the first information at a first time when the second information is output to the distributed cache; the target operation comprising at least one of the following: outputting the second information to the distributed cache; and if the second information meets a predetermined condition, setting a decision task; the input module is configured to collect the first information in a predetermined format and to input the first information to the distributed cache; The front end of the distributed cache includes a buried point, and the distributed cache-based monitoring device further includes an acquisition module.
6. A computer device, comprising: A memory and a processor are included, and the memory stores computer readable instructions, and the computer readable instructions are executed by the processor to make the processor execute the steps of the distributed cache-based monitoring method in any one of claims 1 to 4.
7. A storage medium storing computer readable instructions, wherein, The computer readable instructions are executed by one or more processors to make the one or more processors execute the steps of the distributed cache-based monitoring method in any one of claims 1 to 4.
Citation Information
Patent Citations
IT system operation risk monitoring method and device
CN111949501A
Cache monitoring management method, device and system, equipment and storage medium
CN113590665A