Log data monitoring method and device, electronic equipment and storage medium

By working together between processors, quickly detecting and responding to error log data, the problem that traditional monitoring systems cannot detect and respond in real time is solved, and service stability and user experience are improved.

CN118945045APending Publication Date: 2024-11-12BEIJING YOUTEJIE INFORMATION TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410975597.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Traditional monitoring systems are difficult to detect error log data in real time and respond when processing log data from large Internet applications, resulting in the impact of service stability and user experience.

Method used

By working together between the first processor and the second processor, the error log data is queried and determined, and the relevant data is transmitted to the second processor for pre-aggregation processing and display after the alarm event indicator is met, so as to realize the error log data Quick detection and response.

Benefits of technology

It realizes rapid detection and response to error log data, improves the real-time and responsiveness of the monitoring system, and ensures the stability of the service and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945045A_ABST
    Figure CN118945045A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a log data monitoring method and device, electronic equipment and a storage medium. The method is applied to a first processor, and comprises the following steps: in response to a monitoring instruction of a target service, querying log data stored in a target memory; determining target log data, and determining a target monitoring entity matched with the target log data; the target log data is error-reported log data; when it is determined that the target monitoring entity meets the alarm event index, sending the target monitoring entity and a service level target matched with the target monitoring entity to a target memory, so that the target memory determines reference log data matched with the target monitoring entity, and transmitting the reference log data, the target monitoring entity and the service level target matched with the target monitoring entity to the second processor. According to the scheme provided by the embodiment of the invention, the error report log data can be quickly detected, and the error report log data can be responded.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method, device, electronic device and storage medium for monitoring log data. Background Art

[0002] With the rapid development of the Internet, network equipment and application services are showing an explosive growth trend, and all walks of life are integrated with the Internet. This has brought many opportunities for the development of Internet technology, but also brought huge challenges to the availability, stability and user experience of Internet-related services.

[0003] Large-scale Internet applications need to ensure the stability of services at all times and be able to promptly detect and alarm when services are abnormal. Therefore, a monitoring system is needed that can accurately identify whether services are abnormal.

[0004] However, traditional monitoring systems are prone to delays when processing large amounts of log data generated by various services, and are unable to detect and respond to error log data in real time. Summary of the invention

[0005] The present invention provides a log data monitoring method, device, electronic device and storage medium, so as to quickly detect error log data and respond to the error log data.

[0006] According to one aspect of the present invention, a method for monitoring log data is provided. The method is applied to a first processor and includes:

[0007] In response to the monitoring instruction of the target service, query each log data stored in the target storage;

[0008] Determine target log data, and determine a target monitoring entity matching the target log data; the target log data is error-reporting log data;

[0009] When it is determined that the target monitoring entity meets the alarm event indicators, the target monitoring entity and the service level target matching the target monitoring entity are sent to the target memory, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity and the service level target matching the target monitoring entity to the second processor.

[0010] According to one aspect of the present invention, a method for monitoring log data is provided, the method being applied to a second processor, comprising:

[0011] Receiving a target monitoring entity, a service level objective matching the target monitoring entity, and reference log data matching the target monitoring entity, sent by a target storage;

[0012] Performing pre-aggregation processing on the target monitoring entity, the service level objective and each of the reference log data to obtain a pre-aggregation result;

[0013] The pre-aggregation result is transmitted to a display storage for storage, so that the display storage displays the pre-aggregation result.

[0014] According to another aspect of the present invention, a log data monitoring device is provided, the device being configured on a first processor, comprising:

[0015] A query module, used to query various log data stored in the target storage in response to the monitoring instruction of the target service;

[0016] A monitoring entity determination module, used to determine target log data and determine a target monitoring entity matching the target log data; the target log data is error-reporting log data;

[0017] A transmission module is used to send the target monitoring entity and the service level target matching the target monitoring entity to the target memory when it is determined that the target monitoring entity meets the alarm event indicators, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity and the service level target matching the target monitoring entity to the second processor.

[0018] According to another aspect of the present invention, a log data monitoring device is provided, the device being configured on a second processor, comprising:

[0019] A receiving module, configured to receive a target monitoring entity, a service level target matching the target monitoring entity, and reference log data matching the target monitoring entity, sent by a target storage;

[0020] A pre-aggregation module, used for performing pre-aggregation processing on the target monitoring entity, the service level objective and each of the reference log data to obtain a pre-aggregation result;

[0021] The display module is used to transmit the pre-aggregation result to the display memory for storage, so that the display memory displays the pre-aggregation result.

[0022] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0023] at least one processor; and

[0024] a memory communicatively connected to the at least one processor; wherein,

[0025] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the log data monitoring method described in any embodiment of the present invention.

[0026] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the log data monitoring method described in any embodiment of the present invention when executed.

[0027] The technical solution of the embodiment of the present invention is to query each log data stored in the target memory by a first processor in response to the monitoring instruction of the target service; determine the target log data, and determine the target monitoring entity matching the target log data; the target log data is the error log data; when it is determined that the target monitoring entity meets the alarm event index, the target monitoring entity and the service level target matching the target monitoring entity are sent to the target memory, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity and the service level target matching the target monitoring entity to the second processor, which solves the problem that the traditional monitoring system cannot detect the error log data in real time and respond to the error log data, and can quickly detect the error log data and respond to the error log data.

[0028] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0030] Figure 1 is a flow chart of a log data monitoring method provided according to Embodiment 1 of the present invention;

[0031] Figure 2 is a flow chart of a log data monitoring method provided according to Embodiment 2 of the present invention;

[0032] Figure 3 is a schematic diagram of the structure of a log data monitoring device provided according to Embodiment 3 of the present invention;

[0033] Figure 4 is a structural diagram of a log data monitoring device provided according to a fourth embodiment of the present invention;

[0034] Figure 5 It is a structural schematic diagram of an electronic device for implementing the log data monitoring method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0035] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0036] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0037] Embodiment 1

[0038] Figure 1 This is a flow chart of a log data monitoring method provided according to the first embodiment of the present invention. This embodiment is applicable to the situation where the log data of the service is monitored in real time by the first processor, the error log data is quickly determined and responded to. The method can be executed by a log data monitoring device, which can be implemented in the form of hardware and / or software, and can be configured in electronic devices such as computers or servers. Figure 1 As shown, the method includes:

[0039] Step 110: In response to the monitoring instruction of the target service, query each log data stored in the target storage.

[0040] The target service may be any service task, such as an online transaction service, a data upload service, or an invoicing service, etc., which is not limited in this embodiment.

[0041] It should be noted that, in this embodiment, the first processor may be a processor of any electronic device, such as a processor of computer A or a processor of server B, etc., which is not limited in this embodiment.

[0042] In an optional implementation of this embodiment, after receiving a monitoring instruction for the target service, the first processor can query the log data stored in the target memory, wherein the log data stored in the target memory is the log data generated during the operation of the target service; in this embodiment, the target memory can be integrated with the first processor in the same electronic device, or in a different electronic device, which is not limited in this embodiment.

[0043] Optionally, in this embodiment, before responding to the monitoring instruction of the target service, the method may further include: collecting log data generated during the operation of the target service in real time, and storing each log data in the target memory.

[0044] In this embodiment, the log data generated by the target service during operation can be collected in real time by the collector, and the collected log data can be stored in the target memory; wherein, the collector can be a processor other than the first processor, which can speed up the collection efficiency of the log data and will not affect the response speed of subsequent monitoring of the target service.

[0045] Step 120: Determine target log data, and determine a target monitoring entity that matches the target log data.

[0046] The target log data is the log data of the error report; the number of the target log data may be one or more, which is not limited in this embodiment.

[0047] Optionally, in this embodiment, after querying each log data stored in the target memory, the first processor may further determine target log data in each log data, and determine a target monitoring entity corresponding to each target log data.

[0048] In an optional implementation of this embodiment, determining the target log data may include: traversing each of the log data and determining whether a target keyword exists in each of the log data; if it is determined that the target keyword exists in the first log data, determining the first log data as the target log data.

[0049] The target keyword may be a preset keyword such as error or null, which is not limited in this embodiment. The first log data may be any log data generated by the target service, which is not limited in this embodiment.

[0050] Optionally, in this embodiment, after the first processor queries the target service in the target memory for each log data generated, it can further traverse each log data to determine whether the log data contains the target keyword; if the traversal finds that the target keyword exists in the first log data, it can be determined that the first log data is the target log data for the error report.

[0051] Further, determining a target monitoring entity that matches the target log data may include: determining attribute information of the target log data; and determining a target monitoring entity that matches the target log data based on the attribute information of the target log data.

[0052] Optionally, in this embodiment, after determining to obtain the target log data, the attribute information of the target log data can be further determined, and the target monitoring entity matching the target log data can be determined according to the attribute information of the target log data. The attribute information of the target log attribute can include: the time when the target log data is generated, the machine that generates the target log data, or the interface that transmits the target log data, etc.; the target monitoring entity can include a machine, a container, or an interface, etc., which are not limited in this embodiment.

[0053] Exemplarily, if the attribute information of the target log data includes that the machine generating the target log data is machine 1 and the interface transmitting the target log data is the first interface, then the monitoring entity matching the target log data is "machine 1 and the first interface".

[0054] Step 130. When it is determined that the target monitoring entity meets the alarm event indicators, the target monitoring entity and the service level target matching the target monitoring entity are sent to the target memory, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity, and the service level target matching the target monitoring entity to the second processor.

[0055] Optionally, in an optional implementation of this embodiment, after the target monitoring entity is determined, it is possible to further receive an alarm event indicator matching the target monitoring entity fed back by an alarm center.

[0056] Further, it may be determined whether the target monitoring entity meets the alarm event indicator. If it is determined that the target monitoring entity meets the alarm event indicator, the target monitoring entity and the service level target matching the target monitoring entity may be sent to the target storage.

[0057] Furthermore, after receiving the target monitoring entity and the service level target that matches the target monitoring entity, the target memory can further determine the reference log data related to the target monitoring entity, and send the reference log data, the target monitoring entity, and the service level target that matches the target monitoring entity to the second processor so that the second processor can make a subsequent response.

[0058] It should be noted that in this embodiment, the service level objective (SLO) is a quantitative target for service availability and performance and is part of the service level agreement. SLO defines the service performance and availability standards agreed upon between the service provider and the customer. They are important metrics for service operations and help ensure service quality and customer satisfaction. SLO mainly includes the following key elements: Availability: describes the percentage of time a service is available in a specific time period. For example, 99.9% availability means that the service can be unavailable for up to 43.2 minutes per month. Performance: measures the response time, processing speed, etc. of the service. For example, 99% of requests are completed within 200 milliseconds. Error rate: monitors the proportion of erroneous requests for the service. For example, 99.95% of requests should be successful. Throughput: describes the number of requests processed by the service in a specific time period. For example, 1,000 requests are processed per second. Latency: measures the processing time of a request. For example, 95% of requests are completed within 100 milliseconds.

[0059] The solution of this embodiment is to query each log data stored in the target memory by the first processor in response to the monitoring instruction of the target service; determine the target log data, and determine the target monitoring entity matching the target log data; the target log data is the error log data; when it is determined that the target monitoring entity meets the alarm event index, send the target monitoring entity and the service level target matching the target monitoring entity to the target memory, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity and the service level target matching the target monitoring entity to the second processor, which solves the problem that the traditional monitoring system cannot detect the error log data in real time and respond to the error log data, and can quickly detect the error log data and respond to the error log data.

[0060] Embodiment 2

[0061] Figure 2 This is a flow chart of a log data monitoring method provided according to the second embodiment of the present invention. This embodiment is applicable to the case where the second processor pre-aggregates the received data and quickly responds to the error log data. The method can be executed by a log data monitoring device, which can be implemented in the form of hardware and / or software, and can be configured in electronic devices such as computers or servers. Figure 2 As shown, the method includes:

[0062] Step 210: Receive a target monitoring entity, a service level objective matching the target monitoring entity, and reference log data matching the target monitoring entity, sent by a target storage.

[0063] It should be noted that, in this embodiment, the second processor is a processor with a pre-aggregation function, and is not a processor with simple functions.

[0064] In an optional implementation of the present embodiment, the second processor may receive in real time the target monitoring entity, the service level target matching the target monitoring entity, and the reference log data matching the target monitoring entity sent by the target memory; or it may receive the target monitoring entity, the service level target matching the target monitoring entity, and the reference log data matching the target monitoring entity sent by the target memory once at a set time interval, which is not limited in the present embodiment.

[0065] Step 220: pre-aggregate the target monitoring entity, the service level objective and each reference log data to obtain a pre-aggregation result.

[0066] In an optional implementation of the present embodiment, after receiving the target monitoring entity, the service level target matching the target monitoring entity, and the reference log data matching the target monitoring entity sent by the target memory, the second processor can further pre-aggregate the target monitoring entity, the service level target, and the reference log data to obtain a pre-aggregation result.

[0067] Optionally, in this embodiment, pre-aggregation processing is performed on the target monitoring entity, the service level target and each of the reference log data, which may include: when a preset pre-aggregation time is met, pre-aggregating the target monitoring entity, the service level target and each of the reference log data by a preset pre-aggregation method; the preset pre-aggregation method includes at least one of the following: avg, min, max and latest.

[0068] In this embodiment, the second processor can pre-aggregate the target monitoring entity transmitted from the target storage, the service level target matching the target monitoring entity, and the reference log data matching the target monitoring entity. The pre-aggregation time frequency and pre-aggregation method can be randomly configured. Exemplarily, the time frequency can be 1 minute, 5 minutes, 10 minutes, 15 minutes or half an hour to pre-aggregate one point; the pre-aggregation method can be avg, min, max or latest, which is not limited in this embodiment.

[0069] Step 230: Transmit the pre-aggregation result to a display memory for storage, so that the display memory displays the pre-aggregation result.

[0070] In an optional implementation of this embodiment, after the second processor pre-aggregates to obtain the pre-aggregation result, it can continue to transmit the pre-aggregation result to the display memory. Further, the display memory can display the pre-aggregation result so that the user can intuitively view the error data of the target service.

[0071] Exemplarily, the presentation memory may be classified and stored separately according to entity type+entity+index+time frequency+pre-aggregation mode.

[0072] The solution of this embodiment is to receive, by a second processor, a target monitoring entity, a service level target matching the target monitoring entity, and each reference log data matching the target monitoring entity sent by a target memory; perform pre-aggregation processing on the target monitoring entity, the service level target, and each reference log data to obtain a pre-aggregation result; transmit the pre-aggregation result to a display memory for storage, so that the display memory displays the pre-aggregation result, and can quickly respond to error log data, providing a basis for subsequent service maintenance.

[0073] In order to better understand the log data monitoring method involved in the embodiment of the present invention, a specific example is used below to illustrate, which mainly includes the following steps:

[0074] 1. The collector collects service indicator log data and sends it to the target storage;

[0075] 2. The first processor collects logs based on the target storage to detect whether the service reports an error. If an error is reported, the first processor automatically searches for related monitoring entities of the service, such as machines, containers, interfaces, etc.;

[0076] 3. The first processor obtains the relevant monitoring view of the error reporting service, links to the [Alarm Center], and collects the alarm event indicators of the relevant monitoring entities;

[0077] 4. After the first processor obtains the alarm event indicator, it searches the target storage for the indicator log data of the relevant monitoring entity and transmits it to the second processor. (The user has configured these indicator alarms, which means that these indicators will be paid attention to in the event of a fault).

[0078] 5. The SLO indicator will be configured in the first processor. After the service triggers an error, the first processor will not only detect the event indicator of the alarm center, but also send the monitoring entity + SLO indicator to the target storage. The target storage will send the relevant logs to the second processor

[0079] 6. The second processor pre-aggregates the data sent in "step 4" and "step 5". The time frequency and pre-aggregation method of pre-aggregation can be configured;

[0080] 7. After pre-aggregation, the second processor transfers the data to the display memory, and the display memory stores the data separately according to the entity type + entity + indicator + time frequency + pre-aggregation method as classification; wherein, entity type = machine; illustratively, the storage result of the display memory can be shown in Table 1.

[0081] Table 1. Display memory storage results

[0082]

[0083] 8. Pull and display storage data according to the time range selected by the user page to view the error service indicator analysis. At the same time, pull and display data according to the time granularity selected by the user page;

[0084] 9. Data in the display memory that expires three months ago will be automatically deleted (the expiration time can be configured).

[0085] The solution of this embodiment can realize real-time detection and pre-aggregation processing of service indicators through the first processor and the second processor, and the time and method of pre-aggregation can be flexibly configured.

[0086] Embodiment 3

[0087] Figure 3 1 is a schematic diagram of the structure of a log data monitoring device provided according to Embodiment 3 of the present invention, wherein the device is configured in a first processor. Figure 3 As shown, the device includes: a query module 310, a monitoring entity determination module 320 and a transmission module 330.

[0088] A query module 310, for querying various log data stored in a target storage in response to a monitoring instruction of a target service;

[0089] The monitoring entity determination module 320 is used to determine target log data and determine a target monitoring entity matching the target log data; the target log data is error-reporting log data;

[0090] The transmission module 330 is used to send the target monitoring entity and the service level target matching the target monitoring entity to the target memory when it is determined that the target monitoring entity meets the alarm event indicators, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity and the service level target matching the target monitoring entity to the second processor.

[0091] The solution of this embodiment is to query each log data stored in the target memory in response to the monitoring instruction of the target service through the query module; determine the target log data and determine the target monitoring entity matching the target log data through the monitoring entity determination module; the target log data is the error log data; and when it is determined that the target monitoring entity meets the alarm event indicator through the transmission module, the target monitoring entity and the service level target matching the target monitoring entity are sent to the target memory, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity and the service level target matching the target monitoring entity to the second processor, which solves the problem that the traditional monitoring system cannot detect the error log data in real time and respond to the error log data, and can quickly detect the error log data and respond to the error log data.

[0092] In an optional implementation of this embodiment, the monitoring device for log data further includes: a collection module, which is used to collect log data generated during the operation of the target service in real time and store each of the log data in the target memory.

[0093] In an optional implementation of this embodiment, the monitoring entity determination module 320 is specifically used to traverse each of the log data and determine whether the target keyword exists in each of the log data;

[0094] In a case where it is determined that the target keyword exists in the first log data, the first log data is determined as the target log data.

[0095] In an optional implementation of this embodiment, the monitoring entity determination module 320 is further specifically used to determine the attribute information of the target log data;

[0096] A target monitoring entity matching the target log data is determined according to the attribute information of the target log data.

[0097] In an optional implementation of this embodiment, the log data monitoring device further includes: an alarm event indicator receiving module, which is used to receive an alarm event indicator matching the target monitoring entity fed back by an alarm center.

[0098] The log data monitoring device provided in the embodiment of the present invention can execute the log data monitoring method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0099] Embodiment 4

[0100] Figure 4 1 is a schematic diagram of the structure of a log data monitoring device provided according to Embodiment 4 of the present invention, wherein the device is configured in the second processor. Figure 4 As shown, the device includes: a receiving module 410 , a pre-aggregation module 420 and a display module 430 .

[0101] The receiving module 410 is used to receive a target monitoring entity, a service level objective matching the target monitoring entity, and reference log data matching the target monitoring entity sent by a target storage;

[0102] A pre-aggregation module 420 is used to perform pre-aggregation processing on the target monitoring entity, the service level objective and each of the reference log data to obtain a pre-aggregation result;

[0103] The display module 430 is used to transmit the pre-aggregation result to the display storage for storage, so that the display storage displays the pre-aggregation result.

[0104] The solution of this embodiment receives the target monitoring entity, the service level target matching the target monitoring entity and the reference log data matching the target monitoring entity sent by the target storage through a receiving module; performs pre-aggregation processing on the target monitoring entity, the service level target and the reference log data through a pre-aggregation module to obtain a pre-aggregation result; transmits the pre-aggregation result to the display storage for storage through a display module, so that the display storage displays the pre-aggregation result, which can quickly respond to the error log data and provide a basis for the maintenance of subsequent services.

[0105] The log data monitoring device provided in the embodiment of the present invention can execute the log data monitoring method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0106] In the technical solutions of the embodiments of the present invention, the collection, storage, use, processing, transmission, provision and disclosure of user personal information (such as facial information, voice information, etc.) are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0107] Embodiment 5

[0108] Figure 5 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0109] like Figure 5 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0110] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0111] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a method for monitoring log data.

[0112] In some embodiments, the method for monitoring log data may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the method for monitoring log data described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the method for monitoring log data in any other appropriate manner (e.g., by means of firmware).

[0113] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0114] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0115] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0116] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0117] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0118] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0119] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0120] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A log data monitoring method, applied to a first processor, It is characterized in that include: In response to the monitoring instruction of the target service, query each log data stored in the target storage; Determine target log data, and determine a target monitoring entity matching the target log data; the target log data is error-reporting log data; When it is determined that the target monitoring entity meets the alarm event indicators, the target monitoring entity and the service level target matching the target monitoring entity are sent to the target memory, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity and the service level target matching the target monitoring entity to the second processor.

2. The log data monitoring method according to claim 1, It is characterized in that Before responding to the monitoring instruction of the target service, it also includes: The log data generated during the operation of the target service is collected in real time, and each of the log data is stored in the target storage.

3. The log data monitoring method according to claim 1, It is characterized in that The determining of target log data includes: Traversing each of the log data, and determining whether a target keyword exists in each of the log data; In a case where it is determined that the target keyword exists in the first log data, the first log data is determined as the target log data.

4. The log data monitoring method according to claim 3, It is characterized in that The determining a target monitoring entity that matches the target log data includes: Determining attribute information of the target log data; A target monitoring entity matching the target log data is determined according to the attribute information of the target log data.

5. The method for monitoring log data according to claim 1, It is characterized in that After determining the target monitoring entity matching the target log data, the method further includes: Receive the alarm event indicator matching the target monitoring entity fed back by the alarm center.

6. A method for monitoring log data, applied to a second processor, It is characterized in that include: Receiving a target monitoring entity, a service level objective matching the target monitoring entity, and reference log data matching the target monitoring entity sent by a target storage; Performing pre-aggregation processing on the target monitoring entity, the service level objective and each of the reference log data to obtain a pre-aggregation result; The pre-aggregation result is transmitted to a display storage for storage, so that the display storage displays the pre-aggregation result.

7. A log data monitoring device, configured in a first processor, It is characterized in that include: A query module, used to query various log data stored in the target storage in response to the monitoring instruction of the target service; A monitoring entity determination module, used to determine target log data and determine a target monitoring entity matching the target log data; the target log data is error-reporting log data; A transmission module is used to send the target monitoring entity and the service level target matching the target monitoring entity to the target memory when it is determined that the target monitoring entity meets the alarm event indicators, so that the target memory determines each reference log data matching the target monitoring entity, and transmits each reference log data, the target monitoring entity and the service level target matching the target monitoring entity to the second processor.

8. A log data monitoring device, configured on a second processor, It is characterized in that include: A receiving module, configured to receive a target monitoring entity, a service level target matching the target monitoring entity, and reference log data matching the target monitoring entity, sent by a target storage; A pre-aggregation module, used for performing pre-aggregation processing on the target monitoring entity, the service level objective and each of the reference log data to obtain a pre-aggregation result; The display module is used to transmit the pre-aggregation result to the display memory for storage, so that the display memory displays the pre-aggregation result.

9. An electronic device, It is characterized in that The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the log data monitoring method according to any one of claims 1 to 5 or claim 6.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the log data monitoring method according to any one of claims 1 to 5 or claim 6 when executed.