Data monitoring method and platform, computing device and computer readable storage medium

The data monitoring platform obtains and processes the application service data, solves the problem of poor data monitoring effect in the existing technology, realizes comprehensive monitoring and timely problem discovery of applications, and improves the reliability and usage effect of applications.

CN120407331APending Publication Date: 2025-08-01JINSHAN SHIYOU (WUHAN) NETWORK TECH CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202510503063.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-21
Publication Date
2025-08-01

AI Technical Summary

Technical Problem

The data monitoring effect of applications in the prior art is poor, which affects the efficiency of problem discovery and maintenance optimization.

Method used

Provide a data monitoring method, obtain service data through the data monitoring platform, including service indicators, service logs and link tracking data, process and display, and issue alarm information in abnormal situations.

Benefits of technology

It improves the data monitoring effect of the application, can detect problems in a timely manner, and ensures the reliability and usage effect of the application.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120407331A_ABST
    Figure CN120407331A_ABST
Patent Text Reader

Abstract

The invention provides a data monitoring method and platform, computing equipment and a computer readable storage medium. The method comprises the following steps: for a target application program accessed to the data monitoring platform, acquiring service data of the target application program by using a data acquisition service; wherein the service data comprises data of service indexes, data of service logs and link tracking data; based on a data monitoring demand corresponding to the target application program, processing the service data; displaying a processing result of the service data in a chart form by using a data display service; and when determining that the service data satisfies a target alarm condition based on the processing result, sending alarm information in an information notification mode corresponding to the target alarm condition by using an alarm management service. The method can improve the data monitoring effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present application relate to the field of computer technology, and in particular, to a data monitoring method and platform, a computing device, a computer-readable storage medium, and a computer program product. Background Art

[0002] With the development of computer technology, various application programs are used more and more widely, and the requirements for the usage effects of application programs are also getting higher and higher.

[0003] Problems may occur during the development, upgrade, and user use of application programs. It is necessary to monitor all stages of application programs to discover problems and perform corresponding maintenance and optimization. Monitoring an application program usually involves monitoring relevant data at various stages of the application program, and this data monitoring process will greatly affect the usage effect of the application program.

[0004] However, the current data monitoring effect of application programs still needs to be improved. Summary of the Invention

[0005] Embodiments of the present application provide a data monitoring method, which can improve the data monitoring effect for application programs and correspondingly improve the usage effect of application programs. One or more embodiments of the present application also relate to a data monitoring platform, a computing device, a computer-readable storage medium, and a computer program product.

[0006] According to one aspect of the embodiments of the present application, a data monitoring method is provided, including:

[0007] For a target application program connected to the data monitoring platform, use a data acquisition service to obtain service data of the target application program; wherein, the service data includes data of service metrics, data of service logs, and link tracing data;

[0008] Process the service data based on the data monitoring requirements corresponding to the target application program;

[0009] Use a data display service to display the processing result of the service data in the form of a chart;

[0010] When it is determined based on the processing result that the service data meets the target alarm condition, use an alarm management service to send an alarm message in the information notification manner corresponding to the target alarm condition.

[0011] According to another aspect of the embodiments of the present application, a data monitoring platform is provided, including:

[0012] An acquisition module, configured to obtain service data of a target application accessing the data monitoring platform by using a data acquisition service; wherein, the service data includes service metric data, service log data, and link tracing data;

[0013] A processing module, configured to process the service data based on the data monitoring requirements corresponding to the target application;

[0014] A first display module, configured to display the processing result of the service data in the form of a chart by using a data display service;

[0015] An alarm module, configured to send an alarm message by using an alarm management service in a notification manner corresponding to the target alarm condition when it is determined based on the processing result that the service data meets the target alarm condition.

[0016] According to another aspect of the embodiments of the present application, a computing device is provided, including: a memory and a processor;

[0017] The memory is used to store computer programs / instructions, and the processor is used to execute the computer programs / instructions. When the computer programs / instructions are executed by the processor, the steps of the above method are implemented.

[0018] According to still another aspect of the embodiments of the present application, a computer-readable storage medium is provided, which stores computer programs / instructions. When the computer programs / instructions are executed by a processor, the steps of the above method are implemented.

[0019] According to another aspect of the embodiments of the present application, a computer program product is provided, including computer programs / instructions. When the computer programs / instructions in the computer program product are executed in a processor, the steps of the above method are implemented.

[0020] In an embodiment of the present application, for a target application, different services in the data monitoring platform perform data processing on service data in aspects such as service metrics, service logs, and link tracing based on data monitoring requirements, and perform corresponding display and alarm of the processing results. In this way, all-round data monitoring of the application program can be realized, ensuring better monitoring effect of the application program; the display and alarm can facilitate the staff to timely determine the problems of the application program, and correspondingly can ensure the timely solution of the problems, ensuring that the use effect of the application program can be better. Description of the Drawings

[0021] Figure 1 is a flowchart of a data monitoring method provided by an embodiment of the present application;

[0022] Figure 2It is a schematic structural diagram of a data monitoring platform provided by an embodiment of the present application;

[0023] Figure 3 It is a block diagram of the structure of a computing device provided by an embodiment of the present application. Detailed implementation manners

[0024] In the following description, many specific details are set forth in order to provide a thorough understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the connotation of the present application. Therefore, the present application is not limited by the specific implementations disclosed below.

[0025] The terms used in one or more embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit one or more embodiments of the present application. The singular forms "a", "the", and "said" used in one or more embodiments of the present application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present application refers to and includes any or all possible combinations of one or more of the associated listed items. The term "at least one" in one or more embodiments of the present application refers to "one or more", and "a plurality" refers to "two or more". The term "comprising" is an open description and should be understood as "including but not limited to", and other contents may also be included on the basis of the described contents.

[0026] It should be understood that although the terms "first", "second", etc. may be used in one or more embodiments of the present application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present application, "first" may also be referred to as "second", and similarly, "second" may also be referred to as "first". Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining".

[0027] In addition, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in one or more embodiments of the present application are all information and data that have been authorized by the user or fully authorized by all parties. And the collection, use, and processing of relevant data need to comply with relevant standards and requirements, and corresponding operation entrances are provided for the user to select authorization or rejection.

[0028] With the development of computer technology, there are more and more various application programs. The game industry has also developed rapidly, with various game software emerging in an endless stream, and the requirements for games in all aspects are getting higher and higher. Currently, major game companies are constantly exploring DevOps processes to improve game quality and user experience. DevOps is the general term for development and operation and maintenance, and it is an idea that combines development and operation and maintenance. In the DevOps process, issues to be considered during the operation period are taken into account during the early design stage, reducing the risk of reconstructing the server architecture during the later stage of game research and development, improving software development and operation and maintenance efficiency, and ensuring software quality at the same time.

[0029] Throughout the entire life cycle of an application program, such as from development to testing, then to online release, user use, and version upgrade, problems may exist in these processes. Usually, at each stage of the application program, it is necessary for staff to discover existing problems and handle the discovered problems to ensure the reliable progress of each stage of the application program. For an application program, the discovery and handling of problems are crucial. Usually, it is necessary to monitor the data at each stage of the application program to determine whether there are problems in this stage of the application program by whether the data meets the requirements. The effect of this data monitoring directly affects the discovery and timely handling of problems in the application program and is crucial for the reliability of the application program.

[0030] The embodiment of the present application provides a data monitoring method, which can improve the data monitoring effect of the application program, timely discover problems existing in each stage of the application program, and ensure the reliability of the application program. The present application also relates to a data monitoring platform, a computing device, a computer-readable storage medium, and a computer program product, which will be described in detail one by one in the following embodiments.

[0031] The data monitoring method provided by the embodiment of the present application can be applied to a data monitoring platform. This data monitoring platform can be connected to one or more application programs to monitor the data of the connected application programs, facilitating the timely discovery and handling of problems in the application programs. The application program can be connected to the data monitoring platform at any stage of its life cycle, enabling the data monitoring platform to monitor the data in this stage and subsequent stages. The execution devices at each stage of the application program can be connected to the data monitoring platform to realize connecting the application program to the data monitoring platform. For example, during the testing process of the application program, the testing device of the application program can be connected to the data monitoring platform; during the usage process after the application program is launched online, the background server of the application program can be connected to the data monitoring platform. The background server is connected to multiple user terminals installed with the application program to provide support for the operation of the application program in the user terminals.

[0032] Figure 1It is a flow chart of a data monitoring method provided by an embodiment of the present application. This method is applied to a data monitoring platform. For different steps in this method, corresponding services in the data monitoring platform can be used respectively. As Figure 1 shown, this data monitoring method includes the following steps 102 to 106.

[0033] Step 102: For the target application program accessing the data monitoring platform, use the data acquisition service to obtain the service data of the target application program; wherein, the service data includes data of service metrics, data of service logs, and link tracing data.

[0034] In the embodiment of the present application, the target application program is any application program accessing the data monitoring platform. For other application programs accessing the data monitoring platform, the relevant introduction for the target application program can be referred to. Exemplarily, the target application program can be a game application program, or can also be other types of application programs, such as an instant messaging application program or a video playback application program, etc.

[0035] The data monitoring platform can use the data acquisition service to obtain the service data of the target application program. This service data refers to the data generated by the services used by the target application program at the current stage. The data monitoring platform can obtain this service data from the server corresponding to the target application program. If the target application program is currently in the R & D stage, its service data can include data such as code writing services and parameter setting services. If the target application program is currently in the test stage, its service data can be the data generated by the test service. Another example is that when the target application program is in the user trial stage after going online, and the target application program is a game application program, which includes different game function sections such as a game lobby section, a skill training section, and a battle section. Each game function section can correspond to a service responsible for the implementation of this game function. The game lobby service can manage the game data triggered in the game lobby, such as managing data such as the number of players in the game lobby and the player interaction situation. These data can all belong to the service data generated by the game lobby service. Exemplarily, after the data monitoring platform obtains the service data of the target application program, it can store this service data.

[0036] In the embodiment of the present application, the service data of the target application program can include three aspects of data, namely data of service metrics (Metrics), data of service logs (Logs), and link tracing (Traces) data. The following will introduce these three types of data respectively. For these three different types of data, the data monitoring platform can use different data acquisition services to obtain them.

[0037] In the embodiments of the present application, service metrics to be monitored can be preset for a target application. The service metrics can be certain types of service data, or data obtained by performing certain processing on certain types of service data. For example, different service metrics can be set for different services of the target application, or the same service metrics can be set for different services. Optionally, corresponding thresholds can also be set for the service metrics. If the data of the service metrics exceeds the threshold, it can be considered that there is a problem with the service metrics.

[0038] Exemplarily, for some business services, such as HyperText Transfer Protocol (HTTP) services, which will make application requests. Corresponding service metrics can be set for this service, such as request error rate, request frequency, the time period with the highest or lowest request frequency, and request latency and other service metrics. Another example is that for some cloud services, machine-level data monitoring can be performed. For example, service metrics such as the Central Processing Unit (CPU) occupancy and memory capacity can be set for cloud services. Another example is that corresponding service metrics can be set for services written in different computer languages. For example, for Java services, service metrics such as heap memory, stack memory, and virtual machine data can be set for it. Another example is that for some game services, the service metrics can include the number of online players, the service's business level (such as determined according to the number of players that the server can carry), the regions where the players are located (such as 80% of the players are in the main city and 20% of the players are in the wild, etc.), the number of players in a battle, the number of idle players in the lobby, the number of players chatting, etc.

[0039] For the data of the service metrics, the data monitoring platform can use the registration service and the first data acquisition service to obtain the data of the service metrics. Before step 102, the data monitoring method provided by the embodiments of the present application can further include: registering the target service of the target application using the registration service, and obtaining the registration information of the target service, where the registration information at least includes the information of the data acquisition port of the target service. Correspondingly, in step 102, obtaining the service data of the target application using the data acquisition service includes: sending a service determination request for the target application to the registration service using the first data acquisition service, and receiving the registration information of the target service sent by the registration service; using the first data acquisition service to obtain the data of the service metrics from the data acquisition port of the target service based on the information of the data acquisition port in the registration information.

[0040] It should be noted that the services of the application programs registered in the registration service of the data monitoring platform can change. New services can be continuously registered, or the registered services can be deregistered. For example, the first data acquisition service can periodically send a service determination request for the target application program to the registration service. This service determination request is used to request the determination of the services of the target application program registered in the registration service. The periodically sent service determination request can be used to query the registration service whether the registered services of the application program have changed.

[0041] The registration service of the data monitoring platform can correspond to a service discovery platform, which is hereinafter referred to as the registration center. The registration center is a relatively large service cluster to ensure the service registration and discovery functions under the premise of high availability requirements. When any business service of the application program accessing the data monitoring platform (such as the target service of the target application program) is started, the business service will notify its information to the registration center for registration (that is, registration in the registration service). This information can be called the registration information of the business service. For example, the registration information can include the name of the business service, the type of the service port that can provide data (hereinafter referred to as the data acquisition port), the IP address of the business service, the information of the instance where the business service is located, the label information marked when the business service is declared, etc. The registration center can also perform health checks on the business service based on the metadata of the business service registered therein. This metadata can also belong to the registration information of the business service. For example, the metadata can include the basic information of the business service (such as service name, version number, IP address, and port number, etc.), function description information (such as including service responsibilities, interface lists, etc.), call rules (such as protocol type, complex balancing strategy, etc.), business labels (such as department, environment, region, etc.), and health status (such as load rate, read / write availability, etc.).

[0042] Communication between different business services is achieved by one business service calling another business service. After the business service is registered on the registration center, the business services can learn about the services to be communicated with each other, as well as the registration information such as the ports and IP addresses of the other services through the registration center. Obtaining this registration information can ensure that more details are configured by the business services themselves, ensuring decoupling between services. For example, the business service can set the endpoints of the data of the service metrics through the registration information, as well as the acquisition period of the data of the service metrics, etc.

[0043] In the embodiments of the present application, the first data acquisition service for service metrics can obtain the data of the target service of the target application for which it has permission to obtain through the registration service. For example, the first data acquisition service can be a Prometheus service. Exemplarily, the first data acquisition service can send a service determination request for the target application to the registration service. The registration service can, based on the service determination request, determine the target service of the target application that supports the first data acquisition service to acquire data, and send the information recorded at the time of registration of the target service (including the information of the data acquisition port) to the first data acquisition service. Correspondingly, the first data acquisition service can cache the information, and then, based on the information of the data acquisition port, acquire the data of the service metrics related to the target service from the data acquisition port.

[0044] Optionally, the first data acquisition service can periodically send a service determination request for the target application to the registration service to determine whether the service registration status of the target application has changed. In the case of a change, the information about the change will also be cached, so that the first data acquisition service has a global view of the services connected to the data monitoring platform and knows information such as the name, port, and address of each service. After the first data acquisition service for the application obtains the information of the data acquisition port of the target service, it can also periodically acquire the data of the service metrics from the data acquisition port. For example, it can acquire the data of the service metrics once every 10 seconds, 15 seconds, or other time intervals. The first data acquisition service can also parse the acquired data of the service metrics to obtain the key data required therein.

[0045] For example, for the game lobby service, after the service is registered, the first data acquisition service can learn the address of the game lobby service by sending a request to the registration service. After that, the first data acquisition service can request the game lobby service to acquire the data of the service metrics that the game lobby service can provide. The game lobby service can then start reporting the data of its service metrics, such as the number of players in the lobby, the level distribution of each player, and the memory occupied by the data of each player, etc.

[0046] After the first data acquisition service obtains this data, it can perform screening and summarization. For example, if the first data acquisition service acquires data every 15 seconds, it can summarize the data based on a relatively long time line (such as one hour). For one or more service metrics, a set of continuous points is used to represent the data of the service metric. Through this data summarization, the change situation of the data of the service metric can be determined, and then it can be determined whether the data of the service metric is normal based on this change situation.

[0047] For example, regarding the number of players in the lobby, the number is relatively small in the early morning and relatively large in the afternoon. A curve of the change in the number of people can be determined for each time period. Certain calculations can also be performed based on this data. For example, the change rate of the number of players can be calculated, it can be determined which time period has the fastest change rate of the number of players, and it can also be determined whether the change rate of the number of players exceeds the normal range. Based on the data of these service metrics, it can also be determined accordingly whether an alarm needs to be issued.

[0048] For the data of the service log, in step 102, the service data of the target application is obtained by using the data acquisition service, including: obtaining the initial log from the log storage space corresponding to the target application by using the second data acquisition service, and sending the initial log to the log management service; using the log management service to parse the initial log to obtain multiple target fields corresponding to each initial log, and obtaining the data of the service log based on the information of the initial log and each target field.

[0049] All kinds of services (internal or external services) will generate logs during operation, and these logs will be written into the set log storage space, such as written into a specific file or the container where the service itself is located. There can be a specific service in the data monitoring platform to obtain these logs. For example, the service will be referred to as the second data acquisition service below. The second data acquisition service can be different from the first data acquisition service. The second data acquisition service can obtain logs from this log storage space, such as obtaining logs one by one in sequence. The log directly obtained by the second data acquisition service from the log storage space will be referred to as the initial log below.

[0050] The second data acquisition service can send each obtained initial log to the log management service for summary management and analysis. The log management service is a centralized service, such as the log management service is the Loki service. The log management service will collect, parse, and store the initial logs. For example, the log management service can parse the logs according to a pre-agreed format to determine the information of multiple target fields in each initial log, and the target field can belong to the pre-agreed format. For example, the target field can include fields such as the log generation time, log level (such as warning or error levels), the cluster to which the log belongs, and the machine targeted by the log. After the log management service obtains the information of the target fields of each initial log, it can combine the initial log and the information of this target field as the finally obtained data of the service log.

[0051] In some embodiments, for various services connected to the data monitoring platform, these services can be required to generate logs in the format uniformly specified by the data monitoring platform. In this way, it can be ensured that the data monitoring platform can parse more conveniently after obtaining the logs to determine the information of each target field and obtain the data of the service log.

[0052] After the log management service obtains the data of the service log, the data of the service log can be stored. In some embodiments, after obtaining the data of the service log based on the initial log and the information of multiple target fields, the data monitoring method provided by the embodiments of the present application further includes: respectively storing the data of the service log based on each target field, and tagging the stored data of the service log; using the log management service to receive a log query request, and querying the data of the target service log corresponding to the target tag in the data of each service log based on the target tag carried by the log query request; using the data display service to organize and display the data of the target service log in a target format.

[0053] The log management service can batch store the data of the corresponding service log based on each target field. For example, the data of each service log corresponding to the same target field can be stored in the same storage space. Exemplarily, all logs from the same service can be stored together. For example, the logs from the game hall service can be stored in space a, the logs from all copy services can be stored in space b, and the logs from the same cluster can be stored together. The log management service can store the data of the service log periodically. For example, the data of the service log corresponding to each target field generated within a period of time is collected to batch store the data within this period of time. The data collected in different time periods can be stored in different spaces.

[0054] In some embodiments, the log management service may not batch store the data of the service log corresponding to each target field either. For example, the data of the service log triggered by different objects can be stored in different spaces respectively, and the data is marked with the corresponding target field, so as to facilitate log search based on the target field.

[0055] After storing the service log data, the log management service can also tag the data of each service log based on the target field. By way of example, a certain log indicates that a player entered the game at 10:10 PM on April 10, 2025. His name is A, he is equipped with B equipment, he opened a treasure chest, and the content of the treasure chest is C. After obtaining this log, the log management service can record the specific log content and use the information of the game, service, cluster, and machine (such as d game, e service, f cluster, and g machine) from which the log comes as the tag of this log. For example, the specific log content includes "Player A entered the game at 10:10 PM on April 10, 2025. The player is equipped with B equipment, he opened a treasure chest, and the content of the treasure chest is C". Optionally, the generation time of the log can also be used as the tag of the log. Continuing with the log in the above example, this log can be generated after player A opened the treasure chest. Assuming the generation time is 10:10 PM on April 10, 2025, then the information "10:10 PM on April 10, 2025" can be used as the tag of this log. In this way, the logs can be collected and stored in a standardized manner, facilitating subsequent log utilization.

[0056] When the staff needs to obtain logs for analysis, they can conduct log queries. For example, the staff can send a log query request to the data monitoring platform through a terminal device connected to the data monitoring platform. This log query request can be sent to the log management service of the data monitoring platform. This log query request can carry the tag of the log (such as the target tag, which is some keywords), so that the log management service can query the corresponding target service log data from the stored data of each service log based on this target tag. By way of example, the log query request can indicate to query the logs from e service, f cluster, and g machine during the period from 10:01 PM to 10:15 PM. In the embodiments of the present application, tags are set for each target field during log storage. In this way, it is convenient to conduct log queries based on these tags later, which can simplify the log query process and improve the log query efficiency.

[0057] After the log management service queries the data of the target service log, it can be externally displayed. For example, the log management service can send the data of the target service log to the data display service for display using the data display service. In one implementation, the data display service is the Grafana service. Grafana is an open-source data visualization and monitoring platform, mainly used to convert data such as metrics and logs in various data sources into intuitive charts and dashboards to help users monitor and analyze the system status in real time. The data monitoring platform in the embodiments of this specification can be connected to the Grafana platform to obtain the services provided by the Grafana platform, and this service is called the Grafana service.

[0058] Exemplarily, the data display service may trigger the terminal device of the staff member to display the data of the obtained target service log. The data display service may also sort out the data of the queried target service log based on a set log display method (such as a target format), and then trigger the terminal device to display the sorted data for the convenience of the staff member to view. For example, each log may be arranged in chronological order, or arranged in the order of the log levels to which they belong, or arranged separately according to user behaviors (such as user login behavior, user logout behavior, etc.).

[0059] For the link tracing data, it includes the behavior data of the user in the link from login to logout. The user is represented by a corresponding account. Correspondingly, in step 102, the data acquisition service is used to acquire the service data of the target application, including: using the third data acquisition service, when logging in to the target account for the target application, recording each behavior information corresponding to the target account in chronological order to obtain the link tracing data corresponding to the target account. The third data acquisition service may be different from the first data acquisition service and the second data acquisition service, and the third data acquisition service may be a link tracing service. The target account is any account that logs in to the target application. Some link tracing tools may be embedded in the data monitoring platform, such as existing link tracing tools like OpenTelemetry or Jaeger distributed tracing systems. The link tracing service may refer to the services provided by these link tracing tools. The link tracing tools can be used to record the entire life cycle of the operations of each target account corresponding to the target application to obtain the link tracing data corresponding to each target account. In some ways, the executable file of the link tracing tool may be installed in the data monitoring platform; or, the data monitoring platform may also have a call interface connected to the link tracing tool, and this call interface can be used to call the link tracing tool to provide the link tracing service.

[0060] During the running of the target application, various calls between services are required, and the calls between services have a long link. For example, starting from the player logging in to the account, the user name and password need to be entered for verification. After successful login, the game server needs to be logged in. Then, when playing a dungeon, the dungeon server needs to be entered. After finishing, the game server needs to be exited. When chatting, the chat server needs to be entered. Adding a friend requires logging in to the friend server, and so on. Service calls are required for each jump between two servers. The entire game process of the player will have a series of long links. In the embodiments of the present application, the data monitoring platform can perform link tracking on the player's behavior to monitor various behavior data in the entire link and determine whether there are any problems. For example, the data monitoring platform can mark the behavior each time the player makes an instruction input (such as clicking the confirmation button, etc.), and record the information corresponding to the behavior, such as recording which player performed what action at which time. The information corresponding to each behavior recorded for the player is concatenated in chronological order to obtain the information of the player's behavior link (i.e., link tracking data), realizing the link tracking for the player. Through this link tracking, it is convenient to accurately find problems and correct them in time.

[0061] In the embodiments of the present application, for each target account, the behavior data during the process from login to logout can be regarded as a link. In the case of logging in to the target account for the target application, a link can be considered to start, and a link tracking identifier (trace ID) can be assigned to the target account. Subsequently, each behavior information based on the target account carries this link tracking identifier. Each behavior information in this life cycle can also have a corresponding identifier, such as a span identifier (span ID). During the entire life cycle of the target account, this trace ID is unique. The length of this trace ID is relatively long, such as it can be a 32-bit to 40-bit number. The third data acquisition service can record the information of each behavior based on the target account in chronological order to obtain link tracking data in a tree structure. The third data acquisition service can use the corresponding trace ID for each logged-in account to record its link tracking data, and can store the obtained link tracking data in a specified database.

[0062] Exemplarily, in the link tracing data of the tree structure, the root node represents the main action (such as logging in to the game), the subtree represents the branch actions (such as clicking on the mall, gacha, and payment in sequence, etc.), the level represents the dependency relationship, and the leaf node represents the most detailed operation (such as calling the Alipay API). The link tracing data in this way can facilitate quickly finding problems and quickly calculating the time consumption. If the payment fails during gacha in the mall, the error of the subtree corresponding to this action can be directly viewed to determine the problem. Through the information of each node, the time consumption between two actions can be quickly counted. For example, the total time consumption from logging in to successful gacha can be quickly counted.

[0063] In some embodiments, after obtaining the link tracing data corresponding to the target account in step 102, the data monitoring method provided by the embodiments of the present application further includes: using the data display service to send a link query request for the target account to the third data acquisition service; using the third data acquisition service to send the link tracing data corresponding to the target account to the data display service based on the link query request; using the data display service to display the received link tracing data.

[0064] After the data monitoring platform obtains the link tracing data corresponding to each account, the staff can query the link tracing data they want to analyze. For example, the staff can use the data display service through their terminal device to send a link query request for the target account to the third data acquisition service. Correspondingly, the data monitoring platform can use the third data acquisition service to query the link tracing data of the target account in the database and feedback it to the data display service. The data display service can display the received link tracing data to the staff. Exemplarily, the data display service can display the link tracing data according to the timeline.

[0065] In some embodiments, the link query request may carry a target time period, that is, a partial time period in the entire life cycle of the target account. Correspondingly, the data monitoring platform can use the third data acquisition service to query the link tracing data within the target time period and send the queried link tracing data to the data display service for display. In this way, it can facilitate users to flexibly query the desired link tracing data, avoid obtaining too much useless data, and ensure the accuracy of data acquisition.

[0066] Step 104: Process the service data based on the data monitoring requirements corresponding to the target application.

[0067] For a target application, certain data monitoring requirements can be preset. For example, for service metrics, service logs, and trace data, corresponding data monitoring requirements can be set respectively. The data monitoring requirements can specify the types of service data to be monitored. In this way, based on the data monitoring requirements, processing the service data can involve screening the service data to be monitored from all the obtained service data. Subsequently, based on these service data, it can be determined whether there are problems with the application.

[0068] In some embodiments, the data monitoring requirements can indicate whether the corresponding data is normal and whether it meets the conditions required for normal data. For different types of service data, different services in the data monitoring platform can be used to perform corresponding data processing to determine whether there are problems with the target application based on this data. In one embodiment, the data processing result can indicate whether the corresponding service data is normal. Accordingly, an alarm can be issued when the service data is abnormal.

[0069] For service metrics, the data monitoring requirements can be the normal ranges for the data of each service metric. The processing of the data of service metrics by the data monitoring platform can be to determine whether the data of each service metric is within the corresponding normal range; it can also be to organize and summarize the data of service metrics, or generate corresponding data representation curves. Optionally, the data monitoring requirements can also be the conditions that the results obtained after certain analysis or calculation of the data of service metrics need to meet. In this case, the data monitoring platform can perform corresponding analysis or calculation based on the obtained data of service metrics and determine whether the analysis or calculation results meet the conditions to achieve the processing of service data. By way of example, for the service metric of the number of online users of a certain service, the data monitoring platform can directly determine whether the number of online users is within the normal range, or the data monitoring platform can also determine the rate of change of the number of users at each moment based on the number of online users at each moment and determine whether the rate of change of the number of users is within the normal range. For the data of service metrics, the corresponding data monitoring requirements are usually relatively simple, and the data display service can be used to process the data of this service metric.

[0070] For the data of service logs, the processing of the service data based on the data monitoring requirements corresponding to the target application in step 104 can include: using the log management service to process the data of service logs based on the data monitoring requirements corresponding to the target application. By way of example, the processing of the data of service logs can include comparing the data of each service log in the time dimension. It can also include identifying the types of the data of service logs and then performing processing such as induction, sorting, or aggregation.

[0071] For the link tracing data, in step 104, based on the data monitoring requirements corresponding to the target application, the service data can be analyzed, including: comparing and analyzing the behavior information of the same type in the link tracing data corresponding to the target account on the timeline; or, comparing and analyzing the behavior information of the same type in the link tracing data corresponding to different accounts.

[0072] The link tracing data is data for a target account and related to its timeline. For the link tracing data, horizontal analysis and vertical analysis can be performed to determine different service problems.

[0073] Horizontal analysis is to analyze the link tracing data of a target account on the timeline. For example, in the link tracing data corresponding to the target account, the behavior information of the same type is compared and analyzed on the timeline. For example, the target user plays in the dungeon area both in the early morning and at noon, and accordingly, the dungeon settlement operation needs to be performed. The dungeon settlement needs to perform a one-time settlement of the data of all players in the dungeon area to determine the equipment, items, or experience points obtained by each player in the dungeon, as well as the data of consumed items, etc. In the early morning dungeon, the number of real players is small and the number of robots is large, and the dungeon settlement takes 200 milliseconds. In the afternoon dungeon, the number of real players is large and the number of robots is small, and the dungeon settlement takes up to 5 seconds. By comparing and analyzing the dungeon settlement time of the target user (which can belong to the behavior information of the dungeon game type) on the timeline, the different performances of this behavior information at different times can be determined, and further, it can be inferred that there may be a problem of insufficient operating resources on the server in the afternoon. Accordingly, certain problem handling can be carried out, such as expanding the operating resources of the server in the afternoon.

[0074] Vertical analysis is to analyze the link tracing data of different accounts. For example, in the link tracing data corresponding to different accounts, the behavior information of the same type is compared and analyzed. For example, the dungeon settlement time of user A is longer than that of other users. That is, for the type of dungeon settlement time, the data of user A and other users are compared and analyzed, and it can be inferred that there may be a problem with the relevant equipment of user A or the relevant services provided for it.

[0075] Step 106: Use the data display service to display the processing results of the service data in the form of a chart.

[0076] In the embodiments of the present application, the data monitoring platform can use the data display service for data display. For example, the processing results obtained by processing various service data in step 104 can be displayed, and the service data can be more intuitively displayed on the timeline in the form of a chart. The data monitoring platform can display the processing results for some service data. For some service data, these service data can be directly displayed.

[0077] Exemplarily, the data display service may generate a curve of the number of people changing based on the number of online people of each service, and display the curve of the number of people changing. The data display service may also determine the rate of change of the number of people at each moment based on the number of online people of each service, generate a curve of the rate of change of the number of people, and display the curve of the rate of change of the number of people. Additionally, exemplarily, the data display service may display the classification of the data in the service log, as well as display the link tracing data corresponding to a specific account. Additionally, exemplarily, the data display service may also only display the service data that does not meet the data monitoring requirements, such as the service data that is not within the normal range.

[0078] In some embodiments, by using the data display service, the screen of the terminal device may be controlled to simultaneously display multiple service data or their processing results, so that the staff can intuitively obtain various service data and conveniently determine whether there are problems with the target application program.

[0079] Step 108, when it is determined based on the processing result that the service data meets the target alarm condition, use the alarm management service to send an alarm message in the information notification manner corresponding to the target alarm condition.

[0080] In the embodiments of the present application, corresponding alarm conditions may be preset for each service data. The alarm condition may be an alarm condition corresponding to the processing result of the service data, and an alarm needs to be issued when the processing result meets the alarm condition. When a certain service data meets the corresponding target alarm condition, it may be determined that the service data exceeds the normal range, and there are some problems with the target application program related to the service data. Optionally, when the foregoing data monitoring requirements indicate the normal range of the data, the target alarm condition may be a problem determination condition that is one level higher than the data monitoring requirements.

[0081] In the embodiments of the present application, the data monitoring platform may determine whether each service data meets the target alarm condition, such as by using the data display service. When it is determined that a certain service data meets the target alarm condition, the data display service may push the corresponding alarm message to the alarm management service, so that the alarm management service issues an alarm message. Exemplarily, for different service data and their target alarm conditions, there may be corresponding information notification manners, and the alarm management service issues an alarm message in the information notification manner corresponding to the target alarm condition. For example, for a certain service data and one alarm condition, the alarm message needs to be sent by text message, and for another alarm condition, a phone call is required to send the alarm message. In this way, different notification methods can be adopted for different problem levels, improving the flexibility of the alarm and achieving better control of the urgency of the alarm.

[0082] Before sending an alarm message, the alarm management service can also determine the recipients of the alarm message, that is, determine which personnel or groups the alarm message will be sent to. By way of example, the alarm management service can determine the recipients of the alarm message based on the information obtained from the registration center. If a piece of service data of the target service meets the corresponding target alarm message, the alarm management service can determine the recipient according to the metadata in the registration information of the target service. For the description of this metadata, reference can be made to the foregoing introduction to the metadata of business services, and no additional elaboration will be made here.

[0083] After receiving the alarm message regarding a piece of service data, the recipient can handle the problem for the alarm message. During the problem handling process, the alarm event of the service data can be put into a silent state, and the duration of the silent state can also be set. This silent state can be displayed to the staff through the data display service, so that the staff can know that the problem is being handled for the alarm event. After reaching this duration, if the problem has not been successfully handled, the alarm message can be sent again; if it is determined that someone is still handling the problem, the silent state can continue to be maintained.

[0084] In some embodiments, the Infrastructure as Code (IaC) technology can be used to perform configuration during the running process of the target application. Infrastructure as Code manages and provisions the basic game server facilities through code instead of manual processes. It can create a configuration file containing the specifications of the basic server facilities, thus facilitating the editing and distribution of the configuration. In addition, it can also ensure that the environment provisioned each time is exactly the same, avoiding unrecorded temporary configuration changes. By organizing and recording the configuration specifications, IaC helps to achieve configuration management and improves the efficiency of the development and deployment processes.

[0085] By way of example, before obtaining the service data of the target application by using the data acquisition service for the target application accessing the data monitoring platform in step 102, the data monitoring method provided by the embodiments of the present application further includes: for the target application accessing the data monitoring platform, when the corresponding facility configuration conditions are met, submitting the configuration code corresponding to the facility configuration conditions to the facility configuration service; wherein, the facility configuration conditions are the conditions met by the service data; using the infrastructure configuration service to execute the configuration code to configure the facilities required for the target application to run.

[0086] In the embodiments of the present application, multiple different facility configuration conditions can be preset for a target application. Each facility configuration condition can correspond to different situations of service data. For each facility configuration condition, a corresponding configuration code can be set, and this configuration code is used to indicate configuring corresponding facilities for the application. This configuration code can be stored in a code library. The data monitoring platform can continuously determine whether various facility configuration conditions are met, and submit the corresponding configuration code when any facility configuration condition is met, so as to automatically configure corresponding facilities for the application without manual configuration. Optionally, corresponding configuration codes can also be set for various alarm situations to automatically handle alarm situations, repair problems, and reduce the problem of low efficiency caused by users manually repairing problems.

[0087] Exemplarily, for the game hall service, it can be initially set that the maximum number of players it can accommodate is 3000 people. When the actual number of players exceeds this number, the server can be expanded, and more service resources can be configured for this game hall service. For this example, the facility configuration condition can be that the number of players is greater than 3000 people, and the corresponding configuration code can indicate configuring more service resources for this service. In this way, when the actual number of players is greater than 3000 people, the corresponding configuration code can be submitted from the code library to the facility configuration device to achieve automatic resource expansion. Optionally, facility configuration can also include the creation of virtual machines and parameter modification, etc., which are not limited here.

[0088] The above content all describes that the data monitoring platform obtains data from the server of the target application and observes and monitors the target application based on the obtained data. In the embodiments of the present application, the data monitoring platform can also obtain data during the operation of the target application from the terminal installed with the target application, so as to monitor and analyze the target application through these data, and then optimize the target application.

[0089] After the target application is developed, it usually enters the internal test stage. In this stage, the target application is sent to the terminal for internal testing (hereinafter referred to as the internal test terminal), and the target application is installed and run on this internal test terminal to test the performance of the target application, determine whether there are still problems with the target application, and then further optimize and adjust the target application based on the test results. In this internal test stage, the data monitoring platform can be used for data monitoring and analysis to help the staff obtain the internal test results more quickly, conveniently and accurately.

[0090] In one embodiment, the data monitoring method provided in the embodiment of the present application also includes: receiving target performance data of multiple operating indicators during the operation of the target application sent by the internal test terminal, wherein the target performance data is obtained by filtering the performance data at each moment based on the corresponding operating indicators; and displaying the target performance data using a data display service.

[0091] The internal test terminal is installed with a target application for internal testing. The target application here can be a version specifically for internal testing, which may be different from the version after it is officially launched. For the sake of distinction, the target application of the internal test version will be referred to as the internal test program below. The internal test program can carry some software development kits (SDK, Software Development Kit), and the SDK can indicate various operating indicators that need to be monitored for the internal test program. The operating indicator refers to some data or parameter types that reflect the operating status during the program operation. Each operating indicator can correspond to a default data screening standard, or the SDK can also clearly indicate the data screening standard for each operating indicator.

[0092] While running the internal test program, the internal test terminal can continuously monitor its performance data. For example, the corresponding performance data can be determined for each frame of the internal test program, and target performance data can be filtered from this performance data to reduce the amount of data ultimately used and the network resources (such as data traffic) consumed by the internal test terminal in sending data to the data monitoring platform. The target performance data sent by the internal test terminal to the data monitoring platform can be target performance data at multiple moments on the timeline.

[0093] The internal test terminal can determine the performance data that needs to be monitored based on each operating indicator. The operating indicator can correspond to the type of performance data. For example, the internal test program is a game program, and its corresponding operating indicators may include the number of triangles included in each object model in the game screen, the frame rate during the game, the power consumption speed of the device, and CPU occupancy and other indicators. Accordingly, the internal test terminal can continuously monitor the data corresponding to these operating indicators, that is, performance data. For different internal test programs, the corresponding operating indicators may be different. Optionally, the operating indicators corresponding to each internal test program may also be the same, which is not limited here. In some embodiments, the internal test terminal can also determine the performance data it needs to monitor based on a general performance monitoring standard, and then screen the performance data for the internal test program according to the corresponding operating indicators.

[0094] The internal test terminal can screen the target performance data of each running metric from all the monitored performance data based on various running metrics and data screening criteria corresponding to the internal test program. For example, the internal test terminal can mark the performance data frame by frame for each running metric, that is, mark the data that meets the conditions, and then transmit the marked performance data as the target performance data to the data monitoring platform. Exemplarily, the data screening conditions corresponding to each running metric can be to determine the most representative frame of data for the running metric every certain period of time (such as 1 second). The frame of data here can refer to the performance data corresponding to a frame of picture. For example, for the CPU occupancy metric, the corresponding data screening condition can be to determine the highest CPU occupancy among the CPU occupancies of each frame per second as a target performance data after screening. The representative criteria corresponding to different running metrics are different. For example, the most representative data corresponding to some running metrics is the data with the smallest value.

[0095] The internal test program can be a game program. The internal test terminal can only monitor the performance data during the actual game process and screen the corresponding target performance data. After determining each target performance data, the internal test terminal can transmit the target performance data to the data monitoring platform. Alternatively, the internal test terminal can also transmit all the target performance data corresponding to the game after a game ends to the data monitoring platform. Optionally, the internal test terminal can screen the target performance data in real time during the actual game process; or it can also record the performance data of each frame during the actual game process and then screen after the game ends.

[0096] After screening the target performance data, the internal test terminal can also encode and compress the target performance data to further reduce the amount of data transmitted and reduce the network resource consumption caused by data transmission. The method used for encoding is not limited here. For example, Protobuf (Protocol Buffers) can be used for encoding.

[0097] After obtaining the target performance data at multiple moments, the data monitoring platform can display these target performance data. For example, display them using the same data display service as described above. The data monitoring platform can display these target performance data in the form of a chart in chronological order. The data monitoring platform can display the target performance data of each running metric separately, or can also display the target performance data of some different running metrics using the same chart. Through this display, the R & D personnel or maintenance personnel of the internal test program can analyze these performance data, judge whether each running metric is abnormal, and specifically what causes it when it is abnormal, so as to analyze and optimize the running situation of the program.

[0098] In some embodiments, the internal test terminal can also transmit data such as the operation logs of the internal test program to the data monitoring platform for the data monitoring platform to monitor and analyze the operation process of the internal test program. In some embodiments, the data monitoring platform can also store the data received from the internal test terminal. For the specific method, reference can be made to the foregoing introduction about service data, which will not be elaborated here.

[0099] In the embodiments of the present application, the data monitoring platform can also be provided with a feedback mechanism to feedback information to the internal test terminal based on the target performance data uploaded by the internal test terminal to guide the data upload of the internal test terminal. In one way, the data monitoring method provided by the embodiments of the present application further includes: when it is determined that the data volume of the target performance data sent by the internal test terminal of the target type is greater than the target threshold based on the terminal type corresponding to each received target performance data, a stop transmission instruction is sent to the internal test terminal of the target type.

[0100] Each piece of target performance data uploaded by the internal test terminal to the data monitoring platform will carry the terminal type of the internal test terminal, and this terminal type can be the terminal model. The internal test stage is used to test whether the target application program can run normally on various different types of terminals. For each type of terminal, an appropriate amount of data needs to be collected to determine the test result. This data needs to be relatively large but not overly huge to avoid excessive waste of network transmission resources and processing resources. The data monitoring platform can determine whether the target performance data transmitted by each type of terminal is sufficient for analysis. After determining that the uploaded target performance data is sufficient to support the analysis of a certain type of terminal and obtaining the internal test result on this type of terminal, the data monitoring platform can send a notification transmission instruction to this type of terminal to indicate that the terminal does not need to continue uploading the target performance data. In this way, only an appropriate amount of target performance data can be collected for each type of terminal, reducing the resource consumption caused by excessive data transmission and processing and avoiding data redundancy.

[0101] Exemplarily, for each type (such as the target type) of internal test terminal, the data monitoring platform determines the data volume of all the target performance data uploaded by this type of internal test terminal and judges whether this data volume is greater than the set target threshold. If the data volume is greater than the target threshold, it is considered that this data volume is sufficient to support the analysis of the terminal of the target type.

[0102] After the target application is completed in the internal test, it will enter the formal online usage stage. In this stage, the target application is sent to various terminals (hereinafter referred to as target terminals), and the target application can be installed and run on the target terminal to actually use the functions of the target application. The target application in this stage can delete the SDK for collecting data related to running metrics compared to the aforementioned internal test program to avoid infringing on user privacy. Since not all problems of the program may be discovered during the previous testing and internal test stages, it is necessary to continue monitoring the target application after it is formally put into use to check whether there are still problems, and then optimize and adjust the target application based on the test results to ensure better usage effects of the target application.

[0103] In one implementation manner, the data monitoring method provided by the embodiments of the present application further includes: receiving the running problem data of the target application sent by the target terminal; summarizing the received running problem data based on the problem monitoring requirements corresponding to the target application, and displaying the summarized running problem data; and sending a problem handling notification message to the information notification terminal based on the running problem data.

[0104] There may be many problems that were not discovered during testing when the target terminal is running the target application, such as program crashes, freezes, serious overheating of the terminal, data loading failures, or some running error messages (such as some objects cannot be loaded, cannot talk to NPCs, items cannot be handed in, etc.). In the embodiments of the present application, the data related to these problems is referred to as running problem data. By way of example, the running problem data may include player information, device model, device status (such as available storage space, battery power, etc.), and underlying code call conditions when the problem occurs. Optionally, the running problem data may further include some other relevant attachments, such as screenshot data or some log data when the problem occurs. When the target terminal has problems during the process of running the target application, relevant running problem data can be collected and uploaded to the data monitoring platform.

[0105] For various application programs detected by the data monitoring platform, corresponding problem monitoring requirements can be recorded. The problem monitoring requirements can be set by the developers or operation and maintenance personnel of the application programs, or can be common to multiple application programs. The problem monitoring requirements can indicate the types of problems to be monitored and information on how to process various operation problem data. For example, some operation problem data can be directly displayed in text format after being received, some operation problem data need to construct a data change trend chart according to the time sequence before being displayed, some operation problem data are displayed when they reach a certain amount, some operation problem data need to be analyzed together with multiple data, and some operation problem data need to directly send problem handling notification information to relevant personnel after being received.

[0106] After receiving various operation problem data sent by each target terminal, the data monitoring platform can process these operation problem data according to the corresponding problem monitoring requirements of the target application program. For example, comparing multiple operation problem data of the same type, or generating a change curve based on operation problem data at different times. In the embodiments of the present application, the processing of the data sent by the terminal by the data monitoring platform can refer to the relevant processing of the service data to a certain extent. After processing the operation problem data, it can be displayed. For example, it can be displayed using the aforementioned data display service (such as Grafana service), or it can also be displayed using another data display service different from the aforementioned data display service. For example, the other data display service can include data display services provided by data monitoring tools such as Zabbix, Kibana, or NetData, and the data display service can also be provided by other existing data monitoring tools, which is not limited here.

[0107] Multiple data display services can be embedded in the data monitoring platform, and different data display services can be used for different scenarios; or, some data display services can be used as backups, and a certain data display service is preferentially used. When this data display service cannot work properly, another data display service is switched to.

[0108] The data monitoring platform can also use the aforementioned alarm management service to send problem handling notification information to the information notification terminal. For example, the information notification terminal can refer to the terminal of the staff used to handle the corresponding operation problem, so that the staff can be notified in time to repair the corresponding operation problem and ensure the use effect of the application program. The data monitoring platform can also use corresponding notification methods to send the problem handling notification information for different operation problems. Regarding the problem handling notification information, reference can be made to the relevant introduction of the aforementioned alarm information, which will not be elaborated here.

[0109] The data monitoring platform in the embodiments of the present application belongs to an observability system. Through aspects such as service metrics, service logs, link tracing, data display, error monitoring, and alarm, it realizes all-round monitoring of the application program, improves the observability of the system, helps the team quickly identify and solve problems, and thus improves service quality and user experience. Among them, service logs provide detailed information during the operation of the system, including errors, warnings, and important operations. The logs are structured, facilitating analysis and query, and can also include context information for problem diagnosis. By collecting and analyzing the logs, problems can be quickly located, the behavior of the system can be understood, and the system performance can be optimized. Link tracing is used to track the flow path of requests in a distributed system. Through link tracing, it can be understood how requests pass through each component of the system and how the performance of each component affects the overall performance, which can better help the system identify performance bottlenecks, optimize the system architecture, and improve service quality.

[0110] Error monitoring can evaluate the performance and health status of the system by collecting system metrics (such as CPU usage, memory usage, network traffic, etc.), can identify performance problems in real time, predict potential failures, and optimize the system performance. It can also help support rapid problem location and detection, and reduce duplicate and ineffective alarms. By setting reasonable alarm rules, it can ensure that the team can respond in a timely manner when problems occur, thereby reducing downtime and impact, and improving the reliability and availability of the system.

[0111] In the embodiments of the present application, data monitoring of the target application program in each stage (development, testing, and after going live) can be realized through the data monitoring platform, problems can be discovered more timely and effectively, facilitating timely problem solving and enhancing the reliability of the application program. For the game scenario, the data monitoring platform can be designed according to the game server architecture, can integrate various server metrics, and develop a comprehensive view monitoring, which can help the development team and operation and maintenance system of the application program have a stable running state, and can quickly identify and solve problems. It can monitor the performance, availability, errors, and security of the system in real time, and provide detailed logs and tracing information for problem diagnosis and solution. In this way, the observability of the service is enhanced, user needs can be responded to faster, service quality can be improved, and downtime can be reduced.

[0112] The embodiments of the present application can ensure the transparency of the entire operation process of the target application program. Staff can see the data of some metric parameters, and then when these metric parameters meet the expectations, there can be some automated alarm measures for the staff to immediately intervene and handle. In this way, whether in the R & D stage of the application program or after going live, attention and handling can be carried out only when there is an alarm, without continuous manual monitoring.

[0113] In summary, in the data monitoring method provided by the embodiments of the present application, for a target application program, different services in the data monitoring platform perform data processing on service data based on data monitoring requirements in terms of service metrics, service logs, and link tracing, and perform corresponding display of processing results and alarm. In this way, all-round data monitoring of the application program can be achieved, ensuring better monitoring effect of the application program; the display and alarm can facilitate the staff to determine the problems of the application program in a timely manner, and correspondingly can ensure the timely solution of the problems, ensuring that the use effect of the application program can be better.

[0114] Corresponding to the above method embodiment, the present application also provides an embodiment of a data monitoring platform. Figure 2 It is a schematic structural diagram of a data monitoring platform provided by an embodiment of the present application. As Figure 2 shown, the data monitoring platform includes:

[0115] An acquisition module 202, configured to use a data acquisition service to acquire service data of a target application program for the target application program accessing the data monitoring platform; wherein, the service data includes data of service metrics, data of service logs, and link tracing data;

[0116] A processing module 204, configured to process the service data based on the data monitoring requirements corresponding to the target application program;

[0117] A first display module 206, configured to use a data display service to display the processing result of the service data in the form of a chart;

[0118] An alarm module 208, configured to, when it is determined based on the processing result that the service data meets the target alarm condition, use an alarm management service to send an alarm message in a message notification manner corresponding to the target alarm condition.

[0119] Optionally, the data monitoring platform further includes:

[0120] A registration module, configured to, before using the data acquisition service to acquire service data of the target application program, use a registration service to register the target service of the target application program and obtain registration information of the target service, where the registration information at least includes information of the data acquisition port of the target service;

[0121] The acquisition module 202 is configured to:

[0122] Send a service determination request for the target application program to the registration service by using a first data acquisition service, and receive the registration information of the data acquisition port of the target service sent by the registration service;

[0123] Use the first data acquisition service to obtain service metric data from the data acquisition port of the target service based on the information of the data acquisition port in the registration information.

[0124] Optionally, the acquisition module 202 is used for:

[0125] Use the second data acquisition service to obtain the initial logs from the log storage space corresponding to the target application, and send the initial logs to the log management service;

[0126] Use the log management service to parse the initial logs, obtain multiple target fields corresponding to each initial log, and tag the initial logs based on the target fields to obtain service log data;

[0127] The processing module 204 is used for:

[0128] Use the log management service to process the service log data based on the data monitoring requirements corresponding to the target application.

[0129] Optionally, the data monitoring platform further includes:

[0130] A storage module, which is used to, after tagging the initial logs based on the target fields to obtain service log data, store the service log data separately based on each target field, and store the service log data corresponding to the same target field in the same storage space.

[0131] Optionally, the data monitoring platform further includes:

[0132] A query module, which is used to, after tagging the initial logs based on the target fields to obtain service log data, use the log management service to receive a log query request, and query the target service log data corresponding to the target tag in the service log data based on the target tag carried by the log query request;

[0133] A second display module, which is used to use the data display service to organize and display the data of the target service log in the target format.

[0134] Optionally, the acquisition module 202 is used for:

[0135] Use the third data acquisition service to record each behavior information corresponding to the target account in sequence according to the time line when logging in to the target account for the target application, and obtain the link tracing data corresponding to the target account;

[0136] The processing module 204 is used for:

[0137] Compare and analyze the behavior information of the same type in the link tracing data corresponding to the target account on the time line;

[0138] Alternatively, for the link tracing data corresponding to different accounts, compare and analyze the behavior information of the same type.

[0139] Optionally, the data monitoring platform further includes:

[0140] A first sending module, configured to, after obtaining the link tracing data corresponding to the target account, use the data display service to send a link query request for the target account to the third data acquisition service;

[0141] A second sending module, configured to use the third data acquisition service to send the link tracing data corresponding to the target account to the data display service based on the link query request;

[0142] A third display module, configured to use the data display service to display the received link tracing data.

[0143] Optionally, the data monitoring platform further includes:

[0144] A code submission module, configured to, before obtaining the service data of the target application using the data acquisition service for the target application accessing the data monitoring platform, submit the configuration code corresponding to the facility configuration condition to the facility configuration service when the corresponding facility configuration condition for the target application accessing the data monitoring platform is satisfied; wherein, the facility configuration condition is the condition satisfied by the service data;

[0145] A configuration module, configured to use the infrastructure configuration service to execute the configuration code to configure the facilities required for the target application to run.

[0146] Optionally, the data monitoring platform further includes:

[0147] A first receiving module, configured to receive the target performance data of various running metrics during the running of the target application sent by the internal test terminal, wherein the target performance data is filtered from the performance data at each moment based on the corresponding running metrics;

[0148] A fourth display module, configured to use the data display service to display the target performance data.

[0149] Optionally, the data monitoring platform further includes:

[0150] A determination module, configured to, when determining that the data volume of the target performance data sent by the internal test terminals of the target type is greater than the target threshold based on the terminal types corresponding to the received target performance data, send a stop transmission instruction to the internal test terminals of the target type.

[0151] Optionally, the data monitoring platform further includes:

[0152] A second receiving module, configured to receive the operation problem data of the target application sent by the target terminal;

[0153] A fifth display module, configured to process the received operation problem data based on the problem monitoring requirements corresponding to the target application, and display the processed operation problem data;

[0154] A third sending module, configured to send problem handling notification information to the information notification terminal based on the operation problem data.

[0155] In summary, in the data monitoring platform provided by the embodiment of the present application, for the target application, different services perform data processing on service data based on data monitoring requirements in terms of service metrics, service logs, and link tracing, and perform corresponding display of processing results and alarms. In this way, all-round data monitoring of the application program can be realized, and the monitoring effect of the application program can be ensured to be good; the display and alarm can facilitate the staff to timely determine the problems of the application program, and correspondingly can ensure the timely solution of the problems and ensure that the use effect of the application program can be good.

[0156] Figure 3 It is a structural block diagram of a computing device provided by an embodiment of the present application. The components of the computing device 300 include, but are not limited to, a memory 310 and a processor 320. The processor 320 is connected to the memory 310 through a bus 330, and a database 350 is used to store data.

[0157] The computing device 300 further includes an access device 340, which enables the computing device 300 to communicate via one or more networks 360. Examples of such networks include the Public Switched Telephone Network (PSTN), Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), or a combination of communication networks such as the Internet. The access device 340 may include one or more of any type of wired or wireless network interfaces (e.g., network interface controller (NIC)), such as an IEEE 802.11 Wireless Local Area Network (WLAN) wireless interface, Worldwide Interoperability for Microwave Access (Wi-MAX) interface, Ethernet interface, Universal Serial Bus (USB) interface, cellular network interface, Bluetooth interface, Near Field Communication (NFC).

[0158] In one embodiment of the present application, the above components of the computing device 300, as well as Figure 3 other components not shown, may also be connected to each other, for example, via a bus. It should be understood that Figure 3 the block diagram of the computing device shown is for illustrative purposes only and is not a limitation on the scope of the present application. Those skilled in the art can add or replace other components as needed.

[0159] The computing device 300 can be any type of stationary or mobile computing device, including mobile computers or mobile computing devices (e.g., tablet computers, personal digital assistants, laptop computers, notebook computers, netbooks, etc.), mobile phones (e.g., smartphones), wearable computing devices (e.g., smartwatches, smart glasses, etc.) or other types of mobile devices, or stationary computing devices such as desktop computers or personal computers (PCs). The computing device 300 can also be a mobile or stationary server.

[0160] Among them, the processor 320 is used to execute computer programs / instructions, and when the computer programs / instructions are executed by the processor, the above Figure 1 shown method is implemented.

[0161] For embodiments of the computing device, since it is basically similar to the embodiments of the data monitoring method, the description is relatively simple. For related parts, please refer to the partial description of the embodiments of the data monitoring method.

[0162] An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed by a processor, the steps of the above data monitoring method are implemented. The computer instructions include computer program code, and the computer program code can be in the form of source code, object code, executable file or some intermediate form, etc. The computer-readable storage medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disc, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electrical carrier signal, telecommunication signal, and software distribution medium, etc. It should be noted that the content included in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable storage medium does not include electrical carrier signals and telecommunication signals.

[0163] An embodiment of the present application further provides a computer program product, including computer program / instructions. When the computer program / instructions are executed in a processor, the steps of the above data monitoring method are implemented.

[0164] For embodiments of the computer-readable storage medium and embodiments of the computer program product, since they are basically similar to the embodiments of the data monitoring method, the description is relatively simple. For related parts, please refer to the partial description of the embodiments of the data monitoring method.

[0165] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be executed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require the specific order or sequential order shown to achieve the desired result. In certain embodiments, multi-data monitoring and parallel processing are also possible or may be advantageous.

[0166] It should be noted that the above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require the particular order or sequential order shown to achieve the desired result. In certain embodiments, multi-data monitoring and parallel processing are also possible or may be advantageous. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential for the embodiments of the present application.

[0167] In the above embodiments, the descriptions of the respective embodiments have their own emphases. For parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0168] The preferred embodiments of the present application disclosed above are only used to help explain the present application. The alternative embodiments do not elaborate on all the details and do not limit the invention to the specific embodiments described. Obviously, many modifications and variations can be made according to the content of the embodiments of the present application. The present application selects and specifically describes these embodiments to better explain the principles and practical applications of the embodiments of the present application, so that those skilled in the art can well understand and utilize the present application.

Claims

1. A data monitoring method, characterized in that, Applied to a data monitoring platform, the method includes: For a target application program accessing the data monitoring platform, use a data acquisition service to obtain service data of the target application program; wherein, the service data includes data of service metrics, data of service logs, and link tracing data; Based on the data monitoring requirements corresponding to the target application program, process the service data; Use a data display service to display the processing result of the service data in the form of a chart; When it is determined based on the processing result that the service data meets the target alarm condition, use an alarm management service to send an alarm message in the information notification manner corresponding to the target alarm condition.

2. The method according to claim 1, characterized in that, Before using the data acquisition service to obtain the service data of the target application program, it further includes: Use a registration service to register the target service of the target application program and obtain the registration information of the target service, wherein the registration information at least includes information of the data acquisition port of the target service; The using the data acquisition service to obtain the service data of the target application program includes: Use a first data acquisition service to send a service determination request for the target application program to the registration service and receive the registration information of the target service sent by the registration service; Use the first data acquisition service to obtain data of service metrics from the data acquisition port of the target service based on the information of the data acquisition port in the registration information.

3. The method according to claim 1, wherein The using the data acquisition service to obtain the service data of the target application program includes: Use a second data acquisition service to obtain initial logs from the log storage space corresponding to the target application program and send the initial logs to a log management service; Use the log management service to parse the initial logs to obtain multiple target fields corresponding to each initial log, and obtain data of service logs based on the initial logs and the information of the multiple target fields; The processing the service data based on the data monitoring requirements corresponding to the target application program includes: Use the log management service to process the data of service logs based on the data monitoring requirements corresponding to the target application program.

4. The method according to claim 3, characterized in that, After obtaining the data of service logs based on the initial logs and the information of the multiple target fields, it further includes: Based on each target field, store the data of service logs separately and label the stored data of service logs; Use the log management service to receive a log query request, and query the data of the target service logs corresponding to the target label in the data of each service log based on the target label carried in the log query request; Use the data display service to organize and display the data of the target service logs in a target format.

5. The method according to claim 1, characterized in that, The using the data acquisition service to obtain the service data of the target application program includes: Using the third data acquisition service, when logging in to the target account for the target application, record each behavior information corresponding to the target account in sequence according to the time line to obtain the link tracking data corresponding to the target account; The processing of the service data includes: For the link tracking data corresponding to the target account, compare and analyze the behavior information of the same type on the time line; Alternatively, for the link tracking data corresponding to different accounts, compare and analyze the behavior information of the same type.

6. The method according to claim 5, wherein After obtaining the link tracking data corresponding to the target account, it further includes: Using the data display service, send a link query request for the target account to the third data acquisition service; Using the third data acquisition service, based on the link query request, send the link tracking data corresponding to the target account to the data display service; Using the data display service, display the received link tracking data.

7. According to the method as claimed in any one of claims 1 to 6, characterized in that Before using the data acquisition service to obtain the service data of the target application for the target application accessing the data monitoring platform, it further includes: For the target application accessing the data monitoring platform, when the corresponding facility configuration condition is satisfied, submit the configuration code corresponding to the facility configuration condition to the facility configuration service; wherein, the facility configuration condition is the condition satisfied by the service data; Use the infrastructure configuration service to execute the configuration code to configure the facilities required for the operation of the target application.

8. The method according to any one of claims 1 to 6, characterized in that, It further includes: Receive the target performance data of various operation metrics during the operation of the target application sent by the internal test terminal, wherein the target performance data is obtained by screening from the performance data at each moment based on the corresponding operation metrics; Use the data display service to display the target performance data.

9. The method according to claim 8, wherein It further includes: Based on the terminal type corresponding to each received target performance data, when it is determined that the data volume of the target performance data sent by the internal test terminal of the target type is greater than the target threshold, send a stop transmission instruction to the internal test terminal of the target type.

10. The method according to any one of claims 1 to 6, characterized in that, It further includes: Receive the operation problem data of the target application sent by the target terminal; Based on the problem monitoring requirements corresponding to the target application, process the received operation problem data and display the processed operation problem data; Based on the operation problem data, send a problem handling notification message to the information notification terminal.

11. A data monitoring platform, characterized in that, It includes: An acquisition module, configured to use the data acquisition service to obtain the service data of the target application for the target application accessing the data monitoring platform; wherein, the service data includes service metric data, service log data, and link tracking data; A processing module, configured to process the service data based on the data monitoring requirements corresponding to the target application; A first display module, configured to use the data display service to display the processing result of the service data in the form of a chart; An alarm module, configured to, when it is determined based on the processing result that the service data meets the target alarm condition, use an alarm management service to send an alarm message in an information notification manner corresponding to the target alarm condition.

12. A computing device, characterized in that, Comprising: a memory and a processor; The memory is used to store computer programs / instructions, and the processor is used to execute the computer programs / instructions. When the computer programs / instructions are executed by the processor, the method according to any one of claims 1 to 10 is implemented.

13. A computer-readable storage medium, characterized in that, Stores computer programs / instructions, and when the computer programs / instructions are executed by the processor, the method according to any one of claims 1 to 10 is implemented.

14. A computer program product, characterized in that, Includes computer programs / instructions, and when the computer programs / instructions are executed by the processor, the method according to any one of claims 1 to 10 is implemented.

Citation Information

Cited By

  • Distributed tracking data acquisition method and device based on log analysis and computer readable medium

    CN121125465A