Plug-in configuration log forwarding method, device, electronic device and storage medium

Abstract

The present invention provides a plug-in configuration log forwarding method, device, electronic device and storage medium, wherein the method includes: determining a plug-in configuration file based on the forwarding requirements of the log file to be forwarded, the forwarding requirements are determined based on the type of the log file to be forwarded and the type of the target platform, the plug-in configuration file is used to process the log file to be forwarded to match the data requirements of the target platform; based on the plug-in configuration file, processing the log to be forwarded; and outputting the processed log to be forwarded to the target platform. The method of the present invention achieves the purpose of reliably and effectively forwarding various logs to be forwarded to different platforms through the plug-in configuration file, and when the forwarding requirements of the log file to be forwarded are different, there is no need to redevelop the internal business logic of the system, and the purpose of flexibly responding to the forwarding requirements of various types of log files to be forwarded is achieved, which not only reduces the development cost, but also greatly improves the forwarding efficiency of log files.

Description

Technical Field

[0001] The present invention relates to the technical field of log processing, and in particular to a plug-in configuration type log forwarding method, device, electronic device and storage medium. Background Art

[0002] Terminal devices generate a variety of log files during the operation of the operating system or other application software, and the generated log files need to be forwarded to other platforms for subsequent applications. Therefore, how to efficiently forward logs has become a research hotspot.

[0003] In the related art, conventional log forwarding systems are usually designed to forward log files in targeted input and output formats. However, when the input and output formats of log files change, the internal business logic of the log forwarding system needs to be redeveloped; when the same type of log files need to be forwarded to different third-party platforms, different encoding methods need to be designed to adapt to each third-party platform, resulting in low log file forwarding efficiency and high forwarding cost. Summary of the invention

[0004] The present invention provides a plug-in configuration type log forwarding method, device, electronic device and storage medium, which are used to solve the defects of low log file forwarding efficiency and high forwarding cost caused by the log forwarding system designed in the prior art to forward logs in targeted input format and output format, and realize flexible processing of various log files into valid logs supporting multiple platforms for output based on the plug-in configuration file.

[0005] The present invention provides a plug-in configuration type log forwarding method, comprising:

[0006] Determine a plug-in configuration file based on the forwarding requirements of the log file to be forwarded; wherein the forwarding requirements are determined based on the type of the log file to be forwarded and the type of the target platform, and the plug-in configuration file is used to process the log file to be forwarded to match the data requirements of the target platform;

[0007] Based on the plug-in configuration file, processing the log to be forwarded;

[0008] The processed log to be forwarded is output to the target platform.

[0009] According to a plug-in configuration log forwarding method provided by the present invention, the plug-in configuration file includes decoded plug-in configuration information, and the processing of the log to be forwarded based on the plug-in configuration file includes:

[0010] Based on the decoding plug-in configuration information, obtaining a decoding plug-in that matches the type of the log file to be forwarded;

[0011] The decoding plug-in is used to decode the log to be forwarded to obtain target decoding information of the log to be forwarded.

[0012] According to a plug-in configuration log forwarding method provided by the present invention, the plug-in configuration file includes filtering plug-in configuration information, and the method further includes:

[0013] Based on the filter plug-in configuration information, obtaining a filter plug-in matching the target decoding information;

[0014] The target decoding information is filtered using the filtering plug-in to obtain target valid information in the log to be forwarded.

[0015] According to a plug-in configuration type log forwarding method provided by the present invention, the plug-in configuration file includes encoded plug-in configuration information, and the method further includes:

[0016] Based on the encoding plug-in configuration information, acquiring an encoding plug-in matching the target valid information;

[0017] The encoding plug-in is used to encode the target valid information to obtain a target valid log.

[0018] According to a plug-in configuration log forwarding method provided by the present invention, the plug-in configuration file includes output plug-in configuration information, and the processing of the to-be-forwarded log to the target platform includes:

[0019] Based on the output plug-in configuration information, obtaining a target platform that matches the target valid log;

[0020] The target valid log is output to the target platform.

[0021] According to a plug-in configuration log forwarding method provided by the present invention, the outputting the target valid log to the target platform includes:

[0022] Determining a target idle time range of the target platform based on the platform idle time matching information;

[0023] When it is determined that the current time is within the target idle time range, the target valid log is output to the target platform.

[0024] The present invention also provides a plug-in configuration type log forwarding device, comprising:

[0025] A determination module, configured to determine a plug-in configuration file based on a forwarding requirement of a log file to be forwarded; wherein the forwarding requirement is determined based on the type of the log file to be forwarded and the type of a target platform, and the plug-in configuration file is configured to process the log file to be forwarded to match the data requirement of the target platform;

[0026] A processing module, used for processing the log to be forwarded based on the plug-in configuration file;

[0027] The output module is used to output the processed log to be forwarded to the target platform.

[0028] The present invention also provides an electronic device, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of any of the above-mentioned plug-in configuration log forwarding methods are implemented.

[0029] The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned plug-in configuration log forwarding methods are implemented.

[0030] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the steps of any one of the above-mentioned plug-in configuration type log forwarding methods are implemented.

[0031] The plug-in configuration log forwarding method, device, electronic device and storage medium provided by the present invention, wherein the plug-in configuration log forwarding method determines the plug-in configuration file based on the forwarding requirements of the log file to be forwarded. Since the forwarding requirements are determined based on the type of the log file to be forwarded and the type of the target platform, the plug-in configuration file is used to process the log file to be forwarded to match the data requirements of the target platform, so the determined plug-in configuration file is used to process the log file to be forwarded, which can achieve targeted and flexible effective processing of the log file to be forwarded, and further output the processed log to be forwarded to the target platform; in this way, the purpose of reliably and effectively forwarding various logs to be forwarded to different platforms is achieved through the plug-in configuration file, and when the forwarding requirements of the log file to be forwarded are different, there is no need to redevelop the internal business logic of the system, and only the plug-in type in the plug-in configuration file needs to be adjusted or modified to perform fast and concise function expansion, so as to achieve the purpose of flexibly responding to the forwarding requirements of various types of log files to be forwarded, which not only reduces the development cost, but also greatly improves the forwarding efficiency of the log file. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0033] Figure 1 It is a flow chart of the plug-in configuration log forwarding method provided by the present invention;

[0034] Figure 2 It is a structural schematic diagram of the plug-in configuration type log forwarding device provided by the present invention;

[0035] Figure 3 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0036] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0037] Combine the following Figure 1-Figure 3 The plug-in configuration log forwarding method, device, electronic device and storage medium of the present invention are described, wherein the plug-in configuration log forwarding method is applied to a plug-in configuration log forwarding system, and the plug-in configuration log forwarding system can establish multiple plug-ins for processing log files to be forwarded based on the plugin customization plug-in function, and the plugin customization plug-in function can provide a series of different customized function plug-ins for the plug-in configuration log forwarding system.

[0038] Figure 1 : is a flow chart of the plug-in configuration log forwarding method provided by the present invention, such as Figure 1 As shown, the plug-in configuration log forwarding method includes the following steps:

[0039] Step 110: Determine a plug-in configuration file based on the forwarding requirement of the log file to be forwarded.

[0040] Specifically, the plug-in configuration log forwarding system has multiple plug-ins for processing different log files to be forwarded. In order to ensure the forwarding effectiveness and flexibility of log files, the plug-in configuration file can be pre-determined based on the forwarding requirements of the log files to be forwarded; or the plug-in configuration file corresponding to the forwarding requirements of the log files to be forwarded carried by the log forwarding instructions can be determined based on the received log forwarding instructions. No specific limit is given here.

[0041] It should be noted that, for the plug-in configuration file, the type of the target platform receiving the log file to be forwarded can be determined based on the type of the log file to be forwarded. For example, when the type of the log file to be forwarded is of http type, the type of the target platform can be determined to be of Redis type. Then, based on the type of the target platform, the data requirements of the target platform are obtained; for example, for a target platform of Redis type, its data requirements may include valid data after performing operations such as error correction, incomplete data supplementation, and effective data discarding on the received http type log file to be forwarded. Therefore, in order to improve processing efficiency, the plug-in configuration file can be determined based on the data requirements of the target platform. The plug-in configuration file may include decoding plug-in configuration information, filtering plug-in configuration information, encoding plug-in configuration information, and output plug-in configuration information, so as to quickly and reliably process the log file to be forwarded into the data required by the target platform.

[0042] Step 120: Process the log to be forwarded based on the plug-in configuration file.

[0043] Specifically, since the plug-in configuration file is determined based on the forwarding requirements of the log files to be forwarded, the logs to be forwarded can be processed based on the plug-in configuration file. Plug-ins with different functions in the plug-in configuration file can be used to process the logs to be forwarded, so as to achieve the purpose of processing the logs to be forwarded to match the data requirements of the target platform.

[0044] Step 130: Output the processed log to be forwarded to the target platform.

[0045] The target platform may include at least one of a high-throughput distributed publish-subscribe messaging system kafka, a KV database, an http output platform, a syslog server, and a beanstlkd distributed memory queue system.

[0046] Specifically, the plug-in log forwarding system performs an output operation on the processed log file to be forwarded, which may be a log file to be forwarded processed by various plug-in configuration information in the plug-in configuration file. At this time, based on the forwarding requirements of the log file to be forwarded, the target platform to which the processed log file to be forwarded needs to be forwarded can be determined and then output, thereby ensuring the effectiveness and reliability of the output.

[0047] The plug-in configuration log forwarding method provided by the present invention determines the plug-in configuration file based on the forwarding requirements of the log file to be forwarded. Since the forwarding requirements are determined based on the type of the log file to be forwarded and the type of the target platform, the plug-in configuration file is used to process the log file to be forwarded to match the data requirements of the target platform. Therefore, the determined plug-in configuration file is used to process the log file to be forwarded, which can achieve targeted and flexible effective processing of the log file to be forwarded, and further output the processed log to be forwarded to the target platform; in this way, the purpose of reliably and effectively forwarding various logs to be forwarded to different platforms is achieved through the plug-in configuration file, and when the forwarding requirements of the log file to be forwarded are different, there is no need to redevelop the internal business logic of the system, and only the plug-in type in the plug-in configuration file needs to be adjusted or modified to perform fast and concise function expansion, so as to achieve the purpose of flexibly responding to the forwarding requirements of various types of log files to be forwarded, which not only reduces the development cost, but also greatly improves the forwarding efficiency of the log file.

[0048] Optionally, the plug-in configuration file includes decoded plug-in configuration information, and the implementation process of step 120 includes:

[0049] Based on the decoding plug-in configuration information, a decoding plug-in matching the type of the log file to be forwarded is obtained; and the decoding plug-in is used to decode the log to be forwarded to obtain target decoding information of the log to be forwarded.

[0050] The decoding plug-in configuration information may indicate a mapping relationship between the log type and the decoding plug-in in the standard format.

[0051] Specifically, when the plug-in configured log forwarding system receives different log files to be forwarded, it can match the corresponding decoding plug-in according to the type of each log file to be forwarded based on the decoding plug-in configuration information. That is, two or more log files to be forwarded of the same type can be matched to a decoding plug-in of the same standard format, or two or more log files to be forwarded of different types can be matched to another decoding plug-in of the same standard format. For example, two log files to be forwarded in http format can be matched to a decoding plug-in in json format, and log files to be forwarded in http format and log files to be forwarded in file format can be matched to a decoding plug-in in LineSpliter format. First, different log files to be forwarded are matched to decoding plug-ins of different standard formats based on the decoding plug-in matching information, so as to obtain multiple target decoding information corresponding to different types of log files to be forwarded.

[0052] It should be noted that when the plug-in log forwarding system receives the log files to be forwarded, it first converts the different log files to be forwarded into standard internal representations based on the decoding plug-in configuration information, that is, the metadata of the different log files to be forwarded are correspondingly decoded into a form that can be effectively processed, thereby obtaining the target decoding information of each log file to be forwarded. Among them, each standard format data can be in the form of unstructured data.

[0053] In addition, the plug-in configuration log forwarding system can use the protocol to connect to the terminal network, and determine the log files to be sent to different platforms by reading and parsing the various log files generated by the terminal management system. Different platforms can include high-throughput distributed publish-subscribe messaging system kafka, KV database, http output platform, syslog server, beanstlkd distributed memory queue system. KV database is a stable, reliable, and elastically scalable online database. The plug-in configuration log forwarding system can use protocols including syslog protocol, statsd protocol, and http protocol.

[0054] The plug-in configuration log forwarding method provided by the present invention obtains a decoding plug-in matching the type of the log file to be forwarded based on the decoding plug-in configuration information, and further uses the decoding plug-in to decode the log to be forwarded to obtain the target decoding information of the log to be forwarded. In this way, the purpose of processing the log file to be forwarded into the target decoding information is achieved through the decoding plug-in configuration information, and there is no need to redevelop the internal business logic of the system when the type of the log file to be forwarded changes, which reduces the development cost and also provides a guarantee for improving the forwarding efficiency in the future.

[0055] Optionally, the plug-in configuration file includes filtering plug-in matching information, and the implementation process of step 120 may also include:

[0056] Based on the filter plug-in configuration information, a filter plug-in matching the target decoding information is obtained; and the target decoding information is filtered using the filter plug-in to obtain target valid information in the log to be forwarded.

[0057] The filter plug-in configuration information may indicate a mapping relationship between the decoding information in a standard format and the filter plug-ins with different functions.

[0058] Specifically, the plug-in configured log forwarding system can further match the target decoding information of each standard format to the filtering plug-in of the corresponding function for filtering processing based on the processing plug-in configuration information, that is, the target decoding information of different standard formats is processed using the filtering plug-in that matches it, so as to process the target decoding information of each standard format into the form of structured data. For example, the target decoding information of each standard format is processed into a data structure that may be more friendly to digital statistical data, so as to obtain the target valid information in the log file to be forwarded.

[0059] Exemplarily, in order to improve the processing efficiency of target decoding information in each standard format, the plug-in configuration log forwarding system can first parse the content to be processed in each target decoding information in each standard format for the target decoding information obtained. According to the different contents to be processed in each target decoding information in the standard format, the filter plug-ins can be classified and matched. For example, when the target decoding information in json format is matched to 2 or 3 Skylar filters (Filters) and the 3 Skylar Filters are Skylar Filter1, Skylar Filter2 and Skylar Filter3, Skylar Filter1 can be set to match the target decoding information in json format that needs to correct errors, modify logic and supplement incomplete or empty values, Skylar Filter2 can be set to match the target decoding information in json format that needs to delete duplicates, discard data or variables, and Skylar Filter3 can be set to match the target decoding information in json format that needs unified specifications, conversion structure and data compression, so that the target decoding information in each standard format can be quickly processed into the target valid information in the log to be forwarded.

[0060] It should be noted that parsing the content that needs to be processed in the target decoding information of each standard format and correcting errors, deleting duplicates, unifying specifications, correcting logic, converting structures, compressing data, supplementing missing / empty values, and discarding data / variables for different content that needs to be processed are all common knowledge to those skilled in the art, so they will not be repeated here.

[0061] The plug-in configuration log forwarding method provided by the present invention obtains a filter plug-in matching the target decoding information of the log file to be forwarded by filtering the plug-in configuration information, and further uses the filter plug-in to filter the target decoding information to obtain the target valid information in the log to be forwarded. In this way, the target decoding information of the log file to be forwarded is processed into the target valid information by filtering the plug-in configuration information, and the integrity, uniqueness, authority, legality and consistency of the target valid information are ensured, thereby solving the data quality problem and making the data more potential for mining and display.

[0062] Optionally, the plug-in configuration file includes encoding plug-in configuration information, and the implementation process of step 120 may further include:

[0063] Based on the encoding plug-in configuration information, an encoding plug-in matching the target valid information is obtained; and the target valid information is encoded using the encoding plug-in to obtain a target valid log.

[0064] The encoding plug-in configuration information may indicate a mapping relationship between the format of the valid information and the file type of the encoding plug-in, and the encoding plug-in configuration information may correspond to the aforementioned decoding plug-in configuration information.

[0065] Specifically, the plug-in configuration log forwarding system can further match each target valid information obtained to a corresponding encoding plug-in for encoding processing based on the encoding plug-in configuration information, thereby obtaining a target valid log.

[0066] Exemplarily, the plug-in configuration log forwarding system can further match each target valid information to the corresponding encoding plug-in for encoding processing based on the encoding plug-in configuration information for multiple different target valid information obtained, thereby obtaining target valid logs in different file formats. For example, target valid information 1 in json format obtained after correcting errors, modifying logic, and supplementing incomplete or empty values ​​through Skylar Filter1, target valid information 2 in json format obtained after deleting duplicates, discarding data or variables through Skylar Filter2, and target valid information 3 in json format obtained after unifying specifications, converting structures or compressing data through SkylarFilter3 are matched to the encoding plug-in in json format for encoding processing, thereby obtaining target valid logs in json format.

[0067] The plug-in configuration log forwarding method provided by the present invention obtains a coding plug-in matching the target valid information by encoding the plug-in configuration information, and further uses the coding plug-in to encode the target valid information to obtain a target valid log. In this way, the purpose of encoding each target valid information of the log file to be forwarded before output and encoding it into a file format supported by multiple platforms is achieved by encoding the plug-in configuration information, thereby improving the reliability and accuracy of processing each target valid information into a file format suitable for different platform requirements.

[0068] Optionally, the plug-in configuration file includes output plug-in configuration information, and the implementation process of step 130 may further include:

[0069] Based on the output plug-in configuration information, a target platform matching the target valid log is acquired; and the target valid log is output to the target platform.

[0070] The output plug-in configuration information may represent a mapping relationship between the log file format and the platform type.

[0071] Specifically, the plug-in configured log forwarding system can further obtain the target platform corresponding to each target valid log based on the output plug-in configuration information for the obtained target valid log, and then further output the target valid log accordingly, so that the data in the target valid log can be written into a database, a time series database or a network server for in-depth processing.

[0072] Exemplarily, the plug-in configuration log forwarding system can first determine the log file format required by each target platform based on the output plug-in configuration information for the target valid logs in different file formats, and then further match the corresponding target platform based on the file format of each target valid log. The target valid logs with the same file format can be matched to more than two different target platforms. For example, the target valid logs in json format can be matched to two Redis databases and one http output platform, so that each target valid log can be output to the corresponding target platform for subsequent in-depth processing.

[0073] The plug-in configuration log forwarding method provided by the present invention matches multiple different target valid logs to the corresponding target platform by outputting plug-in configuration information, so that each target valid log can be flexibly and diversely matched to different target platforms, thereby effectively improving the forwarding efficiency of log forwarding.

[0074] Optionally, the plug-in configuration file includes platform idle time matching information, and the outputting the target valid log to the target platform includes:

[0075] Based on the platform idle time matching information, a target idle time range of the target platform is determined; when it is determined that the current time is within the target idle time range, the target valid log is output to the target platform.

[0076] Specifically, in order to avoid a large number of target valid logs being output to the same target platform within a certain period of time, causing great pressure on the target platform, the platform idle time matching information can be set in the plug-in configuration file, and the platform idle time matching information can include each platform and its corresponding idle time range. Therefore, when the plug-in configuration log forwarding system obtains multiple target valid logs, it can first log cache all target valid logs, such as caching them to a log cache server; then, based on the platform idle time configuration information, determine the target idle time range corresponding to each target platform, and then further determine whether the current moment is within the target idle time range of the target platform. If the current moment is within the target idle time range of a target platform, all target valid logs matching the target platform are output to the target platform; on the contrary, if the current moment is not within the target idle time range of the target platform, the corresponding target valid log is not output and the log cache is continued until the target idle time range of the target platform is reached. The output operation is performed. In this way, the purpose of each target platform receiving the corresponding target valid log within its respective target idle time range is achieved.

[0077] The plug-in configuration log forwarding method provided by the present invention realizes that the target platforms matching each target effective log can receive the corresponding target effective log within their respective target idle time ranges by setting the platform idle time matching information in the plug-in configuration file, thereby avoiding the disadvantage that the excessive load of each target platform affects the normal operation of other businesses, and greatly improving the flexibility and reliability of each target platform in receiving the target effective log.

[0078] The plug-in configuration type log forwarding device provided by the present invention is described below. The plug-in configuration type log forwarding device described below and the plug-in configuration type log forwarding method described above can be referred to each other.

[0079] Figure 2 An example of a plug-in configuration log forwarding device is shown below. Figure 2 As shown, the plug-in configuration type log forwarding device 200 includes:

[0080] The determination module 210 is used to determine the plug-in configuration file based on the forwarding requirement of the log file to be forwarded; wherein the forwarding requirement is determined based on the type of the log file to be forwarded and the type of the target platform, and the plug-in configuration file is used to process the log file to be forwarded to match the data requirement of the target platform;

[0081] A processing module 220, configured to process the log to be forwarded based on the plug-in configuration file;

[0082] The output module 230 is used to output the processed log to be forwarded to the target platform.

[0083] Optionally, the processing module 220 may be specifically configured to obtain a decoding plug-in that matches the type of the log file to be forwarded based on the decoding plug-in configuration information; and use the decoding plug-in to decode the log to be forwarded to obtain target decoding information of the log to be forwarded.

[0084] Optionally, the processing module 220 may be specifically configured to obtain a filtering plug-in matching the target decoding information based on the filtering plug-in configuration information; and use the filtering plug-in to filter the target decoding information to obtain the target valid information in the log to be forwarded.

[0085] Optionally, the processing module 220 may be specifically configured to obtain a coding plug-in that matches the target valid information based on the coding plug-in configuration information; and use the coding plug-in to encode the target valid information to obtain a target valid log.

[0086] Optionally, the output module 230 may be specifically configured to obtain a target platform that matches the target valid log based on output plug-in configuration information; and output the target valid log to the target platform.

[0087] Optionally, the output module 230 may be specifically configured to determine a target idle time range of the target platform based on platform idle time matching information; and when it is determined that the current time is within the target idle time range, output the target valid log to the target platform.

[0088] Figure 3 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 3 As shown, the electronic device 300 may include: a processor 310, a communications interface 320, a memory 330 and a communication bus 340, wherein the processor 310, the communications interface 320 and the memory 330 communicate with each other through the communication bus 340. The processor 310 may call the logic instructions in the memory 330 to execute the plug-in configuration log forwarding method, which includes:

[0089] Determine a plug-in configuration file based on the forwarding requirements of the log file to be forwarded; wherein the forwarding requirements are determined based on the type of the log file to be forwarded and the type of the target platform, and the plug-in configuration file is used to process the log file to be forwarded to match the data requirements of the target platform;

[0090] Based on the plug-in configuration file, processing the log to be forwarded;

[0091] The processed log to be forwarded is output to the target platform.

[0092] In addition, the logic instructions in the above-mentioned memory 330 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0093] On the other hand, the present invention further provides a computer program product, the computer program product includes a computer program, the computer program can be stored on a non-transitory computer-readable storage medium, when the computer program is executed by a processor, the computer can execute the plug-in configuration log forwarding method provided by the above methods, the method includes:

[0094] Determine a plug-in configuration file based on the forwarding requirements of the log file to be forwarded; wherein the forwarding requirements are determined based on the type of the log file to be forwarded and the type of the target platform, and the plug-in configuration file is used to process the log file to be forwarded to match the data requirements of the target platform;

[0095] Based on the plug-in configuration file, processing the log to be forwarded;

[0096] The processed log to be forwarded is output to the target platform.

[0097] In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, which is implemented when the computer program is executed by a processor to execute the plug-in configuration log forwarding method provided by the above methods, the method comprising:

[0098] Determine a plug-in configuration file based on the forwarding requirements of the log file to be forwarded; wherein the forwarding requirements are determined based on the type of the log file to be forwarded and the type of the target platform, and the plug-in configuration file is used to process the log file to be forwarded to match the data requirements of the target platform;

[0099] Based on the plug-in configuration file, processing the log to be forwarded;

[0100] The processed log to be forwarded is output to the target platform.

[0101] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0102] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0103] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A plug-in configuration log forwarding method, characterized in that: include: Determine a plug-in configuration file based on the forwarding requirements of the log file to be forwarded; wherein the forwarding requirements are determined based on the type of the log file to be forwarded and the type of the target platform, and the plug-in configuration file is used to process the log file to be forwarded to match the data requirements of the target platform; Based on the plug-in configuration file, processing the log to be forwarded; Outputting the processed log to be forwarded to the target platform; The plug-in configuration file includes decoded plug-in configuration information, and the processing of the log to be forwarded based on the plug-in configuration file includes: Based on the decoding plug-in configuration information, obtaining a decoding plug-in that matches the type of the log file to be forwarded; The decoding plug-in is used to decode the log to be forwarded to obtain target decoding information of the log to be forwarded.

2. The plug-in configuration log forwarding method according to claim 1, characterized in that: The plug-in configuration file includes filtering plug-in configuration information, and the method further includes: Based on the filter plug-in configuration information, obtaining a filter plug-in matching the target decoding information; The target decoding information is filtered using the filtering plug-in to obtain target valid information in the log to be forwarded.

3. The plug-in configuration log forwarding method according to claim 2, characterized in that: The plug-in configuration file includes coded plug-in configuration information, and the method further includes: Based on the encoding plug-in configuration information, acquiring an encoding plug-in matching the target valid information; The encoding plug-in is used to encode the target valid information to obtain a target valid log.

4. The plug-in configuration log forwarding method according to claim 3, characterized in that: The plug-in configuration file includes output plug-in configuration information, and the processing of the to-be-forwarded log to the target platform includes: Based on the output plug-in configuration information, obtaining a target platform that matches the target valid log; The target valid log is output to the target platform.

5. The plug-in configuration log forwarding method according to claim 4, characterized in that: The plug-in configuration file includes platform idle time matching information, and the outputting the target valid log to the target platform includes: Determining a target idle time range of the target platform based on the platform idle time matching information; When it is determined that the current time is within the target idle time range, the target valid log is output to the target platform.

6. A plug-in configuration type log forwarding device, characterized in that: include: A determination module, configured to determine a plug-in configuration file based on a forwarding requirement of a log file to be forwarded; wherein the forwarding requirement is determined based on a type of the log file to be forwarded and a type of a target platform, and the plug-in configuration file is configured to process the log file to be forwarded to match a data requirement of the target platform; A processing module, used for processing the log to be forwarded based on the plug-in configuration file; An output module, used for outputting the processed log to be forwarded to the target platform; The plug-in configuration file includes decoding plug-in configuration information, and the processing module is specifically used to obtain a decoding plug-in that matches the type of the log file to be forwarded based on the decoding plug-in configuration information; use the decoding plug-in to decode the log to be forwarded to obtain target decoding information of the log to be forwarded.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the steps of the plug-in configuration log forwarding method as claimed in any one of claims 1 to 5 are implemented.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the plug-in configuration log forwarding method as claimed in any one of claims 1 to 5 are implemented.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the plug-in configuration log forwarding method as claimed in any one of claims 1 to 5 are implemented.

Images