Data processing method and device, electronic equipment and computer readable storage medium

Abstract

The embodiment of the invention provides a data processing method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of data processing. A data acquisition module is arranged in the electronic equipment, the data acquisition module is operated, and operation data of the web application is obtained through the data acquisition module; and according to the business type corresponding to the operation data, performing data processing on the operation data to obtain the processed operation data and analysis parameters corresponding to the operation data. According to the method, the operation data can be acquired through the data acquisition module in the electronic equipment, so that a data acquisition logic does not need to be embedded into a business code of the web application, and on the basis, the coupling degree between data acquisition and web application business processing can be reduced, so that the complexity and the maintenance cost of a web application system are reduced.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data processing method, device, electronic device and computer-readable storage medium. Background Art

[0002] At present, obtaining web application data for analysis is of great significance in improving website performance, enhancing user experience, ensuring data security, and supporting market decision-making.

[0003] In the prior art, the data collection logic of web application data is often directly embedded in the business code of the web application for use. Therefore, there is a problem of high coupling between data collection and web application business processing, which increases the complexity and maintenance cost of the web application system. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide a data processing method, device, electronic device and computer-readable storage medium to reduce the coupling between data collection and web application business processing, thereby reducing the complexity and maintenance cost of the web application system.

[0005] In order to achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:

[0006] In a first aspect, the present application provides a data processing method, which is applied to an electronic device, wherein a data acquisition module is provided in the electronic device, and the method comprises:

[0007] Running the data acquisition module, and acquiring the operation data of the web application through the data acquisition module;

[0008] According to the business type corresponding to the operation data, the operation data is processed to obtain the processed operation data and the analysis parameters corresponding to the operation data.

[0009] In an optional implementation, the data collection module includes a data collection script and a log collection module, and the operation data includes request response data and a log file;

[0010] The running of the data acquisition module to obtain the running data of the web application through the data acquisition module includes:

[0011] The data collection script and the log collection module are respectively run, the request response data is obtained through the data collection script, and the log file is obtained through the log collection module.

[0012] In an optional implementation manner, the electronic device further stores data queues corresponding to each service type, and corresponding relationships between each of the data queues and data processing logic;

[0013] The performing data processing on the operation data according to the business type corresponding to the operation data to obtain the processed operation data and the analysis parameters corresponding to the operation data includes:

[0014] According to the business type corresponding to the operation data, the operation data is stored in the corresponding target data queue;

[0015] The data processing logic corresponding to the target data queue is obtained, and the operation data in the target data queue is processed according to the data processing logic to obtain the processed operation data and the analysis parameters corresponding to the operation data.

[0016] In an optional implementation, the data processing logic includes a first processing logic and a second processing logic, and the analysis parameters include a public indicator and a business indicator;

[0017] The acquiring the data processing logic corresponding to the target data queue, and performing data processing on the operation data in the target data queue according to the data processing logic to obtain the processed operation data and analysis parameters corresponding to the operation data, includes:

[0018] Acquire a first processing logic and a second processing logic corresponding to the target data queue;

[0019] Performing format processing on the operation data in the target data queue according to the first processing logic to obtain the processed operation data and a common indicator corresponding to the operation data;

[0020] Business processing is performed on the operating data in the target data queue according to the second processing logic to obtain business indicators corresponding to the operating data.

[0021] In an optional implementation, the electronic device is further connected to a distributed database for communication, and the method further includes:

[0022] The operation data is analyzed according to the analysis parameters corresponding to the operation data, the analysis results corresponding to the operation data are output, and the processed operation data and the analysis parameters corresponding to the operation data are stored in a distributed database.

[0023] In an optional embodiment, the method further comprises:

[0024] Receiving a data processing request from a user; the data processing request includes a data identifier and a target processing logic;

[0025] The target operation data corresponding to the data identifier is acquired from the distributed database, and data processing is performed on the target operation data according to the target processing logic.

[0026] In a second aspect, the present application provides a data processing device, which is applied to an electronic device, wherein a data acquisition module is provided in the electronic device, and the device comprises:

[0027] An acquisition module, used to run the data acquisition module and acquire the operation data of the web application through the data acquisition module;

[0028] The processing module is used to process the operation data according to the business type corresponding to the operation data, and obtain the processed operation data and the analysis parameters corresponding to the operation data.

[0029] In an optional implementation, the data collection module includes a data collection script and a log collection module, and the operation data includes request response data and a log file;

[0030] The acquisition module is further used to run the data acquisition script and the log acquisition module respectively, obtain the request response data through the data acquisition script, and obtain the log file through the log acquisition module.

[0031] In a third aspect, the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores a computer program that can be executed by the processor, and the processor can execute the computer program to implement the method described in any one of the aforementioned embodiments.

[0032] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method described in any one of the aforementioned implementations.

[0033] The data processing method, device, electronic device and computer-readable storage medium provided by the embodiments of the present application are provided with a data acquisition module in the electronic device, and the electronic device can run the data acquisition module to obtain the operation data of the web application, and then perform data processing on the operation data according to the business type corresponding to the operation data, so as to obtain the processed operation data and the analysis parameters corresponding to the operation data. Since the method can collect the operation data through the data acquisition module in the electronic device, it is not necessary to embed the data acquisition logic in the business code of the web application, based on which, the coupling degree between data acquisition and web application business processing can be reduced, thereby reducing the complexity and maintenance cost of the web application system.

[0034] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0036] Figure 1 A block diagram of an electronic device provided by an embodiment of the present application is shown;

[0037] Figure 2 A schematic diagram of a process flow of a data processing method provided in an embodiment of the present application is shown;

[0038] Figure 3 Another schematic diagram of a data processing method according to an embodiment of the present invention is shown;

[0039] Figure 4 A functional module diagram of a data processing device provided in an embodiment of the present application is shown.

[0040] Icon: 100 - memory; 110 - processor; 120 - communication module; 200 - acquisition module; 210 - processing module. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0042] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0043] It should be noted that relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0044] Figure 1 For a block diagram of an electronic device provided in an embodiment of the present application, please refer to Figure 1 An electronic device includes a memory 100, a processor 110, and a communication module 120. The memory 100, the processor 110, and the communication module 120 are electrically connected to each other directly or indirectly to achieve data transmission or interaction. For example, these components can be electrically connected to each other through one or more communication buses or signal lines.

[0045] The memory 100 is used to store computer programs or data that can be executed by the processor. The memory 100 can be, but is not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable read-only memory (EEPROM), etc.

[0046] The processor 110 is used to read / write data or computer programs stored in the memory, and execute the computer program to implement the data processing method provided in the embodiment of the present application.

[0047] The communication module 120 is used to establish a communication connection between the electronic device and other communication terminals through a network, and to send and receive data through the network.

[0048] Optionally, a data collection module may be provided in the electronic device to collect operation data of the web application.

[0049] It should be understood that Figure 1 The structure shown is only a schematic diagram of the structure of the electronic device. The electronic device may also include Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown. Figure 1 Each component shown in the figure can be implemented by hardware, software or a combination thereof.

[0050] Next, the above Figure 1 The electronic device in the embodiment is the execution subject, and the data processing method provided in the embodiment of the present application is exemplarily introduced in combination with the flow chart.

[0051] Specifically, Figure 2 A flow chart of a data processing method provided in the embodiment of the present application is shown in Figure 2 , the method comprising:

[0052] Step S20, running the data collection module, and obtaining the running data of the web application through the data collection module.

[0053] Optionally, during the operation of the web application, the data acquisition module may be operated in real time to obtain the operation data of the web application in real time.

[0054] Optionally, the operation data may include various information generated during the interaction between the user and the web application, such as performance data, user behavior data, etc.

[0055] Step S21 : performing data processing on the operation data according to the business type corresponding to the operation data, and obtaining the processed operation data and analysis parameters corresponding to the operation data.

[0056] Optionally, the operating data may include data corresponding to multiple business types, such as operating data corresponding to performance, operating data corresponding to safety, etc. The electronic device can then perform targeted processing on the operating data according to the business types corresponding to different operating data, thereby obtaining processed operating data and analysis parameters corresponding to the operating data.

[0057] Optionally, the analysis parameter refers to a parameter that can be used to perform relevant analysis on the operation data.

[0058] In the data processing method provided by the embodiment of the present application, a data acquisition module is provided in the electronic device, and the electronic device can run the data acquisition module to obtain the operation data of the web application, and then process the operation data according to the business type corresponding to the operation data, so as to obtain the processed operation data and the analysis parameters corresponding to the operation data. Since the method can collect data through the data acquisition module in the electronic device, it is not necessary to embed the data acquisition logic in the business code of the web application, based on which, the coupling degree between data acquisition and web application business processing can be reduced, thereby reducing the complexity and maintenance cost of the web application system.

[0059] In a possible implementation, the data collection module may include a data collection script and a log collection module, and the operation data may include request response data and a log file.

[0060] In this embodiment, the electronic device can run a data collection script and a log collection module respectively, obtain request response data through the data collection script, and obtain a log file through the log collection module.

[0061] In one example, Nginx can be used as a front-end server to provide front-end services and proxy back-end services.

[0062] In this example, the data collection script can be Lua, Perl, etc. Taking Lua as an example, the function of Nginx can be extended through OpenResty to realize Nginx's support for Lua. When the web application runs, the Lua script can run automatically to obtain HTTP request response data.

[0063] In this example, the log collection module may be Flume, which may monitor backend logs to collect log files of web applications.

[0064] In this embodiment, since the response data can be collected through the data collection script and the log file can be collected through the log collection module, the business requirements can be adjusted flexibly and quickly by adjusting the data collection script and the log collection module.

[0065] Optionally, the electronic device may also store data queues corresponding to various service types, and corresponding relationships between various data queues and data processing logic.

[0066] It is understandable that the data processing logics corresponding to different services may be different, so the electronic device can put the operating data corresponding to different services into different data queues, and then determine the corresponding data processing logic according to the data queues.

[0067] Specifically, in Figure 2 On the basis of Figure 3 For another flow chart of the data processing method provided in the embodiment of the present application, please refer to Figure 3 , the above step S21 can also be implemented by the following steps:

[0068] Step S21 - 1 , storing the operating data in a corresponding target data queue according to the business type corresponding to the operating data.

[0069] Step S21 - 2 , obtaining the data processing logic corresponding to the target data queue, and performing data processing on the operating data in the target data queue according to the data processing logic to obtain the processed operating data and analysis parameters corresponding to the operating data.

[0070] In this embodiment, considering that the prior art often uses a centralized architecture when processing web application running data, there is often a performance bottleneck problem when processing large-scale data streams, and the data processing efficiency through this method is also low.

[0071] Based on this, in this embodiment, the electronic device can adopt a distributed architecture and perform parallel data processing on the running data in the target data queue through a distributed computing engine, thereby improving the performance and data processing efficiency of processing large-scale data streams, thereby ensuring the real-time nature of data processing.

[0072] Furthermore, due to the use of a distributed computing engine, it can also provide richer data processing functions, expanding the depth and breadth of data analysis.

[0073] In one example, Kafka can be integrated through Lua. After the electronic device obtains the request response data collected by Lua and the log files collected by Flume, the request response data and log files can be written to Kafka, and Kafka stores the operation data in the corresponding target data queue according to the business type corresponding to the operation data. In this example, Spark Streaming can also be used to process the operation data in each data queue in Kafka, so as to obtain the processed operation data and the analysis parameters corresponding to the operation data.

[0074] It is understandable that the use of Spark Streaming can improve the fault tolerance of data processing.

[0075] Optionally, the processed operating data may be operating data in a unified format.

[0076] Optionally, considering that when processing operating data for different business types, some data processing logic may be universal, such as data cleaning, format conversion, desensitization, etc., but there are also some unique data processing logics closely related to the business type. For example, for the operating data corresponding to the e-commerce business, it is necessary to aggregate and analyze the user behavior data and calculate the activity of each user (such as the number of logins, the number of browsed products, the number of purchased products, etc.).

[0077] Based on this, the general data processing logic and the specific data processing logic related to the business type can be set separately.

[0078] In one possible implementation, general data processing logic may be set through a configuration file, and specific data processing logic closely related to the business type may be set through an embedded plug-in.

[0079] On this basis, the above data processing logic may include a first processing logic and a second processing logic, and the analysis parameters may include public indicators and business indicators.

[0080] In this embodiment, the electronic device can obtain the first processing logic and the second processing logic corresponding to the target data queue, thereby performing format processing on the operating data in the target data queue according to the first processing logic, obtaining the processed operating data and the public indicators corresponding to the operating data, and performing business processing on the operating data in the target data queue according to the second processing logic, obtaining the business indicators corresponding to the operating data.

[0081] Optionally, the first processing logic may refer to a general data processing logic, and the electronic device may perform formal processing on the operating data through the first processing logic and perform public indicator calculations at the same time.

[0082] In one possible implementation, the common indicators may include total visits, page views, average visit duration, bounce rate, access path analysis, response time, loading time, number of abnormal requests, error rate, etc.

[0083] Optionally, the second processing logic may refer to a unique data processing logic closely related to the business type, and the electronic device may perform business processing on the operating data through the second processing logic to calculate corresponding business indicators.

[0084] In one possible implementation, the business metric might include user engagement, ad click-through rate, unusual login attempts, and so on.

[0085] In this embodiment, both the public indicator and the business indicator can be used for data analysis.

[0086] Optionally, the electronic device can also be communicatively connected to a distributed database. Then, after acquiring the analysis parameters corresponding to the operation data, the electronic device can analyze the operation data according to the analysis parameters corresponding to the operation data, output the analysis results corresponding to the operation data, and store the processed operation data and the analysis parameters corresponding to the operation data in the distributed database.

[0087] In this embodiment, the distributed database is a distributed column database.

[0088] Optionally, since the electronic device can obtain operation data corresponding to different business types, the operation data corresponding to different business types can be analyzed according to analysis parameters of the operation data corresponding to different businesses, thereby obtaining analysis results corresponding to different businesses.

[0089] In one example, with respect to user behavior data, the electronic device may perform various analyses on the user behavior through corresponding analysis parameters, such as user behavior pattern analysis, current user access situation analysis, and the like.

[0090] In this embodiment, the electronic device can analyze the operating data to obtain multiple analysis results corresponding to different businesses, and then output the analysis results for users to view. In addition, considering that there may be some emergency situations, for example, when analyzing the security of a web application, if it is determined that the analysis result is a security threat, the electronic device can also output an alarm message to prompt the user to handle it in time.

[0091] It is understandable that, since the operation data is collected in real time by the data collection module during the operation of the web application, the analysis of this part of the operation data through the analysis parameters can only characterize the current situation of the web application in real time, but cannot characterize the overall historical situation of the web application. Therefore, the electronic device can also store the processed operation data and its corresponding analysis parameters, so as to respond to user needs later or based on preset analysis settings, re-analyze the overall historical situation in combination with the operation data over a period of time.

[0092] In this embodiment, the electronic device may also store the processed operation data and its corresponding analysis parameters in a distributed database. In a possible implementation, the distributed database may be Doris.

[0093] In one possible implementation, an electronic device can receive a data processing request from a user, which includes a data identifier and a target processing logic. Therefore, the electronic device can obtain target operation data corresponding to the data identifier from a distributed database and perform data processing on the target operation data according to the target processing logic.

[0094] Optionally, the data processing request may include a data query request, a data analysis request, etc.

[0095] Optionally, the data identifier may refer to the ID of the target operating data, or may be the name of the target operating data, etc., and may be specifically set according to actual application conditions.

[0096] In this embodiment, the target processing logic is related to the data processing request. For example, if the data processing request is a query request, the target processing logic may refer to the corresponding query logic, such as a search formula; if the data processing request is an analysis request, the target processing logic may be specific analysis content, such as a safety performance analysis of safety-related operating data within three months.

[0097] Optionally, in order to facilitate patterned operations, it is also possible to set up a period of time during which relevant analysis is performed on the operating data within a period of time. For example, it is possible to set up an analysis of the web application performance every six months. The electronic device can then obtain the operating data corresponding to the web application performance within these six months every six months to perform web application performance analysis and output the corresponding analysis results.

[0098] In this embodiment, the efficiency and flexibility of data query and data re-analysis can be improved by adopting a distributed database, while reducing the data storage cost.

[0099] In order to execute the corresponding steps in the above embodiments and various possible methods, a data processing device is provided below. Optionally, the data processing device may adopt the above Figure 1 For further information, please refer to Figure 4 , Figure 4 This is a functional module diagram of a data processing device provided in an embodiment of the present application. It should be noted that the basic principle and technical effects of the data processing device provided in this embodiment are the same as those of the above embodiments. For the sake of brief description, for parts not mentioned in this embodiment, reference can be made to the corresponding contents in the above embodiments. The data processing device includes: an acquisition module 200 and a processing module 210.

[0100] The acquisition module 200 is used to run the data acquisition module and acquire the operation data of the web application through the data acquisition module.

[0101] It can be understood that the acquisition module 200 can also be used to execute the above step S20.

[0102] The processing module 210 is used to process the operation data according to the business type corresponding to the operation data, and obtain the processed operation data and the analysis parameters corresponding to the operation data.

[0103] It can be understood that the processing module 210 can also be used to execute the above step S21.

[0104] Optionally, the data collection module includes a data collection script and a log collection module, and the running data includes request response data and log files; the acquisition module 200 is also used to run the data collection script and the log collection module respectively, obtain the request response data through the data collection script, and obtain the log file through the log collection module.

[0105] Optionally, the processing module 210 is also used to store the operating data in a corresponding target data queue according to the business type corresponding to the operating data; obtain the data processing logic corresponding to the target data queue, and perform data processing on the operating data in the target data queue according to the data processing logic to obtain the processed operating data and the analysis parameters corresponding to the operating data.

[0106] Optionally, the processing module 210 is also used to obtain a first processing logic and a second processing logic corresponding to the target data queue; perform format processing on the operating data in the target data queue according to the first processing logic to obtain the processed operating data and public indicators corresponding to the operating data; perform business processing on the operating data in the target data queue according to the second processing logic to obtain business indicators corresponding to the operating data.

[0107] Optionally, the processing module 210 is further used to analyze the operation data according to analysis parameters corresponding to the operation data, output analysis results corresponding to the operation data, and store the processed operation data and the analysis parameters corresponding to the operation data in a distributed database.

[0108] Optionally, the processing module 210 is also used to receive a data processing request from a user; the data processing request includes a data identifier and a target processing logic; obtain target operation data corresponding to the data identifier from a distributed database, and perform data processing on the target operation data according to the target processing logic.

[0109] Optionally, the above modules can be stored in the form of software or firmware. Figure 1 The memory shown in the figure or solidified in the operating system (OS) of the electronic device, and can be Figure 1 Meanwhile, the data and program codes required for executing the above modules can be stored in the memory.

[0110] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the data processing method provided in the embodiment of the present application can be implemented.

[0111] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and a part of the module, program segment or code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0112] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0113] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0114] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A data processing method, characterized in that: Applied to an electronic device, wherein the electronic device is provided with a data acquisition module, the method comprises: Running the data acquisition module, and acquiring the operation data of the web application through the data acquisition module; According to the business type corresponding to the operation data, the operation data is processed to obtain the processed operation data and the analysis parameters corresponding to the operation data.

2. The method according to claim 1, characterized in that The data collection module includes a data collection script and a log collection module, and the operation data includes request response data and log files; The running of the data acquisition module to obtain the running data of the web application through the data acquisition module includes: The data collection script and the log collection module are respectively run, the request response data is obtained through the data collection script, and the log file is obtained through the log collection module.

3. The method according to claim 1, characterized in that: The electronic device also stores data queues corresponding to various service types, and corresponding relationships between various data queues and data processing logics; The performing data processing on the operation data according to the business type corresponding to the operation data to obtain the processed operation data and the analysis parameters corresponding to the operation data includes: According to the business type corresponding to the operation data, the operation data is stored in the corresponding target data queue; The data processing logic corresponding to the target data queue is obtained, and the operation data in the target data queue is processed according to the data processing logic to obtain the processed operation data and the analysis parameters corresponding to the operation data.

4. The method according to claim 3, characterized in that The data processing logic includes a first processing logic and a second processing logic, and the analysis parameters include a public index and a business index; The acquiring the data processing logic corresponding to the target data queue, and performing data processing on the operation data in the target data queue according to the data processing logic to obtain the processed operation data and analysis parameters corresponding to the operation data, includes: Acquire a first processing logic and a second processing logic corresponding to the target data queue; Performing format processing on the operation data in the target data queue according to the first processing logic to obtain the processed operation data and a common indicator corresponding to the operation data; Business processing is performed on the operating data in the target data queue according to the second processing logic to obtain business indicators corresponding to the operating data.

5. The method according to claim 1, characterized in that The electronic device is also in communication connection with a distributed database, and the method further comprises: The operation data is analyzed according to the analysis parameters corresponding to the operation data, the analysis results corresponding to the operation data are output, and the processed operation data and the analysis parameters corresponding to the operation data are stored in a distributed database.

6. The method according to claim 5, characterized in that The method further comprises: Receiving a data processing request from a user; the data processing request includes a data identifier and a target processing logic; The target operation data corresponding to the data identifier is acquired from the distributed database, and data processing is performed on the target operation data according to the target processing logic.

7. A data processing device, characterized in that: Applied to electronic equipment, the electronic equipment is provided with a data acquisition module, and the device comprises: An acquisition module, used to run the data acquisition module and acquire the operation data of the web application through the data acquisition module; The processing module is used to process the operation data according to the business type corresponding to the operation data, and obtain the processed operation data and the analysis parameters corresponding to the operation data.

8. The device according to claim 7, characterized in that The data collection module includes a data collection script and a log collection module, and the operation data includes request response data and log files; The acquisition module is further used to run the data acquisition script and the log acquisition module respectively, obtain the request response data through the data acquisition script, and obtain the log file through the log acquisition module.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a computer program executable by the processor, and the processor can execute the computer program to implement the method according to any one of claims 1 to 5.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

Images