Log data verification method and device, electronic equipment, storage medium and product

Abstract

The present disclosure provides a log data verification method and device, electronic equipment, storage medium and product, relates to the field of automation, in particular to the field of data processing. The specific implementation scheme is: obtaining a pseudo code, and determining point position information for log dotting based on the pseudo code; recording log data based on the point position information; obtaining a data constraint rule of the log data, and verifying the log data based on the data constraint rule. Through the present disclosure, the cost of log data verification can be saved.

Description

Technical Field

[0001] This disclosure relates to the field of automation technology, and more particularly to the field of data processing technology, specifically to a log data verification method, apparatus, electronic device, storage medium, and product. Background Technology

[0002] Smart terminals involve numerous applications that provide various services. To understand the usage of each application, relevant data can be acquired. This data acquisition can be achieved through logging and statistical analysis.

[0003] Implementing log tracking and statistics requires relatively high human resource investment and statistics-related resource investment. Summary of the Invention

[0004] This disclosure provides a log data verification method, apparatus, electronic device, storage medium, and product.

[0005] According to a first aspect of this disclosure, a log data verification method is provided, the method comprising:

[0006] Obtain pseudocode, and based on the pseudocode, determine the location information for logging; based on the location information, record log data; obtain the data constraint rules for the log data, and verify the log data based on the data constraint rules.

[0007] According to a second aspect of this disclosure, a log data verification apparatus is provided, the apparatus comprising:

[0008] The module is used to acquire pseudocode and determine the location information for logging based on the pseudocode; the module is used to record log data based on the location information; and the module is used to acquire the data constraint rules of the log data and verify the log data based on the data constraint rules.

[0009] According to a third aspect of this disclosure, an electronic device is provided, comprising:

[0010] At least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first aspect.

[0011] According to a fourth aspect of this disclosure, a non-transitory computer-readable storage medium is provided storing computer instructions, wherein the computer instructions are configured to cause the computer to perform the method according to the first aspect.

[0012] According to a fifth aspect of this disclosure, a computer product is provided, including a computer program that, when executed by a processor, implements the method according to the first aspect.

[0013] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0014] The accompanying drawings are provided to better understand this solution and do not constitute a limitation of this disclosure. Wherein:

[0015] Figure 1 This is a schematic diagram of the application environment based on this disclosure;

[0016] Figure 2 A flowchart illustrating a log data verification method provided in an embodiment of this disclosure is shown.

[0017] Figure 3 A schematic diagram of the structure of a log data verification device provided in an embodiment of this disclosure is shown;

[0018] Figure 4 A schematic block diagram of an example electronic device that can be used to implement embodiments of the present disclosure is shown. Detailed Implementation

[0019] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0020] With the widespread adoption of the internet and the increase in smart terminals, these terminals are connected to numerous applications that provide various services. To understand the usage of each application, relevant data can be obtained. This data can be acquired through logging and statistical analysis. For example, this can involve tracking unique visitors (UV), page views (PV), or clicks for each application.

[0021] Statistical functions serve as a fundamental capability for every product line. In the daily R&D process, statistical work has also become a human resource investment for R&D personnel, and the investment in statistics-related resources is relatively high.

[0022] For example, in terms of communication, statistical work is mainly carried out by product staff who submit requirements to R&D staff. Product staff focus on statistical goals, while R&D staff focus on specific implementation. From the goal to the implementation process, multiple communications are required to determine the final implementation effect.

[0023] In terms of research and development: Each statistical function has different location information, which contains many related parameters. Depending on the location requirements, there can be hundreds of parameters. Moreover, these parameters are implemented in multiple versions over a long period of time, which involves the learning and maintenance costs for R&D personnel.

[0024] In terms of validation: For R&D personnel, due to the magnitude of the fields, the debugging process is mainly done manually to determine whether the parameter fields have been successfully marked and to verify the validity and integrity of the fields, which is costly.

[0025] In summary, the relevant technologies that utilize the point-tracking capabilities within applications require business personnel to record point locations, manually write code, and report log data for verification. This increases communication costs and results in relatively high implementation and verification costs.

[0026] Based on the issues raised in the above embodiments, this disclosure provides a log data verification method and apparatus. By generating pseudocode from parameters set by business personnel, communication costs for staff are reduced. Obtaining application-tracked log data based on the pseudocode reduces implementation costs, automatically verifies the validity and integrity of the data, and further reduces verification costs.

[0027] The log data verification method provided in this application can be applied to, for example... Figure 1 In the application environment shown, terminal 101 communicates with server 102 via a network. Terminal 101 is the client in this disclosure, used to record log data, report it to server 102, and verify the validity and integrity of the data. Server 102 is used to generate pseudocode. Terminal 101 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices, and server 102 can be implemented using a standalone server or a server cluster consisting of multiple servers.

[0028] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0029] Figure 2 A flowchart illustrating a log data verification method provided in an embodiment of this disclosure is shown, as follows: Figure 2 As shown, this method can be applied to a client, including:

[0030] In step S210, pseudocode is obtained, and based on the pseudocode, the location information for logging is determined.

[0031] In this embodiment of the disclosure, pseudocode can be obtained from the server. The server can provide a location management system for the application, and set parameter restrictions for each location, such as the parameter names to be set and the standard for parameter values.

[0032] In this disclosure, for a target application, the points where log entries need to be made are determined, thereby determining the parameters required for those points. There can be one or more points.

[0033] Furthermore, in response to the detection of the parameter setting operation, the server obtains the parameters used to log the target application and generates corresponding pseudocode based on the obtained parameters.

[0034] In this embodiment of the disclosure, the server can generate pseudocode from the parameters set by the staff for subsequent research and development.

[0035] After obtaining the pseudocode, the client stores it in the data module. Based on the parameter information carried in the pseudocode, the location information for logging is determined.

[0036] In step S220, log data is recorded based on the location information.

[0037] In this embodiment of the disclosure, the location information includes the location name and the corresponding number of location fields. Log data is then recorded based on the location name and the required fields.

[0038] In step S230, the data constraint rules of the log data are obtained, and the log data is verified based on the data constraint rules.

[0039] In this embodiment of the disclosure, data constraint rules can be obtained for verifying the validity and integrity of log data. For example, to determine the factors affecting the loading speed of a webpage, the data constraint rule could set the location keyword as time, and the location value standard could be the start and end times of webpage loading. Network type constraints can also be set, such as mobile network or Wi-Fi. Geographic location information, client device model, etc., can also be set.

[0040] The log data verification method provided in this disclosure uses pseudocode to determine location information, saving on manual communication costs. Log data is directly obtained from the recorded locations, conserving resources. Automated log verification allows for relatively quick identification of log data issues, thereby improving verification efficiency.

[0041] In this embodiment of the disclosure, the pseudocode is determined based on the point key, the point value standard, and the relationship between the point key.

[0042] The location keywords, location value standards, and the relationship between the location keywords are determined based on preset parameters.

[0043] That is, in this disclosure, the parameters for logging the target application at each point used to generate pseudocode may include point keywords, point value criteria, and the relationship between point keywords. The relationship between point keywords can be a hierarchical relationship between point keywords.

[0044] In this embodiment of the disclosure, the pseudocode can be a development language, which can be, but is not limited to, C, C++, JAVA, Objective-C (OC), Swift, Kotlin, etc.

[0045] In this embodiment of the disclosure, received log data can be verified to determine its validity and completeness. The following embodiments will describe the verification of log data in response to receiving log data sent by a client.

[0046] In this embodiment of the disclosure, the location information includes the location name and the number of fields. For example, for location 168, there are three fields.

[0047] In this disclosure, if it is determined that an application has been launched and a point-marking behavior has occurred, the point that generated the point-marking behavior is associated. Based on the point information, the log data generated by that point is recorded.

[0048] Furthermore, the client determines the business requirements based on the parameters in the pseudocode. Then, based on these requirements, it calculates the parameter values ​​at each location, records the log data generated at each location, and stores it in a specified data item.

[0049] In this embodiment of the disclosure, the parameters required for logging the target application can be customized by staff. For example, staff may need the log data for further processing. Therefore, when the server detects the parameter setting operation, it can obtain the parameters used for logging the target application.

[0050] In one embodiment of this disclosure, in response to determining that the location name in the log data is the same as the location name in the location information, the log data is verified based on data constraint rules to obtain the integrity verification result and the value validity verification result of the log data.

[0051] In another embodiment of this disclosure, log data verification is not initiated in response to the determination that the point name in the log data is different from the point name in the point information. For example, if the parameter name in the pseudocode is point 168, and the recorded log data is log data generated by point 158, then the current log data is not verified.

[0052] In some embodiments of this disclosure, in response to determining that the integrity verification result is a missing result, the name of the missing data is prompted to the customer.

[0053] For example, parameters include Uniform Resource Locator (URL), size, and load status (isLoadS).

[0054] A URL is a concise representation of the location and access method of a resource that can be obtained from the Internet; it is the address of a standard resource on the Internet.

[0055] After verification, if the log data contains the URL but not size and isLoadS, the user can be prompted that size and isLoadS are missing.

[0056] In other embodiments of this disclosure, in response to determining that there is data with an empty field, the name of the abnormal log data is indicated.

[0057] For example, if the field in the URL parameter upload is empty, it is determined that the log data uploaded via the URL is invalid and is abnormal log data. In this case, the client is prompted that the URL is abnormal and invalid.

[0058] In some embodiments of this disclosure, the log data of newly added locations in the application can also be displayed separately.

[0059] In this disclosure, a new logging point can be a point where the application version where the current log data resides differs from the application version where the previous log data resided. For example, the current application version is an updated version.

[0060] For example, if the URL is a newly added field in the new version, then the log data uploaded via the URL is determined to be invalid or abnormal log data. In this case, the client will be notified separately that the URL is abnormal and invalid.

[0061] In this disclosure, prompts can be made via the console or as pop-ups in the application.

[0062] The following embodiments illustrate the log data verification method provided in this disclosure.

[0063] For example, taking 168 points as an example, the parameters used to log the target application include URL, size, and isLoadS.

[0064] The URL can be the URL of a webpage, which is a string type that cannot be empty and can be up to 1024 bytes in length.

[0065] Size can be the size of the webpage, and it is an integer type.

[0066] isLoadS determines whether the load was successfully loaded; it is a boolean type.

[0067] The server can further generate corresponding pseudocode based on the configured parameters. For example, char URL

[1024] ; / / URL of the webpage, not allowed to be empty, length not exceeding 1024 bytes. int size; / / Size of the webpage. boolisLoadS; / / Whether loading was successful.

[0068] The client uses the generated pseudocode as the output of the data storage component. Here, variable names serve as the keys for the uploaded data, and the values ​​are the corresponding values.

[0069] The server receives data, parses the key and value, and updates the corresponding entry data according to the key value.

[0070] The client-side update criteria for points include: point name (168 points), number of fields (three fields in total). Among these, the URL cannot be empty and its length cannot exceed 1024; the URL type is string; the size type is integer; and the isLoadS type is boolean.

[0071] When developers use the app to perform point tracking and report point information, the system checks if the points are identical. For example, if the reported point is 158 and the client updates the point to 168, no verification is needed, and log data verification is not enabled. If the points are identical, then log data verification is enabled.

[0072] In this disclosed embodiment, integrity verification is performed, for example, if uploaded data only contains the URL, the system will prompt that the size and isLoadS are missing.

[0073] Validation: For example, if a field uploaded in the URL is empty, the system will prompt that the URL is invalid.

[0074] The new version's points are explained separately: For example, if the URL is a newly added field in the new version, and an error occurs, a separate prompt can be made, such as different prompt content, different prompting methods, and different prompting areas.

[0075] The log data verification method disclosed herein automatically generates data layer code and provides rapid debugging and verification capabilities, enabling developers to quickly identify integrity and validity issues. It also provides separate prompts for newly added fields in new versions. This reduces development costs for developers, and for product personnel, the data layer is abstracted and encapsulated during the requirement submission process, reducing communication costs. Parameter reporting based on data points can also be verified in advance during the product design phase. In summary, it improves the development efficiency of business statistics.

[0076] The methods provided in this disclosure are applicable to, but not limited to, development versions of applications.

[0077] Based on and Figure 2 The method shown follows the same principle. Figure 3 A schematic diagram of the structure of a log data verification device provided in an embodiment of this disclosure is shown, such as... Figure 3 As shown, the log data verification device 300 may include:

[0078] The acquisition module 301 is used to acquire pseudocode and determine the log point information based on the pseudocode; the recording module 302 is used to record log data based on the point information; and the verification module 303 is used to acquire the data constraint rules of the log data and verify the log data based on the data constraint rules.

[0079] In this embodiment of the disclosure, the pseudocode is determined based on point keywords, point value standards, and the relationship between the point keywords; the relationship between the point keywords, point value standards, and the point keywords is determined based on preset parameters.

[0080] In this embodiment of the disclosure, the location information includes the location name and the number of fields.

[0081] In this embodiment of the disclosure, the recording module 302 is used to, in response to the application that determines to perform log recording, associate the log recording points and record the log data generated by the points based on the point information.

[0082] In this embodiment of the disclosure, the verification module 303 is used to verify the log data based on the data constraint rules in response to determining that the location name in the log data is the same as the location name in the location information, and to obtain the integrity verification result and the value validity verification result of the log data.

[0083] In this embodiment of the disclosure, the verification module 303 is further configured to prompt the name of the missing log data in response to determining that the integrity verification result is a missing result.

[0084] In this embodiment of the disclosure, the verification module 303 is further configured to prompt the name of the abnormal log data in response to determining that there is data with an empty field.

[0085] In this embodiment of the disclosure, the verification module 303 is further configured to, in response to determining that the data with an empty field is newly added log data, separately prompt the name of the abnormal log data.

[0086] The acquisition, storage, and application of user personal information involved in the technical solution disclosed herein comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0087] According to embodiments of this disclosure, this disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0088] Figure 4 A schematic block diagram of an example electronic device 400 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0089] like Figure 4As shown, device 400 includes a computing unit 401, which can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) 402 or a computer program loaded from storage unit 408 into random access memory (RAM) 403. RAM 403 may also store various programs and data required for the operation of device 400. The computing unit 401, ROM 402, and RAM 403 are interconnected via bus 404. Input / output (I / O) interface 405 is also connected to bus 404.

[0090] Multiple components in device 400 are connected to I / O interface 405, including: input unit 406, such as keyboard, mouse, etc.; output unit 407, such as various types of monitors, speakers, etc.; storage unit 408, such as disk, optical disk, etc.; and communication unit 409, such as network card, modem, wireless transceiver, etc. Communication unit 409 allows device 400 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0091] The computing unit 401 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 401 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 401 performs the various methods and processes described above, such as the log data verification method. For example, in some embodiments, the log data verification method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 408. In some embodiments, part or all of the computer program may be loaded and / or installed on device 400 via ROM 402 and / or communication unit 409. When the computer program is loaded into RAM 403 and executed by the computing unit 401, one or more steps of the log data verification method described above may be performed. Alternatively, in other embodiments, the computing unit 401 may be configured to perform the log data verification method by any other suitable means (e.g., by means of firmware).

[0092] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0093] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0094] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0095] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0096] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0097] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0098] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0099] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A log data verification method, the method comprising: Obtain the pseudocode, and based on the pseudocode, determine the location information for logging. Based on the location information, log data is recorded; Obtain the data constraint rules for the log data, and verify the log data based on the data constraint rules; The pseudocode is determined based on the location keywords, location value standards, and the relationship between the location keywords; the location keywords, location value standards, and the relationship between the location keywords are determined based on preset parameters; the location information includes the location name and the number of fields.

2. The method according to claim 1, wherein, The process of recording log data based on the location information includes: In response to the application that determines to perform log logging, associate the log logging points; Based on the location information, log data generated at the location is recorded.

3. The method according to claim 1, wherein, The verification of the log data based on the data constraint rules includes: In response to the determination that the location name in the log data is the same as the location name in the location information, the log data is verified based on the data constraint rules to obtain the integrity verification result and the value validity verification result of the log data.

4. The method according to claim 3, wherein, The method further includes: In response to the determination that the integrity verification result is missing, the name of the missing log data is displayed.

5. The method according to claim 3, wherein, The method further includes: In response to the discovery of data where a field is empty, the name of the exception log data is displayed.

6. The method according to claim 5, wherein, The response to determining that data with an empty field exists, indicating the name of the abnormal log data, also includes: In response to the determination that the data with an empty field is newly added log data, the name of the abnormal log data is displayed separately.

7. A log data verification device, the device comprising: The acquisition module is used to acquire pseudocode and determine the log point information based on the pseudocode. The recording module is used to record log data based on the location information; The verification module is used to obtain the data constraint rules of the log data and verify the log data based on the data constraint rules. The pseudocode is determined based on the location keywords, location value standards, and the relationship between the location keywords; the location keywords, location value standards, and the relationship between the location keywords are determined based on preset parameters; the location information includes the location name and the number of fields.

8. The apparatus according to claim 7, wherein, The recording module is used for: In response to the application that determines to perform log logging, associate the log logging points; Based on the location information, log data generated at the location is recorded.

9. The apparatus according to claim 7, wherein, The verification module is used for: In response to the determination that the location name in the log data is the same as the location name in the location information, the log data is verified based on the data constraint rules to obtain the integrity verification result and the value validity verification result of the log data.

10. The apparatus according to claim 9, wherein, The verification module is also used for: In response to the determination that the integrity verification result is missing, the name of the missing log data is displayed.

11. The apparatus according to claim 9, wherein, The verification module is also used for: In response to the discovery of data where a field is empty, the name of the exception log data is displayed.

12. The apparatus according to claim 11, wherein, The verification module is also used for: In response to the determination that the data with an empty field is newly added log data, the name of the abnormal log data is displayed separately.

13. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.

14. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-6.

15. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1-6.

Images