Data acquisition method, system, computer device and storage medium

Abstract

The application relates to a data collection method, system, computer device and storage medium. The method comprises: collecting information of a collection object involved in a running process of a target application program; the target application program comprises a plurality of hierarchical collection objects, each collection object has a unique object code; when collecting information of a target collection object, a combined code with a hierarchical structure is determined; the combined code is generated by combining the object code of the target collection object and the object code of a dependent collection object; the hierarchical level of the dependent collection object is higher than that of the target collection object, and the dependent collection object has a running dependent relationship with the target collection object; and the information of the target collection object and the combined code are reported; wherein the combined code is used for information processing of the information of the target collection object. The method can improve the analysis efficiency of the collected data.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of big data, and in particular to a data collection method and system, a computer device, and a storage medium. BACKGROUND

[0002] With the development of the Internet, the functions provided by Internet products for users are more and more perfect, but at the same time, the Internet products become more and more complex. Generally, Internet products face the following problems: user retention and user activity analysis difficulty increases, product optimization and decision-making difficulty increases, and the like. In order to solve the above problems and improve the efficiency of problem solving, a solution based on big data analysis is proposed. Since the basis of the solution based on big data analysis is data collection, data collection has become increasingly important.

[0003] However, the traditional data collection method relies on a collection list for describing the collection content, and after collecting the data, the collected data needs to be analyzed through the collection list and correlated and analyzed through manual means, which results in a relatively low analysis efficiency. SUMMARY

[0004] Therefore, it is necessary to provide a data collection method, system, computer device, storage medium, and computer program product capable of improving the analysis efficiency of collected data in view of the above technical problems.

[0005] In a first aspect, the present application provides a data collection method. The method comprises:

[0006] collecting information of a collection object involved in a running process of a target application program; the target application program comprises a plurality of hierarchical collection objects, and each collection object has a unique object code corresponding thereto;

[0007] when collecting information of a target collection object, determining a combined code having a hierarchical structure; the combined code is generated by combining the object code of the target collection object and the object code of a dependent collection object; the hierarchical level of the dependent collection object is higher than that of the target collection object, and the dependent collection object and the target collection object have a running dependency relationship;

[0008] reporting the information of the target collection object and the combined code; wherein the combined code is used for information processing of the information of the target collection object.

[0009] In one embodiment, the reporting of the information of the target collection object and the combined code comprises:

[0010] report the information of the target collection object and the combined code to a processing end, so that the processing end performs the following processing:

[0011] determine a code mapping table corresponding to the combined code, the code mapping table including a mapping relationship between object codes and object names of the collection objects of the multiple levels;

[0012] convert each object code in the combined code into a corresponding object name based on the code mapping table, and generate a collection log according to the converted object name and the information of the target collection object.

[0013] In one of the embodiments, the code mapping table is obtained from a coding end; the coding end is configured to:

[0014] confirm object codes of the collection objects of the multiple levels;

[0015] establish a mapping relationship between object names and corresponding object codes of the collection objects of the multiple levels, so as to generate and store a code mapping table.

[0016] In one of the embodiments, the combined code of the collection objects of the multiple levels is obtained from a coding end; wherein the coding end is configured to confirm object codes of the collection objects of the multiple levels, and determine the combined code of the collection objects of the multiple levels based on the object codes of the collection objects of the multiple levels;

[0017] the determination of the combined code with a hierarchical structure includes:

[0018] screening the combined code of the target collection object from the combined code of the collection objects of the multiple levels.

[0019] In one of the embodiments, the information collection of the collection objects involved in the running process of the target application program includes any one of the following processing:

[0020] when the binding attribute of the collection object involved in the running process of the target application program indicates information collection, collecting information of the involved collection object;

[0021] when the information collection code is executed in the running process of the target application program, collecting information of the corresponding collection object through the information collection code;

[0022] in the case where a preset event in the target application program occurs, collecting information of the collection object corresponding to the preset event.

[0023] In one of the embodiments, the combined code further includes at least one of a channel code of a target traffic channel and a feature code.

[0024] The target application program is triggered to run through the target traffic channel; the target traffic channel is one of an external traffic channel and an internal traffic channel, and the external traffic channel is a traffic channel for triggering the target application program to run through a preset external link.

[0025] The feature code includes at least one of an encrypted feature code and an environment feature code, the encrypted feature code is obtained by encrypting a plurality of object encodings in the combined encoding, and the environment feature code is used to represent an environment parameter when the target collection object is information collected.

[0026] In one of the embodiments, the hierarchy of the target application program includes at least one of a program level, a page level, a page block level, and a page element level; and the order of the combination of the object encodings in the combined encoding is determined according to the hierarchical relationship between the respective collection objects corresponding to the combined encoding.

[0027] In a second aspect, the application further provides a data collection system, an application end and a processing end, the application end runs a target application program;

[0028] The application end is configured to collect information of a collection object involved in a running process of a target application program; the target application program includes a plurality of hierarchical collection objects, each collection object has a unique object encoding; when information of a target collection object is collected, a combined encoding with a hierarchical structure is determined; the combined encoding is generated by combining the object encoding of the target collection object and the object encoding of a dependent collection object; the hierarchical level of the dependent collection object is higher than that of the target collection object, and the dependent collection object and the target collection object have a running dependency relationship; and the information of the target collection object and the combined encoding are reported to the processing end; wherein the combined encoding is used for information processing of the information of the target collection object.

[0029] The processing end is configured to receive the information of the target collection object and the combined encoding, and perform information processing of the information of the target collection object based on the combined encoding.

[0030] In a third aspect, the application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor executes the steps of the above-mentioned data collection method.

[0031] In a fourth aspect, the application further provides a computer readable storage medium. The computer readable storage medium stores a computer program, and the computer program is executed by a processor to execute the steps of the above-mentioned data collection method.

[0032] In a fifth aspect, the present application provides a computer program product. The computer program product comprises a computer program which is executed by a processor to perform the steps of the above data collection method.

[0033] The above data collection method, system, computer device, storage medium and computer program product collect information of a collection object involved in a running process of a target application program. The target application program comprises a plurality of hierarchical collection objects, each of which has a unique object code. When collecting information of a target collection object, a combined code with a hierarchical structure is determined. The combined code is generated by combining the object code of the target collection object and the object code of a dependent collection object. The hierarchical level of the dependent collection object is higher than that of the target collection object, and the dependent collection object has a running dependency relationship with the target collection object. In this way, the combined code indicates the collection objects involved in the running dependency relationship and the hierarchical structure, forming complete data link information. The information of the target collection object and the combined code are reported. The combined code is used for information processing of the information of the target collection object. In this way, complete data link information can be obtained while analyzing the information of the target collection object, without manual backtracking and accurate data, thereby improving the data analysis efficiency of the collected data. BRIEF DESCRIPTION OF DRAWINGS

[0034] Figure 1 FIG. 1 is a diagram of an application environment of the data collection method in an embodiment;

[0035] Figure 2 FIG. 2 is a flowchart of the data collection method in an embodiment;

[0036] Figure 3 FIG. 3 is a schematic diagram of the principle of the data collection method in an embodiment;

[0037] Figure 4 FIG. 4 is a schematic diagram of the principle of the data collection method in an embodiment;

[0038] Figure 5 FIG. 5 is a schematic diagram of the principle of the data collection method in an embodiment;

[0039] Figure 6 FIG. 6 is a flowchart of the data collection method in an embodiment;

[0040] Figure 7 FIG. 7 is a structural block diagram of the data collection system in an embodiment;

[0041] Figure 8 FIG. 8 is an internal structure diagram of the computer device in an embodiment. DETAILED DESCRIPTION

[0042] In order to make the purposes, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and not intended to limit the present application.

[0043] The data collection method provided by the present application can be applied to an application environment as shown in Figure 1 The application end 110 communicates with the processing end 120 through a network, and the application end 110 runs a target application program. The application end 110 can be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, servers and portable wearable devices, and the processing end 120 can be implemented by a terminal device, a stand-alone server, a terminal or a server cluster composed of multiple servers.

[0044] The application end 110 can collect information of a collection object involved in the running process of the target application program. The target application program includes multiple levels of collection objects, and each collection object has a unique object code. When collecting information of the target collection object, a combined code with a hierarchical structure is determined. The combined code is generated by combining the object code of the target collection object and the object code of a dependent collection object. The level of the dependent collection object is higher than that of the target collection object, and the dependent collection object and the target collection object have a running dependency relationship. The application end 110 reports the information of the target collection object and the combined code to the processing end 120. The processing end 120 uses the combined code to process the information of the target collection object.

[0045] It can be understood that in other embodiments, the application end 110 can only run the target application program, and other information collection devices can collect information of the target application program running in the application end 110 and generate a combined code, and report it to the processing end 120. That is, the steps performed by the application end 110 in the embodiments of the present application can be replaced by a dedicated information collection device.

[0046] In one embodiment, as shown in Figure 2 A data collection method is provided, and the present embodiment takes the method applied to an application end as an example. It can be understood that the method can also be applied to a system including an application end and a processing end, and implemented through the interaction of the application end and the processing end. The method includes the following steps in the present embodiment:

[0047] S202, collecting information of a collection object involved in the running process of a target application program. The target application program includes multiple levels of collection objects, and each collection object has a unique object code.

[0048] The collection object is an object involved in the running of the target application program and needed to be collected. The collection object includes the target application program and an object processed by the code logic of the target application program in the running of the target application program. For example, the collection object can be a function executed in the running of the target application program, a variable executed, a picture clicked, a table clicked, a column selected, or can be the name of the target application program, the target application program in different operating systems, and the like. The object code is a code for the collection object. The level is not a physical hierarchical concept, but a level obtained by classifying the process from shallow to deep and from early to late in the running. The running time point of the collection object at a high level is earlier than the running time point of the collection object at a low level. The first layer can represent the highest level, or the first layer can represent the lowest level, and the specific limitation is not made.

[0049] Specifically, each collection object of the target application program has a unique corresponding object code, and the target application program includes collection objects at multiple levels. After the application end runs the target application program, information collection is performed on the collection objects involved in the running of the target application program. It can be understood that the uniqueness of the object code is for the same target application program, and the object codes of different target application programs can be the same.

[0050] In one embodiment, the target application program collects information on the collection objects involved in the running of the target application program.

[0051] In another embodiment, the target application program is a first application program, and a second application program collects information on the collection objects involved in the running of the first application program.

[0052] In one embodiment, the encoding end provides an encoding definition interface to determine the collection objects of the target application program and encode the collection objects.

[0053] In one embodiment, if the target application program is an application program supporting display of multiple pages, the encoding end can encode the pages selected and confirmed by the user terminal as the collection objects, the blocks in the pages, and the elements in the blocks, and form a set of encoding definition results for the target application program. The block can be a table, a column (channel), a drop-down selection box, and the like in the page, and the element is used to constitute the block, such as an option constituting the drop-down selection box.

[0054] S204, when collecting information on the target collection object, determining a combined code with a hierarchical structure; the combined code is generated by combining the object code of the target collection object and the object code of a dependent collection object; the level of the dependent collection object is higher than the level of the target collection object, and the dependent collection object and the target collection object have a running dependency relationship.

[0055] The existence of a running dependency relationship between the collection objects is used to indicate that the collection object is dependent on another collection object being run. The target collection object is a collection object that triggers the generation of the combined code, and the dependent collection object is a collection object that has a running dependency relationship with the target collection object and is at a higher level than the target collection object. The hierarchical structure refers to a structure that is divided according to levels. It can be understood that the combined code with a hierarchical structure has a structure with multiple different levels, and at each level there is an object code corresponding to the collection object, such as the combined code "12.A.12C", which has a hierarchical structure with three levels, the first level corresponding to the object code "12", the second level corresponding to the object code "A", and the third level corresponding to the object code "12C".

[0056] Specifically, during the running process of the application end, when information collection is performed on the target collection object, a combined code with a hierarchical structure is determined. The combined code is generated by combining the object code of the target collection object and the object code of the dependent collection object. The level of the dependent collection object is higher than that of the target collection object, and the dependent collection object has a running dependency relationship with the target collection object. Here, the application end can extract and store the combined codes of the collection objects at multiple levels, and when information collection is performed on the target collection object, the combined code of the target collection object is searched from the stored multiple combined codes. Alternatively, the combined code of the target collection object can be obtained in real time when information collection is performed on the target collection object.

[0057] It can be understood that the combined code with a hierarchical structure generated by combining the object code of the target collection object and the object code of the dependent collection object not only represents the target collection object and the dependent collection object, but also has a hierarchical structure, thereby ensuring the atomicity and diversity of the data, providing flexible and diversified coding combinations, and enabling the combined code to support infinite hierarchical division and have an extensible effect, thereby making the data analysis result more rich. Moreover, any collection object in the target application program can be accurately located, the data is clear and accurate, manual screening and correlation of the collected data are no longer needed, the analysis cost is reduced, thereby improving the efficiency of data analysis and greatly reducing the resource consumption of calculation.

[0058] In one embodiment, the levels involved in the combined code with a hierarchical structure are customizable.

[0059] For example, for the running process of A function calling B function, and B function calling C function:

[0060] In the case of tracing A function, B function and C function, A function can be confirmed as the collection object of the first layer, B function as the collection object of the second layer and C function as the collection object of the third layer in a self-defined form. When C function is executed, it depends on B function, and the execution of B function depends on A function. Therefore, A function and B function are dependent collection objects of different levels of C function. The combination code with hierarchical structure can be generated by combining the object code of the target collection object (C function) and the object code of the dependent collection object (B function and A function).

[0061] In the case of tracing A function and C function, A function can be confirmed as the collection object of the first layer and C function as the collection object of the second layer in a self-defined form. It can be understood that when C function is executed, it depends on B function, and the execution of B function depends on A function. Therefore, the first layer A function and the second layer C function have a running dependent relationship. Therefore, A function is a dependent collection object of C function. The combination code with hierarchical structure can be generated by combining the object code of the target collection object (C function) and the object code of the dependent collection object (A function).

[0062] It can be understood that the running process of calling B function for A function and calling C function for B function can replace A function, B function and C function with the first page, the drop-down box in the first page and the drop-down option, respectively. Similarly, the first page, the drop-down box and the drop-down option have a running dependent relationship and a hierarchical relationship. The first page and the drop-down option also have a running dependent relationship, which can be understood as the running of the drop-down option is based on the running of the first page first.

[0063] In one embodiment, the application end can determine the target traffic channel triggering the running of the target application program, and report the channel code and the combination code of the target traffic channel. In one embodiment, the channel code of the target traffic channel and the object code of the target collection object can be combined to generate the combination code including the channel code of the target traffic channel. In another embodiment, the channel code of the target traffic channel and the combination code can be reported as two codes at the same time.

[0064] In one embodiment, the combination code can be represented in the form of object code, interval symbol and object code to isolate different object codes. For example, for the combination code "0001.0005.006", "." is the interval symbol, and "0001", "0005" and "0006" are object codes. The "." interval symbol is used to isolate different object codes to avoid multiple object codes sticking together and being confused as one object code.

[0065] S206, report the information of the target collection object and the combined code; wherein the combined code is used for information processing of the information of the target collection object.

[0066] The information of the target collection object is used to represent the running condition of the target collection object, for example, the user stays in the target collection object for a long time, the related event information when the target collection object is running, and the like.

[0067] Specifically, the application end reports the combined code and the information of the target collection object after determining the combined code. After the combined code is reported, the processing end uses the combined code to process the information of the target collection object. The processing manner of the embodiment of the present application is not limited, for example, it can be log generation, big data analysis, and the like.

[0068] In one embodiment, the processing end is a device for implementing a log management system.

[0069] In one embodiment, the processing end converts the combined code into a log that describes the combined code information in a language form. It can be understood that describing the combined code information in a language form can make the person or program analyzing the log not need to focus on the coding specification, thereby achieving intuitive and decoupling effects.

[0070] In one embodiment, the application end reports the combined code to the processing end, the processing end confirms the mapping relationship between the object codes and the object names of the collection objects of multiple levels in the coding mapping table, and converts each object code in the combined code into the corresponding object name according to the coding mapping table to generate the collection log.

[0071] The above data collection method collects information of the collection objects involved in the running process of the target application program; the target application program includes collection objects of multiple levels, and each collection object has a unique corresponding object code. When collecting information of the target collection object, a combined code with a hierarchical structure is determined; the combined code is generated by combining the object code of the target collection object and the object code of the dependent collection object; the level of the dependent collection object is higher than the level of the target collection object, and the dependent collection object and the target collection object have a running dependency relationship. In this way, the combined code indicates the collection objects with the running dependency relationship and the hierarchical structure that have been involved, forming complete data link information. The information of the target collection object and the combined code are reported; wherein the combined code is used for information processing of the information of the target collection object. In this way, while analyzing the information of the target collection object, complete data link information can be obtained, without manual backtracking and accurate data, thereby improving the data analysis efficiency of the collected data.

[0072] In an embodiment, the reporting the information of the target collection object and the combined code comprises: reporting the information of the target collection object and the combined code to a processing end, so that the processing end performs the following processing: determining a code mapping table corresponding to the combined code, the code mapping table comprising a mapping relationship between object codes and object names of collection objects of multiple levels; converting each object code in the combined code into a corresponding object name based on the code mapping table, and generating a collection log according to the converted object name and the information of the target collection object.

[0073] Specifically, the application end reports the information of the target collection object and the combined code to the processing end. The processing end receives the combined code; and determines a code mapping table corresponding to the combined code. The code mapping table comprises a mapping relationship between object codes and object names of collection objects of multiple levels. The processing end converts each object code in the combined code into a corresponding object name based on the code mapping table, and generates a collection log according to the converted object name and the information of the target collection object.

[0074] In the embodiment, each object code in the combined code is converted into a corresponding object name based on the code mapping table, and a collection log is generated according to the converted object name and the information of the target collection object, so that the information of the combined code is described in the form of language, and an analyzer or a program analyzing the log does not need to focus on the code specification, thereby achieving intuitive and decoupling effects.

[0075] In an embodiment, the code mapping table is obtained from a coding end. The coding end is configured to: confirm object codes of collection objects of multiple levels; and establish a mapping relationship between object names and corresponding object codes of the collection objects of multiple levels, so as to generate and store the code mapping table.

[0076] Specifically, the code mapping table is obtained from the coding end. The coding end confirms object codes of collection objects of multiple levels involved in a running process of a target application program. A mapping relationship between object names and corresponding object codes of the collection objects of multiple levels is established, so as to generate and store the code mapping table.

[0077] In an embodiment, the coding end is a device in a coding system.

[0078] In the embodiment, the object codes are confirmed by the coding end, and the code mapping table is generated and stored, so that the coding end can uniformly, centrally and standardize manage the object codes of the collection objects of different application programs, and problems such as code disorder and loss can be avoided, the maintainability is high, and the processing efficiency of data analysis preparation work is improved. Compared with the previous acquisition of a collection list by manual work to analyze collection data, the processing end can automatically obtain the code mapping table from the coding end, so that the maintainability, accuracy and efficiency of the process of data analysis are higher.

[0079] In an embodiment, the combination encoding of the plurality of hierarchical collection objects is obtained from an encoding end; wherein the encoding end is configured to confirm the object encoding of the plurality of hierarchical collection objects, and determine the combination encoding of the plurality of hierarchical collection objects based on the object encoding of the plurality of hierarchical collection objects; and the determining the combination encoding having the hierarchical structure comprises: screening the combination encoding of the target collection object from the combination encoding of the plurality of hierarchical collection objects.

[0080] Specifically, the application end and the encoding end can interact, the encoding end confirms the plurality of hierarchical collection objects of the application end, further confirms the object encoding of the plurality of hierarchical collection objects, and determines the combination encoding of the plurality of hierarchical collection objects based on the object encoding of the plurality of hierarchical collection objects. In the process of determining the combination encoding having the hierarchical structure, the encoding end can also screen the combination encoding of the target collection object from the combination encoding of the plurality of hierarchical collection objects.

[0081] In the embodiment, the encoding end generates the object encoding of the plurality of hierarchical collection objects, and generates the combination encoding having the hierarchical structure. In this way, the encoding end uniformly manages the generation process of the combination encoding, and achieves the effect of centralized management and standardized management.

[0082] In an embodiment, the information collection of the collection object involved in the running process of the target application program comprises any one of the following processes: when the binding attribute of the collection object involved in the running process of the target application program indicates to perform information collection, performing information collection on the involved collection object; when the information collection code is executed in the running process of the target application program, performing information collection on the corresponding collection object through the information collection code; and in the case that a preset event in the target application program occurs, performing information collection on the collection object corresponding to the preset event.

[0083] Specifically, the information collection of the collection object involved in the running process of the target application program comprises any one of the following processes:

[0084] (1) The collection object has a corresponding binding attribute, which is used to indicate whether information collection is needed. The application end runs the target application program, and when the target application program executes to the collection object, the binding attribute of the collection object is confirmed. In the case where the binding attribute indicates that information collection is needed, the application end collects information of the collection object. For example, the target application program can display a first page and a drop-down box in the first page, and the drop-down box has five drop-down box options. Among them, the binding attributes of the first, second and third drop-down box options are set to collection, and the binding attributes of the fourth and fifth drop-down box options are set to no collection. Then, in the case where the first, second or third drop-down box option is selected, the first, second or third drop-down box option is collected. In the case where the fourth and fifth drop-down box options are selected, the application end determines not to collect information according to the binding attribute of the selected drop-down box option, and then does not collect information of the fourth and fifth drop-down box.

[0085] (2) The target application program further includes information collection code. When the target application program executes to the information collection code, the corresponding collection object is collected by the information collection code. Here, the function of collecting information of a specific collection object is built in the information collection code, and the information collection function is realized by executing the information collection code.

[0086] (3) The target application program further includes a preset event. In the case where the preset event occurs in the target application program, the collection object corresponding to the preset event is collected. For example, in the process of running the target application program, the access, exit, uninstall and other events of the page of the target application program can be preset events, that is, in the case where the access, exit, uninstall and other events of the page occur, the collection object corresponding to the preset event is collected. For another example, the user order success or order failure event can also be a preset event, and so on.

[0087] In the embodiment, each collection object has a corresponding binding attribute, and the application end confirms whether to collect information according to the binding attribute, so that the target application program automatically identifies whether to collect information according to the binding attribute. Such a collection mechanism can be easily adjusted, has low development cost, high maintainability, flexible scheme and wide application. In the embodiment, information collection code can also be used to collect information of the corresponding collection object, so as to centralizedly control the collection objects that can collect information. In the embodiment, when the preset event occurs, the collection object corresponding to the preset event is collected, so that the preset event and the collection object can be associated.

[0088] In one embodiment, the combined encoding further comprises at least one of a channel code of a target traffic channel and a feature code. The target application is triggered to run through the target traffic channel. The target traffic channel is one of an external traffic channel and an internal traffic channel. The external traffic channel is a traffic channel triggering the target application to run through a preset external link. The feature code comprises at least one of an encrypted feature code and an environment feature code. The encrypted feature code is obtained by encrypting a plurality of object codes in the combined encoding. The environment feature code is used to represent an environment parameter when the target object is collected.

[0089] The traffic channel is an intermediary triggering the target application to run. For example, an external program running the target application. The external program can be a traffic channel.

[0090] Specifically, the target application is triggered to run through the target traffic channel. The target traffic channel includes any one of an external traffic channel and an internal traffic channel. The external traffic channel is a traffic channel triggering the target application to run through a preset external link. The combined encoding includes a channel code of the target traffic channel. It can be understood that the traffic channel and the target application also have a running hierarchical relationship because the target application is triggered to run through the traffic channel. The feature code comprises at least one of an encrypted feature code and an environment feature code. The encrypted feature code is obtained by encrypting a plurality of object codes in the combined encoding. The environment feature code is used to represent an environment parameter when the target object is collected.

[0091] For example, the combined encoding "1111 = 123.0009.abcdef.2021.4", wherein "." is a separator, "1111" represents an external traffic channel, and "0000" represents an internal traffic channel. "1111 = 123" means that the external program with channel code "123" calls an external link to trigger the target application "0009" to run. "0009" is the object code of the name of the target application. The page code collected is "abcdef", the block collected is "2021", and the element collected is "4".

[0092] For example, the combined encoding can also be "1111.0009.abcdef.2021.4 / appid = 123", which also means that the external program with channel code "123" calls an external link to trigger the target application "0009" to run. It can be understood that the definition of the combined encoding is various, and it can be identified without confusion.

[0093] For example, in the case that the feature code is used to encrypt the object code, the feature code can be obtained by using a shuffle algorithm, a hash random value, etc. In the case that the feature code is used to represent the environmental parameters when the target acquisition object is information acquisition, for example, the environmental parameter is the acquisition time point, the same button can be selected at 10 am or at 11 am, but the target acquisition object involved is the same, therefore, the target application program can generate two combination codes including different feature codes to distinguish different combination codes.

[0094] In one embodiment, the application end can report the combination code and the channel code of the target traffic channel separately and simultaneously. For example, "1111 = 123.0009.abcdef.2021.4" and "appid = 123" are reported simultaneously, which can also indicate that the external program calls the external link to trigger the running of the target application program "0009" through the channel code "123". It can be understood that the reporting methods are various, and it is enough to be able to identify and not to be confused.

[0095] In the embodiment, the combination code includes the channel code of the target traffic channel, so that the traffic channel information can be acquired simultaneously when the target acquisition object is traced back, and the traffic channel tracking, traffic channel positioning and evaluation of the value of the traffic channel can be performed. The combination code further includes the feature code, which can be at least one of the encrypted feature code and the environmental feature code, used to encrypt the combination code to prevent tampering, and can also be used to represent the environmental parameters to provide more acquisition related information, thereby enriching the information amount of the combination code.

[0096] In one embodiment, the hierarchy of the target application program includes at least one of a program hierarchy, a page hierarchy, a page block hierarchy and a page element hierarchy; and the order of combination of the object codes in the combination code is determined according to the hierarchical relationship between the respective acquisition objects corresponding to the combination code.

[0097] The program hierarchy is used to represent the hierarchy in which the program runs, the page hierarchy is used to represent the hierarchy in which the page runs, the page block hierarchy is used to represent the hierarchy in which the page block runs, and the page element hierarchy is used to represent the hierarchy in which the page element runs. For example, the hierarchy of the home page and the next level sub-page of the target application program can be the page hierarchy, the hierarchy of the navigation bar region in the home page can be the page block hierarchy, the first button of the navigation bar region can be the target element, and the hierarchy can be the page element hierarchy.

[0098] Specifically, the hierarchy of the target application program includes at least one of a program hierarchy, a page hierarchy, a page block hierarchy, and a page element hierarchy. The order of combining the respective object codes in the combined code is determined according to the hierarchical relationship between the respective collection objects corresponding to the combined code.

[0099] In the embodiment, the hierarchy is divided into a program hierarchy, a page hierarchy, a page block hierarchy, and a page element hierarchy, and the hierarchical relationship between the respective collection objects is used to determine the order of combining the respective object codes in the combined code. In this way, when processing the combined code, the hierarchical relationship between the respective collection objects can be determined according to the order of appearance of the respective object codes in the combined code, so that the hierarchical backtracking is performed, the effect is simple, and the error rate of backtracking is greatly reduced. Moreover, the obtained combined code can be directly backtracked to the page operation record, without manually collecting multiple page operation records for backtracking, thereby improving the accuracy and simplicity of data analysis.

[0100] In one embodiment, the encoding end also manages the encoding specification. It can be guaranteed that the specifications of all applications in the same application or the same company are consistent. For example, the encoding specification can be as follows: "1111" represents an external traffic channel, and "0000" represents an internal traffic channel. The object code length corresponding to the name of the target application program is 4 bits in the form of pure numbers, such as "0003". The object code corresponding to the page is generated by a specific algorithm or manually generated, the object code of each page under an application program is unique, composed of letters and numbers, and the length is 6 bits, such as the homepage code "a21bo3" and the commodity list page code "f73op3". The object code corresponding to the block is a dynamic value, the block code of the same page is unique, composed of numbers or letters, and the length is 4 bits, such as the homepage navigation bar channel code "i001". The object code corresponding to the element is a dynamic value, which needs to be guaranteed to be unique in the same page and the same block, the length is not limited, and composed of incremental pure numbers, that is, the elements are assigned in the form of 1, 2, 3, … 99. It can be understood that the encoding specification is provided by the encoding end, so as to play a unified and standardized management role in the encoding of multiple different application programs, and the encoding preparation work for data analysis is orderly, controllable, and manageable.

[0101] The target code calculated based on the coding specification of the coding end is normative. For example, assuming that the object code of the target application in the Android system is 0001, and the object code of the target application in the computer is 0009. For the combined code "0000.0001.a21bo3.asuv.3", it indicates that the target application from the Android system is run (understandably, clicked) at the third element of the page code a21bo3 and the page block asuv. For "1111.0009.abcdef.2021.4 / appid=fqtqekwetagad" or "1111.0009.abcdef.2021.4" and "appid=fqtqekwetagad", it indicates that the target application in the computer is triggered to run by the channel code "fqtqekwetagad" (the channel code of the traffic channel), and the fourth element of the page code abcdef and the page block 2021 is run.

[0102] In one embodiment, before the information collection of the collection object involved in the running of the target application, the coding end is further configured to: display a coding definition interface; in response to an application selection operation input in the coding definition interface, determine the selected target application; the target application is an application supporting display of multiple different pages; confirm any one target page selected from different pages as a collection object, and generate a page object code of the target page; in the case of displaying the target page, in response to a block selection operation for the target page, confirm the selected target block as a collection object, and generate a corresponding block object code; in response to an element selection operation for the target block, confirm the selected target element as a collection object, and generate a corresponding element object code.

[0103] Specifically, the target application is an application supporting display of multiple different pages. The coding end displays a coding definition interface to assist the user in selecting a collection object for the target application. In response to an application selection operation input in the coding definition interface, the selected target application is determined. Any one target page selected from different pages is confirmed as a collection object, and a page object code of the target page is generated. In the case of displaying the target page, in response to a block selection operation for the target page, the selected target block is confirmed as a collection object, and a corresponding block object code is generated. In response to an element selection operation for the target block, the selected target element is confirmed as a collection object, and a corresponding element object code is generated. It can be understood that the user can return to other target pages with set collection objects until the user confirms that the coding definition is complete.

[0104] In the embodiment, when a target application is selected as a collection object by using the code definition interface, a target page of the target application is simultaneously displayed, so as to facilitate a user to select the collection object and improve the simplicity and reduce the error rate of code definition.

[0105] In one embodiment, a data collection system is provided, which includes a code system, a log management system and a data analysis system. Specifically, as shown in Figure 3 In the process of using the data collection system, a relevant person defines codes according to an operation scheme by using a code definition interface provided by the code system. The code system generates a code mapping table according to a code definition result and manages code definition results of a plurality of different applications. It can be understood that the code definition results of different applications are managed by the code system, so as to form a unified data collection specification. The code system also provides the code definition result to a developer for developing a point-in-time of the application. When the application runs, data is collected, and information of a combined code and a target collection object is reported to the log management system. The log management system generates a collection log according to the information of the combined code and the target collection object, and performs log storage, log supplement and log classification and the like. The data analysis system obtains the log from the log management system, and performs data modeling and data reporting to analyze the log, and a relevant person makes data application according to a data analysis result. It can be understood that, due to the characteristics of the log such as traceability and accurate positioning, the data analysis system can obtain more abundant, perfect and accurate data models and data reports than a traditional data collection method, so as to promote the relevant person to make more accurate and effective data application decisions.

[0106] In one embodiment, the code system provides a code definition page to code the application. After the coding is completed, the developer develops the point-in-time of the application end based on the coding of the application. When the application end runs the application, the application reports the target code to the log management system of the processing end. Specifically, as shown in Figure 4As shown, the user logs in the coding definition interface provided by the coding system, and selects an application on the coding definition interface. The coding system confirms the selected application, and displays the page of the application, and generates the application object code corresponding to the application. The user selects a block on the application page, and the coding system confirms the selected block on the application page, and generates the block object code corresponding to the block. If the block is selected to support displaying the block page, when the user selects to enter the block page corresponding to the block, the coding system displays the block page. The user selects an element on the block page, and the coding system confirms the selected element on the block page, and generates the element object code corresponding to the element. It can be understood that the user can select different levels of pages and select different levels of blocks, elements, etc. to perform coding in a hierarchical manner, or can re-rollback the page and then enter it to define new block object codes or element object codes. Finally, after the user confirms that the coding definition is completed, the coding system generates a complete coding definition result corresponding to the application. After the developer obtains the coding definition result corresponding to the application from the coding system, the developer performs the point embedding development on the application side. After the application on the application side runs, the combined code specified by the coding definition result is reported to the processing side. The log management system of the processing side receives the combined code, obtains the coding mapping table from the coding system, and converts the combined code into the collection log for storage. The data analysis system of the processing side obtains the collection log of the log management system, and analyzes the data.

[0107] In one embodiment, the application side stores the running record of the application into the log when the application runs, to collect information for reporting. For example, as shown in Figure 5 The application is an application that can display a page, and the running record of the application can include the operation of the user on the page. Specifically, after the application is started, an application start log can be added. When entering the page of the application, a page entry log can be added. If the page is not exited and an operation is performed on the page, a page operation log can be added. If the page is exited and the next page is entered, a page exit log can be added. If the application is exited, an application exit log is added and the application is closed. If the application is not exited, and the page is returned or redirected, a page unloading log can be added, and the like. It can be understood that when the log is added, the combined code can be generated at the same time, and reported to the processing side, or when the log is added, the combined code can be generated only when the reporting condition is met, which is not limited.

[0108] In one embodiment, the application side caches a plurality of combined codes to be reported (which can also include the information of the collection object corresponding to the combined code), and waits for the centralized reporting condition to be met, and then reports the plurality of combined codes to the processing side at the same time. Specifically, as shown in Figure 6As shown, the application end can sequentially put multiple combination encodings to be reported into a local log to cache multiple combination encodings to be reported. After the application end prepares to start collection, it is determined whether the local log storing combination encodings exists. If the log exists, the application end waits to add combination encodings. If the log does not exist, the application end creates a log storing combination encodings. When the collection requirement is met, the application end generates a combination encoding and adds the combination encoding to the log. The application end determines whether the number of combination encodings in the log reaches a preset number of combination encodings. If the number of combination encodings reaches the preset number of combination encodings, the application end reports the multiple combination encodings in the log and clears the log. If the number of combination encodings does not reach the preset number of combination encodings, the application end determines whether a preset reporting time is reached. If the preset reporting time is reached, the application end reports the multiple combination encodings in the log and clears the log. After the log is cleared or without reporting combination encodings, the application end continues to wait to add combination encodings and repeatedly executes the adding of combination encodings and subsequent steps. It can be understood that the application end caches multiple combination encodings to be reported and reports the combination encodings to the processing end only when the number condition or the time condition is met, thereby relieving the processing pressure of the processing end and improving the overall performance of the data collection system. It can be understood that the application end can also put the information of the target collection object corresponding to the combination encoding into the log, which is not limited.

[0109] It should be understood that, although each step in the flowchart in some embodiments of the present application is shown in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise specified herein, the execution of these steps is not strictly limited in sequence, and these steps can be executed in other sequences. Moreover, at least part of the steps in the flowchart can include multiple steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of these steps or stages is not necessarily sequential, but can be alternately executed with at least part of other steps or steps or stages in other steps.

[0110] Based on the same inventive concept, the embodiments of the present application also provide a data collection device for implementing the above-mentioned data collection method. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above method, so the specific limitations in one or more data collection device embodiments provided below can refer to the limitations of the data collection method in the above text, which will not be repeated here.

[0111] In one embodiment, as shown in Figure 7 A data collection system 700 is provided, including an application end 702 and a processing end 704, the application end 702 running a target application program;

[0112] The application end 702 is configured to collect information of a target collection object involved in a running process of a target application; the target application includes a plurality of hierarchical collection objects, each of which has a unique object code; when collecting information of the target collection object, a combined code with a hierarchical structure is determined; the combined code is generated by combining the object code of the target collection object and the object code of a dependent collection object; the dependent collection object has a higher level than the target collection object, and the dependent collection object has a running dependency relationship with the target collection object; the information of the target collection object and the combined code are reported to the processing end 704; wherein the combined code is used for information processing of the information of the target collection object.

[0113] The processing end 704 is configured to receive the information of the target collection object and the combined code, and use the combined code to process the information of the target collection object.

[0114] In one embodiment, the processing end is further configured to determine a code mapping table corresponding to the combined code, the code mapping table including a mapping relationship between the object codes and object names of the plurality of hierarchical collection objects; convert each object code in the combined code into a corresponding object name based on the code mapping table, and generate a collection log according to the converted object name and the information of the target collection object.

[0115] In one embodiment, the code mapping table is obtained from a coding end; the coding end is configured to confirm the object codes of the plurality of hierarchical collection objects; establish a mapping relationship between the object names and the corresponding object codes of the plurality of hierarchical collection objects, to generate and store the code mapping table.

[0116] In one embodiment, the application end is further configured to obtain the combined codes of the plurality of hierarchical collection objects from the coding end; wherein the coding end is configured to confirm the object codes of the plurality of hierarchical collection objects, and determine the combined codes of the plurality of hierarchical collection objects based on the object codes of the plurality of hierarchical collection objects; the application end is further configured to screen the combined code of the target collection object from the combined codes of the plurality of hierarchical collection objects.

[0117] In one embodiment, the application end is further configured to collect information of a collection object involved in a running process of a target application when a binding attribute of the collection object indicates to collect information; collect information of a corresponding collection object through information collection code when the information collection code is executed in the running process of the target application; and collect information of a collection object corresponding to a preset event when the preset event occurs in the target application.

[0118] In an embodiment, the combined encoding further comprises at least one of a channel encoding of a target traffic channel and a feature code; the target application program is triggered to run through the target traffic channel; the target traffic channel is one of an external traffic channel and an internal traffic channel, the external traffic channel is a traffic channel triggering the target application program to run through a preset external link; the feature code comprises at least one of an encrypted feature code and an environment feature code, the encrypted feature code is obtained by encrypting the multiple object encodings in the combined encoding, and the environment feature code is used to represent an environment parameter when the target collection object is collected.

[0119] In an embodiment, the hierarchy of the target application program comprises at least one of a program hierarchy, a page hierarchy, a page block hierarchy, and a page element hierarchy; and the order of the multiple object encodings in the combined encoding when the multiple object encodings are combined is determined according to the hierarchical relationship between the multiple collection objects corresponding to the combined encoding.

[0120] The above data collection system collects information of a collection object involved in running of a target application program; the target application program comprises multiple hierarchical collection objects, and each collection object has a unique object encoding. When collecting information of a target collection object, a combined encoding having a hierarchical structure is determined; the combined encoding is generated by combining the object encoding of the target collection object and the object encoding of a dependent collection object; the hierarchical level of the dependent collection object is higher than that of the target collection object, and the dependent collection object and the target collection object have a running dependency relationship. In this way, the combined encoding indicates the collection objects involved and having the running dependency relationship and the hierarchical structure, forming complete data link information. The information of the target collection object and the combined encoding are reported; the combined encoding is used for information processing of the information of the target collection object. In this way, when the information of the target collection object is analyzed, complete data link information can be obtained, without manual backtracking and accurate data, thereby improving the data analysis efficiency of the collected data.

[0121] The specific limitations of the above data collection system can be referred to the limitations of the above data collection method, which will not be repeated here. Each device in the above data collection system can be realized by software, hardware, and a combination thereof, in whole or in part. Each device can be embedded in or independent of a processor in a computer device in hardware form, or stored in a memory in a computer device in software form, so as to be called and executed by a processor to perform the operations corresponding to each device.

[0122] In an embodiment, a computer device is provided, which can be a terminal, and an internal structure diagram of the computer device can be as shown in Figure 8The computer device shown in the figure includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capability. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operating system and the computer program in the non-volatile storage medium to run. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner. The wireless manner can be realized through WIFI, mobile cellular network, NFC (near field communication) or other technologies. The computer program is executed by the processor to realize a data acquisition method. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball or touchpad arranged on the shell of the computer device. It can also be an external keyboard, touchpad or mouse, etc.

[0123] Those skilled in the art can understand that, Figure 8 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0124] In one embodiment, a computer device is also provided, including a memory and a processor, the memory storing a computer program, and the processor executing the computer program to realize the steps in each of the above method embodiments.

[0125] In one embodiment, a computer readable storage medium is provided, which stores a computer program, and the computer program is executed by a processor to realize the steps in each of the above method embodiments.

[0126] In one embodiment, a computer program product is provided, including a computer program, and the computer program is executed by a processor to realize the steps in each of the above method embodiments.

[0127] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by a computer program instructing relevant hardware, and the computer program can be stored in a non-volatile computer readable storage medium. When the computer program is executed, it can include the processes of the above-mentioned embodiments of each method. In the embodiments provided in the present application, any reference to memory, storage, database or other medium can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration but not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0128] The technical features of the above embodiments can be combined in any way. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, but as long as the combination of the technical features does not exist, it should be considered as the scope of the present application.

[0129] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent. It should be pointed out that for those skilled in the art, without departing from the concept of the present application, some modifications and improvements can be made, which are all within the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A data acquisition method, characterized by, The method comprises: information collection on a target application running process involved collection object; the target application comprises a plurality of hierarchical collection objects, each collection object has a unique object code corresponding to the object; when the target collection object is collected, a combination code with a hierarchical structure is determined; the combination code is generated by combining the object code of the target collection object and the object code of the dependent collection object; the hierarchical level of the dependent collection object is higher than that of the target collection object, and the dependent collection object has a running dependent relationship with the target collection object; the hierarchical level of the target application includes at least one of the program level, the page level, the page block level and the page element level; the order of combination of each object code in the combination code is determined according to the hierarchical relationship between each collection object corresponding to the combination code; reporting the information of the target collection object and the combination code; wherein the combination code is used for information processing of the information of the target collection object; obtaining the combination code of the plurality of hierarchical collection objects from the encoding end; wherein the encoding end is used to confirm the object code of the plurality of hierarchical collection objects, and to determine the combination code of the plurality of hierarchical collection objects based on the object code of the plurality of hierarchical collection objects; the determination of the combination code with hierarchical structure comprises: screening the combination code of the target collection object from the combination code of the plurality of hierarchical collection objects.

2. The method of claim 1, wherein, the reporting of the information of the target collection object and the combination code comprises: reporting the information of the target collection object and the combination code to the processing end, so that the processing end performs the following processing: determining the encoding mapping table corresponding to the combination code, the encoding mapping table comprising the mapping relationship between the object code and the object name of the plurality of hierarchical collection objects; based on the encoding mapping table, converting each object code in the combination code into the corresponding object name, and generating the collection log according to the converted object name and the information of the target collection object.

3. The method of claim 2, wherein, the encoding mapping table is obtained from the encoding end; the encoding end is used to: confirm the object code of the plurality of hierarchical collection objects; establish the mapping relationship between the object name and the corresponding object code of the plurality of hierarchical collection objects, to generate and store the encoding mapping table.

4. The method of claim 1, wherein, the information collection on the target application running process involved collection object comprises any one of the following processing: when the binding attribute of the collection object involved in the target application running process indicates information collection, the collection object involved is collected; when the information collection code is executed in the target application running process, the corresponding collection object is collected through the information collection code; in the case of a preset event in the target application, the collection object corresponding to the preset event is collected.

5. The method according to any one of claims 1 to 4, characterized in that, the combination code further comprises at least one of the channel code of the target traffic channel and the feature code; The target application program is triggered to run through the target traffic channel; the target traffic channel is one of an external traffic channel and an internal traffic channel, and the external traffic channel is a traffic channel for triggering the target application program to run through a preset external link; The feature code includes at least one of an encrypted feature code and an environment feature code, the encrypted feature code is obtained by encrypting a plurality of object encodings in the combined encoding, and the environment feature code is used to represent an environment parameter when information of the target collection object is collected.

6. A data acquisition system characterized by, The system comprises an application end and a processing end, and the application end runs a target application program; The application end is configured to collect information of a collection object involved in a running process of a target application program; the target application program comprises a plurality of hierarchical collection objects, each collection object has a unique object encoding, a combined encoding with a hierarchical structure is determined when information of a target collection object is collected, the combined encoding is generated by combining an object encoding of the target collection object and an object encoding of a dependent collection object, the hierarchical level of the dependent collection object is higher than that of the target collection object, and the dependent collection object has a running dependency relationship with the target collection object; and the information of the target collection object and the combined encoding are reported to the processing end; wherein the combined encoding is used for information processing of the information of the target collection object; the hierarchical level of the target application program comprises at least one of a program hierarchical level, a page hierarchical level, a page block hierarchical level, and a page element hierarchical level; and the order of combination of each object encoding in the combined encoding is determined according to the hierarchical relationship between each collection object corresponding to the combined encoding. The processing end is configured to receive the information of the target collection object and the combined encoding, and perform information processing on the information of the target collection object based on the combined encoding. The application end is further configured to obtain the combined encoding of the plurality of hierarchical collection objects from an encoding end; wherein the encoding end is configured to confirm object encodings of the plurality of hierarchical collection objects, and determine the combined encoding of the plurality of hierarchical collection objects based on the object encodings of the plurality of hierarchical collection objects; and the determination of the combined encoding with a hierarchical structure comprises screening the combined encoding of the target collection object from the combined encoding of the plurality of hierarchical collection objects.

7. The system of claim 6, wherein, The processing end is further configured to report the information of the target collection object and the combined encoding to the processing end, so that the processing end performs the following processing: determining an encoding mapping table corresponding to the combined encoding, the encoding mapping table comprising a mapping relationship between object encodings and object names of the plurality of hierarchical collection objects; converting each object encoding in the combined encoding into a corresponding object name based on the encoding mapping table, and generating a collection log according to the converted object name and the information of the target collection object.

8. The system of claim 7, wherein, The encoding mapping table is obtained from an encoding end; the encoding end is used to confirm object encoding of the multiple levels of collection objects; a mapping relationship between object names of the multiple levels of collection objects and corresponding object encodings is established to generate and store the encoding mapping table. 9.A computer device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer device is configured to perform the method according to any one of claims 1-8 when the computer program is executed by the processor. The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 5.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program, when executed by the processor, implements the steps of the method of any one of claims 1 to 5.

Images