Data acquisition method, device, equipment and storage medium

Abstract

Embodiments of the present application relate to the technical field of data collection, in particular to a data collection method and device, equipment and storage medium, aiming to ensure the security of data collection. The method comprises: when detecting that a current data request is sent by a user terminal through any interface, detecting whether there is unreported collection result data stored in the user terminal, the collection result data being specified data on the user terminal collected by the user terminal interacting with the server through the interface corresponding to the last data request; when the user terminal stores unreported collection result data, adding the collection result data and the instruction identifier corresponding to the collection result data to the current data request, the instruction identifier being the identifier of the data collection instruction corresponding to the collection result data; and sending the current data request carrying the collection result data and the instruction identifier corresponding to the collection result data to the server through the interface corresponding to the current data request.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of data processing, in particular, to a data collection method and device, equipment and storage medium. BACKGROUND

[0002] In the process of using an application program by a user, a service party of the application program often needs to collect a large amount of application program related data of the user when using the application program, and then judges the state of the application program according to the collected application program related data, which provides an important basis for upgrading and perfecting the application program and is conducive to optimizing the user experience of using the application program. The existing application program data remote collection method generally adds data collection logic in the development stage of the application program, triggers the data collection logic in a fixed scene and reports the collected application program data, for example, triggers the collection logic to collect data when the application program starts, triggers the collection logic to collect data when the application program enters a certain module, or triggers the collection logic to collect data manually by the user. After the data collection is completed, the collected application program data is reported to the server through a fixed interface.

[0003] The data collection means of the prior art is centralized and fixed, and the data is reported through a fixed interface when reporting the data, which is very easy to be found by malicious crackers. The malicious crackers can fake the reported data, thereby affecting the accuracy of data analysis. Moreover, the existing data collection means can only collect limited information of the application program, and cannot collect specific application program data, which will collect all the runtime data, consume unnecessary traffic of the user, waste storage space of the server, waste a large amount of resources for screening useful data, and is low in efficiency. SUMMARY

[0004] Embodiments of the present application provide a data collection method, device, equipment and storage medium, which aims to ensure the security of data collection.

[0005] The first aspect of the embodiments of the present application provides a data collection method, characterized in that the method is applied to a user terminal and includes:

[0006] When detecting that the user terminal sends a current data request through any interface, detecting whether there is unreported collection result data stored in the user terminal, the collection result data being specified data on the user terminal collected by the user terminal interacting with the server through an interface corresponding to a previous data request;

[0007] The collection result data and an instruction identifier corresponding to the collection result data are added to the current data request, the instruction identifier being an identifier of a data collection instruction corresponding to the collection result data.

[0008] The current data request carrying the collection result data and the instruction identifier corresponding to the collection result data is sent to the server through an interface corresponding to the current data request, wherein the data request of the user terminal is sent through a random interface.

[0009] Optionally, the method further comprises:

[0010] In response to a user starting an operation of a target application on the user terminal, a device identifier of the user terminal is sent to a server.

[0011] A data collection mark returned by the server is acquired, and user feedback information representing whether to start data collection is acquired based on the data collection mark.

[0012] In response to the user feedback information being permission to start data collection, a data request sent by the user terminal is listened to.

[0013] Optionally, the method further comprises:

[0014] Interface return data corresponding to the current data request sent by the server is received.

[0015] Data collection is performed on the user terminal according to a data collection instruction carried in the interface return data, to obtain collection result data.

[0016] The collection result data is saved.

[0017] Optionally, performing data collection on the user terminal according to the data collection instruction carried in the interface return data comprises:

[0018] The data collection instruction carried in the interface return data is parsed to obtain data collection function information corresponding to the data collection instruction.

[0019] The corresponding data collection function is searched for in the user terminal according to the data collection function information.

[0020] The data collection function is run to perform data collection on the user terminal.

[0021] Optionally, adding the collection result data to the current data request comprises:

[0022] encrypt the collection result data and the instruction identifier corresponding to the collection result data to obtain encrypted collection result data and encrypted instruction identifier;

[0023] add the encrypted collection result data and the encrypted instruction identifier to the parameter of the current data request.

[0024] Optionally, a data object combination is configured for any interface combination, the data object combinations corresponding to each interface combination are not completely same, each data object combination contains object identifiers of at least one data object, each interface combination contains interface identifiers of at least one interface in the user terminal, the data object is any data object requested from the server by a data request sent through any interface;

[0025] For any data request, the interface for sending the data request is randomly determined from a target interface combination, and the target interface combination is an interface combination corresponding to a data request combination where the data request is located.

[0026] The second aspect of the embodiment of the application provides a data collection method, characterized in that the method is applied to a server and comprises the following steps:

[0027] receiving a current data request sent by a user terminal through an interface corresponding to the current data request;

[0028] parsing and saving collection result data in the current data request, the collection result data being specified data on the user terminal collected by the user terminal interacting with the server through an interface corresponding to a previous data request;

[0029] adding a data collection instruction for the target application and a corresponding instruction identifier into interface return data corresponding to the current data request;

[0030] sending the interface return data carrying the data collection instruction and the instruction identifier to the user terminal through the interface corresponding to the current data request, wherein the data request of the user terminal is sent through a random interface.

[0031] Optionally, the method further comprises:

[0032] receiving a device identifier sent by a user terminal, determining a data collection instruction and an instruction identifier needed to be sent to the user terminal according to the device identifier;

[0033] sending a data collection inquiry mark to the user terminal, the data collection inquiry mark being used to inquire the user whether to start data collection.

[0034] Optionally, the data collection instruction and the instruction identifier required to be sent to the user terminal are determined according to the device identifier, comprising:

[0035] According to the device identifier, a data collection task for the user terminal is determined.

[0036] According to the data collection task, the data collection instruction and the instruction identifier are determined.

[0037] Optionally, the collection instruction for the target application and the corresponding instruction identifier are added into the interface return data corresponding to the current data request, comprising:

[0038] The data collection instruction and the instruction identifier are encrypted to obtain an encrypted data collection instruction and an encrypted instruction identifier.

[0039] The encrypted data collection instruction and the encrypted instruction identifier are added into the interface return data.

[0040] The third aspect of the embodiments of the application provides a data collection device, characterized in that the device is applied to a user terminal, comprising:

[0041] A collection result data detection module is configured to detect whether the user terminal stores unreported collection result data of the target application when detecting that the user terminal sends a current data request through any interface, wherein the collection result data is specified data on the user terminal collected by the user terminal interacting with the server through an interface corresponding to a previous data request.

[0042] A collection result data adding module is configured to add the collection result data and an instruction identifier corresponding to the collection result data into the current data request when the user terminal stores unreported collection result data, wherein the instruction identifier is an identifier of a data collection instruction corresponding to the collection result data.

[0043] A collection result data sending module is configured to send the current data request carrying the collection result data and the instruction identifier corresponding to the collection result data to the server through an interface corresponding to the current data request, wherein the data request of the user terminal is sent through a random interface.

[0044] Optionally, the device further comprises:

[0045] A device identifier sending module is configured to send a device identifier of the user terminal to the server in response to a user starting an operation of a target application on the user terminal.

[0046] The data collection mark receiving module is configured to acquire the data collection mark returned by the server and acquire user feedback information indicating whether to start data collection based on the data collection mark.

[0047] The data request monitoring module is configured to monitor a data request sent by the user terminal in response to the user feedback information indicating that data collection is allowed to start.

[0048] Optionally, the apparatus further comprises:

[0049] The interface return data receiving module is configured to receive interface return data corresponding to the current data request sent by the server.

[0050] The data collection module is configured to collect data of the user terminal according to a data collection instruction carried in the interface return data to obtain collected result data.

[0051] The collected result data saving module is configured to save the collected result data.

[0052] Optionally, the data collection module comprises:

[0053] The collection instruction analyzing submodule is configured to analyze the data collection instruction carried in the interface return data to obtain data collection function information corresponding to the data collection instruction.

[0054] The collection function searching submodule is configured to search for a corresponding data collection function in the user terminal according to the data collection function information.

[0055] The data collection submodule is configured to run the data collection function to collect data of the user terminal.

[0056] Optionally, the collected result data adding module comprises:

[0057] The data encryption submodule is configured to encrypt the collected result data and an instruction identifier corresponding to the collected result data to obtain encrypted collected result data and encrypted instruction identifier.

[0058] The data adding submodule is configured to add the encrypted collected result data and the encrypted instruction identifier to parameters of the current data request.

[0059] Optionally, a data object combination is configured for any interface combination, the data object combinations corresponding to each interface combination are not completely identical, each data object combination comprises object identifiers of at least one data object, each interface combination comprises interface identifiers of at least one interface in the user terminal, and the data object is any data object requested from the server by a data request sent through any interface.

[0060] For any data request, the interface used to send the data request is randomly determined from a target interface combination, where the target interface combination is the interface combination corresponding to the data request combination in which the data request is located.

[0061] A fourth aspect of this application provides a data acquisition device, characterized in that the device 5 is applied to a server and includes:

[0062] The data request receiving module is used to receive the current data request sent by the user terminal through the interface corresponding to the current data request;

[0063] The data collection result parsing module is used to parse and save the data collection result data in the current data request. The data collection result data is: the user terminal interacts with the server through the interface corresponding to the previous data request, and then collects the specified data on the user terminal.

[0064] The data acquisition instruction adding module is used to add the data acquisition instruction for the user terminal and the corresponding instruction identifier to the interface return data corresponding to the current data request;

[0065] The interface returns a data sending module, which is used to send data through the interface corresponding to the current data request.

[0066] The interface, carrying the data acquisition command and the command identifier, returns data to the user terminal; wherein the user terminal's data request is sent through a random interface.

[0067] Optionally, the device further includes:

[0068] The device identifier receiving module receives the device identifier sent by the user terminal and determines the data acquisition command and command identifier to be sent to the user terminal based on the device identifier.

[0069] The data collection query flag sending module is used to send a data collection query flag to the user terminal. The data collection query flag is used to ask the user whether to start data collection.

[0070] Optionally, the device identifier receiving module includes:

[0071] The data acquisition task determination submodule is used to determine the data acquisition task for the user terminal based on the device identifier;

[0072] The data acquisition instruction determination submodule uses a function to determine the data acquisition instruction and the instruction identifier based on the data acquisition task.

[0073] Optionally, the data collection instruction adding module comprises:

[0074] a data collection instruction encryption sub-module, configured to encrypt the data collection instruction and the instruction identifier, to obtain encrypted data collection instruction and encrypted instruction identifier;

[0075] a data collection instruction adding sub-module, configured to add the encrypted data collection instruction and the encrypted instruction identifier into the interface return data.

[0076] The fifth aspect of the embodiment of the present application provides a readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps in the method of the first aspect of the present application.

[0077] The sixth aspect of the embodiment of the present application provides an electronic device, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the method of the first aspect of the present application when executing the computer program.

[0078] The data collection method provided by the present application is used on a user terminal, when it is detected that the user terminal sends a current data request through any interface, it is detected whether there is unreported collection result data stored in the user terminal, the collection result data is specified data on the user terminal collected by the user terminal interacting with the server through the interface corresponding to the last data request; when the user terminal stores unreported collection result data, the collection result data and an instruction identifier corresponding to the collection result data are added to the current data request, the instruction identifier is an identifier of a data collection instruction corresponding to the collection result data;

[0079] The current data request carrying the collection result data and the instruction identifier corresponding to the collection result data is sent to the server through the interface corresponding to the current data request, wherein the data request of the user terminal is sent through a random interface. When the user terminal sends a data request, the data collected for a target application when last interacting with the server is added to the current data request for data reporting. Since each data request sent by the user terminal is random, the corresponding interface is also random, and therefore the data interface used by the collected application program is random each time, so it is not easy to be found by malicious crackers, thereby increasing the security of data reporting and ensuring the accuracy of data analysis.

[0080] On the server side, the current data request sent by the user terminal through the interface corresponding to the current data request is received; the collection result data in the current data request is parsed and saved, the collection result data is the specified data on the user terminal collected by the user terminal interacting with the server through the interface corresponding to the previous data request; the data collection instruction for the target application and the corresponding instruction identifier are added into the interface return data corresponding to the current data request; the interface return data carrying the data collection instruction and the instruction identifier is sent to the user terminal through the interface corresponding to the current data request. When the server receives the data request sent by the user terminal, the collection instruction data for the target application is added into the interface return data corresponding to the current request, the corresponding data of the target application can be collected by the user terminal through the collection instruction data, the data needed to be used can be collected, the additional traffic of the user is not consumed, the collected data does not need to be screened, the resources of the server are saved, and the efficiency of data collection is improved. BRIEF DESCRIPTION OF DRAWINGS

[0081] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0082] Figure 1 is a flow chart of a data collection method according to an embodiment of the present application;

[0083] Figure 2 is a flow chart of a data collection method according to an embodiment of the present application;

[0084] Figure 3 is a schematic diagram of a data collection device according to an embodiment of the present application;

[0085] Figure 4 is a schematic diagram of a data collection device according to an embodiment of the present application. DETAILED DESCRIPTION

[0086] The technical solutions of the embodiments of the present application will be described clearly and completely in the following description of the embodiments of the present application with reference to the drawings. Obviously, the described embodiments are some embodiments of the present application, not all embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0087] Reference Figure 1 ,Figure 1 is a flowchart of a data collection method proposed by an embodiment of the present application, which is applied to a user terminal. As shown in Figure 1 includes the following steps:

[0088] S11: When detecting that the user terminal sends a current data request through any interface, detecting whether there is unreported collection result data in the user terminal, the collection result data being specified data on the user terminal collected by the user terminal interacting with the server through an interface corresponding to a previous data request.

[0089] In this embodiment, the data request is protocol information sent by the user terminal to the server for obtaining certain resource data, and the server returns corresponding data according to the content of the request when receiving the data request sent by the user terminal. The collection result data is related data collected by the user terminal according to the collection instruction of the server when the target application program runs, and the interface is the address of the request. When the application program on the user terminal runs, the user terminal sends a data request to the server through a random interface, and the server sends corresponding data to the interface address after receiving the data request, thereby realizing the interaction between the server and the user terminal.

[0090] In this embodiment, the user terminal listens to each data request sent by the user terminal. When detecting that the user terminal sends a request each time, it is detected whether there is unreported collection result data in the user terminal at the current time. The unreported collection result data is specified data on the user terminal collected by the user terminal according to the collection instruction data sent by the server when the user terminal interacts with the server last time.

[0091] In this embodiment, the SDK (software development kit) is connected to the application program, and a listening module is added in the SDK. The listening module realizes the listening to each data request sent by the user terminal. By connecting the SDK to the application program on the user terminal, various different functions can be added to the target application. The functions can be added by the user as needed.

[0092] For example, the user terminal can be a PC terminal, a mobile terminal such as a mobile phone and a tablet computer, etc. The target application program is any APP running on the user terminal. When the target application program is a shopping APP, the user clicks the picture of a certain commodity on the shopping page to view the detailed information of the commodity. At this time, the user terminal sends a data request for the detailed information of the commodity to the server. The listening module in the target application program detects that the user terminal sends a data request, and starts to detect whether there is unreported collection result data in the user terminal.

[0093] S12: When the user terminal has unreported collection result data stored therein, adding the collection result data and an instruction identifier corresponding to the collection result data to the current data request, the instruction identifier being an identifier of a data collection instruction corresponding to the collection result data.

[0094] In the embodiment, when it is detected that the user terminal has unreported collection result data stored therein, the collection result data is added to the current request data, and an instruction identifier corresponding to the collection result data is added to the current data request.

[0095] In the embodiment, a logic is added to the pre-accessed SDK, the logic being to intercept each data request sent by the user terminal, and when the data collection or the specified logic is completed, adding the collection result data to the parameters of the next data request. After the SDK is accessed to the target application, the target application executes the corresponding logic, and when it is detected that the user terminal has unreported collection result data stored therein, the unreported collection result data, i.e., the collection result data generated by the user terminal in the last interaction with the server, is added to the current request data. The user terminal also adds an instruction identifier corresponding to the collection result data to the current request data, the instruction identifier being an identifier of the current data collection task, and through the instruction identifier, the server can associate the data collection task with the collected data.

[0096] In the embodiment, the collection result data and the corresponding instruction identifier are added to the parameters of the current request in a pre-set form. For example, a specified field for the collection result data and the corresponding instruction identifier can be added to the data protocol of the current data request parameter.

[0097] S13: Sending, to the server, the current data request carrying the collection result data and the instruction identifier corresponding to the collection result data through an interface corresponding to the current data request, wherein the data request of the user terminal is sent through a random interface.

[0098] In the embodiment, the user terminal sends, to the server, the current data request carrying the collection result data through a data interface corresponding to the current data request.

[0099] In this embodiment, by setting in the application, when the user terminal sends a data request to the server, each data request can be sent through a random interface, when the user terminal sends a data request to the server, the collection result data is added to the parameters of the current data request, and is sent to the server through the interface corresponding to the current data request, so that each time the data interface used for reporting the collection result data is random, and an external person cannot crack the data reported by the target application by searching for a data transmission interface, thereby increasing the security of reporting the collected data.

[0100] In another embodiment of the present application, before detecting that the user terminal sends a data request to the server through any interface, the method further comprises:

[0101] S21: In response to the user starting the operation of the target application on the user terminal, sending the device identifier of the user terminal to the server.

[0102] In this embodiment, the device identifier is equivalent to the name of the user terminal, and the device identifier of each user terminal is unique. The server finds the related information of the user terminal by the device identifier of the user terminal. The server pre-stores the device identifier of the user terminal and the data collection task corresponding to the user terminal set by the administrator, and the data collection task is used to collect some runtime data of the application program running on the user terminal.

[0103] For example, the device identifier of the user terminal is the device ID of the user terminal.

[0104] S22: Obtaining the data collection mark returned by the server, and obtaining the user feedback information indicating whether to start data collection based on the data collection mark.

[0105] In this embodiment, the data collection mark is a mark sent by the server to the user terminal to inquire whether to start the data collection function. The user can operate the data collection mark to select whether to start the data collection function. When the user selects to start the data collection function, the target application program starts to control the listening module to listen to each data request sent by the user terminal, and performs the data collection process.

[0106] When the user selects not to start the data collection function, the target application program is normally run, and the data collection reporting process is not performed during the period, and the user terminal does not analyze any instruction from the server.

[0107] In this embodiment, when the user starts the target application, the server sends the data collection mark to the user terminal, and the target application program on the user terminal displays the data collection mark to the user in the interface of the program, and inquires the user whether to allow starting the data collection through the mark.

[0108] 5For example, the data collection mark can be a pop-up window displayed on the opening page of the target application, which has two selection items of yes and no. When the user selects the yes item, the target application starts to listen to each data request sent by the user terminal. When the user selects the no item, the target application normally runs until the user finishes using it, during which no data collection and data reporting activities are performed.

[0109] S23: In response to the user feedback information being permission to start data collection, listening to the data request sent by the user terminal.

[0110] In this embodiment, when the user allows to start data collection, the target application starts to continuously listen to each data request sent by the user terminal.

[0111] In another embodiment of the present application, the method further comprises:

[0112] S31: Receiving the interface return data corresponding to the current data request sent by the server. In this embodiment, the interface return data is the data requested by the data request sent by the user terminal to the server, and the interface return data further carries the collection instruction data and the instruction identifier for the target application.

[0113] In this embodiment, after the user terminal sends the data request to the server, the server sends the interface return data to the corresponding interface on the user terminal according to the sent data request.

[0114] S32: According to the data collection instruction carried in the interface return data, collecting data of the user terminal to obtain collection result data.

[0115] In this embodiment, the data collection instruction is sent by the server to the user terminal, and is an instruction for collecting one or more data of the application program on the user terminal. The data collection instruction includes related information of the target application data to be collected and a data collection function to be used for performing the data collection task.

[0116] In this embodiment, according to the data collection instruction carried in the interface return data, collecting data of the user terminal to obtain collection result data comprises:

[0117] S32-1: Analyzing the data collection instruction carried in the interface return data to obtain the data collection function information corresponding to the data collection instruction.

[0118] In this embodiment, the data acquisition function is a function that collects a specific piece of data from the target application. It can analyze the runtime state of the target application and collect data from the target application during runtime. The data acquisition function information is used to query information about the data acquisition function.

[0119] In this embodiment, when configuring the target application, corresponding data acquisition functions are added in the SDK in advance according to the data acquisition tasks to be performed. These data acquisition functions are registered to the SDK through the message registry. The message registry is used to register the data acquisition functions to the SDK, and the functions in the SDK can be quickly found through the message registry.

[0120] In this embodiment, after the user terminal receives the data returned by the interface, it parses the data collection instruction data carried in the data return by the interface. The parsing obtains the data collection instruction corresponding to the data collection task and the instruction identifier contained in the data collection instruction data. The fields in the data collection instruction contain information about the data to be collected corresponding to the data collection task and information about the data collection function to be used.

[0121] For example, the data acquisition function information includes the function name and other relevant information about the data acquisition function.

[0122] In this embodiment, a corresponding data acquisition function can also be added to the SDK according to the actual business needs. The data acquisition function can be developed independently as needed, and it can collect various information of the target application when it is running on the user terminal.

[0123] S32-2: Based on the data acquisition function information, locate the corresponding data acquisition function in the user terminal.

[0124] In this embodiment, when the data acquisition function information is parsed and obtained, the function is searched in the registry of the target application's SDK based on the data acquisition function information, such as the function name. The registry will pre-record the function name and storage location of each data acquisition function. Based on the function address information in the registry, the corresponding data acquisition function can be found.

[0125] S32-3: Run the data acquisition function to collect data from the user terminal.

[0126] S33: Save the collected data to the user terminal.

[0127] In this embodiment, the collected result data is the relevant data of the target application running on the mobile terminal collected by the data collection function. This data can be the data generated by the target application during runtime, or any data of the target application on the mobile terminal during runtime.

[0128] In this embodiment, after the corresponding data collection function is found, the data collection function is run, data of the target application is collected, and the collected result data is saved to the user terminal, and the instruction identifier corresponding to the data collection task is also saved.

[0129] For example, the collected result data is determined according to the collection target of the data collection task. When the data collection task is to collect the specified function list, function address, etc. of the target application, the collected result data is the specified function list, function address, etc. of the target application when the target application is running on the user terminal. The collected result data can also be the execution result of the specified variable or the specified function, the screenshot of the current device, the version number of the target application, and other related information.

[0130] In another embodiment of the present application, the collected result data is added to the current data request, including:

[0131] S41: The collected result data and the instruction identifier corresponding to the collected result data are encrypted to obtain encrypted collected result data and encrypted instruction identifier.

[0132] In this embodiment, the collected result data and the corresponding instruction identifier are encrypted to obtain encrypted collected result data and encrypted instruction identifier.

[0133] In this embodiment, in order to ensure the security of data transmission, the collected result data and the corresponding instruction identifier are encrypted. There are special modules for encrypting data on the target application of the user terminal and the server. The data encryption module can encrypt ordinary data. Correspondingly, there are modules for analyzing encrypted data on the target application of the user terminal and the server. The data analysis module can analyze encrypted data.

[0134] In this embodiment, the encryption rule for the collected result data and the corresponding instruction identifier is pre-customized. It can be an existing data encryption method or a special encryption rule set for data transmission. When developing the target application, the pre-designed encryption rule is implanted into the data encryption module and the data analysis module.

[0135] S42: The encrypted collected result data and the encrypted instruction identifier are added to the parameters of the current data request.

[0136] In this embodiment, after the collected result data and the instruction identifier corresponding to the data collection task are encrypted, the encrypted collected result data and the encrypted instruction identifier are added to the parameters of the current data request in a specified form.

[0137] In the embodiment, the parameters of the current data request are sent from the mobile terminal to the server through the interface corresponding to the current request. When sending, the collected result data and the instruction identifier are added to the parameters of the current data request in a specified form set in advance, and are sent to the server through the interface corresponding to the current data request, thereby completing the reporting of the data.

[0138] For example, the specified form of adding data can be set in advance. For example, the collected result data and the instruction identifier are added in the form of a field in the data protocol of the parameters of the current data request. In this way, the current collected result data and the instruction identifier can be well hidden and sent in the request parameters.

[0139] Optionally, in the embodiment of the application, a data object combination is configured for any interface combination. The data object combinations corresponding to each interface combination are not completely the same. Each data object combination contains object identifiers of at least one data object. Each interface combination contains interface identifiers of at least one interface in the user terminal. The data object is any data object requested by the server through a data request sent by any interface.

[0140] For any data request, the interface used to send the data request is randomly determined from a target interface combination. The target interface combination is the interface combination corresponding to the data request combination where the data request is located.

[0141] As described above, in the embodiment of the application, the interface used when issuing a data request can be randomly determined. Specifically, the interface used to send the current data request can be randomly determined from all available interfaces of the user terminal. Alternatively, the interface used to send the current data request can be randomly determined from some available interfaces from the perspective of the page, service, type, etc. to which the current request belongs. Alternatively, in actual applications, the data request triggered by the user terminal can be random. For example, the needs of different users are not fixed but change randomly with changes in factors such as the scene, time, and space. Therefore, it can be understood that the data request issued by the user terminal is random to some extent, and therefore the interface used by the user terminal can also be random.

[0142] In the present application, in order to achieve the purpose of interface randomization and to avoid the influence of interface randomization being too large, a data object combination applicable to different interface combinations can be configured in advance, and when a data object is requested from the server through a data request, an interface can be randomly allocated to the data object from the interface combination corresponding to the data object. The data object can be understood as any data object that can be requested from the server through a data request by a user terminal, such as web page data, picture data, audio and video data, etc. Each interface combination can include one or more interfaces, and each data object combination can include one or more data objects. The specific number of each interface combination and each data object combination can not be completely consistent, and can be set to be consistent according to requirements, which is not limited in the embodiments of the present application.

[0143] Reference Figure 2 , Figure 2 is a flowchart of a data collection method according to an embodiment of the present application, and the method is applied to a server. As shown in Figure 2 , the method includes the following steps:

[0144] S51: receiving a current data request sent by a user terminal through an interface corresponding to the current data request.

[0145] In the present embodiment, after the server sends a data request to the user terminal, the server receives the current data request sent by the user terminal through the interface corresponding to the current data request.

[0146] In the present embodiment, after the mobile terminal runs the target application program, the target application program will respond to the user's operation, request the corresponding data from the server, and then send the corresponding data request, which is received by the server.

[0147] S52: parsing and saving the collection result data in the current data request, wherein the collection result data is the specified data on the user terminal collected by the user terminal interacting with the server through an interface corresponding to a previous data request.

[0148] In the present embodiment, when the server receives the current request data sent by the mobile terminal, the collection result data in the request data is parsed, and the parsed collection result data is saved in the server.

[0149] In this embodiment, the server side is previously set with logic at each interface, which parses and decrypts the specified form of the collection result data in the request parameter, decrypts the collection result data through the decryption module in the server side, and determines the collection instruction corresponding to the collection result data through the instruction identification sent by the user terminal. The collection result data can also be analyzed to obtain the corresponding environment information and state information of the application program on the user terminal when running.

[0150] S53: Add the data collection instruction for the target application and the corresponding instruction identification into the interface return data corresponding to the current data request.

[0151] In this embodiment, the server side adds the data collection instruction for the target application and the corresponding instruction identification into the interface return data corresponding to the current data request after receiving the data request.

[0152] In this embodiment, a data collection service is developed on the server side, and the administrator is allowed to configure a certain data collection task of a certain device on the server side. The configured task is executed when the target application runs on the device. Logic is also added on the server side, that is, when the data request sent by the user terminal is received, the data collection instruction and the instruction identification are returned to the user terminal. The server side is set with logic to query the instruction service at each interface request. Through the service, the corresponding collection instruction and instruction identification can be generated when the interface receives the data request sent by the user terminal.

[0153] S54: Send the interface return data carrying the data collection instruction and the instruction identification to the user terminal through the interface corresponding to the current data request.

[0154] In this embodiment, after the data collection instruction and the corresponding instruction identification are added to the interface return data, the interface return data carrying the data collection instruction and the instruction identification is sent to the user terminal through the interface corresponding to the current data request.

[0155] For example, the target application running on the user terminal is a video APP, and the user clicks on the comment area of a certain movie. At this time, the user terminal sends a data request to the server side to request related data of the comment area. After receiving the data request, the server side adds the data collection instruction for the target application and the instruction identification to the returned comment area data. The background of the user terminal receives the data collection instruction and the instruction identification at the same time as receiving the comment area data.

[0156] In the embodiment, the interface of the request received by the server side when the server side and the user terminal interact with each other changes according to different requests, and therefore the interface of the data collection instruction and the instruction identifier issued to the user terminal also changes, thereby ensuring the security of the data collection task, and for the same data collection task, the interface of the data collection instruction is the interface corresponding to the last request, and the interface of the collection result data is the interface corresponding to the current data request, thereby further ensuring the security of the data collection task.

[0157] In another embodiment of the present application, before the server side receives the data request issued by the user terminal, the method further comprises:

[0158] S61: receiving the device identifier sent by the user terminal, and determining the data collection instruction and the instruction identifier required to be sent to the user terminal according to the device identifier.

[0159] In the embodiment, when the user terminal starts the target application, the user terminal sends the device identifier to the server side, and according to the device identifier, the data collection instruction and the instruction identifier required to be sent to the user terminal can be determined, and the specific steps are as follows:

[0160] S61-1: determining the data collection task for the user terminal according to the device identifier.

[0161] In the embodiment, the server side determines the data collection task for the user terminal according to the device identifier of the user terminal.

[0162] In the embodiment, the server side pre-configures the device identifier required to be detected, and when the device identifier is received, for each device, the data required to be detected when the application program runs is pre-configured. According to the device identifier, the pre-configured data collection task can be found.

[0163] S61-2: determining the data collection instruction and the instruction identifier according to the data collection task.

[0164] In the embodiment, according to the data collection task, the data collection instruction and the instruction identifier corresponding to the data collection task can be determined.

[0165] In the embodiment, according to the data collection task, the related information of the data required to be collected by the data collection task and the function name of the data collection function required to be used are determined, and then the data collection instruction and the corresponding instruction identifier are generated.

[0166] S62: sending the data collection inquiry mark to the user terminal, and the data collection inquiry mark is used to inquire the user whether to start data collection.

[0167] In this embodiment, after the server receives the device identifier sent by the user terminal, it is determined that the target application has been started on the user terminal, at which time the data collection inquiry mark is sent to the user terminal, and the data collection inquiry mark is used to inquire the user whether to start data collection.

[0168] In another embodiment of the present application, the collection instruction for the target application and the corresponding instruction identifier are added to the interface return data corresponding to the current data request, including:

[0169] S71: The data collection instruction and the instruction identifier are encrypted to obtain the encrypted data collection instruction and the encrypted instruction identifier.

[0170] In this embodiment, after the server receives the data request sent by the mobile terminal, the corresponding data collection instruction and instruction identifier are generated according to the data collection task of the target application on the mobile terminal sending the data request, and the data collection instruction and the instruction identifier are encrypted to obtain the encrypted data collection instruction and the encrypted instruction identifier.

[0171] In this embodiment, in order to ensure the security of data interaction between the server and the mobile terminal, the data collection instruction and the instruction identifier are encrypted by a pre-specified encryption method.

[0172] S72: The encrypted data collection instruction and the encrypted instruction identifier are added to the interface return data.

[0173] In this embodiment, the server adds the encrypted data collection instruction and the encrypted instruction identifier to the interface return data in a specified form.

[0174] For example, the server can add the encrypted data collection instruction and the encrypted instruction identifier as an encryption field to the data protocol of the interface return data. When the mobile terminal receives the interface return data, it also receives the encryption field in the data protocol. By using the analysis module of the target application to analyze and decrypt the encryption field, the information of the corresponding data collection task can be obtained, and data collection can be performed.

[0175] In another embodiment of the present application, a practical application scenario is used to further illustrate the data collection method proposed in the present application.

[0176] When a target application is installed in a certain device, i.e., a user terminal, a user starts the target application, at this time, the user terminal has a false malicious software installed therein, the malicious software can intercept data sent by the target application to the server and send false data to the server, the software can find an interface for data reporting and intercept data, and affect analysis of the entire device state of the target application running by the server. When the mobile terminal sends a data request, the server adds a data collection instruction and an instruction identifier in the form of an encrypted field to the corresponding interface of the returned data sent to the server, the user terminal parses the collection instruction and performs a data collection task, and saves the collected result data to the local, and sends the result data to the server through another request corresponding interface in the next request, the malicious software can only find a fixed data reporting interface, and cannot accurately find the interface at each data reporting time when the interface is randomly changed, so it cannot intercept data, even if the data is intercepted, the encrypted data cannot be effectively cracked. The collection task of the related data of the target application running on the user terminal can be safely performed.

[0177] It should be noted that the data collection method in the above embodiments can be interacted between the user terminal and the server, and the data collection methods in different embodiments can be mutually referred.

[0178] Based on the same inventive concept, an embodiment of the present application provides a data collection device, which is applied to a user terminal. Referring to Figure 3 , Figure 3 is a schematic diagram of a data collection device 300 according to an embodiment of the present application. As shown in Figure 3 , the device comprises:

[0179] A collection result data detection module 301 is configured to detect whether the user terminal has stored unreported collection result data of the target application when detecting that the user terminal sends a current data request through any interface, the collection result data is specified data on the user terminal collected by the user terminal interacting with the server through an interface corresponding to a previous data request;

[0180] A collection result data adding module 302 is configured to add the collection result data and an instruction identifier corresponding to the collection result data to the current data request when the user terminal has stored unreported collection result data, the instruction identifier is an identifier of a data collection instruction corresponding to the collection result data;

[0181] The collection result data sending module 303 is configured to send the current data request carrying the collection result data and the instruction identifier corresponding to the collection result data to the server through an interface corresponding to the current data request.

[0182] Optionally, the apparatus further comprises:

[0183] The device identifier sending module is configured to send a device identifier of the user terminal to the server in response to an operation of starting a target application on the user terminal by the user.

[0184] The data collection marker receiving module is configured to acquire a data collection marker returned by the server and acquire user feedback information representing whether to start data collection based on the data collection marker.

[0185] The data request listening module is configured to listen to a data request sent by the user terminal in response to the user feedback information being the permission to start data collection.

[0186] Optionally, the apparatus further comprises:

[0187] The interface return data receiving module is configured to receive interface return data corresponding to the current data request sent by the server.

[0188] The data collection module is configured to collect data of the user terminal according to a data collection instruction carried in the interface return data to obtain collection result data.

[0189] The collection result data saving module is configured to save the collection result data.

[0190] Optionally, the data collection module comprises:

[0191] The collection instruction analyzing submodule is configured to analyze the data collection instruction carried in the interface return data to obtain data collection function information corresponding to the data collection instruction.

[0192] The collection function searching submodule is configured to search for a corresponding data collection function in the user terminal according to the data collection function information.

[0193] The data collection submodule is configured to run the data collection function to collect data of the user terminal.

[0194] Optionally, the collection result data adding module comprises:

[0195] a data encryption submodule, configured to encrypt the collection result data and the instruction identifier corresponding to the collection result data, to obtain encrypted collection result data and encrypted instruction identifier;

[0196] a data addition submodule, configured to add the encrypted collection result data and the encrypted instruction identifier into the parameter of the current data request.

[0197] Optionally, a data object combination is configured for any interface combination, the data object combinations corresponding to each interface combination are not completely identical, each data object combination contains object identifiers of at least one data object, each interface combination contains interface identifiers of at least one interface in the user terminal, and the data object is any data object requested by the user terminal through any interface.

[0198] For any data request, the interface used to send the data request is randomly determined from a target interface combination, and the target interface combination is an interface combination corresponding to a data request combination where the data request is located.

[0199] Based on the same inventive concept, an embodiment of the present application provides a data collection device, which is applied to a server. Figure 4 , Figure 4 is a schematic diagram of a data collection device 400 provided by an embodiment of the present application. As shown in the figure, the device includes: Figure 4

[0200] a data request receiving module 401, configured to receive a current data request sent by a user terminal through an interface corresponding to the current data request;

[0201] a collection result analysis module 402, configured to analyze and save collection result data in the current data request, the collection result data being specified data collected by the user terminal through an interface corresponding to a previous data request and interacting with the server;

[0202] a data collection instruction adding module 403, configured to add a data collection instruction for the user terminal and a corresponding instruction identifier into interface return data corresponding to the current data request;

[0203] an interface return data sending module 404, configured to send the interface return data carrying the data collection instruction and the instruction identifier to the user terminal through the interface corresponding to the current data request.

[0204] Optionally, the device further includes:

[0205] ​The device identification receiving module receives the device identification sent by the user terminal, and determines the data collection instruction and the instruction identification to be sent to the user terminal according to the device identification.

[0206] The data collection inquiry mark sending module is configured to send a data collection inquiry mark to the user terminal, and the data collection inquiry mark is used to inquire the user whether to start data collection.

[0207] Optionally, the device identification receiving module comprises:

[0208] The data collection task determining sub-module is configured to determine the data collection task for the user terminal according to the device identification.

[0209] The collection instruction determining sub-module is configured to determine the data collection instruction and the instruction identification according to the data collection task.

[0210] Optionally, the data collection instruction adding module comprises:

[0211] The data collection instruction encrypting sub-module is configured to encrypt the data collection instruction and the instruction identification to obtain the encrypted data collection instruction and the encrypted instruction identification.

[0212] The data collection instruction adding sub-module is configured to add the encrypted data collection instruction and the encrypted instruction identification to the interface return data.

[0213] Based on the same inventive concept, another embodiment of the present application provides a readable storage medium having a computer program stored thereon, the program being executed by a processor to implement the steps in the data collection method according to any one of the above embodiments of the present application.

[0214] Based on the same inventive concept, another embodiment of the present application provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor being executed to implement the steps in the data collection method according to any one of the above embodiments of the present application.

[0215] For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the related parts are described in the part of the method embodiment.

[0216] Each embodiment in the specification is described in a progressive manner, and each embodiment focuses on the difference from other embodiments. The same and similar parts of each embodiment can be referred to each other.

[0217] Those skilled in the art will appreciate that embodiments of the application can be supplied as a method, a device, or a computer program product. Thus, embodiments of the application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the application can take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) embodying computer readable program code.

[0218] Embodiments of the application are described herein with reference to the drawings, in which are shown flowcharts and / or block diagrams of methods, apparatuses (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processing device or other programmable data processing terminal devices to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal devices, create means for implementing the functions specified in the flowcharts and / or block diagrams block or blocks. Figure 1 one or more functions specified in the flowchart or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart or block diagram block or blocks.

[0219] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing terminal device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart or block diagram block or blocks.

[0220] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device to cause a series of operational steps to be performed on the computer or other programmable terminal device to produce a computer-implemented process such that the instructions which execute on the computer or other programmable terminal device provide steps for implementing the functions specified in the flowchart or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart or block diagram block or blocks. Figure 1 one or more functions specified in the flowchart or block diagram block or blocks.

[0221] While preferred embodiments of the application have been described, modifications and variations can be apparent to those skilled in the art once aware of the general underlying concepts. Accordingly, the appended claims are intended to embrace all such modifications and variations as fall within the scope of the application.

[0222] Finally, it is to be understood that the phraseology or terminology such as "first" and "second" etc. used herein is merely intended to differentiate one entity or operation from another entity or operation, without necessarily requiring or implying any actual such relationship or order between such entities or operations. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0223] The data acquisition method, device, equipment and storage medium provided by the present application are described in detail above, and the principles and implementation modes of the present application are described by applying specific examples. The above description of the embodiments is only used to help understand the method and core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed, and the above description of the specification should not be understood as a limitation of the present application.

Claims

1. A data acquisition method, characterized in that, The method is applied to a user terminal and includes: When a current data request is detected sent by the user terminal to the server through any interface, it is checked whether there is any unreported collection result data stored in the user terminal. The collection result data is: the specified data on the user terminal obtained by the user terminal through the interface corresponding to the previous data request and the interaction with the server, according to the collection instruction issued by the server. When there is unreported collection result data stored in the user terminal, the collection result data and the instruction identifier corresponding to the collection result data are added to the current data request. The instruction identifier is the identifier of the data collection instruction corresponding to the collection result data. Adding the collected data to the current data request includes: The collected result data and the corresponding instruction identifier are encrypted to obtain encrypted collected result data and encrypted instruction identifier. Add the encrypted acquisition result data and the encrypted instruction identifier to the parameters of the current data request; The current data request, carrying the collected result data and the instruction identifier corresponding to the collected result data, is sent to the server through the interface corresponding to the current data request. The data request of the user terminal is sent through a random interface. The method further includes: Receive the interface return data corresponding to the current data request sent by the server; Based on the data collection instructions carried in the data returned by the interface, data is collected from the user terminal to obtain the collection result data. Save the collected data.

2. The method according to claim 1, characterized in that, Before detecting that the user terminal sends a data request to the server through any interface, the method further includes: In response to the user launching the target application on the user terminal, the device identifier of the user terminal is sent to the server; Obtain the data collection flag returned by the server, and obtain user feedback information indicating whether data collection is enabled based on the data collection flag; In response to the user feedback message allowing data collection to begin, the system listens for data requests from the user terminal.

3. The method according to claim 2, characterized in that, The step of collecting data from the user terminal according to the data collection instructions carried in the data returned by the interface includes: The data acquisition instructions carried in the data returned by the interface are parsed to obtain the data acquisition function information corresponding to the data acquisition instructions. Based on the data acquisition function information, the corresponding data acquisition function is located in the user terminal; Run the data acquisition function to collect data from the user terminal.

4. The method according to any one of claims 1-3, characterized in that, For any interface combination, a data object combination is configured. The data object combinations corresponding to each interface combination are not completely the same. Each data object combination contains the object identifier of at least one data object. Each interface combination contains the interface identifier of at least one interface in the user terminal. The data object is any data object that can be requested from the server through a data request sent by any interface. For any data request, the interface used to send the data request is randomly determined from a target interface combination, where the target interface combination is the interface combination corresponding to the data request combination in which the data request is located.

5. A data acquisition method, characterized in that, The method is applied to the server side and includes: Receive the current data request sent by the user terminal through the interface corresponding to the current data request; The collection result data in the current data request is parsed and saved. The collection result data is: the specified data on the user terminal obtained by the user terminal through the interface corresponding to the previous data request and the server, according to the collection instructions issued by the server. The data collection command for the target application and its corresponding command identifier are added to the interface return data corresponding to the current data request; including: The data acquisition command and the command identifier are encrypted to obtain the encrypted data acquisition command and the encrypted command identifier; Add the encrypted data acquisition command and the encrypted command identifier to the data returned by the interface; The interface corresponding to the current data request sends the returned data, carrying the data collection instruction and the instruction identifier, to the user terminal; wherein the user terminal's data request is sent through a random interface. The user terminal receives the interface return data corresponding to the current data request sent by the server; Based on the data collection instructions carried in the data returned by the interface, data is collected from the user terminal to obtain the collection result data. Save the collected data.

6. The method according to claim 5, wherein before the server receives the data request from the user terminal, the method further comprises: Receive the device identifier sent by the user terminal, and determine the data collection command and command identifier to be sent to the user terminal based on the device identifier; A data collection inquiry flag is sent to the user terminal, which is used to ask the user whether to start data collection.

7. The method according to claim 6, characterized in that, The step of determining the data collection command and command identifier to be sent to the user terminal based on the device identifier includes: Based on the device identifier, a data collection task for the user terminal is determined; Based on the data acquisition task, determine the data acquisition instruction and the instruction identifier.

8. A data acquisition device, characterized in that, The device is applied to a user terminal and includes: The data collection result detection module is used to detect whether the user terminal stores unreported data collection result data of the target application when the user terminal sends a current data request to the server through any interface. The data collection result data is: the specified data on the user terminal collected by the user terminal through the interface corresponding to the previous data request and the server according to the collection instructions issued by the server. The data acquisition result addition module is used to add the data acquisition result data and the instruction identifier corresponding to the data acquisition result data to the current data request when there is unreported data acquisition result data stored in the user terminal. The instruction identifier is the identifier of the data acquisition instruction corresponding to the data acquisition result data. The data addition module for the collected results includes: The data encryption submodule is used to encrypt the collected result data and the instruction identifier corresponding to the collected result data to obtain encrypted collected result data and encrypted instruction identifier. The data addition submodule is used to add the encrypted collection result data and the encrypted instruction identifier to the parameters of the current data request; The data collection result sending module is used to send the current data request, which carries the data collection result and the instruction identifier corresponding to the data collection result, to the server through the interface corresponding to the current data request. The data request of the user terminal is sent through a random interface. The device further includes: The interface return data receiving module is used to receive the interface return data corresponding to the current data request sent by the server; The data acquisition module is used to acquire data from the user terminal according to the data acquisition instructions carried in the data returned by the interface, and obtain the acquisition result data. The data collection result storage module is used to store the data collection result.

9. A data acquisition device, characterized in that, The device is used on the server side and includes: The data request receiving module is used to receive the current data request sent by the user terminal through the interface corresponding to the current data request; The data collection result parsing module is used to parse and save the data collection result data in the current data request. The data collection result data is: the user terminal interacts with the server through the interface corresponding to the previous data request and collects the specified data on the user terminal according to the data collection instructions issued by the server. The data acquisition instruction adding module is used to add the data acquisition instruction for the user terminal and the corresponding instruction identifier to the interface return data corresponding to the current data request; The data acquisition instruction adding module includes: The data acquisition instruction encryption submodule is used to encrypt the data acquisition instruction and the instruction identifier to obtain the encrypted data acquisition instruction and the encrypted instruction identifier. A data acquisition instruction adding submodule is used to add the encrypted data acquisition instruction and the encrypted instruction identifier to the data returned by the interface; The interface return data sending module is used to send the interface return data, carrying the data collection instruction and the instruction identifier, to the user terminal through the interface corresponding to the current data request; wherein, the data request of the user terminal is sent through a random interface; the user terminal receives the interface return data corresponding to the current data request sent by the server; performs data collection on the user terminal according to the data collection instruction carried in the interface return data, obtains the collection result data; and saves the collection result data.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps in the data acquisition method as described in any one of claims 1 to 4, or the steps in the data acquisition method as described in any one of claims 5 to 7.

11. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the data acquisition method as described in any one of claims 1 to 4, or the steps of the data acquisition method as described in any one of claims 5 to 7.

Images