Data processing method, device, equipment and storage medium

Abstract

The present application provides a data processing method, apparatus, device and storage medium. The method includes: obtaining event information of an operation on an application of a terminal device, the event information including: an identifier of a page on which a user operates the application and location information of an input operation by the user on the page; obtaining a first page image corresponding to the identifier of the page; and marking the first page image according to the location information corresponding to the page to obtain a second page image. The embodiment of the present application can accurately restore the user's operation on the terminal device through the event information reported by the terminal device, and store the user's operation on the application.

Description

Technical Field

[0001] The present application relates to the technical field of financial technology (Fintech), and in particular to a data processing method, apparatus, device and storage medium. Background Art

[0002] With the development of science and technology, more and more technologies are applied in the financial field. The traditional financial industry is gradually transforming to financial technology (Fintech), but due to the security and real-time requirements of the financial industry, higher requirements are also placed on technology. More and more users need to handle business through the Internet. For example, in the financial field, users use terminal devices to handle transfers, remittances and other businesses, but in order to ensure the safety of users, user operations need to be recorded.

[0003] In the related art, the user's business operation using the terminal device is recorded by recording the terminal device's screen, that is, when the user uses certain applications on the terminal device, the screen recording or screenshot is turned on. When the user completes the operation, the recorded video or multiple screenshots are uploaded to the server for evidence. However, in the above solution, the recorded video or screenshot is large and the upload time is long, which leads to low efficiency in user operation evidence. Summary of the invention

[0004] The present application provides a data processing method, apparatus, device and storage medium to achieve efficient storage of operations generated by users in terminal device applications.

[0005] In a first aspect, the present application provides a data processing method, comprising:

[0006] Acquire event information of an operation on an application program of a terminal device, the event information including: an identifier of a page on which a user operates the application program and location information of an input operation by the user on the page;

[0007] Acquire a first page image corresponding to the identifier of the page;

[0008] The first page image is marked according to the position information corresponding to the page to obtain a second page image.

[0009] In a second aspect, the present application provides a data processing method, comprising:

[0010] In response to an operation on an application program of a terminal device, event information corresponding to the operation is acquired; the event information includes: an identifier of a page on which a user operates the application program and location information of the user inputting the operation on the page;

[0011] The event information is sent to a server.

[0012] In a third aspect, the present application provides a data processing device, including:

[0013] An acquisition module, used to acquire event information of an operation on an application program, wherein the event information includes: an identifier of a page on which a user operates the application program and location information of an operation input by the user on the page;

[0014] The acquisition module is further used to acquire a first page image corresponding to the identifier of the page;

[0015] The processing module is used to mark the first page image according to the position information corresponding to the page to obtain a second page image.

[0016] In a fourth aspect, the present application provides a data processing device, including:

[0017] An acquisition module, configured to acquire event information corresponding to an operation on an application program of a terminal device in response to the operation; the event information includes: an identifier of a page on which a user operates the application program and location information of an input operation by the user on the page;

[0018] The sending module is used to send the event information to the server.

[0019] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method described in any one of the first aspect and the second aspect is implemented.

[0020] In a sixth aspect, an embodiment of the present application provides an electronic device, including:

[0021] Processor; and

[0022] A memory, configured to store executable instructions of the processor;

[0023] The processor is configured to perform the method according to any one of the first aspects by executing the executable instructions.

[0024] In a seventh aspect, an embodiment of the present application provides a terminal device, including:

[0025] Processor; and

[0026] A memory, configured to store executable instructions of the processor;

[0027] The processor is configured to perform the method described in any one of the second aspects by executing the executable instructions.

[0028] The data processing method, apparatus, device and storage medium provided in the embodiments of the present application obtain event information of the operation of the terminal device application, and the event information includes: the identifier of the page where the user operates the application and the location information of the user inputting the operation in the page; the terminal device only needs to collect the event information of the user operation and upload it to the server, which improves the efficiency of the terminal device to transmit data to the server. The server obtains the first page image associated with the event information, and marks the second page image to obtain the second page image, thereby realizing the restoration of the user's operation on the terminal device application. The second page image can be used as evidence of the user's operation on the application, realizing an efficient user operation evidence solution. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0030] Figure 1 A schematic diagram of the system architecture provided for an embodiment of the present application;

[0031] Figure 2 It is a flowchart of an embodiment of a data processing method provided by the present application;

[0032] Figure 3 It is a schematic diagram of the principle of an embodiment provided by the present application;

[0033] Figure 4 It is a schematic diagram of a page image of an embodiment provided by the present application;

[0034] Figure 5 It is a schematic diagram of the marking processing principle of an embodiment provided by the present application;

[0035] Figure 6 This is a schematic diagram of a page image after marking according to an embodiment of the present application;

[0036] Figure 7 This is a schematic diagram of page images corresponding to multiple operations of an embodiment provided by the present application;

[0037] Figure 8 This is a schematic diagram of the data preprocessing principle of an embodiment provided by the present application;

[0038] Fig. 9 It is a flowchart of another embodiment of the data processing method provided by the present application;

[0039] Fig.10 This is a schematic diagram of the principle of data collection by a terminal device in accordance with an embodiment of the method provided by the present application;

[0040] Fig.11This is a schematic diagram of data cache of a terminal device according to an embodiment of the method provided by the present application;

[0041] Fig.12 It is a structural schematic diagram of an embodiment of a data processing device provided by the present application;

[0042] Fig.13 is a structural schematic diagram of another embodiment of the data processing device provided by the present application;

[0043] Fig.14 is a structural schematic diagram of an electronic device embodiment provided by the present application;

[0044] Fig.15 It is a structural diagram of a terminal device embodiment provided in this application.

[0045] The above drawings show clear embodiments of the present disclosure, which will be described in more detail below. These drawings and text descriptions are not intended to limit the scope of the present disclosure in any way, but to illustrate the concepts of the present disclosure to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0046] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0047] The terms "including" and "having" and any variations thereof in the specification and claims of the present application and the drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0048] First, the application scenarios involved in the embodiments of the present application are introduced.

[0049] Figure 1 This is a schematic diagram of the system architecture provided in the embodiment of the present application. Figure 1 As shown, the system architecture of the embodiment of the present application may include but is not limited to: a terminal device 11 and a server 12. The terminal device includes but is not limited to a mobile phone, a tablet computer, a wearable device, a laptop computer, and the like.

[0050] The terminal device 11 and the server 12 may be connected via a network.

[0051] In the related art, the user's use of the terminal device to perform business operations is recorded by recording the terminal device's screen, that is, when the user uses certain applications on the terminal device, the screen recording or screenshots are turned on. When the user completes the operation, the recorded video or multiple screenshots are uploaded to the server for evidence. However, in the above scheme, the recorded video or screenshots are large and the upload time is long, which results in low efficiency in user operation evidence. In addition, the user cannot continue to operate the terminal device during the upload process, which affects the user experience. The recorded video or screenshots may also contain user privacy information, which is easy to infringe and leak user privacy.

[0052] The method of the embodiment of the present application collects event information of user operations through the terminal device, such as the identification of the operated page and the location information of the user's operation on the page, and uploads it to the server. Compared with the terminal device transmitting the screenshot or video data of the screen recording to the server, the efficiency of the terminal device transmitting data to the server is improved, and it does not affect the user's operation of the terminal device. The server marks the pre-stored page image associated with the event information based on the uploaded event information to obtain a second page image, thereby realizing the accurate restoration of the user's operation on the terminal device application. The second page image can be used as evidence of the user's operation on the application, realizing an efficient user operation evidence solution.

[0053] Storing evidence of user operations can not only protect the user's financial security, but also enable application operators and developers to understand the user's actual operating habits and optimize the application. Or if a user encounters a problem while using the application, developers and testers can locate the problem more quickly and accurately through the stored evidence data of the user's operation.

[0054] In an embodiment of the present application, the user's operations on the application of the terminal device are restored and recorded. The application is, for example, a web application APP, such as a web APP developed based on HTML5 technology. These web APPs can, for example, run in a browser, WeChat, webview, etc.

[0055] In the embodiment of the present application, the above-mentioned application may also be other types of application, such as a local Native APP, which is not limited in the embodiment of the present application.

[0056] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0057] Figure 2 1 is a flow chart of an embodiment of a data processing method provided by the present application. Figure 2 , Figure 3 As shown, the method provided in this embodiment includes:

[0058] Step 101: Acquire event information of an application operation on a terminal device, wherein the event information includes: an identifier of a page on which a user operates the application and location information of a user inputting an operation on the page.

[0059] Specifically, Figure 3 As shown, when a user uses a terminal device, the terminal device collects the user's behavior data, that is, collects event information of application operations, and the event information includes: the identifier of the page where the user operates the application and the location information of the user input operation in the page. The location information is, for example, the coordinate information of the input operation.

[0060] After the user interacts with the terminal device, the terminal device captures the event information and reports it to the server.

[0061] For example, when the terminal device detects operation events such as submit, change, click, scroll, etc., it captures event information.

[0062] Step 102: Obtain a first page image corresponding to the page identifier.

[0063] Specifically, the first page images of each page of the application can be pre-stored, and different first page images are distinguished by page identifiers. The first page image is the image of the original page of the application, and does not contain a mark of user operation, such as Figure 4 shown.

[0064] According to the page identifier contained in the event information, a first page image corresponding to the page identifier is acquired.

[0065] In one embodiment, the first page image may be an actual screenshot of a page of the application or a visual image of a page of the application in a development stage.

[0066] In an embodiment of the present application, page images for different applications only need to be uploaded once during the configuration management process, and do not need to be uploaded by the user's terminal device. The user's terminal device only collects event information of user operations, so the amount of data transmitted from the terminal device to the server can be greatly reduced, thereby improving transmission efficiency.

[0067] like Figure 5 As shown, a correspondence is established between the first page image and the page identifier in advance, the first page image and the correspondence are stored, and the first page image associated with the page identifier in the event information is obtained according to the event information.

[0068] Step 103: Mark the first page image according to the position information corresponding to the page to obtain a second page image.

[0069] Specifically, after obtaining the event information and the first page image of the original page of the application, it is necessary to restore the user operation event on the first page image, so as to store the user's operation on the application. Restoring the user operation event is to visualize the event information, that is, according to the location information in the event information, mark the first page image to obtain the second page image, and then store the second page image. Figure 6 As shown, the position where the user operates is marked on the first page image, for example, the operation position is marked by a preset symbol.

[0070] For example, the user's operations when performing transfers, remittances, purchases, and other services in the application can be stored as image data to ensure the user's financial security.

[0071] The method of this embodiment obtains event information of the operation of the terminal device application, and the event information includes: the identifier of the page where the user operates the application and the location information of the user inputting the operation on the page; the terminal device only needs to collect the event information of the user operation and upload it to the server, which improves the efficiency of the terminal device to transmit data to the server. The server obtains the first page image associated with the event information, and marks the second page image to obtain the second page image, thereby realizing the restoration of the user's operation on the terminal device application. The second page image can be used as evidence of the user's operation on the application, realizing an efficient user operation evidence solution.

[0072] In one embodiment, step 103 may be implemented as follows:

[0073] Determine the mark position in the first page image according to the position information;

[0074] Mark information is added at the mark position of the first page image to obtain a second page image.

[0075] Specifically, Figure 6 As shown, when event restoration is performed, the mark position corresponding to the operation event is first determined according to the bit position information in the event information, such as the click position of the user on the page.

[0076] The position information can be represented by coordinates, for example, with the lower left corner of the screen as the origin, the lower edge of the screen as the X axis, and the left edge of the screen as the Y axis. Figure 6 As shown, the coordinates (X, Y) of the user's click position are (210, 365) in pixels.

[0077] The coordinates of the position information are the coordinates of the marked position.

[0078] Then, mark information is added at the mark position of the first page image to obtain a marked second page image, where the mark information includes, for example, preset symbols, text information of user operations, and the like.

[0079] In one embodiment, obtaining the first page image associated with the page identifier in the event information may be achieved in the following manner:

[0080] Create a new box model , then create The tag loads the first page image.

[0081] Each element on the page (such as the first page image) can be displayed through a box model. The Cascading Style Sheets (CSS) attributes corresponding to the box model include width, height, margin, border and other attributes.

[0082] pass Before the tag loads the first page image, it will first use the unique identification ID of the page in the event information to obtain the associated first page image.

[0083] In one embodiment, the first page image can also be stored in a server. When storing the first page image, the file ID (fileId) and file summary information (such as file Hash value) of the first page image can also be stored. The first page image can be found through the correspondence between fileId and fileHash and the page identifier.

[0084] For example, by The SRC attribute of the tag loads the first page image, and the value of the SRC attribute is the Uniform Resource Locator (URL) address of the first page image.

[0085] In one embodiment, the marking process can be implemented in the following way: obtaining the x and y coordinate data in the event information. The lower left corner is used as the origin of the coordinate axis, the lower edge of the box model is the x-axis, and the left edge is the y-axis, thus establishing the same coordinate system as the user's terminal device. Set the position property to relative; create a new Tag 2 (same as the previous box model Similar), Set the position attribute of tag 2 to absolute, and set the x and y coordinate data in the event information of the user operation to In the bottom and left attributes of tag 2. The position of label 2 is located at the position where the user operates. Then set The CSS style of tag 2, for example, by configuring the Glow property of the CSS style Label 2 is set to a blue dynamic dot to mark the location where the user clicks.

[0086] In the above implementation, the mark position corresponding to the user operation is determined by the location information in the event information, and the mark information is added at the mark position of the first page image to obtain the second page image, thereby realizing the restoration of the user's operation on the terminal device application. The second page image can be used as evidence of the user's operation on the application, thereby realizing an efficient user operation evidence storage solution.

[0087] In one embodiment, the event information further includes: time information of the operation, user identification information, and event identification information. After step 103, the following operations may be performed:

[0088] Acquire event information of multiple operations corresponding to the user identification information; the operations correspond to the event identification information one by one;

[0089] Determine the time interval between adjacent operations according to the time information in each of the event information;

[0090] Video data of the user's operation on the application is generated according to the time interval and the second page image corresponding to each of the operations.

[0091] Specifically, after processing in step 103, the event information of the user's interaction with the terminal device is marked at the corresponding position of the corresponding first page image, and the time information in the event information is further read to calculate the time interval between adjacent events. Based on the time interval between adjacent events and the marked second page image corresponding to each event, video data of the user's operation on the application of the terminal device is generated.

[0092] For example, Figure 7 As shown, the user generates three events by operating the application A of the terminal device, and the time intervals of adjacent events are calculated by the time information triggered by the three events; the interval between event 1 and event 2 is 200ms, and the interval between event 2 and event 3 is 500ms. Then, in the generated video data, the second page image corresponding to event 1 is displayed 200ms later than the second page image corresponding to event 2, and the second page image corresponding to event 2 is displayed 500ms later than the second page image corresponding to event 3. That is, the interval time of displaying each second page image is consistent with the time interval of the operation generated by the user on the application.

[0093] Figure 7 In the example, the event information of event 1 includes: the position coordinates (X, Y) are (210, 365), the event information of event 2 includes: the position coordinates (X, Y) are (510, 365), and the event information of event 3 includes: the position coordinates (X, Y) are (510, 365).

[0094] In one embodiment, the acquired event information of different operations of the same user on the same application program may be data that is sorted according to time information after being processed, that is, arranged in the order of events generated by the user operations.

[0095] In one embodiment, the box model corresponding to each event is controlled The display display property is displayed / hidden in turn, thereby generating video data of the user's operation on the application of the terminal device, and the user's operation on the terminal device can be played back through the video data.

[0096] In the above implementation, video data is generated by using the time information in the event information and a second page image with mark information of the user operation added to the location of the user operation, thereby realizing the restoration of the user's operation on the terminal device application. The video data can be used as evidence of the user's operation on the application, thereby realizing an efficient user operation evidence solution.

[0097] In one embodiment, the event information further includes: screen attribute information of the terminal device; Step 103 includes:

[0098] Processing the first page image according to the screen attribute information of the terminal device to obtain a processed third page image;

[0099] The third page image is marked according to the position information corresponding to the page to obtain the second page image.

[0100] Specifically, in order to keep the page image consistent with the page of the application operated by the user, before marking the first page image, the first page image can be processed according to the screen attribute information of the terminal device to obtain a processed third page image, and then marked.

[0101] In this implementation, the page image is kept consistent with the page of the application program operated by the user, and the user's operation on the application program can be accurately restored.

[0102] In one embodiment, the screen attribute information includes: the screen resolution of the terminal device and the screen size of the terminal device. The first page image is processed according to the screen attribute information of the terminal device, which can be specifically implemented in the following manner:

[0103] According to the screen resolution, adjusting the resolution of the first page image to obtain an adjusted first page image;

[0104] The adjusted first page image is scaled according to the screen size to obtain the third page image.

[0105] Specifically, the resolution of the first page image is adjusted according to the screen resolution in the event information of the user operation, so that the first page image is consistent with the resolution of the page of the application operated by the user, for example, the screen resolution is 760*1280. Then, the adjusted first page image is scaled according to the screen size, for example, by setting The CSS attributes width and height of the tag enable the first page image to maintain the same size as the screen of the user's terminal device.

[0106] In one embodiment, if Figure 8 As shown, after obtaining the event information reported by the terminal device, a preprocessing operation may be performed first, for example, including at least one of the following operations: decompression, filtering, deduplication, statistics, and database entry, and then stored after preprocessing.

[0107] In one embodiment, the target information in the event information is filtered; the target information includes at least one of the following: executable code, preset symbol, attack-type database statement.

[0108] Specifically, in order to save transmission bandwidth, the event information can be compressed when uploading, and the receiving end decompresses the event information reported by the terminal device after receiving it;

[0109] The event information is further filtered. The purpose of filtering is mainly to prevent attacks, such as filtering attack-related SQL statements, executable codes, preset symbols, etc.

[0110] The event information is expressed in string format.

[0111] Among them, attack-type SQL statements include some keywords, such as "SELECT", "DELETE", etc., and these SQL statements are filtered to prevent event information from being executed in SQL statements;

[0112] Filter executable code to prevent event information from being executed when the image is displayed.

[0113] Preset symbols include, for example, brackets, commas, colons, underscores, vertical bars and other special symbols.

[0114] The filtered data is saved in a database, such as a hive database. The event information can be used as log information.

[0115] In one embodiment, the event information can also be deduplicated, which is the key to data cleaning and can reduce the amount of unnecessary data storage. According to the information carried in the reported event information, the event information can be classified and counted, for example, according to user identification information, event identification information, and location information, and the statistical data can be stored in the hbase database.

[0116] In the above implementation manner, filtering the data can improve the security of the data.

[0117] Fig. 9 1 is a flow chart of an embodiment of a data processing method provided by the present application. Fig. 9 As shown, the execution subject of this embodiment is a terminal device of a user, and the method includes:

[0118] Step 201: In response to an operation on an application program of a terminal device, obtain event information corresponding to the operation; the event information includes: an identifier of a page on which the user operates the application program and location information of the user inputting the operation on the page;

[0119] Step 202: Send event information to the server.

[0120] Specifically, Fig.10 As shown, after the user interacts with the terminal device, the event information is captured by the event listener, and then data filtering is performed. Sensitive information (such as user privacy information) is filtered out before entering the data queue, and finally the data queue is compressed and reported. For example, multiple event information can be reported in batches, or each event information can be reported individually.

[0121] In one embodiment, the event listener can capture events such as submit, change, click, scroll, etc. When a user triggers at least one of the above events in a page, the terminal device will automatically capture the event information.

[0122] In one embodiment, the position information may be represented by coordinates, for example, with the lower left corner of the screen as the origin, the lower edge of the screen as the X-axis, and the left edge of the screen as the Y-axis. Figure 6 As shown, the coordinates (X, Y) of the user's click position are (210, 365) in pixels.

[0123] For example, when a user clicks the screen, the event listener will capture the event of type click and obtain the location information of the event triggering and the Document Object Model (DOM) node information. The event information also includes at least one of the following: event identification information, user identification information, time information, and screen attribute information of the terminal device.

[0124] like Figure 6 As shown, the DOM node information corresponding to the user operation is " Label ”, which is the page code snippet corresponding to the user operation position.

[0125] In the method of this embodiment, the terminal device obtains event information of the operation of the terminal device application, and the event information includes: the identifier of the page where the user operates the application and the location information of the user inputting the operation in the page; and reports the event information to the server. The terminal device only needs to collect the event information of the user operation and upload it to the server, which improves the efficiency of the terminal device in transmitting data to the server. The server obtains the first page image associated with the event information, and marks the second page image to obtain the second page image, thereby realizing the restoration of the user's operation on the terminal device application. The second page image can be used as evidence of the user's operation on the application, realizing an efficient user operation evidence solution.

[0126] In one embodiment, before step 202, the method further includes:

[0127] The user privacy information in the event information is filtered.

[0128] Specifically, data filtering is mainly to avoid collecting sensitive information of users (such as privacy information). The reported event information contains records of user operations, but does not contain specific information entered by users, such as ID card, name, mobile phone number, email address, password, etc. For example, DOM node information may contain sensitive information such as ID card, name, mobile phone number, email address, password, etc. entered by users.

[0129] In one embodiment, the data filter can be implemented using regular expressions, and the filtering content includes: ID card, name, mobile phone number, email address, password and other sensitive information. If the captured information contains the above content, it will be filtered and the filtered event information will be reported.

[0130] The implementation of data filters uses regular expressions to verify the format of captured information. When the information contains sensitive information, the sensitive information will be deleted or desensitized.

[0131] In this method, user privacy information is filtered before uploading data to the server to avoid infringement and leakage of user privacy and improve the security of user information.

[0132] In one embodiment, the following operations may also be performed before step 202:

[0133] Compressing the event information to obtain compressed event information;

[0134] The compressed event information is cached according to a cache mode supported by an application of the terminal device.

[0135] Before compression, the multiple events may be arranged in chronological order.

[0136] Specifically, the event information reported to the server can be reported immediately after data filtering or triggered by an event, for example, reporting is performed when certain trigger conditions are met, such as time, cached data size, etc., and reporting is performed when the trigger conditions are met.

[0137] If the report is triggered by an event, the filtered event information will be cached first, for example, temporarily stored in a batch data array, and the batch data array will be compressed and cached locally, waiting for the right time to report.

[0138] For example, Fig.11 As shown in the figure, the operation data triggered by the user will be recorded as events. If n interactions generate n events, the event information of these n events will form a data queue in chronological order and be stored in a batch data array in JSON format. Then the batch data array will be compressed by the gzip algorithm and compressed into a string of binary format text. The array is compressed into binary text by the gizp algorithm.

[0139] In one embodiment, the compressed event information may be converted through a coding algorithm to further compress the data, such as the base64 algorithm.

[0140] In one embodiment, event information is cached locally according to the cache method supported by the current application's running environment (such as browser, WeChat, webview), for example, supporting at least one of the following cache methods: WebSQL, Indexed DB, and local storage localStorage.

[0141] For developers, they can configure the terminal device's application to use a certain cache mechanism, for example, they can specify the cache mechanism through the waLog.using method.

[0142] The waLog.using(protocol,database) method contains two parameters:

[0143] Among them, protocol specifies which cache mechanism to use, and optional values ​​include localStorage, indexedDB, or webSQL;

[0144] database specifies the name of the database where the cache data is stored.

[0145] For example, by using waLog.using('localStorage', 'test'), the localStorage cache mechanism is used, and the data will be cached in the database named 'test'.

[0146] In one embodiment, if no cache mechanism is specified, it can be determined whether the application supports a preset cache method, which includes at least one of the following: WebSQL, Indexed DB, and local storage. The specific implementation method is, for example:

[0147] First, determine whether the application supports the preset first cache method, such as localStorage. For example, determine whether window.localStorage exists in the program code. If so, select localStorage for caching.

[0148] If window.localStorage does not exist, determine whether the application supports the second cache mode indexedDB, for example, determine whether at least one of window.indexedDB, window.IDBTransaction and window.IDBKeyRange exists in the program code, and if so, use the indexDB mode for caching;

[0149] Otherwise, it is determined whether the application supports the third cache mode WebSQL, for example, whether window.openDatabase exists in the program code, if so, WebSQL mode cache is used; otherwise, no cache is performed.

[0150] In one embodiment, the report can be made by initiating a report request to the server, such as initiating a beacon request, or by creating a The tag initiates a cross-domain get request or an ajax request.

[0151] The method of this embodiment can further improve the efficiency of data transmission from the terminal device to the server by performing compression, encoding conversion and other processing before data transmission. When reporting to the server, the time when the bandwidth of the terminal device is relatively idle can be selected to avoid affecting the use of users and improve the user experience.

[0152] Fig.12 A structural diagram of an embodiment of a data processing device provided by the present application is shown in FIG. Fig.12 As shown, the data processing device of this embodiment is applied to a server, and the data processing device includes:

[0153] The acquisition module 110 is used to acquire event information of the operation of the terminal device application, wherein the event information includes: the identifier of the page where the user operates the application and the location information of the user inputting the operation in the page;

[0154] The acquisition module 110 is further used to acquire a first page image corresponding to the page identifier;

[0155] The processing module 111 is used to mark the first page image according to the position information corresponding to the page to obtain a second page image.

[0156] In a possible implementation, the processing module 111 is specifically configured to:

[0157] Determining a mark position in the first page image according to the position information;

[0158] Marking information is added at the marking position of the first page image to obtain the second page image.

[0159] In a possible implementation, the event information further includes: time information of the operation, user identification information and event identification information, and the processing module 111 is further configured to:

[0160] Acquire event information of multiple operations corresponding to the user identification information; the operations correspond to the event identification information one by one;

[0161] Determine the time interval between adjacent operations according to the time information in each of the event information;

[0162] Video data of the user's operation on the application is generated according to the time interval and the second page image corresponding to each of the operations.

[0163] In a possible implementation, the event information further includes: screen attribute information of the terminal device; the processing module 111 is specifically configured to:

[0164] Processing the first page image according to the screen attribute information of the terminal device to obtain a processed third page image;

[0165] The third page image is marked according to the position information corresponding to the page to obtain the second page image.

[0166] In a possible implementation, the screen attribute information includes: the screen resolution of the terminal device and the screen size of the terminal device. The processing module 111 is specifically configured to:

[0167] According to the screen resolution, adjusting the resolution of the first page image to obtain an adjusted first page image;

[0168] The adjusted first page image is scaled according to the screen size to obtain the third page image.

[0169] In a possible implementation, the processing module 111 is further configured to:

[0170] Filter the target information in the event information; the target information includes at least one of the following: executable code, preset symbol, attack-type database statement.

[0171] The device of this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0172] Fig.13 A structural diagram of another embodiment of the data processing device provided by the present application is shown in FIG. Fig.13 As shown, the data processing device of this embodiment is applied to a terminal device, and the data processing device includes:

[0173] The acquisition module 120 is used to obtain event information corresponding to the operation in response to the operation on the terminal device application; the event information includes: the identifier of the page where the user operates the application and the location information of the user inputting the operation on the page;

[0174] The sending module 121 is used to send the event information to the server.

[0175] In a possible implementation manner, the event information further includes at least one of the following: time information of the operation, event identification information, user identification information, and screen attribute information of the terminal device.

[0176] In a possible implementation, the sending module 121 is further configured to:

[0177] Compressing the event information to obtain compressed event information;

[0178] The compressed event information is cached according to a cache mode supported by an application of the terminal device.

[0179] In a possible implementation, if the number of the event information is multiple, the sending module 121 is further configured to:

[0180] The multiple events are arranged in chronological order.

[0181] The device of this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0182] Fig.14 A schematic diagram of the structure of an electronic device embodiment provided in this application, such as Fig.14 As shown, the electronic device includes:

[0183] A processor 131 , and a memory 132 for storing executable instructions of the processor 131 .

[0184] Optionally, it may also include: a communication interface 133 for implementing communication with other devices.

[0185] The above components may communicate via one or more buses.

[0186] Among them, the processor 131 is configured to execute the corresponding method in the aforementioned method embodiment by executing the executable instructions. The specific implementation process can be found in the aforementioned method embodiment and will not be repeated here.

[0187] Fig.15 A schematic diagram of the structure of a terminal device embodiment provided in this application, such as Fig.15 As shown, the terminal device includes:

[0188] A processor 141 , and a memory 142 for storing executable instructions of the processor 141 .

[0189] Optionally, it may also include: a communication interface 143 for implementing communication with other devices.

[0190] The above components may communicate via one or more buses.

[0191] Among them, the processor 141 is configured to execute the corresponding method in the aforementioned method embodiment by executing the executable instructions. The specific implementation process can be found in the aforementioned method embodiment and will not be repeated here.

[0192] A computer-readable storage medium is also provided in an embodiment of the present application, on which a computer program is stored. When the computer program is executed by a processor, the corresponding method in the aforementioned method embodiment is implemented. The specific implementation process can be found in the aforementioned method embodiment. The implementation principle and technical effects are similar and will not be repeated here.

[0193] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0194] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A data processing method, characterized in that: include: Acquire event information of an application operation on a terminal device, the event information including: an identifier of a page on which a user operates the application and location information of an input operation by the user on the page; Acquire a first page image corresponding to the identifier of the page; the first page image is a visual image of a page of the application in the development stage, and the first page image is uploaded and pre-stored on the server during the configuration management process of the application; The first page image is marked according to the position information corresponding to the page to obtain a second page image.

2. The method according to claim 1, characterized in that Marking the first page image according to the position information corresponding to the page to obtain a second page image includes: Determining a mark position in the first page image according to the position information; Marking information is added at the marking position of the first page image to obtain the second page image.

3. The method according to claim 1 or 2, characterized in that: The event information also includes: time information of the operation, user identification information and event identification information. After obtaining the second page image, the method further includes: Acquire event information of multiple operations corresponding to the user identification information; the operations correspond to the event identification information one by one; Determine the time interval between adjacent operations according to the time information in each of the event information; Video data of the user's operation on the application is generated according to the time interval and the second page image corresponding to each of the operations.

4. The method according to claim 1 or 2, characterized in that: The event information also includes: screen attribute information of the terminal device; marking the first page image according to the position information corresponding to the page to obtain the second page image, including: Processing the first page image according to the screen attribute information of the terminal device to obtain a processed third page image; The third page image is marked according to the position information corresponding to the page to obtain the second page image.

5. The method according to claim 4, characterized in that The screen attribute information includes: a screen resolution of the terminal device and a screen size of the terminal device. The processing of the first page image according to the screen attribute information of the terminal device to obtain a processed third page image includes: According to the screen resolution, adjusting the resolution of the first page image to obtain an adjusted first page image; The adjusted first page image is scaled according to the screen size to obtain the third page image.

6. The method according to claim 1 or 2, characterized in that: After obtaining the event information of the application operation, the method further includes: Filter the target information in the event information; the target information includes at least one of the following: executable code, preset symbol, attack-type database statement.

7. A data processing method, characterized in that: include: In response to an operation on an application program of a terminal device, obtaining event information corresponding to the operation; The event information includes: an identifier of a page on which a user operates the application and location information of an input operation by the user on the page; The event information is sent to a server, and the server is used to execute the data processing method according to any one of claims 1 to 6.

8. The method according to claim 7, characterized in that The event information also includes at least one of the following: time information of the operation, event identification information, user identification information, and screen attribute information of the terminal device.

9. The method according to claim 7 or 8, characterized in that: Before sending the event information to the server, the method further includes: Compressing the event information to obtain compressed event information; The compressed event information is cached according to a cache mode supported by an application of the terminal device.

10. The method according to claim 9, characterized in that If there are multiple event information, before compressing the event information, the method further includes: The multiple events are arranged in chronological order.

11. A data processing device, characterized in that: include: An acquisition module, used to acquire event information of an operation on an application of a terminal device, the event information including: an identifier of a page on which a user operates the application and location information of an input operation by the user on the page; The acquisition module is further used to acquire a first page image corresponding to the identifier of the page; the first page image is a visual image of a page of the application in the development stage, and the first page image is uploaded and pre-stored on the server during the configuration management process of the application; The processing module is used to mark the first page image according to the position information corresponding to the page to obtain a second page image.

12. A data processing device, characterized in that: include: An acquisition module, configured to, in response to an operation on an application program of a terminal device, acquire event information corresponding to the operation; The event information includes: an identifier of a page on which a user operates the application and location information of an input operation by the user on the page; A sending module is used to send the event information to a server, and the server is used to execute the data processing method according to any one of claims 1 to 6.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 or 7 to 11 is implemented.

14. A device, characterized in that include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to perform the method of any one of claims 1-6 or 7-11 by executing the executable instructions.

Images