A screen recording-based intelligent terminal fault positioning device, method and equipment

Abstract

The application relates to a screen-recording-based intelligent terminal fault positioning device, method and equipment, the device comprising a data acquisition module, a data processing module, a data simulation module and a fault positioning module; the data acquisition module is used for acquiring fault recording data and test acceptance data of the intelligent terminal; the data processing module is used for identifying and classifying the fault recording data to obtain processing data; the data simulation module is used for generating simulation data with code value marks according to the test acceptance data; and the fault positioning module is used for identifying the fault position according to comparison between the processing data and the simulation data. The screen-recording-based intelligent terminal fault positioning device realizes the purposes of quickly obtaining fault recording data, processing the fault recording data to obtain processing data, intuitively comparing the processing data with simulation data to obtain the fault position and quickly positioning and solving the fault through the data acquisition module, the data processing module, the data simulation module and the fault positioning module.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal device fault, in particular to a smart terminal fault positioning device, method and equipment based on screen recording. BACKGROUND

[0002] In the process of smart phone software release and operation, faults such as page rendering error, operation response exception and even crash will inevitably occur, and it is necessary to collect data, locate faults and finally optimize and repair the problems of smart phone software. The smart phone software includes iOS, Android and other software.

[0003] In the process of locating faults of smart phone software, most of the solutions are user operation, burying point data analysis, user narration and screen recording to restore the fault environment and context for analysis and positioning. The above-mentioned burying point solution has the problem that the amount of burying point data may not be able to accurately extract the key data causing the fault, affecting the analysis of the fault. From the perspective of user narration, there is cognitive bias when the user is not familiar with the software, and the communication cost is high. Taking screen recording as an example, there is a large proportion of users who are not familiar with mobile terminals in the mobile terminal user group, such as middle-aged and old users, and the recognition rate of complex operations such as screen recording and sending to software developers is low, and the submission rate and success rate are low. Secondly, after obtaining the user screen recording data, the user operation still needs to be speculated and the interface request needs to be simulated before the fault cause can be analyzed. Therefore, the above-mentioned fault positioning methods of smart phone software restrict the improvement of repair speed and affect the final repair efficiency. SUMMARY

[0004] The embodiments of the present application provide a smart terminal fault positioning device, method and equipment based on screen recording, which are used to solve the technical problems of existing burying point analysis for smart phone software fault positioning, which cannot match the obtained data, has large analysis data and complicated operation.

[0005] In order to achieve the above-mentioned purpose, the embodiments of the present application provide the following technical solutions:

[0006] A smart terminal fault positioning device based on screen recording, comprising a data acquisition module, a data processing module, a data simulation module and a fault positioning module;

[0007] The data acquisition module is used to acquire fault recording data and test acceptance data of the smart terminal.

[0008] The data processing module is used to identify and classify the fault recording data to obtain processing data.

[0009] The data simulation module is used to generate simulation data with code value mark according to the test acceptance data.

[0010] The fault positioning module is configured to identify a fault position according to comparison of the processing data and the simulation data.

[0011] Preferably, the intelligent terminal fault positioning device based on screen recording comprises a visualization module configured to display the fault recording data, the test acceptance data, the processing data, the simulation data and the fault position.

[0012] Preferably, the data acquisition module is further configured to stop the data acquisition operation of the data acquisition module according to the fault recording data inquired through the visualization module.

[0013] Preferably, the fault recording data and the test acceptance data acquired by the data acquisition module are both marked with code values, and the data acquisition module comprises a first data acquisition submodule and a second data acquisition submodule.

[0014] The first data acquisition submodule is configured to acquire data of a test intelligent terminal and mark the data with interaction code values and / or operation code values as test acceptance data.

[0015] The second data acquisition submodule is configured to acquire data of a user recording a running intelligent terminal after a fault occurs and mark the data with fault code values as fault recording data.

[0016] Preferably, the fault recording data and the test acceptance data both comprise environmental information, interaction information and video recording information of the intelligent terminal.

[0017] Preferably, the data processing module comprises an identification submodule and an association submodule.

[0018] The identification submodule is configured to identify and classify the fault recording data according to pages, operations and interactions to obtain identification data.

[0019] The association submodule is configured to associate the identification data according to a tree structure slice data model to obtain processing data.

[0020] Preferably, the tree structure slice data model is a model constructed with time as a root node and pages, operations and interactions from top to bottom.

[0021] The application further provides an intelligent terminal fault positioning method based on screen recording, comprising the following steps:

[0022] Acquiring test acceptance data of an intelligent terminal and fault instructions of the intelligent terminal, and acquiring fault recording data by a user performing fault recovery operation on the intelligent terminal according to the fault instructions;

[0023] The fault recording data is identified and classified to obtain processing data, and simulation data with code value labels is generated according to the test acceptance data;

[0024] According to the comparison between the processing data and the simulation data, a fault position is identified.

[0025] Preferably, the intelligent terminal fault positioning method based on screen recording comprises: displaying the fault recording data, the test acceptance data, the processing data, the simulation data and the fault position for a user or a maintainer to view.

[0026] The application also provides a storage device having a plurality of program codes stored therein, the program codes being adapted to be loaded and run by a processor to execute the intelligent terminal fault positioning method based on screen recording described above.

[0027] The application also provides a terminal device comprising a processor and a memory.

[0028] The memory is configured to store program codes and transmit the program codes to the processor.

[0029] The processor is configured to execute the intelligent terminal fault positioning method based on screen recording according to instructions in the program codes.

[0030] As can be seen from the above technical solutions, the intelligent terminal fault positioning device, method and equipment based on screen recording have the following advantages: the device comprises a data acquisition module, a data processing module, a data simulation module and a fault positioning module; the data acquisition module is configured to acquire fault recording data and test acceptance data of an intelligent terminal; the data processing module is configured to identify and classify the fault recording data to obtain processing data; the data simulation module is configured to generate simulation data with code value labels according to the test acceptance data; and the fault positioning module is configured to compare the processing data with the simulation data to identify a fault position. The intelligent terminal fault positioning device based on screen recording realizes rapid acquisition of fault recording data and processing of the fault recording data to obtain processing data, and the processing data and the simulation data are compared to obtain a fault position, thereby achieving the purpose of rapid positioning and solving. The technical problems of existing intelligent phone software fault positioning, such as unmatchable data acquisition, large amount of data analysis and complicated operation, are solved.

[0031] The intelligent terminal fault positioning method based on screen recording comprises the following steps: obtaining test and acceptance data of an intelligent terminal and a fault instruction of the intelligent terminal, and obtaining fault recording data by performing fault restoration operation on the intelligent terminal according to the fault instruction; identifying and classifying the fault recording data to obtain processing data; generating simulation data with code value markers according to the test and acceptance data; and identifying the fault position according to comparison between the processing data and the simulation data. The intelligent terminal fault positioning method based on screen recording compares the processing data obtained by processing the fault recording data and the test and acceptance data with the simulation data, identifies the fault position of the intelligent terminal, avoids the problems of unmatched data, large analysis data and complicated operation, and solves the technical problems of unmatched data, large analysis data and complicated operation in the existing software fault positioning of the intelligent terminal. BRIEF DESCRIPTION OF DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.

[0033] Figure 1 The framework diagram of the intelligent terminal fault positioning device based on screen recording described in the embodiments of the present application;

[0034] Figure 2 The step flow chart of the intelligent terminal fault positioning method based on screen recording described in the embodiments of the present application. DETAILED DESCRIPTION

[0035] In order to make the purposes, features and advantages of the present application more obvious and easy to understand, the technical solutions in the embodiments of the present application will be described clearly and completely in combination with the drawings in the embodiments of the present application. Obviously, the following described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0036] The application provides a screen recording-based intelligent terminal fault positioning device, method and equipment, which is used for solving the technical problems of the existing point embedding analysis for positioning software faults of intelligent mobile phones, such as unmatchable data acquisition, large amount of analysis data and complicated operation. The screen recording-based intelligent terminal fault positioning device, method and equipment are based on a push fault instruction, and a user uses screen recording as a tool to mark data by using special generated code values such as a fault code, a page code, an operation code and an interaction code, and collects and reports the data to generate intuitive fault recording data of user operation, and the fault position is obtained by comparison and identification of generated simulation data, which is beneficial to fault analysis and positioning, realizes fast acquisition of fault recording data of user operation, intuitively compares data, and achieves the purpose of fast positioning and solving of faults.

[0037] Embodiment one:

[0038] Figure 1 A framework diagram of the screen recording-based intelligent terminal fault positioning device described in the embodiments of the application.

[0039] As shown in Figure 1 The application provides a screen recording-based intelligent terminal fault positioning device, which comprises a data collection module 10, a data processing module 20, a data simulation module 30 and a fault positioning module 40. The data collection module 10 is connected with the data processing module 20 and the data simulation module 30, and the data processing module 20 and the data simulation module 30 are both connected with the fault positioning module 40.

[0040] In the embodiments of the application, the data collection module 10 is used for collecting fault recording data and test acceptance data of the intelligent terminal.

[0041] It should be noted that the data collection module 10 collects test acceptance data of the intelligent terminal detected as qualified at the time of factory shipment or software release, and collects data of the operation of the intelligent terminal when a fault occurs, and the data can be obtained by recording fault recording data by a user or a maintenance station. In the embodiments, the intelligent terminal can be a mobile phone or a tablet computer.

[0042] Further, the fault recording data and the test acceptance data collected by the data collection module 10 are both marked with code values, and the data collection module 10 comprises a first data collection sub-module and a second data collection sub-module.

[0043] The first data collection sub-module is used for collecting data of a test intelligent terminal and marked with an interaction code value and / or an operation code value as test acceptance data.

[0044] The second data collection sub-module is used for collecting data of a user recording a running intelligent terminal after a fault occurs and marked with a fault code value as fault recording data.

[0045] The fault recording data and the test acceptance data each include environment information, interaction information and video recording information of the intelligent terminal.

[0046] It should be noted that the data acquisition module 10 implements acquisition of key data of various intelligent terminals, and acquisition of environment information, interaction information and video recording information. The environment information includes software configuration, system parameters, network environment and the like of the intelligent terminal. The video recording information refers to screen recording data of a fault recovery operation performed by a user. The interaction information refers to relevant data related to data access operations such as local storage and interface request.

[0047] In the embodiment of the present application, the fault recording data and the test acceptance data collected in the data acquisition module 10 are each marked with a code value. The data acquisition module 10 is arranged on the intelligent terminal, and the intelligent terminal is provided with a first code value module for generating a marked interaction code value.

[0048] It should be noted that the first code value module can generate a page code, an operation code and an interaction code. The page code can be generated by splicing and processing a fault code and / or a page identifier; the operation code can be generated by splicing and processing a page code and a user operation identifier; and the interaction code can be generated by splicing and processing an operation code and a data interaction identifier.

[0049] In the embodiment of the present application, the data processing module 20 can be used to identify and classify the fault recording data to obtain processing data.

[0050] It should be noted that the data processing module 20 mainly processes the fault recording data to obtain processing data. In the embodiment, the data processing module 20 identifies the fault recording data by reading the code value carried therein by frame extraction of the screen recording, and identifies the current belonging page, operation action and interaction after analysis; and then associates and classifies the analyzed data. The classification refers to collating and counting the data in a time period, and inducing user operation and software running state.

[0051] Further, the data processing module 20 includes an identification submodule and an association submodule.

[0052] The identification submodule is used to identify and classify the fault recording data according to the page, operation and interaction to obtain identification data.

[0053] The association submodule is used to associate the identification data according to a tree structure slice data model to obtain processing data.

[0054] The tree structure slice data model is a model constructed with time as a root node, and the page, operation and interaction from top to bottom.

[0055] It should be noted that the data processing module 20 is used to identify and classify the fault recording data. According to various interaction code values carried in the user screen recording, the fault recording data can be associated with the data of the tree structure slice data model, and the data information involved in the pages, operations, interactions and the like is recorded in the association process to obtain the processing data in the tree structure slice data model and store it. In this embodiment, the association rule is that, taking the data at a certain time point as an example, the data of the human-computer interaction operation on the page of the intelligent terminal is marked with a corresponding page code or operation code, and the data of the interaction is marked with a corresponding interaction code. The interaction code value is combined, encrypted and processed into a string, a two-dimensional code is generated and rendered in a fixed area of the screen, and through the analysis of the two-dimensional code, it can be known that the data at the time point is what page the intelligent terminal is in, what operation is performed, and what associated data is.

[0056] In the embodiment of the application, the data processing module 20 and the data simulation module 30 are both arranged on the server, and the server is provided with a second code value module. The second code value module is used to generate a fault code value and transmit it to the intelligent terminal so that the data acquisition module 10 can acquire the data of the page code, operation code and interaction code with the fault code value.

[0057] It should be noted that the page code, operation code and interaction code are provided with corresponding code values, and the code values are fixed-length, unordered, non-repeated and analyzable strings generated according to fixed rules. The intelligent terminal fault positioning device based on screen recording provides convenience for the fault positioning module 40 to more accurately perform fault positioning through the fault recording data marked by the data acquisition module 10 and the analysis and binding of the fault recording data in the identification and induction of the data processing module 20.

[0058] In the embodiment of the application, the data simulation module 30 is used to generate simulation data with code value marking according to the test acceptance data.

[0059] It should be noted that the data simulation module 30 analyzes the code values of the acquired test acceptance data, and statistically organizes all compliant data according to the page, operation and interaction association rules as simulation data.

[0060] In the embodiment of the application, the fault positioning module 40 is used to identify the fault position according to the comparison between the processing data and the simulation data.

[0061] It should be noted that the fault positioning module 40 mainly compares the processing data with the simulation data, finds out the difference between the data, and the difference corresponds to the position where the fault occurs. Through the fault positioning module 40, the position where the intelligent terminal fails is obtained, which is convenient for the maintainer to maintain.

[0062] The screen recording-based intelligent terminal fault positioning device provided in the application comprises a data acquisition module, a data processing module, a data simulation module and a fault positioning module; the data acquisition module is used to acquire fault recording data and test acceptance data of the intelligent terminal; the data processing module is used to identify and classify the fault recording data to obtain processed data; the data simulation module is used to generate simulation data with code value markers according to the test acceptance data; and the fault positioning module is used to identify the fault position by comparing the processed data with the simulation data. The screen recording-based intelligent terminal fault positioning device realizes rapid acquisition of fault recording data and processing of the fault recording data into processed data, and intuitive comparison of the processed data with simulation data to obtain the fault position, thereby achieving the purpose of rapid positioning and solving of faults, and solving the technical problems of existing point embedding analysis for positioning of software faults of intelligent terminals, such as unmatchable data acquisition, large amount of analysis data and complicated operation.

[0063] In an embodiment of the application, the screen recording-based intelligent terminal fault positioning device comprises a visualization module 50, which is used to display the fault recording data, the test acceptance data, the processed data, the simulation data and the fault position. The data acquisition module 10 is further used to query the fault recording data through the visualization module 50 to stop the data acquisition operation of the data acquisition module 10.

[0064] It should be noted that the visualization module 50 can be arranged on a visualization platform, which is used to display the data processed by the data processing module 20 for the convenience of maintenance personnel to check; the fault recording data acquired by the data acquisition module 10 can also be checked to read the code value carried in the current frame when the data acquisition module 10 is stopped to check the specific data corresponding to the code value. The processed data generated according to the tree structure slice data model can also be directly checked.

[0065] Embodiment two:

[0066] Figure 2 The screen recording-based intelligent terminal fault positioning method described in the embodiments of the application has the step flowchart shown in the figure.

[0067] As Figure 2 shown, the application further provides a screen recording-based intelligent terminal fault positioning method, which comprises the following steps:

[0068] S10. Acquire test acceptance data of the intelligent terminal and fault instructions of the intelligent terminal, and acquire fault recording data by performing fault restoration operation on the intelligent terminal according to the fault instructions.

[0069] It should be noted that in step S10, test acceptance data of the intelligent terminal is acquired, and fault recording data is also acquired.

[0070] Further, the intelligent terminal fault positioning method based on screen recording receives the fault instruction of the intelligent terminal from the server, and then sends the fault instruction carrying the fault code in the push content to the intelligent terminal to identify the current fault to be processed. The data acquisition module on the intelligent terminal guides the user to read and agree to the relevant agreement after recognizing the fault code, and restores the fault operation of the intelligent terminal. The user records the screen through the ReplayKit framework during the process of restoring the fault operation of the intelligent terminal, and obtains the fault recording data.

[0071] It should be noted that ReplayKit is a screen recording framework in iOS mobile phones, and similar technologies exist in Android. The intelligent terminal fault positioning method based on screen recording can collect the data that may cause the fault by restoring the fault intelligent terminal once, thereby reducing the communication cost.

[0072] Further, the intelligent terminal fault positioning method based on screen recording includes:

[0073] Collecting the environment data of the intelligent terminal system, including user information, system data, software configuration, etc.

[0074] During the process of restoring the operation of the intelligent terminal, generating a page code for the fault related page; generating an operation code for user operations such as page switching, clicking, and inputting text; and generating an interaction code for local storage, network request, and other data interaction operations;

[0075] The network request around the fault needs to carry the interaction code in the request header for transmission, and the local storage is collected synchronously with the interaction code;

[0076] The generated page code, operation code, and interaction code are drawn in the screen in the form of a two-dimensional code and are updated in real time, for screen recording and collection, to obtain fault recording data.

[0077] It should be noted that the data around the fault is marked during the process of obtaining the fault recording data, which can provide more accurate data for restoring the intelligent terminal fault scene.

[0078] S20. Identifying, classifying, and processing the fault recording data to obtain processing data; and generating simulation data with code value marks according to the test acceptance data.

[0079] It should be noted that the details of generating and processing the simulated data in step S20 have already been described in the data processing module 20 and data simulation module 30 of Embodiment 1, and will not be repeated here. In this embodiment, after the fault recording data is collected in step S10, the fault recording data is encrypted. The fault recording data carrying the fault code in the request header is transmitted to the server-side data processing module 20 via an HTTPS request. After receiving the fault recording data carrying the fault code, the server-side data processing module 20 performs data association. It obtains environmental information, interaction information, and video recording information of the smart terminal from the fault recording data, extracts all code value information from the fault recording data, concatenates them to obtain processed data in a tree-structured slice data model, and stores it.

[0080] S30. Based on the comparison between the processed data and the simulated data, the location of the fault is identified.

[0081] It should be noted that the fault location identified in step S30 has been detailed in the fault location module 40 of Embodiment 1, and will not be described in detail here.

[0082] In this embodiment of the application, the screen recording-based smart terminal fault location method includes displaying fault recording data, test and acceptance data, processing data, simulation data, and fault location for users or repairers to view.

[0083] It should be noted that this screen recording-based smart terminal fault location method allows users to view the fault handling process through a visualization platform, selectively view the complete screen recording process of user operations, or select a single operation to view data. That is, view page details through a specific fault, view operation details through a specific page, and view data details through a specific operation.

[0084] The screen recording-based fault location method for smart terminals provided in this application includes acquiring test and acceptance data and fault commands of the smart terminal, and obtaining fault recording data by having the user perform a fault restoration operation on the smart terminal according to the fault commands; identifying and classifying the fault recording data to obtain processed data; generating simulated data with code value markers based on the test and acceptance data; and identifying the fault location by comparing the processed data with the simulated data. This screen recording-based fault location method for smart terminals identifies the fault location of the smart terminal by comparing the processed data obtained from the marked fault recording data and test and acceptance data with the simulated data. This avoids the problems of data mismatch, large analysis data volume, and cumbersome operation, and solves the technical problems of existing methods for fault location of smartphone software that use embedded point analysis, which suffer from data mismatch, large analysis data volume, and cumbersome operation.

[0085] In this embodiment, the server receives a fault report from a smart terminal. The fault is that after entering page A on the smart terminal, the entire page is blank and there is no response to operations. After receiving the fault command, the server generates and issues a fault code trigger process, guiding the user to perform a restore operation on the smart terminal. The server's data processing module and data simulation module receive the test acceptance data and fault recording data collected from the smart terminal. When the personnel or repairers view the test acceptance data and fault recording data on the visualization platform, they find that the page is abnormal when displaying a certain interaction code in the fault recording data. By processing the interaction code through the visualization platform tools, it is determined that the fault page is page A, and the user performed operation B on the smart terminal. The data interaction involved is a request from interface C. Through manual identification, it is found that there are no abnormalities in the logical processing and data, thus achieving fault location.

[0086] Example 3:

[0087] This application also provides a storage device storing a plurality of program codes, which are adapted to be loaded and run by a processor to perform the above-described screen recording-based smart terminal fault location method.

[0088] Example 4:

[0089] This application also provides a terminal device, including a processor and a memory;

[0090] Memory is used to store program code and transfer the program code to the processor;

[0091] The processor is used to execute the above-mentioned screen recording-based smart terminal fault location method according to the instructions in the program code.

[0092] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0093] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between apparatuses or units through some interfaces, and may be electrical, mechanical, or other forms.

[0094] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0095] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0096] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0097] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A fault location device for a smart terminal based on screen recording, characterized in that, It includes a data acquisition module, a data processing module, a data simulation module, and a fault location module; The data acquisition module is used to collect fault recording data and test acceptance data of the smart terminal; The data processing module is used to identify and classify the fault recording data to obtain processed data; The data processing module is specifically used to associate the fault recording data with the data of the tree-structured slice data model based on the various interaction code values ​​carried in the fault recording data. During the association process, at least one type of data information involving pages, operations, and interactions is recorded to obtain processed data based on the tree-structured slice data model, and the processed data based on the tree-structured slice data model is stored. The association rule is as follows: data involving human-computer interaction operations on the page of the smart terminal is marked with a corresponding page code or operation code, and interactive data is marked with a corresponding interaction code. The interaction code values ​​are combined, encrypted, and processed into a string to generate a QR code that is rendered in a fixed area of ​​the screen. The QR code is used to parse and obtain the processed data at the target time point. The data simulation module is used to generate simulated data with code value markers based on the test and acceptance data; The fault location module is used to identify the fault location by comparing the processed data with the simulated data.

2. The intelligent terminal fault location device based on screen recording according to claim 1, characterized in that, include: A visualization module is used to display the fault recording data, the test and acceptance data, the processing data, the simulation data, and the fault location.

3. The intelligent terminal fault location device based on screen recording according to claim 2, characterized in that, The data acquisition module is also used to stop the data acquisition operation of the data acquisition module based on the fault recording data queried through the visualization module.

4. The intelligent terminal fault location device based on screen recording according to claim 1, characterized in that, The fault recording data and the test acceptance data collected by the data acquisition module are both marked with code values. The data acquisition module includes a first data acquisition submodule and a second data acquisition submodule. The first data acquisition submodule is used to acquire data from the test smart terminal that is marked with interaction code value and / or operation code value as test acceptance data; The second data acquisition submodule is used to collect data recorded by the user after a fault occurs, showing the operation of the smart terminal and marked with fault code values, as fault recording data; The fault recording data and the test acceptance data both include environmental information, interaction information and video recording information of the smart terminal.

5. The intelligent terminal fault location device based on screen recording according to claim 1, characterized in that, The data processing module includes an identification submodule and an association submodule; The identification submodule is used to identify and classify the fault recording data based on the page, operation, and interaction to obtain identification data. The association submodule is used to associate the identified data according to the tree-structured slice data model to obtain processed data.

6. The intelligent terminal fault location device based on screen recording according to claim 5, characterized in that, The tree-structured slice data model is a model with time as the root node, and from the top to the bottom, it is a model constructed from pages, operations, and interactions.

7. A method for fault location of a smart terminal based on screen recording, characterized in that, Includes the following steps: Acquire test and acceptance data of the smart terminal and fault instructions for its failure, and obtain fault recording data by having the user perform a fault restoration operation on the smart terminal according to the fault instructions; The fault recording data is identified and categorized to obtain processed data; The specific steps include: associating the fault recording data with the data of the tree-structured slice data model based on the various interaction code values ​​carried in the fault recording data; recording at least one type of data information involving pages, operations, and interactions during the association process to obtain processed data based on the tree-structured slice data model and storing the processed data based on the tree-structured slice data model; wherein, the association rule is: data of human-computer interaction operations on the page of the smart terminal is marked with a corresponding page code or operation code, and interactive data is marked with a corresponding interaction code; the interaction code values ​​are combined, encrypted, and processed into a string to generate a QR code that is rendered in a fixed area of ​​the screen; the QR code is used to parse and obtain the processed data at the target time point; And generate simulated data with code value markers based on the test and acceptance data; The location of the fault is identified by comparing the processed data with the simulated data.

8. The method for fault location of a smart terminal based on screen recording according to claim 7, characterized in that, include: The fault recording data, test and acceptance data, processing data, simulation data, and fault location are displayed for users or repair personnel to view.

9. A storage device storing a plurality of program codes, characterized in that, The program code is adapted to be loaded and run by a processor to perform the screen recording-based smart terminal fault location method as described in claim 7 or 8.

10. A terminal device, characterized in that, Including processor and memory; The memory is used to store program code and transmit the program code to the processor; The processor is configured to execute the screen recording-based smart terminal fault location method as described in claim 7 or 8 according to the instructions in the program code.

Images