Application analysis report generation method and device, computer device and storage medium
Patent Information
- Application Number
- CN202211149521.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-21
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2042-09-21
AI Technical Summary
[0002]金融科技背景下,互联网金融产品成为企业外部形象和获客、黏客的重要媒介,但互联网金融产品由于隶属不同业务部门,分属不同开发团队,在应用产品的设计和研发过程中,存在标准不统一的情况,导致相同品牌对外展示的应用产品存在不一致问题,给客户造成了体验的割裂感,影响用户体验,同时,也降低了应用产品的专业程度
[0054]The aforementioned application analysis report generation method, apparatus, computer equipment, storage medium, and computer program product acquire images of object operations collected by a wearable device worn by the target object. Based on these images, they determine the target object's operational behavior data and the interface element recognition data of the target application. This operational behavior data is then added to a preset analysis report template to obtain a report to be analyzed. The report is then analyzed and processed to obtain analysis results. Finally, a target analysis report is generated based on these results and the report to be analyzed. This allows for the collection of application interface data and target object operational data using a wearable device while the target object is using the target application. By simulating ordinary users' use of the target application, it is possible to collect operational behavior data and interface element recognition data that real users may exhibit when using the target application. The data is then analyzed in an analysis report template. Based on the analysis results and the report to be analyzed, a target analysis report is generated, thus completing the analysis of the target application and generating a corresponding target analysis report. This comprehensive standardized analysis and review of the data generated during the target user's use of the target application can reduce the error rate in the standardization process of the application product and shorten the standardization analysis and review time, thereby improving the efficiency of application product analysis and effectively enhancing the efficiency of application product standardization review.
Smart Images

Figure CN115686320B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computers, and in particular to an application analysis report generation method, apparatus, computer equipment, storage medium, and computer program product. Background Technology
[0002] In the context of fintech, internet finance products have become an important medium for companies to enhance their external image and acquire and retain customers. However, because internet finance products belong to different business departments and are developed by different teams, there are inconsistencies in the design and development of application products. This leads to inconsistencies in the application products presented by the same brand, creating a fragmented experience for customers, affecting user experience, and reducing the professionalism of the application products.
[0003] However, in traditional technologies, the standardization of internet finance products is characterized by high costs, low efficiency, and long time consumption. Moreover, the error rate is relatively high during the standardization process of application products, resulting in low efficiency in the analysis of application products and hindering the improvement of the standardization review efficiency of application products. Summary of the Invention
[0004] Therefore, it is necessary to provide an application analysis report generation method, apparatus, computer equipment, computer-readable storage medium, and computer program product that can improve the efficiency of application product analysis and review, in order to address the above-mentioned technical problems.
[0005] In a first aspect, this application provides an application analysis report generation method, applied to a terminal device, the method comprising:
[0006] Acquire object operation images sent by the wearable device of the target object; the object operation images are images captured by the wearable device during the target object's operation of the target application;
[0007] Based on the object operation image, determine the operation behavior data of the target object and the interface element identification data of the target application;
[0008] The operation behavior data and the interface element recognition data are added to a preset analysis report template to obtain the analysis report;
[0009] The report to be analyzed is processed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions.
[0010] Based on the analysis results and the report to be analyzed, a target analysis report is generated; the target analysis report is used to review the target application.
[0011] In one embodiment, the object operation image includes an application interface image of the target application and an eye image of the target object. The step of determining the operation behavior data of the target object and the interface element recognition data of the target application based on the object operation image includes:
[0012] Based on the eye image of the target object, determine the eye movement trajectory of the target object;
[0013] Based on the eye movement trajectory, determine the position information of the gaze point of the target object in each of the application interface images;
[0014] The location information is used as the operation behavior data of the target object.
[0015] In one embodiment, determining the operation behavior data of the target object and the interface element identification data of the target application based on the object operation image includes:
[0016] The application interface image is subjected to image recognition to determine the interface recognition result of the target application; the interface recognition result includes at least one of interface text information or interface icon information; the interface icon information includes at least one of icon object size information, position information, and color information.
[0017] The interface recognition results of the target application are used as the interface element recognition data of the target application.
[0018] In one embodiment, obtaining the target analysis report based on the analysis results and the report to be analyzed includes:
[0019] Add the analysis results to the report to be analyzed to obtain the report to be annotated:
[0020] The usage records of the target object on the terminal are obtained, and the usage records are used as annotation information to annotate the report to be annotated, thereby obtaining the target analysis report.
[0021] In one embodiment, after obtaining the target analysis report based on the analysis results and the report to be analyzed, the method further includes:
[0022] Send an analysis report upload request to the cloud platform; the analysis report upload request is used to instruct the cloud platform to store the target analysis report carried in the analysis report upload request;
[0023] The cloud platform is used to respond to a report processing request for the target analysis report and perform a report processing operation corresponding to the processing request on the target analysis report.
[0024] This application provides a method for generating application analysis reports, applied to wearable devices, the method comprising:
[0025] Collect object operation images generated during the operation of the target object in the target application;
[0026] The system sends the object operation image to a terminal device; the terminal device determines the operation behavior data of the target object and the interface element identification data of the target application based on the object operation image; the operation behavior data and the interface element identification data are added to a preset analysis report template to obtain a report to be analyzed; the report to be analyzed is processed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions; a target analysis report is generated based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application.
[0027] In one embodiment, the wearable device is equipped with a first camera and a second camera, and the acquisition of object operation images generated by the target object during the operation of the target application includes:
[0028] The first camera captures images of the target object's eyes to obtain an eye image corresponding to the target object;
[0029] The second camera captures images of the target application's interface to obtain an image of the application interface corresponding to the target application.
[0030] The eye image and the application interface image are used as the object operation images.
[0031] In one embodiment, the method further includes:
[0032] An image setting area is displayed in the user interface of the wearable device; the image setting area is used to characterize the area where the application interface image is located in the user interface.
[0033] In response to an adjustment operation on the image setting area, the adjusted image setting area is displayed; the adjustment operation includes adjusting the focal area range or focal position within the image setting area.
[0034] In one embodiment, the wearable device further includes a laser emitter for emitting laser light onto a target display device; the target display device is a display device of an electronic device running the target application, and the method further includes:
[0035] Identify the location of the laser emitted by the laser emitter in the application interface image;
[0036] The acquisition status of the wearable device is determined based on the distance between the landing point location and the focal area range or the focal point location;
[0037] If the data acquisition status meets the abnormal acquisition conditions, the wearable device will output a data acquisition adjustment prompt.
[0038] In one embodiment, the wearable device is further provided with an inertial sensing module, and the method further includes:
[0039] The inertial sensing module is used to obtain the motion speed and device attitude of the wearable device.
[0040] Based on the movement speed and device posture, the wearing status of the wearable device is determined;
[0041] If the wearing condition meets the abnormal wearing conditions, the wearable device will output a wearing adjustment prompt.
[0042] Secondly, this application also provides an application analysis report generation device for use in a terminal device, the device comprising:
[0043] The image acquisition module is used to acquire object operation images sent by the wearable device of the target object; the object operation images are images captured by the wearable device during the target object's operation of the target application;
[0044] The data recognition module is used to determine the operation behavior data of the target object and the interface element recognition data of the target application based on the object operation image;
[0045] The data addition module is used to add the operation behavior data and the interface element recognition data to a preset analysis report template to obtain the analysis report;
[0046] The report analysis module is used to analyze and process the report to be analyzed and obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions.
[0047] The report generation module is used to generate a target analysis report based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application.
[0048] This application also provides an application analysis report generation device for wearable devices, the device comprising:
[0049] The image acquisition module is used to acquire object operation images generated during the operation of the target object in the target application;
[0050] An image sending module is used to send the object operation image to a terminal device; the terminal device is used to determine the operation behavior data of the target object and the interface element recognition data of the target application based on the object operation image; add the operation behavior data and the interface element recognition data to a preset analysis report template to obtain a report to be analyzed; analyze and process the report to be analyzed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions; generate a target analysis report based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application.
[0051] Thirdly, this application also provides a computer device, the computer device including a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the method described in any of the above aspects.
[0052] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method described in any of the preceding aspects.
[0053] Fifthly, this application also provides a computer program product, which includes a computer program that, when executed by a processor, implements the steps of the method described in any of the preceding aspects.
[0054] The aforementioned application analysis report generation method, apparatus, computer equipment, storage medium, and computer program product acquire images of object operations collected by a wearable device worn by the target object. Based on these images, they determine the target object's operational behavior data and the interface element recognition data of the target application. This operational behavior data is then added to a preset analysis report template to obtain a report to be analyzed. The report is then analyzed and processed to obtain analysis results. Finally, a target analysis report is generated based on these results and the report to be analyzed. This allows for the collection of application interface data and target object operational data using a wearable device while the target object is using the target application. By simulating ordinary users' use of the target application, it is possible to collect operational behavior data and interface element recognition data that real users may exhibit when using the target application. The data is then analyzed in an analysis report template. Based on the analysis results and the report to be analyzed, a target analysis report is generated, thus completing the analysis of the target application and generating a corresponding target analysis report. This comprehensive standardized analysis and review of the data generated during the target user's use of the target application can reduce the error rate in the standardization process of the application product and shorten the standardization analysis and review time, thereby improving the efficiency of application product analysis and effectively enhancing the efficiency of application product standardization review. Attached Figure Description
[0055] To better describe and illustrate the embodiments and examples disclosed herein, reference may be made to one or more accompanying drawings. Additional details or examples used to describe the drawings should not be considered as limiting the scope of any of the disclosed inventions, the currently described embodiments and / or examples, or the best mode of these inventions as currently understood.
[0056] Figure 1 This is an application environment diagram of an application analysis report generation method in one embodiment;
[0057] Figure 2 This is a flowchart illustrating an application analysis report generation method in one embodiment;
[0058] Figure 3 This is a flowchart illustrating the process of determining operation behavior data and interface element identification data in one embodiment.
[0059] Figure 4 This is a flowchart illustrating the process of determining the target analysis report in one embodiment;
[0060] Figure 5 This is a flowchart illustrating an application analysis report generation method in another embodiment;
[0061] Figure 6This is a flowchart illustrating an image acquisition process for an object in one embodiment.
[0062] Figure 7 This is a schematic diagram illustrating a process for adjusting a defined area of an image in one embodiment.
[0063] Figure 8 This is a flowchart illustrating the process of determining the acquisition status in one embodiment;
[0064] Figure 9 This is a flowchart illustrating the process of determining the wearing status in one embodiment;
[0065] Figure 10 This is a structural block diagram of an application analysis report generation device in one embodiment;
[0066] Figure 11 This is a structural block diagram of an application analysis report generation device in another embodiment;
[0067] Figure 12 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation
[0068] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0069] It should be noted that the application analysis report generation method, apparatus, computer equipment, storage medium and computer program products disclosed in this application can be applied to the financial technology field, and can also be used in any field other than the financial technology field.
[0070] The application analysis report generation method provided in this application embodiment can be applied to, for example, Figure 1In the application environment shown, terminal 102 communicates with server 104 via a network. A data storage system can store the data that server 104 needs to process. The data storage system can be integrated onto server 104 or placed on a cloud or other network server. In practical applications, terminal 102 acquires object operation images sent by the wearable device 106 of the target object; the object operation images are images collected during the target object's operation of the target application via the wearable device; based on the object operation images, terminal 102 determines the target object's operation behavior data and the target application's interface element recognition data; terminal 102 adds the operation behavior data and interface element recognition data to a preset analysis report template to obtain a report to be analyzed; terminal 102 analyzes and processes the report to be analyzed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions; terminal 102 generates a target analysis report based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application. Terminal 102 sends the target analysis report to server 104. Terminal 102 can be, but is not limited to, various personal computers, laptops, smartphones, and tablets. Server 104 can be implemented using a standalone server or a server cluster consisting of multiple servers. It is understood that this method can also be applied to server 104, and also to a system including terminal 102 and server 104, and implemented through the interaction between terminal 102 and server 104.
[0071] In one exemplary embodiment, such as Figure 2 As shown, an application analysis report generation method is provided. This embodiment uses the application of this method to a terminal as an example for illustration. In this embodiment, the method includes the following steps:
[0072] S210, acquire the object operation image sent by the wearable device of the target object.
[0073] The target audience can refer to individuals wearing wearable devices. In practical applications, this target audience may include, but is not limited to, users of the target application and application review personnel who analyze and audit the target application.
[0074] The object manipulation image can refer to an image captured by the wearable device during the target object manipulation application process. In practical applications, the image format of the object manipulation image can include, but is not limited to, bitmap (BMP), tag image file format (TIFF), Joint Photographic Experts Group (JPEG) format, and portable network graphics (PNG).
[0075] The target application can refer to an application that requires analysis and review. For example, the target application could be an internet finance product that requires standardized review.
[0076] In some embodiments, when a target object needs to perform standardized review of an application, the target object can use its currently worn wearable device to collect images captured during the target object's operation of the application, so that the wearable device can capture images of the object's operation; then, the wearable device sends the captured images of the object's operation to the terminal, so that the terminal can obtain the images of the object's operation sent by the wearable device.
[0077] S220, based on the above object operation image, determine the operation behavior data of the above target object and the interface element recognition data of the above target application.
[0078] Among them, operation behavior data can refer to the behavior data of the target object collected by the wearable device during the operation of the target application. In practical applications, operation behavior data may include, but is not limited to, the target object's eye movement speed, the time the eyes stay on different pages, and the movement time and angle of the wearable device.
[0079] Among them, interface element recognition information can refer to element recognition data obtained by recognizing the interface image of the target application based on the wearable device during the operation of the target application by the target object. In practical applications, interface element recognition data can include text data and icon data in the interface of the target application.
[0080] In some embodiments, the terminal performs image recognition on the object operation image based on image recognition technology to obtain the operation behavior data of the target object and the interface element recognition data of the target application; for example, the terminal performs optical character recognition (OCR) on the object operation image to obtain the text data in the interface element recognition data of the target application.
[0081] S230, add the above-mentioned operation behavior data and the above-mentioned interface element recognition data to the preset analysis report template to obtain the analysis report.
[0082] Among them, the analysis report template can refer to the system's preset analysis report reference template. In actual applications, the format of the analysis report template includes, but is not limited to, Word format and preset special format. The analysis report template can also be an imported manually filled analysis report template.
[0083] The report to be analyzed can refer to the report containing the content that needs to be analyzed. In practical applications, the format of the report to be analyzed includes, but is not limited to, Word format and preset special format.
[0084] In some embodiments, the terminal identifies the object operation image to obtain operation behavior data and interface element identification data. The terminal adds the operation behavior data and interface element identification data to a preset analysis report template in a preset order to obtain the analysis report.
[0085] S240, The above-mentioned report to be analyzed is analyzed and processed to obtain the analysis results; the above analysis results are used to characterize whether at least one analysis item in the above-mentioned report to be analyzed meets the corresponding standardized inspection conditions.
[0086] As an example, standardized inspection conditions may include, but are not limited to, rule inspection conditions, page inspection conditions, information definition inspection conditions, and behavior inspection conditions.
[0087] In some embodiments, the terminal checks each item in the analysis report based on preset standardized inspection conditions to obtain the analysis results.
[0088] In an exemplary embodiment, the terminal checks the text information in the interface element recognition data item by item according to preset rule checking conditions. The terminal first identifies keywords in the text information of the interface element recognition data. Taking the keyword "details" as an example, the terminal checks whether the text information contains the following information elements according to the preset checking rules corresponding to the keyword: product code, product number, product category, product effective date, product expiration date, product unit price, product handling fee rate, product charging method, currency, interest rate, cash / foreign exchange, third-party information, etc. If these elements are present, the terminal determines that the rule passes and continues to search for the next keyword until the terminal completes the keyword search. If these elements are not present, or if there are missing items, the terminal determines that the rule fails, records the information that does not meet the requirements, and continues to search for the next keyword until the terminal completes the keyword search. After completing all rule checks, the terminal generates a list of rule check failure information, obtaining the rule check results.
[0089] In one exemplary embodiment, the terminal checks the interface information in the interface element recognition data item by item according to preset page inspection conditions to determine whether the page design meets standardization requirements. Taking the size of the button at the bottom of the page as an example, the terminal determines whether the size of the button at the bottom of the page meets the requirements based on the image recognition results. If it meets the page inspection requirements, the terminal determines that the rule passes and continues to check the next item until the terminal completes all item checks. If it does not meet the page inspection requirements, the terminal determines that the rule fails and records the information of non-compliance. After recording, the terminal continues to check the next item until the terminal completes all item checks. After completing all page checks, the terminal generates a list of page inspection failure information, thus obtaining the page inspection result.
[0090] In one exemplary embodiment, the terminal checks the input and output information definitions in the interface element recognition data item by item according to preset information definition check conditions. Taking the page name check as an example, the preset standardized rule requires the page name format to be "atomic function name|page name". Based on the image recognition result, the terminal determines whether the page name meets the requirements. If it meets the information definition requirements, the terminal determines that the rule passes and continues to check the next item until the terminal completes all item checks. If it does not meet the information definition requirements, the terminal determines that the rule fails and records the information that does not meet the requirements. After recording, the terminal continues to check the next item until the terminal completes all item checks. After completing all checks, a list of information definition failure information is generated, and the information definition check result is obtained.
[0091] As an example, the analysis results may include, but are not limited to, rule check results, page check results, and information definition check results.
[0092] S250, Based on the above analysis results and the above report to be analyzed, generate a target analysis report; the above target analysis report is used to review the above target application.
[0093] The target analysis report can be in formats including, but not limited to, Word format and preset custom formats.
[0094] In some embodiments, after the terminal completes the analysis, a target analysis report is generated based on the analysis results and the report to be analyzed. In practical applications, the terminal can add the analysis results to the report to be analyzed in real time, or it can form a preset file for the analysis results separately and then merge the preset file formed by the analysis results with the report to be analyzed.
[0095] The aforementioned application analysis report generation method, apparatus, computer equipment, storage medium, and computer program product acquire images of object operations collected by a wearable device worn by the target object. Based on these images, they determine the target object's operational behavior data and the interface element recognition data of the target application. This operational behavior data is then added to a preset analysis report template to obtain a report to be analyzed. The report is then analyzed and processed to obtain analysis results. Finally, a target analysis report is generated based on these results and the report to be analyzed. This allows for the collection of application interface data and target object operational data using a wearable device while the target object is using the target application. By simulating ordinary users' use of the target application, it is possible to collect operational behavior data and interface element recognition data that real users may exhibit when using the target application. The data is then analyzed in an analysis report template. Based on the analysis results and the report to be analyzed, a target analysis report is generated, thus completing the analysis of the target application and generating a corresponding target analysis report. This comprehensive standardized analysis and review of the data generated during the target user's use of the target application can reduce the error rate in the standardization process of the application product and shorten the standardization analysis and review time, thereby improving the efficiency of application product analysis and effectively enhancing the efficiency of application product standardization review.
[0096] In one exemplary embodiment, such as Figure 3 As shown, the object operation image includes the application interface image of the target application and the eye image of the target object. The process of determining the operation behavior data of the target object and the interface element recognition data of the target application based on the object operation image includes:
[0097] S310, Based on the eye image of the target object, determine the eye movement trajectory of the target object.
[0098] Among them, eye image can refer to the image of the target object's eyes captured by the camera set on the wearable device during the target object's operation of the target application; eye movement trajectory can refer to the movement trajectory of the target object's eyes obtained from the analysis of eye images.
[0099] In some embodiments, the terminal determines a preset feature in the eye image as a reference point based on at least two eye images of the target object collected by the wearable device. In practical applications, the preset feature may include the pupil position. The terminal obtains the eye movement trajectory of the target object by comparing the position changes of the reference point in at least two eye images.
[0100] S320, based on the aforementioned eye movement trajectory, determine the position information of the gaze point of the aforementioned target object in each of the aforementioned application interface images.
[0101] As an example, the fixation point can be the point corresponding to the pupil of the target object.
[0102] In some embodiments, the terminal determines the movement trajectory of the gaze point of the target object based on the eye movement trajectory, determines the position information of the gaze point of the target object in the application interface image based on the correspondence between the eye movement trajectory and the application interface image, and determines the position information change data of the gaze point in the application interface based on the position information and the movement trajectory of the gaze point.
[0103] S330, the above location information is used as the operation behavior data of the above target object.
[0104] Location information can refer to the location information of the gaze point in the application interface.
[0105] In some embodiments, the terminal uses operation behavior data to calculate the time the target object's eyes stay at different coordinates on the application page, so as to provide a basis for decision-making in adjusting page content, structure and highlights. In practical applications, the target object's operation behavior data can be used for behavior inspection.
[0106] In this embodiment, by recognizing and analyzing the eye image in the object operation image, the position information of the target object's gaze point in the application interface image is determined, and this position information is used as the target object's operation behavior data. This enables the collection and acquisition of the target object's operation behavior and provides a basis for the analysis of the target object's operation behavior data.
[0107] In an exemplary embodiment, determining the operation behavior data of the target object and the interface element identification data of the target application based on the object operation image includes:
[0108] Image recognition is performed on the above application interface image to determine the interface recognition result of the target application; the interface recognition result includes at least one of interface text information or interface icon information; the interface icon information includes at least one of icon object size information, position information, and color information.
[0109] The interface recognition result can refer to the element information contained in the application interface image obtained through image recognition. In practical applications, the interface recognition result may include, but is not limited to, text information, page design information, and page icon information in the interface.
[0110] In some embodiments, the terminal performs image recognition on the application interface image based on image recognition technology, and obtains the interface recognition result corresponding to the target application according to preset standardized review rules. In practical applications, the preset standardized review rules may include, but are not limited to, the positional relationship between interface text information and interface icon information. The standardized review rules may be formulated by specific business requirements. For example, the button icon in the interface icon is set at the bottom of the interface. When there are multiple buttons on the page, the "back" button is located at the bottom of all related transaction buttons. All related transaction buttons are solid, and the "back" button has a white background. When the application displays an operation success interface, the size of the icon indicating operation success can be 128px*80px. When the page only has a back button, the "back" button is solid. The date format in the interface text information includes, but is not limited to, day-day / month-month / year-year and year-year-month-month-day.
[0111] The interface recognition results of the target application are used as the interface element recognition data of the target application.
[0112] In this embodiment, by recognizing and analyzing the eye image in the object operation image, the interface recognition result of the target application is determined, and the interface recognition result is used as the interface element recognition data of the target application. This enables the collection and acquisition of the interface elements of the target application and provides a basis for the analysis of the interface element recognition data of the target application.
[0113] In one exemplary embodiment, such as Figure 4 As shown, based on the above analysis results and the above report to be analyzed, the target analysis report is obtained, including:
[0114] S410, add the above analysis results to the above report to be analyzed to obtain the report to be annotated.
[0115] Among them, the report to be annotated can be a report that needs to be annotated after the analysis is completed. In practical applications, the format of the report to be annotated includes, but is not limited to, Word format and preset special format.
[0116] S420, obtain the usage records of the target object on the terminal, and use the usage records as annotation information to annotate the report to be annotated, thereby obtaining the target analysis report.
[0117] Usage records can refer to data used to record usage traces.
[0118] In practical applications, usage records may include, but are not limited to, user information of the analysis tool, IP address used, and process logs.
[0119] In some embodiments, the terminal obtains usage records related to the current operation from the usage record database, and uses the usage records as annotation information to annotate the report to be annotated, thereby obtaining the target analysis report corresponding to the target application.
[0120] In this embodiment, by using the usage records of the target object on the terminal as annotation information to annotate the report to be annotated, the association between the usage records and the target analysis report can be realized, the information content of the target analysis report can be enriched, the correlation between the usage records and the target analysis report can be enhanced, and the generation process of the target analysis report can also be monitored and recorded.
[0121] In one exemplary embodiment, after obtaining the target analysis report based on the above analysis results and the above report to be analyzed, the method further includes:
[0122] An analysis report upload request is sent to the cloud platform; the analysis report upload request is used to instruct the cloud platform to store the target analysis report carried by the analysis report upload request; wherein, the cloud platform is used to respond to the report processing request of the target analysis report and perform the report processing operation corresponding to the processing request on the target analysis report.
[0123] As an example, report processing requests may include, but are not limited to, storage requests, viewing requests, and invocation requests.
[0124] In some embodiments, the cloud platform also includes a communication module, a storage module, a control module, an allocation module, a tool update module, and a client information checking module. The communication module is used to interact with wearable devices and terminals. The storage module is used to store, view, and manage reports; store, view, and manage scanning information of terminals and wearable devices; store installation records, etc. The storage module can also provide API interfaces and support access and invocation from multiple applications and platforms. The control module is used to view and manage the operating status of terminals. The allocation module is used to view and manage human positions and support task allocation. The tool update module is used to develop, update, debug, and upload new tools. It can rely on multiple development languages such as Python and VB for tool development and supports auxiliary development of user UI interaction based on screen recording, control capture, etc. The tool update module can directly perform tool development, updates, and debugging within this module. The client information checking module is used to check the version information of each local client and smart wearable device to confirm the local clients that need to be updated.
[0125] In an exemplary embodiment, the terminal is further provided with a scanning module, an installation module, a document version detection module, and a debugging module. Based on a preset period, the terminal automatically starts the scanning module to scan the application version information of the terminal. After the scan is completed, the scanning module sends the updated information such as the application version number, IP and MAC address of the terminal to the storage module in the cloud platform. In practical applications, the preset period parameters of the scanning module can be adjusted according to the needs of the target object. The adjusted period parameters include, but are not limited to, once a week, once a month, once a quarter, and once a year. Taking application updates on the terminal as an example, the terminal compares the scan results from the scanning module with the latest scan information of the terminal in the storage module of the cloud platform to determine the applications that need to be updated and generate a list of applications to be updated. Based on the IP and MAC addresses in the update information, the terminal obtains the update commands and installation packages from the list of applications to be updated sent by the cloud platform, and performs the installation and update, including registration, script execution, and plugin installation. After installation, the document version detection module checks the document editing software on the terminal. If the document editing software does not meet the version requirements, the terminal automatically installs the latest version of the document editing software, such as Word and WPS. If the document editing software meets the version requirements, the terminal directly enters the debugging module and performs operations such as creating a new path and creating a new standard dictionary. After installation and updates are completed, the terminal generates an installation log and sends the installation log to the cloud platform, which then updates the installation log.
[0126] In this embodiment, by responding to the analysis report upload request and uploading the analysis report to the cloud platform, the target analysis report can be managed on the cloud platform, facilitating operations such as calling the target analysis report.
[0127] In one exemplary embodiment, such as Figure 5 As shown, an application analysis report generation method is provided for wearable devices. The method includes:
[0128] S510, acquires object operation images generated by the target object during the operation of the target application.
[0129] S520, the object operation image is sent to the terminal device; the terminal device is used to determine the operation behavior data of the target object and the interface element recognition data of the target application based on the object operation image; the operation behavior data and the interface element recognition data are added to a preset analysis report template to obtain an analysis report; the analysis report is processed to obtain an analysis result; the analysis result is used to characterize whether at least one analysis item in the analysis report meets the corresponding standardized check conditions; a target analysis report is generated based on the analysis result and the analysis report; the target analysis report is used to review the target application.
[0130] In this embodiment, an object operation image is collected by a wearable device and sent to a terminal device. This enables the interaction between the wearable device and the terminal device after the object operation image is collected, facilitating the recognition and analysis of the object operation image by the terminal device.
[0131] In one exemplary embodiment, such as Figure 6 As shown, the wearable device is equipped with a first camera and a second camera. The aforementioned acquisition of object operation images generated during the operation of the target object by the target object includes:
[0132] S610, the first camera is used to capture an image of the target object's eyes to obtain an image of the target object's eyes.
[0133] The first camera may refer to a camera used to capture images of the eyes of the target object; the second camera may refer to a camera used to capture images of the interface of the target application.
[0134] S620: The second camera is used to capture images of the interface of the target application, thereby obtaining an image of the application interface corresponding to the target application.
[0135] S630, the above-mentioned eye image and the above-mentioned application interface image are used as the above-mentioned object operation image.
[0136] In some embodiments, the first camera captures images from the front to obtain an eye image corresponding to the target object, and the second camera captures images from the side to obtain an application interface image corresponding to the target application. The wearable device uses the eye image and the application interface image as the object operation image.
[0137] In this embodiment, by using a wearable device to collect eye images corresponding to the target object and application interface images corresponding to the target application, it is possible to collect object operation images and provide a data foundation for the analysis of object operation images.
[0138] In one exemplary embodiment, such as Figure 7 As shown, the above method also includes:
[0139] S710, an image setting area is displayed in the user interface of the wearable device; the image setting area is used to characterize the area where the application interface image is located in the user interface.
[0140] The user interface can refer to the interface through which the target object interacts with the wearable device.
[0141] S720, in response to the adjustment operation of the above-mentioned image setting area, the adjusted image setting area is displayed; the adjustment operation includes the adjustment operation of the focal area range or focal position in the above-mentioned image setting area.
[0142] As an example, the image setting area can include the focus area range or overlap with the focus area range.
[0143] In some embodiments, the target object adjusts the image setting area according to the operation state or operation habits, and the wearable device responds to the target object's adjustment operation on the image setting area by adjusting the size or position of the image setting area accordingly.
[0144] In this embodiment, by adjusting the image setting area of the wearable device, the flexibility of the wearable device when acquiring images of the object being manipulated can be increased.
[0145] In one exemplary embodiment, such as Figure 8 As shown, the wearable device also includes a laser emitter, which emits a laser beam onto a target display device; the target display device is a display device of an electronic device running the target application; and the method further includes:
[0146] S810, Identify the landing point of the laser emitted by the laser emitter in the application interface image.
[0147] The landing point location can refer to the position of the laser landing point in the application interface image. In practical applications, the laser emitted by the laser emitter includes visible light or invisible light.
[0148] In some embodiments, the terminal acquires the application interface image captured by the second camera, and extracts the laser landing point in the application interface using a preset extraction method to obtain landing point information. After the terminal performs noise reduction processing on the landing point information, it obtains the landing point location information in the application interface.
[0149] S820, based on the distance between the above-mentioned landing point location and the above-mentioned focal area range or focal point location, determine the collection status of the above-mentioned wearable device.
[0150] The focal area range can refer to the area within the image setting area that needs to be analyzed and reviewed, which is a preset proportion of the image setting area. In practical applications, the preset proportion of the focal area range to the image setting area range can include 1 / 3 and 1 / 2.
[0151] The focal position can refer to the location of the center point that represents the focal area. In practical applications, the shape of the focal area can include a circle and a rectangle.
[0152] The acquisition status can refer to the working state of the wearable device in acquiring the target application. In practical applications, the acquisition status may include, but is not limited to, capturing an image, not capturing an image, being in focus, and being out of focus.
[0153] In some embodiments, image recognition is used to obtain location information of the focal region or focal position. Based on the location information of the landing point and the boundary of the focal region, it is determined whether the laser landing point is within the focal region. Based on the landing point and focal position information, the distance between the laser landing point and the focal point is determined. If the laser landing point is within the focal region, this state is determined to be an image captured; if the laser landing point is not within the focal region, this state is determined to be an image not captured. If the distance between the laser landing point and the focal point is greater than a preset value, this state is determined to be out of focus; if the distance between the laser landing point and the focal point is less than or equal to the preset value, this state is determined to be focused. By determining the relationship between the laser landing point and the focal region or focal position, it is possible to determine whether an image has been acquired and it can also be used to assist focusing.
[0154] S830, if the above-mentioned acquisition status meets the abnormal acquisition conditions, the above-mentioned wearable device outputs acquisition adjustment prompt information.
[0155] Abnormal acquisition conditions can refer to acquisition states that do not meet preset requirements.
[0156] Among them, the collection and adjustment prompt information can refer to the information used to remind the target object to adjust the collection action. In practical applications, the prompting methods for collection and adjustment prompt information can include voice broadcast and text reminder.
[0157] In some embodiments, after the wearable device acquires the location information of the focal area or the focal position, if the laser point is not within the focal area or the distance between the laser point and the focal point is greater than a preset value, the wearable device can prompt the target object to adjust the acquisition action through voice broadcast, or the wearable device's user interface can display preset acquisition adjustment text information.
[0158] In this embodiment, by determining the position of the laser landing point and the positional relationship between the focal area range or the focal position, the acquisition status of the target object when using a wearable device for acquisition can be monitored in real time, and it can be determined whether an image has been captured or whether the image is out of focus, thereby realizing the monitoring and correction prompts of the acquisition status of the wearable device.
[0159] In one exemplary embodiment, such as Figure 9 As shown, the wearable device also includes an inertial sensing module, and the method further includes:
[0160] S910, the motion speed and device attitude of the wearable device are obtained through the inertial sensing module.
[0161] Among them, the inertial sensing module can refer to the module used to measure the motion speed and device attitude of the wearable device; the motion speed of the wearable device can refer to the motion speed characterizing the wearable device when it is working; and the device attitude of the wearable device can refer to the device attitude characterizing the target object when wearing the wearable device.
[0162] S920, based on the above-mentioned movement speed and device posture, determine the wearing status of the wearable device.
[0163] Among them, the wearing state of the wearable device can be used to characterize the physical state of the wearable device when the target user wears it. In practical applications, the wearing state can be obtained by measuring the angle between the wearable device and the vertical direction through the inertial sensing module.
[0164] In some embodiments, after the wearable device acquires the motion speed, it compares the motion speed with a preset speed threshold to determine whether the motion speed meets the preset requirements; after the wearable device acquires the device posture, it compares the angle used to characterize the device posture with a preset angle threshold to determine whether the device posture meets the preset requirements.
[0165] S930, when the above-mentioned wearing state meets the abnormal wearing conditions, the above-mentioned wearable device outputs wearing adjustment prompt information.
[0166] Abnormal wearing conditions can refer to wearing conditions that do not meet preset requirements;
[0167] Among them, the wearing adjustment prompt information can refer to information used to remind the target to adjust the wearing status. In practical applications, the prompting methods of wearing adjustment prompt information can include voice broadcast and text reminder.
[0168] In some embodiments, the wearable device acquires its movement speed and device posture through an inertial sensing module. If the movement speed is greater than a preset speed threshold, or the difference between the angle used to characterize the device posture and a preset angle threshold is not within a preset error range, the wearable device determines that the wearing status needs adjustment. The wearable device can prompt the target to adjust the wearing status through voice broadcast, or the wearable device's user interface can display preset wearing adjustment text information. For example, when the target turns their head quickly while wearing the wearable device, or the wearing angle of the wearable device is too tilted, the wearable device outputs wearing adjustment prompt text information to prompt the target user to adjust the wearing status.
[0169] In some embodiments, the above-mentioned collection adjustment prompts and wearing adjustment prompts can be implemented. The target user can choose to enable or disable the prompt function according to their usage habits and other specific circumstances. After the target user disables the prompt function, the wearable device will no longer output collection adjustment prompts and wearing adjustment prompts based on the collection status and wearing status.
[0170] In one exemplary embodiment, the wearable device, the terminal, and the cloud platform can be connected via a communication link, which can include various connection types, such as wired and / or wireless communication links.
[0171] In this embodiment, the motion speed and posture of the wearable device are obtained through the inertial sensing module, thereby determining the wearing status of the wearable device. This enables real-time monitoring of the wearing status of the wearable device when the target object is using the wearable device for data collection, facilitating the detection and correction of the wearing status and realizing the monitoring of the wearing status of the wearable device.
[0172] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0173] Based on the same inventive concept, this application also provides an application analysis report generation apparatus for implementing the application analysis report generation method described above. The solution provided by this apparatus is similar to the implementation scheme described in the above method; therefore, the specific limitations in one or more application analysis report generation apparatus embodiments provided below can be found in the limitations of the application analysis report generation method described above, and will not be repeated here.
[0174] In one exemplary embodiment, such as Figure 10 As shown, an application analysis report generation device is provided for use in a terminal device, including: an image acquisition module 1010, a data recognition module 1020, a data addition module 1030, a report analysis module 1040, and a report generation module 1050, wherein:
[0175] The image acquisition module 1010 is used to acquire object operation images sent by the wearable device of the target object; the object operation images are images captured by the wearable device during the target object's operation of the target application;
[0176] The data recognition module 1020 is used to determine the operation behavior data of the target object and the interface element recognition data of the target application based on the object operation image.
[0177] The data adding module 1030 is used to add the operation behavior data and the interface element recognition data to a preset analysis report template to obtain the analysis report;
[0178] The report analysis module 1040 is used to analyze and process the report to be analyzed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions.
[0179] The report generation module 1050 is used to generate a target analysis report based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application.
[0180] In an exemplary embodiment, the data recognition module 1020 is specifically configured to determine the eye movement trajectory of the target object based on the eye image of the target object, determine the position information of the gaze point of the target object in each of the application interface images based on the eye movement trajectory, and use the position information as the operation behavior data of the target object.
[0181] In an exemplary embodiment, the data recognition module 1020 is further configured to perform image recognition on the application interface image to determine the interface recognition result of the target application; the interface recognition result includes at least one of interface text information or interface icon information; the interface icon information includes at least one of icon object size information, position information, and color information, and the interface recognition result of the target application is used as the interface element recognition data of the target application.
[0182] In an exemplary embodiment, the report generation module 1050 is specifically used to add the analysis results to the report to be analyzed to obtain the report to be annotated, obtain the usage record of the target object on the terminal, and use the usage record as annotation information to annotate the report to be annotated to obtain the target analysis report.
[0183] In one exemplary embodiment, the above-described apparatus further includes a report uploading module, which is configured to send an analysis report upload request to a cloud platform; the analysis report upload request is configured to instruct the cloud platform to store the target analysis report carried in the analysis report upload request; wherein, the cloud platform is configured to perform a report processing operation corresponding to the processing request on the target analysis report in response to a report processing request for the target analysis report.
[0184] In one exemplary embodiment, such as Figure 11 As shown, an application analysis report generation device is provided for wearable devices, including: an image acquisition module 1110 and an image transmission module 1120, wherein:
[0185] Image acquisition module 1110 is used to acquire object operation images generated by the target object during the operation of the target application;
[0186] An image sending module 1120 is used to send the object operation image to a terminal device; the terminal device is used to determine the operation behavior data of the target object and the interface element recognition data of the target application based on the object operation image; add the operation behavior data and the interface element recognition data to a preset analysis report template to obtain a report to be analyzed; analyze and process the report to be analyzed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions; generate a target analysis report based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application.
[0187] In an exemplary embodiment, the image acquisition module 1110 is specifically used to acquire images of the interface of the target application through the first camera to obtain an application interface image corresponding to the target application, acquire images of the eyes of the target object through the second camera to obtain an eye image corresponding to the target object, and use the application interface image and the eye image as the object operation image.
[0188] In one exemplary embodiment, the above-described apparatus further includes a focus adjustment module for displaying an image setting area in the user interface of the wearable device; the image setting area is used to characterize the area where the application interface image is located in the user interface, and in response to an adjustment operation on the image setting area, the adjusted image setting area is displayed; the adjustment operation includes an adjustment operation on the focus area range or focus position in the image setting area.
[0189] In one exemplary embodiment, the above-described apparatus further includes a data acquisition and adjustment module. The wearable device is also equipped with a laser emitter, which is used to emit a laser beam onto a target display device. The target display device is a display device of an electronic device running the target application. The data acquisition and adjustment module is used to identify the landing point position of the laser beam emitted by the laser emitter in the application interface image, determine the data acquisition state of the wearable device based on the distance between the landing point position and the focal area range or the focal position, and output data acquisition and adjustment prompt information through the wearable device when the data acquisition state meets the abnormal data acquisition conditions.
[0190] In an exemplary embodiment, the above-described device further includes a wearing adjustment module, which is used to acquire the movement speed and device posture of the wearable device through an inertial sensing module, determine the wearing state of the wearable device based on the movement speed and device posture, and output wearing adjustment prompt information through the wearable device when the wearing state meets abnormal wearing conditions.
[0191] The modules in the aforementioned application analysis report generation device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.
[0192] In one exemplary embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as follows: Figure 12As shown, the computer device includes a processor, memory, input / output interfaces, a communication interface, a display unit, and an input device. The processor, memory, and input / output interfaces are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interfaces. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The input / output interfaces are used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements an application analysis report generation method. The display unit is used to form a visually visible image and can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.
[0193] Those skilled in the art will understand that Figure 12 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0194] In one exemplary embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.
[0195] In one exemplary embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps in the above-described method embodiments.
[0196] In one exemplary embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above-described method embodiments.
[0197] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0198] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments described above. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.
[0199] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0200] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A method for generating application analysis reports, characterized in that, Applied to a terminal device, the method includes: Acquire object operation images sent by the wearable device of the target object; the object operation images are images captured by the wearable device during the target object's operation of the target application; the object operation images include the application interface image of the target application and the eye image of the target object; Based on the eye image of the target object, determine the eye movement trajectory of the target object; Based on the eye movement trajectory, determine the position information of the gaze point of the target object in each of the application interface images; The location information is used as the operation behavior data of the target object; The application interface image is subjected to image recognition to determine the interface recognition result of the target application; the interface recognition result includes at least one of interface text information or interface icon information; the interface icon information includes at least one of icon object size information, position information, and color information. The interface recognition results of the target application are used as the interface element recognition data of the target application. The operation behavior data and the interface element recognition data are added to the preset analysis report template to obtain the analysis report. The report to be analyzed is processed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions. Based on the analysis results and the report to be analyzed, a target analysis report is generated; the target analysis report is used to review the target application.
2. The method according to claim 1, characterized in that, Applied to terminal devices, the step of obtaining a target analysis report based on the analysis results and the report to be analyzed includes: Add the analysis results to the report to be analyzed to obtain the report to be annotated: The usage records of the target object on the terminal are obtained, and the usage records are used as annotation information to annotate the report to be annotated, thereby obtaining the target analysis report.
3. The method according to claim 1, characterized in that, After obtaining the target analysis report based on the analysis results and the report to be analyzed, the process further includes: Send a target analysis report upload request to the cloud platform; the target analysis report upload request is used to instruct the cloud platform to store the target analysis report carried in the analysis report upload request; The cloud platform is used to respond to a report processing request for the target analysis report and perform a report processing operation corresponding to the processing request on the target analysis report.
4. A method for generating application analysis reports, characterized in that, Applied to wearable devices, the method includes: Collect object operation images generated by the target object during the operation of the target application; the object operation images include the application interface image of the target application and the eye image of the target object; The system sends the object operation image to a terminal device; the terminal device determines the target object's eye movement trajectory based on the target object's eye image; determines the position information of the target object's gaze point in each application interface image based on the eye movement trajectory; uses the position information as the target object's operation behavior data; performs image recognition on the application interface images to determine the interface recognition result of the target application; the interface recognition result includes at least one of interface text information or interface icon information; the interface icon information includes at least one of icon object size information, position information, and color information; uses the target application's interface recognition result as the target application's interface element recognition data; adds the operation behavior data and the interface element recognition data to a preset analysis report template to obtain a report to be analyzed; analyzes and processes the report to be analyzed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized inspection conditions; generates a target analysis report based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application.
5. The method according to claim 4, characterized in that, The wearable device is equipped with a first camera and a second camera. The acquisition of object operation images generated during the operation of the target object by the target object includes: The first camera captures images of the target object's eyes to obtain an eye image corresponding to the target object; The second camera captures images of the target application's interface to obtain an image of the application interface corresponding to the target application. The eye image and the application interface image are used as the object operation images.
6. The method according to claim 5, characterized in that, The method further includes: An image setting area is displayed in the user interface of the wearable device; the image setting area is used to characterize the area where the application interface image is located in the user interface. In response to an adjustment operation on the image setting area, the adjusted image setting area is displayed; the adjustment operation includes adjusting the focal area range or focal position within the image setting area.
7. The method according to claim 6, characterized in that, The wearable device also includes a laser emitter for emitting laser light onto a target display device; the target display device is a display device of an electronic device running the target application, and the method further includes: Identify the location of the laser emitted by the laser emitter in the application interface image; The acquisition status of the wearable device is determined based on the distance between the landing point location and the focal area range or the focal point location; If the data acquisition status meets the abnormal acquisition conditions, the wearable device will output a data acquisition adjustment prompt.
8. The method according to claim 4, characterized in that, The wearable device is further provided with an inertial sensing module, and the method further includes: The inertial sensing module is used to obtain the motion speed and device attitude of the wearable device. Based on the movement speed and device posture, the wearing status of the wearable device is determined; If the wearing condition meets the abnormal wearing conditions, the wearable device will output a wearing adjustment prompt.
9. An application analysis report generation device, characterized in that, Applied to a terminal device, the device includes: An image acquisition module is used to acquire object operation images sent by a wearable device of the target object; the object operation images are images captured by the wearable device during the target object's operation of a target application; the object operation images include the application interface image of the target application and the eye image of the target object; A data recognition module is used to determine the eye movement trajectory of the target object based on the eye image of the target object; determine the position information of the target object's gaze point in each of the application interface images based on the eye movement trajectory; use the position information as the operation behavior data of the target object; perform image recognition on the application interface images to determine the interface recognition result of the target application; the interface recognition result includes at least one of interface text information or interface icon information; the interface icon information includes at least one of icon object size information, position information, and color information; use the interface recognition result of the target application as the interface element recognition data of the target application; and determine the operation behavior data of the target object and the interface element recognition data of the target application based on the object operation image. The data addition module is used to add the operation behavior data and the interface element recognition data to a preset analysis report template to obtain the analysis report; The report analysis module is used to analyze and process the report to be analyzed and obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized check conditions. The report generation module is used to generate a target analysis report based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application.
10. An application analysis report generation device, characterized in that, The device, used in wearable devices, includes: The image acquisition module is used to acquire object operation images generated by the target object during the operation of the target application; the object operation images include the application interface image of the target application and the eye image of the target object; An image sending module is used to send the object operation image to a terminal device; the terminal device is used to determine the eye movement trajectory of the target object based on the eye image of the target object; determine the position information of the target object's gaze point in each of the application interface images based on the eye movement trajectory; use the position information as the operation behavior data of the target object; perform image recognition on the application interface images to determine the interface recognition result of the target application; the interface recognition result includes at least one of interface text information or interface icon information; the interface icon information includes at least one of icon object size information, position information, and color information; use the interface recognition result of the target application as the interface element recognition data of the target application; add the operation behavior data and the interface element recognition data to a preset analysis report template to obtain a report to be analyzed; analyze and process the report to be analyzed to obtain analysis results; the analysis results are used to characterize whether at least one analysis item in the report to be analyzed meets the corresponding standardized inspection conditions; generate a target analysis report based on the analysis results and the report to be analyzed; the target analysis report is used to review the target application.
11. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 8.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 8.
13. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Generation method and device for application program evaluation report, and evaluation report
CN108228441A
Trigger operation analysis method and device based on application program
CN110209581A