A method for generating an operation step diagram based on an Android terminal

Abstract

The application discloses a method for generating an operation step graph based on an Android terminal, which can record interactive data such as long pressing, clicking, sliding, pressing a physical button, triggering a bubble prompt and triggering a voice prompt and set corresponding reproduction modes. The application can effectively record and reproduce operation information such as a physical button, a bubble prompt and a voice prompt, and can meet the needs of a user for manually or automatically checking operation records as much as possible, and improve user experience.

Description

Technical Field

[0001] The present invention relates to the technical field of Android terminals, and in particular to a method for generating an operation step diagram based on an Android terminal. Background Art

[0002] When using Android devices (especially phones and tablets), you often need to know how to access a specific application interface. For example, a customer may report a problem with a third-party application to the device manufacturer. The customer simply takes a screenshot of the problematic interface and sends the image to the manufacturer. The manufacturer is unfamiliar with the third-party application and does not know how the interface was obtained. In this case, the manufacturer needs the customer to provide a step-by-step demonstration of how to access a specific interface.

[0003] In the face of the above problems, the most commonly used solution is screen recording, but the screen recording method cannot accurately display step events such as pressing physical buttons, bubble prompts, and voice prompts. Summary of the Invention

[0004] In view of the deficiencies in the prior art, the present invention aims to provide a method for generating an operation step diagram based on an Android terminal.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions:

[0006] A method for generating an operation step diagram based on an Android terminal, the specific process is as follows:

[0007] The user triggers an operation step recording event on the Android terminal;

[0008] After the user triggers the operation step recording event, the Android terminal first takes a full-screen screenshot of the current interactive interface as the base image;

[0009] When a user interacts on the current interactive interface, the Android terminal records the interaction data occurring on the user's current interactive interface, and the interaction data includes: 1) when the user slides, clicks, or long presses the screen, the screen coordinate data and the occurrence timestamp of the sliding, clicking, or long pressing event; 2) the physical key number and the occurrence timestamp involved in the event of pressing a physical key triggered by the user; 3) the screen coordinate position, corresponding pattern, prompt text, and occurrence timestamp of the bubble pop-up corresponding to the bubble prompt event triggered by the user; 4) the text corresponding to the voice in the voice prompt event triggered by the user and the occurrence timestamp;

[0010] When the user triggers an interface jump on the current interactive interface, the Android terminal first saves the corresponding base image and all interaction data on the current interactive interface before jumping, and automatically triggers the operation step recording event for the interactive interface after jumping, takes a full-screen screenshot again as the base image, and then records the interaction data that occurred on the interactive interface;

[0011] After the user triggers the operation step recording end event, the operation step recording event stops; the Android terminal records all the data obtained this time as an event item;

[0012] When the user triggers an operation record viewing event, the Android terminal reproduces the interactive data corresponding to the occurrence timestamp in ascending order of the occurrence timestamp on the corresponding base map and generates a frame of picture to present to the user; when a sliding, clicking or long pressing event occurs, the corresponding action is reproduced at the corresponding coordinate position on the base map through a preset finger icon; when an event of pressing a physical button occurs, the number of the pressed physical button is presented in the form of animation or text; when an event of triggering a bubble prompt occurs, the corresponding pattern and text are presented at the corresponding coordinate position of the base map; when an event of triggering a voice prompt occurs, the corresponding voice prompt text is displayed on the base map.

[0013] Furthermore, in the above method, when the user triggers an operation record viewing event, manual frame-by-frame viewing can be selected; at this time, the user first selects the target base map, and the Android terminal displays the base map on the screen. Each time the user triggers to view the next frame, the Android terminal reproduces the interactive data corresponding to the occurrence timestamp in ascending order on the base map and generates a frame of picture; when a sliding, clicking or long pressing event occurs, the corresponding action is reproduced at the corresponding coordinate position on the base map through a preset finger icon, when the event of pressing a physical button occurs, the number of the pressed physical button is presented in the form of animation or text, when the event of triggering a bubble prompt occurs, the corresponding pattern and text are presented at the corresponding coordinate position of the base map, and when the event of triggering a voice prompt occurs, the corresponding voice prompt text is displayed on the base map.

[0014] Furthermore, in the above method, when the user triggers the operation record to view the event, automatic playback can be selected for viewing; at this time, the user first selects the target event item, and the Android terminal automatically reproduces the interaction data corresponding to the occurrence timestamps of each sequence on the base map in ascending order of the occurrence timestamps for each base map and interaction data saved in the event item, generates a frame of picture, and automatically plays it to the user frame by frame; when a sliding, clicking or long pressing event occurs, the corresponding action is reproduced at the corresponding coordinate position on the base map through a preset finger icon, when the event of pressing a physical button occurs, the number of the pressed physical button is presented in the form of animation or text, when the event of triggering a bubble prompt occurs, the corresponding pattern and text are presented at the corresponding coordinate position of the base map, and when the event of triggering a voice prompt occurs, the corresponding voice prompt text is displayed on the base map.

[0015] Furthermore, in the above method, after manual frame-by-frame viewing or automatic playback viewing is completed, the Android terminal stitches the generated frames into a long image of the operation steps in ascending order of timestamps.

[0016] The present invention also provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program implements the above method when executed by a processor.

[0017] The present invention also provides an Android terminal, comprising a processor and a memory, wherein the memory is used to store a computer program; and when the processor is used to execute the computer program, the above method is implemented.

[0018] The beneficial effects of the present invention are that the present invention can effectively record and reproduce operation information such as physical buttons, bubble prompts, voice prompts, etc., and meet the user's needs for manual or automatic viewing of operation records as much as possible, thereby improving the user experience. DETAILED DESCRIPTION

[0019] The present invention will be further described below. It should be noted that this embodiment is based on the technical solution and provides a detailed implementation method and specific operation process, but the protection scope of the present invention is not limited to this embodiment.

[0020] This embodiment provides a method for generating an operation step diagram based on an Android terminal, and the specific process is as follows:

[0021] The user triggers an operation step recording event on the Android terminal through settings such as physical buttons, gestures, and sliding special characters on the screen;

[0022] After the user triggers the operation step recording event, the Android terminal first takes a full-screen screenshot of the current interactive interface as a base image.

[0023] When the user is interacting on the current interactive interface, the Android terminal records the interaction data occurring on the user's current interactive interface, and the interaction data includes: 1) when the user slides, clicks or long presses the screen, the screen coordinate data and the occurrence timestamp of the sliding, clicking or long pressing event; 2) the physical key number and the occurrence timestamp involved in the event of pressing a physical key triggered by the user; 3) the screen coordinate position, corresponding pattern, prompt text and occurrence timestamp of the bubble pop-up corresponding to the bubble prompt event triggered by the user; 4) the text corresponding to the voice in the voice prompt event triggered by the user and the occurrence timestamp.

[0024] When the user triggers an interface jump by clicking on the current interactive interface, the Android terminal first saves the corresponding base image and all interaction data on the current interactive interface before jumping, and automatically triggers the operation step recording event for the interactive interface after jumping, takes a full-screen screenshot again as the base image, and then records the interaction data that occurred on the interactive interface;

[0025] After the user triggers the operation step recording end event through a set method such as physical buttons, gestures, sliding special characters on the screen, etc., the operation step recording event stops; the Android terminal records all the data obtained this time as an event item.

[0026] When the user triggers an operation record viewing event, first choose to manually view frame by frame or automatically play and view;

[0027] When the user chooses to manually view frame by frame, the user first selects the target base map, and the Android terminal displays the base map on the screen. Each time the user triggers to view the next frame, the Android terminal reproduces the interactive data corresponding to the occurrence timestamps in the order of ascending timestamps on the base map and generates a frame of picture; when a sliding, clicking or long pressing event occurs, the corresponding action is reproduced at the corresponding coordinate position on the base map through the preset finger icon; when an event of pressing a physical button occurs, the number of the pressed physical button is presented in the form of animation or text; when an event of triggering a bubble prompt occurs, the corresponding pattern and text are presented at the corresponding coordinate position of the base map; when an event of triggering a voice prompt occurs, the corresponding voice prompt text is displayed on the base map.

[0028] When the user chooses to view automatically through automatic playback, the user first selects the target event item. The Android terminal will automatically reproduce the interaction data corresponding to the occurrence timestamps of each sequence on the base map in ascending order of the occurrence timestamps for each base map and interaction data saved in the event item, generate a frame of picture, and automatically play it to the user frame by frame. When a sliding, clicking, or long pressing event occurs, the corresponding action is reproduced at the corresponding coordinate position on the base map through the preset finger icon. When a physical button is pressed, the number of the pressed physical button is presented in the form of animation or text. When a bubble prompt is triggered, the corresponding pattern and text are presented at the corresponding coordinate position of the base map. When a voice prompt is triggered, the corresponding voice prompt text is displayed on the base map.

[0029] In this embodiment, after manual frame-by-frame viewing or automatic playback viewing is completed, the Android terminal splices the generated frames into a long image of the operation steps in ascending order of timestamps.

[0030] Those skilled in the art can make various corresponding changes and modifications based on the above technical solutions and concepts, and all of these changes and modifications should be included in the scope of protection of the claims of the present invention.

Claims

1. A method for generating an operation step diagram based on an Android terminal, characterized in that: The specific process is: The user triggers an operation step recording event on the Android terminal; After the user triggers the operation step recording event, the Android terminal first takes a full-screen screenshot of the current interactive interface as the base image; When a user interacts on the current interactive interface, the Android terminal records the interaction data that occurs on the user's current interactive interface. The interaction data includes: 1) when the user slides, clicks, or long presses the screen, the screen coordinate data and the occurrence timestamp of the sliding, clicking, or long pressing event; 2) the physical key number and the occurrence timestamp involved in the event of pressing a physical key triggered by the user; 3) the screen coordinate position, corresponding pattern, prompt text, and occurrence timestamp of the bubble pop-up corresponding to the bubble prompt event triggered by the user; 4) the text corresponding to the voice in the voice prompt event triggered by the user and the occurrence timestamp; When the user triggers an interface jump on the current interactive interface, the Android terminal first saves the corresponding base image and all interaction data on the current interactive interface before jumping, and automatically triggers the operation step recording event for the interactive interface after jumping, takes a full-screen screenshot again as the base image, and then records the interaction data that occurred on the interactive interface; After the user triggers the operation step recording end event, the operation step recording event stops; the Android terminal records all the data obtained this time as an event item; When the user triggers an operation record viewing event, the Android terminal reproduces the interaction data corresponding to the occurrence timestamp in the order of the occurrence timestamp on the corresponding base map and generates a frame of picture to present to the user; when a sliding, clicking or long pressing event occurs, the corresponding action is reproduced by a preset finger icon at the corresponding coordinate position on the base map; when an event of pressing a physical button occurs, the pressed physical button number is presented in the form of animation or text; when an event of triggering a bubble prompt occurs, the corresponding pattern and text are presented at the corresponding coordinate position of the base map; when an event of triggering a voice prompt occurs, the corresponding voice prompt text is displayed on the base map; When the user triggers an operation record viewing event, he or she can choose to view it manually frame by frame; at this time, the user first selects the target base map, and the Android terminal displays the base map on the screen. Each time the user triggers to view the next frame, the Android terminal reproduces the interaction data corresponding to the occurrence timestamp in the order of ascending timestamps on the base map and generates a frame of picture; when a sliding, clicking or long pressing event occurs, the corresponding action is reproduced at the corresponding coordinate position on the base map through a preset finger icon; when an event of pressing a physical button occurs, the number of the pressed physical button is presented in the form of animation or text; when an event of triggering a bubble prompt occurs, the corresponding pattern and text are presented at the corresponding coordinate position of the base map; when an event of triggering a voice prompt occurs, the corresponding voice prompt text is displayed on the base map; When the user triggers an operation record to view an event, he or she can choose to automatically play and view it; at this time, the user first selects the target event item, and the Android terminal automatically reproduces the interaction data corresponding to the occurrence timestamps of each sequence on the base map in ascending order of the occurrence timestamps, generates a frame of picture, and automatically plays it to the user frame by frame; when a sliding, clicking or long pressing event occurs, the corresponding action is reproduced at the corresponding coordinate position on the base map through the preset finger icon; when the event occurs of pressing a physical button, the number of the pressed physical button is presented in the form of animation or text; when the event occurs of triggering a bubble prompt, the corresponding pattern and text are presented at the corresponding coordinate position of the base map; when the event occurs of triggering a voice prompt, the corresponding voice prompt text is displayed on the base map.

2. The method according to claim 1, characterized in that After manual frame-by-frame viewing or automatic playback viewing is completed, the Android terminal stitches the generated frames into a long image of the operation steps in ascending order of timestamps.

3. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 2 is implemented.

4. An Android terminal, characterized in that: The method comprises a processor and a memory, wherein the memory is used to store a computer program; and when the processor is used to execute the computer program, the method according to any one of claims 1 to 2 is implemented.