Product operation guide method and device, storage medium and electronic equipment

Abstract

The application discloses a product operation guidance method and device, a storage medium and an electronic device. The method comprises the following steps: during screen recording, in response to an interface switching operation of an operator on a product to be introduced, voice data of the operator when introducing a current interface of the product to be introduced is acquired; voice-to-text processing is performed on the voice data to obtain text content of the operator when introducing the current interface; according to a display operation response on the current interface, annotated text is extracted from the text content; and the annotated text is filled in a marked box position of the display operation instruction to obtain an operation guidance video of the product to be introduced. The popularization efficiency of the product to be introduced can be improved.

Description

Technical Field

[0001] This application relates to the field of financial technology, specifically to a product operation guidance method, apparatus, storage medium, and electronic device. Background Technology

[0002] Banking transactions rely on various applications. As banking services are optimized, the applications used by banks are updated more and more frequently. After each application update, the new functions need to be communicated to banking staff so that they can assist customers in using the new functions to conduct banking transactions.

[0003] Generally, updated application features can be sent to banking staff via email or user manual for review. However, due to the large number of banking staff and their varying levels of understanding of the user manual, the widespread adoption of new features in the application has not been very effective. Summary of the Invention

[0004] This application provides a product operation guidance method, apparatus, storage medium, and electronic device, which can improve the efficiency of popularizing new functions in applications.

[0005] In a first aspect, embodiments of this application provide a product operation guidance method, the method comprising:

[0006] During screen recording, in response to the operator's interface switching operation for the product to be introduced, the voice data of the operator when introducing the current interface of the product to be introduced is acquired.

[0007] The voice data is processed to convert it to text, resulting in the text content of the operator introducing the current interface.

[0008] Based on the displayed actions on the current interface, extract the labeled text from the text content;

[0009] Fill in the annotation text in the annotation box that displays the operation instructions to obtain the operation guidance video of the product to be introduced.

[0010] Secondly, embodiments of this application also provide a product operation guidance device, comprising:

[0011] The data acquisition module is used to acquire the operator's voice data when introducing the product in the current interface, in response to the operator's interface switching operation during screen recording.

[0012] The voice processing module is used to process voice data into text, so as to obtain the text content when the operator introduces the current interface;

[0013] The text recognition module is used to extract labeled text from the text content based on the display operations responded to on the current interface.

[0014] The video processing module is used to fill in the annotation text in the annotation box where operation instructions are displayed, so as to obtain the operation guidance video of the product to be introduced.

[0015] Thirdly, embodiments of this application also provide a computer-readable storage medium having a computer program stored thereon, which, when run on a computer, causes the computer to execute the product operation guidance method provided in any embodiment of this application.

[0016] Fourthly, embodiments of this application also provide an electronic device, including a processor and a memory, the memory having a computer program, and the processor executing a product operation guidance method as provided in any embodiment of this application by calling the computer program.

[0017] The technical solution provided in this application involves recording the screen of an operator introducing a product and collecting their voice data. This voice data is then processed based on changes in the product's interface to obtain the text content of the current interface. The video and text descriptions of the current interface are then combined to present the content more vividly and accurately. Furthermore, annotation text is extracted from the text content based on responses to actions on the current interface. This annotation text highlights new or specific functions on the current interface, allowing for quicker and more accurate identification of these functions. This enables banking personnel to intuitively view the annotation text, guiding them to quickly locate the function and learn how to operate it. This improves their understanding of the new function and facilitates more efficient and accurate dissemination of the product's functionality among banking staff. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 A schematic diagram illustrating the application scenario of the product operation guidance method provided in this application.

[0020] Figure 2This is a flowchart illustrating the product operation guidance method provided in the embodiments of this application.

[0021] Figure 3 This is a schematic diagram illustrating the method for obtaining voice data corresponding to the current interface in the product operation guidance method provided in this application embodiment.

[0022] Figure 4 This is a schematic diagram illustrating the display of subtitles and annotations in the product operation guidance method provided in the embodiments of this application.

[0023] Figure 5 This is a schematic diagram of the operation guidance video following the push icon in the product operation guidance method provided in the embodiments of this application.

[0024] Figure 6 A detailed flowchart of the product operation guidance method provided in the embodiments of this application.

[0025] Figure 7 This is a schematic diagram of the product operation guidance device provided in the embodiments of this application.

[0026] Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0027] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the protection scope of this application.

[0028] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0029] The various applications used in banking operations undergo functional improvements as the needs of banking services evolve. The extent of these improvements varies, with some interfaces changing significantly while others change less so. Furthermore, interface changes also differ depending on the application version. For different banking staff responsible for different areas of banking business, the multiple applications they use can be categorized into several different types, or even the same application can be divided into multiple different business sections. Additionally, even within the same category of application, the interface can vary depending on the version used by different banking staff.

[0030] Therefore, for different types and versions of applications, it is necessary to provide a specific introduction to the changes in their interface content before they go live, so that banking personnel using a particular application can understand the changes in the application's interface and use the application smoothly, thereby expediting the process of conducting banking business with customers.

[0031] Specifically, please refer to Figure 1 , Figure 1 This diagram illustrates an application scenario for the product operation guidance method provided in this application. The application scenario refers to a banking business processing scenario, using a bank branch as an example. For instance, a bank branch can handle services such as storage, loans, social security, wealth management, and insurance. The banking personnel can be, for example, the tellers in the bank branch. Taking storage and loan services as examples, teller A at the storage counter uses application a to process a customer's storage transaction, and teller B at the loan counter uses application b to process a customer's loan transaction. Before using application a or application b, relevant personnel need to provide operation guidelines for application a or application b for teller A or teller B to review, so they can understand any new functions or interface changes in application a or application b.

[0032] Of course, in another scenario, tellers may also use the same type of application to handle banking business for customers in different business sections. Taking wealth management and insurance as examples, teller C at the wealth management counter uses the wealth management section of application c to handle wealth management business for customers, and teller D at the insurance counter uses the insurance section of application c to handle insurance business for customers. If the insurance section of application c undergoes functional or interface changes (the changed version is referred to as application d), then before teller D uses the new application d, relevant personnel need to provide operation instructions for application d for teller D to review, so as to understand the new functions or interface changes in the insurance section of application d.

[0033] It is understood that the functional changes or interface changes mentioned in the embodiments of this application may refer to changes in the business modules of the same application, or to functional changes or interface changes in different applications, depending on the applications used for different banking services. One application may be used to handle at least two different banking services. Alternatively, one application may handle only one banking service, while different banking services can be handled using different applications.

[0034] To address the technical problems mentioned in related technologies, embodiments of this application provide a product operation guidance method. The executing entity of this product operation guidance method can be the product operation guidance device provided in embodiments of this application, or an electronic device integrating the product operation guidance device. The product operation guidance device can be implemented in hardware or software, and the electronic device can be a smartphone, foldable phone, tablet computer, PDA, desktop computer, smart screen, or other similar device.

[0035] Please see Figure 1 , Figure 1 This is a flowchart illustrating the product operation guidance method provided in this application embodiment. The specific flow of the product operation guidance method provided in this application embodiment can be as follows:

[0036] 101. During screen recording, in response to the operator's interface switching operation for the product to be introduced, acquire the operator's voice data when introducing the current interface of the product to be introduced.

[0037] In this embodiment, the relevant personnel who need to provide operation guidance for the application to banking business personnel are referred to as operators, and the application that needs to introduce new functions or interface changes is referred to as the product to be introduced. The product to be introduced also includes function changes or interface changes of a certain functional module.

[0038] When an operator is introducing a product, they can use a screen recording tool on their electronic device to record the screen during the presentation. During recording, the operator can interact with the product on the device, switching between different interfaces based on their actions. For example, clicking a virtual button on the product allows the operator to navigate to another interface.

[0039] For example, during the screen recording process, a microphone is also activated to record audio. This microphone can be a built-in microphone of the electronic device or an external microphone connected to the electronic device. By activating the microphone to collect the operator's voice, the operator's voice data is obtained.

[0040] There are several ways to acquire the operator's voice data while introducing the product on the current interface. As an example, audio can be recorded selectively while switching interfaces. For instance, the timestamps of screen recording and audio recording can be synchronized. Using the interface switch for the product as a boundary, as the product switches from the previous interface to the current one, the voice data collected by the microphone while the microphone is on the current interface is identified using a new encoding method. This ensures that each current interface corresponds to a segment of voice data, and that the voice data for different interfaces is identified by different encodings.

[0041] As another example, after screen recording and audio recording are completed, the audio data obtained from the recording can be segmented according to the operator's operation process, so that the interface corresponding to each operation stage has a corresponding segment of audio data.

[0042] 102. Perform speech-to-text processing on the voice data to obtain the text content of the operator introducing the current interface.

[0043] In addition to processing the speech data corresponding to the current interface into text, the converted text can be further processed by identifying, correcting, and formatting errors to obtain the text content that the operator uses to introduce the current interface.

[0044] 103. Extract the labeled text from the text content based on the display operation responded to on the current interface.

[0045] While on the current screen, the user can perform display operations, which may include opening a list, clicking operable buttons, swiping, and controlling elements.

[0046] The changes to the current interface vary depending on the type of action that can be performed. For example, opening a list on the current interface will not cause the interface to switch and will display the contents of the list. Clicking an actionable button on the current interface will cause the interface to switch to the corresponding screen. Performing a swipe operation on the current interface will not cause the interface to switch and will display the contents of the current interface in a swipe manner.

[0047] For example, while the current interface is active, annotation text corresponding to each display operation can be extracted from the text content by detecting each display operation that responds to the current interface. Understandably, if the current interface does not respond to any display operation, it is not necessary to extract annotation text from the text content.

[0048] In this embodiment, there are several ways to extract annotation text from text content. For example, one could extract annotation text corresponding to the displayed operation by performing semantic understanding on the text content; another example is providing a screen recording annotation tool so that the operator can use it to annotate the current interface, thereby generating annotation text. For instance, if the operator uses the annotation tool to select a location on the current interface and starts annotating, subsequent speech-to-text content is directly input into that selected location to form the annotation text. When the operator exits the annotation tool, the subsequent speech-to-text is not part of the annotation text. Furthermore, the location selected by the annotation tool can be moved to a specific position on the current interface based on the operator's actions.

[0049] For example, during the use of the annotation tool, a modification tool can also be provided to perform text processing such as deleting, adding, and correcting the font of the annotation text, thereby modifying the annotation text.

[0050] In this embodiment, the use of annotation tools allows operators to flexibly describe the executable buttons, and this annotation method is simple and efficient.

[0051] 104. Fill in the annotation text in the annotation box where the operation instructions are displayed to obtain the operation guidance video of the product to be introduced.

[0052] In this process, the operator performs a display operation by pressing an operable button at a certain location on the current interface. The location of the operable button can be the location of the annotation box, or the annotation box can be located at a certain location around the operable button. The shape of the annotation box can be a cloud map, a pie chart, a box chart, etc. The size of the annotation box can be a fixed size, or it can be adaptively adjusted according to the length of the annotation text.

[0053] After determining the position of the annotation box corresponding to the display operation, the annotation text can be filled into the annotation box. The color, font, paragraph, etc. of the annotation text can also be adaptively adjusted according to the format set by the annotation box.

[0054] During screen recording, the operator switches between interfaces of the product being introduced to obtain a video of the operation flow of a specific function. For each interface, the operator also captures the audio data used to introduce it, processes this data to extract corresponding text content. Furthermore, for interfaces that respond to demonstration actions, the operator extracts annotation text from the corresponding text content and fills it into the annotation boxes for the demonstration actions. This allows for text annotation of each interface with demonstration actions, ultimately resulting in an operation guidance video for the product being introduced.

[0055] When banking staff use an application similar to the product being introduced, they can play an operation guide video to learn about the application's new features or interface changes, thus quickly learning the operation process of a certain function on the application and better serving customers.

[0056] In practice, this application is not limited by the execution order of the described steps. Without causing conflicts, some steps may be performed in other orders or simultaneously.

[0057] In some embodiments, during screen recording, in response to an operator's interface switching operation on the product to be introduced, voice data of the operator introducing the current interface of the product to be introduced is acquired, including:

[0058] During screen recording, in response to the operator's switching operation on the interface of the product to be introduced, the operator's voice data when introducing the current interface of the product is acquired with new encoding.

[0059] Specifically, please refer to Figure 3 , Figure 3 This is a schematic diagram illustrating the method for obtaining voice data corresponding to the current interface in the product operation guidance method provided in this application embodiment, such as... Figure 3 As shown, when an operator performs an interface switching operation on the product to be introduced, the interface of the product to be introduced jumps according to the interface switching operation. Specifically, the operator's operation flow can sequentially jump to the first interface, the second interface, the third interface, and the fourth interface. When switching to the first interface, number 1 is used as the code for the operator's voice data during the introduction of the first interface. When switching from the first interface to the second interface, number 2 is used as the code for the operator's voice data during the introduction of the second interface, and so on. Each interface corresponds to a different code for the voice data, thus achieving the segmentation of voice data. Voice data with different codes can be stored separately or not.

[0060] For example, the operator's voice data can also be deredundanted, such as retaining only the voice data when the product to be introduced is being run, thereby avoiding redundancy of voice data.

[0061] Of course, redundancy removal can also be performed on the voice data corresponding to each interface, such as deleting duplicate content and interjections in the voice data, to make the voice data smoother.

[0062] In some embodiments, extracting labeled text from text content based on the display operation responded to on the current interface includes:

[0063] Detect the display operations responded to by the operable buttons on the current interface, and locate the position of the keywords corresponding to the operable buttons in the text content;

[0064] Based on the location of keywords, extract the annotation text corresponding to the operable buttons from the text content.

[0065] Considering that the operator needs to provide background information before introducing the operable buttons, keywords can be located from the voice data corresponding to the current interface to extract labeled text from the content. These keywords may include descriptions of the operable button icons, their names, or their locations.

[0066] When extracting labeled text based on keyword position, the text content following the keyword can be used as labeled text. Furthermore, when there are multiple display operations on the current interface, only the text content from the position of the keyword corresponding to the currently operable button to the position of the keyword corresponding to the next operable button can be used as the labeled text for the currently operable button.

[0067] For example, the start and end phrases for the operable buttons can be preset. When the operator says the corresponding keyword according to the start phrase, the position of the keyword can be located in the text content, and the position is used as the start position for extracting the labeled text. When the operator says another corresponding keyword according to the end phrase, the position of the other keyword can be located in the text content, and the other position is used as the end position for extracting the labeled text. Then, the labeled text corresponding to the operable buttons can be extracted from the text content according to the start and end positions.

[0068] When multiple labeled texts are extracted from the text content based on the opening and closing statements, the labeled text corresponding to each operable button can be matched one by one from the multiple labeled texts according to the order in which the operator operates each operable button. The order of the operable buttons is consistent with the order of the multiple labeled texts in the text content.

[0069] In some embodiments, label text is filled into the label box where operation instructions are displayed to obtain an operation guidance video for the product to be introduced, including:

[0070] The text content other than the labeled text is designated as the interface description text;

[0071] Fill the subtitle position on the current screen with interface introduction text, and fill the annotation position in the annotation box that displays operation instructions with annotation text to obtain the operation guidance video of the product to be introduced.

[0072] The subtitle positions on each screen can be the same or different. The subtitle positions can be the default settings or customized by the user; there are no restrictions here.

[0073] After the interface introduction text is filled into the subtitle position, during the playback of the operation guide video, the interface introduction text can be displayed directly in the subtitle position, or it can be played synchronously with the audio content of the video, or it can be scrolled in the subtitle position. The display method of the annotation text during playback is similar to that of the interface introduction text, and will not be described again here.

[0074] Specifically, please refer to Figure 4 , Figure 4 This is a schematic diagram illustrating the display of subtitles and annotations in the product operation guidance method provided in this application embodiment. For example, the current interface shown in the figure is displayed. The subtitle position is at the bottom center of the current interface, and the position of the annotation box displaying the operation instruction is the position of the operable button triggered when the user performs the display operation. If the operable button is located in the middle of the right side, the position of the annotation box can be to the left of the operable button. Specifically, it can be as shown in the figure, but it is not limited to the position shown in the figure. It can also be located in any position around the operable button, as long as the annotation box does not obscure other interface elements.

[0075] Understandably, if the positions of the annotation box and the subtitle overlap, the positions of the annotation box or subtitle can be adaptively fine-tuned to prevent them from overlapping and thus avoid obscuring the text. On the other hand, the text format of the annotation box and the subtitle can be set differently to make them easy to distinguish. The differentiating settings include, but are not limited to, differentiating them by color, font size, font style, and arrangement.

[0076] In some embodiments, before filling the labeled text in the labeled box where the operation instructions are displayed to obtain the operation guidance video for the product to be introduced, the method further includes:

[0077] Based on the demonstration, circle the operable buttons on the current interface and add a label box to the circled position of the operable buttons.

[0078] Following the above embodiments, this embodiment not only determines the position of the label box based on the position of the operable button, but also circles the operable button based on its position, so that the position of the operable button is conspicuous, making it easy for banking staff to quickly and accurately know the position of the operable button on the current interface, and distinguish it from other operable buttons on the current interface, thus avoiding accidental touches of other operable buttons.

[0079] There are several ways to select operable buttons. For example, a pre-defined correspondence between the size of operable buttons and the size of the selection box can be established. Once the size of the operable button is known, it can be selected using a selection box of the corresponding size. The shape and color of the selection box are not limited here; they can be adjusted adaptively according to the shape of the operable button, and can also be customized by the user. Alternatively, the size of an operable button can be obtained by automatically recognizing the button on the current screen.

[0080] For example, the operator can also use the annotation tool mentioned in the above embodiments to circle the operable button on the current interface. When the operator uses the annotation tool to circle, it is regarded as the operator drawing a selection box, which can be drawn flexibly by the operator.

[0081] For example, the location of operable buttons on the current interface can be determined by locating the operator's eye focus point, and then the operable button can be selected based on its location.

[0082] In some embodiments, after filling the annotation text in the annotation box displaying the operation instructions to obtain the operation guidance video for the product to be introduced, the method further includes:

[0083] Establish resource associations between the instruction videos and the products to be introduced, and publish the products to be introduced that have resource associations.

[0084] Specifically, after obtaining the operation guidance video for the product to be introduced, a Uniform Resource Locator (URL) is generated between the operation guidance video and the product to be introduced. The processed product to be introduced is then uploaded to the server corresponding to the banking business, so that banking staff can obtain the operation guidance video corresponding to the updated application based on the URL after downloading or updating the application they are using.

[0085] For example, taking the product to be introduced as an updated application, when banking staff use the product, if the product's functions or interface have changed compared to the previous version, and the staff are unfamiliar with the operation process, they can obtain the operation guidance video based on the resource locator. This operation guidance video is returned to the banking staff in the form of a web address, and the staff can view the operation guidance video by opening the web address, without consuming too much memory on the terminal device used by the banking staff.

[0086] In some embodiments, after filling the annotation text in the annotation box displaying the operation instructions to obtain the operation guidance video for the product to be introduced, the method further includes:

[0087] Acquire the standard and extended strategies configured by the operator based on the operation guidance video;

[0088] The operation guidance videos are labeled based on standard and extended strategies, and the labeled operation guidance videos are uploaded.

[0089] The standard policy can include a standard ACL, which represents a standard access control list, to filter the source address of access. Only source addresses and ports belonging to the standard access control list can access the operation guidance video, thus realizing the control of access to the operation guidance video and improving the security of the operation guidance video.

[0090] Extended policies can include extended ACLs, which represent extended access control lists, to filter access based on the source address, destination address, specified protocol, port, and flags.

[0091] After the operation guidance video is identified using standard and extended policies, only eligible terminal devices can access it. For example, by setting standard and extended policies, operators can ensure that only banking personnel can access the operation guidance video, while non-banking personnel cannot.

[0092] In some embodiments, after identifying the instruction video based on standard and extended policies, the method further includes:

[0093] Match the corresponding video tags to the identified instructional video;

[0094] Match video tags with corresponding target group tags;

[0095] Identify the target customer group indicated by the target group tag and push the labeled operation guide video to the customer group.

[0096] In this embodiment, the operation guidance video is assigned corresponding video tags based on the functions of the video to be introduced. These tags can be assigned using machine learning, keyword matching algorithms, or similar methods.

[0097] Accordingly, a user profile can be built for each user, and then users can be divided into multiple customer groups based on numerous user profiles. This customer group division based on user profiles can be achieved through methods such as statistical algorithms or clustering algorithms. Once multiple customer groups are obtained, each customer group can be assigned a corresponding group label.

[0098] In this system, a pre-established correspondence between video tags and group tags is used. Based on this correspondence and the video tag of the tagged operation guidance video, the corresponding target group tag can be matched for the video tag. Based on the target group tag, the customer group it indicates can be determined, and then the tagged operation guidance video can be pushed to the customer group.

[0099] Please see Figure 5 , Figure 5 This diagram illustrates the push of an operation guidance video with an identifier in the product operation guidance method provided in this application embodiment. For each operation guidance video of a product to be introduced, after configuring a standard strategy and an extended strategy, video tags are matched to the corresponding product operation guidance video according to the function of each product to be introduced. Each operation guidance video corresponds to a set of video tags. For each user, a user profile is constructed, and users are segmented based on the user profile to form multiple customer groups. Each user can be assigned to a customer group, and each customer group has a corresponding group tag. Then, each video tag is matched with the group tag, thereby pushing the operation guidance video corresponding to each video tag to the corresponding customer group with the target group tag.

[0100] In this embodiment, operation guidance videos are automatically pushed to customers to automatically identify their needs and facilitate their use of the videos. This method is more suitable for customers conducting banking transactions remotely. When customers log into the banking application and are unfamiliar with its operation, operation guidance videos demonstrating the corresponding functions are pushed to them, helping them understand the operation process and thus smoothly conduct banking transactions remotely.

[0101] Referring to the above embodiments, a detailed flowchart is also provided here to illustrate the solution provided by the embodiments of this application. Please refer to the flowchart for details. Figure 6 , Figure 6 A detailed flowchart of the product operation guidance method provided in this application embodiment. The specific operation is as follows:

[0102] 201. Begin screen recording and audio recording;

[0103] 202. During screen recording, the operator switches interfaces by operating the product to be introduced, and determines the voice data of the current interface based on the interface switching operation;

[0104] 203. Convert the voice data into text content;

[0105] 204. Based on the display operation responded to on the current interface, determine the position of the operable button on the current interface corresponding to the display operation;

[0106] 205. Select the operable buttons based on their positions;

[0107] 206. Add annotation boxes based on the selected positions of the operable buttons;

[0108] 207. Based on the location of the operable buttons, divide the text content into annotation text and interface description text;

[0109] 208. Fill in the annotation text into the annotation box, and fill in the interface description text into the subtitle position of the current interface;

[0110] 209. End screen recording and generate an operation guide video;

[0111] 210. Generate a resource locator between the operation guide video and the product to be introduced, and publish the product to be introduced.

[0112] 220. Identify and upload operation guidance videos based on standard and extended strategies.

[0113] 230. Push the operation guide video to the matching customer group.

[0114] As can be seen from the above, the product operation guidance method proposed in this embodiment of the invention allows operators to enter the new functional interface of the application by executing the operation process after the bank's application is updated, and provides voice explanations. During this process, screen recording and audio recording are also performed, and the recorded audio data is converted into text to display subtitles and function labels for operable buttons on the corresponding interface, thereby generating an operation guidance video. After generating the operation guidance video, on the one hand, bank staff can use the operation guidance video to help customers conduct banking business; on the other hand, the operation guidance video can also be pushed to customers who need it, so that customers understand the operation process of banking business and can conduct banking business independently. The solution provided in this embodiment can generate operation guidance videos quickly and accurately, solving the shortcomings of the prior art. It can serve not only bank staff but also customers, has wide applicability, and is beneficial for promoting new banking services.

[0115] In one embodiment, a product operation guidance device is also provided. Please refer to [link / reference]. Figure 7 , Figure 7 This is a schematic diagram of the structure of a product operation guidance device 300 provided in an embodiment of this application. The product operation guidance device 300 is applied to an electronic device and includes:

[0116] The data acquisition module 301 is used to acquire the operator's voice data when introducing the current interface of the product to be introduced, in response to the operator's interface switching operation during screen recording.

[0117] The voice processing module 302 is used to process voice data into text to obtain the text content when the operator introduces the current interface;

[0118] The text recognition module 303 is used to extract labeled text from the text content based on the display operation responded to on the current interface.

[0119] The video processing module 304 is used to fill the annotation text in the annotation box where the operation instructions are displayed, so as to obtain the operation guidance video of the product to be introduced.

[0120] In some embodiments, the text recognition module 303 is further configured to:

[0121] Detect the display operations responded to by the operable buttons on the current interface, and locate the position of the keywords corresponding to the operable buttons in the text content;

[0122] Based on the location of keywords, extract the annotation text corresponding to the operable buttons from the text content.

[0123] In some embodiments, the video processing module 304 is further configured to:

[0124] The text content other than the labeled text is designated as the interface description text;

[0125] Fill the subtitle position on the current screen with interface introduction text, and fill the annotation position in the annotation box that displays operation instructions with annotation text to obtain the operation guidance video of the product to be introduced.

[0126] In some embodiments, before filling the annotation text in the annotation box displaying the operation instructions to obtain the operation guidance video for the product to be introduced, the video processing module 304 is further configured to:

[0127] Based on the demonstration, circle the operable buttons on the current interface and add a label box to the circled position of the operable buttons.

[0128] In some embodiments, after filling the annotation text in the annotation box displaying the operation instructions to obtain the operation guidance video for the product to be introduced, the video processing module 304 is further used to:

[0129] Establish resource associations between the instruction videos and the products to be introduced, and publish the products to be introduced that have resource associations.

[0130] In some embodiments, after filling the annotation text in the annotation box displaying the operation instructions to obtain the operation guidance video for the product to be introduced, the video processing module 304 is further used to:

[0131] Acquire the standard and extended strategies configured by the operator based on the operation guidance video;

[0132] The operation guidance videos are labeled based on standard and extended strategies, and the labeled operation guidance videos are uploaded.

[0133] In some embodiments, after identifying the operation guidance video based on standard and extended strategies, the video processing module 304 is further configured to:

[0134] Match the corresponding video tags to the identified instructional video;

[0135] Match video tags with corresponding target group tags;

[0136] Identify the target customer group indicated by the target group tag and push the labeled operation guide video to the customer group.

[0137] It should be noted that the product operation guidance device 300 provided in this application embodiment belongs to the same concept as the product operation guidance method in the above embodiment. The product operation guidance device 300 can implement any of the methods provided in the product operation guidance method embodiment. For details of its implementation process, please refer to the product operation guidance method embodiment, which will not be repeated here.

[0138] This application also provides an electronic device, which may be a smartphone, foldable phone, tablet computer, PDA, desktop computer, smart screen, etc. Figure 8 As shown, Figure 8 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device 400 includes a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, and a computer program stored in the memory 402 and executable on the processor. The processor 401 and the memory 402 are electrically connected. Those skilled in the art will understand that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0139] The processor 401 is the control center of the electronic device 400. It connects various parts of the electronic device 400 through various interfaces and lines. By running or loading software programs and / or modules stored in the memory 402, and calling data stored in the memory 402, it performs various functions of the electronic device 400 and processes data, thereby monitoring the electronic device 400 as a whole.

[0140] In this embodiment, the processor 401 in the electronic device 400 loads the instructions corresponding to the processes of one or more applications into the memory 402 according to the following steps, and the processor 401 runs the applications stored in the memory 402 to realize various functions:

[0141] During screen recording, in response to the operator's interface switching operation for the product to be introduced, the voice data of the operator when introducing the current interface of the product to be introduced is acquired.

[0142] The voice data is processed to convert it to text, resulting in the text content of the operator introducing the current interface.

[0143] Based on the displayed actions on the current interface, extract the labeled text from the text content;

[0144] Fill in the annotation text in the annotation box that displays the operation instructions to obtain the operation guidance video of the product to be introduced.

[0145] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0146] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0147] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0148] Therefore, this application provides a computer-readable storage medium. Those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it includes the following steps:

[0149] During screen recording, in response to the operator's interface switching operation for the product to be introduced, the voice data of the operator when introducing the current interface of the product to be introduced is acquired.

[0150] The voice data is processed to convert it to text, resulting in the text content of the operator introducing the current interface.

[0151] Based on the displayed actions on the current interface, extract the labeled text from the text content;

[0152] Fill in the annotation text in the annotation box that displays the operation instructions to obtain the operation guidance video of the product to be introduced.

[0153] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0154] The aforementioned storage medium can be ROM / RAM, magnetic disk, optical disk, etc. Since the computer program stored in the storage medium can execute the steps in any of the product operation guidance methods provided in the embodiments of this application, it can achieve the beneficial effects that any of the product operation guidance methods provided in the embodiments of this application can achieve, as detailed in the preceding embodiments, and will not be repeated here.

[0155] The foregoing has provided a detailed description of a product operation guidance method, apparatus, medium, and electronic device provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A product operation guidance method, characterized in that, include: During screen recording, in response to the operator's interface switching operation for the product to be introduced, the voice data collected by the operator when introducing the current interface of the product to be introduced is identified with a new encoding method, so that the encoding identifier of the voice data corresponding to different interfaces is different. The voice data is processed to convert it to text, resulting in the text content of the operator introducing the current interface. Based on the display operation responded to on the current interface, extract the labeled text from the text content; Fill the labeled text in the labeled box where the operation instructions are displayed to obtain the operation guidance video of the product to be introduced; The step of extracting labeled text from the text content based on the display operation responded to on the current interface includes: Detect the display operation responded to by the operable button on the current interface, locate the position of the keyword corresponding to the operable button in the text content, and the keyword includes the icon description, name or position description of the operable button; Based on the location of the keyword, extract the annotation text corresponding to the operable button from the text content.

2. The product operation guidance method according to claim 1, characterized in that, The process of filling the labeled text in the labeled box of the displayed operation instructions to obtain the operation guidance video of the product to be introduced includes: The text content other than the labeled text is identified as the interface description text; The interface description text is filled in the subtitle position of the current interface, and the annotation text is filled in the annotation box position of the operation instruction to obtain the operation guidance video of the product to be introduced.

3. The product operation guidance method according to claim 1, characterized in that, Before filling the annotation text in the annotation box of the displayed operation instructions to obtain the operation guidance video of the product to be introduced, the method further includes: According to the demonstration operation, circle the operable button on the current interface and add the annotation box at the circled position of the operable button.

4. The product operation guidance method according to any one of claims 1 to 3, characterized in that, After filling the annotation text in the annotation box of the displayed operation instructions to obtain the operation guidance video of the product to be introduced, the method further includes: Establish a resource association between the operation guidance video and the product to be introduced, and publish the product to be introduced with the resource association.

5. The product operation guidance method according to any one of claims 1 to 3, characterized in that, After filling the annotation text in the annotation box of the displayed operation instructions to obtain the operation guidance video of the product to be introduced, the method further includes: Obtain the standard and extended strategies configured by the operator based on the operation guidance video; The operation guidance video is identified based on the standard strategy and the extended strategy, and the identified operation guidance video is uploaded.

6. The product operation guidance method according to claim 5, characterized in that, After identifying the operation guidance video based on the standard strategy and the extended strategy, the method further includes: Match the corresponding video tag to the operation guidance video following the identifier; Match the corresponding target group tags to the video tags; Identify the customer group indicated by the target group label, and push the operation guidance video after the label to the customer group.

7. A product operation guidance device, characterized in that, include: The data acquisition module is used to identify the voice data collected by the operator when introducing the product in the current interface of the product during screen recording, in response to the operator's interface switching operation. This results in different encoding identifiers for the voice data corresponding to different interfaces. The voice processing module is used to process the voice data into text to obtain the text content of the operator when introducing the current interface; The text recognition module is used to extract labeled text from the text content based on the display operation responded to on the current interface. The video processing module is used to fill the annotation text in the annotation box of the display operation instructions to obtain the operation guidance video of the product to be introduced; The text recognition module is used for: Detect the display operation responded to by the operable button on the current interface, locate the position of the keyword corresponding to the operable button in the text content, and the keyword includes the icon description, name or position description of the operable button; Based on the location of the keyword, extract the annotation text corresponding to the operable button from the text content.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is run on a computer, it causes the computer to perform the product operation guidance method as described in any one of claims 1 to 6.

9. An electronic device comprising a processor and a memory, the memory storing a computer program, characterized in that, The processor invokes the computer program to execute the product operation guidance method as described in any one of claims 1 to 6.

Images