Operation guiding method and device, electronic equipment, storage medium and program product

Abstract

This application discloses an operation guidance method, apparatus, electronic device, storage medium, and program product, relating to the field of electronic device technology. The method includes: displaying an interface; upon receiving query information inquiring about the operation method for a target function, outputting guidance information for the target function based on the query information and interface context information, wherein the guidance information guides the execution of a triggered operation on an operation object in the interface; and upon detecting that an event indicated by the guidance information has been completed, updating the displayed interface and the guidance information, wherein the updated guidance information guides the execution of a triggered operation on an operation object in the updated interface, until the target function is completed. This application determines the guidance information based on the query information and interface context information to guide the user to complete the target function through operation objects in the interface, making the guidance information adaptable to the user's situation, thereby improving the guidance learning effect.

Description

Technical Field

[0001] This application relates to the field of electronic equipment technology, and more specifically, to an operation guidance method, apparatus, electronic equipment, storage medium, and program product. Background Technology

[0002] With the development of science and technology, electronic devices are becoming increasingly widespread and feature-rich, becoming an essential part of people's daily lives. When users ask questions about how to operate these devices, the devices typically provide pre-set operating instructions, leading to poor learning outcomes for users. Summary of the Invention

[0003] In view of the above problems, this application proposes an operation guidance method, apparatus, electronic device, storage medium, and program product to solve the above problems.

[0004] In a first aspect, embodiments of this application provide an operation guidance method, the method comprising: displaying an interface; upon receiving inquiry information for querying the operation method for a target function, outputting guidance information for the target function based on the inquiry information and interface context information of the interface, wherein the guidance information is used to guide the implementation of a trigger operation on an operation object in the interface; upon detecting that a trigger operation on an operation object in the interface has been implemented, updating the displayed interface and the guidance information, wherein the updated guidance information is used to guide the implementation of a trigger operation on an operation object in the updated interface, until the target function is completed.

[0005] Secondly, embodiments of this application provide an operation guidance device, the method comprising: displaying an interface; upon receiving inquiry information for querying the operation method for a target function, outputting guidance information for the target function based on the inquiry information and interface context information of the interface, wherein the guidance information is used to guide the implementation of a trigger operation on an operation object in the interface; upon detecting that a trigger operation on an operation object in the interface has been implemented, updating the displayed interface and the guidance information, wherein the updated guidance information is used to guide the implementation of a trigger operation on an operation object in the updated interface, until the target function is completed.

[0006] Thirdly, embodiments of this application provide an electronic device, including a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor performs the above-described method.

[0007] Fourthly, embodiments of this application provide a computer-readable storage medium storing program code, which can be invoked by a processor to execute the above-described method.

[0008] Fifthly, embodiments of this application provide a computer program product, which includes a computer program that, when executed by a processor, implements the above-described method.

[0009] The operation guidance method, apparatus, electronic device, storage medium, and program product provided in this application embodiment display interface. Upon receiving query information for inquiring about the operation method for a target function, the system outputs guidance information for the target function based on the query information and the interface context information. The guidance information guides the user to perform a trigger operation on the operation object in the interface. Upon detecting that the event indicated by the guidance information has been completed, the displayed interface and guidance information are updated. The updated guidance information guides the user to perform a trigger operation on the operation object in the updated interface until the target function is completed. Thus, the guidance information is determined based on the query information and the interface context information to guide the user to complete the target function through the operation object in the interface, making the guidance information adaptable to the user's situation, thereby improving the guidance learning effect. Attached Figure Description

[0010] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 A flowchart illustrating an operation guidance method provided in an embodiment of this application is shown;

[0012] Figure 2 A flowchart illustrating an operation guidance method provided in an embodiment of this application is shown.

[0013] Figure 3 A flowchart illustrating an operation guidance method provided in an embodiment of this application is shown;

[0014] Figure 4 This paper illustrates a first interface diagram of an electronic device provided in an embodiment of the present application;

[0015] Figure 5 A schematic diagram of a second interface of an electronic device provided in an embodiment of this application is shown;

[0016] Figure 6A schematic diagram of a third interface of an electronic device provided in an embodiment of this application is shown;

[0017] Figure 7 This invention illustrates a fourth interface diagram of the electronic device provided in an embodiment of this application;

[0018] Figure 8 A schematic diagram of a fifth interface of the electronic device provided in an embodiment of this application is shown;

[0019] Figure 9 A schematic diagram of a sixth interface of an electronic device provided in an embodiment of this application is shown;

[0020] Figure 10 A schematic diagram of a seventh interface of an electronic device provided in an embodiment of this application is shown;

[0021] Figure 11 A schematic diagram of an eighth interface of an electronic device provided in an embodiment of this application is shown;

[0022] Figure 12 A flowchart illustrating an operation guidance method provided in an embodiment of this application is shown;

[0023] Figure 13 A schematic diagram of a ninth interface of an electronic device provided in an embodiment of this application is shown;

[0024] Figure 14 A schematic diagram of a tenth interface of an electronic device provided in an embodiment of this application is shown;

[0025] Figure 15 This illustration shows an eleventh interface diagram of an electronic device provided in an embodiment of this application;

[0026] Figure 16 This invention illustrates a twelfth type of interface of an electronic device provided in an embodiment of this application;

[0027] Figure 17 A flowchart illustrating an operation guidance method provided in an embodiment of this application is shown;

[0028] Figure 18 A thirteenth interface diagram of the electronic device provided in this application embodiment is shown;

[0029] Figure 19 A schematic diagram of the fourteenth interface of the electronic device provided in this application embodiment is shown;

[0030] Figure 20 This invention illustrates a fifteenth type of interface of an electronic device provided in an embodiment of this application;

[0031] Figure 21 This application shows Figure 17The flowchart of step S520 of the guided operation shown is illustrated.

[0032] Figure 22 A timing diagram of the guiding method for operation provided in an embodiment of this application is shown;

[0033] Figure 23 This invention provides a block diagram of an operational guidance device according to an embodiment of the present application.

[0034] Figure 24 A block diagram of an electronic device for performing a bootstrapping method according to an embodiment of the present application is shown;

[0035] Figure 25 A storage unit for storing or carrying program code that implements a bootstrapping method according to an embodiment of the present application is shown. Detailed Implementation

[0036] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0037] Currently, when users inquire about how to operate electronic devices and their functions, the smart assistants of these devices primarily respond in the following three ways:

[0038] First, based on user inquiries, the intelligent assistant queries or generates relevant operation guides, which usually include text descriptions of the operation steps and some simple illustrations;

[0039] Secondly, the intelligent assistant can directly help users ask questions, or locate the destination page for the operation and provide further information in the form of voice or text replies;

[0040] Third, the intelligent assistant brings up the relevant document page and locates the position corresponding to the user's intent.

[0041] After a delay, the inventors discovered that the first method lacks intuitiveness, interactivity, and feedback mechanisms. The assistance provided is not well-suited to the user's current situation, requiring the user to understand the response and deduce subsequent operations based on the current interface, increasing cognitive burden and reducing problem-solving efficiency and accuracy. The second method, from the perspective of the user's subsequent problem-solving, directly assists the user in completing the operation, which is akin to "giving a man a fish," failing to enhance the user's autonomy and familiarity with and control over the operation of the function, leading to user dependence on the intelligent assistant and affecting future operational efficiency. The third method carries the risk of mismatched intent; a user's inquiry about an operation does not necessarily indicate an immediate intention to execute it, and directly performing the operation may violate user expectations, producing negative effects.

[0042] To address the aforementioned problems, the inventors, through extensive research, discovered and proposed the operation guidance method, apparatus, electronic device, storage medium, and program product provided in the embodiments of this application. Guidance information is determined based on query information and interface context information to guide the user to complete the target function through operation objects in the interface. This ensures that the guidance information is adapted to the user's situation, thereby improving the guidance learning effect. The specific operation guidance method will be described in detail in subsequent embodiments.

[0043] The technical terms that can be used in the embodiments of this application will be explained below:

[0044] Intelligent Assistant: An "intelligent assistant" refers to a computer program that uses artificial intelligence technology to interact with users through natural language processing, machine learning, and multimodal interaction technologies (such as voice, text, and images).

[0045] UI Automation: UI automation is an automated process that uses software tools and technologies to simulate user interactions with a graphical user interface (GUI). It can automatically perform actions such as clicking buttons, entering text, and selecting menus.

[0046] Please see Figure 1 , Figure 1 A flowchart illustrating an embodiment of the operation guidance method provided in this application is shown. This method determines guidance information based on query information and interface context information to guide the user to complete a target function through operation objects in the interface, making the guidance information adaptable to the user's situation, thereby improving the guidance learning effect. In a specific embodiment, this operation guidance method is applied to, for example... Figure 23 The illustrated operation guidance device 200 and the electronic device 100 equipped with the operation guidance device 200. Figure 24 The following will use an electronic device as an example to illustrate the specific process of this embodiment. Of course, it is understood that the electronic device used in this embodiment may include smartphones, tablets, wearable devices, in-vehicle devices, etc., and is not limited thereto. The following will focus on... Figure 1 The process shown is described in detail, and the guidance method for the operation may specifically include the following steps:

[0047] Step S110: Display the interface.

[0048] In this embodiment, the electronic device may display an interface. Optionally, the interface may include a lock screen, an always-on display, a desktop, an application interface, etc., and is not limited thereto.

[0049] The lock screen can be understood as the interface displayed on an electronic device before it is unlocked, designed to protect the device's security and privacy. When the lock screen is displayed, users need to enter a password, pattern, fingerprint, or other authentication method to access the desktop or application page. Of course, the lock screen can also display basic information such as time, date, notifications, and weather, allowing users to view these information without unlocking the device. Furthermore, the lock screen allows users to personalize it, such as changing the background image and adding widgets, to meet the aesthetic and usage needs of different users.

[0050] The always-on display (AOP) can be understood as the interface displayed on an electronic device when the touchscreen is off but some functions remain active. In AOP mode, users can view information such as time, date, and notifications without illuminating the entire screen. This allows users to quickly view important information without fully waking the device, and significantly reduces power consumption by illuminating only a small area of ​​the touchscreen. Furthermore, AOP allows users to personalize the display style and content, such as choosing different clock styles, adding images, or animations.

[0051] The desktop can be understood as the main interface that appears when an electronic device is unlocked; it's the core area for users to perform various operations and manage applications. Users can install, uninstall, move, and arrange application icons on the desktop for quick application launch and management. Furthermore, users can personalize the desktop according to their preferences and needs, such as changing background images, adjusting icon sizes, and adding widgets. Additionally, the desktop usually provides shortcuts for file management and access, making it convenient for users to view and manage files and data on their device.

[0052] In this context, the application interface can be understood as the page of an application that appears when an electronic device is unlocked. It typically refers to the specific interface through which the user interacts within a software or application. These pages are an important component of the software's functionality, used to display information, collect user input, provide navigation, and execute various operations requested by the user. The design of application pages directly impacts user experience and software usability.

[0053] Step S120: Upon receiving an inquiry message for asking how to operate a target function, based on the inquiry message and the interface context information of the interface, output guidance information for the target function, wherein the guidance information is used to guide the implementation of a trigger operation on the operation object in the interface.

[0054] Optionally, the target function can be any of the multiple functions supported by the electronic device. As an example, the target function may include: icon switching function, AI elimination function, wallpaper switching function, display brightness adjustment function, language setting function, etc., without limitation.

[0055] Optionally, the objects to be manipulated in the interface may include multimedia materials (such as text, images, and videos), buttons, input boxes, selection boxes, links, blank areas, etc., without limitation.

[0056] In this embodiment, during the display of the interface, it is possible to monitor whether a query message inquiring about the operation method for a target function is received. If such a query message is received, guidance information for the target function can be output based on the query message and the interface context information. This guidance information is used to guide the triggering of an operation on the object within the interface.

[0057] In some implementations, during the display of the interface, it is possible to monitor in real time whether an inquiry message for asking how to operate the target function is received; it is possible to monitor at preset time intervals whether an inquiry message for asking how to operate the target function is received; it is possible to monitor at preset time points whether an inquiry message for asking how to operate the target function is received, etc., without limitation.

[0058] As an example, if the message "How do I change the icon style?" is received, it can be determined that the message is asking how to operate the "icon switching function" for the target function; if the message "Where is the AI ​​removal function?" is received, it can be determined that the message is asking how to operate the "AI removal function" for the target function, etc., without further limitation.

[0059] As an feasible approach, inquiries can be input via voice. During the display process, if the target voice information is received, it can be determined whether the target voice information is used to inquire about the operation method of the target function. If it is determined that the target voice information is used to inquire about the operation method of the target function, it can be confirmed that an inquiry about the operation method of the target function has been received.

[0060] As another feasible approach, when the smart assistant is in the wake-up state, an input box can be displayed on the interface for the user to input text information. Therefore, queries can also be entered through the input box. During the display process, if the input target text information is received, it can be determined whether the target text information is used to inquire about the operation method of the target function. If it is determined that the target text information is used to inquire about the operation method of the target function, it can be confirmed that a query message for inquiring about the operation method of the target function has been received.

[0061] As another feasible approach, when the smart assistant is awake, it can display recommended commands that support touch operation on the interface. These recommended commands can be generated based on the user's interests on the interface, their usage habits, personal preferences, or usage scenarios, etc., without any limitations. Therefore, the query information page can be entered via touch-based recommended commands. During the display process, if a touch operation applied to a target recommended command is detected, it can be determined whether the target recommended command is used to inquire about the operation method of the target function. If it is determined that the target recommended command is used to inquire about the operation method of the target function, then it can be confirmed that a query information for inquiring about the operation method of the target function has been received.

[0062] In some implementations, upon receiving a query message inquiring about the operation method for a target function, the interface can be analyzed to obtain its context information. Based on the query message and the context information, guidance information for the target function can be output to guide the user to trigger operations on the objects within the interface. It is understood that the guidance information allows the user to know how to trigger the objects within the interface and then perform the corresponding operations according to the guidance. This can be achieved by parsing the layout and elements of the interface using interface parsing techniques or rule-based matching methods to obtain the interface context information. Optionally, the interface context information may include the content displayed on the interface, the position of each object within the interface, and the logical relationships between the objects, etc., without limitation. It is understood that since the interface context information includes various environmental and state information related to the interface, this information is beneficial for understanding the user's (interface's) operational scenario and intent.

[0063] Optionally, the guidance information for the target function output based on the query information and interface context information can be guidance information starting from the interface, that is, the operation object indicated by the guidance information can be the operation object in the interface. As an example, suppose the query is "How to change icon style" and the interface is the "Settings" screen. Based on the query and the interface's context, it can be determined that the user expects to change icon styles starting from the Settings screen. Therefore, the target operation indicated by the output guidance information for the target function should be an object within the Settings screen. Similarly, suppose the query is "How to change icon style" and the interface is the "Desktop". Based on the query and the interface's context, it can be determined that the user expects to change icon styles starting from the desktop. Therefore, the target operation indicated by the output guidance information for the target function can be an object within the desktop. Likewise, suppose the query is "Where is the AI ​​function?" and the interface is the "Photos" page. Based on the query and the interface's context, it can be determined that the user expects to enable the AI ​​removal function starting from the Photos page. Therefore, the target operation indicated by the output guidance information for the target function can be an object within the Photos page settings.

[0064] In some implementations, the operation steps to complete the target function (i.e., the complete operation steps required to achieve the target function) can be determined based on the query information and interface context information. The operation steps can include multiple guidance information. Therefore, the guidance information ranked first can be obtained from the operation steps and output as guidance information for the target function, so as to guide the operation object in the interface to perform the trigger operation through the output guidance information.

[0065] As an example, suppose the query is "How to change the icon style," and the interface is the "Settings interface." Based on the query and the interface context, the steps to complete the target function are: "1. Click [Wallpaper & Styling]; 2. Click [Icons]; 3. Select the desired style." Therefore, we can select the first-ranked guidance message, "Click [Wallpaper & Styling]," from the step descriptions and output "Click [Wallpaper & Styling]" to guide the user to perform a trigger operation on [Wallpaper & Styling] in the settings interface, such as clicking it.

[0066] As another example, suppose the query is "How to change the icon style," and the interface is a "desktop." Based on the query and the interface context, the steps to complete the target function are: "1. Long press on the [blank area] of the desktop; 2. Click on the [icon]; 3. Select the desired style." Based on this, the first guide message in the step description, "Long press on the [blank area] of the desktop," can be selected and output as "Long press on the [blank area] of the desktop" to guide the user to perform a trigger operation on the [blank area] of the desktop, such as a long press.

[0067] As another example, suppose the query is "Where is the AI ​​removal function?" and the interface is the "Album page". Based on the query and the interface context, the steps to complete the target function are: "1. Click [Edit]; 2. Click [AI Removal]". Therefore, the first prompt in the step description, "Click [Edit]", can be selected and output to guide the user to perform a click operation on the [Edit] button in the Album page.

[0068] In some implementations, outputting guidance information for a target function may include displaying guidance information for the target function on the interface.

[0069] One approach is to overlay a guide window onto the interface and display guide information in the guide window to guide the triggering of operations on the objects in the interface.

[0070] The display position of the guidance information on the interface can be preset. Based on this, when guidance information for a specific target function is determined, it can be displayed at the preset position. Optionally, the display position of the guidance information on the interface can remain fixed or change dynamically based on user actions; this is not limited here. Optionally, the display position can be located in the top, bottom, or corner areas of the interface to reduce display interference. Optionally, the display position can be located near the object to be triggered, serving as an identifier for the object to be triggered.

[0071] In some implementations, outputting guidance information for a target function may include: voice-reading guidance information for the target function.

[0072] In one approach, the guidance information can be broadcast once; after broadcasting the guidance information once, it can be checked whether a specified condition is met, and if the specified condition is met, the guidance information can be broadcast again. Optionally, the specified condition can be an instruction to broadcast again upon receiving user input, or no trigger operation is detected on the operation object in the interface within a preset time after the broadcast.

[0073] In some implementations, outputting guidance information for a target function may include: displaying guidance information for the target function on the interface, and verbally reading out guidance information for the target function.

[0074] Step S130: If it is detected that a trigger operation has been performed on the operation object in the interface, update the displayed interface and guidance information, wherein the updated guidance information is used to guide the trigger operation to be performed on the operation object in the updated interface until the target function is completed.

[0075] In this embodiment, when the interface is displayed and guidance information for the target function is output, it is possible to detect whether a trigger operation has been performed on the operation object in the interface. If a trigger operation on the operation object in the interface is detected, the displayed interface and guidance information can be updated. This updated guidance information can be used to guide the trigger operation on the operation object in the updated interface until the target function is completed.

[0076] In some implementations, when displaying the interface and outputting guidance information for the target function, it is possible to detect in real time whether a trigger operation has been performed on the operation object in the interface, or to detect at a preset time interval, or at a preset time point, or to detect according to other preset conditions, etc., without limitation.

[0077] As an example, if the object of operation in the interface is the aforementioned "[Wallpaper and Stylization]", then if a click operation is detected on "[Wallpaper and Stylization]", it can be determined that a trigger operation on the object of operation in the interface has been detected; if the object of operation in the interface is the aforementioned "[Blank Area]", then if a long press operation is detected on "[Blank Area]", it can be determined that a trigger operation on the object of operation in the interface has been detected, and so on. These will not be elaborated further here.

[0078] In some implementations, when a trigger operation on an object in the interface is detected, the electronic device can respond to the trigger operation on the object in the interface by switching from displaying the current interface to displaying the interface corresponding to the triggered object, i.e., updating the displayed interface, wherein the updated interface is the interface corresponding to the triggered object in the interface.

[0079] In some implementations, when a trigger operation on an object in the interface is detected, the electronic device can respond to the trigger operation on the object in the interface by jumping from the current guidance information to the next guidance information, i.e., updating the guidance information, wherein the updated guidance information is the next guidance information of the current guidance information.

[0080] As one feasible approach, upon detecting that a trigger operation has been performed on an object within the interface, the electronic device can respond to the trigger operation by retrieving the guidance information ordered after the current guidance information from the operation step description. Then, it updates the guidance information based on the guidance information ordered after the current guidance information, where the updated guidance information is the guidance information ordered after the current guidance information. Optionally, if the current guidance information is the guidance information ranked first in the operation step description, then the updated guidance information is the guidance information ranked second in the operation step description.

[0081] As an example, the operation steps are described as "1. Click [Wallpaper & Stylize]; 2. Click [Icon]; 3. Select the desired style", and the current output guidance information is "Click [Wallpaper & Stylize]". Then, if it is detected that an operation has been triggered on the operation object in the interface, the guidance information can be updated to "Click [Icon]".

[0082] In some implementations, when updated guidance information is obtained, it can be detected whether the updated guidance information is the last guidance information in the operation procedure description. If it is determined that the updated guidance information is the last guidance information in the operation procedure description, it can be determined that the user can complete the target function by triggering an operation on the operation object in the updated interface; if it is determined that the updated guidance information is not the last guidance information in the operation procedure description, the steps of updating the interface and updating guidance information can be repeated until the target function is completed.

[0083] Therefore, this embodiment establishes an interaction mechanism and feedback channel between the user and the interface, linking in real-time with the interface context information. What is seen is what is learned, and what is learned is what is done, eliminating the need for users to deduce operations themselves. This results in a more intuitive experience and less cognitive burden. Furthermore, learning and operation proceed in parallel; the interaction mechanism and real-time feedback deepen user memory, enhance autonomy and a sense of mastery, leading to more profound retention. Additionally, guidance information is provided at each operation step, making the operation guidance more human-centered and providing a warm and supportive experience for the user.

[0084] An embodiment of this application provides an operation guidance method. The display interface, upon receiving an inquiry message asking for an operation method for a target function, outputs guidance information for the target function based on the inquiry message and the interface context information. The guidance information guides the user to perform a trigger operation on an operation object within the interface. Upon detecting that the event indicated by the guidance information has been completed, the displayed interface and the guidance information are updated. The updated guidance information guides the user to perform a trigger operation on an operation object within the updated interface until the target function is completed. This method determines the guidance information based on the inquiry message and the interface context information, guiding the user to complete the target function through operation objects within the interface. This adapts the guidance information to the user's situation, thereby improving the learning effect.

[0085] Please see Figure 2 , Figure 2 A flowchart illustrating an embodiment of the guiding method for operation provided in this application is shown. The following will focus on... Figure 2 The process shown is described in detail, and the guidance method for the operation may specifically include the following steps:

[0086] Step S210: Display the interface.

[0087] For a detailed description of step S210, please refer to step S110, which will not be repeated here.

[0088] Step S220: Upon receiving an inquiry message for asking how to operate a target function, based on the inquiry message and the interface context information of the interface, output guidance information for the target function, and highlight the operation object in the guidance message on the interface, wherein the guidance information is used to guide the triggering operation of the operation object in the interface.

[0089] In this embodiment, during the display of the interface, it is possible to monitor whether a query message inquiring about the operation method for a target function is received. If such a query message is received, based on the query message and the interface context information, guidance information can be output to guide the user to perform a trigger operation on an object within the interface, and the object in the guidance information can be highlighted on the interface.

[0090] In some implementations, when a query message is received asking how to operate a target function, guidance information for the target function can be determined based on the query message and interface context information. The operation object indicated by the guidance message can be identified from the interface, and if the operation object indicated by the guidance message is identified from the interface, the operation object indicated by the guidance message can be highlighted on the interface.

[0091] As an feasible approach, given the guidance information for the target function, key data can be extracted from the guidance information, such as the ID, class name, location coordinates, or other unique identifiers of the object to be operated on. Then, the interface elements are traversed; for example, if the interface is a webpage, the DOM (Document Object Model) tree can be traversed to find matching interface elements; if the interface is an application page or desktop, the UI component tree can be traversed to find matching interface elements. Next, the key data extracted from the guidance information is used to match the interface elements on the interface. If an interface element is matched using the extracted key data, the matched interface element can be identified as the object to be operated on as indicated by the guidance information, and the matched interface element can be highlighted on the interface.

[0092] Optionally, highlighting the operation object in the guide information on the interface may include: highlighting the operation object in the guide information on the interface; displaying the operation object in the guide information on the interface with color changes (such as eye-catching colors); displaying the operation object in the guide information on the interface with animation effects (such as zooming, rotating, etc.); displaying the operation object in the guide information on the interface with added borders; displaying the operation object in the guide information on the interface with added lines; displaying the operation object in the guide information on the interface with changed transparency, etc., without limitation.

[0093] Step S230: If it is detected that a trigger operation has been performed on the operation object in the interface, update the displayed interface and guidance information, wherein the updated guidance information is used to guide the trigger operation to be performed on the operation object in the updated interface until the target function is completed.

[0094] For a detailed description of step S230, please refer to step S130, which will not be repeated here.

[0095] An embodiment of this application provides an operation guidance method. The display interface, upon receiving a query message inquiring about the operation method for a target function, outputs guidance information for the target function based on the query message and the interface context information. The method also highlights the operation object in the guidance information on the interface. The guidance information guides the execution of a triggered operation on the operation object in the interface. Upon detecting that the event indicated by the guidance information has been completed, the displayed interface and guidance information are updated. The updated guidance information guides the execution of a triggered operation on the operation object in the updated interface until the target function is completed. Compared to... Figure 1 The operation guidance method shown in this embodiment also highlights the operation object in the guidance information on the interface to more intuitively guide the user to touch the operation object, thereby improving the user experience.

[0096] Please see Figure 3 , Figure 3 A flowchart illustrating an embodiment of the guiding method for operation provided in this application is shown. The following will focus on... Figure 3 The process shown is described in detail, and the guidance method for the operation may specifically include the following steps:

[0097] Step S310: Display the interface.

[0098] Step S320: Upon receiving an inquiry message for asking how to operate a target function, based on the inquiry message and the interface context information of the interface, output guidance information for the target function, wherein the guidance information is used to guide the implementation of a trigger operation on the operation object in the interface.

[0099] For a detailed description of steps S310-S320, please refer to steps S110-S120, which will not be repeated here.

[0100] Step S330: When a touch operation is detected on an object in the interface, a trigger operation is performed on the object in the interface.

[0101] Alternatively, users can manually trigger operations on the objects in the interface.

[0102] In this embodiment, during the output of guidance information to guide the user to perform a trigger operation on an object in the interface, touch operations on the object can be detected. If a touch operation is detected, the user can respond to the touch operation and perform a trigger operation on the object to complete the trigger operation, thus guiding the user to the next step until the user completes the target function or exits midway. If no touch operation is detected, the guidance information can be continuously output, or the output of the guidance information can be stopped when the output duration reaches a duration threshold.

[0103] In some implementations, during the output of guidance information for guiding the triggering of operations on the operation objects in the interface, the touch operations on the operation objects in the interface can be detected in real time, at preset time intervals, at preset time points, or according to other preset rules, etc., without limitation.

[0104] Optionally, touch operations applied to objects in the interface may include: clicking, pressing, and swiping operations on objects in the interface, etc., without limitation.

[0105] As an example, assuming the object of operation in the interface is a control, when a touch operation is detected on the control, a trigger operation can be performed on the control to jump to the interface corresponding to the control.

[0106] Step S340: If it is detected that a trigger operation has been performed on the operation object in the interface, update the displayed interface and guidance information, wherein the updated guidance information is used to guide the trigger operation to be performed on the operation object in the updated interface until the target function is completed.

[0107] For a detailed description of step S340, please refer to step S130, which will not be repeated here.

[0108] As an example, please refer to Figures 4-7 ,like Figure 4 As shown, while the electronic device is displaying the "Settings interface," the user can ask the smart assistant how to operate a specific function. Specifically, the user can ask the smart assistant how to switch icon styles, and the smart assistant receives the question "How do I switch icon styles?". Figure 5As shown, based on the query information and the interface context, the intelligent assistant displays the prompt "Click [Wallpaper & Stylize]" on the interface and highlights the [Wallpaper & Stylize] control to guide the user to perform a trigger operation on the [Wallpaper & Stylize] control in the interface. Figure 6 As shown, if a click operation is detected on the [Wallpaper & Stylization] control, the interface and guidance information can be updated, displaying the updated interface and guidance information. Specifically, the updated guidance information can be the "Click [Icon]" section. At this time, the [Icon] section can be highlighted to guide the user to perform a trigger operation on the [Icon] section in the updated interface. Figure 7 As shown, if a click operation is detected on the [icon] section, the interface and guidance information can be updated to display the updated interface and guidance information. Specifically, the updated guidance information can be "[You can change the icon style here]", and the user can then complete the target function of switching icon styles in the updated interface.

[0109] As yet another example, please refer to Figures 8-11 ,like Figure 8 As shown, while the electronic device is displaying the "desktop," the user can ask the smart assistant how to operate a specific function. Specifically, the user can ask the smart assistant how to switch icon styles, and the smart assistant receives the question "How do I switch icon styles?". Figure 9 As shown, based on the query information and interface context information, the intelligent assistant displays the guidance message "Long press [empty area on the desktop]" and highlights the [empty area] to guide the user to perform a trigger operation on the empty area of ​​the interface. Figure 10 As shown, if a long press operation is detected on the [blank area], the interface and guidance information can be updated, displaying the updated interface and guidance information. Specifically, the updated guidance information can be the "Click [icon]" option. At this time, the [icon] option can be highlighted to guide the user to trigger the [icon] option in the updated interface. Figure 11 As shown, if a click operation is detected on the [icon] option, the interface and guidance information can be updated to display the updated interface and guidance information. Specifically, the updated guidance information can be "[You can change the icon style here]", and the user can then complete the target function of switching the icon style in the updated interface.

[0110] An embodiment of this application provides an operation guidance method. The display interface, upon receiving a query message inquiring about the operation method for a target function, outputs guidance information for the target function based on the query message and the interface context information. This guidance information guides the execution of a trigger operation on an operation object within the interface. Upon detecting a touch operation on an operation object within the interface, it is determined that a trigger operation will be performed on the operation object. The displayed interface and guidance information are then updated. The updated guidance information guides the execution of a trigger operation on the updated operation object within the updated interface until the target function is completed. Compared to... Figure 1 The operation guidance method shown in this embodiment can also be completed by the user touching the operation object in the interface, thereby improving the guidance effect.

[0111] Please see Figure 12 , Figure 12 A flowchart illustrating an embodiment of the guiding method for operation provided in this application is shown. The following will focus on... Figure 12 The process shown is described in detail, and the guidance method for the operation may specifically include the following steps:

[0112] Step S410: Display the interface.

[0113] Step S420: Upon receiving an inquiry message for asking how to operate a target function, based on the inquiry message and the interface context information of the interface, output guidance information for the target function, wherein the guidance information is used to guide the implementation of a trigger operation on the operation object in the interface.

[0114] For a detailed description of steps S410-S420, please refer to steps S110-S120, which will not be repeated here.

[0115] Step S430: Upon receiving voice information indicating the next step, a trigger operation is performed on the operation object in the interface.

[0116] Optionally, users can use voice input to instruct electronic devices to perform trigger operations on objects in the interface.

[0117] In this embodiment, during the output of guidance information to guide the user to perform a trigger operation on an object in the interface, it is possible to detect whether voice information instructing the user to proceed to the next step has been received. If voice information instructing the user to proceed to the next step is received, the system can respond to this voice information by performing the trigger operation on the object in the interface, thereby guiding the user to the next step until the user completes the target function or exits midway. If no voice information instructing the user to proceed to the next step is received, the guidance information can be continuously output, or the output of the guidance information can be stopped when the output duration reaches a duration threshold.

[0118] In some implementations, during the process of outputting guidance information to guide the triggering operation of the operation object in the interface, it is possible to detect in real time whether voice information indicating the next step has been received, or to detect at a preset time interval, or at a preset time point, or to detect under other preset conditions, etc., without limitation.

[0119] Optionally, the voice information used to indicate the next step may include: then what, next step, after that, etc., without limitation.

[0120] As an example, assuming the object of operation in the interface is a control, when a voice message is received indicating to proceed to the next step, it can be assumed that the user is instructing the electronic device to perform a trigger operation on the control in order to jump to the interface corresponding to the control.

[0121] Step S440: If it is detected that a trigger operation has been performed on the operation object in the interface, update the displayed interface and the guidance information, wherein the updated guidance information is used to guide the trigger operation to be performed on the operation object in the updated interface until the target function is completed.

[0122] For a detailed description of step S440, please refer to step S130, which will not be repeated here.

[0123] As an example, please refer to Figures 13-16 ,like Figure 13 As shown, while the electronic device is displaying the "Album Page," the user can ask the smart assistant how to operate a specific function. Specifically, the user can ask the smart assistant how to operate the AI ​​erasure function, and the smart assistant will receive the question, "Where is the AI ​​erasure function?" Figure 14 As shown, based on the query information and the interface context information, the intelligent assistant displays the prompt "Click [Edit]" on the interface and highlights the [Edit] control to guide the user to perform the trigger operation on the [Edit] control in the interface. Figure 15 As shown, if the system receives a voice message from the user saying "Then what?", it can be interpreted as the user instructing the electronic device to trigger the [Edit] control. The electronic device can then trigger the [Edit] control, updating the interface and guidance information accordingly. Specifically, the updated guidance information could be "Click [AI Elimination]". At this point, the [AI Elimination] control can be highlighted to guide the user to trigger the [AI Elimination] control in the updated interface. Figure 16 As shown, if the system receives a voice message from the user asking "What's next?", it can be assumed that the user is instructing the electronic device to trigger the [AI Elimination] control. The electronic device can then trigger the [AI Elimination] control, and accordingly, it updates the interface and guidance information, displaying the updated interface and guidance information. Specifically, the updated guidance information can be "[You can use related functions here]", allowing the user to complete the AI ​​elimination target function within the updated interface.

[0124] An embodiment of this application provides an operation guidance method. The display interface, upon receiving a query message inquiring about the operation method for a target function, outputs guidance information for the target function based on the query message and the interface context information. This guidance information guides the execution of a trigger operation on an object within the interface. Upon receiving voice information instructing the user to proceed to the next step, and determining that a trigger operation will be performed on the object within the interface, the displayed interface and guidance information are updated. The updated guidance information guides the execution of a trigger operation on the updated object within the interface until the target function is completed. Compared to... Figure 1 The operation guidance method shown in this embodiment can also be improved by having the user complete the corresponding operation by using voice to guide the electronic device to the operation object on the touch interface.

[0125] Please see Figure 17 , Figure 17 A flowchart illustrating an embodiment of the guiding method for operation provided in this application is shown. The following will focus on... Figure 17 The process shown is described in detail, and the guidance method for the operation may specifically include the following steps:

[0126] Step S510: Display the interface.

[0127] For a detailed description of step S510, please refer to step S110, which will not be repeated here.

[0128] Step S520: Upon receiving the inquiry information, based on the inquiry information and the interface context information of the interface, a window is displayed on the interface, and an operation step description for completing the target function is displayed in the window. The operation step description includes multiple guidance messages, which are used to guide the triggering operation on the operation object in the interface.

[0129] In this embodiment, during the display of the interface, it is possible to monitor whether a query message inquiring about the operation method for a target function is received. If such a query message is received, the operation steps for completing the target function can be determined based on the query message and the interface context information. A window is then displayed on the interface, along with the operation steps for completing the target function, which may include multiple pieces of guidance information.

[0130] In some implementations, if the steps to complete the target function are determined, a floating window can be displayed on the interface, and the steps to complete the operation can be displayed in the window.

[0131] Optionally, the size of the window can be dynamically changed based on the content of the operation steps instructions. For example, if the operation steps instructions are short, the window size can be set to a smaller size to reduce display interference with the interface; if the operation steps instructions are long, the window size can be set to a larger size to ensure complete display of the operation steps instructions and improve the user experience.

[0132] Optionally, the size of the window can remain fixed. If the operation steps are short, they can be displayed in their entirety in the window; if the operation steps are long, the content can be scrolled within the window to be shown or hidden, without any limitation.

[0133] like Figure 18 As shown, assuming the query message is "How to change the icon style" and the interface is the "Settings interface", then, based on the query message and the interface context, the operation steps to complete the target function are determined to be "1. Click [Wallpaper & Styling]; 2. Click [Icons]; 3. Select the desired style". At this time, a window can be displayed on the settings interface, showing the operation steps including the three guiding messages: "1. Click [Wallpaper & Styling]; 2. Click [Icons]; 3. Select the desired style".

[0134] like Figure 19As shown, assuming the query message is "How to change the icon style" and the interface is "desktop", then, based on the query message and the interface context, the operation steps to complete the target function are determined to be "1. Long press on the desktop [blank area]; 2. Click on the [icon]; 3. Select the desired style". At this time, a window can be displayed on the desktop, showing the operation steps including the three guiding messages: "1. Long press on the desktop [blank area]; 2. Click on the [icon]; 3. Select the desired style".

[0135] like Figure 20 As shown, assuming the query is "Where is the AI ​​removal function?" and the interface is the "Album Page", then, based on the query and interface context, the steps to complete the target function are "1. Click [Edit]; 2. Click [AI Removal]". At this point, a window can be displayed on the Album Page, showing the steps including the two guiding messages: "1. Click [Edit]; 2. Click [AI Removal]".

[0136] Please see Figure 21 , Figure 21 This application shows Figure 17 The flowchart shown illustrates the steps S520 of the guided operation method. The following will focus on... Figure 21 The process shown will be described in detail, and the method may specifically include the following steps:

[0137] Step S521: Upon receiving the query information, based on the query information and the interface context information of the interface, determine the operation method to complete the target function, and determine the number of operation methods, wherein each operation method corresponds to an operation step description.

[0138] It is understandable that there can be one or more paths to complete the target function starting from the interface. Different paths can correspond to different operation methods. For example, suppose there are two different paths to complete the target function starting from the interface. The first path requires three steps to complete the target function, and the second path requires two steps to complete the target function. Then the first path can correspond to one operation method, and the operation step description for this operation method includes three steps. That is, the operation step description for the first path can include three pieces of guidance information. The second path can correspond to another operation method, and the operation step description for this operation method includes two steps. That is, the operation step description for the second path can include two pieces of guidance information.

[0139] In some implementations, upon receiving a query message inquiring about the operation method for a target function, the operation method for completing the target function can be determined based on the query message and interface context information, and the number of such operation methods can be determined. Optionally, the number may include one, two, three, etc., and is not limited thereto.

[0140] Step S522: Display the window on the interface, and display the operation steps corresponding to the operation mode in the window based on the quantity.

[0141] In some implementations, when the operation method for completing the target function is determined and the number of operation methods is determined, a window can be displayed on the interface, and the operation steps corresponding to the operation method can be displayed in the window based on the number of operation methods.

[0142] As one feasible approach, the electronic device can pre-set and store mapping relationships, which may include multiple quantities, multiple display modes, and correspondences between multiple quantities and multiple display modes. In this embodiment, when the number of operation step descriptions is determined, the display modes corresponding to the number of operation step descriptions can be determined based on the mapping relationship, and the operation step descriptions corresponding to the number of operation modes can be displayed in the window according to the display modes corresponding to the number of operation modes.

[0143] Optionally, if there is only one operation method, the operation steps corresponding to that operation method can be directly displayed in the window.

[0144] Optionally, if there are multiple operation methods, the window can display the operation steps for each of these methods. These operation steps can be sorted and displayed in the window according to their priority from highest to lowest. For example, they can be sorted and displayed in the window according to the amount of guidance information included, from least to most; according to the frequency of use of the corresponding path, from highest to lowest; or according to the amount of private content involved, from least to most, etc. No further limitation is imposed here.

[0145] Optionally, if there are multiple operation methods, the optimal operation method can be selected from among them, and the corresponding operation steps description can be displayed in the window. Specifically, the operation method with the highest priority can be selected as the optimal operation method. For example, the operation method with the least amount of guidance information can be selected, the operation method with the highest frequency of use of the corresponding path can be selected, or the operation method involving the least amount of private content can be selected, etc., without limitation.

[0146] Step S530: If the window meets the specified conditions, output the guidance information.

[0147] In this embodiment, the electronic device can pre-set and store specified conditions, which serve as the basis for determining whether a window is displayed on the interface. Therefore, in this embodiment, during the process of displaying a window on the interface, it can be detected whether the window meets the specified conditions. If the window meets the specified conditions, it indicates that the user expects to start interactive guidance, and guidance information can be output. The output guidance information can be the guidance information listed first in the operation steps description. If the window does not meet the specified conditions, guidance information can be withheld, and the window can remain displayed on the interface.

[0148] As an example, if the instruction information is as follows: Figure 18 The instructions shown include three guided steps: "1. Click [Wallpaper & Stylize]; 2. Click [Icon]; 3. Select the desired style." If the window meets certain conditions, it can output the guided message "Click [Wallpaper & Stylize]," as shown below. Figure 5 As shown.

[0149] As another example, if the instruction information is as follows: Figure 19 The instructions include three guided steps: "1. Long press on the [blank area] of the desktop; 2. Click on the [icon]; 3. Select the desired style." Therefore, if the window meets certain conditions, it can output the guided message "Long press on the [blank area] of the desktop," as shown below. Figure 9 As shown.

[0150] As another example, if the instruction information is as follows: Figure 20 The instructions shown include two guided messages: "1. Click [Edit]"; "2. Click [AI Eliminate]". Therefore, if the window meets the specified conditions, the guided message "Click [Edit]" can be output, such as... Figure 14 As shown.

[0151] In some implementations, during the display of a window on the interface, the display duration of the window can be detected and compared with a duration threshold to determine whether the display duration of the window has reached the threshold. If it is determined that the display duration of the window has reached the duration threshold, it can be determined that the window meets the specified conditions, and guidance information is output.

[0152] In some implementations, during the process of displaying a window on the interface, input voice information can be detected and compared with specified voice information to determine whether the input voice information matches the specified voice information. If it is determined that the input voice information matches the specified voice information, the window is deemed to meet a specified condition, and guidance information is output.

[0153] In some implementations, the window also includes a target control, which can display operation steps and the target control. During the display of the window on the interface, touch operations applied to the target control can be detected. If a touch operation is detected on the target control, it can be determined that the window meets specified conditions, and then guidance information is output.

[0154] Optionally, the touch operation applied to the target control may include: a click operation applied to the target control, a press operation applied to the target control, a swipe operation applied to the target control, etc., without limitation.

[0155] Step S540: If it is detected that a trigger operation has been performed on the operation object in the interface, update the displayed interface and guidance information, wherein the updated guidance information is used to guide the trigger operation to be performed on the operation object in the updated interface until the target function is completed.

[0156] For a detailed description of step S540, please refer to step S130, which will not be repeated here.

[0157] An embodiment of this application provides an operation guidance method. The method displays an interface, and upon receiving a query message, based on the query message and the interface context information, displays a window on the interface. The window displays operation steps for a target function, including multiple guidance messages. These guidance messages guide the execution of trigger operations on operation objects within the interface. When the window meets specified conditions, the guidance messages are output. Upon detecting that an event indicated by the guidance messages has been completed, the displayed interface and guidance messages are updated. The updated guidance messages guide the execution of trigger operations on operation objects within the updated interface until the target function is completed. Compared to... Figure 1The operation guidance method shown in this embodiment also first displays the operation steps for the target function on the interface, so that the user can understand the operation required to achieve the whole process and choose whether to proceed with subsequent interactive guidance, thereby improving the user experience.

[0158] Next, let's combine... Figure 22 The timing sequence shown describes the guidance method for the operations involved in the foregoing embodiments.

[0159] like Figure 22 As shown, when an electronic device receives a user's query to inquire about the operation of a certain function while displaying an interface, the device can analyze the user's query and interface context information, query relevant documents locally or online, generate operation steps for completing the queried function, and display them on the interface. If the user follows the operation steps to perform interactive guidance (such as clicking the target control), interactive guidance can begin. At this time, the next step instructions (guidance information) can be displayed / announced, and the operation objects in the interface can be highlighted. Based on the guidance information, the user can have the system trigger the operation objects on their behalf or trigger the operation objects themselves until the queried function is completed.

[0160] Please see Figure 23 , Figure 23 A block diagram of an operational guidance device according to an embodiment of this application is shown. The following will focus on... Figure 23 The block diagram shown illustrates that the operation guidance device 200 includes: an interface display module 210, a guidance information output module 220, and a guidance information update module 230, wherein:

[0161] Interface display module 210 is used to display the interface.

[0162] The guidance information output module 220 is used to output guidance information for the target function based on the inquiry information and the interface context information of the interface when it receives the inquiry information for asking how to operate on the target function. The guidance information is used to guide the implementation of a trigger operation on the operation object in the interface.

[0163] Furthermore, the guidance information output module 220 includes: an operation step display submodule and an operation step broadcasting submodule, wherein:

[0164] The operation steps display submodule is used to display guide information on the interface.

[0165] The operation step broadcasting submodule is used to broadcast guidance information via voice.

[0166] Furthermore, the guidance information output module 220 includes: a window display submodule and a guidance information output submodule, wherein:

[0167] The window display submodule is used to display a window on the interface based on the inquiry information and the interface context information of the interface when the inquiry information is received, and to display an operation step description for completing the target function in the window, wherein the operation step description includes multiple guidance information.

[0168] Furthermore, the window display submodule includes: a quantity determination unit and a window display unit, wherein:

[0169] The quantity determination unit is used to determine the operation method for completing the target function based on the query information and the interface context information of the interface when the query information is received, and to determine the quantity of the operation method, wherein each operation method corresponds to an operation step description.

[0170] A window display unit is used to display the window on the interface, and to display the operation steps corresponding to the operation mode in the window based on the number of windows.

[0171] Furthermore, when there are multiple operation step descriptions, the window display unit includes: a first operation step description subunit and a second operation step description subunit, wherein:

[0172] The first operation step description subunit is used to select the optimal operation mode from multiple operation modes and display the operation step description corresponding to the optimal operation mode in the window.

[0173] The second operation step description subunit is used to display the operation step descriptions corresponding to each of the multiple operation methods in the window.

[0174] The guidance information output submodule is used to output the guidance information when the window meets specified conditions.

[0175] Furthermore, the window also includes a target control, and the guidance information output submodule includes: a guidance information output unit, wherein:

[0176] The guidance information output unit is used to output the guidance information when a touch operation is detected on the target control.

[0177] The guidance information update module 230 is used to update the displayed interface and guidance information when it is detected that a trigger operation has been performed on the operation object in the interface. The updated guidance information is used to guide the trigger operation to be performed on the operation object in the updated interface until the target function is completed.

[0178] Furthermore, the operation guidance device 200 also includes: an operation object highlighting module, wherein:

[0179] The object highlighting module is used to highlight the objects in the guide information on the interface.

[0180] Furthermore, the operation object highlighting module includes: an operation object highlighting submodule, wherein:

[0181] The Operation Object Highlighting Submodule is used to highlight the operation objects in the guide information on the interface.

[0182] Furthermore, the operation object highlighting module includes: an operation object recognition unit and an operation object highlighting unit, wherein:

[0183] The operation object identification unit is used to identify the operation object indicated by the guidance information from the interface.

[0184] The operation object highlighting unit is used to highlight the operation object indicated by the guidance information on the interface.

[0185] Furthermore, the operation guidance device 200 further includes: a first trigger operation determination module and a second trigger operation determination module, wherein:

[0186] The first trigger operation determination module is used to perform a trigger operation on the operation object in the interface when a touch operation is detected acting on the operation object in the interface.

[0187] The second trigger operation determination module is used to perform a trigger operation on the operation object in the interface when it receives voice information indicating that the next step should be performed.

[0188] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0189] In the several embodiments provided in this application, the coupling between modules can be electrical, mechanical, or other forms of coupling.

[0190] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0191] Please see Figure 24 This document illustrates a structural block diagram of an electronic device 100 provided in an embodiment of this application. The electronic device 100 can be a smartphone, tablet computer, e-reader, or other electronic device capable of running applications. The electronic device 100 in this application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications can be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more applications are configured to perform the methods described in the foregoing method embodiments.

[0192] The processor 110 may include one or more processing cores. The processor 110 connects to various parts within the electronic device 100 using various interfaces and lines, and performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 120, and by calling data stored in the memory 120. Optionally, the processor 110 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 110 may integrate one or a combination of several of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content to be displayed; and the modem handles wireless communication. It is understood that the modem may also not be integrated into the processor 110 and may be implemented separately using a communication chip.

[0193] The memory 120 may include random access memory (RAM) or read-only memory (ROM). The memory 120 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing functions (such as touch functionality, sound playback functionality, image playback functionality, etc.), and instructions for implementing the various method embodiments described below. The data storage area may also store data created by the electronic device 100 during use (such as phonebook data, audio and video data, chat log data, etc.).

[0194] In some embodiments, the electronic device 100 may further include a touch screen, which is used to display information input by the user, information provided to the user, and various graphical user interfaces of the electronic device 100. These graphical user interfaces may be composed of graphics, text, icons, numbers, video, and any combination thereof. In one example, the touch screen may be a liquid crystal display (LCD) or an organic light-emitting diode (OLED), without limitation.

[0195] In some embodiments, the electronic device 100 may further include a camera for collecting user motion data. Optionally, the camera may include a front-facing camera, a rear-facing camera, a telescopic camera, a rotating camera, etc., and is not limited thereto.

[0196] In some embodiments, the electronic device 100 may further include sensors, including a light sensor that can be used to turn off the touchscreen display when an object approaches the touchscreen, such as when the body of the electronic device is moved to the ear. The sensor may also include a pressure sensor that can detect pressure generated by pressing on the electronic device; that is, the pressure sensor can detect pressure generated by contact or pressing between the user and the electronic device, such as pressure generated by contact or pressing between the user's ear or finger and the electronic device. The sensor may also include a gravity sensor that can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. This can be used for applications that identify the posture of the electronic device (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometers, taps), etc. Additionally, the electronic device may also be equipped with other sensors such as gyroscopes, barometers, and hygrometers, which are not limited here.

[0197] In some embodiments, the electronic device 100 may also include an artificial intelligence module, which may be integrated into the processor 110 of the electronic device 100 to improve the intelligence level and performance of the electronic device.

[0198] Of course, electronic devices may include many other components, which will not be elaborated here.

[0199] Please see Figure 25 This diagram illustrates a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. The computer-readable medium 300 stores program code that can be called by a processor to execute the methods described in the above method embodiments.

[0200] The computer-readable storage medium 300 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 300 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 300 has storage space for program code 310 that performs any of the method steps described above. This program code can be read from or written to one or more computer program products. The program code 310 may be compressed, for example, in a suitable form.

[0201] In some embodiments, this application provides a computer program product comprising a computer program that, when executed by a processor, implements the recommended method of the instructions in the embodiments of this application.

[0202] In summary, the operation guidance method, apparatus, electronic device, storage medium, and program product provided in this application embodiment, displaying an interface, upon receiving inquiry information for querying the operation method for a target function, outputs guidance information for the target function based on the inquiry information and the interface context information. The guidance information guides the user to perform a trigger operation on the operation object in the interface. Upon detecting that the event indicated by the guidance information has been completed, the displayed interface and guidance information are updated. The updated guidance information guides the user to perform a trigger operation on the operation object in the updated interface until the target function is completed. Thus, the guidance information is determined based on the inquiry information and the interface context information to guide the user to complete the target function through the operation object in the interface, making the guidance information adaptable to the user's situation, thereby improving the guidance learning effect.

[0203] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for guiding an operation, characterized in that, The method includes: Display interface; Upon receiving a query message inquiring about the operation method for a target function, based on the query message and the interface context information of the interface, guidance information for the target function is output, wherein the guidance information is used to guide the triggering operation of the operation object in the interface; If a trigger operation on an object in the interface is detected, the displayed interface and guidance information are updated. The updated guidance information is used to guide the trigger operation on the object in the updated interface until the target function is completed.

2. The method according to claim 1, characterized in that, The method further includes: Highlight the objects to be operated on in the guide information on the interface.

3. The method according to claim 2, characterized in that, The step of highlighting the operation object in the guidance information on the interface includes: Highlight the operation objects in the guide information on the interface.

4. The method according to claim 2, characterized in that, Highlighting the operation object in the guidance information on the interface includes: Identify the target object indicated by the guidance information from the interface; Highlight the target object indicated by the guide information on the interface.

5. The method according to claim 1, characterized in that, The output includes guidance information for the target function, including: Display guidance information on the interface; and / or The system provides voice prompts and guidance.

6. The method according to claim 1, characterized in that, Before updating the displayed interface and guidance information upon detecting that a trigger operation on an object in the interface has been performed, the method further includes: Upon detecting a touch operation applied to an object within the interface, a trigger operation is performed on the object within the interface; or Upon receiving voice information instructing the user to proceed to the next step, a trigger operation is performed on the object in the interface.

7. The method according to any one of claims 1-6, characterized in that, Upon receiving a query message inquiring about the operation method for a target function, the system outputs guidance information for the target function based on the query message and the interface context information, including: Upon receiving the inquiry information, based on the inquiry information and the interface context information of the interface, a window is displayed on the interface, and an operation step description for completing the target function is displayed in the window, wherein the operation step description includes multiple pieces of guidance information; If the window meets the specified conditions, the guidance information will be output.

8. The method according to claim 7, characterized in that, The window also includes a target control, and the step of outputting the guidance information when the window meets specified conditions includes: Upon detecting a touch operation applied to the target control, the guidance information is output.

9. The method according to claim 7, characterized in that, Upon receiving the query information, based on the query information and the interface context information, a window is displayed on the interface, and the window displays instructions on the operation steps to complete the target function, including: Upon receiving the query information, based on the query information and the interface context information of the interface, the operation method for completing the target function is determined, and the number of operation methods is determined, wherein each operation method corresponds to an operation step description; The window is displayed on the interface, and the operation steps corresponding to the operation method are displayed in the window based on the number of operations.

10. The method according to claim 9, characterized in that, When there are multiple operation methods, displaying the operation steps corresponding to each operation method in the window based on the number of methods includes: Select the optimal operation method from multiple operation methods and display the corresponding operation steps description in the window; or The window displays the operation steps corresponding to each of the multiple operation methods.

11. An operational guidance device, characterized in that, The device includes: The interface display module is used to display the interface. The guidance information output module is used to output guidance information for the target function based on the inquiry information and the interface context information of the interface when it receives the inquiry information for asking how to operate on the target function. The guidance information is used to guide the implementation of a trigger operation on the operation object in the interface. The guidance information update module is used to update the displayed interface and the guidance information when it is detected that a trigger operation has been performed on the operation object in the interface. The updated guidance information is used to guide the trigger operation to be performed on the operation object in the updated interface until the target function is completed.

12. An electronic device, characterized in that, The method includes a memory and a processor, the memory being coupled to the processor, the memory storing instructions, and when the instructions are executed by the processor, the processor performing the method as described in any one of claims 1-10.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium contains program code that can be invoked by a processor to execute the method as described in any one of claims 1-10.

14. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the method as described in any one of claims 1-10.

Images