Interface display method and apparatus

Abstract

The embodiments of the present application relate to the technical field of terminals. Provided are an interface display method and apparatus. The method comprises: upon receiving an operation to activate a first voice assistant, displaying a first window; upon receiving the operation of a user inputting a first message into the first window, displaying the first message and a second message in the first window, wherein the second message is a reply message provided by the first voice assistant on the basis of the first message; and upon receiving the operation of the user inputting a third message into the first window, displaying the third message and a fourth message in the first window, wherein the fourth message is a reply message provided by a second voice assistant on the basis of the third message. In this way, an electronic device can provide conversation messages in different scenarios (such as a first scenario and a second scenario) in a first window, thereby enhancing the flexibility for users in using voice assistants.

Description

Interface display method and device TECHNICAL FIELD

[0001] The present application relates to the technical field of terminals, and in particular to an interface display method and device. BACKGROUND

[0002] With the popularity and development of the Internet, people's functional requirements for electronic devices are increasingly diversified. Many electronic devices can provide a voice assistant, which can reply based on a demand message input by a user. For example, a user can use a voice assistant to query the weather, set a schedule reminder, and the like.

[0003] Generally, a user can input a demand message in a conversation window of a voice assistant, and the voice assistant can provide a corresponding reply message according to the demand message. In the case where the voice assistant cannot provide a reply message, the electronic device jumps to another interface.

[0004] However, the above method of using a voice assistant has certain limitations.

[0005] SUMMARY

[0006] Embodiments of the present application provide an interface display method and device, applied to the technical field of terminals, for improving the flexibility of a voice assistant.

[0007] In a first aspect, an embodiment of the present application provides a display method, which includes: after receiving an operation of starting a first voice assistant, displaying a first interface, the first interface including: a first window; after receiving an operation of a user inputting a first message into the first window, displaying the first message in the first window; when the first message is a message under a first scenario, displaying a second message in the first window, the second message being a reply message provided by the first voice assistant based on the first message; after receiving an operation of the user inputting a third message into the first window, displaying the third message in the first window; when the third message is a message under a second scenario, displaying a fourth message in the first window, the fourth message being a reply message provided by a second voice assistant based on the third message. In this way, the electronic device can provide conversation messages under different scenarios (such as the first scenario and the second scenario) in the first window, so as to improve the flexibility of the user using the voice assistant.

[0008] In a possible implementation manner, the first window further includes a first button, and the method further includes: after receiving an operation on the first button, displaying a second interface, the second interface including: a second window, the second window being used for processing conversation messages under the second scenario; after receiving an operation of inputting the third message into the second window, displaying the third message and the fourth message in the second window.

[0009] The first button can be the button 308 in the dialog window 305, the second interface can be the interface shown in FIG. 5B, and the second window can be the dialog window 506 in FIG. 5B. The third message can be the message 1 described in FIG. 5C, and the fourth message can be the message 530 and / or the message 531 described in FIG. 5D. Among them, the message 530 in FIG. 5D is the same as the message 424 in FIG. 3C, and the message 531 in FIG. 5D is the same as the message 325 in FIG. 3C.

[0010] In this way, the electronic device can make targeted demand questions in the second window after detecting that the user enters the second window corresponding to the second voice assistant, and the second voice assistant can also provide more accurate message replies.

[0011] In a possible implementation, the first window further includes a first button, and after the fourth message is displayed in the first window, the method further includes: displaying a second interface after receiving an operation on the first button, the second interface including: a second window, the second window including: a third message and a fourth message, and the second window being used to process dialog messages in a second scenario.

[0012] It can be understood that, in a case where the user opens the first window and then enters the second window based on the first button in the first window, the electronic device can carry the message in the first window to the second window, so as to simplify the step of re-inputting the same message in the second window by the user and improve the flexibility of the second voice assistant.

[0013] In a possible implementation, before the second interface is displayed, the method further includes: displaying a third interface, the third interface including: a second button, the second button being related to the second voice assistant; and displaying the second interface, including: displaying the second interface after receiving an operation on the second button.

[0014] The third interface can be the interface shown in FIG. 5A, and the second button can be the button 504 in FIG. 5A.

[0015] It can be understood that the third interface can further include a button related to another voice assistant, so that the user can select multiple voice assistants after entering the third interface, and select the second voice assistant related to the user's demand.

[0016] In a possible implementation, the first window further includes a fifth message, and the method further includes: displaying a second button after receiving an operation of forwarding the fifth message in the first window; and displaying the fifth message in the second window after receiving an operation on the second button.

[0017] The fifth message can be message 1 described in FIG. 6C, and the operation of forwarding the fifth message can be a click operation of a user on a forwarding button 601 around message 1 in FIG. 6C. The second button can also be button 603 in FIG. 6D, and the second window can also be window 506 in FIG. 6F.

[0018] In this way, the electronic device can also manually copy the message in the first window into the second window based on the forwarding operation of the user on the message, so as to simplify the step of the user re-inputting the same message in the second window.

[0019] In a possible implementation, after displaying the second interface, the method further includes: displaying a sixth message in the second window after receiving an operation of inputting the sixth message into the second window; when the sixth message does not belong to the message under the second scenario and the sixth message belongs to a message under a third scenario, displaying first prompt information and a third button in the second interface, the first prompt information is used to prompt whether to jump to a third window, and the third window is used to process the conversation message under the third scenario, and the third scenario is different from the second scenario; and displaying a fourth interface after receiving an operation on the third button, the fourth interface includes the third window, the third window includes the sixth message and a seventh message, and the seventh message is a reply message provided by the third voice assistant based on the sixth message.

[0020] The sixth message can be message 801 described in FIG. 8B, the third scenario can be a life information scenario, and the third voice assistant can be a life service assistant.

[0021] The first prompt information can be prompt information 803 in FIG. 8B, and the third button can be button 805 in FIG. 8B. The third window can be a conversation window 813 in FIG. 8D. The fourth interface can be the interface shown in FIG. 8D, and the seventh message can include at least one of the following messages in FIG. 8D: message 806, message 807, or message 808.

[0022] In this way, when the electronic device detects the sixth message irrelevant to the second scenario, the electronic device prompts the user to jump to another window related to the sixth message, so that the user obtains a reply message related to the sixth message in the new window.

[0023] In a possible implementation, the second window further includes: prompt information for indicating that the second voice assistant is entered for the first time, or a historical conversation message under the second voice assistant.

[0024] The prompt information for indicating that the second voice assistant is entered for the first time can be message 508 in FIG. 5B, and the historical conversation message under the second voice assistant can be message 522 in FIG. 5F.

[0025] In this way, the electronic device can provide various prompt information in the second window, so as to provide more appropriate services for the user.

[0026] In a possible implementation, the fourth message is further surrounded by the display of the identification of the second voice assistant. The identification of the second voice assistant can be the service identification 321 and / or the service name 322 in FIG. 3C. In this way, the user can quickly understand, through the identification of the second voice assistant, that the fourth message is a reply message provided by which voice assistant.

[0027] In a possible implementation, before the third message is displayed in the first window, the method further includes: displaying a fourth button associated with the second voice assistant after receiving an operation of inputting the first identification into the first window; displaying a first text box in the first window after receiving an operation on the fourth button; and receiving an operation of inputting the third message into the first window by the user, including: receiving an operation of inputting the third message into the first text box.

[0028] The first identification can be the reference symbol 402 in FIG. 4A, the fourth button can be the button 404 in FIG. 4B, the first text box can be the text box 406 in FIG. 4C, and the third message can be the message 1 in the message 2.

[0029] In this way, the electronic device can distribute the third message to the second voice assistant through the reference, so that the second voice assistant can provide a reply message related to the third message in the first window, thereby improving the flexibility of the dialogue.

[0030] In a possible implementation, the method further includes: displaying the eighth message in the first window after receiving an operation of inputting the eighth message into the first window; and displaying a ninth message in the first window when the eighth message belongs to a message in a fourth scenario, the ninth message being a reply message provided by a fourth voice assistant based on the eighth message, and the ninth message being further surrounded by the display of an identification of the fourth voice assistant.

[0031] The eighth message can be the message 801 described in FIG. 8C, the fourth scenario can be a life information scenario, the ninth message can be one or more of the following messages: the message 806, the message 807, or the message 808 described in FIG. 8C, and the fourth voice assistant can be a life service assistant. The identification of the fourth voice assistant can be the service identification 809 and / or the service name 810 in FIG. 8C.

[0032] In a possible implementation, the second window further includes an identifier of the second voice assistant, and the method further includes: displaying a fifth interface after receiving an operation on the identifier of the third voice assistant in the second window, the fifth interface including: a fifth button, the fifth button being configured to initiate a fill-in type message in the second scenario; and displaying a tenth message in an input box of the second window after receiving an operation on the fifth button, the tenth message including a second text box, the second text box being configured to fill in other content in the tenth message.

[0033] The identifier of the third voice assistant can be the service identifier 500 in FIG. 5B, the fifth interface can be the interface shown in FIG. 7A, and the fifth button can be the button 706 in FIG. 7A.

[0034] The input box of the second window can be the text box 710 in FIG. 7B, the tenth message can be the message displayed in the text box 710 in FIG. 7B, and the second text box can include at least one of the following text boxes in FIG. 7B: the text box 712 or the text box 713.

[0035] In a possible implementation, the message displayed in the first window exists in one or more of the following forms: a window, a button, a list, a card, or a multi-task selector.

[0036] In a second aspect, an embodiment of the present application provides an interface display apparatus. The interface display apparatus can be an electronic device, or a chip or chip system in the electronic device. The interface display apparatus can include a display unit and a processing unit. When the interface display apparatus is an electronic device, the display unit can be a display screen. The display unit is configured to perform the step of displaying, so that the electronic device implements an interface display method described in the first aspect or any possible implementation of the first aspect. When the interface display apparatus is an electronic device, the processing unit can be a processor. The interface display apparatus can further include a storage unit, which can be a memory. The storage unit is configured to store instructions, and the processing unit executes the instructions stored in the storage unit, so that the electronic device implements an interface display method described in the first aspect or any possible implementation of the first aspect. When the interface display apparatus is a chip or chip system in the electronic device, the processing unit can be a processor. The processing unit executes the instructions stored in the storage unit, so that the electronic device implements an interface display method described in the first aspect or any possible implementation of the first aspect. The storage unit can be a storage unit (for example, a register, a cache, etc.) in the chip, or a storage unit (for example, a read-only memory, a random access memory, etc.) in the electronic device and located outside the chip.

[0037] Specifically, after the processing unit receives an operation of starting the first voice assistant, the display unit is configured to display a first interface, the first interface including a first window; after the processing unit receives an operation of a user inputting a first message into the first window, the display unit is further configured to display the first message in the first window; when the first message is a message in a first scenario, the display unit is further configured to display a second message in the first window, the second message being a reply message provided by the first voice assistant based on the first message; after the processing unit receives an operation of the user inputting a third message into the first window, the display unit is further configured to display the third message in the first window; when the third message is a message in a second scenario, the display unit is further configured to display a fourth message in the first window, the fourth message being a reply message provided by the second voice assistant based on the third message.

[0038] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is configured to store computer program codes, the computer program codes comprising computer instructions, and the one or more processors are configured to invoke the computer instructions to enable the electronic device to perform the method described in the first aspect or any possible implementation manner of the first aspect.

[0039] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, the computer readable storage medium comprising computer instructions, and when the computer instructions run on an electronic device, the computer instructions enable the electronic device to perform the method described in the first aspect or any possible implementation manner of the first aspect.

[0040] In a fifth aspect, an embodiment of the present application provides a computer program product comprising a computer program, and when the computer program product comprises computer program codes, and when the computer program codes run on an electronic device, the computer program codes enable the electronic device to perform the method described in the first aspect or any possible implementation manner of the first aspect.

[0041] In a sixth aspect, an embodiment of the present application provides a chip system, the chip system being applied to an electronic device, and the chip system comprising one or more processors, and the one or more processors are configured to invoke computer instructions to enable the electronic device to perform the method described in the first aspect or any possible implementation manner of the first aspect.

[0042] In a possible implementation, the chip system described in the present application further comprises at least one memory, and the at least one memory stores instructions. The memory can be a storage unit inside the chip system, for example, a register, a cache, etc., or can be a storage unit of the chip system (for example, a read-only memory, a random access memory, etc.).

[0043] It should be understood that the second aspect to the sixth aspect of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation manners are similar, and will not be repeated. BRIEF DESCRIPTION OF DRAWINGS

[0044] FIGS. 1A-1E are schematic diagrams of a scenario according to an embodiment of the present application;

[0045] FIG. 2 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

[0046] FIGS. 3A-3C are schematic diagrams of an interface according to an embodiment of the present application;

[0047] FIGS. 4A-4E are schematic diagrams of an interface according to an embodiment of the present application;

[0048] FIGS. 5A-5F are schematic diagrams of an interface according to an embodiment of the present application;

[0049] FIGS. 6A-6F are schematic diagrams of an interface according to an embodiment of the present application;

[0050] FIGS. 7A-7C are schematic diagrams of an interface according to an embodiment of the present application;

[0051] FIGS. 8A-8E are schematic diagrams of an interface according to an embodiment of the present application;

[0052] FIGS. 9A-9C are schematic diagrams of an interface according to an embodiment of the present application;

[0053] FIG. 10 is a schematic diagram of a flow of an interface display method according to an embodiment of the present application;

[0054] FIG. 11 is a schematic diagram of a hardware structure of another electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0055] In order to clearly describe the technical solutions of the embodiments of the present application, the following briefly introduces some terms and technologies involved in the embodiments of the present application:

[0056] 1. Voice assistant

[0057] The voice assistant can enable the user to interact with the electronic device through natural speech. The voice assistant can exist in the electronic device in the form of a service, or can exist in the electronic device in the form of an application.

[0058] The voice assistant can also be referred to as a first voice assistant, a YOYO assistant, an intelligent dialogue, an artificial intelligence (AI) assistant, or other names, which are not limited in the embodiments of the present application. In subsequent embodiments, the voice assistant will be presented as YOYO assistant in the interface, which will not be described again.

[0059] For example, after the user wakes up the voice assistant, the user can input voice information or text information of "check the weather of A city today" to the electronic device, and the voice assistant can broadcast the weather of A city, so that the user can understand the weather of A city without opening the weather application.

[0060] The voice assistant has three states: a silent state, a listening state (or a hearing state), and a thinking state. In the silent state, the voice assistant does not receive sound, at which time the microphone can be in a closed state; in the listening state, the voice assistant starts to receive sound, at which time the microphone can be in an open state and receive voice information of the user; in the thinking state, the voice assistant ends the sound receiving and replies to the message input by the user.

[0061] 2. Intelligent agent

[0062] The intelligent agent can also be referred to as a second voice assistant.

[0063] The intelligent agent and the voice assistant can be parallel services. Alternatively, the intelligent agent can also provide services in different scenarios in the voice assistant, at which time the intelligent agent can also be referred to as a sub-service, a sub-scene, a skill, an AI model, an AI service, or other names, which are not limited in the embodiments of the present application.

[0064] The intelligent agent can be divided according to different use scenarios, such as the intelligent agent can include one or more of the following: a smart travel assistant applied to a travel scenario, a life service assistant applied to a life information scenario, or a smart film-making assistant applied to a video editing scenario.

[0065] Among them, the smart travel assistant can realize functions such as flight query, ticket booking, and itinerary planning; the life service assistant can realize functions related to the user's daily life, such as restaurant query, schedule creation, and schedule reminder; and the smart film-making assistant can realize functions such as generating a short video within a certain period of time based on pictures, videos, and audio content in the electronic device.

[0066] The intelligent agent can be a service developed by the manufacturer of the electronic device, a service provided by a third party, or a service generated by cooperation between the manufacturer of the electronic device and a third party application, or a service related to the developer. The intelligent agent can also include: an interesting entertainment intelligent agent, a learning and education intelligent agent, an image generation intelligent agent, a health intelligent agent, etc.

[0067] The method of using the intelligent agent can refer to the description in FIGS. 5A-5F, which is not repeated here.

[0068] It can be understood that the intelligent agent name provided in the embodiments of the present application and the functions allowed by the intelligent agent are only used as an example and do not constitute a limitation on the embodiments of the present application.

[0069] 3, conversation window

[0070] The conversation window can be a window for interacting with the user. The conversation window can also be referred to as a window. The conversation window can include conversation messages, such as a user input requirement message (e.g., message A) and an electronic device reply message (e.g., message B) provided based on message 1.

[0071] The message A can include a text message input by the user through a text box, a voice message input by the user, or a message selected by the user in any application interface, etc. The message type of the message A or the message B can be text, picture, voice, video, or file, etc. The message type of the message A and the message B is not limited in the embodiments of the present application.

[0072] For example, the conversation window can include a first window and a second window.

[0073] The first window can be a conversation window pulled up after the wake-up voice assistant, or understood as a conversation window corresponding to the voice assistant. The user can interact with the voice assistant through the first window. For example, the first window can be the conversation window 305 in FIG. 3B.

[0074] The second window can be a conversation window pulled up after entering any intelligent agent, or understood as a conversation window corresponding to the intelligent agent. The user can interact with any intelligent agent through the second window.

[0075] It can be understood that in the case of including multiple intelligent agents in the voice assistant, each intelligent agent can correspond to a second window, i.e., the second window can be multiple. For example, the second window can include the conversation window 506 in FIG. 5B or the conversation window 813 in FIG. 8D, etc.

[0076] 4, user interface (UI) component

[0077] The UI component can be a basic element of the UI. In the case of displaying any UI component on the electronic device, the user can interact with the electronic device by triggering the UI component.

[0078] The UI component can include one or more of a window, a button, a list, a card, a multitasking selector, and the like.

[0079] The window can be understood as an independent view, and the window can generally include a title bar, a border, a content area, and the like. The button can be understood as an element that allows a user to click, and the button can be used to trigger an operation or an event. The list can be used to display a group of items or entries, and the list generally appears in a vertical or horizontal arrangement, and each item can include text, icons, or other UI elements. The card can be understood as a visual container for grouping and displaying related information. The multitasking selector can allow a user to switch between multiple tasks (or buttons), and the multitasking selector can include text boxes, buttons, and the like.

[0080] It can be understood that one or more UI components can be displayed in the dialog window described in the embodiments of the present application.

[0081] 5. Electronic device

[0082] The electronic device in the embodiments of the present application can include a handheld device with a display function, a vehicle-mounted device, and the like. For example, some electronic devices are a mobile phone, a tablet computer, a palm computer, a notebook computer, a mobile internet device (MID), a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, a vehicle-mounted device, a wearable device, a terminal device in a 5G network, or a terminal device in a future evolved public land mobile network (PLMN), and the like, and the embodiments of the present application are not limited thereto. The wearable device can include one or more of a smart watch, smart glasses, a smart bracelet, smart jewelry, and the like.

[0083] The electronic device in the embodiments of the present application can also be referred to as a terminal device, a user equipment (UE), a mobile station (MS), a mobile terminal (MT), an access terminal, a subscriber unit, a subscriber station, a mobile station, a mobile terminal, a remote station, a remote terminal, a mobile device, a user terminal, a terminal, a wireless communication device, a user agent, or a user apparatus, and the like.

[0084] 6. Other terms

[0085] In the embodiments of the present application, the terms "first", "second", and the like are used to distinguish between similar or identical items or items with substantially the same function and effect. For example, the first chip and the second chip are merely used to distinguish between different chips, and do not limit the order. Those skilled in the art can understand that the terms "first", "second", and the like do not limit the number and execution order, and the terms "first", "second", and the like do not necessarily mean different.

[0086] It should be noted that in the embodiments of the present application, the words "exemplary" or "for example" are used to represent an example, illustration or description. Any embodiment or design scheme described as "exemplary" or "for example" in the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the use of "exemplary" or "for example" is intended to present the relevant concept in a specific manner.

[0087] In the embodiments of the present application, "at least one" means one or more, and "multiple" means two or more. The association relationship between the associated objects is described, which means that there can be three kinds of relationships, for example, A and / or B, which can represent the following cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects. "At least one of the following" or similar expressions means any combination of these items, including any combination of single item or multiple items. For example, at least one of a, b, or c can represent a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c can be single or multiple.

[0088] The use method of the voice assistant will be schematically described below in combination with the embodiments of FIGS. 1A-1E. FIGS. 1A-1E are a scene schematic diagram provided by the embodiments of the present application. In the embodiments of the present application, an electronic device is taken as an example of a mobile phone, which does not constitute a limitation on the embodiments of the present application.

[0089] FIGS. 1A-1B can schematically show a process in which the voice assistant can reply based on the demand message of the user, and FIGS. 1C-1E can schematically show a process in which the voice assistant cannot reply based on the demand message of the user.

[0090] In response to the user opening the voice assistant and inputting the message 101, the electronic device can display the interface shown in FIG. 1A and the interface shown in FIG. 1B in turn. The message 101 can be used to query the weather, for example, the message 101 can be displayed as the word "How is the weather today".

[0091] As shown in FIG. 1A, the interface can include a conversation window 102 corresponding to the voice assistant. The conversation window 102 can be a window for displaying conversation messages, which include a demand message (e.g., message 101) input by the user and a reply message provided by the electronic device based on the demand message.

[0092] The conversation window 102 can also be referred to as the window 102. The window 102 can display a button 104, an option bar 103, the message 101, a button 106, a text box 107, and a button 108.

[0093] The button 104 can be used to adjust the size of the window 102. For example, in response to the user dragging the button 104 and sliding it downward, the height of the window 102 gradually decreases, and the electronic device can implement the function of reducing or closing the window 102. Alternatively, in response to the user dragging the button 104 and sliding it upward, the height of the window 102 gradually increases, and the electronic device can implement the function of enlarging the window 102.

[0094] The option bar 103 can display, from left to right, a conversation button 105, a recommendation button, a smart composition button, a text creation button, and a settings button. The conversation button 105 is in a selected state, which can be understood as a state of thickening and / or enlarging the line.

[0095] The conversation button 105 can be used to view the window 102. The recommendation button can be used to view the sub-services recommended by the voice assistant. The smart composition button can be used to view the sub-services related to smart composition. The text creation button can be used to view the sub-services related to text creation. The settings button can be used to set the voice assistant.

[0096] The button 106 can be used to start the microphone. For example, in response to the user clicking the button 106, the electronic device can start the microphone and collect the voice information input by the user.

[0097] The text box 107 can be used to collect the text information input by the user and edit the text information.

[0098] The button 108, which can also be referred to as a send button 108, can be used to send the content in the text box 107 to the window 102.

[0099] The window 102 of FIG. 1B can display the message 101, a message 109, and a message 110. The messages 109 and 110 can be reply messages provided by the voice assistant based on the message 101.

[0100] For example, the message 109 can display the weather condition of B city, such as displaying temperature information, air quality index, and the like. The message 110 can display the weather condition of B city in the form of a card. The specific content displayed in the message 109 and the message 110 is only an example.

[0101] Based on the description of FIGS. 1A-1B, in a case where the voice assistant can reply to the demand message of the user, the voice assistant can display the reply message (such as the message 109 and / or the message 110) in the dialogue window 102.

[0102] In response to the operation of the user continuously inputting the message 111 in the dialogue window 102 of FIG. 1B, the electronic device can display the interface shown in FIG. 1C and the interface shown in FIG. 1D in sequence. The message 111 can be used to subscribe to a ticket, for example, the message 111 can be displayed as “Help me book a ticket from B city to A city”.

[0103] The message 111 can be displayed in the dialogue window 102 of FIG. 1C, and other content displayed in the dialogue window 102 of FIG. 1C can refer to the description in FIG. 1B.

[0104] The message 112 can be displayed in the dialogue window 102 of FIG. 1D. The message 112 can be a reply message provided by the voice assistant based on the message 111, and the message 112 can be used to indicate that the voice assistant cannot continue to provide services. For example, the message 112 can be displayed as “OK”. Alternatively, the message 112 can also be displayed as “Cannot provide a reply temporarily” and the like, which is not limited in the embodiments of the present application.

[0105] Optionally, after replying to the message 112 in FIG. 1D, the voice assistant in the electronic device can also jump to other applications (such as a browser application) and search for content related to the message 111 in the other applications, at which time the electronic device can display the interface shown in FIG. 1E.

[0106] FIG. 1E can be an interface obtained by the electronic device when searching for the message 111 in other applications (such as a browser application), and the content displayed in FIG. 1E is only an example and does not constitute a limitation on the embodiments of the present application. For example, FIG. 1E can be referred to as a ticket query interface, and the search box 113 and the like can be displayed in FIG. 1E, which can be used to query a ticket from B city to A city.

[0107] It can be understood that FIG. 1E can be an example of the electronic device searching for the message 111 in the browser application. Alternatively, the electronic device can also search for the message 111 in other applications. For example, when the message 111 is a message related to restaurant search, the electronic device can also filter an application 1 capable of implementing restaurant search and display a restaurant search interface in the application 1, which is not limited in the embodiments of the present application.

[0108] Based on the description of FIGS. 1C-1D, in a case where the voice assistant cannot reply to the demand message of the user, the voice assistant can reply to the message 112; or, based on the description of FIGS. 1C-1E, in a case where the voice assistant cannot reply to the demand message of the user, the voice assistant can also search for content related to the demand message in other applications after replying to the message 112, which is not limited in the embodiments of the present application.

[0109] Based on the description of FIGS. 1C-1E, the message 101 can be a message that the voice assistant can reply to, and the message 111 can be a message that the voice assistant cannot reply to. In a case where the voice assistant cannot reply to the demand message of the user, the voice assistant can jump to an interface other than the dialogue window 102 (as shown in FIG. 1E), so that the user can perform related operations in the other interface.

[0110] It can be understood that the services that can be provided in the voice assistant are relatively limited. In the case of increasing user demands, there are many cases that need to jump to other applications to complete the conversion of user demands, which has poor flexibility and weak immersion of the dialogue, affecting the user experience.

[0111] Therefore, the embodiments of the present application provide an interface display method, so that the voice assistant can provide dialogue messages in different scenarios in the first window, for example, dialogue messages in a weather scenario, dialogue messages in a travel scenario, dialogue messages in a life information scenario, etc., to improve the flexibility of the user using the voice assistant.

[0112] In order to better understand the embodiments of the present application, the structure of the electronic device of the embodiments of the present application is introduced below. For example, FIG. 2 is a schematic diagram of the hardware structure of an electronic device provided by the embodiments of the present application.

[0113] The electronic device can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, an indicator 192, a camera 193, and a display screen 194, etc.

[0114] In the embodiments of the present application, the sensor module 180 can include a touch sensor 180A, which can be used to receive the triggering operation of the user on the electronic device.

[0115] The sensor module 180 can further include one or more of a proximity light sensor and an ambient light sensor, a pressure sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a temperature sensor, or a bone conduction sensor, etc. (not shown in FIG. 2), which are not specifically limited in the embodiments of the present application.

[0116] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device can include more or fewer components than illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0117] The processor 110 can include one or more processing units, and the processor 110 can implement the steps of detecting a user's air gesture in the power supply method provided by the embodiments of the present application, and controlling the device to execute corresponding instructions based on the user's air gesture.

[0118] The USB interface 130 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc.

[0119] The charging management module 140 is configured to receive a charging input from a charger. The power management module 141 is configured to connect the charging management module 140 and the processor 110.

[0120] The wireless communication function of the electronic device can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0121] The electronic device implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor.

[0122] The display screen 194 is configured to display images and videos, etc. For example, the display screen 194 can display the interfaces shown in FIGS. 1A-1E and FIGS. 3A-9C described in the embodiments of the present application.

[0123] The electronic device can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0124] The camera 193 is configured to capture still images or videos.

[0125] The external memory interface 120 can be used to connect an external memory card. The internal memory 121 can be used to store computer executable program code, which includes instructions.

[0126] The electronic device can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, and an application processor, etc. For example, music playing, recording, etc.

[0127] The microphone 170C, also known as a "microphone", "microphone", is used to convert a sound signal into an electrical signal. When a user inputs voice information to the electronic device through the microphone, the user can speak by approaching the microphone 170C with the mouth, and the electronic device can collect a sound signal through the microphone 170C, and can also convert the sound signal into text information and display it on the display screen.

[0128] The touch sensor 180A can be provided on the display screen 194, and the touch sensor 180A and the display screen 194 form a touch screen, also known as a "touch screen". The touch sensor 180A can detect a target operation or other trigger operation of the user on the electronic device.

[0129] The keys 190 include a power-on key, a volume key, etc.

[0130] The software system of the electronic device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc., which will not be described here.

[0131] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific examples. The following specific examples can be implemented independently, or can be combined with each other, and the same or similar concepts or processes can not be described in detail in some examples.

[0132] The display method provided by the embodiments of the present application enables the electronic device to implement service distribution in the first window, service distribution in the second window, and data interaction in the first window and the second window, etc.

[0133] 1. Distribute services in the conversation window (Figures 3A-5F)

[0134] In the embodiments of the present application, the electronic device can provide multiple service distribution methods. For example, the electronic device can actively distribute services in the first window, which can be described in detail in the following method A; or the electronic device can distribute services in the first window by referencing services, which can be described in detail in the following method B; or the electronic device can distribute services in the second window, which can be described in detail in the following method C.

[0135] Manner A: the electronic device proactively performs service distribution in the first window (Figures 3A-3C)

[0136] In response to the user's long-press operation on the physical button, the electronic device can display the interface as shown in Figure 3A. The physical button can include a power button in the electronic device.

[0137] The manner of pulling up the conversation window can not be limited to the above-mentioned long-press operation on the physical button. For example, in response to the user's voice message or gesture operation, etc., the electronic device can also pull up the conversation window, which is not limited in the embodiments of the present application.

[0138] The bottom position of Figure 3A can display a conversation window 301, which can display one or more of the following: an identifier 302, a button 306, a button 311, a button 303, and a prompt information 304.

[0139] The identifier 302 can be a service identifier corresponding to the voice assistant.

[0140] The button 306 can be used to adjust the size of the conversation window 301. For example, in response to the user's operation of pressing the button 306 and sliding upwards, the electronic device can enlarge the conversation window 301, such as enlarging the conversation window 301 to the size of the conversation window 305 in Figure 3B; or in response to the user's operation of pressing the button 306 and sliding downwards, the electronic device can reduce the conversation window 301 or close the conversation window 301.

[0141] The button 311 can be used to input other elements into the conversation window 301 in addition to text information, such as pictures, videos, audios, or documents, etc.

[0142] The button 303 can be used to pull up a soft keyboard. For example, in response to the user's operation of clicking the button 303, the electronic device can display a soft keyboard as shown in Figure 3A, so that the user can input text information into the conversation window 301 through the soft keyboard, which is not shown in Figure 3A.

[0143] The prompt information 304 can be used to prompt that the microphone is in an open state, for example, the prompt information 304 can be displayed as the words "I am listening" or other words, which are not limited in the embodiments of the present application.

[0144] It can be understood that the display state of the conversation window can include a retracted state and an expanded state, the retracted state can be as shown in the conversation window 301, and the expanded state can be as shown in the conversation window 305. The conversation window can be switched between the retracted state and the expanded state, and the switching process can be referred to the description of the button 306.

[0145] It can be understood that the embodiments of the present application do not limit the content displayed in other areas of FIG. 3A. For example, the other areas of FIG. 3A can be areas in FIG. 3A other than the bottom position, and the other areas of FIG. 3A can display: a desktop interface, any interface in an application program, or a lock screen interface, etc.

[0146] When displaying the interface shown in FIG. 3A, the voice assistant is in a listening state. At this time, the microphone of the electronic device can be in an open state.

[0147] In response to the user inputting message 1 in FIG. 3A by voice, the electronic device can display the interface shown in FIG. 3B and the interface shown in FIG. 3C in sequence.

[0148] As shown in FIG. 3B, the interface can display a conversation window 305.

[0149] Optionally, after the electronic device receives the operation of the user inputting message 101 in the conversation window 305, the electronic device can also display message 109 and / or message 110 in the conversation window 305, which is not shown in FIG. 3B. The contents contained in message 101, message 109 and message 110 can refer to the description of FIG. 1B, which will not be repeated here.

[0150] When displaying the interface shown in FIG. 3B, the voice assistant is in a thinking state. At this time, the microphone can be in a closed state.

[0151] The top position of the conversation window 305 can display: a button 306, a button 307, a button 308, and an identifier 309, and the button 307 can be in a selected state.

[0152] The button 307 can be used to enter the first window of the voice assistant, that is, the conversation window 305. The button 307 can display "YOYO Assistant" or can also display the name of the voice assistant, etc.

[0153] The button 308 can be used to select an intelligent agent. For example, in response to the user's click operation on the button 308 in FIG. 3B, the electronic device can display the interface shown in FIG. 5A, which can include a plurality of intelligent agents.

[0154] The identifier 309 can be an identifier previously set by the user, and the user's avatar can be displayed in the identifier 309.

[0155] The middle position of the conversation window 305 can display: a conversation message, such as message 1.

[0156] The bottom position of the conversation window 305 can display: a text box 310 and a button 312, and the button 311 can be displayed in the text box 310.

[0157] The text box 310 can be used to collect and edit text information input by the user. The text box 310 can display the text "please speak up". For example, in response to a click operation of the user on the text box 310 in FIG. 3B, the electronic device can display a soft keyboard and a text box with a send button. In response to an operation of the user inputting text information into the text box through the soft keyboard and clicking the send button, the electronic device can send the text information in the text box to the conversation window 305.

[0158] The button 312 can be used to turn on the microphone, and the button 312 can be displayed in the form of a microphone. For example, in response to a click operation (or a long press operation) of the user on the button 312 in FIG. 3B, the voice assistant can switch from the thinking state to the listening state. At this time, the electronic device starts the microphone to receive sound, converts the voice signal input by the user into text information 1, and then sends the text information 1 to the conversation window 305. Optionally, when the user completes voice input in FIG. 3B, the voice assistant can switch from the listening state to the thinking state, and then display the interface as shown in FIG. 3C.

[0159] As shown in FIG. 3C, the conversation window 305 of the interface can display message 1 and a reply message related to message 1. The reply message related to message 1 can include message 324 and message 325.

[0160] In the process of displaying FIG. 3C, the electronic device can first be in the thinking state, and then display the reply message related to message 1 in sequence after the thinking is completed. When the electronic device has displayed the reply message related to message 1 in FIG. 3C, the voice assistant can switch from the thinking state to the silent state.

[0161] For example, in the thinking state, the voice assistant can determine, through analysis of message 1, to which intelligent agent message 1 is distributed, such as the intelligent travel assistant. At this time, the electronic device can display the service identifier 321 of the intelligent travel assistant, the service name 322 of the intelligent travel assistant, and the prompt information 323 in FIG. 3C. Then, after the intelligent travel assistant provides a corresponding reply message based on message 1, the electronic device can display message 324, message 325, and the like in FIG. 3C in sequence.

[0162] The voice assistant can switch from the thinking state to the silent state after providing the reply message, or within a period of time after providing the reply message, without detecting any message or the like, to save device power consumption. At this time, the microphone is in the off state. For example, when the electronic device replies to message 324 and message 325 in FIG. 3C, or the electronic device does not receive any message within 10 seconds after displaying FIG. 3C, the voice assistant can switch from the thinking state to the silent state.

[0163] The message 324 can indicate that the electronic device has searched for a flight to A city, and the message 325 can indicate specific information of the flight. For example, the message 325 can display flight information from B city T1 airport to A city T2 airport at 07:30-09:00, and flight information from B city T2 airport to A city T2 airport at 10:00-12:00, and the like. The message 325 can be in the form of a window or a card, or the like.

[0164] The message 324 and the message 325 can be messages provided by a smart travel assistant in the voice assistant, and the upper side of the message 324 can also display content related to the smart travel assistant. For example, one or more of the following can be displayed: a service identifier 321 of the smart travel assistant, a service name 322 of the smart travel assistant, and a prompt information 323.

[0165] The service name 322 of the smart travel assistant can be displayed as the word "smart travel assistant".

[0166] The prompt information 323 can be used to prompt that the electronic device is providing related services for the user, for example, the prompt information 323 can be displayed as the word "serving you" or the like. Optionally, the content displayed in the prompt information 323 can also change according to the service provided by the smart body, which is not limited in the embodiments of the present application.

[0167] Based on the description of FIGS. 3A-3C, the electronic device can determine whether the demand message of the user needs to be distributed to a certain smart body in the voice assistant when detecting the demand message. When the electronic device determines that the demand message needs to be distributed to a certain smart body, the demand message can be distributed to the smart body, and then the smart body can provide a reply message corresponding to the demand message. Alternatively, when the electronic device determines that the demand message does not need to be distributed to the smart body, the voice assistant can provide a reply message corresponding to the demand message in combination with user personal habit data or the like, or the voice assistant can provide a reply message corresponding to the demand message through objective third-party data.

[0168] For example, when the demand message of the user is a query weather message, the electronic device can determine that the demand message does not need to be distributed to the smart body, and at this time the voice assistant can query the current weather through objective weather data.

[0169] For example, when the demand message of the user is a message for reminding the schedule on a business trip day, the electronic device can determine that the demand message does not need to be distributed to the smart body, and at this time the voice assistant can provide a reply message through user personal habit data, for example, the voice assistant can query the business trip day in the schedule service, and then set a schedule reminder on the business trip day.

[0170] For example, when the demand message of the user is a flight subscription message, the electronic device can determine that the demand message needs to be distributed to an intelligent agent (e.g., a smart travel assistant), and then the electronic device distributes the demand message to the smart travel assistant, and the smart travel assistant can provide a reply message related to the flight subscription message.

[0171] Based on this, the electronic device can implement active distribution of services in the first window (i.e., the conversation window 305) according to the demand message of the user, thereby simplifying the operation of the user and improving the user experience.

[0172] Method B: The electronic device distributes services in the first window by referencing services (Figs. 4A-4E)

[0173] In response to the user's long-press operation on the physical button, the electronic device can display the interface as shown in Fig. 3A.

[0174] In response to the user's voice input of the message 1 "Help me book a ticket from B city to A city" in Fig. 3A, the electronic device can display the interface as shown in Fig. 3B and the interface as shown in Fig. 4A in sequence.

[0175] As shown in Fig. 4A, the conversation window 305 of the interface can display the message 1, the message 401, and the text box 400, etc.

[0176] The message 401 can be a reply message related to the message 1. The message 401 can be used to prompt the electronic device that it cannot provide the related service according to the message 401. For example, the message 401 can display the words "Currently unable to provide the ability to subscribe to tickets for you".

[0177] Optionally, the message 401 can also display other content. For example, the message 401 can prompt the user that the ability proposed in the message 1 can be realized by opening an intelligent agent (e.g., a smart travel assistant). In this way, the user can solve the problem that the service cannot be provided at present by opening the intelligent agent.

[0178] Optionally, the message 401 can directly push an intelligent agent (e.g., a smart travel assistant) related to the message 1. For example, the message 401 can display a button 1 (not shown in Fig. 4A) for opening the intelligent agent. In this way, the user can directly jump to the conversation window corresponding to the intelligent agent by a click operation on the button 1.

[0179] It can be understood that the content displayed in the message 401 is not limited in the embodiments of the present application.

[0180] In response to the user's operation of inputting a reference symbol 402 (e.g., "@") in the text box 400 of Fig. 4A, the electronic device displays the interface as shown in Fig. 4B.

[0181] The window 403 can be included in FIG. 4B, and the window 403 is overlaid on the dialogue window 305.

[0182] The window 403 can display at least one button corresponding to an intelligent agent, such as a button 404 corresponding to a smart travel assistant, a button corresponding to a smart video assistant, and a button corresponding to a life service assistant.

[0183] The button 404 can display a service identifier of the smart travel assistant, a service name of the smart travel assistant, and a service introduction of the smart travel assistant, and the like. For example, the service introduction of the smart travel assistant can include content such as providing ticket checking services and travel services for you.

[0184] The button corresponding to the smart video assistant can display a service identifier of the smart video assistant, a service name of the smart video assistant, and a service introduction of the smart video assistant, and the like. For example, the service introduction of the smart video assistant can include content such as automatically generating a video within a period of time for you.

[0185] The button corresponding to the life service assistant can display a service identifier of the life service assistant, a service name of the life service assistant, and a service introduction of the life service assistant, and the like. For example, the service introduction of the life service assistant can include content such as a one-stop life concierge.

[0186] In response to a click operation of the user on the button 404 in FIG. 4B, the electronic device displays an interface as shown in FIG. 4C.

[0187] As shown in FIG. 4C, the interface can display a window 405 overlaid on the dialogue window 305. At this time, the window 403 is no longer displayed in FIG. 4C.

[0188] The window 405 can include content such as a prompt information 407, a text box 406, a button 408, and a soft keyboard.

[0189] The prompt information 407 is used to prompt the electronic device to provide services through the smart travel assistant, such as the prompt information 407 can be displayed as the words "Send to Smart Travel Assistant".

[0190] The button 408 is used to send the content in the text box 406 to the dialogue window 506, and the button 408 can also be referred to as a send button 408.

[0191] In response to the user inputting a message 1 in the text box 406 of FIG. 4C and the click operation of the user on the button 408, the electronic device can display an interface as shown in FIG. 4D and an interface as shown in FIG. 4E in sequence. The specific content of the message 1 can refer to the description of FIG. 3B, which will not be described here.

[0192] It can be understood that, since the electronic device implements service distribution in the agent by referring to any agent, the electronic device needs to re-input the demand message in the text box 406 so that the agent can reply.

[0193] The message 2 can be displayed in the conversation window 305 of FIG. 4D.

[0194] It can be understood that the message 2 can include the message 1, or the message 2 can also include the content related to the message 1. The message 2 can be the same or similar to the demand message in the message 1, so that in the case that the voice assistant cannot reply to the message 1, the reply message corresponding to the message 2 can be provided by the smart travel assistant.

[0195] Optionally, the message 2 can also include the service name of the smart travel assistant or the service identifier of the smart travel assistant and the like. In this way, the user can determine the reference of the agent through the message 2.

[0196] It can be understood that, after the voice assistant detects the message 2, the message 2 can be distributed to the smart travel assistant according to the smart travel assistant referred to in the message 2, at this time the electronic device can display the service identifier of the smart travel assistant, the service name of the smart travel assistant and the prompt information in FIG. 4E. Further, after the smart travel assistant provides the corresponding reply message based on the message 2, the electronic device can display the message 324 and the message 325 in FIG. 4E in turn.

[0197] The message 2 and the reply message related to the message 2 can be displayed in the conversation window 305 of FIG. 4E. The reply message related to the message 2 can include the message 324 and the message 325, and the specific content contained in the message 324 and the message 325 can refer to the description of FIG. 3C, which will not be repeated here.

[0198] Referring to the description of FIGS. 4A-4E, the message 401 can be understood as the reply message provided by the voice assistant based on the message 1, and the message 324 and the message 325 can be understood as the reply message provided by the agent (such as the smart travel assistant) in the voice assistant based on the message 2. In the case that the message 1 is included in the message 2, the message 324 (or the message 325) is different from the message 401.

[0199] In this way, in the case that the voice assistant cannot provide the reply message, the voice assistant can distribute the demand message to the agent by referring to the agent, so that the agent can feed back more accurate reply message based on the demand message of the user, to improve the flexibility of the conversation.

[0200] Method C: the electronic device distributes services in the second window (FIGS. 5A-5F)

[0201] In response to the user's long-press operation on the physical button, the electronic device can display the interface as shown in FIG. 3A.

[0202] In response to the user's voice input of "Help me book a ticket from B city to A city" in FIG. 3A, the electronic device can display the interface as shown in FIG. 3B.

[0203] After the electronic device displays as shown in FIG. 3B, the electronic device can continue to display the interface as shown in FIG. 3C, or can also continue to display the interface as shown in FIG. 4A. In the description of mode C, only the electronic device can display as shown in FIG. 3B is required, and the content of the interface displayed after FIG. 3B is not limited in the embodiments of the present application.

[0204] In response to the user's click operation on the button 308 in FIG. 3B, the electronic device displays the interface as shown in FIG. 5A.

[0205] In FIG. 5A, a window 501 can be displayed, and the window 501 can display an option bar 502. The option bar can include one or more of the following: a recent option button 503, a recommended option button, a travel option button, a sports option button, and the like.

[0206] The recent option button 503 can be used to view the smart agents used by the user in a period of time or the smart agents set by default by the electronic device. The recommended option button can be used to display the smart agents recommended by the electronic device. The travel option button can be used to view the smart agents related to the travel scenario. The sports option button can be used to view the smart agents related to the sports health scenario.

[0207] In the case where the recent option button 503 is in the selected state, the window 501 can further display the buttons of at least one smart agent included in the recent option, such as one or more of the following: a button 504 corresponding to the smart travel assistant, a button corresponding to the smart photo assistant, or a button 505 corresponding to the life service assistant.

[0208] It can be understood that the smart agents displayed in the window 501 of FIG. 5A are only illustrative and do not constitute a limitation on the embodiments of the present application.

[0209] Optionally, any smart agent in FIG. 5A can support the ability to be pinned or deleted. For example, FIG. 5A can include a smart agent 1, in response to the user's long-press operation on the button corresponding to the smart agent 1, the smart agent 1 can display a button for pinning the smart agent 1 and a button for deleting the smart agent 1, and the like, so that the user can control the pinning or deletion of the smart agent 1 through the buttons, which are not shown in FIG. 5A.

[0210] The window 501 of FIG. 5A can further display the content of the button 306, the button 307, and the button 308.

[0211] The button 308 can be in a selected state. The meanings of the button 306, the button 307, and the button 308 are not repeated here. For example, in response to the user performing an operation on the button 307 in FIG. 5A, the electronic device can display the interface shown in FIG. 3B.

[0212] It can be understood that, in response to the user performing a click operation on the button 504 in FIG. 5A, the electronic device can display different messages in the conversation window 506 according to the use of the intelligent travel assistant by the user. See the descriptions in FIG. 5B, FIG. 5E, and FIG. 5F.

[0213] In an implementation, in response to the user performing a click operation on the button 504 in FIG. 5A, in a case where the electronic device detects that the user enters the intelligent travel assistant for the first time, the electronic device can introduce the service in the conversation window 506. See the description in FIG. 5B.

[0214] It can be understood that the electronic device can record the number of times of entering any intelligent agent. For example, after responding to the user performing a click operation on the button 504 in FIG. 5A, the electronic device can determine that the number of times of entering the intelligent agent is 1. When the electronic device detects that the number of times of entering the intelligent agent is 1, the electronic device can determine that the user enters the intelligent agent for the first time. Or, when the number of times of entering the intelligent agent is greater than 1, the electronic device can determine that the user has entered the intelligent agent.

[0215] The conversation window 506 can be included in FIG. 5B. The conversation window 506 can be a conversation window corresponding to the intelligent travel assistant, and the conversation window 506 can also be referred to as the second window 506.

[0216] The conversation window 506 can display the service name of the intelligent travel assistant, the service identifier 500 of the intelligent travel assistant, the slogan 507 of the intelligent travel assistant (such as “experience intelligent travel”), the button 509, and the message 508.

[0217] The button 509 can be used to exit the conversation window 506. For example, in response to the user performing an operation on the button 509 in FIG. 5B, the electronic device can display the interface as shown in FIG. 5A.

[0218] The message 508 can be a message displayed by default when the user opens the intelligent travel assistant for the first time. For example, the message 508 can display the service introduction of the intelligent travel assistant and the like.

[0219] Optionally, the lower side of the message 508 can also display a prompt message 1, which can be a message related to travel. The prompt message 1 is not shown in FIG. 5B.

[0220] For example, the prompt message 1 can include: a message 3 prompting the user to query how to upgrade the cabin at a low price, or a message 4 prompting the user to query how to quickly register, etc. In response to the click operation of the user on the message 3, the electronic device can display a reply message related to the message 3 in the dialogue window 506. In this way, the user quickly masters how to dialogue with the intelligent agent and the content that can be inquired from the intelligent agent through the prompt message 1, so as to improve the user experience.

[0221] The bottom position of the dialogue window 506 of FIG. 5B can display a text box 510, and the button 512, and the button 511 can be displayed in the text box 510. The meanings of the text box 510, the button 512 and the button 511 can be referred to the description in FIG. 3B, which will not be repeated here.

[0222] In response to the operation of the user inputting the message 1 based on the text box 510 in FIG. 5B, the electronic device can display the interface shown in FIG. 5C and the interface shown in FIG. 5D in turn.

[0223] The dialogue window 506 of FIG. 5C can display the message 1.

[0224] The dialogue window 506 of FIG. 5D can display the message 1 and the reply message provided by the intelligent travel assistant based on the message 1, such as the message 530 and the message 531. The message 530 can be the same as the message 324, and the message 531 can be the same as the message 325, which will not be repeated here.

[0225] Based on this, since the voice assistant can include intelligent agents in different use scenarios, the user can select a suitable intelligent agent according to the demand, and input a demand message in the second window corresponding to the intelligent agent, so that the intelligent agent can provide more accurate reply messages, and improve the trial experience of the user.

[0226] In another implementation, in response to the click operation of the user on the button 504 in FIG. 5A, the electronic device can actively push the content related to the intelligent travel assistant in the dialogue window 506 in the case where it is detected that the user has entered the intelligent travel assistant (see the description in FIG. 5E).

[0227] The dialogue window 506 of FIG. 5E can display the message 520 and the message 521. The message 520 can indicate that it is detected that there is a travel event next Wednesday, and the message 521 can indicate the travel information.

[0228] The message 520 and the message 521 can be messages generated by the electronic device based on the pre-stored travel events in the device, and the specific content displayed in the message 520 and the message 521 is not limited in the embodiments of the present application.

[0229] The travel event can be an event generated based on a travel order in a three-party application, and / or a short message received by the user, etc. For example, the travel event can include one or more of the following messages: a travel date, a travel mode, and a message related to the travel mode (such as flight information, including: departure and arrival times, flight name, check-in counter, etc.).

[0230] Optionally, the lower side of the message 521 can also display a prompt message 2. The prompt message 2 can be a message provided by the intelligent travel assistant, which is not shown in FIG. 5E.

[0231] For example, the prompt message 2 is related to the message 520 and the message 521. For example, the prompt message 2 can include: a message 3 for prompting the user to query how to upgrade at a low price, or a message 4 for prompting the user to query how to quickly register, or a message 5 for prompting the user to set a flight reminder, etc. In response to a click operation of the user on the message 3, the electronic device can display a reply message related to the message 3 in the window 506. In this way, the user can ask the content related to the message 520 or the message 521 through the prompt message 2, so as to better implement the travel plan and improve the user experience.

[0232] Based on this, the electronic device can generate a conversation message based on the travel event stored in the device, and display the conversation message in the conversation window 506, so that the user can directly initiate the demand related to the travel event by entering the conversation window 506, thereby simplifying the use process of the user.

[0233] It can be understood that in the case where the electronic device displays as shown in FIG. 5E, in response to the user inputting the message 1 in FIG. 5E, the electronic device can display the message 1 and the reply message (such as the message 530 and the message 531) related to the message 1 in the conversation window 506 in turn. The specific process is similar to the description of FIGS. 5C-5D, and will not be described here.

[0234] In another implementation, in response to a click operation of the user on the button 504 in FIG. 5A, the electronic device can display historical messages in the conversation window (see the interface shown in FIG. 5F) when it is detected that the user has entered the intelligent travel assistant.

[0235] The conversation window 506 in FIG. 5F can display historical messages such as the message 522 and the message 523.

[0236] Optionally, the time when the historical messages 522 and 523 are generated can also be displayed around the historical messages.

[0237] Optionally, only prompt message 3 can be displayed in the dialog window 506 of FIG. 5F, and message 522 and message 523 are not displayed, which is not shown in FIG. 5F. Prompt message 3 can be used to prompt the user to view the historical messages through the drop-down window. For example, in response to the user's operation of dropping the dialog window 506 in FIG. 5F, the electronic device can display the content of message 522 and message 523 in the dialog window 506. In this way, the way of displaying only prompt message 3 in the dialog window 506 can reserve a larger use space in the dialog window 506, so as to input the latest message by the user.

[0238] Based on this, the user can view the historical messages in the dialog window 506 at any time according to the use demand, so as to improve the use experience of the user.

[0239] It can be understood that in the case that the electronic device displays as shown in FIG. 5F, in response to the user's operation of inputting message 1 in FIG. 5F, the electronic device can display message 1 and the reply messages (such as message 530 and message 531) related to message 1 in the dialog window 506 in turn. The specific process is similar to the description of FIGS. 5C-5D, and will not be described here.

[0240] Based on the description of FIGS. 5A-5F, when the electronic device detects that the user enters any intelligent agent and inputs a demand message, the electronic device can directly distribute the demand message to the intelligent agent, and then the intelligent agent can provide a reply message in combination with the user's personal habit data, or the intelligent agent can also provide a reply message through objective third-party data.

[0241] For example, when the user enters the intelligent travel assistant and inputs a flight subscription message, the electronic device can provide a reply message related to the flight subscription message in the intelligent travel assistant.

[0242] For example, when the user enters the intelligent travel assistant and inputs a query about the route from the airport back home on the business trip day, the electronic device can determine the business trip day and the airport information by querying the user's personal habit data, and then query the route from the airport back home in the intelligent travel assistant.

[0243] Based on this, the electronic device can select any intelligent agent according to the use demand, and distribute the message to the second window corresponding to the intelligent agent, so that the intelligent agent can specifically reply to the message, and improve the accuracy and efficiency of the message reply.

[0244] 2. Synchronization of messages in the first window and the second window

[0245] In the embodiments of this application, in the case that the user opens the first window and then opens the second window, the electronic device can actively copy the message in the first window to the second window (see the description of mode 1 below), or the electronic device can also copy the message in the first window to the second window based on the target operation of the user (see the description of mode 2 below).

[0246] Mode 1: The electronic device actively copies the message in the first window to the second window (Figures 6A-6B)

[0247] In response to the click operation of the user on the button 308 in Figure 3B, the electronic device can display the interface as shown in Figure 5A. In response to the click operation of the user on the button 504 in Figure 5A, the electronic device can display the interface as shown in Figure 6A.

[0248] In the case that the message 1 is included in the conversation window 305 in Figure 3B, the message 1 can be displayed by default in the conversation window 506 in Figure 6A.

[0249] Optionally, in the case that multiple messages are included in the conversation window 305 in Figure 3B, the electronic device can also display the multiple messages in the conversation window 506 in Figure 6B.

[0250] For example, the electronic device displays the interface as shown in Figure 3C, and the message 1, the message 324 and the message 325 can be included in the conversation window 305 in Figure 3C. In response to the click operation of the user on the button 308 in Figure 3C, the electronic device can display the interface as shown in Figure 5A. In response to the click operation of the user on the button 504 in Figure 5A, the electronic device can display the interface as shown in Figure 6B.

[0251] In the case that the message 1, the message 324 and the message 325 are included in the conversation window 305 in Figure 3C, the message 1, the message 324 and the message 325 can also be displayed in the conversation window 506 in Figure 6B.

[0252] It can be understood that Figures 6A-6B can be a schematic for the electronic device to copy all the messages in the first window to the second window. In this way, the omission of messages can be reduced, and the process of re-inputting the required messages in the second window by the user can be saved.

[0253] Optionally, in the case that the user opens the first window and then opens the second window, the electronic device can also copy part of the content in the first window to the second window.

[0254] In an implementation, the electronic device can copy the messages in the first window within the first time length to the second window. For example, in response to a click operation of the user on the button 504 in FIG. 5A, the electronic device can obtain a click time corresponding to the click operation, and obtain the messages in the first window within the first time length before the click time, and then copy the messages within the first time length to the second window. In this way, the user can not need to re-input the required messages in the second window, and the operation steps are saved.

[0255] In another implementation, the electronic device can also filter the messages in the first window, filter out the messages related to the sub-service, and then copy the messages related to the sub-service to the second window. For example, in response to a click operation of the user on the button 504 in FIG. 5A, the electronic device can filter all the messages in the first window, filter out the messages related to the intelligent travel assistant (such as filtering out the messages related to travel), and then copy the messages related to the intelligent travel assistant to the second window. In this way, not only can the user not need to re-input the required messages in the second window, and the operation steps are saved, but also irrelevant messages can be filtered out through message filtering, so that the second window can provide more accurate reply messages.

[0256] In another implementation, the electronic device can also filter the messages in the first window within the first time length, filter out the messages related to the sub-service within the first time length, and then copy the messages related to the sub-service within the first time length to the second window. The specific implementation process is not repeated here.

[0257] It can be understood that the embodiments of the present application do not make specific limitations on the process of copying the messages from the first window to the second window.

[0258] Method 2: The electronic device can also copy the messages in the first window to the second window based on the target operation of the user (FIGS. 6C-6F)

[0259] The target operation can include an operation of the user selecting at least one message in the first window and forwarding the message to the second window.

[0260] In response to a long press operation of the user on the message 1 in FIG. 3B, the electronic device displays an interface as shown in FIG. 6C. The conversation window 305 in FIG. 6C can display an option bar 600 arranged around the message 1.

[0261] The option bar 600 can include a copy button, a delete button, a forward button 601, and a multi-selection button.

[0262] In a case where the message 1 is in a selected state, the copy button is used to copy the message 1, the delete button is used to delete the message 1 in the conversation window 305, the forward button 601 is used to forward the message 1 to a conversation window corresponding to any intelligent agent, and the multi-selection button is used to select multiple messages in the conversation window 305.

[0263] In response to a click operation of the user on the forward button 601 in FIG. 6C, the electronic device displays an interface as shown in FIG. 6D.

[0264] The window 602 can be included in FIG. 6D, and the window 602 is overlaid on the conversation window 305.

[0265] Buttons of at least one intelligent agent can be displayed in the window 602, such as a button 603 corresponding to the intelligent travel assistant, a button corresponding to the intelligent photo assistant, and a button corresponding to the life service assistant.

[0266] In response to a click operation of the user on the button 603, the electronic device displays an interface as shown in FIG. 6F. The conversation window 506 in FIG. 6F includes the message 1.

[0267] Optionally, in response to a click operation of the user on the button 603, the electronic device can display an interface as shown in FIG. 6E. The window 604 can be included in FIG. 6E, and the window 604 can be overlaid on the window 305.

[0268] The window 604 can include a prompt information 605, a button 606, and a button 607.

[0269] The prompt information 605 can be used to prompt whether to jump to a conversation window corresponding to an intelligent agent. For example, the prompt information 605 can be displayed as: “Whether to jump to a conversation window corresponding to the intelligent travel assistant”.

[0270] The button 606 can be used to jump to a conversation window corresponding to an intelligent agent, and the button 606 can be displayed as “Yes”. For example, in response to a click operation of the user on the button 606 in FIG. 6E, the electronic device can display an interface as shown in FIG. 6F.

[0271] The button 607 can be used to cancel the jump to the dialog window corresponding to the intelligent agent, and the button 607 can display the word "No". For example, in response to a click operation of the user on the button 607, the electronic device can display the interface shown in FIG. 3B. In the case where the message 1 has been forwarded to the smart travel assistant, in response to a click operation of the user on the button 308 in FIG. 3B, the electronic device displays the interface as shown in FIG. 5A. In response to a click operation of the user on the button 504 in FIG. 5A, the electronic device can again display the interface as shown in FIG. 6F. In this way, the content of the message 1 can be retained in FIG. 6F, so that the user switches back and forth between the first window and the second window without affecting the content display in the second window.

[0272] Optionally, the user can also forward multiple messages to the intelligent agent through the multiple selection button in FIG. 6C. For example, in response to a click operation of the user on the multiple selection button in FIG. 6C, the electronic device can display a selected button around each message in the dialog window 305 in FIG. 6C, and display a forwarding button in FIG. 6C. In the case where the user selects multiple messages through the selected button, in response to a click operation of the user on the forwarding button, the electronic device can display the window 602. Further, in response to a click operation of the user on the button 603 in the window 602, the electronic device can display the multiple messages selected by the user in FIG. 6F.

[0273] Optionally, in the case where the messages in the first window and the second window cannot be synchronized, the user can also re-input the demand message in the second window, see the description of FIGS. 5B-5C. In this way, the content in the first window can not be directly transferred to the second window, so as to reduce the interference of the messages in the first window to the sub-service.

[0274] 3. Usage mode of intelligent agent (FIGS. 7A-7C)

[0275] In the embodiments of the present application, in response to the operation of the user opening any intelligent agent, the electronic device can guide the intelligent agent to service, so as to guide the user to carry out the conversation through the information filling, or to carry out the conversation through the direct sending of messages, etc.

[0276] In response to a click operation of the user on the service identifier 500 of the smart travel assistant in FIG. 5B (or the service identifier of the smart travel assistant in FIG. 5A), the electronic device displays the interface as shown in FIG. 7A. FIG. 7A can be referred to as the home page of the smart travel assistant.

[0277] The window 700 of FIG. 7A can display one or more of the following: a return button 701, a service logo 702 of the intelligent travel assistant, a service name 703 of the intelligent travel assistant, a slogan (e.g., experience intelligent travel) 704 of the intelligent travel assistant, service detail information 705 of the intelligent travel assistant, a message prompt button, or a button 708.

[0278] The message prompt button can include the button 706 and the button 707, etc. Both the button 706 and the button 707 can be used to initiate a pre-set message in the intelligent travel assistant.

[0279] The button 706 can be used to initiate a fill-in edit type message to the intelligent travel assistant. The fill-in edit type message can contain content that needs to be filled in by the user.

[0280] The button 706 can display a reminder icon, which can indicate that the message 6 generated based on the button 706 is a message for initiating a reminder. For example, after the electronic device generates the message 6 based on the button 706 and sends the message 6 to the conversation window, the electronic device can create a schedule based on the message 6 to achieve the purpose of reminding the user.

[0281] The button 707 can be used to initiate a direct execution type message to the intelligent travel assistant. The direct execution type message can be directly sent to the conversation window, and the direct execution type message can not allow the user to modify the message.

[0282] The button 707 can display a search Q&A icon, which can indicate that the message 7 generated based on the button 707 is a question type message. For example, after the electronic device generates the message 7 based on the button 707 and sends the message 7 to the conversation window, the electronic device can display a reply message corresponding to the message 7.

[0283] The button 708 can be used to pull up the conversation window 506 corresponding to the intelligent travel assistant. For example, in response to a click operation of the user on the button 708, the electronic device can display an interface as shown in FIG. 5B (or 5E, or 5F).

[0284] In response to a click operation of the user on the button 706 in FIG. 7A, the electronic device can display an interface as shown in FIG. 7B.

[0285] The conversation window 506 of FIG. 7B can display a text box 710, a button 711, and a soft keyboard, etc.

[0286] The text box 710 can display the content pre-filled based on the button 706, such as time and content, the text box 712, and the text box 713. For example, the user can input the word "the day before the trip" by clicking the text box 712, and input the word "identity card" by clicking the text box 713, to complete the filling of the message, and then in response to the user's click operation on the button 711, the electronic device can send all the content in the text box 710 to the conversation window 506.

[0287] The button 711 can be used to send the content in the text box 710 to the conversation window 506.

[0288] In response to the user's click operation on the button 707 in FIG. 7A, the electronic device can display the interface as shown in FIG. 7C. The conversation window 506 in FIG. 7C can display a message 714, which is the same as the message content displayed in the button 707. After receiving the message 714, the smart travel assistant can generate a reply message corresponding to the message 714, which is not shown in FIG. 7C.

[0289] Based on this, the electronic device can display at least one message prompt button in the home page of the intelligent agent, so that the user can determine the content that can be asked to the intelligent agent through the message prompt button, simplify the operation process of the user, and improve the user's use experience.

[0290] 4. Abnormal scenarios in the second window (FIGS. 8A-8E)

[0291] In the embodiments of the present application, the voice assistant can include multiple intelligent agents, for example, intelligent agent A and intelligent agent B. The intelligent agent A can correspond to the second window A, and the intelligent agent B can correspond to the second window B. In the case that the intelligent agent A cannot provide a reply message based on the user's demand message, the electronic device can prompt the user to start a new topic in the second window A, so that the user can get a suitable reply message in the first window or the second window B.

[0292] In the description of FIGS. 8A-8E, the intelligent agent A is taken as a smart travel assistant, the intelligent agent B is taken as a life service assistant, the second window A is taken as the conversation window (such as the conversation window 506) corresponding to the intelligent agent A, and the second window B is taken as the conversation window (such as the conversation window 813) corresponding to the intelligent agent B. This example does not constitute a limitation on the embodiments of the present application.

[0293] In response to the user's input of the message 801 in the conversation window 506 corresponding to the smart travel assistant, the electronic device can display the interface as shown in FIG. 8A and the interface as shown in FIG. 8B in sequence.

[0294] The message 801 can be a restaurant reservation message, for example, the message 801 can display as "Reserve a private room for an 8-person dinner".

[0295] It can be understood that the message 801 can be a message irrelevant to the intelligent travel assistant, that is, the intelligent travel assistant cannot reply to the message 801. At this time, the electronic device can display the interface shown in FIG. 8B.

[0296] The window 802 can be included in FIG. 8B, and the window 802 is overlaid on the window 506.

[0297] The window 802 can include a prompt information 803, a button 804, and a button 805.

[0298] The prompt information 803 can be used to prompt whether to start a new topic. For example, the prompt information 803 can display as "Task in progress, do you want to start a new topic?".

[0299] The button 804 can be used to instruct to continue the task, for example, the button 804 can display as "Continue task".

[0300] The button 805 can be used to start a new topic, for example, the button 805 can display as "New topic".

[0301] For example, in response to a click operation of the button 805 in FIG. 8B by the user, the electronic device can push a service in the first window (see the interface shown in FIG. 8C), or the electronic device can also push a service in the second window B (see the interface shown in FIG. 8D).

[0302] The message 801, the message 806, and the message 807 and the message 808 are displayed in the conversation window 305 of FIG. 8C in sequence.

[0303] The upper side of the message 806 in FIG. 8C can also display a service identifier 809 of the life service assistant, a service name 810 of the life service assistant, and information for prompting that the related service is being provided for you.

[0304] It can be understood that the message 806, the message 807, and the message 808 can all be messages replied by the life service assistant based on the message 801. The message 806 can be used to instruct the electronic device to recommend multiple restaurants near the user, and the restaurant information can be displayed in the message 807 and the message 808. The forms of the message 807 and the message 808 can be cards.

[0305] Based on the description of FIG. 8B and FIG. 8C, in a case where the intelligent agent corresponding to the second window cannot provide the corresponding service, the electronic device can directly forward the message 801 to the first window, so that the first window can provide the service related to the message 801. It can be understood that the message 801 is forwarded to the first window because the first window can reply to the message in any scenario.

[0306] The conversation window 813 can be included in FIG. 8D, and the conversation window 813 can be a conversation window corresponding to the life service assistant.

[0307] The service identifier of the life service assistant, the service name of the life service assistant, and the slogan of the life service assistant (such as life entertainment and food little helper) and the like can be displayed in the conversation window 813.

[0308] The message 801, the message 806, the message 807, and the message 808 can also be displayed in the conversation window 813, and the meaning of any message can be referred to the description in FIG. 8C, which will not be described here.

[0309] Based on the description of FIG. 8B and FIG. 8D, in a case where the second window A cannot provide the corresponding service, the electronic device can push the intelligent agent B based on the content in the message 801, and directly forward the message 801 to the second window B, so that the intelligent agent B can provide the corresponding service.

[0310] It can be understood that the message 801 can be a message irrelevant to the intelligent agent A, and the message 801 can be a message related to the intelligent agent B. In a case where the electronic device detects that the intelligent agent A cannot provide the reply message corresponding to the message 801, the message 801 can be forwarded to the intelligent agent B, and the intelligent agent B can provide the reply message corresponding to the message 801, and at this time, the message 801 and the reply message corresponding to the message 801 can be displayed in the second window B.

[0311] Optionally, in response to the click operation of the user on the button 805 in FIG. 8B, the electronic device can display the interface as shown in FIG. 8E.

[0312] The message 812 can be displayed in the conversation window 506 of FIG. 8E, and the message 812 can be used to indicate that the intelligent travel assistant cannot provide the service. For example, the message 812 can be displayed as “Sorry, the intelligent travel assistant cannot provide the restaurant reservation capability for you temporarily.”.

[0313] In this way, in a case where the intelligent agent A cannot provide the reply message based on the demand message of the user, the electronic device can prompt the user in the second window A whether to start a new topic, so that the user can get a suitable reply message in the first window or the second window B, to improve the user experience.

[0314] 5. Display form of messages in the dialogue window (Figures 9A-9C)

[0315] The messages in the dialogue window can be displayed in one or more of the following forms, such as: a window, a window + button, a list, a card, and a multi-task selector, etc.

[0316] Figure 9A can be a schematic of a process of displaying a window + button in a dialogue window. For example, in the scenario of viewing the route of scenic spot A based on a voice assistant, the voice assistant can display: a message 902, a message 903, a button 906, and a button 907 in the dialogue window 901 of Figure 9A.

[0317] The message 902 can be a demand message input by the user, and the message 902 is used to query the route of scenic spot A.

[0318] The message 903, the button 906, and the button 907 can all be reply content provided based on the message 902. The message 903 is used to indicate the route of scenic spot A, for example, the message 903 can be in the form of a window, and the message 903 can display the scenic route of scenic spot A, as well as a button 904 and a button 905, the button 904 is used to query the scenic guide of scenic spot A, and the button 905 is used to query the food near scenic spot A.

[0319] The button 906 is used to generate a route book corresponding to scenic spot A, and the button 907 is used to view more functions related to the message 903.

[0320] In this way, when the electronic device supports displaying a window + button in the dialogue window, the user can view more message content in the window, and directly execute related services through the button, so as to improve the user experience of using the voice assistant.

[0321] Figure 9B can be a schematic of a process of displaying a list in a dialogue window. For example, in the scenario of recommending a movie based on a voice assistant, the voice assistant can display: a message 909 and a message 910 in the dialogue window 908 of Figure 9B.

[0322] The message 909 can be a demand message input by the user, and the message 909 is used to query movie recommendations.

[0323] The message 910 can be reply content provided based on the message 909. At least one movie information can be displayed in the form of a list in the message 910, such as the information of movie A, movie B, movie C, and movie D, etc., which can be displayed in turn from top to bottom in the message 910.

[0324] In this way, when the electronic device supports displaying a list in the dialogue window, the user can clearly view similar information in the list, so that the dialogue window is more concise and clear, so as to improve the user experience of using the voice assistant.

[0325] FIG. 9C can be a process diagram of displaying a multi-task selector in a dialogue window. For example, in the scenario of conducting a fitness plan based on a voice assistant, the voice assistant can display, in the dialogue window 911 of FIG. 9C, a message 912 and a message 913.

[0326] The message 912 can be a demand message input by the user, and the message 912 is used to query the fitness plan.

[0327] The message 913 can be reply content provided based on the message 912. The fitness plan can be displayed in the form of a multi-task selector in the message 913, such as one or more of the following: a plurality of text boxes for inputting personal information, a plurality of buttons for selecting gender, a plurality of buttons for selecting weight change conditions, and a plurality of buttons for selecting exercise plans, etc.

[0328] In this way, when the electronic device supports displaying a multi-task selector in a dialogue window, the user can input text and trigger buttons in the multi-task selection to input more accurate user demands to the voice assistant, so as to improve the user experience of using the voice assistant.

[0329] Optionally, the process of displaying a card in a dialogue window can refer to the description in FIG. 8D, and the process of displaying a window in a dialogue window can refer to the description in FIG. 3C.

[0330] It can be understood that the content displayed in the dialogue window of FIG. 9A, FIG. 9B and FIG. 9C is only an example and does not constitute a limitation on the embodiments of the present application.

[0331] In combination with the description in FIG. 3A-FIG. 9C, FIG. 10 is a flow diagram of an interface display method provided by the embodiments of the present application. As shown in FIG. 10, the interface display method can include the following steps:

[0332] S1001, after receiving an operation of starting a first voice assistant, the electronic device displays a first interface.

[0333] The first interface includes a first window.

[0334] The first voice assistant can be the voice assistant described in the embodiments of the present application, and the operation of starting the first voice assistant can be the operation of pressing a physical button of the electronic device for a long time.

[0335] The first interface can be the interface shown in FIG. 3B.

[0336] S1002, after receiving an operation of inputting a first message by the user to the first window, the electronic device displays the first message in the first window.

[0337] The first message can be the message 101, and the content contained in the message 101 can refer to the description in FIG. 1A.

[0338] S1003, when the first message belongs to a message in a first scenario, the electronic device displays a second message in the first window.

[0339] The second message is a reply message provided by a first voice assistant based on the first message.

[0340] The first scenario can be understood as a dialogue scenario in which the first voice assistant can reply. The second message can be the message 109 and / or the message 110, and the content contained in the message 109 and the message 110 can refer to the description in FIG. 1B.

[0341] S1004, after receiving an operation of inputting a third message by a user to the first window, the electronic device displays the third message in the first window.

[0342] The third message can be the message 1 described in FIG. 3B.

[0343] S1005, when the third message belongs to a message in a second scenario, the electronic device displays a fourth message in the first window.

[0344] The fourth message is a reply message provided by a second voice assistant based on the third message.

[0345] The second scenario can be a dialogue scenario in which the second voice assistant can reply. The second voice assistant can be a smart travel assistant, and at this time, the second scenario can be a travel scenario.

[0346] The fourth message can be the message 324 and / or the message 325, and the content contained in the message 324 and the message 325 can refer to the description in FIG. 3C.

[0347] Based on this, the electronic device can provide dialogue messages in different scenarios (such as the first scenario and the second scenario) in the first window, so as to improve the flexibility of the user in using the voice assistant.

[0348] It should be noted that the interface provided by the embodiments of the present application and the content that can be displayed in the interface are only used as an example and do not constitute a limitation on the embodiments of the present application.

[0349] It should be noted that the module names involved in the embodiments of the present application can be defined as other names, as long as the functions of the modules can be realized, and the names of the modules are not limited.

[0350] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the embodiments of the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of countries and regions, and provide corresponding operation portal for user to choose authorization or refusal.

[0351] The interface display method of the embodiments of the present application has been described above, and the device for executing the above method provided by the embodiments of the present application will be described below. Those skilled in the art can understand that the method and the device can be combined and referred to each other, and the related device provided by the embodiments of the present application can execute the steps in the list sorting method.

[0352] FIG. 11 is a schematic diagram of the hardware structure of another electronic device provided by the embodiments of the present application.

[0353] The electronic device includes a processor 1101, a communication line 1104 and at least one communication interface (for example, the communication interface 1103 is exemplarily illustrated in FIG. 11).

[0354] The processor 1101 can be a general-purpose CPU, a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs of the present application scheme.

[0355] The communication line 1104 can include a circuit for transmitting information between the above components.

[0356] The communication interface 1103 uses any transceiver-like device for communicating with other devices or communication networks, such as Ethernet, wireless local area networks (WLAN), etc.

[0357] Possibly, the electronic device can also include a memory 1102.

[0358] The memory 1102 can be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM), or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disk storage, a magnetic disk storage or other magnetic storage devices, or any other medium capable of storing desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited to this. The memory can exist independently and be connected to the processor through the communication line 1104. The memory can also be integrated with the processor.

[0359] The memory 1102 is configured to store computer-executable instructions for implementing the solutions of the present application, and the processor 1101 is configured to execute the computer-executable instructions stored in the memory 1102, so as to implement the method provided by the embodiments of the present application.

[0360] Possibly, the computer-executable instructions in the embodiments of the present application can also be referred to as application program codes, which are not specifically limited in the embodiments of the present application.

[0361] In a specific implementation, as an embodiment, the processor 1101 can include one or more CPUs, such as CPU0 and CPU1 in FIG. 11.

[0362] In a specific implementation, as an embodiment, the electronic device can include multiple processors, such as the processor 1101 and the processor 1105 in FIG. 11. Each of the processors can be a single-CPU processor or a multi-CPU processor. The processor herein can refer to one or more devices, circuits, and / or processing cores for processing data (for example, computer program instructions).

[0363] The interface display method provided by the embodiments of the present application can be applied to an electronic device with a communication function. The electronic device includes a terminal device, and the specific device form of the terminal device can refer to the above related description, which will not be described here.

[0364] The embodiment of the present application provides a terminal device, which comprises: a processor and a memory; the memory stores computer execution instructions; and the processor executes the computer execution instructions stored in the memory, so that the terminal device executes the method.

[0365] The embodiment of the present application provides a chip. The chip comprises a processor configured to invoke a computer program in a memory to execute the technical solutions in the above-described embodiments. The implementation principle and technical effects are similar to those of the above-described related embodiments, which will not be described herein again.

[0366] The embodiment of the present application further provides a computer readable storage medium. The computer readable storage medium stores a computer program. The computer program is executed by a processor to implement the above-described method. The method described in the above-described embodiments can be implemented by software, hardware, firmware or any combination thereof in whole or in part. If implemented in software, the functions can be stored in or transmitted as one or more instructions or codes on a computer readable medium. The computer readable medium can include a computer storage medium and a communication medium, and can further include any medium that can carry computer programs from one place to another. The storage medium can be any target medium that can be accessed by a computer.

[0367] In a possible implementation, the computer readable medium can include a RAM, a ROM, a compact disc read-only memory (CD-ROM) or other optical disk storage, a magnetic disk storage or other magnetic storage device, or any other medium that is targeted to carry or store desired program codes in the form of instructions or data structures and can be accessed by a computer. Moreover, any connection is appropriately referred to as a computer readable medium. For example, if software is transmitted from a website, a server or other remote source using a coaxial cable, an optical fiber cable, a twisted pair, a digital subscriber line (DSL) or wireless technology (such as infrared, radio and microwave), the coaxial cable, the optical fiber cable, the twisted pair, the DSL or the wireless technology (such as infrared, radio and microwave) is included in the definition of the medium. As used herein, a disk and a disc include a compact disc, a laser disc, an optical disc, a digital versatile disc (DVD), a floppy disk and a Blu-ray disc, wherein the disk usually magnetically reproduces data, and the disc optically reproduces data with a laser. The above combinations should also be included in the scope of the computer readable medium.

[0368] The embodiment of the present application provides a computer program product, which comprises a computer program. When the computer program is executed, the computer program causes a computer to execute the above-described method.

[0369] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and a combination of flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions can be provided to a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing devices to produce a machine, so that the instructions executed by the computer or other programmable data processing devices produce a device that implements the functions specified in one or more flows in the flowcharts and / or one or more blocks in the block diagrams.

[0370] The above detailed description of the application is further detailed, the purpose, technical solutions and beneficial effects of the present application are further detailed, it should be understood that the above is only the specific embodiment of the present application, and is not used to limit the protection scope of the present application, any modification, equivalent replacement, improvement, etc. made on the basis of the technical solutions of the present application should be included in the protection scope of the present application.

Claims

1. A method for displaying an interface, characterized in that, The methods include: Upon receiving the command to activate the first voice assistant, a first interface is displayed, which includes: a first window; After receiving an operation from the user to input a first message into the first window, the first message is displayed in the first window; When the first message belongs to the first scenario, the second message is displayed in the first window. The second message is the reply message provided by the first voice assistant based on the first message. After receiving an operation from the user to input a third message into the first window, the third message is displayed in the first window; When the third message belongs to the second scenario, the fourth message is displayed in the first window. The fourth message is a reply message provided by the second voice assistant based on the third message.

2. The method according to claim 1, characterized in that, The first window also includes a first button, and the method further includes: Upon receiving an operation on the first button, a second interface is displayed, which includes a second window for processing dialogue messages in the second scenario. Upon receiving an operation to input the third message into the second window, the third message and the fourth message are displayed in the second window.

3. The method according to claim 1, characterized in that, The first window also includes: a first button; after the fourth message is displayed in the first window, the method further includes: Upon receiving an operation on the first button, a second interface is displayed. The second interface includes a second window, which contains the third message and the fourth message. The second window is used to process dialogue messages in the second scenario.

4. The method according to claim 2, characterized in that, Before displaying the second interface, the method further includes: displaying a third interface, the third interface including: a second button, the second button being associated with the second voice assistant, and the second interface being the interface displayed after receiving an operation on the second button.

5. The method according to claim 4, characterized in that, The first window also includes a fifth message, and the method further includes: Upon receiving an operation to forward the fifth message in the first window, the second button is displayed; Upon receiving an action on the second button, the fifth message is displayed in the second window.

6. The method according to any one of claims 2-5, characterized in that, After displaying the second interface, the method further includes: Upon receiving an operation to input a sixth message into the second window, the sixth message is displayed in the second window; When the sixth message does not belong to the second scenario but belongs to the third scenario, a first prompt and a third button are displayed on the second interface. The first prompt indicates whether to jump to the third window, which is used to process the dialogue messages in the third scenario. The third scenario differs from the second scenario; Upon receiving an operation on the third button, a fourth interface is displayed. The fourth interface includes the third window, which contains the sixth message and a seventh message. The seventh message is a response message provided by the third voice assistant based on the sixth message.

7. The method according to any one of claims 2-6, characterized in that, The second window also includes: a prompt message indicating the first time the second voice assistant is accessed, or historical conversation messages under the second voice assistant.

8. The method according to any one of claims 1-7, characterized in that, The fourth message is also surrounded by the logo of the second voice assistant.

9. The method according to any one of claims 1-8, characterized in that, Before displaying the third message in the first window, the method further includes: upon receiving an operation to input a first identifier into the first window, displaying a fourth button, the fourth button being associated with the second voice assistant; Upon receiving an operation on the fourth button, the first text box is displayed in the first window; The operation of receiving the user to input a third message into the first window includes: receiving the operation of inputting the third message into the first text box and sending it.

10. The method according to any one of claims 1-9, characterized in that, The method further includes: Upon receiving an operation to input the eighth message into the first window, the eighth message is displayed in the first window. When the eighth message belongs to the fourth scenario, the ninth message is displayed in the first window. The ninth message is a reply message provided by the fourth voice assistant based on the eighth message. The logo of the fourth voice assistant is also displayed around the ninth message.

11. The method according to any one of claims 2-7, characterized in that, The second window also includes: an identifier for the third voice assistant, and the method further includes: Upon receiving an operation targeting the identifier of the third voice assistant in the second window, a fifth interface is displayed, which includes a fifth button for initiating a fill-type message in the second scenario. Upon receiving an operation on the fifth button, the input box of the second window displays: the tenth message, which includes a second text box for filling in other content.

12. The method according to any one of claims 1-11, characterized in that, The message displayed in the first window exists in one or more of the following forms: window, button, list, card, or multitasking selector.

13. An electronic device, characterized in that, The electronic device includes: one or more processors and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 12.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 12.

15. A computer program product, characterized in that, The computer program product includes computer program code that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1 to 12.

Images