Smart assistant interface display method and electronic device

Abstract

A smart assistant interface display method and an electronic device. In the method, on a displayed main dialog flow interface between a user and a main smart assistant, an electronic device can detect and respond to a third-party smart assistant trigger event, and update and display, on the main dialog flow interface, an introduced third-party dialog flow between the user and the third-party smart assistant. In this way, by means of the method, in a dialog box, not only is a dialog between a user and a main intelligent assistant realized, but a dialog between the user and a third-party intelligent assistant is also realized, such that services of smart scenarios such as an information search and operation execution can be provided to the user by means of the main intelligent assistant in combination with the third-party intelligent assistant, thereby improving the efficiency of smart scenarios, and realizing the cooperation between a plurality of smart assistants to more accurately answer questions and provide services to users.

Description

Intelligent assistant interface display method and electronic device

[0001] Cross-reference to Related Applications

[0002] This application claims priority to the Chinese Patent Application No. 202410807550.8, filed on June 20, 2024, and entitled "Intelligent Assistant Interface Display Method and Electronic Device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0003] Embodiments of the present application relate to the technical field of terminal, and in particular, to an intelligent assistant interface display method and an electronic device. BACKGROUND

[0004] The operating system of an electronic device generally provides an intelligent assistant, which can be awakened through voice wake-up, control triggering, and the like, and then can be used to query information or execute some service functions provided by the operating system through dialogue with the intelligent assistant.

[0005] With the gradual improvement and enrichment of the functions of the intelligent assistant, better user experience can be provided. For example, in some scenarios, the intelligent assistant of the electronic device can be divided into different roles, so as to enrich the interest of the dialogue; for example, the intelligent assistant includes role A, role B, and the like, and the dialogue of the user with different roles has independent dialogue boxes. For another example, in other scenarios, the intelligent assistant of the electronic device can also be split into sub-assistants with different capabilities; for example, the intelligent assistant includes sub-assistant 1, sub-assistant 2, and the like, and the dialogue of the user with different sub-assistants is also isolated and independent from each other. For another example, in yet other scenarios, the intelligent assistant can also call the interface of a third-party service and provide an answer to the user in combination with the understanding of the intelligent assistant itself.

[0006] However, how to further improve the function accuracy and intelligence of the intelligent assistant is worth continuous research. SUMMARY

[0007] Embodiments of the present application provide an intelligent assistant interface display method and an electronic device to improve the function accuracy and intelligence of the intelligent assistant.

[0008] In a first aspect, an embodiment of the present application provides a method for displaying an intelligent assistant interface. The method can be applied to an electronic device. In the method, a first interface is displayed, and the first interface includes a main dialogue flow between a user and a main intelligent assistant. In the first interface, a third-party intelligent assistant triggering event is detected, and the third-party intelligent assistant triggering event is used to indicate that a dialogue with a third-party intelligent assistant is triggered. In response to the third-party intelligent assistant triggering event, the first interface is updated, and the updated first interface includes the main dialogue flow and a third-party dialogue flow between the user and the third-party intelligent assistant.

[0009] In the method, in the process of the dialogue between the user and the main intelligent assistant, the third intelligent assistant can be triggered to participate in the dialogue through various triggering manners. Thus, the dialogue between the user and the intelligent assistant can include not only the dialogue between the user and the main intelligent assistant, but also the dialogue between the user and the third-party intelligent assistant, which can be understood as the dialogue between the user and a group of intelligent assistants. In this way, through multiple intelligent assistants, the function accuracy of the intelligent assistant can be improved, and more professional and detailed functions can be provided.

[0010] In a possible implementation, before the first interface is updated, the first interface includes a first control, and the first control is a triggering entrance for the dialogue with the third-party intelligent assistant. The detection of the third-party intelligent assistant triggering event includes the detection of a first operation instruction on the first control.

[0011] In the implementation, the triggering entrance for triggering the third-party intelligent assistant is provided on the dialogue interface between the user and the main intelligent assistant, for example, the triggering entrance can be displayed to the user in the form of a control. Thus, the third-party dialogue flow can be introduced into the main dialogue flow. Therefore, through the dialogue between multiple intelligent assistants and the user, the user can be answered more efficiently and accurately, and services can be provided more efficiently and accurately.

[0012] Based on the above implementation, the updated first interface further includes first prompt information, and the first prompt information is used to indicate that the user is in the dialogue with the third-party intelligent assistant. The first prompt information includes an exit control, and the exit control is used to exit the dialogue with the third-party intelligent assistant and resume the dialogue with the main intelligent assistant.

[0013] In the implementation, after the third-party dialogue flow is introduced into the main dialogue flow, the user can be prompted by the prompt information that the current dialogue is with the third-party intelligent assistant, and the user can conveniently resume the dialogue with the main intelligent assistant through the exit control.

[0014] In a possible implementation, before the first interface is updated, the first interface further comprises a second control, and the second control is a trigger entry for single processing by the third-party intelligent assistant. The detecting the third-party intelligent assistant trigger event comprises: detecting a second operation instruction on the second control.

[0015] In this implementation, in the dialogue interface between the user and the main intelligent assistant, not only can the trigger entry for the long dialogue between the user and the third-party intelligent assistant be provided, but also the trigger entry for the single-round dialogue between the user and the third-party intelligent assistant can be provided, which can be understood as that the third-party intelligent assistant is called to process a command once, and the subsequent command of the user is still processed by the main intelligent assistant. In this way, by providing different types of trigger entries related to the third-party intelligent assistant in the main dialogue interface, the user can call the third-party intelligent assistant in multiple different scenarios, multiple use scenarios are expanded, and the user experience is improved.

[0016] In a possible implementation, the third-party intelligent assistant is recommended based on a preset configuration rule. The preset configuration rule comprises one or more of the following rules: the highest usage frequency, the latest online time, and the shortest interval from the last usage time.

[0017] In this implementation, by recommending the third-party intelligent assistant to the user in the main dialogue interface based on the preset configuration rule, the user can be facilitated to select the third-party intelligent assistant for dialogue, so that more use scenarios of the intelligent assistant can be met, and the user experience is improved.

[0018] In another possible implementation, the detecting the third-party intelligent assistant trigger event comprises: determining, according to the dialogue content of the main dialogue flow and the capability of at least one candidate third-party intelligent assistant pre-stored, that the single processing by the third-party intelligent assistant is performed; wherein the capability of the candidate third-party intelligent assistant is used to indicate a dialogue that can be processed by the candidate third-party intelligent assistant, and the third-party intelligent assistant has the capability of processing the dialogue content of the main dialogue flow.

[0019] In this implementation, in the process of the dialogue between the user and the main intelligent assistant, when it is detected that the function provided by the third-party intelligent assistant is hit through the analysis of the main dialogue flow, the dialogue between the user and the third-party intelligent assistant can be triggered. In this way, the main intelligent assistant can actively call the third-party intelligent assistant for the user, so that more targeted services can be provided by the third-party intelligent assistant.

[0020] In a further possible implementation, the detecting the third-party intelligent assistant triggering event comprises: detecting that the user triggers single processing by the third-party intelligent assistant through a preset manner. The preset manner comprises but is not limited to: invoking the third-party intelligent assistant through a preset symbol in an input box or invoking the third-party intelligent assistant through a keyword in a voice instruction.

[0021] In this implementation, the main intelligent assistant can also respond to the user's invocation of the third-party intelligent assistant, so as to passively invoke the third-party intelligent assistant for the user. In this way, the user's demand for the use scene of multiple intelligent assistants can be met.

[0022] For example, the preset symbol is @.

[0023] In this implementation, the invocation of the third-party intelligent assistant is realized through a preset symbol, so that the user can experience the use effect of group chat with multiple intelligent assistants in one dialog box interface. In this way, the user can conveniently invoke different intelligent assistants to answer questions or provide services, etc.

[0024] In a possible implementation, the third-party conversation flow comprises: a user command based on the second control and an answer content of the third-party intelligent assistant to the user command; in the updated first interface, a first control associated with the answer content is included, and the first control is a triggering entrance for a conversation with the third-party intelligent assistant. The method further comprises: in response to a third operation instruction to the first control included in the updated first interface, updating single processing by the third-party intelligent assistant to a conversation with the third-party intelligent assistant.

[0025] In this implementation, in various scenes of single invocation of the third-party intelligent assistant, the electronic device can provide the user with a triggering entrance for switching to a multi-round conversation with the third-party intelligent assistant while displaying the answer from the third-party intelligent assistant, so that the user's demand for multiple use scenes of the third-party intelligent assistant can be met, and the use scene of the intelligent assistant on the electronic device is expanded.

[0026] In a possible implementation, the updated first interface further comprises a third control for displaying multiple third-party intelligent assistants. The method further comprises: in response to a fourth operation instruction to the third control, displaying a second interface; the second interface comprises multiple third-party intelligent assistants; in response to a selection operation on another third-party intelligent assistant included in the second interface, displaying a third interface; wherein the third interface comprises the main conversation flow, the third-party conversation flow, and another third-party conversation flow between the user and the another third-party intelligent assistant.

[0027] In this embodiment, the user can also be provided with a quick switching function for conducting a conversation between multiple different third-party intelligent assistants, so as to meet the use demand of the user for conducting a conversation with different third-party intelligent assistants. In this way, the user can be provided with a function of switching a conversation between the primary intelligent assistant and multiple third-party intelligent assistants based on one conversation box, so that the user obtains the use experience of "group chat" with multiple different intelligent assistants.

[0028] In a possible implementation, the third control is a pull-down control in first prompt information, and the first prompt information is used to indicate that the user is conducting a conversation with the third-party intelligent assistant. Alternatively, the third control is a navigation bar control.

[0029] In this embodiment, in a small-screen electronic device such as a mobile phone, the pull-down control can be used to not only switch different third-party intelligent assistants, but also reduce the shielding of the original conversation interface. In a large-screen electronic device such as a folding screen mobile phone, the navigation bar can be used to trigger the display of multiple switchable intelligent assistants and the original conversation interface in the form of a split column, so that the user can conveniently handle the continuity of the task.

[0030] In another possible implementation, the third interface further includes second prompt information, and the second prompt information is used to indicate that the user is conducting a conversation with the another third-party intelligent assistant, and is also used to indicate the task execution status of the third-party intelligent assistant.

[0031] In this embodiment, the dynamic display of the task execution status of the third-party intelligent assistant can help the user to obtain the execution of the task by the third-party intelligent assistant in a timely manner, so as to ensure the monitoring of the task of the third-party intelligent assistant.

[0032] In a possible implementation, the method further includes: in response to a fifth operation instruction on the task execution status of the third-party intelligent assistant, jumping to the conversation content associated with the task in the third-party conversation flow.

[0033] In this embodiment, based on the dynamic display of the task execution status of the third-party intelligent assistant, the corresponding conversation record can also be associated, so that the user can backtrack to the corresponding conversation record through the operation of the task execution status, and conveniently view the historical conversation record. In this way, the function of the intelligent assistant scene can be expanded.

[0034] In a possible implementation, the method further includes: when it is detected that there is a third-party intelligent assistant that executes a task in the background, displaying the task execution status of the third-party intelligent assistant that executes the task in the background through third prompt information in any intelligent assistant interface. In a possible implementation, the method further includes: when it is detected that there is a third-party intelligent assistant that executes a task in the background, displaying the task execution status of the third-party intelligent assistant that executes the task in the background through third prompt information in any intelligent assistant interface.

[0035] In this embodiment, by dynamically displaying the task execution status of the third-party intelligent assistant executing the task in the background in the display interface of any intelligent assistant, the user can conveniently monitor the execution status of multiple tasks in the scenario of issuing multiple tasks.

[0036] In a possible implementation, the main intelligent assistant is provided by an operating system of the electronic device, and the third-party intelligent assistant is provided by a third application provider.

[0037] In this embodiment, by the method provided in the application, the main intelligent assistant provided by the operating system can call one or more third-party intelligent assistants actively or in response to user operation, so that more functions and scenarios can be expanded when the user uses the intelligent assistant, and the efficiency in the process of using the intelligent assistant by the user can be improved and more accurate answers or more professional and more detailed services can be obtained.

[0038] In a second aspect, the application provides an electronic device, which includes multiple functional modules; the multiple functional modules interact with each other to implement the method executed by the electronic device in the first aspect and each implementation thereof. The multiple functional modules can be implemented based on software, hardware or a combination of software and hardware, and the multiple functional modules can be combined or divided in any manner based on specific implementation.

[0039] In a third aspect, the application provides an electronic device, which includes at least one processor and at least one memory, and the at least one memory stores computer program instructions. When the electronic device is running, the at least one processor executes the method executed by the electronic device in the first aspect and each implementation thereof.

[0040] In a fourth aspect, the application further provides a computer readable storage medium, which stores a computer program. When the computer program is executed by a computer, the computer executes the method executed by the electronic device in the first aspect and each possible implementation thereof.

[0041] In a fifth aspect, the application provides a computer program product, which includes a computer program (also referred to as code or instruction). When the computer program is executed, the computer executes the method of the electronic device in the first aspect and each possible implementation thereof.

[0042] In a sixth aspect, the embodiments of the present application further provide a graphical user interface on an electronic device, the electronic device having a display screen, one or more memories, and one or more processors configured to execute one or more computer programs stored in the one or more memories, the graphical user interface comprising the graphical user interface displayed by the electronic device when executing the method of the first aspect above and possible implementation manners thereof.

[0043] In a seventh aspect, the embodiments of the present application further provide a chip for reading a computer program stored in a memory, and executing the method of the first aspect above and possible implementation manners thereof.

[0044] In an eighth aspect, the embodiments of the present application further provide a chip system comprising a processor configured to support a computer device to implement the method of the first aspect above and possible implementation manners thereof. In a possible implementation manner, the chip system further comprises a memory configured to store programs and data necessary for the computer device. The chip system can be composed of a chip, or can include a chip and other discrete devices.

[0045] The advantages of the second aspect to the eighth aspect above and possible implementation manners thereof can refer to the advantages of the possible implementation manners of the first aspect above, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0046] FIG. 1 is a schematic diagram of an interface of a smart assistant;

[0047] FIG. 2 is a schematic diagram of a hardware structure of a possible electronic device according to an embodiment of the present application;

[0048] FIG. 3 is a software architecture block diagram of an electronic device according to an embodiment of the present application;

[0049] FIG. 4 is a schematic diagram of a display interface of a smart assistant according to an embodiment of the present application;

[0050] FIG. 5 is a schematic diagram of a display interface of a smart assistant according to an embodiment of the present application;

[0051] FIG. 6 is a schematic diagram of a display interface of a smart assistant according to an embodiment of the present application;

[0052] FIG. 7 is a schematic diagram of a display interface of a smart assistant according to an embodiment of the present application;

[0053] FIG. 8 is a schematic diagram of a display interface of a smart assistant according to an embodiment of the present application;

[0054] FIG. 9 is a schematic diagram of a display interface of a smart assistant according to an embodiment of the present application;

[0055] FIG. 10 is a seventh display interface of the intelligent assistant according to an embodiment of the present application;

[0056] FIG. 11 is an eighth display interface of the intelligent assistant according to an embodiment of the present application;

[0057] FIG. 12 is a flowchart of a method for displaying an intelligent assistant interface according to an embodiment of the present application. DETAILED DESCRIPTION

[0058] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0059] The embodiments of the present application can be applied to the technical field of terminals, and can be particularly applicable to electronic devices that can provide an intelligent assistant. On the electronic device, the intelligent assistant can be invoked in various ways. For example, a voice wake-up manner can be used, in which the electronic device wakes up the intelligent assistant by detecting a wake-up word spoken by a user. For another example, a physical button triggering manner can be used, in which the electronic device wakes up the intelligent assistant by detecting a 2-second long-press operation on a power key by the user. For yet another example, a control triggering manner can be used, in which the electronic device wakes up the intelligent assistant by detecting a click operation on an intelligent assistant application (APP) icon or a shortcut entry.

[0060] As a possible example, FIG. 1 is a display interface of an intelligent assistant. As shown in interface 101 of FIG. 1, the intelligent assistant can receive an instruction of "how to improve public speaking" input by a user, and then provide a solution interface as shown in interface 101 to the user in response to the instruction. It can be understood that the intelligent assistant can also provide the solution to the user in the form of voice broadcast while providing interface 101. In this way, the intelligent assistant can provide some information query functions for the user through a dialogue with the user.

[0061] In addition to the display interface of the intelligent assistant shown in interface 101, the intelligent assistant can also provide some system services or system functions that can be provided by an operating system for the user, such as functions of the operating system for scheduling, setting an alarm, making a call, etc. Furthermore, the intelligent assistant can also show the execution result to the user through an interface, such as an intelligent assistant interface including a prompt information of completion of scheduling, completion of setting an alarm, etc.

[0062] The conversation between the user and the intelligent assistant is usually completed in the form of an intelligent agent (IA). The intelligent agent can also be referred to as an "intelligent portal", a "service portal", or an "intelligent agent", and the like, which are not limited in the embodiments of the present application. The intelligent agent refers to an entity with intelligence, which can build a stereoscopic perception, global collaboration, accurate judgment, continuous evolution, and open intelligent system based on the cloud and centered on artificial intelligence (AI). In the field of intelligence and artificial intelligence, an intelligent agent can refer to an agent that acts in an intelligent manner, can perceive its environment, autonomously take actions to achieve goals, and can improve its performance through learning or acquiring knowledge. Therefore, in the embodiments of the present application, "intelligent agent" and "intelligent assistant" can be used interchangeably.

[0063] Therefore, the embodiments of the present application provide an intelligent assistant interface display method. In the method, in the conversation flow based on the first intelligent agent, the conversation flow of the second intelligent agent can be adaptively introduced through some preset manners, so that the "group chat" effect of the user and multiple intelligent agents can be realized in one conversation box interface, and the accuracy, efficiency and intelligence of the intelligent assistant function (in the embodiments of the present application, the intelligent assistant function can be understood as the function realized by the intelligent assistant group composed of multiple intelligent agents) can be improved by introducing one or more second intelligent agents.

[0064] The first intelligent agent can also be understood as a main intelligent agent, that is, an intelligent agent provided by an operating system; and the conversation flow of the first intelligent agent can also be understood as a main conversation flow, for example, a conversation flow between the user and an intelligent assistant provided by the operating system. In the embodiments of the present application, the main intelligent agent can be replaced with "main intelligent assistant", "main intelligent assistant", and the like.

[0065] The second intelligent agent can also be understood as a third-party intelligent agent, that is, an intelligent agent developed by a third-party application provider; and the conversation flow of the second intelligent agent can also be understood as a third-party conversation flow, for example, a conversation flow between the user and an intelligent assistant provided by a third-party service, or a conversation flow between the user and an intelligent assistant not provided by the operating system. In the embodiments of the present application, the third-party intelligent agent can be replaced with "third-party intelligent assistant", "third-party intelligent assistant", and the like.

[0066] The preset manners are described in detail in the following embodiments, which are not described here.

[0067] It should be noted that the number of introduced second intelligent agents is not limited in the embodiments of the present application, and can be one or multiple, and the specific number can be determined according to actual conditions or preset manners.

[0068] Embodiments of the present application can be applied to electronic devices such as a mobile phone, a PC, a tablet computer, a wearable device (for example, a watch, a bracelet, etc.), a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a smart home device (for example, a smart television, a smart speaker, etc.), and the like, which can provide a smart assistant. It can be understood that embodiments of the present application do not make any limitation on the specific type of the electronic device.

[0069] Embodiments of the present application can be applied to electronic devices, exemplary embodiments include but are not limited to electronic devices running or other operating systems.

[0070] FIG. 2 shows a schematic diagram of a hardware structure of a possible electronic device. The electronic device 200 includes radio frequency (RF) circuit 210, power supply 220, processor 230, memory 240, input unit 250, display unit 260, audio circuit 270, communication interface 280, and wireless-fidelity (Wi-Fi) module 290, and the like. Those skilled in the art can understand that the hardware structure of the electronic device 200 shown in FIG. 2 does not constitute a limitation on the electronic device 200, and the electronic device 200 provided by embodiments of the present application can include more or fewer components than those shown in the figure, two or more components can be combined, or have a different component configuration. The various components shown in FIG. 2 can be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and / or application-specific integrated circuits.

[0071] The various constituent components of the electronic device 200 will be specifically introduced below in conjunction with FIG. 2:

[0072] The RF circuit 210 can be used for receiving and sending data in a communication or call process. In particular, the RF circuit 210 sends the processor 230 for processing after receiving the downlink data of the base station, and sends the uplink data to be sent to the base station. Generally, the RF circuit 210 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, and the like.

[0073] In addition, the RF circuit 210 can also communicate with other devices through wireless communication networks. The wireless communication can use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), email, short messaging service (SMS), etc.

[0074] The electronic device 200 can also implement communication services and interact with other electronic devices, and thus the electronic device 200 needs to have a data transmission function, i.e., the electronic device 200 needs to include a communication module inside. Although FIG. 2 shows the RF circuit 210, the Wi-Fi module 290, and the communication interface 280 as communication modules, it can be understood that at least one of the above components or other communication modules (such as a Bluetooth module) for implementing communication exist in the electronic device 200 to perform data transmission.

[0075] Wi-Fi technology belongs to short-range wireless transmission technology. The electronic device 200 can connect to an access point (AP) through the Wi-Fi module 290 to access a data network. The Wi-Fi module 290 can be used in the communication process for receiving and sending data.

[0076] The electronic device 200 can be physically connected to other devices through the communication interface 280. Optionally, the communication interface 280 and the communication interface of the other device are connected through a cable to achieve data transmission between the electronic device 200 and the other device.

[0077] The memory 240 can be used to store software programs and modules. The processor 230 executes various function applications and data processing of the electronic device 200 by running the software programs and modules stored in the memory 240. Optionally, the memory 240 can mainly include a program storage area and a data storage area. The program storage area can store an operating system (mainly including respective software programs or modules of a kernel layer, a system layer, an application program framework layer, and an application program layer, etc.).

[0078] In addition, the memory 240 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state memory device. In an embodiment of the present application, the memory 240 can store computer program instructions and the like for implementing the method for displaying the intelligent assistant interface provided by the embodiment of the present application, for example, some third-party agents can be stored, and the goals and decision-making capabilities of different third-party agents can also be stored. In this way, by storing the third-party agents and their related capabilities, the third-party agents can be adaptively introduced in the process of the user and the main agent conducting a dialogue.

[0079] The input unit 250 can be used to receive the editing operation of the digital or character information and other various types of data objects input by the user, and to generate key signal input related to the user settings and function control of the electronic device 200. Optionally, the input unit 250 can include a touch panel 251 and other input devices 252. The touch panel 251, also known as a touch screen, can collect the touch operation of the user on or near it (such as the operation of the user using a finger, a stylus, or any suitable object or accessory on or near the touch panel 251), and drive the corresponding connection device according to the pre-set program. In some possible embodiments, the touch panel 251 can collect the typing operation of the user on the dialogue interface of the intelligent assistant, for example, the operation of the user typing the dialogue instruction on the dialogue interface through the keyboard.

[0080] Optionally, the other input devices 252 can include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), trackballs, mice, joysticks, and the like. For example, when the electronic device 200 is a notebook computer, the other input devices 252 can be a mouse and / or a keyboard.

[0081] The display unit 260 can be used to display information input by a user or information provided to the user, as well as various menus of the electronic device 200. The display unit 260 is a display system of the electronic device 200, and is used to present an interface and realize human-computer interaction. The display unit 260 can include a display panel 261. Optionally, the display panel 261 can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. In an embodiment of the present application, the display unit 260 can be used to display a dialogue interface of a smart assistant for a user. For example, in a dialogue interface with a main smart assistant, a user can display or recommend a third-party smart assistant to the user through some trigger entry, so as to realize introduction of a dialogue of a third-party agent based on a dialogue flow of a main agent, and thus improve processing accuracy, efficiency and intelligence of a smart scene, and the like.

[0082] The processor 230 is the center of controlling the electronic device 200, and connects various components through various interfaces and lines, executes various functions of the electronic device 200 and processes data by running or executing software programs and / or modules stored in the memory 240 and calling data stored in the memory 240, so as to realize various services based on the electronic device 200. In an embodiment of the present application, the processor 230 can be used to realize the smart assistant interface display method provided in the embodiments of the present application.

[0083] The electronic device 200 further includes a power supply 220 (such as a battery) for supplying power to various components. Optionally, the power supply 220 can be logically connected to the processor 230 through a power management system, so as to realize functions such as management of charging, discharging and power consumption through the power management system.

[0084] As shown in FIG. 2, the electronic device 200 further includes an audio circuit 270, a microphone 271 and a speaker 272, which can provide an audio interface between a user and the electronic device 200. The audio circuit 270 can be used to convert audio data into a signal recognizable by the speaker 272, and transmit the signal to the speaker 272 to be converted into an audio signal output by the speaker 272. The microphone 271 is used to collect external sound signals (such as human speech or other sounds), and convert the collected external sound signals into a signal recognizable by the audio circuit 270 and send to the audio circuit 270. The audio circuit 270 can also be used to convert the signal sent by the microphone 271 into audio data, and then output the audio data to the RF circuit 210 for transmission to another electronic device, or output the audio data to the memory 240 for subsequent further processing.

[0085] Although not shown, the electronic device 200 can also include a camera, at least one sensor, and the like, which will not be described herein. The at least one sensor can include, but is not limited to, a pressure sensor, an air pressure sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a touch sensor, a temperature sensor, and the like.

[0086] Embodiments of the present application relate to an operating system (OS) running on the electronic device 200. The software system of the electronic device 200 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. Embodiments of the present application take the operating system adopting a layered architecture as an example to illustrate the software system architecture of the electronic device 200.

[0087] FIG. 3 is a software system architecture block diagram of an electronic device according to an embodiment of the present application. As shown in FIG. 3, the software system architecture of the electronic device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, the application layer, the application framework layer (FWK), the runtime and system library, the kernel layer, and the hardware layer.

[0088] The application layer can include a series of application packages. As shown in FIG. 3, the application layer can include a camera, settings, a skin module, a user interface (UI), a smart assistant, third-party applications, and the like. Among them, the third-party applications can include a wireless local area network (WLAN), music, calls, Bluetooth, video, notes, and the like.

[0089] In embodiments of the present application, the application layer can be used to implement the presentation of the smart assistant interface. The above-mentioned smart assistant interface can be displayed based on the content introduced in the following embodiments.

[0090] In one possible implementation, the application can be developed using the java language, which is completed by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the underlying layer (such as the hardware layer, the kernel layer, etc.) of the operating system through the application framework layer to develop their own applications. The application framework layer is mainly a series of services and management systems of the operating system.

[0091] The application framework layer provides application programming interfaces and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. As shown in FIG. 3, the application framework layer can include an activity manager, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0092] The activity manager is used to manage the life cycle of each application and provide a common navigation back function, and provides an interface for interaction of windows of all programs.

[0093] The window manager is used to manage window programs. The window manager can acquire the size of a display screen, determine whether there is a status bar, lock a screen, and capture a screen, etc. The content provider is used to store and acquire data, and make the data accessible by an application. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, a phone book, etc.

[0094] The view system includes visual controls, such as a control for displaying text, a control for displaying pictures, etc. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0095] The phone manager is used to provide communication functions of the electronic device. For example, management of a call state (including call connection, call hang-up, etc.).

[0096] The resource manager provides various resources for an application, such as localized strings, icons, pictures, layout files, video files, etc.

[0097] The notification manager makes an application capable of displaying notification information in a status bar, which can be used to convey a message of the informing type, can automatically disappear after a short stay, and does not require user interaction. For example, the notification manager is used to inform of a download completion, a message reminder, etc. The notification manager can also be a notification appearing in a system top status bar in a form of a graph or a scroll bar text, for example, a notification of an application running in the background, and can also be a notification appearing on a screen in a form of a dialogue window. For example, a text information is prompted in a status bar, a prompt sound is emitted, the electronic device vibrates, an indicator light flashes, etc.

[0098] The runtime includes a core library and a virtual machine. The runtime is responsible for scheduling and management of the operating system.

[0099] The core library includes two parts: one part is the function function called by the java language, and the other part is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java file of the application layer and the application framework layer into a binary file. The virtual machine is used to execute the functions of object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0100] The system library can include a plurality of function modules. For example: surface manager, media framework, three-dimensional graphics processing library (such as OpenGL ES), two-dimensional graphics engine (such as SGL) and the like.

[0101] The surface manager is used to manage the display subsystem, and provides two-dimensional and 3D layer fusion for multiple applications.

[0102] The media framework supports a variety of commonly used audio, video format playback and recording, and static image files and the like. The media framework can support a variety of audio and video coding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG and the like.

[0103] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing and the like.

[0104] The two-dimensional graphics engine is a two-dimensional drawing engine.

[0105] In some embodiments, the three-dimensional graphics processing library can be used to draw three-dimensional motion trajectory images, and the two-dimensional graphics engine can be used to draw two-dimensional motion trajectory images.

[0106] The kernel layer is the layer between hardware and software. The kernel layer at least contains display driver, camera driver, audio driver, sensor driver.

[0107] The hardware layer can include various sensors, such as acceleration sensor, gravity sensor, touch sensor and the like.

[0108] Generally, the electronic device 200 can run multiple applications simultaneously. More simply, one application can correspond to one process, and more complexly, one application can correspond to multiple processes. Each process has a process number (process ID).

[0109] It should be understood that "at least one of" or similar expressions in the embodiments of the present application refers to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple. "Multiple" refers to two or more. "And / or" describes the relationship between the associated objects, which means that there can be three relationships, for example, A and / or B, which means that A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects.

[0110] In addition, it should be understood that in the description of the present application, the words "first", "second" and the like are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance.

[0111] It should be understood that the hardware structure of the electronic device can be as shown in FIG. 2, and the software system architecture can be as shown in FIG. 3, wherein the software system architecture in the electronic device corresponds to the software program and / or module stored in the memory 240, and the processor 230 can run the software program and application stored in the memory 240 to execute the flow of the intelligent assistant interface display method provided in the embodiments of the present application.

[0112] In order to facilitate understanding of the intelligent assistant interface display method provided by the present application, the implementation process of the method provided by the present application will be introduced below in combination with the content shown in FIGS. 4 to 11.

[0113] The method provided in the embodiments of the present application can be applied to electronic devices such as mobile phones or tablet computers, and can be specifically applied to scenarios where an intelligent assistant is provided on an electronic device. Among them, on the electronic device, the intelligent assistant provided by the operating system can be triggered by voice wake-up, physical button wake-up, virtual control wake-up and the like. In the following embodiments, the electronic device 200 is taken as a mobile phone as an example, and the interface processing effect that can be achieved by the method provided in the embodiments of the present application will be introduced first through a plurality of possible scenarios. It can be understood that in specific implementation, the present application is not limited to the scenarios introduced below.

[0114] In combination with the interface 101 shown in FIG. 1, on the basis of the electronic device displaying the dialogue interface of the main intelligent assistant, one or more third-party intelligent assistants can be introduced through a plurality of triggering modes. The following will introduce three triggering modes through scenarios A1 to A3. It should be understood that the triggering modes introduced below are not limited in the embodiments of the present application.

[0115] Scenario A1: Triggering a recommended third-party intelligent assistant through dynamic configuration of a dialogue instruction (chips).

[0116] FIG. 4 is a schematic diagram of a display interface of an intelligent assistant according to an embodiment of the present application. As shown in interface 400A1 of FIG. 4, it is a dialogue interface of a user and a main intelligent assistant. The interface 400A1 can include, but is not limited to, the following basic contents: the name of the main intelligent assistant, which can be "Xiao Yi" for example; the avatar 401 of the main intelligent assistant; the command 402 issued by the user to the main intelligent assistant, which can be "How to write a sentence describing spring"; and the answer 403 of the main intelligent assistant in response to the user's command. In the interface 400A1, the following can also be included, but are not limited to: a keyboard control, a voice control, an add control, etc., for enabling the user to dialogue with the main intelligent assistant or with a third-party intelligent assistant introduced in multiple ways.

[0117] In the embodiment of the present application, based on the dialogue interface of the user and the main intelligent assistant, a third-party intelligent assistant can be recommended to the user, such as the weather manager 404 shown in the interface 400A1. As shown in the interface 400A1, when displaying the third-party intelligent assistant, not only the name of the third-party intelligent assistant can be displayed, but also the avatar of the third-party intelligent assistant can be displayed.

[0118] For example, in the interface 400A1, the phone can display the interface 400B in response to the clicking operation on the weather manager 404.

[0119] In the interface 400B, based on the dialogue window of the user and the main intelligent assistant, dialogue with the third-party intelligent assistant can be realized. For example, in the interface 400B, a floating bar 406 can be displayed; the floating bar 406 can be used to prompt the user that he is in dialogue with the third-party intelligent assistant. For example, the floating bar 406 can include the name and avatar of the third-party intelligent assistant, such as "Weather Manager" and its avatar; and a "quit" control, which can be used by the user to quit the dialogue with the third-party intelligent assistant and resume the dialogue with the main intelligent assistant. It should be noted that although the floating bar is used to display the prompt information that the user is in dialogue with the third-party intelligent assistant in FIG. 4 and subsequent drawings, in the specific implementation, the specific form of the prompt information is not limited, for example, a floating ball or other forms can also be used to prompt the user.

[0120] Another example, in the interface 400B, the main dialogue flow 407 and the third-party dialogue flow 408 can be displayed. Among them, before displaying the third-party dialogue flow 408, the user can be prompted by the prompt text that the current smart assistant is switched from Xiaoyi to the weather manager assistant. As can be seen from the interface 400B, the interface 400B is the updated interface 400A1, and it can also be understood that the dialogue content with the weather manager assistant is updated in the dialogue interface shown in the interface 400A1, and it is not switched to other dialogue interfaces. Through the method provided in the embodiment of the present application, it can be realized in one dialogue box that not only the dialogue between the user and the main smart assistant is realized, but also the dialogue between the user and the third-party smart assistant is realized. In this way, on the basis of the main dialogue flow, the recommended third-party dialogue flow can be triggered through the dynamic configuration of the chip, so that the main smart assistant and the third-party smart assistant can work together to more efficiently and accurately answer the user's questions or provide services, etc.

[0121] In addition, in the interface 400A1, some questions related to the third-party smart assistant can also be included, such as "today's weather" 405A, "recent weather" 405B, etc. Another example, the mobile phone can also respond to the click operation on "today's weather" 405A or "recent weather" 405B, etc. to realize single answer by the weather manager 404; optionally, the single answer content of the weather manager 404 can be displayed in the dialogue interface between the user and the main smart assistant. For example, in the interface 400A2, the mobile phone can respond to the click operation on "today's weather" 405A to display the interface 400C; among them, in the interface 400C, the answer 409 to the command "today's weather" by the weather manager can be displayed. It can be seen from the combination of the interface 400B and the interface 400C that the interface 400B is triggered to enter the multi-round dialogue process between the user and the weather manager, and the subsequent commands of the user can be understood and processed by the weather manager. While the interface 400C is only the answer to the current command of the user by the weather manager, the subsequent commands of the user can be understood and still processed by Xiaoyi. In addition, the trigger entry 410 of the weather manager assistant can also be associated and displayed near the display area of the single answer of the weather manager 404. Through the trigger entry 410, the single answer by the weather manager 404 can also be changed to the multi-round dialogue of the weather manager 404.

[0122] It should be noted that although the interface 400A1 recommends a third-party intelligent assistant, the number of third-party intelligent assistants that can be recommended in the embodiments of the present application is not limited, and can be determined according to dynamically configured rules. For example, when the mobile phone detects that there are multiple third-party intelligent assistants that meet the dynamically configured rules, the multiple third-party intelligent assistants can be directly displayed on the dialogue interface between the user and the main intelligent assistant, or the multiple third-party intelligent assistants that cannot be directly displayed can be viewed through left and right sliding operations or the like.

[0123] In this scenario, the dynamic configuration of the chips can include but is not limited to the following configuration rules: the hottest third-party intelligent assistant, the newly updated third-party intelligent assistant, the third-party intelligent assistant with the highest historical query times, the third-party intelligent assistant most likely to be viewed, and the like. As shown in the interface 400A1, at 8:00 in the morning, based on the dynamic configuration rules, the third-party intelligent assistant most likely to be viewed is the weather manager assistant, so the weather manager 404 is recommended in the interface 400A1.

[0124] Scenario A2, hit by dialogue

[0125] FIG. 5 is another display interface of an intelligent assistant provided by an embodiment of the present application. As shown in interface 500A in FIG. 5, it is a dialogue interface between the user and the main intelligent assistant. Similar to the interface 400A1, the interface 500A can include but is not limited to the following basic content: the name of the main intelligent assistant, for example, “Xiao Yi”; the avatar 501 of the main intelligent assistant; the command 502 issued by the user to the main intelligent assistant, for example, it can be “What is the weather today?”. It can be understood that in the interface 500A, keyboard controls, voice controls, new controls, etc. can also be included, which are used to realize dialogue with the main intelligent assistant or the introduced third-party intelligent assistant in multiple ways.

[0126] In the interface 500A, the mobile phone can display the interface 500B in response to the command 502. The difference between the interface 500B and the interface 400A1 is that when the main intelligent assistant can determine that a third-party intelligent assistant (weather manager) can provide more accurate, more detailed, and more professional answers according to the dialogue with the user, the pre-stored third-party intelligent assistant and its corresponding functions, the main intelligent assistant can provide answers as shown in the display box 503 in the dialogue interface between the main intelligent assistant and the user; the answer in the display box 503 is answered by the weather manager. In this way, the operating system can actively introduce a third-party intelligent assistant according to the dialogue content, so as to realize more efficient and more accurate answers to questions or provision of services for the user by the main intelligent assistant in combination with the third-party intelligent assistant.

[0127] In this scenario, the user can also be provided with a trigger entry 504 for a multi-turn dialogue with the weather butler. As shown in interface 500B, when the trigger entry for the weather butler is displayed, not only the name of the weather butler, but also the avatar of the weather butler can be displayed, so as to prompt the user that the trigger entry 504 is used to indicate the third-party intelligent assistant. For example, the mobile phone can display interface 500C in response to the click or other operations on the trigger entry 504 of the weather butler.

[0128] In interface 500C, based on the dialogue window between the user and the main intelligent assistant, a multi-turn dialogue with the weather butler can be implemented. For example, in interface 500C, a floating bar 505 can be displayed; the floating bar 505 can be used to prompt the user that the dialogue is being conducted with the weather butler. For example, the floating bar 506 can include the name and avatar of the weather butler; the “exit” control can also be included, which can be used by the user to exit the dialogue with the weather butler and resume the dialogue with Xia Yi.

[0129] Another example is that in interface 500C, the main dialogue flow 506 and the third-party dialogue flow 507 can be displayed. Before displaying the third-party dialogue flow 507, the user can be prompted by a prompt text that the current intelligent assistant is switched from “Xia Yi” to “weather butler”. As shown in interface 500C, the subsequent dialogue of the user can be answered by the weather butler assistant. It can also be understood that when the mobile phone detects the click or other operations on the exit control in the floating bar 505, the dialogue between the user and Xia Yi can be resumed.

[0130] It should be noted that in interface 500B, the dialogue hits the weather butler assistant as an example. It can be understood that when the user's command is other command, other third-party intelligent assistants can be hit, for example, when the user's command is “how to cook”, the third-party intelligent assistant that can be hit can be a recipe assistant. Alternatively, in some other possible scenarios, the dialogue can not hit the third-party intelligent assistant, and the main intelligent assistant answers.

[0131] As can be seen from interface 500C, through the method provided by the embodiments of the present application, on the basis of the main dialogue flow, the third-party dialogue flow can be triggered by the hit of the dialogue command, so as to realize that the main intelligent assistant and the third-party intelligent assistant can jointly provide more efficient, more accurate and more professional answers to the user's questions or services.

[0132] Scenario A3, single call based on preset rules

[0133] FIG. 6 is another display interface of the intelligent assistant according to an embodiment of the present application. As shown in interface 600A, it is a dialogue interface between the user and the main intelligent assistant. The interface 600A can include, but is not limited to, the following basic content: the name of the main intelligent assistant, for example, it can be "Xiao Yi"; the avatar 601 of the main intelligent assistant; the keyboard control 602; the voice control; the add control, etc. For example, the mobile phone can display the interface 600B in response to the click operation on the keyboard control 602.

[0134] In the interface 600B, the input area of the keyboard can be included, and the input area can include the input box 603. Optionally, the mobile phone can display the pop-up window 604 in the interface 600B in response to the user typing "@" in the input box 603. In the pop-up window 604, one or more third-party intelligent assistants can be displayed. Optionally, the pop-up window 604 can be used to display the third-party intelligent assistants that have been used historically, or the third-party intelligent assistants that have been used in a preset historical time period, or all third-party intelligent assistants stored by the main intelligent assistant, or third-party intelligent assistants determined according to historical use frequency, etc.

[0135] It should be noted that in the embodiments of the present application, the preset rules for displaying the third-party assistants in the pop-up window 604 are not limited, and can be defined by the user as needed. For example, in the pop-up window 604 shown in the interface 600B, the third-party intelligent assistants displayed can include the weather manager assistant and the recipe assistant.

[0136] For example, the mobile phone can display the interface 600C in response to the click operation on the weather manager assistant in the pop-up window 604. In the input box 605 included in the input area of the keyboard in the interface 600C, the mobile phone can respond to the user typing "What's the weather like today?" in the input box 605. It can be understood that the word "@ weather manager" in the input box 605 is input by the "@" shown in the interface 600B and the click operation on the weather manager assistant in the pop-up window 604.

[0137] Optionally, in the input box 605 shown in the interface 600C, "@ weather manager" can be used as a control 6051, and can be switched to other third-party intelligent assistants by clicking or other operations.

[0138] In the interface 600C, the mobile phone can display the interface 600D in response to the clicking operation on the sending control 606. The interface 600D still shows the conversation interface of the user and Xiaoyi, but based on the fact that the command 6071 issued by the user includes "@ weather butler", the answer 6072 to the command 6071 is answered by the weather butler assistant. It can be understood that in this scenario, the weather butler assistant can provide a single round of conversation for the user. Based on this, the interface 600D can also provide a trigger entry 608 for the user to have a multi-round conversation with the weather butler assistant near the answer provided by the weather butler assistant. As shown in the interface 600D, when the trigger entry 608 of the weather butler is displayed, not only the name of the weather butler can be displayed, but also the avatar of the weather butler can be displayed, so as to prompt the user that the trigger entry 608 is used to indicate a third-party intelligent assistant. The function of the trigger entry 608 can be referred to the trigger entry 504 shown in FIG. 5. Through the trigger entry 608, the user can have a multi-round conversation with the weather butler.

[0139] In this scenario, through the configuration of some preset rules, a single call of a third-party intelligent assistant can be realized. For example, the symbol "@" can be pre-configured to realize a single call of a third-party intelligent assistant for answering, so as to realize more efficient and more accurate answers and services provided by the third-party intelligent assistant for the user. It should be noted that the symbol "@" is not limited as a way of a single call of a third-party intelligent assistant in the embodiments of the present application. For example, other preset symbols such as "*" can also be used as a way of a single call of a third-party intelligent assistant.

[0140] In addition, in some other possible scenarios, a single call of a third-party intelligent assistant can also be realized through a voice instruction. For example, the voice instruction can be "Xiaoyi, help me ask the weather butler about the weather today".

[0141] Based on the introduction of the scenarios A1 to A3, through the method provided in the embodiments of the present application, a third-party intelligent assistant can be quickly called in a main conversation flow, so as to realize answering and providing services by the third-party intelligent assistant. In this way, through a main intelligent assistant and at least one third-party intelligent assistant, more accurate, more efficient, more positive, and more intelligent answers and services can be provided for the user in one conversation interface.

[0142] The above scenarios A1 to A3 introduce several triggering manners for calling a third-party intelligent assistant based on a primary intelligent assistant. In a scenario where multiple third-party intelligent assistants exist, the method provided in the embodiments of the present application can also switch a dialogue between different third-party intelligent assistants, so as to realize a "group chat" experience of a user with multiple intelligent assistants. The following describes three dialogue switching scenarios through scenarios B1 to B3. It should be understood that the dialogue switching scenarios described below are not limited in the embodiments of the present application.

[0143] Scenario B1, switching dialogue based on a pull-down control

[0144] FIG. 7 is another display interface of an intelligent assistant provided in the embodiments of the present application. In combination with the interface 400B in FIG. 4, in a scenario where a third-party intelligent assistant (Weather Butler) is introduced in the process of a primary dialogue with a primary intelligent assistant (Xiao Yi), the pull-down control 4061 can be included in the floating bar 406. Exemplarily, the mobile phone displays the interface 700A in response to a click on the pull-down control 4061 or the like.

[0145] Compared with the floating bar 406 shown in the interface 400B, a more complete floating bar 701 can be displayed in the interface 700A. The floating bar 701 can include the third-party intelligent assistant (Weather Butler) 7011 and the third-party intelligent assistant (Recipe) 7012. It should be noted that the floating bar 701 takes two third-party intelligent assistants as examples, and the number of third-party intelligent assistants displayed in the floating bar 701 is not limited in the embodiments of the present application.

[0146] In the floating bar 701, the mobile phone can display the interface 700B in response to a selection operation on the third-party intelligent assistant (Recipe) 7012. In the interface 700B, the floating bar 702 can be displayed; similar to the floating bar 406 in the interface 400B, the floating bar 702 can be used to prompt that the user is in a dialogue with the third-party intelligent assistant (Recipe). In addition, the third-party dialogue flow 703 can also be included in the interface 700B; the third-party dialogue flow 703 is used to indicate the dialogue content between the user and the Recipe Assistant. It can be understood that the dialogue flow between the user and the Weather Butler Assistant before switching is displayed before the third-party dialogue flow 703. In this way, the dialogue between the user and Xiao Yi, the dialogue flow between the user and the Weather Butler Assistant, and the dialogue flow between the user and the Recipe Assistant can be included in one dialogue box, so as to realize a "group chat" dialogue experience of the user with multiple assistants, and the dialogue between the user and different assistants can be switched in some switching manners.

[0147] Scenario B2, switching dialogue based on a navigation bar

[0148] FIG. 8 is another display interface of the smart assistant according to an embodiment of the present application. Taking a folding screen mobile phone as an example, other large-screen devices such as a tablet computer can refer to the scenario introduced in FIG. 8, and the present application will not be repeated here.

[0149] As shown in interface 800A in FIG. 8, for a folding screen mobile phone, a third-party smart assistant (Weather Butler) is introduced in the process of conducting a main dialogue with a main smart assistant (Xiaoyi). The interface can include at least a floating bar 801, which can include but is not limited to the name of the Weather Butler, the avatar of the Weather Butler, a "quit" control, and a navigation bar control 802. Similar to the floating bar 406 shown in the interface 400B in FIG. 4, the floating bar 801 can be used to prompt the user that he is in dialogue with the third-party smart assistant. Compared with FIG. 7, since the folding screen mobile phone has a larger screen size, the navigation bar mode can be used to display multiple switchable third-party assistant controls, and the pull-down control form does not need to be used. It should be noted that although FIG. 7 and FIG. 8 show two different switching modes for different electronic devices, the present application does not limit the specific form of switching dialogue for electronic devices in the embodiments, for example, the navigation bar mode can also be used to realize dialogue with different third-party assistants on a mobile phone.

[0150] For example, the folding screen mobile phone displays interface 800B in response to a click or other operation on the navigation bar control 802. In interface 800B, a column form can be used to display a navigation bar region 803 and a region for displaying original interface display content. The navigation bar region 803 can be used to display multiple smart assistants that the user can switch, and can include but is not limited to a main smart assistant (Xiaoyi assistant 8031) and multiple third-party smart assistants (for example, Weather Butler assistant 8032 and recipe assistant 8033 shown in interface 800B).

[0151] In interface 800B, the folding screen mobile phone can display interface 800C in response to a selection operation on the recipe assistant 8033. In interface 800C, a floating bar 804 can be displayed. Similar to the floating bar 801, the floating bar 804 can be used to prompt the user that he is in dialogue with the third-party smart assistant; unlike the floating bar 801, the floating bar 804 is used to indicate that the user is in dialogue with the recipe assistant. In addition, interface 800C can also include a third-party dialogue flow 805; the third-party dialogue flow 805 is used to indicate the dialogue content between the user and the recipe assistant.

[0152] Through the scene B1 and the scene B2, it can be realized that the dialog with different third-party intelligent assistants is quickly switched in one dialog flow, so that more efficient, more intelligent, more targeted, more accurate information query and more comprehensive service can be provided by introducing more third-party intelligent assistants in the process of the dialog with the main intelligent assistant or the third-party intelligent assistant.

[0153] The scene B3, through the preset rule, the dialog can be switched once

[0154] FIG. 9 is another display interface of the intelligent assistant provided by the embodiment of the present application. As shown in interface 900A in FIG. 9, it is a scene based on the introduction of the third-party intelligent assistant (Weather Butler) in the process of the main dialog with the main intelligent assistant (Xiao Yi). In the interface 900A, at least the third-party dialog flow of the user and the Weather Butler can be included, and the keyboard control 901, the voice control, the new control and the like can also be included.

[0155] For example, the mobile phone can display the interface 900B in response to the clicking operation on the keyboard control 901. The interface 900B can include the input area of the keyboard, and the input area can include the input box 902. Similar to the interface 600B in FIG. 6, the mobile phone can display the pop-up window 903 in the interface 900B in response to the trigger instruction that the user types "@" in the input box 902. Optionally, the third-party intelligent assistant included in the pop-up window 903 can include: Today's Dressing Assistant 903. Optionally, the third-party intelligent assistant shown in the pop-up window 903 can be determined based on the dialog content with the Weather Butler. Another optional, the third-party intelligent assistant shown in the pop-up window 903 can also be determined based on the preset rule (for example, the hottest, the latest, the highest historical use frequency).

[0156] The mobile phone can display the interface 900C in response to the clicking operation on the Today's Dressing Assistant 903 included in the pop-up window 903 or the like. In the interface 900C, the input box 904 of the keyboard can display the instruction that the user inputs "@ Today's Dressing Assistant helps me to match the short clothes and pants". Then, the mobile phone can display the interface 900D in response to the clicking operation on the sending control 905. In the interface 900D, it is indicated that in the process of the dialog between the user and the Weather Butler, the single dialog with other third-party intelligent assistants can be realized through the "@" mode. In addition, in the interface 900D, in addition to displaying the answer provided by the Today's Dressing Assistant, the trigger entry 906 for providing the user with the multi-round dialog with the Today's Dressing Assistant can also be included. The specific introduction of the trigger entry 906 can be referred to the trigger entry 608 introduced in FIG. 6, which will not be described here.

[0157] In this scenario, during the conversation with the third-party intelligent assistant, different third-party intelligent assistants can be quickly introduced in a single time through preset rules (for example, @ mode), so that the user experience of the user having a "group chat" conversation with more intelligent assistants can be realized.

[0158] Based on the introduction of scenarios B1 to B3, in the scenario of switching between multiple third-party intelligent assistants, considering that the third-party intelligent assistant before switching may have an ongoing task, after switching to other third-party intelligent assistants, the task of the original third-party intelligent assistant can also be dynamically displayed, so that the user can conveniently monitor the execution of multiple third-party intelligent assistants.

[0159] Scenario C, dynamically displaying an ongoing task

[0160] FIG. 10 is another display interface of an intelligent assistant provided by an embodiment of the present application. As shown in interface 1000A in FIG. 10, it is a scenario of introducing a third-party intelligent assistant (Weather Butler) based on a main conversation with a main intelligent assistant (Xiao Yi). In the third-party conversation flow between the user and the Weather Butler, the user can issue an instruction to "monitor the real-time rain state". It can be understood that this instruction can be understood as a continuous task with a certain long duration.

[0161] For example, when the phone responds to the click operation on the pull-down control included in the floating bar of interface 1000A, interface 1000B can be displayed. In interface 1000B, when the phone responds to the selected operation on the recipe assistant, interface 1000C1 or interface 1000C2 can be displayed.

[0162] In interface 1000C1, floating bar 1001 and floating bar 1002 can be displayed side by side. Floating bar 1001 is used to indicate the ongoing task of the Weather Butler assistant, which can be understood as the Weather Butler assistant running in the background and timely displaying the brief information of the task to the user through floating bar 1001. Floating bar 1002 is used to indicate that the user is having a conversation with the recipe assistant. Based on this, interface 1000C1 can also include third-party conversation flow 1003 between the user and the recipe assistant. In this way, by displaying multiple floating bars side by side on the interface, the user can timely obtain the task execution status of multiple third-party intelligent assistants.

[0163] In the interface 1000C2, a floating bar 1004 can be displayed. The floating bar 1004 can be used to display multiple pieces of prompt information in a folding manner, and the brief information of the task status of the weather butler assistant can be displayed at the forefront. For example, the mobile phone can display the interface 1000D in response to a click operation on the pull-down control included in the floating bar 1004. In the interface 1000D, a more complete floating bar 1005 can be displayed. The floating bar 1005 can include not only the prompt information 10051 of the brief information of the task status of the weather butler assistant, but also the prompt information that the user is currently having a conversation with the recipe assistant. In this way, by displaying the task execution status of multiple third-party intelligent assistants in a folding manner in one floating bar, the current interface can be reduced, and the user can easily obtain the task execution status of multiple third-party intelligent assistants by clicking the pull-down control and the like. In addition, in the floating bar, the task execution status with the highest priority can be displayed according to the priority of multiple task execution statuses. The priority of the task can be determined by, but not limited to, the following information: the task has been updated, important tasks, and the like.

[0164] In addition, in the interface 1000D, the mobile phone can display the interface 1000E in response to a click operation on the prompt information 10051 included in the floating bar 1005. The interface 1000E is used to indicate that the conversation content corresponding to the task of the weather butler assistant is jumped back, that is, the conversation content 1006. In this way, the user can conveniently view the conversation content with different third-party intelligent assistants.

[0165] In addition, as can be seen from the interface 1000D and the interface 1000E, the task status of the weather butler assistant can also be refreshed to provide the user with real-time task status. For example, the weather butler assistant monitors that it will rain in one hour at 8:00, and monitors that it will rain in half an hour at 8:30, and synchronously displays the monitoring results in real time.

[0166] As can be seen from the introduction of the scenario, the method provided by the embodiments of the present application can dynamically display multiple third-party intelligent assistants that are currently in progress. The task of the third-party intelligent assistant can include, but is not limited to, a conversation with the third-party intelligent assistant, and a task that the third-party intelligent assistant is currently performing (for example, a ticketing task of a ticketing assistant).

[0167] Fig. 11 is another display interface of the smart assistant according to an embodiment of the present application. As shown in interface 1100, a new dialogue interface is triggered for the user to start a new dialogue with the main smart assistant. As can be seen from interface 1100, when the phone detects that there is a task being executed by the third-party smart assistant in the background, the task information can be displayed on the new dialogue interface through the floating bar 1101. In interface 1100, the phone can also display interface 1000E in response to the click operation on the floating bar 1101, so as to facilitate the display position of the historical dialogue record. For details of interface 1000E, please refer to Fig. 10. Through the processing of this scenario, the dialogue content corresponding to the weather assistant task can be returned, and the specific implementation is not described here.

[0168] Based on the foregoing description of the interface processing effect achieved by the method provided by the present application, the implementation process of the smart assistant interface display method provided by the present application is introduced below, which is used to illustrate how to achieve the interface processing effect shown in Figs. 4-11 by using the method provided by the present application, so as to improve the function accuracy and intelligence of the smart assistant through the main smart assistant and at least one third-party smart assistant.

[0169] Referring to Fig. 12, a flowchart of a smart assistant interface display method according to an embodiment of the present application is shown. The method can be applied to an electronic device, for example, a phone, and can include the following steps:

[0170] Step 1201, display a first interface, wherein the first interface includes a main dialogue flow between the user and the main smart assistant.

[0171] For example, the first interface can be interface 400A1 or interface 400A2 in Fig. 4, or interface 500A in Fig. 5, or interface 600A in Fig. 6. The main smart assistant can be Xiaoyi provided by the phone.

[0172] Step 1202, in the first interface, a third-party smart assistant triggering event is detected; wherein the third-party smart assistant triggering event is used to indicate that a dialogue with the third-party smart assistant is triggered.

[0173] Exemplarily, the third-party intelligent assistant triggering event can include, but is not limited to: a click operation on the weather manager 404 in the interface 400A1 in FIG. 4, or a click operation on the "today's weather" 405A in the interface 400A2; or the command 502 in FIG. 5; or the triggering instruction of typing "@" in the input box 603 shown in the interface 600B in FIG. 6, and the like. The third-party intelligent assistant can be, for example, the weather manager assistant, the recipe assistant, the today's outfit assistant, and the like introduced in the foregoing, and the present application does not limit the third-party intelligent assistant.

[0174] In addition, the third-party intelligent assistant triggering event includes two triggering results, one triggering result is that the user has a long conversation with the third-party intelligent assistant, which can also be understood as a multi-round conversation, for example, as shown in the interface 400B in FIG. 4; and the other triggering result is that the user has a single-round conversation with the third-party intelligent assistant, which can also be understood as a single-time processing by the third-party intelligent assistant, for example, as shown in the interface 400C in FIG. 4. In specific implementation, the corresponding triggering result can be determined according to the detection of the triggering event. In addition, it can be understood that when the third-party intelligent assistant provides a result of single-time processing, a triggering entry for switching to a long conversation can also be provided, for example, the triggering entry 410 in the interface 400C in FIG. 4, for example, the triggering entry 504 in the interface 500B in FIG. 5, or for example, the triggering entry 608 in the interface 600D in FIG. 6.

[0175] Step 1203: updating the first interface in response to the third-party intelligent assistant triggering event; wherein the updated first interface includes the main conversation flow and a third-party conversation flow between the user and the third-party intelligent assistant.

[0176] Exemplarily, the updated first interface can be, for example, the interface 400B or the interface 400C in FIG. 4, for example, the interface 500B in FIG. 5, or for example, the interface 600D in FIG. 6.

[0177] It should be noted that the intelligent assistant interface display method shown in FIG. 12 can refer to the above-mentioned embodiments of the present application in specific implementation, and repeated parts will not be described again.

[0178] Based on the above embodiments, the present application further provides an electronic device including a plurality of functional modules; the plurality of functional modules interact with each other to realize the functions performed by the electronic device in the methods described in the embodiments of the present application. The plurality of functional modules can be realized based on software, hardware or a combination of software and hardware, and the plurality of functional modules can be arbitrarily combined or divided based on specific implementation. For example, the steps 1201 to 1203 performed by the electronic device in the embodiment shown in FIG. 12.

[0179] Based on the above embodiments, the present application further provides an electronic device, comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes the functions performed by the electronic device in the methods described in the embodiments of the present application. For example, the electronic device executes steps 1201 to 1203 shown in the embodiment of FIG. 12.

[0180] Based on the above embodiments, the present application further provides a computer program product, comprising: a computer program (also referred to as code or instructions), when the computer program is executed, causing a computer to execute the methods described in the embodiments of the present application.

[0181] Based on the above embodiments, the present application further provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, when the computer program is executed by a computer, causing the computer to execute the methods described in the embodiments of the present application.

[0182] Based on the above embodiments, the present application further provides a chip for reading a computer program stored in a memory, and implementing the methods described in the embodiments of the present application.

[0183] Based on the above embodiments, the present application provides a chip system, comprising a processor for supporting a computer device to implement the methods described in the embodiments of the present application. In a possible design, the chip system further comprises a memory for storing the necessary programs and data of the computer device. The chip system can be composed of a chip, or can include a chip and other discrete devices. Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program code.

[0184] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0185] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks.

[0186] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks.

[0187] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the claims and their equivalents, the application can be practiced otherwise than as specifically described.

Claims

1. A method for displaying a smart assistant interface, characterized in that, Applied to electronic devices, including: The first interface is displayed, which includes the main dialogue flow between the user and the main intelligent assistant. In the first interface, a third-party smart assistant trigger event is detected; wherein, the third-party smart assistant trigger event is used to indicate triggering a dialogue with the third-party smart assistant; In response to the third-party smart assistant triggering event, the first interface is updated; wherein, the updated first interface includes the main dialogue flow and the third-party dialogue flow between the user and the third-party smart assistant.

2. The method according to claim 1, characterized in that, Before updating the first interface, the first interface includes a first control, which is a trigger entry point for interacting with the third-party smart assistant. The detected third-party smart assistant trigger event includes: A first operation command for the first control was detected.

3. The method according to claim 2, characterized in that, The updated first interface also includes a first prompt message, which indicates that the user is having a conversation with the third-party smart assistant. The first prompt message includes an exit control, which is used to exit the conversation with the third-party smart assistant and resume the conversation with the main smart assistant.

4. The method according to claim 2 or 3, characterized in that, Before updating the first interface, the first interface also includes a second control, which is a trigger entry point for single processing by the third-party smart assistant. The detected third-party smart assistant trigger event includes: A second operation command for the second control was detected.

5. The method according to any one of claims 2 to 4, characterized in that, The third-party smart assistant makes recommendations based on preset configuration rules; The preset configuration rules include one or more of the following rules: highest usage frequency, most recent online time, and shortest interval since last use.

6. The method according to claim 1, characterized in that, The detected third-party smart assistant trigger event includes: Based on the dialogue content of the main dialogue stream and the capabilities of at least one pre-stored alternative third-party smart assistant, it is determined that the third-party smart assistant will perform a single processing session; wherein, the capabilities of the alternative third-party smart assistant are used to indicate the dialogue that the alternative third-party smart assistant can process, and the third-party smart assistant has the ability to process the dialogue content of the main dialogue stream.

7. The method according to claim 1, characterized in that, The detected third-party smart assistant trigger event includes: The system detects that the user has triggered a single-time processing by the third-party smart assistant through a preset method. The preset methods include: calling the third-party smart assistant by using a preset symbol in the input box, or calling the third-party smart assistant by using keywords in a voice command.

8. The method according to claim 7, characterized in that, The preset symbol is @.

9. The method according to claim 4, 6 or 7, characterized in that, The third-party dialogue flow includes: user commands based on the second control, and the third-party smart assistant's response to the user commands; in the updated first interface, a first control is associated with the response, and the first control is the trigger entry point for dialogue with the third-party smart assistant; The method further includes: In response to a third operation instruction on the first control included in the updated first interface, the process changes from a one-time processing by the third-party smart assistant to a dialogue with the third-party smart assistant.

10. The method according to any one of claims 1 to 9, characterized in that, The updated first interface also includes a third control, which is used to display multiple third-party smart assistants; The method further includes: In response to a fourth operation command on the third control, a second interface is displayed; the second interface includes multiple third-party smart assistants. In response to the selection of another third-party smart assistant included in the second interface, a third interface is displayed; wherein the third interface includes the main dialogue stream, the third-party dialogue stream, and another third-party dialogue stream between the user and the other third-party smart assistant.

11. The method according to claim 10, characterized in that, The third control is a dropdown control in the first prompt message, which indicates that the user is having a conversation with the third-party smart assistant; or... The third control is a navigation bar control.

12. The method according to claim 10 or 11, characterized in that, The third interface also includes a second prompt message; The second prompt message is used to indicate that the user is having a conversation with the other third-party smart assistant, and also to indicate the task execution status of the third-party smart assistant.

13. The method according to claim 12, characterized in that, The method further includes: In response to the fifth operation command regarding the task execution status of the third-party smart assistant, the system jumps to the dialogue content associated with the task in the third-party dialogue stream.

14. The method according to any one of claims 1 to 13, characterized in that, The method further includes: When a third-party smart assistant is detected to be performing a background task, the task execution status of the third-party smart assistant will be displayed on any smart assistant interface through a third prompt message.

15. The method according to any one of claims 1 to 14, characterized in that, The main smart assistant is provided by the operating system of the electronic device, and the third-party smart assistant is provided by a third application provider.

16. An electronic device, characterized in that, It includes at least one processor coupled to at least one memory, the at least one processor being configured to read a computer program stored in the at least one memory to perform the method as described in any one of claims 1 to 15.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 1 to 15.

18. A computer program product containing instructions, characterized in that, When the computer program product is run on a computer, it causes the computer to perform the method as described in any one of claims 1 to 15.

Images