Smart assistant interface display method and electronic equipment

Abstract

The invention relates to the technical field of terminals, and discloses a smart assistant interface display method and electronic equipment. In the method, an electronic device can detect and respond to a third-party smart assistant trigger event on a displayed main dialogue stream interface between a user and a main smart assistant, and updates and displays an introduced third-party dialogue stream between the user and the third-party smart assistant on the main dialogue stream interface. Therefore, through the method, not only can the conversation between the user and the main smart assistant be realized, but also the conversation between the user and the third-party smart assistant can be realized in one dialog box, so that the service of smart scenes such as information query and operation execution can be provided for the user through the combination of the main smart assistant and the third-party smart assistant; therefore, the efficiency of the smart scene can be improved, and the cooperation among a plurality of smart assistants can be realized to more accurately answer questions, provide services and the like to the user.

Description

[0001] This application is a divisional application. The application number of the original application is 202410807550.8, and the original application date is June 20, 2024. The entire content of the original application is incorporated herein by reference. Technical Field

[0002] Embodiments of this application relate to the technical field of terminals, and in particular, to a method for displaying a smart assistant interface and an electronic device. Background Art

[0003] The operating system of an electronic device generally provides a smart assistant, which can be invoked by means of voice wake-up, control triggering, etc., and then the user can query information or execute some service functions provided by the operating system by having a conversation with the smart assistant.

[0004] As the functions of the smart assistant are gradually improved and enriched, a better user experience can be provided to users. For example, in some scenarios, the smart assistant of the electronic device can be divided into different roles, so as to enrich the fun of the conversation; for example, the smart assistant includes Role A, Role B, etc., and the conversations between the user and different roles have independent dialog boxes. For another example, in some other scenarios, the smart assistant of the electronic device can also be split into sub-assistants with different capabilities; for example, the smart assistant includes Sub-assistant 1, Sub-assistant 2, etc., and the conversations between the user and different sub-assistants are also isolated and independent of each other. For yet another example, in some other scenarios, the smart assistant can also call the interfaces of third-party services and combine its own understanding to provide answers to users.

[0005] However, how to further improve the functional accuracy and intelligence of the smart assistant is worthy of continuous research. Summary of the Invention

[0006] Embodiments of this application provide a method for displaying a smart assistant interface and an electronic device, so as to improve the functional accuracy and intelligence of the smart assistant.

[0007] In a first aspect, embodiments of this application provide a method for displaying a smart assistant interface. The method can be applied to an electronic device. In the method, a first interface is displayed, and the first interface includes a main conversation flow between the user and the main smart assistant; in the first interface, a third-party smart assistant trigger event is detected; wherein, the third-party smart assistant trigger event is used to indicate triggering a conversation with the third-party smart assistant; in response to the third-party smart assistant trigger event, the first interface is updated; wherein, the updated first interface includes the main conversation flow and a third-party conversation flow between the user and the third-party smart assistant.

[0008] In this method, during the process of a user's conversation with the primary intelligent assistant, the third intelligent assistant can be triggered to participate in the conversation through various triggering methods. Thus, the conversation between the user and the intelligent assistant can be realized, including not only the conversation between the user and the primary intelligent assistant, but also the conversation between the user and the third-party intelligent assistant, which can be understood as the conversation between the user and the intelligent assistant group. In this way, through multiple intelligent assistants, the functional accuracy of the intelligent assistant can be improved, and more professional and detailed functions can be provided.

[0009] In a possible implementation manner, before updating the first interface, the first interface includes a first control, and the first control is a trigger entry for having a conversation with the third-party intelligent assistant. The detecting of the third-party intelligent assistant trigger event includes: detecting a first operation instruction for the first control.

[0010] In this implementation manner, by providing a trigger entry for triggering the third-party intelligent assistant on the conversation interface between the user and the primary intelligent assistant, for example, it can be displayed to the user in a control manner, so that the third-party conversation flow can be introduced into the main conversation flow. Therefore, through the conversations of multiple intelligent assistants with the user, questions can be answered and services can be provided to the user more efficiently and accurately.

[0011] Based on the above implementation manner, the updated first interface further includes a first prompt message, and the first prompt message is used to indicate that the user is having a conversation with the third-party intelligent assistant; wherein, the first prompt message includes an exit control, and the exit control is used to exit the conversation with the third-party intelligent assistant and resume the conversation with the primary intelligent assistant.

[0012] In this implementation manner, after introducing the third-party conversation flow into the main conversation flow, the user can be prompted through the prompt message that the current conversation is with the third-party intelligent assistant, and the user can also conveniently resume the conversation with the primary intelligent assistant through the exit control.

[0013] In a possible implementation manner, before updating the first interface, the first interface further includes a second control, and the second control is a trigger entry for a single processing by the third-party intelligent assistant. The detecting of the third-party intelligent assistant trigger event includes: detecting a second operation instruction for the second control.

[0014] In this embodiment, on the dialogue interface between the user and the main intelligent assistant, not only can a trigger entry for the user to have a long conversation with a third-party intelligent assistant be provided, but also a trigger entry for the user to have a single-round conversation with the third-party intelligent assistant can be provided. It can also be understood as invoking the third-party intelligent assistant to process a command, while the subsequent commands of the user are still processed by the main intelligent assistant. In this way, by providing different types of trigger entries related to the third-party intelligent assistant on the main dialogue interface, various different scenarios of the third-party intelligent assistant can be invoked by the user, expanding multiple usage scenarios and enhancing the user experience.

[0015] In a possible embodiment, the third-party intelligent assistant is recommended based on a preset configuration rule; wherein, the preset configuration rule includes one or more of the following rules: the highest usage frequency, the latest online time, and the shortest interval since the last use.

[0016] In this embodiment, by recommending the third-party intelligent assistant to the user on the main dialogue interface based on the preset configuration rule, it is convenient for the user to select the third-party intelligent assistant for conversation, thereby meeting more usage scenarios of the user for the intelligent assistant and enhancing the user experience.

[0017] In another possible embodiment, the detection of the third-party intelligent assistant trigger event includes: determining that the third-party intelligent assistant performs a single processing based on the dialogue content of the main dialogue flow and the capabilities of at least one alternative third-party intelligent assistant stored in advance; wherein, the capabilities of the alternative third-party intelligent assistant are used to indicate the conversations that the alternative third-party intelligent assistant can process, and the third-party intelligent assistant has the ability to process the dialogue content of the main dialogue flow.

[0018] In this embodiment, during the conversation between the user and the main intelligent assistant, through the analysis of the main dialogue flow, when it is detected that the function provided by the third-party intelligent assistant is hit, the conversation between the user and the third-party intelligent assistant can be triggered. In this way, it is convenient for the main intelligent assistant to actively invoke the third-party intelligent assistant for the user, so that more targeted services can be provided by the third-party intelligent assistant, etc.

[0019] In yet another possible embodiment, the detection of the third-party intelligent assistant trigger event includes: detecting that the user triggers the single processing by the third-party intelligent assistant through a preset method. The preset method includes, but is not limited to: invoking the third-party intelligent assistant through a preset symbol in the input box, or invoking the third-party intelligent assistant through a keyword in the voice command.

[0020] In this embodiment, the main intelligent assistant can also respond to the user's invocation of a third-party intelligent assistant, so that it can passively invoke the third-party intelligent assistant for the user. In this way, the needs of the user for various usage scenarios of intelligent assistants can be met.

[0021] Exemplarily, the preset symbol is @.

[0022] In this embodiment, the invocation of the third-party intelligent assistant is realized through a preset symbol, which enables the user to experience the usage effect of group chatting with multiple intelligent assistants in a dialog box interface. In this way, it is convenient for the user to invoke different intelligent assistants to answer questions or provide services, etc.

[0023] In a possible implementation manner, the third-party conversation flow includes: a user command based on the second control and the answer content of the third-party intelligent assistant to the user command; in the updated first interface, a first control is associated with the answer content, and the first control is a trigger entry for having a conversation with the third-party intelligent assistant. The method further includes: in response to a third operation instruction for the first control included in the updated first interface, changing from being processed once by the third-party intelligent assistant to having a conversation with the third-party intelligent assistant.

[0024] In this embodiment, in various scenarios of single invocation of the third-party intelligent assistant, while the electronic device displays the answer from the third-party intelligent assistant, it can also provide the user with a trigger entry for switching to a multi-round conversation with the third-party intelligent assistant, so as to meet the requirements of the user for various usage scenarios of the third-party intelligent assistant and expand the usage scenarios of the intelligent assistant on the electronic device.

[0025] In a possible implementation manner, the updated first interface further includes a third control for displaying multiple third-party intelligent assistants. The method further includes: in response to a fourth operation instruction for the third control, displaying a second interface; the second interface includes multiple third-party intelligent assistants; in response to a selection operation for another third-party intelligent assistant included in the second interface, displaying a third interface; wherein, the third interface includes the main conversation flow, the third-party conversation flow, and another third-party conversation flow between the user and the other third-party intelligent assistant.

[0026] In this embodiment, a quick switching function for conversations between multiple different third-party intelligent assistants can also be provided to the user, so as to meet the user's usage requirements for conversations with different third-party intelligent assistants. In this way, a function can be provided to the user to conveniently switch conversations between the main intelligent assistant and multiple third-party intelligent assistants based on a single dialog box, enabling the user to obtain a usage experience of "group chatting" with multiple different intelligent assistants.

[0027] In a possible embodiment, the third control is a drop-down control in the first prompt message, and the first prompt message is used to indicate that the user is having a conversation with the third-party intelligent assistant; alternatively, the third control is a navigation bar control.

[0028] In this embodiment, in small-screen electronic devices such as mobile phones, different third-party intelligent assistants can be switched by means of a drop-down control, and the occlusion of the original conversation interface can also be reduced. In large-screen electronic devices such as foldable mobile phones, the navigation bar can be used to trigger the display of multiple switchable intelligent assistants and the original conversation interface in a split-screen form, which is convenient for the user to handle the coherence of tasks.

[0029] In another possible embodiment, the third interface further includes a second prompt message; wherein, the second prompt message is used to indicate that the user is having a conversation with the other third-party intelligent assistant and is also used to indicate the task execution status of the third-party intelligent assistant.

[0030] In this embodiment, by dynamically displaying the task execution status of the third-party intelligent assistant, it is convenient for the user to timely obtain the task execution situation of the third-party intelligent assistant, thereby ensuring the monitoring of the tasks of the third-party intelligent assistant.

[0031] In a possible embodiment, the method further includes: in response to a fifth operation instruction for the task execution status of the third-party intelligent assistant, jumping to the conversation content associated with the task in the third-party conversation flow.

[0032] In this embodiment, based on the dynamic display of the task execution status of the third-party intelligent assistant, it can also be associated with the corresponding conversation record, so that by operating on the task execution status, the user can go back to the corresponding conversation record, which is convenient for the user to view the historical conversation record. In this way, the function of the intelligent assistant scenario can be extended.

[0033] In a possible embodiment, the method further includes: when it is detected that there is a third-party intelligent assistant performing a background task, the task execution status of the third-party intelligent assistant performing the background task is displayed through a third prompt message on any intelligent assistant interface.

[0034] In this embodiment, by dynamically displaying the task execution status of a third-party intelligent assistant that is executing tasks in the background on the display interface of any intelligent assistant, it is convenient for the user to monitor the execution of multiple tasks in a scenario where multiple tasks are issued in a timely manner.

[0035] In a possible implementation manner, the main intelligent assistant is provided by the operating system of the electronic device, and the third-party intelligent assistant is provided by a third application provider.

[0036] In this embodiment, through the method provided by the embodiments of the present application, the main intelligent assistant provided by the operating system can actively or in response to a user operation, call one or more third-party intelligent assistants, thereby expanding more functions and scenarios when the user uses the intelligent assistant, and through the main intelligent assistant and one or more third-party intelligent assistants, the efficiency of the user in the process of using the intelligent assistant can be improved and more accurate answers or more professional and detailed services can be obtained.

[0037] In a second aspect, the present application provides an electronic device, which includes a plurality of functional modules; the plurality of functional modules interact with each other to implement the method executed by the electronic device in the first aspect and its various embodiments above. The plurality of functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules can be arbitrarily combined or divided based on specific implementations.

[0038] In a third aspect, the present application provides an electronic device, including at least one processor and at least one memory, and computer program instructions are stored in the at least one memory. When the electronic device runs, the at least one processor executes the method executed by the electronic device in the first aspect and its various embodiments above.

[0039] In a fourth aspect, the present application further provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a computer, the computer is caused to execute the method executed by the electronic device in the first aspect and its various possible embodiments above.

[0040] In a fifth aspect, the present application provides a computer program product, which includes: a computer program (which can also be referred to as code or instructions). When the computer program is run, the computer is caused to execute the method of the electronic device in the first aspect and its various possible embodiments above.

[0041] Sixth aspect, an embodiment of the present application further provides a graphical user interface on an electronic device. The electronic device has a display screen, one or more memories, and one or more processors. The one or more processors are configured to execute one or more computer programs stored in the one or more memories. The graphical user interface includes the graphical user interface displayed when the electronic device executes the first aspect and its various possible embodiments as described above.

[0042] Seventh aspect, the present application further provides a chip. The chip is configured to read a computer program stored in a memory and execute the method executed by the electronic device in the first aspect and its various possible embodiments as described above.

[0043] Eighth aspect, the present application further provides a chip system. The chip system includes a processor configured to support a computer device to implement the method executed by the electronic device in the first aspect and its various possible embodiments as described above. In a possible embodiment, the chip system further includes a memory configured to store necessary programs and data for the computer device. The chip system may be composed of chips or may include chips and other discrete devices.

[0044] For the beneficial effects of any one of the second aspect to the eighth aspect and its possible embodiments, please specifically refer to the beneficial effects of various possible embodiments in the first aspect as described above, which will not be elaborated herein. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 It is a schematic diagram of the interface of a smart assistant;

[0046] Figure 2 It is a schematic diagram of the hardware structure of a possible electronic device provided by an embodiment of the present application;

[0047] Figure 3 It is a block diagram of the software architecture of an electronic device provided by an embodiment of the present application;

[0048] Figure 4 It is one of the schematic diagrams of the display interface of the smart assistant provided by an embodiment of the present application;

[0049] Figure 5 It is another schematic diagram of the display interface of the smart assistant provided by an embodiment of the present application;

[0050] Figure 6 It is yet another schematic diagram of the display interface of the smart assistant provided by an embodiment of the present application;

[0051] Figure 7 It is still another schematic diagram of the display interface of the smart assistant provided by an embodiment of the present application;

[0052] Figure 8The fifth schematic diagram of the display interface of the intelligent assistant provided by the embodiment of the present application;

[0053] Figure 9 The sixth schematic diagram of the display interface of the intelligent assistant provided by the embodiment of the present application;

[0054] Figure 10 The seventh schematic diagram of the display interface of the intelligent assistant provided by the embodiment of the present application;

[0055] Figure 11 The eighth schematic diagram of the display interface of the intelligent assistant provided by the embodiment of the present application;

[0056] Figure 12 The flowchart of a method for displaying an intelligent assistant interface provided by the embodiment of the present application. Detailed implementation manners

[0057] Next, the embodiments of the present application will be described in detail with reference to the accompanying drawings.

[0058] The embodiments of the present application can be applied to the terminal technology field, and specifically can be applicable to electronic devices that can provide intelligent assistants. On the electronic device, the intelligent assistant can be awakened in various ways. For example, the voice wake-up method can be adopted, and the electronic device wakes up the intelligent assistant by detecting the wake-up word spoken by the user. For another example, the physical button trigger method can also be adopted, and the electronic device can wake up the intelligent assistant by detecting the operation that the user long presses the power button for 2 seconds. For still another example, the control trigger method can also be adopted, and the electronic device wakes up the intelligent assistant by detecting the click operation on the intelligent assistant application (APP) icon or the quick entry.

[0059] A possible example Figure 1 is an interface schematic diagram of an intelligent assistant. As Figure 1 shown in the interface 101, the intelligent assistant can receive the instruction of "how to improve eloquence" input by the user; then, in response to the instruction, it can provide the user with a solution interface as shown in the interface 101. It can be understood that while providing the interface 101, the intelligent assistant can also provide the solution to the user in the form of voice broadcast. In this way, the intelligent assistant can provide some information query functions to the user through the conversation with the user.

[0060] In addition to the display interface of the intelligent assistant shown in the interface 101, the intelligent assistant can also provide some system services or system functions that the operating system can provide for the user, such as functions of the operating system like scheduling, setting alarms, making calls, etc. And it can also display the execution result to the user through the interface, such as an intelligent assistant interface including prompt information such as the scheduling is completed and the alarm is set successfully.

[0061] The conversation between a user and a smart assistant is usually completed in the form of an intelligent agent (IA). Among them, the intelligent agent can also be called an "intelligent entrance", a "service entrance", or an "intelligent agent", etc., and this is not limited in the embodiments of this application. An intelligent agent refers to an entity with intelligence, which can be used to build a three-dimensional perception, global collaboration, accurate judgment, continuous evolution, and open intelligent system based on the cloud and with artificial intelligence (AI) as the core. In the field of intelligence and artificial intelligence, an intelligent agent can refer to an agent that acts in an intelligent manner, can perceive its environment, autonomously take actions to achieve goals, and can improve its performance by learning or acquiring knowledge. Therefore, in the embodiments of this application, "intelligent agent" and "smart assistant" can be used interchangeably.

[0062] In view of this, the embodiments of this application provide a method for displaying a smart assistant interface. In this method, in the conversation flow based on the first intelligent agent, the conversation flow of the second intelligent agent can be adaptively introduced through some preset methods, so that in a dialog box interface, the "group chat" effect between the user and multiple intelligent agents can be realized, and by introducing one or more second intelligent agents, the accuracy, efficiency, and intelligence of the smart assistant function (in the embodiments of this application, the smart assistant function can be understood as being jointly realized by a group of smart assistants composed of multiple intelligent agents) can be improved.

[0063] Among them, the first intelligent agent can also be understood as the main intelligent agent, that is, the intelligent agent provided by the operating system; the conversation flow of the first intelligent agent can also be understood as the main conversation flow, for example, the conversation flow between the user and the smart assistant provided by the operating system. In the embodiments of this application, the main intelligent agent can be used interchangeably with "main smart assistant", "main smart assistant", etc.

[0064] The second intelligent agent can also be understood as a third-party intelligent agent, that is, an intelligent agent developed by a third-party application provider; the conversation flow of the second intelligent agent can also be understood as a third-party conversation flow, for example, the conversation flow between the user and the smart assistant provided by a third-party service, or the conversation flow between the user and a smart assistant that is not provided by the operating system. In the embodiments of this application, the third-party intelligent agent can be used interchangeably with "third-party smart assistant", "third-party smart assistant", etc.

[0065] Among them, the preset methods will be introduced in detail in the following embodiment content and will not be elaborated here for the time being.

[0066] It should be noted that in the embodiments of this application, the number of introduced second intelligent agents is not limited, and it can be one or multiple. The specific number can be determined according to the actual situation or preset methods.

[0067] Embodiments of the present application can be applied to electronic devices that can provide intelligent assistants, such as mobile phones, PCs, tablet computers, wearable devices (e.g., watches, bracelets, etc.), in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart home devices (e.g., smart TVs, smart speakers, etc.). It can be understood that embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0068] The electronic devices to which embodiments of the present application can be applied, exemplary embodiments include but are not limited to those equipped with or other operating systems.

[0069] Figure 2 Fig. shows a schematic diagram of the hardware structure of a possible electronic device. Among them, the electronic device 200 includes: radio frequency (RF) circuit 210, power supply 220, processor 230, memory 240, input unit 250, display unit 260, audio circuit 270, communication interface 280, and wireless-fidelity (Wi-Fi) module 290 and other components. Those skilled in the art can understand that Figure 2 the hardware structure of the electronic device 200 shown in does not constitute a limitation on the electronic device 200. The electronic device 200 provided by embodiments of the present application may include more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. Figure 2 The various components shown in can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0070] The following will combine Figure 2 to specifically introduce each component of the electronic device 200:

[0071] The RF circuit 210 can be used for receiving and sending data during communication or calls. In particular, after receiving downlink data from the base station, the RF circuit 210 sends it to the processor 230 for processing; in addition, the uplink data to be sent is sent to the base station. Generally, the RF circuit 210 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc.

[0072] In addition, the RF circuit 210 can also communicate with other devices through a wireless communication network. The wireless communication can use any communication standard or protocol, including but not limited to global system of mobile communication (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), long term evolution (LTE), email, short messaging service (SMS), etc.

[0073] The electronic device 200 can also implement communication services and interact with other electronic devices, so the electronic device 200 needs to have a data transmission function, that is, the electronic device 200 needs to include a communication module. Figure 2 Communication modules such as the RF circuit 210, the Wi-Fi module 290, and the communication interface 280 are shown, but it is understandable that at least one of the above components or other communication modules (such as a Bluetooth module) for implementing communication exist in the electronic device 200 to perform data transmission.

[0074] Wi-Fi technology is a short-range wireless transmission technology. The electronic device 200 can connect to an access point (AP) through the Wi-Fi module 290 to access the data network. The Wi-Fi module 290 can be used for receiving and sending data during the communication process.

[0075] The electronic device 200 can be physically connected to other devices through the communication interface 280. Optionally, the communication interface 280 is connected to the communication interface of the other device through a cable to achieve data transmission between the electronic device 200 and the other device.

[0076] The memory 240 can be used to store software programs and modules. The processor 230 executes various functional applications and data processing of the electronic device 200 by running the software programs and modules stored in the memory 240. Optionally, the memory 240 may mainly include a program storage area and a data storage area. Among them, the program storage area can store an operating system (mainly including software programs or modules corresponding to the kernel layer, system layer, application framework layer, application layer, etc.).

[0077] In addition, the memory 240 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices. In the embodiments of the present application, the memory 240 can store computer program instructions for implementing the intelligent assistant interface display method provided in the embodiments of the present application, etc. For example, it can store some third-party agents, and can also store the goals and decision-making capabilities of different third-party agents. In this way, through the stored third-party agents and their related capabilities, the third-party agents can be adaptively introduced during the process of the user's conversation with the main agent.

[0078] The input unit 250 can be used to receive editing operations of various different types of data objects such as digital or character information input by the user, and generate key signal inputs related to the user settings and function controls of the electronic device 200. Optionally, the input unit 250 may include a touch panel 251 and other input devices 252. Among them, the touch panel 251, also known as a touch screen, can collect touch operations of the user on or near it (such as operations of the user using a finger, a stylus, or any suitable object or accessory on or near the touch panel 251), and drive the corresponding connection device according to a pre-set program. In some possible embodiments, the touch panel 251 can collect the typing operations of the user on the conversation interface of the intelligent assistant, such as the operation of the user typing conversation instructions through a keyboard on the conversation interface.

[0079] Optionally, the other input devices 252 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, power-on keys, etc.), a trackball, a mouse, a joystick, etc. For example, when the electronic device 200 is a laptop computer, the other input devices 252 can be a mouse and / or a keyboard.

[0080] The display unit 260 can be used to display information input by the user or information provided to the user, as well as various menus of the electronic device 200. The display unit 260 is the display system of the electronic device 200, which is used to present an interface and realize human-computer interaction. The display unit 260 may include a display panel 261. Optionally, the display panel 261 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. In the embodiments of the present application, the display unit 260 can be used to display a dialogue interface of a smart assistant for the user. Exemplarily, on the dialogue interface with the main smart assistant, the user can, through some trigger entrances, display or recommend a third-party smart assistant to the user, so that the dialogue flow based on the main agent can introduce the dialogue of the third-party agent, thereby improving the processing accuracy, efficiency, and intelligence of the smart scenario, etc.

[0081] The processor 230 is the center that controls the electronic device 200. It connects various components through various interfaces and circuits, runs or executes software programs and / or modules stored in the memory 240, and calls data stored in the memory 240 to execute various functions of the electronic device 200 and process data, thereby implementing various services based on the electronic device 200. In the embodiments of the present application, the processor 230 can be used to implement the smart assistant interface display method provided in the embodiments of the present application.

[0082] The electronic device 200 further includes a power supply 220 (such as a battery) for powering each component. Optionally, the power supply 220 can be logically connected to the processor 230 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption through the power management system.

[0083] As Figure 2 shown, the electronic device 200 further includes an audio circuit 270, a microphone 271, and a speaker 272, which can provide an audio interface between the user and the electronic device 200. The audio circuit 270 can be used to convert audio data into a signal that the speaker 272 can recognize, and transmit the signal to the speaker 272, which converts it into a sound signal for output. The microphone 271 is used to collect external sound signals (such as the sound of a person speaking, or other sounds, etc.), and convert the collected external sound signals into a signal that the audio circuit 270 can recognize, and send it to the audio circuit 270. The audio circuit 270 can also be used to convert the signal sent by the microphone 271 into audio data, and then output the audio data to the RF circuit 210 to be sent to, for example, another electronic device, or output the audio data to the memory 240 for further processing later.

[0084] Although not shown, the electronic device 200 may further include a camera, at least one sensor, etc., which will not be elaborated here. The at least one sensor may include, but is not limited to, a pressure sensor, a barometric pressure sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a touch sensor, a temperature sensor, etc.

[0085] The operating system (OS) involved in the embodiments of this application is the most basic system software running on the electronic device 200. The software system of the electronic device 200 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of this application, taking the operating system with a layered architecture as an example, the software system architecture of the electronic device 200 will be exemplarily described.

[0086] Figure 3 It is a block diagram of the software system architecture of an electronic device provided by the embodiments of this application. As Figure 3 shown, the software system architecture of the electronic device may be a layered architecture. For example, the software can be divided into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into five layers, from top to bottom, namely the application layer, the application framework layer (FWK), the runtime and system libraries, the kernel layer, and the hardware layer.

[0087] The application layer may include a series of application packages. As Figure 3 shown, the application layer may include a camera, settings, a skin module, a user interface (UI), a smart assistant, third-party applications, etc. Among them, the third-party applications may include a wireless local area network (WLAN), music, calls, Bluetooth, video, a memo, etc.

[0088] In the embodiments of this application, the application layer may be used to implement the presentation of the smart assistant interface. The above-mentioned smart assistant interface may be implemented for display based on the content introduced in the following embodiments.

[0089] In a possible implementation, the application may be developed using the Java language and completed by calling the application programming interface (API) provided by the application framework layer. Developers can interact with the underlying layers of the operating system (such as the hardware layer, the kernel layer, etc.) through the application framework layer to develop their own applications. The application framework layer is mainly a series of services and management systems of the operating system.

[0090] The application framework layer provides application programming interfaces and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions. For example, Figure 3 as shown, the application framework layer may include an activity manager, a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc.

[0091] The activity manager is used to manage the life cycles of various applications and provide common navigation and back functions, and provide an interactive interface for the windows of all programs.

[0092] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, dialed and answered calls, browsing history and bookmarks, phone books, etc.

[0093] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures.

[0094] The phone manager is used to provide the communication function of the electronic device. For example, the management of call states (including connection, hanging up, etc.).

[0095] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0096] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of a download, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of a background-running application, and can also be a notification that appears on the screen in the form of a dialogue window. For example, prompting text information in the status bar, emitting a prompt tone, vibrating the electronic device, flashing the indicator light, etc.

[0097] The runtime includes a core library and a virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0098] The core library consists of two parts: one part is the functional functions that the Java language needs to call, and the other part is the core library of the operating system. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to manage the object life cycle, stack management, thread management, security and exception management, as well as garbage collection and other functions.

[0099] The system library can include multiple functional modules. For example: surface manager, media framework, 3D graphics processing library (such as: OpenGL ES), 2D graphics engine (such as: SGL), etc.

[0100] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.

[0101] The media framework supports the playback and recording of various common audio and video formats, as well as static image files, etc. The media framework can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0102] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0103] The 2D graphics engine is a drawing engine for 2D drawing.

[0104] In some embodiments, the 3D graphics processing library can be used to draw 3D motion trajectory images, and the 2D graphics engine can be used to draw 2D motion trajectory images.

[0105] The kernel layer is the layer between the hardware and the software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.

[0106] The hardware layer can include various sensors, such as an acceleration sensor, a gravity sensor, a touch sensor, etc.

[0107] Generally, the electronic device 200 can run multiple applications simultaneously. More simply, one application can correspond to one process, and more complexly, one application can correspond to multiple processes. Each process has a process number (process ID).

[0108] It should be understood that in the embodiments of the present application, "at least one (item)" or its similar expressions refer to any combination of these items, including any combination of single item or plural items. For example, at least one (item) of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple. "Multiple" means two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the front and back associated objects.

[0109] In addition, it should be understood that in the description of the present application, terms such as "first" and "second" are only used for the purpose of distinguishing descriptions, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0110] It should be understood that the hardware structure of the electronic device can be as Figure 2 shown, and the software system architecture can be as Figure 3 shown. Among them, the software programs and / or modules corresponding to the software system architecture in the electronic device can be stored in the memory 240, and the processor 230 can run the software programs and applications stored in the memory 240 to execute the process of a method for displaying a smart assistant interface provided in the embodiments of the present application.

[0111] To facilitate the understanding of the method for displaying a smart assistant interface provided in the present application, the implementation process of the method provided in the present application will be introduced below in combination with Figures 4 to 11 the content shown.

[0112] The method provided in the embodiments of the present application can be applied to electronic devices such as mobile phones or tablet computers, and specifically can be applied to scenarios where a smart assistant is provided on the electronic device. Among them, on the electronic device, generally, the smart assistant provided by the operating system can be triggered by means such as voice wake-up, physical button wake-up, virtual control wake-up, etc. In the following embodiments, the electronic device 200 is taken as a mobile phone as an example. First, the interface processing effects that can be achieved by the method provided in the embodiments of the present application will be introduced through various possible scenarios. It can be understood that in specific implementation, the present application is not limited to the scenarios introduced below.

[0113] Combined with Figure 1 shown in the interface 101, on the basis of the electronic device displaying the dialogue interface of the main smart assistant, one or more third-party smart assistants can be introduced through various triggering methods. The following introduces three triggering methods through Scenario A1 to Scenario A3. It should be understood that the triggering methods introduced below are not limited in the embodiments of the present application.

[0114] Scenario A1: Trigger the recommendation of a third-party intelligent assistant through the dynamic configuration of dialogue instructions (chips).

[0115] Figure 4 This is a schematic diagram of a display interface for the intelligent assistant provided in the embodiments of the present application. As shown in interface 400A1 in Figure 4 it is the dialogue interface between the user and the main intelligent assistant. Among them, interface 400A1 may include but is not limited to the following basic contents: the name of the main intelligent assistant, which may be, for example, "Xiaoyi"; the avatar 401 of the main intelligent assistant; the command 402 issued by the user to the main intelligent assistant, which may be, for example, "How to write sentences describing spring"; the answer 403 of the main intelligent assistant in response to the user's command. In interface 400A1, it may also include but is not limited to: keyboard controls, voice controls, new controls, etc., for implementing conversations with the main intelligent assistant or the introduced third-party intelligent assistant in multiple ways.

[0116] In the embodiments of the present application, based on the dialogue interface between the user and the main intelligent assistant, a third-party intelligent assistant can be recommended to the user, such as the weather steward 404 shown in interface 400A1. As shown in interface 400A1, when displaying the third-party intelligent assistant, not only the name of the third-party intelligent assistant can be displayed, but also the avatar of the third-party intelligent assistant can be displayed.

[0117] Exemplarily, in interface 400A1, the mobile phone can display interface 400B in response to operations such as clicking on the weather steward 404.

[0118] In interface 400B, based on the dialogue window between the user and the main intelligent assistant, a conversation with the third-party intelligent assistant can be realized. Exemplarily, in interface 400B, a floating bar 406 can be displayed; among them, the floating bar 406 can be used to prompt the user that they are having a conversation with the third-party intelligent assistant. For example, the floating bar 406 may include the name and avatar of the third-party intelligent assistant, such as "weather steward" and its avatar; it may also include an "exit" control, and the "exit" control can be used for the user to exit the conversation with the third-party intelligent assistant and resume the conversation with the main intelligent assistant. It should be noted that although Figure 4 and in the subsequent drawings, the prompt information indicating that the user is having a conversation with the third-party intelligent assistant is displayed in the form of a floating bar, in specific implementations, the specific form of the prompt information is not limited, for example, other forms such as a floating ball can also be used to prompt the user, etc.

[0119] Another exemplary case is that in interface 400B, the main dialogue flow 407 and the third-party dialogue flow 408 can be displayed. Among them, before the third-party dialogue flow 408 is displayed, the user can be prompted through prompt text that the current intelligent assistant is switched from "Xiaoyi" to the "Weather Butler" assistant. It can be seen from interface 400B that interface 400B is the updated interface 400A1. It can also be understood that in the dialogue interface shown in interface 400A1, the dialogue content with the "Weather Butler" assistant is updated, and no other dialogue interface is switched to. Through the method provided by the embodiments of the present application, it can be realized that in a dialog box, not only can the user communicate with the main intelligent assistant, but also the user can communicate with the third-party intelligent assistant. In this way, based on the main dialogue flow, the third-party dialogue flow can be triggered through the dynamic configuration of chips, so that it can be realized that the main intelligent assistant combines with the third-party intelligent assistant to answer questions or provide services for users more efficiently and accurately, etc.

[0120] In addition, in interface 400A1, there can also be some questions related to the third-party intelligent assistant, such as "What's the weather like today?" 405A, "Recent weather" 405B, etc. Another exemplary case is that the mobile phone can also respond to operations such as clicking on "What's the weather like today?" 405A or "Recent weather" 405B, and the Weather Butler 404 can provide a single answer; optionally, the content of the single answer of the Weather Butler 404 can be displayed in the dialogue interface between the user and the main intelligent assistant. For example, in interface 400A2, the mobile phone can respond to operations such as clicking on "What's the weather like today?" 405A and display interface 400C; among them, in interface 400C, the answer 409 of the Weather Butler to the command "What's the weather like today?" can be displayed. Combining interface 400B and interface 400C, it can be seen that when interface 400B triggers the multi-round dialogue process between the user and the Weather Butler, it can be understood that subsequent commands from the user are also processed by the Weather Butler, while interface 400C is only the answer of the Weather Butler to the user's current command, and it can be understood that subsequent commands from the user are still processed by Xiaoyi. In addition, near the display area of the single answer of the Weather Butler 404, the trigger entry 410 of the Weather Butler assistant can also be associated and displayed. Through the trigger entry 410, the single answer of the Weather Butler 404 can also be changed to a multi-round dialogue of the Weather Butler 404.

[0121] It should be noted that although a third-party intelligent assistant is recommended in the interface 400A1, the number of third-party intelligent assistants that can be recommended in the embodiments of the present application is not limited and can be determined according to dynamically configured rules. For example, when the mobile phone detects that there are multiple third-party intelligent assistants that meet the dynamically configured rules, multiple third-party intelligent assistants can be directly displayed on the dialogue interface between the user and the primary intelligent assistant, or multiple third-party intelligent assistants that cannot be directly displayed can be viewed by means of left and right sliding operations, etc.

[0122] In this scenario, the dynamic configuration through chips can include but is not limited to the following configuration rules: the hottest third-party intelligent assistant, the newly launched third-party intelligent assistant, the third-party intelligent assistant with the highest historical query times, the third-party intelligent assistant most likely to be viewed, etc. Among them, as shown in the interface 400A1, at 8:00 in the morning, based on the dynamic configuration rules, the third-party intelligent assistant most likely to be viewed at this time is the Weather Butler Assistant, so the Weather Butler 404 is recommended in the interface 400A1.

[0123] Scenario A2, Hit by dialogue

[0124] Figure 5 This is another schematic diagram of the display interface of the intelligent assistant provided by the embodiments of the present application. As Figure 5 shown in the interface 500A, it is the dialogue interface between the user and the primary intelligent assistant. Similar to the interface 400A1, the interface 500A may include but is not limited to the following basic contents: the name of the primary intelligent assistant, such as "Xiaoyi"; the avatar 501 of the primary intelligent assistant; the command 502 issued by the user to the primary intelligent assistant, such as "What's the weather like today?". It can be understood that in the interface 500A, keyboard controls, voice controls, new controls, etc. may also be included to implement conversations with the primary intelligent assistant or the introduced third-party intelligent assistant in multiple ways.

[0125] In the interface 500A, the mobile phone can display the interface 500B in response to the command 502. The difference between the interface 500B and the interface 400A1 is that when the primary intelligent assistant can determine, according to the conversation with the user and the pre-stored third-party intelligent assistants and their corresponding functions, that a third-party intelligent assistant (Weather Butler) can provide a more accurate, more detailed, and more professional answer, a display box 503 can be provided in the dialogue interface between the primary intelligent assistant and the user for the answer; the answer in the display box 503 is answered by the Weather Butler. In this way, the operating system can actively introduce a third-party intelligent assistant according to the conversation content, so as to realize that the primary intelligent assistant combines with the third-party intelligent assistant to answer questions or provide services for the user more efficiently and accurately.

[0126] Moreover, in this scenario, a trigger entry 504 for multiple-round conversations with the Weather Butler can also be provided to the user. As shown in interface 500B, when displaying the trigger entry of the Weather Butler, not only the name of the Weather Butler can be displayed, but also the avatar of the Weather Butler can be shown, so as to prompt the user that the trigger entry 504 is used to indicate a third-party intelligent assistant. Exemplarily, the mobile phone can display interface 500C in response to operations such as clicking on the trigger entry 504 of the Weather Butler.

[0127] In interface 500C, based on the conversation window between the user and the main intelligent assistant, multiple-round conversations with the Weather Butler can be realized. Exemplarily, in interface 500C, a floating bar 505 can be displayed; among them, the floating bar 505 can be used to prompt the user that they are having a conversation with the Weather Butler. For example, the floating bar 506 can include the name and avatar of the Weather Butler; it can also include an "Exit" control, and the "Exit" control can be used for the user to exit the conversation with the Weather Butler and resume the conversation with Xiaoyi.

[0128] Another exemplarily, in interface 500C, a main conversation flow 506 and a third-party conversation flow 507 can be displayed. Among them, before displaying the third-party conversation flow 507, the user can be prompted by prompt text that the current intelligent assistant is switched from "Xiaoyi" to the "Weather Butler". As shown in the third-party conversation flow 507 shown in interface 500C, the subsequent conversations of the user can be answered by the Weather Butler assistant. It can also be understood that when the mobile phone detects operations such as clicking on the exit control in the floating bar 505, the conversation between the user and Xiaoyi can be resumed.

[0129] It should be noted that in interface 500B, the example of the conversation hitting the Weather Butler assistant is taken. It can be understood that when the user's command is other commands, other third-party intelligent assistants may be hit. For example, when the user's command is "how to cook", the third-party intelligent assistant hit at this time can be the recipe assistant. Or, in some other possible scenarios, the conversation may not hit the third-party intelligent assistant, and in this case, the main intelligent assistant will answer.

[0130] It can be seen from interface 500C that through the method provided in the embodiments of the present application, on the basis of the main conversation flow, the third-party conversation flow can be triggered by hitting the conversation command, so that it can be realized that the main intelligent assistant combines with the third-party intelligent assistant to answer questions or provide services for the user more efficiently, accurately and professionally.

[0131] Scenario A3: Single call based on preset rules

[0132] Figure 6 This is another schematic diagram of the display interface of the intelligent assistant provided by the embodiments of the present application. As Figure 6As shown in the interface 600A, it is the dialogue interface between the user and the main intelligent assistant. The interface 600A may include but is not limited to the following basic contents: the name of the main intelligent assistant, which may be "Xiaoyi" for example; the avatar 601 of the main intelligent assistant; the keyboard control 602; the voice control; the new control, etc. Exemplarily, in response to an operation such as a click on the keyboard control 602, the mobile phone can display the interface 600B.

[0133] In the interface 600B, it may include the input area of the keyboard, and this input area may include the input box 603. Optionally, the mobile phone can display a pop-up window 604 in the interface 600B in response to a trigger instruction that the user types "@" in the input box 603. Among them, the pop-up window 604 can be used to display one or more third-party intelligent assistants. Optionally, the pop-up window 604 can be used to display the third-party intelligent assistants used in the past, or the third-party intelligent assistants used within a preset historical time period, or all the third-party intelligent assistants stored by the main intelligent assistant, or the third-party intelligent assistants determined according to the historical usage frequency, etc.

[0134] It should be noted that in the embodiments of this application, there is no limitation on the preset rule for displaying the third-party assistant in the pop-up window 604, and it can be defined by itself according to needs. For example, in the pop-up window 604 shown in the interface 600B, the displayed third-party intelligent assistants may include: the weather steward assistant and the recipe assistant.

[0135] Exemplarily, in response to an operation such as a click on the weather steward assistant in the pop-up window 604, the mobile phone can display the interface 600C. In the interface 600C, in the input box 605 included in the input area of the keyboard, the mobile phone can respond to an instruction that the user types "What's the weather like today?" in the input box 605. It can be understood that in the input box 605, the word "@weather steward" is input through operations such as the "@" shown in the interface 600B and a click on the weather steward assistant in the pop-up window 604.

[0136] Optionally, in the input box 605 shown in the interface 600C, "@weather steward" can be used as the control 6051, and it can also be switched through operations such as a click to switch to other third-party intelligent assistants.

[0137] In the interface 600C, in response to a click operation on the send control 606, the mobile phone can display the interface 600D. The interface 600D still shows the dialogue interface between the user and Xiaoyi. However, since the command 6071 issued by the user includes "@Weather Butler", the answer 6072 to the command 6071 is provided by the Weather Butler assistant. It can be understood that in this scenario, the Weather Butler assistant can provide a single-round dialogue for the user. Based on this, in the interface 600D, a trigger entry 608 for a multi-round dialogue with the Weather Butler assistant can also be provided near the answer provided by the Weather Butler assistant. As shown in the interface 600D, when the trigger entry 608 for the Weather Butler is displayed, not only the name of the Weather Butler can be displayed, but also the avatar of the Weather Butler can be displayed, so as to prompt the user that the trigger entry 608 is used to indicate a third-party intelligent assistant. The function of the trigger entry 608 can refer to Figure 5 the trigger entry 504 shown in Figure 5 . Through the trigger entry 608, the user can have a multi-round dialogue with the Weather Butler.

[0138] In this scenario, through the configuration of some preset rules, a single call to a third-party intelligent assistant can be realized. For example, it can be pre-configured through the symbol "@" to enable a single call to a third-party intelligent assistant for answering, so as to enable the third-party intelligent assistant to answer questions and provide services for users more efficiently and accurately. It should be noted that in the embodiments of the present application, the method of using the symbol "@" as a single call to a third-party intelligent assistant is not limited. For example, other preset symbols such as "*" can also be used as the method of a single call to a third-party intelligent assistant.

[0139] In addition, in some other possible scenarios, a single call to a third-party intelligent assistant can also be realized through a voice command. For example, the voice command can be "Xiaoyi, help me ask the Weather Butler what the weather is like today?".

[0140] Based on the introduction of the above scenarios A1 to A3, through the method provided by the embodiments of the present application, it is possible to quickly call out a third-party intelligent assistant in the main dialogue flow, so that the third-party intelligent assistant can answer questions and provide services. In this way, through the main intelligent assistant and at least one third-party intelligent assistant, more accurate, efficient, targeted and intelligent answers and services can be provided for users on a single dialogue interface.

[0141] The above introductions of Scenarios A1 to A3 can be based on several triggering methods for the main intelligent assistant to call third-party intelligent assistants. In a scenario with multiple third-party intelligent assistants, the method provided in the embodiments of the present application can also implement switching conversations between different third-party intelligent assistants, so as to achieve the "group chat" experience for users with multiple intelligent assistants. The following introduces three conversation switching scenarios through Scenarios B1 to B3. It should be understood that the conversation switching scenarios introduced below are not limited in the embodiments of the present application.

[0142] Scenario B1: Switching conversations based on a drop-down control

[0143] Figure 7 This is another schematic diagram of the display interface of the intelligent assistant provided in the embodiments of the present application. As shown in interface 400B in Figure 4 , in the scenario where a third-party intelligent assistant (Weather Butler) is introduced during the main conversation with the main intelligent assistant (Xiaoyi), the drop-down control 4061 can be included in the floating bar 406. Exemplarily, in response to operations such as clicking on the drop-down control 4061 by the mobile phone, the display interface 700A is displayed.

[0144] Compared with the floating bar 406 shown in interface 400B, a more complete floating bar 701 can be displayed in interface 700A. Among them, the floating bar 701 can include a third-party intelligent assistant (Weather Butler) 7011 and a third-party intelligent assistant (Recipe) 7012. It should be noted that the floating bar 701 takes two third-party intelligent assistants as examples, and the embodiments of the present application do not limit the number of third-party intelligent assistants displayed in the floating bar 701.

[0145] In the floating bar 701, the mobile phone can display interface 700B in response to the selection operation of the third-party intelligent assistant (Recipe) 7012. In interface 700B, a floating bar 702 can be displayed; among them, similar to the floating bar 406 in interface 400B, the floating bar 702 can be used to prompt the user that they are having a conversation with the third-party intelligent assistant (Recipe). And in interface 700B, a third-party conversation flow 703 can also be included; among them, the third-party conversation flow 703 is used to indicate the conversation content between the user and the recipe assistant. It can be understood that before the third-party conversation flow 703, the conversation flow between the user and the weather butler assistant before switching is displayed. In this way, in a dialog box, it can include the conversation between the user and Xiaoyi, the conversation flow between the user and the weather butler assistant, and the conversation flow between the user and the recipe assistant, so as to achieve the "group chat" conversation experience for the user with multiple assistants, and can switch the conversation with different assistants in some switching ways.

[0146] Scenario B2: Switching conversations based on a navigation bar

[0147] Figure 8Another schematic diagram of the display interface of the intelligent assistant provided by the embodiments of the present application. Taking a folding screen mobile phone as an example of the electronic device, other large-screen devices such as tablet computers can refer to the scenarios introduced in Figure 8 , and the present application will not elaborate on this. Figure 8 The scenarios introduced in Figure 8 are not elaborated in the present application.

[0148] As Figure 8 shown in the interface 800A in Figure 8 , it is a scenario where a folding screen mobile phone introduces a third-party intelligent assistant (Weather Butler) during the process of having a main conversation with the main intelligent assistant (Xiaoyi). This interface can at least include a floating bar 801, and the floating bar 801 can include but is not limited to: the name of the Weather Butler, the avatar of the Weather Butler, an "Exit" control; a navigation bar control 802. Among them, similar to the floating bar 406 shown in the interface 400B in Figure 4 , the floating bar 801 can be used to prompt the user that they are having a conversation with a third-party intelligent assistant. Compared with Figure 7 , due to the relatively large screen size of the folding screen mobile phone, it is possible to consider using a navigation bar to display multiple switchable third-party assistant controls, instead of using a drop-down control form. It should be noted that although Figure 7 and Figure 8 show two different switching methods for different electronic devices, the embodiments of the present application do not limit the specific form of switching conversations of the electronic device. For example, on a mobile phone, a navigation bar can also be used to implement conversations with different third-party assistants. Figure 4 The floating bar 801 shown in the interface 400B in Figure 4 , the floating bar 801 can be used to prompt the user that they are having a conversation with a third-party intelligent assistant. Compared with Figure 7 , due to the relatively large screen size of the folding screen mobile phone, it is possible to consider using a navigation bar to display multiple switchable third-party assistant controls, instead of using a drop-down control form. It should be noted that although Figure 7 and Figure 8 show two different switching methods for different electronic devices, the embodiments of the present application do not limit the specific form of switching conversations of the electronic device. For example, on a mobile phone, a navigation bar can also be used to implement conversations with different third-party assistants. Figure 7 Figure 7 , due to the relatively large screen size of the folding screen mobile phone, it is possible to consider using a navigation bar to display multiple switchable third-party assistant controls, instead of using a drop-down control form. It should be noted that although Figure 7 and Figure 8 show two different switching methods for different electronic devices, the embodiments of the present application do not limit the specific form of switching conversations of the electronic device. For example, on a mobile phone, a navigation bar can also be used to implement conversations with different third-party assistants. Figure 7 and Figure 8 Figure 8 show two different switching methods for different electronic devices, the embodiments of the present application do not limit the specific form of switching conversations of the electronic device. For example, on a mobile phone, a navigation bar can also be used to implement conversations with different third-party assistants.

[0149] Exemplarily, in response to an operation such as a click on the navigation bar control 802 by the folding screen mobile phone, the interface 800B is displayed. In the interface 800B, a columnar form can be used to display a navigation bar area 803 and an area for displaying the original interface display content. Among them, the navigation bar area 803 can be used to display multiple intelligent assistants that the user can switch, and can include but is not limited to: the main intelligent assistant (Xiaoyi Assistant 8031), multiple third-party intelligent assistants (such as the Weather Butler Assistant 8032 and the Recipe Assistant 8033 shown in the interface 800B).

[0150] In the interface 800B, when the folding screen mobile phone responds to a selection operation on the Recipe Assistant 8033, the interface 800C can be displayed. In the interface 800C, a floating bar 804 can be displayed. Among them, similar to the floating bar 801, the floating bar 804 can be used to prompt the user that they are having a conversation with a third-party intelligent assistant; the difference from the floating bar 801 is that the floating bar 804 is used to indicate that the user is having a conversation with the Recipe Assistant. And, in the interface 800C, a third-party conversation flow 805 can also be included; among them, the third-party conversation flow 805 is used to indicate the conversation content between the user and the Recipe Assistant.

[0151] Through scenarios B1 and B2, it is possible to quickly switch conversations with different third-party intelligent assistants in a single conversation flow. Thus, during the process of conversing with the main intelligent assistant or a third-party intelligent assistant, by introducing more third-party intelligent assistants, more efficient, intelligent, targeted, and accurate information queries can be achieved, as well as more comprehensive services can be provided.

[0152] Scenario B3: Through preset rules, the conversation can be switched once.

[0153] Figure 9 This is another schematic diagram of the display interface of the intelligent assistant provided by the embodiment of the present application. As shown in interface 900A in Figure 9 , it is a scenario where a third-party intelligent assistant (Weather Butler) is introduced during the process of having a main conversation with the main intelligent assistant (Xiaoyi). In interface 900A, it can at least include the third-party conversation flow between the user and the Weather Butler, and can also include a keyboard control 901, a voice control, a new control, etc.

[0154] Exemplarily, when the mobile phone responds to a click operation on the keyboard control 901, interface 900B can be displayed; among them, interface 900B can include an input area of the keyboard, and this input area can include an input box 902. Similar to the interface 600B in Figure 6 , the mobile phone can respond to a trigger instruction entered by the user with "@" in the input box 902, and display a pop-up window 903 in interface 900B. Optionally, the third-party intelligent assistants included in the pop-up window 903 can include: Today's Outfit Assistant 903. Optionally, the third-party intelligent assistants shown in the pop-up window 903 can be determined based on the conversation content with the Weather Butler. Another option is that the third-party intelligent assistants shown in the pop-up window 903 can also be determined based on preset rules (such as the hottest, the latest, the highest historical usage times).

[0155] The mobile phone can respond to click operations on the Today's Outfit Assistant 903 included in the pop-up window 903, etc., and display interface 900C. In interface 900C, the instruction "Help me match short clothes and pants with @Today's Outfit" entered by the user can be displayed in the input box 904 of the keyboard. Then, when the mobile phone responds to a click operation on the send control 905, interface 900D can be displayed. Among them, in interface 900D, it is indicated that during the process of the user conversing with the Weather Butler, a single conversation with other third-party intelligent assistants can be achieved through the "@" method. In addition, in interface 900D, in addition to displaying the answer provided by the Today's Outfit Assistant, it can also include a trigger entry 906 for the user to have multiple rounds of conversations with the Today's Outfit Assistant. For the specific introduction content of the trigger entry 906, reference can be made to the trigger entry 608 introduced in Figure 6 , which will not be elaborated here.

[0156] In this scenario, during the process of having a conversation with a third-party intelligent assistant, different third-party intelligent assistants can also be quickly introduced individually through preset rules (such as the @ method), so as to achieve the user experience of "group chat" conversations between the user and more intelligent assistants.

[0157] Based on the introduction of Scenarios B1 to B3, in the scenario of switching between multiple third-party intelligent assistants, considering that there may be tasks being executed by the third-party intelligent assistant before the switch, after switching to another third-party intelligent assistant, it is also possible to dynamically display the tasks of the original third-party intelligent assistant, so as to facilitate the user to monitor the execution tasks of multiple third-party intelligent assistants simultaneously.

[0158] Scenario C: Dynamically display the tasks in progress

[0159] Figure 10 This is another schematic diagram of the display interface of the intelligent assistant provided by the embodiment of the present application. As Figure 10 shown in Interface 1000A in it, it is a scenario where a third-party intelligent assistant (Weather Butler) is introduced during the main conversation with the main intelligent assistant (Xiaoyi). Among them, in the third-party conversation flow between the user and the Weather Butler, it may include the instruction "Real-time monitor the rain status" issued by the user. It can be understood that this instruction can be regarded as a continuous task with a certain long duration.

[0160] Exemplarily, when the mobile phone responds to the click operation on the drop-down control included in the floating bar of Interface 1000A, Interface 1000B can be displayed. In Interface 1000B, when the mobile phone responds to the selection operation on the Recipe Assistant, Interface 1000C1 or Interface 1000C2 can be displayed.

[0161] In Interface 1000C1, the floating bar 1001 and the floating bar 1002 can be displayed side by side. Among them, the floating bar 1001 is used to indicate the tasks in progress of the Weather Butler Assistant. It can be understood that the Weather Butler Assistant is running in the background and timely displays the brief information of the task situation to the user through the floating bar 1001. The floating bar 1002 is used to indicate that the user is having a conversation with the Recipe Assistant. Based on this, the third-party conversation flow 1003 between the user and the Recipe Assistant can also be included in Interface 1000C1. In this way, by the way of displaying multiple floating bars side by side on the interface, it is convenient for the user to obtain the task execution status of multiple third-party intelligent assistants in a timely manner.

[0162] In the interface 1000C2, a floating bar 1004 can be displayed. Among them, the floating bar 1004 can be used to display multiple prompt messages in a folded manner, and the brief information of the task status of the weather steward assistant can be displayed at the forefront. Exemplarily, in response to a click operation on the drop-down control included in the floating bar 1004, the mobile phone can display the interface 1000D. In the interface 1000D, a more complete floating bar 1005 can be displayed; among them, the floating bar 1005 can not only include the prompt message 10051 of the brief information of the task status of the weather steward assistant, but also include the prompt message that the user is having a conversation with the recipe assistant. In this way, by displaying the task execution status of multiple third-party intelligent assistants in a folded form in a single floating bar, the occlusion of the current interface can be reduced, and the user can conveniently obtain the task execution status of multiple third-party intelligent assistants through operations such as clicking on the drop-down control. And in the floating bar, the task execution status with the highest priority can be displayed according to the priorities of multiple task execution statuses; among them, the task priority can be determined by, but not limited to, the following information: task has an update, important task, etc.

[0163] In addition, in the interface 1000D, the mobile phone can display the interface 1000E in response to operations such as clicking on the prompt message 10051 included in the floating bar 1005. Among them, the interface 1000E is used to indicate a jump back to the conversation content corresponding to the task of the weather steward assistant, that is, the conversation content 1006. In this way, it is convenient for the user to view the conversation content with different third-party intelligent assistants.

[0164] In addition, as can be seen from the interface 1000D and the interface 1000E, the task status of the weather steward assistant can also be refreshed to provide the user with real-time task status. For example, the weather steward monitors at 8:00 that "it is expected to rain in 1 hour", monitors at 8:30 that "it is expected to rain in half an hour", and synchronizes and displays the monitoring results in real time.

[0165] From the introduction content of this scenario, it can be seen that the method provided by the embodiment of the present application can dynamically display the tasks of multiple ongoing third-party intelligent assistants. Among them, the tasks of the third-party intelligent assistants can include, but are not limited to: having a conversation with the third-party intelligent assistant, tasks being executed by the third-party intelligent assistant (such as the ticket-purchasing assistant's ongoing ticket-purchasing task, etc.).

[0166] Figure 11 This is another schematic diagram of the display interface of the intelligent assistant provided by the embodiment of the present application. As Figure 11As shown in the interface 1100, it is a new dialogue interface for the user to evoke the main intelligent assistant. It can be seen from the interface 1100 that when the mobile phone detects that there is a task being executed by a third-party intelligent assistant in the background, it can display a brief information of the task situation on the new dialogue interface through the floating bar 1101. In the interface 1100, the mobile phone can also respond to operations such as clicking on the floating bar 1101 to display the interface 1000E, so as to facilitate viewing the display position of the historical conversation record. Among them, referring to Figure 10 the introduction of the interface 1000E, through the processing of this scenario, it can jump back to the conversation content corresponding to the task of the weather steward assistant, and the specific implementation will not be elaborated here.

[0167] Based on the foregoing content that illustrates the interface processing effect that can be achieved by using the method provided in the embodiments of the present application, the following introduces the implementation process of the intelligent assistant interface display method provided by the present application, so as to illustrate how to achieve the Figures 4 to 11 interface processing effect shown above, which can help improve the functional accuracy and intelligence of the intelligent assistant through the main intelligent assistant and at least one third-party intelligent assistant.

[0168] Referring to Figure 12 , it is a schematic flowchart of an intelligent assistant interface display method provided by a possible embodiment of the present application. This method can be applied to an electronic device. Taking the electronic device as a mobile phone as an example, it can include the following processes:

[0169] Step 1201: Display a first interface, where the first interface includes the main conversation flow between the user and the main intelligent assistant.

[0170] Exemplarily, the first interface can be, for example, Figure 4 the interface 400A1 or interface 400A2 in Figure 5 the interface 500A in Figure 6 the interface 600A in

[0171] Step 1202: In the first interface, detect a third-party intelligent assistant trigger event; where the third-party intelligent assistant trigger event is used to indicate triggering a conversation with the third-party intelligent assistant.

[0172] Exemplarily, the third-party intelligent assistant trigger event can include but is not limited to: such as Figure 4 the click operation on the weather steward 404 in the interface 400A1 in Figure 5 or the click operation on "What's the weather like today" 405A in the interface 400A2; or such as Figure 6The trigger instruction such as typing "@" in the input box 603 as shown in the interface 600B. The third-party intelligent assistant can be, for example, the weather steward assistant, recipe assistant, today's outfit assistant, etc. introduced above. This application does not limit the third-party intelligent assistant.

[0173] In addition, the trigger events of the third-party intelligent assistant include two trigger results. One trigger result is that the user has a long conversation with the third-party intelligent assistant, which can also be understood as having multiple rounds of conversations. For example, Figure 4 as shown in the interface 400B; the other trigger result is that the user has a single-round conversation with the third-party intelligent assistant, which can also be understood as a single processing by the third-party intelligent assistant. For example, Figure 4 as shown in the interface 400C. When specifically implemented, according to different detected trigger events, the corresponding trigger results can be determined. In addition, it can be understood that when the third-party intelligent assistant provides the result of single processing, it can also provide a trigger entry that can be switched to a long conversation. For example, Figure 4 the trigger entry 410 in the interface 400C, and for another example, Figure 5 the trigger entry 504 in the interface 500B, or for another example, Figure 6 the trigger entry 608 in the interface 600D.

[0174] Step 1203, in response to the trigger event of the third-party intelligent assistant, update the first interface; wherein, the updated first interface includes the main conversation flow and the third-party conversation flow between the user and the third-party intelligent assistant.

[0175] Exemplarily, the updated first interface can be, for example, Figure 4 the interface 400B or interface 400C, and for another example, Figure 5 the interface 500B, or for another example, it can also be Figure 6 the interface 600D.

[0176] It should be noted that Figure 12 For the method for displaying the intelligent assistant interface shown in this application, reference can be made to the above embodiments of this application in specific implementation, and repeated parts will not be elaborated.

[0177] Based on the above embodiments, this application also provides an electronic device, which includes multiple functional modules; the multiple functional modules interact with each other to implement the functions performed by the electronic device in each method described in the embodiments of this application. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementation. Such as executing Figure 12 the steps 1201 to 1203 executed by the electronic device in the embodiments shown.

[0178] Based on the above embodiments, the present application further provides an electronic device, which includes at least one processor and at least one memory. Computer program instructions are stored in the at least one memory. When the electronic device runs, the at least one processor executes the functions performed by the electronic device in the various methods described in the embodiments of the present application. For example, it executes Figure 12 Steps 1201 to 1203 performed by the electronic device in the illustrated embodiment.

[0179] Based on the above embodiments, the present application further provides a computer program product, which includes: a computer program (which may also be referred to as code or instructions). When the computer program runs, it causes the computer to execute the various methods described in the embodiments of the present application.

[0180] Based on the above embodiments, the present application further provides a computer-readable storage medium. A computer program is stored in the computer-readable storage medium. When the computer program is executed by a computer, it causes the computer to execute the various methods described in the embodiments of the present application.

[0181] Based on the above embodiments, the present application further provides a chip, which is used to read the computer program stored in the memory and implement the various methods described in the embodiments of the present application.

[0182] Based on the above embodiments, the present application provides a chip system, which includes a processor and is used to support a computer device to implement the various methods described in the embodiments of the present application. In a possible design, the chip system further includes a memory, and the memory is used to store the necessary programs and data of the computer device. The chip system can be composed of chips or can include chips and other discrete devices. Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memories, CD-ROMs, optical memories, etc.) containing computer-usable program codes.

[0183] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, as well as the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate for implementation in the processFigure 1 means for a process or processes and / or blocks Figure 1 specified in one block or blocks.

[0184] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the process Figure 1 for a process or processes and / or blocks Figure 1 specified in one block or blocks.

[0185] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable apparatus provide steps for implementing the function specified in the process Figure 1 for a process or processes and / or blocks Figure 1 specified in one block or blocks.

[0186] Obviously, those skilled in the art can make various changes and modifications to this application without departing from the scope of protection of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, this application is also intended to include these changes and modifications.

Claims

1. A method for displaying an intelligent assistant interface, characterized in that, Applied to an electronic device, including: Displaying a first interface, where the first interface is a dialogue interface including a main dialogue flow between a user and a main intelligent assistant; Detecting a third-party intelligent assistant trigger event; wherein, the third-party intelligent assistant trigger event is used to indicate triggering a dialogue with a third-party intelligent assistant; In response to the third-party intelligent assistant trigger event, updating the first interface; wherein, the updated first interface includes the main dialogue flow and a third-party dialogue flow between the user and the third-party intelligent assistant.

2. The method according to claim 1, wherein There are multiple third-party intelligent assistants, and the third-party intelligent assistant trigger event includes a selection event among the multiple third-party intelligent assistants.

3. The method according to claim 1, characterized in that, Detecting a third-party intelligent assistant trigger event includes: Displaying an identifier of the third-party intelligent assistant on the first interface; detecting a click operation on the identifier.

4. The method according to claim 1, wherein Before detecting the third-party intelligent assistant trigger event, the method further includes: determining one or more third-party intelligent assistants according to the content displayed in the first interface; and displaying the identifiers of the one or more third-party intelligent assistants in the first interface.

5. The method according to claim 1, wherein Before updating the first interface, the first interface includes a first control, and the first control is a trigger entry for starting a dialogue with the third-party intelligent assistant; Detecting the third-party intelligent assistant trigger event includes: Detecting a first operation instruction on the first control.

6. The method according to claim 5, wherein The updated first interface further includes a first prompt message, and the first prompt message is used to indicate that the user is having a dialogue with the third-party intelligent assistant; Wherein, the first prompt message includes an exit control, and the exit control is used to exit the dialogue with the third-party intelligent assistant and resume the dialogue with the main intelligent assistant.

7. The method according to claim 5 or 6, characterized in that, Before updating the first interface, the first interface further includes a second control, and the second control is a trigger entry for a single processing by the third-party intelligent assistant; Detecting the third-party intelligent assistant trigger event includes: Detecting a second operation instruction on the second control.

8. The method according to any one of claims 5 to 7, characterized in that The third-party intelligent assistant is recommended based on a preset configuration rule; Wherein, the preset configuration rule includes one or more of the following rules: the highest usage frequency, the latest online time, the shortest interval since the last use.

9. The method according to claim 1, characterized in that Detecting the third-party intelligent assistant trigger event includes: Determining a single processing by the third-party intelligent assistant according to the dialogue content of the main dialogue flow and the capabilities of at least one pre-stored alternative third-party intelligent assistant; wherein, the capabilities of the alternative third-party intelligent assistant are used to indicate the dialogues that the alternative third-party intelligent assistant can process, and the third-party intelligent assistant has the ability to process the dialogue content of the main dialogue flow.

10. The method according to claim 1, characterized in that, The third-party intelligent assistant trigger event includes: Entering a preset symbol and the name of the third-party intelligent assistant in an input box, or including a keyword for triggering the third-party intelligent assistant in a voice command.

11. The method according to claim 10, wherein The preset symbol is @.

12. The method according to claim 7, 9 or 10, characterized in that The third-party conversation flow includes: a user command based on the second control and the response content of the third-party intelligent assistant to the user command; in the updated first interface, a first control is associated with the response content, and the first control is a trigger entry for having a conversation with the third-party intelligent assistant. The method further includes: In response to a third operation instruction for the first control included in the updated first interface, changing from a single processing by the third-party intelligent assistant to having a conversation with the third-party intelligent assistant.

13. The method according to any one of claims 1 to 12, characterized in that, The updated first interface further includes a third control for displaying multiple third-party intelligent assistants. The method further includes: In response to a fourth operation instruction for the third control, displaying a second interface; the second interface includes multiple third-party intelligent assistants. In response to a selection operation for another third-party intelligent assistant included in the second interface, displaying a third interface; wherein, the third interface includes the main conversation flow, the third-party conversation flow, and another third-party conversation flow between the user and the other third-party intelligent assistant.

14. The method according to claim 13, wherein the third control is a drop-down control in the first prompt message for indicating that the user is having a conversation with the third-party intelligent assistant; or the third control is a navigation bar control.

15. The method according to claim 13 or 14, wherein the third interface further includes a second prompt message; wherein, the second prompt message is used to indicate that the user is having a conversation with the other third-party intelligent assistant and is also used to indicate the task execution status of the third-party intelligent assistant.

16. The method according to claim 15, wherein The method further includes: In response to a fifth operation instruction for the task execution status of the third-party intelligent assistant, jumping to the conversation content associated with the task in the third-party conversation flow.

17. The method according to any one of claims 1 to 16, characterized in that, The method further includes: When detecting a third-party intelligent assistant with a background execution task, displaying the task execution status of the third-party intelligent assistant with the background execution task through a third prompt message in any intelligent assistant interface.

18. The method according to any one of claims 1 to 17, characterized in that The main intelligent assistant is provided by the operating system of the electronic device, and the third-party intelligent assistant is provided by a third application provider.

19. An electronic device, characterized in that, Comprising at least one processor, the at least one processor is coupled to at least one memory, and the at least one processor is configured to read a computer program stored in the at least one memory to execute the method according to any one of claims 1 to 18.

20. A computer-readable storage medium, characterized in that, Instructions are stored in the computer-readable storage medium, and when it runs on a computer, it causes the computer to execute the method according to any one of claims 1 to 18.

21. A computer program product comprising instructions, characterized in that, When the computer program product runs on a computer, it causes the computer to execute the method according to any one of claims 1 to 18.

Images