Conversation content display method and apparatus, terminal, and computer program product

Abstract

Embodiments of the present application relate to the technical field of human-computer interaction, and disclosed are a conversation content display method and apparatus, a terminal, and a computer program product. The method comprises: in response to a conversation trigger operation, displaying a conversational interface, the conversational interface being an interface for human-computer interaction between a user and a terminal through a conversation (101); and in response to a first conversation instruction, displaying, in a conversation content sequence of the conversational interface, a first conversation content component corresponding to the first conversation instruction, the conversation content sequence being used for arranging and displaying conversation content components in chronological order of the conversation, each conversation content component comprising a corresponding conversation instruction and an instruction response result to the conversation instruction, and each instruction response result comprising at least one of generative content, a called service, and a called application (102).

Description

Dialogue content display methods, devices, terminals, and computer program products

[0001] This application claims priority to Chinese Patent Application No. 202510370116.2, filed on March 26, 2025, entitled “Dialogue Content Display Method, Apparatus, Terminal and Computer Program Product”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of human-computer interaction technology, and in particular to a method, device, terminal, and computer program product for displaying dialogue content. Background Technology

[0003] As users' demands for intelligent devices continue to increase, more and more devices are offering voice assistant functionality. Once the voice assistant is activated, the device can respond to the user's voice commands. Summary of the Invention

[0004] This application provides a method, apparatus, terminal, and computer program product for displaying dialogue content. The technical solution is as follows:

[0005] On one hand, embodiments of this application provide a method for displaying dialogue content, the method being used on a terminal, the method comprising:

[0006] In response to a dialogue-triggered operation, a conversational interface is displayed, which is an interface through which the user and the terminal interact with each other via dialogue.

[0007] In response to a first dialogue instruction, a first dialogue content component corresponding to the first dialogue instruction is displayed in the dialogue content sequence of the dialogic interface. The dialogue content sequence is used to display the dialogue content components in the order of the dialogue. The dialogue content component includes a dialogue instruction and an instruction response result to the dialogue instruction. The instruction response result includes at least one of generative content, a called service, and a called application.

[0008] On the other hand, embodiments of this application provide a dialog content display device, the device comprising:

[0009] The interface display module is used to display a conversational interface in response to a dialogue trigger operation. The conversational interface is an interface through which the user and the terminal interact with each other via dialogue.

[0010] A component display module is configured to respond to a first dialogue instruction by displaying a first dialogue content component corresponding to the first dialogue instruction in a dialogue content sequence of the dialogic interface. The dialogue content sequence is configured to display the dialogue content components in the order of the dialogue. The dialogue content component includes a dialogue instruction and an instruction response result to the dialogue instruction. The instruction response result includes at least one of generative content, a called service, and a called application.

[0011] On the other hand, embodiments of this application provide a terminal, the terminal including a processor and a memory, the memory storing at least one computer instruction, the at least one computer instruction being loaded and executed by the processor to implement the dialogue content display method as described above.

[0012] On the other hand, embodiments of this application provide a computer-readable storage medium storing at least one computer instruction, which is executed by a processor to implement the dialog content display method as described above.

[0013] On the other hand, embodiments of this application provide a computer program product, which includes computer instructions, and when a processor executes the computer instructions, it implements the dialog content display method as described above. Attached Figure Description

[0014] Figure 1 shows a flowchart of a dialog content display method provided in an exemplary embodiment of this application;

[0015] Figure 2 is a schematic diagram of a dialog-based interface shown in an exemplary embodiment of this application;

[0016] Figure 3 is a schematic diagram of the interface illustrating the display process of the generative content corresponding to the dialogue content component in an exemplary embodiment of this application;

[0017] Figure 4 is a schematic diagram illustrating the size change process of generative content in an exemplary embodiment of this application;

[0018] Figure 5 is a schematic diagram of the interface illustrating the display process of the dialog content component corresponding to the invoked service in an exemplary embodiment of this application;

[0019] Figure 6 is a schematic diagram of the interface illustrating the display process of the dialog content component corresponding to the called application in an exemplary embodiment of this application;

[0020] Figure 7 is a schematic diagram of the interface of the application view display process of the invoked application, as illustrated in an exemplary embodiment of this application.

[0021] Figure 8 is a schematic diagram illustrating the interface for calling the application and the generative function in an exemplary embodiment of this application;

[0022] Figure 9 is an exemplary embodiment of this application illustrating a dialog-based interface returned by triggering a dialog return control;

[0023] Figure 10 is an exemplary embodiment of this application illustrating a dialog-style interface returned by triggering a task card;

[0024] Figure 11 is a schematic diagram of an interface illustrating alternating invocation of multiple application processes in an exemplary embodiment of this application;

[0025] Figure 12 is a flowchart illustrating the dialog content component display process in an exemplary embodiment of this application;

[0026] Figure 13 is a schematic diagram illustrating the display hierarchy in the initial state according to an exemplary embodiment of this application;

[0027] Figure 14 is a schematic diagram illustrating the display hierarchy in a compressed state according to an exemplary embodiment of this application;

[0028] Figure 15 is a schematic diagram illustrating the display hierarchy in a folded state according to an exemplary embodiment of this application;

[0029] Figure 16 shows a structural block diagram of a dialog content display device provided in another exemplary embodiment of this application;

[0030] Figure 17 shows a structural block diagram of a terminal provided in an exemplary embodiment of this application. Detailed Implementation

[0031] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0032] In this article, "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0033] In related technologies, when users invoke different types of functions (which may include services, applications, voice assistants, etc.) to achieve specific tasks, they need to switch between different interfaces. Taking watching a movie as an example, when a user needs to check a movie's rating, then buy tickets, and navigate to the cinema, they first need to open the movie rating app to check the rating, then open the ticketing app to buy tickets, and finally open the navigation app for navigation. Because this requires switching between multiple applications, it is inefficient and hinders users from understanding the context.

[0034] This application provides a conversational interface that displays conversational content components corresponding to conversational commands sequentially according to the dialogue order. Since the command response results contained in the conversational content components of the conversational interface can include at least one of generative content, invoked services, and invoked applications, users can invoke generative functions, services, and applications as needed within the same conversational interface, thereby achieving specific tasks within the same interface and improving task execution efficiency. Furthermore, because the conversational commands and command response content are displayed in the conversational interface according to the dialogue order, users can trace back contextual operations within the same interface, improving the efficiency of context tracing.

[0035] The dialogue content display method provided in this application can be used in terminals with conversational human-computer interaction (HCI) functions. This conversational HCI function can be a voice assistant function of the terminal system, allowing users to interact with the terminal via voice and instruct it to complete specific tasks. The terminal can be a smartphone, tablet, wearable device, personal computer, etc. Furthermore, the terminal in this application has an interface display function, capable of displaying received dialogue commands and their response results in the form of dialogue content components. In the following embodiments, for ease of description, the application of the dialogue content display method to a terminal is used as an example.

[0036] Please refer to Figure 1, which shows a flowchart of a dialog content display method provided in an exemplary embodiment of this application. This embodiment uses the method applied to a terminal as an example for illustration. The method may include the following steps.

[0037] Step 101: In response to the dialogue trigger operation, display the conversational interface. The conversational interface is an interface through which the user and the terminal interact with each other via dialogue.

[0038] The dialogue triggering operation can be a voice operation (such as a wake word to wake up a voice assistant), a virtual button operation, a physical button / button combination operation (such as long-pressing a specific physical button to wake up a voice assistant), or a gesture operation. This application embodiment does not limit this.

[0039] In this embodiment of the application, the conversational interface is an interface for users to interact with the terminal, and the human-computer interaction method adopted is a conversational form that is more in line with the interaction between real people. That is, after the user issues a command, the terminal will respond to the command in the conversational interface, and the terminal will combine the contextual dialogue content when responding.

[0040] In some embodiments, the conversational interface has the function of displaying user-inputted dialogue commands and the terminal's response to the dialogue commands.

[0041] In some embodiments, when a dialogue trigger operation is received when no application is displayed in the foreground (such as when the desktop is displayed or the screen is off), the conversational interface includes a dialogue command and a command response result; when a dialogue trigger operation is received when the Origin application is displayed in the foreground, the conversational interface may include the application view of the Origin application in addition to the dialogue command and command response result.

[0042] Step 102: In response to the first dialogue instruction, display the first dialogue content component corresponding to the first dialogue instruction in the dialogue content sequence of the dialogue interface. The dialogue content sequence is used to display the dialogue content components in the order of the dialogue. The dialogue content component includes the dialogue instruction and the instruction response result to the dialogue instruction. The instruction response result includes at least one of the following: generated content, the called service, and the called application.

[0043] The first dialogue instruction can be a voice instruction received by the terminal through the microphone or a text instruction received by input.

[0044] It should be noted that the first dialogue instruction does not specifically refer to the first dialogue instruction received after the dialog interface is displayed, but rather any dialogue instruction received after the dialog interface is displayed. That is, there may be historical dialogue instructions before the first dialogue instruction.

[0045] Unlike displaying dialogue commands and responses in a simple dialogue flow format, this embodiment of the application displays dialogue commands and their responses in units of dialogue content components. That is, the dialogue command input by the user and the terminal's response to that command are displayed in the same dialogue content component, and dialogue commands and their responses from different rounds within the same session are displayed in different dialogue content components. The dialogue commands in the dialogue content components are displayed in text format.

[0046] The dialogue content component can take the form of a card, a floating window, a dialog box, etc., and this embodiment does not limit it.

[0047] In this embodiment, for different rounds of dialogue, the dialogue content components corresponding to each round are arranged in the order of the dialogue to form a dialogue content sequence. Since the display size of the conversational interface is limited, when there are many rounds of dialogue, the conversational interface displays the dialogue content components corresponding to some rounds of dialogue in the dialogue content sequence, and supports manual operation by the user (such as swiping up and down) to switch the displayed dialogue content components.

[0048] In this embodiment of the application, in order to improve the user's attention on the same interface and avoid the user switching back and forth between different interfaces, the instruction response results displayed in the dialogue content component include at least one of the following: generated content, the called service, and the called application.

[0049] Among them, generated content is generated by the terminal through AIGC (Artificial Intelligence Generated Content) when the dialogue command indicates that there is a need for content generation; the called service is used to meet the needs indicated by the dialogue command; and the application functions provided by the called application are used to meet the needs indicated by the dialogue command.

[0050] Furthermore, different types of dialogue content components can be alternately scheduled in the same session, or the same type of dialogue content component can be scheduled multiple times consecutively in the same session (e.g., calling different applications consecutively).

[0051] Because the same conversational interface can support content generation, service invocation, and application invocation, even if a specific task requires calling different types of functions, the terminal can complete it in the same conversational interface without having to switch between multiple interfaces.

[0052] As illustrated in Figure 2, the conversational interface 21 includes a first conversational content component 22, a second conversational content component 23, and a third conversational content component 24 displayed in the order of the conversation. The first conversational content component 22 contains the invoked application (movie review application B), the second conversational content component 23 contains generated content (an introduction to Wang Wu), and the third conversational content component 24 contains the invoked service (music playback service).

[0053] In summary, in the embodiments of this application, when a user interacts with a terminal through dialogue, the terminal displays dialogue content components corresponding to the dialogue commands in the dialogue interface according to the dialogue order. The command response results included in the dialogue content components may include at least one of generated content, called services, and called applications. That is, the same dialogue interface can realize the user's content generation needs, service call needs, and application call needs without switching back and forth between different interfaces, allowing the user to complete different tasks without leaving the dialogue interface, thereby improving task processing efficiency.

[0054] In some embodiments, in response to a first dialogue instruction, a first dialogue content component corresponding to the first dialogue instruction is displayed in a dialogue content sequence of the dialogue interface, including at least one of the following:

[0055] In response to the first dialogue instruction, if the first dialogue instruction indicates the invocation of the generative function, the first dialogue content component containing the first dialogue instruction and the generative content is displayed in the dialogue content sequence of the dialogue interface.

[0056] In response to the first dialogue instruction, if the first dialogue instruction indicates that the target service is invoked, a first dialogue content component containing the first dialogue instruction and the target service card is displayed in the dialogue content sequence of the dialogue interface. The target service card is used to provide the target service.

[0057] In response to a first dialogue instruction, if the first dialogue instruction indicates that the target application should be invoked, a first dialogue content component containing the first dialogue instruction and the target application card is displayed in the dialogue content sequence of the dialog interface. The target application card is used to trigger the display of the target application.

[0058] In some embodiments, a first dialogue content component, comprising a first dialogue instruction and generative content, is displayed in a dialogue content sequence of a conversational interface, including:

[0059] Display a first dialogue content component of a first size, containing a first dialogue instruction and generative content, in the dialogue content sequence of the conversational interface.

[0060] The method also includes:

[0061] In response to a second dialogue instruction, a first dialogue content component with a second size, which includes the first dialogue instruction and generative content, is displayed in the dialogue content sequence, and a second dialogue content component corresponding to the second dialogue instruction is displayed in the dialogue content sequence of the dialogic interface. The second dialogue content component includes the second dialogue instruction and the instruction response result to the second dialogue instruction, and the second size is smaller than the first size.

[0062] In some embodiments, when displaying a first dialogue content component having a second size, the method further includes:

[0063] In response to a triggering operation on the first dialogue content component, a first dialogue content component of a first size containing the first dialogue instruction and generative content is displayed in the dialogue content sequence.

[0064] In some embodiments, in response to a first dialogue instruction, where the first dialogue instruction indicates the invocation of a target application, a first dialogue content component containing the first dialogue instruction and the target application card is displayed in the dialogue content sequence of the conversational interface, including:

[0065] In response to the first dialog instruction, if the first dialog instruction instructs the invocation of the target application, the target application view is displayed on top of the dialog interface.

[0066] In response to a trigger action on a close control in the target application view, stop displaying the target application view and display the first dialogue content component containing the first dialogue instruction and the target application card in the dialogue content sequence of the conversational interface.

[0067] In some embodiments, after displaying the target application view of the target application on top of the conversational interface, the method further includes:

[0068] In response to the second dialogue command, the target application view is stopped from being displayed, and a first dialogue content component containing the first dialogue command and the target application card, and a second dialogue content component corresponding to the second dialogue command are displayed in the dialogue content sequence of the conversational interface.

[0069] In some embodiments, the method further includes:

[0070] In response to a trigger action on a full-screen control in the target application view, the target application is displayed in full screen.

[0071] In some embodiments, the method further includes:

[0072] In response to a trigger action on a full-screen control in the target application view, display the dialog back control; in response to a trigger action on the dialog back control, redisplay the dialog interface.

[0073] And / or,

[0074] In response to a multitasking call, the corresponding task card in the conversational interface is displayed in the multitasking interface; in response to a triggering operation on the corresponding task card in the conversational interface, the conversational interface is redisplayed.

[0075] In some embodiments, where the first dialogue content component includes a first dialogue instruction and a target application card, the method further includes:

[0076] In response to a trigger action on the first dialog content component, the target application view of the target application is displayed on top of the dialog interface.

[0077] In some embodiments, in response to a first dialogue instruction, a first dialogue content component corresponding to the first dialogue instruction is displayed in a dialogue content sequence of the conversational interface, including:

[0078] In response to the first dialogue instruction, the instruction response result for the first dialogue instruction is determined based on at least one of the historical dialogue content components in the dialogue content sequence and the application content of the origin application, wherein the origin application is the application displayed in the foreground when the dialogue trigger operation is received.

[0079] Based on the first dialogue command and the command response result, the first dialogue content component corresponding to the first dialogue command is displayed in the dialogue content sequence.

[0080] In some embodiments, a conversational interface is displayed in response to a dialog-triggered action, including:

[0081] In response to a dialog-triggered operation, if an origin application exists, a dialog-style interface containing the origin application view in the first display state is displayed, wherein the origin application is the application displayed in the foreground when the dialog-triggered operation is received, and the view size of the origin application view in the first display state is smaller than the full screen size.

[0082] In some embodiments, the method further includes:

[0083] If the total display length of the dialogue content components in the dialogue content sequence is greater than the first threshold and less than the second threshold, the origin application view of the second display state is displayed, and the view size of the origin application view of the second display state is smaller than the view size of the origin application view of the first display state.

[0084] If the total display length of the dialogue content components in the dialogue content sequence is greater than the second threshold, the origin application view of the third display state is displayed, and the view size of the origin application view of the third display state is smaller than the view size of the origin application view of the second display state.

[0085] The origin application view in the first display state and the origin application view in the second display state support in-view interaction, while the origin application view in the third display state does not support in-view interaction.

[0086] In some embodiments, the method further includes:

[0087] In response to a triggering operation of a full-screen control in the origin application view of the first display state and / or the origin application view of the second display state, stop displaying the dialog interface.

[0088] And / or,

[0089] In response to a trigger action that applies a view to the origin of the third display state, stop displaying the dialogic interface.

[0090] In some embodiments, the method further includes:

[0091] In response to a trigger action on an empty area in the conversational interface, stop displaying the conversational interface;

[0092] And / or,

[0093] In response to a third dialogue instruction, the dialog interface is stopped from being displayed if the third dialogue instruction indicates that the dialogue should be ended.

[0094] In some embodiments, the display area includes a first display layer, a second display layer, and a third display layer, wherein the third display layer is located above the second display layer, and the second display layer is located above the first display layer;

[0095] The first display layer includes a desktop display area; the second display layer includes an origin application view display area and a dialogue content sequence display area; and the third display layer includes a dialogue command input area.

[0096] The desktop display area is used to display the desktop or foreground applications. The origin application view display area is used to display the application view of the origin application, which is the application displayed in the foreground when a dialog trigger operation is received. The dialog content sequence display area is used to display the dialog content sequence.

[0097] In some embodiments, the third display layer further includes an application view display area for displaying the application view of the invoked application.

[0098] Display format of dialogue content components

[0099] The presentation format of the command response result in the dialogue content component varies depending on the specific needs of the dialogue command. In some embodiments, the terminal determines the function type of the function to be invoked by the dialogue command, and then displays the dialogue content component containing the dialogue command and its response result based on the response result display format corresponding to that function type.

[0100] The function types required for the dialogue command to invoke include at least one of the following: invoking generative functions, invoking services, and invoking applications. Correspondingly, the first dialogue content component displaying the first dialogue command can include the following possible implementation methods.

[0101] Implementation Method 1: In response to the first dialogue instruction, when the first dialogue instruction indicates the invocation of the generative function, the first dialogue content component containing the first dialogue instruction and the generative content is displayed in the dialogue content sequence of the dialogue interface.

[0102] In some embodiments, the terminal performs intent recognition on the first dialogue instruction to obtain an intent recognition result, which is used to indicate the function to be invoked.

[0103] When a generative function (provided locally and / or in the cloud) is detected as needing to be invoked, the terminal takes the dialogue text corresponding to the first dialogue instruction as input and generates the generative content indicated by the first dialogue instruction through the model. This generative content can be generative text, generative image, generative audio, or generative video, etc., and this application embodiment does not limit this.

[0104] As illustrated in Figure 3, during the process of displaying the chat interface 31 of the instant messaging application on the front end, the terminal recognizes the specific wake-up word to activate the voice assistant, activates the voice assistant function, and further receives the voice command "Introduce the plot of this movie". The terminal displays a dialogue content component 33 in the conversational interface 32, which includes the voice text 331 corresponding to the voice command and the generated text 332.

[0105] In some embodiments, when the first dialogue content component is generated for the first time, in order to facilitate the user's viewing of the generated content, the terminal displays the first dialogue content component with a first size, which includes the first dialogue instruction and the generated content, in the dialogue content sequence of the dialogue interface.

[0106] When a second dialogue instruction is subsequently received and the second dialogue content component corresponding to the second dialogue instruction needs to be displayed in the dialogue interface, in order to reduce interference with the second dialogue content component that was generated and displayed for the first time, in response to the second dialogue instruction, the terminal displays a first dialogue content component with a second size that includes the first dialogue instruction and the generated content in the dialogue content sequence, and displays the second dialogue content component corresponding to the second dialogue instruction in the dialogue content sequence of the dialogue interface.

[0107] The second dialogue content component includes a second dialogue instruction and a response result to the second dialogue instruction, and the second size is smaller than the first size.

[0108] When the first size is larger than the second size, the first dialogue content component can display more comprehensive generated content when it is first generated and displayed, while the first dialogue content component displays more concise or partially generated content when the second dialogue content component is displayed subsequently.

[0109] For example, a first dialogue content component with a first size can display complete generative text, while a first dialogue content component with a second size displays partial generative text; a first dialogue content component with a first size can display a complete generative image, while a first dialogue content component with a second size displays the upper half of the generative image; a first dialogue content component with a first size can display a complete generative video frame, while a first dialogue content component with a second size displays the upper half of the generative video frame.

[0110] As illustrated in Figure 4, when the voice command "Introduce the plot of this movie" is received, the terminal displays a first dialogue content component 42 of a first size in the conversational interface 41, wherein the first dialogue content component 42 of the first size displays complete generated text. When the voice command "How is the rating of this movie on app B?" is received, the terminal adjusts the first dialogue content component 42 from the first size to a second size and displays a second dialogue content component 43, wherein the first dialogue content component 42 of the second size displays only a portion of the generated text.

[0111] Optionally, to facilitate users in reviewing historical generated content, when displaying a first dialogue content component with a second size, in response to a triggering operation on the first dialogue content component, the terminal displays a first dialogue content component with a first size containing the first dialogue instruction and generated content in the dialogue content sequence.

[0112] The triggering operation can be a touch operation (click, long press, etc.), a voice command operation, a gesture operation, etc., and this application embodiment does not limit it.

[0113] Optionally, when displaying a first dialogue content component with a first size, if a trigger operation is received again for the first dialogue content component, the terminal can re-display the first dialogue content component with a second size. That is, the terminal can cycle through the size of the first dialogue content component according to the trigger operation for the first dialogue content component.

[0114] As illustrated in Figure 4, when the user clicks on the first dialogue content component 42 with the second size, the terminal redisplays the first dialogue content component 42 with the first size.

[0115] In some embodiments, when the generative content in the first dialogue content component supports autoplay, such as generative audio, generative video, and generative text that support scrolling playback, the playback function of the generative content is enabled when the first dialogue content component is of a first size, and disabled when the first dialogue content component is of a second size.

[0116] Optionally, after changing from the second size to the first size, the generated content can start playing from the beginning, or resume playing from the point when it last stopped playing.

[0117] In this embodiment, when displaying a dialog content component containing generative content, the terminal can adaptively adjust the size of the dialog content component to facilitate the user's viewing of the completed generative content and avoid the generative content interfering with the dialog content component displayed subsequently.

[0118] Implementation Method 2: In response to the first dialogue instruction, if the first dialogue instruction indicates that the target service should be invoked, a first dialogue content component containing the first dialogue instruction and the target service card is displayed in the dialogue content sequence of the dialogue interface. The target service card is used to provide the target service.

[0119] In some embodiments, the terminal performs intent recognition on the first dialogue instruction to obtain an intent recognition result, which is used to indicate the function to be invoked.

[0120] When a service call is detected, the terminal further determines the target service to be invoked by the first dialogue command. This target service is provided locally on the terminal and / or in the cloud.

[0121] To facilitate users' use of the target service in the conversational interface, in this embodiment, the service invoked in the first conversational content component is displayed in the form of a service card, that is, the first conversational content component contains a target service card for providing the target service.

[0122] In some embodiments, a service card may only have the function of displaying the result of a target service call, or it may also have the function of controlling the target service. For example, when the service card is a weather card, the user can view weather details through the weather card; when the service card is a music player card, the user can view song information through the music player card and further perform corresponding controls (playback progress control, personalized operations, etc.) through the controls in the card (such as pause button, fast forward button, progress bar, like button, favorite button, share button, etc.). This application does not limit the specific service type provided by the service card or the specific content displayed by the service card.

[0123] In some embodiments, the result of the target service call displayed on the service card can be determined by the terminal based on the first dialogue instruction. For example, when the first dialogue instruction instructs the playback of song A, the terminal calls the music playback service based on the song name of song A, thereby displaying a music player card for playing song A.

[0124] As illustrated in Figure 5, during the process of displaying the chat interface 51 of the instant messaging application on the front end, the terminal recognizes the specific wake-up word to activate the voice assistant, activates the voice assistant function, and further receives the voice command "play this song". The terminal displays a dialogue content component 53 in the conversational interface 52, which includes the voice text 531 corresponding to the voice command and a music player card 532. The music player card 532 is used to play the song C indicated by the chat content in the chat interface 51.

[0125] In one possible design, the dialog content component containing the service card has a fixed size so that the user can quickly interact with the service card.

[0126] In another possible design, the dialog content component containing the service card has a third size and a fourth size, where the third size is larger than the fourth size. When the dialog content component containing the service card is first generated and displayed, the terminal displays the dialog content component of the third size; when it is necessary to further display dialog content components corresponding to other dialog commands, the terminal switches the dialog content component containing the service card from the third size to the fourth size.

[0127] Optionally, users can switch the size of the dialog content component by performing a trigger operation on the dialog content component containing the service card; this embodiment does not limit this.

[0128] In some embodiments, when the service card in the first dialogue content component supports playback, such as a music player card or photo album card that supports playback, the playback function is enabled when the first dialogue content component is of the third size, and the playback function is disabled when the first dialogue content component is of the fourth size.

[0129] In this embodiment, when a dialog command indicates a service call requirement, the service card corresponding to the called service is displayed in the dialog content component, allowing the user to quickly use the service through the service card in the dialog interface, thus improving the efficiency of the user in obtaining services.

[0130] Implementation Method 3: In response to the first dialogue instruction, when the first dialogue instruction indicates the invocation of the target application, the first dialogue content component containing the first dialogue instruction and the target application card is displayed in the dialogue content sequence of the dialog interface. The target application card is used to trigger the display of the target application.

[0131] In some embodiments, the terminal performs intent recognition on the first dialogue instruction to obtain an intent recognition result, which is used to indicate the function to be invoked.

[0132] When it is recognized that an application needs to be invoked, the terminal further determines the target application to be invoked by the first dialogue command. This target application can be a regular application, a quick app, or a mini-program, etc., and this embodiment does not limit this.

[0133] In some embodiments, the target application card displays a target application interface within the target application. This target application interface provides target application functionality, which is determined by the terminal based on a first dialogue command and candidate application functions provided by the target application.

[0134] For example, when the target application is a rating application and the first dialogue command instructs the user to view the rating of movie A, the target application interface is used to provide movie rating functionality; while when the first dialogue command instructs the user to view the rating of novel B, the target application interface is used to provide novel rating functionality.

[0135] Optionally, the target application card can be used to trigger the display of a specific application interface of the target application, or to trigger the display of the target application interface of the target application.

[0136] Optionally, the target application interface in the target application card can be displayed as a screenshot, or the interface elements of the target application interface can be rearranged and displayed.

[0137] In some embodiments, due to the limited display size of the dialog content component, when the target application interface is displayed as a screenshot, the target application card only shows a portion of the screenshot. For example, only the top of the screenshot is displayed.

[0138] In one possible design, the target application card only has the function of displaying the result of the target application call (such as displaying the target application interface in the form of a screenshot), or the target application card may also have in-application operation functions (such as recombining and displaying the interface elements of the target application interface), that is, it can realize some or all of the in-application functions.

[0139] Since the target application card can only display a limited amount of content, in order to allow users to see more application content when calling the application, in one possible implementation, in response to a first dialogue instruction, when the first dialogue instruction instructs the calling of the target application, the terminal first displays the target application view of the target application on top of the dialog interface.

[0140] Optionally, when the target application view is displayed, the underlying conversational interface is not visible, or the underlying conversational interface is masked.

[0141] In some embodiments, the target application view can be a view of the target application interface within the target application, and the target application view supports in-view operations, meaning that users can experience the full in-app functionality within the target application view.

[0142] In some embodiments, the size of the target application view is less than or equal to the full-screen display size of the target application. Furthermore, the target application view can be displayed in a floating window.

[0143] Furthermore, in response to a triggering operation on the close control in the target application view, the terminal stops displaying the target application view and displays a first dialogue content component containing the first dialogue instruction and the target application card in the dialogue content sequence of the conversational interface.

[0144] The close control in the target application view is used to trigger the closing of the target application view. After the target application view is closed, the dialog interface that was previously located at the bottom of the target application view will once again be on top of the view and can be viewed and interacted with by the user.

[0145] In one possible implementation, a first dialog content component containing the target application card is added to the dialog content sequence upon receiving a trigger action on a close control in the target application view.

[0146] In another possible implementation, a first dialogue content component containing the target application card is synchronously added to the dialogue content sequence when the target application view is displayed (which avoids the display delay caused by real-time generation when the target application view is closed).

[0147] As illustrated in Figure 6, during the process of displaying the chat interface 61 of the instant messaging application on the front end, the terminal recognizes a specific wake-up word to activate the voice assistant, activates the voice assistant function, and further receives the voice command "How is the rating of this movie in application B?". Based on this voice command, the terminal displays the application view 63 of application B on top of the conversational interface 62, where the application view 63 is the rating interface of movie A. When a click operation is received on the close control 631 in the application view 63, the terminal stops displaying the application view 63 and displays a dialogue content component 64 in the conversational interface 62, which includes the voice text 641 corresponding to the voice command and the target application card 642, where the target application card 642 displays a partial screenshot of the rating interface of movie A.

[0148] Of course, in other possible implementations, in order to maintain the continuity of the human-computer interaction process within the conversational interface, the terminal may directly display the first conversational content component in the conversational interface in response to the first conversational instruction. This embodiment does not limit this.

[0149] In one possible implementation, when the first dialogue content component includes a first dialogue instruction and a target application card, in order to facilitate quick operation by the user within the target application, in response to the triggering operation of the first dialogue content component, a target application view of the target application is displayed on top of the dialogic interface.

[0150] The triggering operation for displaying the target application view can be a click operation, a long press operation, a press operation, or a click operation on a specific control in the component (such as a control set in the component specifically for triggering the display of the application view), etc. This embodiment does not limit this.

[0151] In illustrative terms, based on Figure 6, as shown in Figure 7, when a click operation is received on the dialogue content component 64 in the conversational interface 62, the terminal displays the application view 63 corresponding to the application in the dialogue content component 64 on the upper layer of the conversational interface 62.

[0152] When the terminal displays the target application view, it supports continuously receiving dialogue commands. When a second dialogue command is received, in order to prevent the target application view from affecting the user's viewing of the response result of the second dialogue command, in one possible implementation, in response to the second dialogue command, the terminal stops displaying the target application view and displays a first dialogue content component containing the first dialogue command and the target application card, as well as a second dialogue content component corresponding to the second dialogue command, in the dialogue content sequence of the conversational interface.

[0153] Optionally, when the second dialogue instruction indicates the invocation of a generative function and / or the invocation of a service, the terminal displays the first dialogue content component and the second dialogue content component in the dialogue interface; when the second dialogue instruction indicates the invocation of an application, the terminal switches to display the application view of the application invoked by the second dialogue instruction (which may be the same as or different from the target application view invoked by the first dialogue instruction).

[0154] Optionally, the first dialogue content component and the second dialogue content component can be generated synchronously and added to the dialogue content sequence when the second dialogue instruction is received; or, the first dialogue content component is generated and added to the dialogue content sequence when the first dialogue instruction is received, and the second dialogue content component is generated and added to the dialogue content sequence when the second dialogue instruction is received.

[0155] Schematic, based on Figure 6, as shown in Figure 8, when the voice command "Introduce the main actors" is received while displaying application view 63, the terminal stops displaying application view 63 and displays dialogue content component 64 containing application cards and dialogue content component 65 containing generated content in the conversational interface 62.

[0156] In some embodiments, the size of the target application view is smaller than the full-screen display size of the target application, and the target application view also includes a full-screen control. In response to a trigger operation on the full-screen control in the target application view, the terminal displays the target application in full-screen mode. Because the size of the target application in full-screen mode is larger than the size of the target application view, it is more convenient for users to perform in-application operations.

[0157] Optionally, if the target application is displayed in full-screen mode, the conversational interface may be stopped, or the conversational interface may be displayed in the background, or the conversational interface may be displayed as a layer beneath the target application in full-screen mode.

[0158] When the target application is displayed in full screen, in order to facilitate the user's return to the conversational interface to continue making function calls, the user can trigger the redisplay of the conversational interface in at least one of the following ways.

[0159] Method 1: Trigger the redisplay of the conversational interface via the dialog return control.

[0160] Optionally, in response to a triggering action on a full-screen control in the target application view, the terminal displays a dialog return control, which is used to trigger a return to the dialog interface.

[0161] In some embodiments, the dialog return control can be displayed as a status bar badge, a floating icon, or the like, and the dialog return control can be displayed using a combination of text and images to inform the user of the control's function. This embodiment does not limit the specific display form of the dialog return control.

[0162] In some embodiments, the dialog return control is continuously displayed; or, the dialog return control stops displaying when leaving the target application; or, the dialog return control stops displaying after a preset display duration; or, the dialog return control can be manually eliminated.

[0163] Furthermore, in response to a trigger action on the dialog return control, the dialog interface is redisplayed.

[0164] Optionally, when the conversational interface is redisplayed, the target application switches from running in the foreground to running in the background.

[0165] Optionally, when the conversational interface is redisplayed, the terminal needs to restart the human-computer conversational interaction function (such as re-waking up the voice assistant).

[0166] Schematic, based on Figure 6, as shown in Figure 9, when a click operation is received on the full-screen control 632 in the application view 63, the terminal displays the target application in full screen and displays the dialog return control 66 in the notification bar. When a click operation is received on the dialog return control 66, the terminal switches the target application to the background and redisplays the conversational interface containing the dialog content component 64.

[0167] Method 2: Trigger the redisplay of the conversational interface through the multitasking interface.

[0168] In one possible implementation, when a conversational interface is displayed, the terminal creates a task card corresponding to the conversational interface and adds the task card to the multitasking interface. That is, the user can view and operate the task card corresponding to the conversational interface within the multitasking interface.

[0169] Optionally, the task card displays a live screenshot of the conversational interface.

[0170] Similar to task cards in other applications within a multitasking interface, task cards in the conversational interface support click, delete, and lock operations. Clicking a task card triggers the execution of the corresponding task in the foreground; deleting a task card ends the lifecycle of the corresponding task; and locking a task card prevents the corresponding task from being deleted.

[0171] In one possible implementation, in response to a multitasking call, the terminal displays the task card corresponding to the conversational interface in the multitasking interface. Further, in response to a triggering operation on the task card corresponding to the conversational interface, the terminal redisplays the conversational interface.

[0172] The multitasking operation can be a gesture operation, a voice operation, or a virtual button operation, etc., and this embodiment does not limit it.

[0173] In some embodiments, the terminal associates and stores task cards with component information of dialogue content components contained in the conversational interface. When a trigger operation is received on a task card corresponding to the conversational interface, the terminal obtains the component information corresponding to the task card and then redisplays the conversational interface based on the component information. This component information may include component order, dialogue commands, command response results, etc.

[0174] As illustrated in Figure 10, when a user brings up the multitasking interface via an upward swipe gesture, the multitasking interface 1001 displays a task card 1002 corresponding to the conversational interface. When a click operation is received on the task card 1002, the terminal displays the conversational interface 1003 corresponding to the task card, which contains multiple conversational content components.

[0175] It should be noted that triggering the re-display of the conversational interface through the multitasking interface can be used not only for the scenario of full-screen display of the target application, but also at any stage of the conversational interface's lifecycle. That is, as long as the conversational interface's lifecycle has not ended, the user can trigger the display of the conversational interface through its corresponding task card.

[0176] In this embodiment, when a dialog command instructs the user to invoke an application, the terminal can display a dialog content component containing the application card. This dialog content component can trigger the display of the application view, facilitating user operations within the application view. Furthermore, the application view can be used to switch to full-screen application display, further improving in-application operation efficiency.

[0177] Furthermore, the dialog content component and the application view can be switched back and forth to meet the application usage needs in various scenarios.

[0178] In addition, the terminal provides two ways to recall the historical conversational interface: "triggering the redisplay of the conversational interface through the dialogue return control" and "triggering the redisplay of the conversational interface through the multitasking interface", so as to avoid users having to go through a series of dialogues again after accidentally exiting the conversational interface.

[0179] In an example of continuously calling multiple applications, as shown in Figure 11, during the process of displaying the chat interface 1101 of the instant messaging application in the foreground, the terminal recognizes a specific wake-up word to activate the voice assistant, activates the voice assistant function, and further receives the voice command "How is the rating of this movie in application B?". Based on this voice command, the terminal displays the first application view 1102 of application B on top of the conversational interface, where the first application view 1102 is the rating interface of movie A.

[0180] Furthermore, upon receiving the voice command "Buy tickets," the terminal displays a second application view 1103 of the ticketing application on top of the conversational interface. This second application view 1103 is the ticketing interface for movie A.

[0181] Furthermore, upon receiving the instruction "Navigate here", the terminal displays a third application view 1104 of the navigation application on top of the conversational interface. This third application view 1104 is the navigation interface for navigating to XX Cinema.

[0182] When a close operation is received for the third application view 1104, the terminal stops displaying the third application view 1104 and displays a conversational interface 1105 containing the dialogue content components corresponding to application B, the ticketing application, and the navigation application.

[0183] Method for determining the result of a command response

[0184] During a session, each time the terminal receives a dialogue command and determines the corresponding response, it needs to refer to the context information of the current session. This context information includes, at a minimum, the historical dialogues preceding the current round.

[0185] Furthermore, the dialogue commands issued by the user may be related to the content of the foreground application. Therefore, to improve the accuracy of command responses, the referenced context information can also include the content of the originating application. Here, the originating application is the application displayed in the foreground when the dialogue trigger operation is received.

[0186] Based on the above contextual information, in one possible implementation, as shown in Figure 12, the process of displaying the first dialogue content component may include the following steps.

[0187] Step 1201: In response to the first dialogue instruction, determine the instruction response result to the first dialogue instruction based on at least one of the historical dialogue content components in the dialogue content sequence and the application content of the origin application, wherein the origin application is the application displayed in the foreground when the dialogue trigger operation is received.

[0188] In some embodiments, when there is no origin application (i.e., when the dialogue is triggered without the application being displayed in the foreground), the terminal determines the instruction response result of the first dialogue instruction based on the historical dialogue content component; when there is an origin application (i.e., when the dialogue is triggered with the application being displayed in the foreground), the terminal determines the instruction response result of the first dialogue instruction based on the historical dialogue content component and the application content of the origin application.

[0189] Optionally, the historical dialogue content component is the dialogue content component corresponding to the dialogue instruction received before the first dialogue instruction in the same session. Furthermore, when determining the instruction response result, the terminal obtains the historical dialogue instruction and the historical instruction response result contained in the historical dialogue content component.

[0190] Optionally, when an originating application exists, the terminal extracts application content from the application interface of the originating application when determining the command response result. The terminal can use methods such as OCR (Optical Character Recognition) or screenshots to obtain application content such as text and images. This embodiment does not limit the specific method for extracting application content.

[0191] Regarding the method for determining the instruction response result, in some embodiments, the terminal may use a neural network model (such as a large language model) or keyword matching to determine the instruction response result of the first dialogue instruction based on at least one of the historical dialogue content components and the application content of the origin application. This embodiment does not limit this.

[0192] As illustrated in Figure 11, when receiving the voice command "What's the rating for this movie in app B?", the terminal determines that "this movie" refers to "movie A" based on the text displayed in the original app (instant messaging app), and then searches for the rating of "movie A" in app B. When receiving the voice command "Buy tickets", the terminal searches for the purchase channels for "movie A" in the ticketing app based on the historical command response result "movie A" contained in the historical dialogue content component. When receiving the command "Navigate here", the terminal displays the navigation path in the navigation app with "XX Cinema" as the navigation destination based on the historical command response result "XX Cinema" contained in the historical dialogue content component.

[0193] Step 1202: Based on the first dialogue instruction and the instruction response result, display the first dialogue content component corresponding to the first dialogue instruction in the dialogue content sequence.

[0194] Based on the determined instruction response result, the terminal displays the first dialogue instruction and instruction response result in the first dialogue content component using the corresponding instruction response result display format.

[0195] In this embodiment, when determining the instruction response result of the current dialogue instruction, the terminal fully considers the context information in the session and determines the instruction response result based on at least one of the historical dialogue content components and the application content of the origin application, thereby improving the accuracy of the instruction response result.

[0196] The origin point is used to display the state change process in a conversational interface.

[0197] In one possible application scenario, when a dialogue trigger operation is received without the foreground application being displayed, the initially displayed conversational interface is empty. During subsequent dialogues, the conversational interface continuously adds dialogue content components corresponding to each dialogue turn.

[0198] In another possible application scenario, when a dialogue-triggered operation is received while a foreground application is displayed, the initial displayed dialog interface contains an application view of the foreground application, and this application view remains displayed during subsequent dialogues so that the user can quickly return to the foreground application to perform operations.

[0199] In one possible implementation, in response to the dialogue triggering operation, if an origin application is present, the terminal displays a dialogic interface including an origin application view of a first display state, wherein the origin application is the application displayed in the foreground when the dialogue triggering operation is received, and the view size of the origin application view of the first display state is smaller than the full screen size.

[0200] Optionally, the origin application view in the first display state is obtained by scaling the full-screen application view proportionally, and the origin application view in the first display state supports in-application operations, that is, users can use all or part of the application functions of the origin application within the origin application view in the first display state.

[0201] Optionally, the origin of the first display state may be used to display a screen area outside the application view to display a multimodal interaction area, which may display voice commands in text form, text input boxes, and interaction-related controls.

[0202] As illustrated in Figure 3, when a conversation trigger operation is received while the chat interface 31 of the instant messaging application is displayed in the foreground, the chat interface 31 switches from full-screen display to first display state.

[0203] In one possible design, the origin application view includes a second display state (compressed state) and a third display state (folded state) in addition to the first display state.

[0204] Regarding view size, the view size of the origin application view in the second display state is smaller than the view size of the origin application view in the first display state, and the view size of the origin application view in the third display state is smaller than the view size of the origin application view in the second display state.

[0205] Regarding interactivity, the origin application view in the first display state and the origin application view in the second display state support in-view interaction, while the origin application view in the third display state does not support in-view interaction. Optionally, the types of in-view interaction supported by the origin application view in the first display state are more than or equal to the types of in-view interaction supported by the origin application view in the second display state; that is, richer or the same in-view operations can be performed in the origin application view in the first display state relative to the second display state.

[0206] In one possible implementation, the origin application view of the second display state is obtained by scaling down the origin application view of the full-screen display.

[0207] In another possible implementation, the origin application view of the second display state includes key application elements within the origin application, including key display elements and key interactive elements, enabling users to know the real-time application content of the origin application through the key display elements and to perform in-application transactions through the key interactive elements.

[0208] As an illustration, when the origin application is an instant messaging application, the origin application view in the second display state includes chat information (including chat partners and chat content information) and message editing and sending controls. This application embodiment does not limit the specific view content included in the origin application view in the second display state.

[0209] In one possible implementation, the origin application view of the third display state includes application status information of the origin application and key display elements, enabling users to understand the real-time application status through the application status information and recall the application content of the origin application before entering the conversational interface through the key display elements.

[0210] Schematic illustration: When the origin application is an instant messaging application, the origin application view in the third display state includes chat object information and message receiving status (whether a new message from the chat object has been received). This application embodiment does not limit the specific view content included in the origin application view of the third display state.

[0211] During the dialogue, the number of dialogue content components in the sequence increases, causing the size of the display area occupied by these components to also increase. In one possible design, the display state of the origin view in the conversational interface changes with the total display length of the dialogue content components.

[0212] In one possible implementation, if the total display length of the dialogue content components in the dialogue content sequence is greater than a first threshold and less than a second threshold, the terminal displays the origin application view of the second display state.

[0213] If the total display length of the dialogue content components in the dialogue content sequence is greater than the second threshold, the terminal displays the origin application view of the third display state, and the view size of the origin application view of the third display state is smaller than the view size of the origin application view of the second display state.

[0214] The total display length is determined based on the individual display length of each dialogue content component in the dialogue content sequence. For example, the total display length = the sum of the individual display lengths of each dialogue content component + the sum of the component spacing between dialogue content components.

[0215] As illustrated in Figure 5, when the total display length of the dialogue content components in the dialogue content sequence is greater than the first threshold and less than the second threshold, the chat interface 51 in the second display state is displayed in the conversational interface 52.

[0216] As shown in Figure 8, when the total display length of the dialogue content components in the dialogue content sequence is greater than the second threshold, the chat interface 61 in the third display state is displayed in the conversational interface 62.

[0217] It should be noted that the three display states mentioned above can be switched. For example, by clicking on the origin application view, the display states of the origin application view can be cycled through in the order of third display state → second display state → first display state → third display state.

[0218] In this embodiment, by displaying the Origin Application view of the Origin Application in a dialogic interface, the user can pay attention to the application status of the Origin Application in real time during human-computer interaction with the terminal; and the Origin Application view can switch between multiple display states to meet the user's display and operation needs of the Origin Application view in different scenarios.

[0219] Exit via conversational interface

[0220] Terminals / users can exit the conversational interface by using at least one of the following methods, i.e., the terminal stops displaying the conversational interface.

[0221] Exit Method 1: In response to a triggering operation of a full-screen control in the origin application view of the first display state and / or the origin application view of the second display state, stop displaying the dialog interface.

[0222] Optionally, a full-screen control is provided in the origin application view in the first display state and / or the second display state. This full-screen control is used to trigger the full-screen display of the origin application view. Accordingly, when the user triggers the full-screen control, it indicates that the user has a need for full-screen operation in the origin application. Therefore, the terminal stops displaying the dialog interface and displays the origin application view in full-screen mode.

[0223] Exit Method 2: In response to a trigger operation on the origin view of the third display state, stop displaying the dialog interface.

[0224] Optionally, the origin application view in the third display state can switch to full-screen display upon receiving a trigger operation. This trigger operation can be a click, a long press, etc., and this embodiment does not limit this.

[0225] Correspondingly, when the user triggers the origin application view in the third display state, the terminal stops displaying the conversational interface and displays the origin application view in full screen.

[0226] Exit Method 3: In response to a trigger operation on an empty area in the dialog interface, stop displaying the dialog interface.

[0227] In addition to exiting the conversational interface by manipulating the view applied to the origin, another possible implementation is that the terminal detects whether there is a trigger operation on an empty area in the conversational interface, and if so, stops displaying the conversational interface.

[0228] The free area refers to the area in the conversational interface that displays the conversational content components, the area that displays the origin application view, and the area outside the multimodal interaction area.

[0229] Optionally, upon exiting the conversational interface, the terminal can display the desktop or the original application; this embodiment does not limit this.

[0230] Exit Method 4: In response to the third dialogue instruction, stop displaying the dialog interface when the third dialogue instruction indicates the end of the dialogue.

[0231] In some embodiments, once a user has completed a specific task within the conversational interface, they can notify the terminal to end the interaction via a third conversational instruction. Accordingly, upon recognizing the intention to end the conversation in the third conversational instruction, the terminal stops displaying the conversational interface.

[0232] Optionally, upon exiting the conversational interface, the terminal can display the desktop or the original application; this embodiment does not limit this.

[0233] Of course, in addition to the above exit methods, users can also actively exit the conversational interface by clicking specific physical buttons, etc., and this application embodiment does not limit this.

[0234] Display hierarchy

[0235] To display the aforementioned conversational interface, in one possible design, the terminal's display area has three display layers: a first display layer, a second display layer, and a third display layer, wherein the third display layer is located above the second display layer, and the second display layer is located above the first display layer.

[0236] The first display layer includes a desktop display area, the second display layer includes an origin application view display area and a dialogue content sequence display area, and the third display layer includes a dialogue command input area.

[0237] The desktop display area is used to display the desktop or foreground application. The origin application view display area is used to display the application view of the origin application, which is the application displayed in the foreground when a dialogue trigger operation is received. The dialogue content sequence display area is used to display the dialogue content sequence. The dialogue command input area is used to display multimodal dialogue commands and provides controls related to dialogue command input (such as a virtual keyboard).

[0238] It should be noted that when a foreground application is displayed in the desktop display area, if a dialogue trigger operation is received, the foreground application is identified as the origin application. That is, the origin application is the foreground application in a specific scenario (a scenario where a dialogue trigger operation exists).

[0239] Furthermore, in one possible implementation, when a dialog trigger operation is received while a foreground application is displayed in the desktop display area, the foreground application in the desktop display area is moved to the origin application view display area of ​​the second display layer; or, the foreground application in the desktop display area is retained, and an application view of the foreground application is added to the origin application view display area of ​​the second display layer.

[0240] In one design, the display size of the origin application view display area supports dynamic changes. Optionally, the origin application view display area has three display sizes, corresponding to three display states of the origin application view.

[0241] In one design, the conversation content sequence supports scrolling display of conversation content components. That is, when there are many conversation content components, users can switch the conversation content components displayed in the conversation content sequence display area by swiping up and down.

[0242] To support the display of the application view of the invoked application, in one possible implementation, the third display layer further includes an application view display area for displaying the application view of the invoked application.

[0243] In one design, the size of the application view display area is greater than or equal to the size of "origin application view display area + dialog content sequence display area", thus obscuring the origin application view and the dialog content sequence. Alternatively, the size of the application view display area can be smaller than the size of "origin application view display area + dialog content sequence display area", meaning that when displaying the application view of the invoked application, the lower-level origin application view and dialog content sequence portion are exposed (the exposed portion can be blurred or masked).

[0244] As illustrated in Figure 13, when a dialog trigger operation is received and the dialog interface is initially displayed, the origin application view display area in the second display layer displays the origin application view of the first display state (initial state), and the dialog command display area in the third display layer displays the multimodal command input controls. Since the second and third display layers are located above the first display layer, the user can see both the origin application view display area and the dialog command display area, i.e., see the initial state of the origin application view and the multimodal command input controls.

[0245] As shown in Figure 14, when there are fewer dialogue rounds, the origin application view display area in the second display layer displays the origin application view in the second display state (compressed state), and the dialogue content sequence display area displays the dialogue content sequence containing the dialogue content components corresponding to the dialogue commands. Since the second and third display layers are located above the first display layer, the user can view the origin application view display area, the dialogue content sequence display area, and the dialogue command display area, that is, view the compressed origin application view, the dialogue content components, and the multimodal command input controls.

[0246] As shown in Figure 15, when there are many dialogue rounds, the origin application view display area in the second display layer displays the origin application view in the third display state (collapsed state), and the dialogue content sequence display area displays the dialogue content sequence containing the dialogue content components corresponding to the dialogue commands. Since the second and third display layers are located above the first display layer, the user can see the origin application view display area, the dialogue content sequence display area, and the dialogue command display area, that is, see the collapsed origin application view, the dialogue content components, and the multimodal command input controls.

[0247] As shown in Figures 14 and 15, when a click operation is received on the corresponding dialog content component of the invoked application, the terminal displays the application view of the invoked application in the application view display area of ​​the third display layer. Since the application view display area is located above the origin application view display area and the dialog content sequence display area, the user can view both the application view display area and the dialog command display area, that is, view the application view including the invoked application and the multimodal command input controls.

[0248] Please refer to Figure 16, which shows a structural block diagram of a dialog content display device provided in an exemplary embodiment of this application. The device includes:

[0249] The interface display module 1601 is used to display a conversational interface in response to a dialogue trigger operation. The conversational interface is an interface through which the user and the terminal interact with each other via dialogue.

[0250] The component display module 1602 is used to respond to a first dialogue instruction by displaying a first dialogue content component corresponding to the first dialogue instruction in a dialogue content sequence of the dialogue interface. The dialogue content sequence is used to display the dialogue content components in the order of the dialogue. The dialogue content component includes a dialogue instruction and an instruction response result to the dialogue instruction. The instruction response result includes at least one of generated content, a called service, and a called application.

[0251] Optionally, component display module 1602 is used for:

[0252] In response to the first dialogue instruction, if the first dialogue instruction indicates the invocation of a generative function, the first dialogue content component containing the first dialogue instruction and the generative content is displayed in the dialogue content sequence of the dialogue interface; and / or,

[0253] In response to the first dialogue instruction, if the first dialogue instruction indicates the invocation of a target service, the first dialogue content component, including the first dialogue instruction and a target service card, is displayed in the dialogue content sequence of the conversational interface, the target service card being used to provide the target service; and / or,

[0254] In response to the first dialogue instruction, if the first dialogue instruction indicates the invocation of a target application, the first dialogue content component containing the first dialogue instruction and a target application card is displayed in the dialogue content sequence of the conversational interface, the target application card being used to trigger the display of the target application.

[0255] Optionally, component display module 1602 is used for:

[0256] The first dialogue content component, having a first size, containing the first dialogue instruction and the generative content, is displayed in the dialogue content sequence of the conversational interface.

[0257] Component display module 1602 is also used for:

[0258] In response to a second dialogue instruction, a first dialogue content component with a second size, comprising the first dialogue instruction and the generative content, is displayed in the dialogue content sequence, and a second dialogue content component corresponding to the second dialogue instruction is displayed in the dialogue content sequence of the conversational interface. The second dialogue content component includes the second dialogue instruction and the instruction response result to the second dialogue instruction, and the second size is smaller than the first size.

[0259] Optionally, when displaying the first dialogue content component having the second size, the component display module 1602 is further configured to:

[0260] In response to a triggering operation on the first dialogue content component, the first dialogue content component, containing the first dialogue instruction and the generative content, and having the first size, is displayed in the dialogue content sequence.

[0261] Optionally, component display module 1602 is used for:

[0262] In response to the first dialogue instruction, if the first dialogue instruction indicates that the target application is invoked, a target application view of the target application is displayed on top of the conversational interface;

[0263] In response to a trigger operation on a close control in the target application view, the display of the target application view is stopped, and the first dialogue content component containing the first dialogue instruction and the target application card is displayed in the dialogue content sequence of the conversational interface.

[0264] Optionally, component display module 1602 is also used for:

[0265] In response to the second dialogue instruction, the display of the target application view is stopped, and the first dialogue content component containing the first dialogue instruction and the target application card, as well as the second dialogue content component corresponding to the second dialogue instruction, are displayed in the dialogue content sequence of the conversational interface.

[0266] Optionally, the device further includes a full-screen display module for:

[0267] In response to a triggering operation on a full-screen control in the target application view, the target application is displayed in full screen.

[0268] Optionally, the interface display module 1601 is also used for:

[0269] In response to a triggering operation on the full-screen control in the target application view, a dialog return control is displayed; in response to a triggering operation on the dialog return control, the dialog interface is redisplayed.

[0270] And / or,

[0271] In response to a multitasking call-out operation, the task card corresponding to the conversational interface is displayed in the multitasking interface; in response to a trigger operation on the task card corresponding to the conversational interface, the conversational interface is redisplayed.

[0272] Optionally, when the first dialogue content component includes the first dialogue instruction and the target application card, the device further includes an application view display module, used for:

[0273] In response to a triggering operation on the first dialogue content component, a target application view of the target application is displayed on top of the dialogue interface.

[0274] Optionally, component display module 1602 is used for:

[0275] In response to the first dialogue instruction, the instruction response result to the first dialogue instruction is determined based on at least one of the historical dialogue content components in the dialogue content sequence and the application content of the origin application, wherein the origin application is the application displayed in the foreground when the dialogue trigger operation is received.

[0276] Based on the first dialogue instruction and the instruction response result, the first dialogue content component corresponding to the first dialogue instruction is displayed in the dialogue content sequence.

[0277] Optionally, the interface display module 1601 is used for:

[0278] In response to the dialogue triggering operation, if an origin application exists, the dialogic interface is displayed, which includes the origin application view in a first display state, wherein the origin application is the application displayed in the foreground when the dialogue triggering operation is received, and the view size of the origin application view in the first display state is smaller than the full screen size.

[0279] Optionally, the interface display module 1601 is also used for:

[0280] If the total display length of the dialogue content components in the dialogue content sequence is greater than a first threshold and less than a second threshold, the origin application view of the second display state is displayed, and the view size of the origin application view of the second display state is smaller than the view size of the origin application view of the first display state.

[0281] If the total display length of the dialogue content components in the dialogue content sequence is greater than the second threshold, the origin application view of the third display state is displayed, and the view size of the origin application view of the third display state is smaller than the view size of the origin application view of the second display state.

[0282] The origin application view in the first display state and the origin application view in the second display state support in-view interaction, while the origin application view in the third display state does not support in-view interaction.

[0283] Optionally, the interface display module 1601 is also used for:

[0284] In response to a triggering operation of a full-screen control in the origin application view of the first display state and / or the origin application view of the second display state, the display of the dialogic interface is stopped.

[0285] And / or,

[0286] In response to a triggering operation that applies a view to the origin of the third display state, the display of the conversational interface is stopped.

[0287] Optionally, the interface display module 1601 is also used for:

[0288] In response to a trigger operation on an empty area in the dialog interface, stop displaying the dialog interface;

[0289] And / or,

[0290] In response to a third dialogue instruction, the dialog interface is stopped from being displayed if the third dialogue instruction indicates that the dialogue should be ended.

[0291] Optionally, the display area includes a first display layer, a second display layer, and a third display layer, wherein the third display layer is located above the second display layer, and the second display layer is located above the first display layer;

[0292] The first display layer includes a desktop display area; the second display layer includes an origin application view display area and a dialogue content sequence display area; and the third display layer includes a dialogue command input area.

[0293] The desktop display area is used to display the desktop or foreground application, the origin application view display area is used to display the application view of the origin application, the origin application is the application displayed in the foreground when the dialogue trigger operation is received, and the dialogue content sequence display area is used to display the dialogue content sequence.

[0294] Optionally, the third display layer further includes an application view display area, which is used to display the application view of the invoked application.

[0295] In summary, in the embodiments of this application, when a user interacts with a terminal through dialogue, the terminal displays dialogue content components corresponding to the dialogue commands in the dialogue interface according to the dialogue order. The command response results included in the dialogue content components may include at least one of generated content, called services, and called applications. That is, the same dialogue interface can realize the user's content generation needs, service call needs, and application call needs without switching back and forth between different interfaces, allowing the user to complete different tasks without leaving the dialogue interface, thereby improving task processing efficiency.

[0296] Referring to Figure 17, which is a structural block diagram of a terminal provided in an exemplary embodiment of this application, the terminal may include one or more components such as a processor 1710 and a memory 1720.

[0297] Optionally, the processor 1710 connects various parts within the electronic device using various interfaces and lines. It performs various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 1720, and by calling data stored in the memory 1720. Optionally, the processor 1710 can be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 1710 can integrate one or more of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), Neural-network Processing Unit (NPU), and baseband chip. Specifically, the CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content displayed on the touchscreen; the NPU implements artificial intelligence (AI) functions; and the baseband chip handles wireless communication. It is understandable that the aforementioned baseband chip may not be integrated into the processor 1710, but may be implemented as a separate chip.

[0298] The memory 1720 may include random access memory (RAM) or read-only memory (ROM). Optionally, the memory 1720 may include a non-transitory computer-readable storage medium. The memory 1720 may be used to store instructions, programs, code, code sets, or instruction sets. The memory 1720 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the various method embodiments described below, etc.; the data storage area may store data created according to the use of the electronic device, etc.

[0299] In addition, those skilled in the art will understand that the structure of the terminal shown in the above figures does not constitute a limitation on the terminal. The terminal may include more (e.g., screen, communication components, display components, microphone) or fewer components than shown, or combine certain components, or have different component arrangements.

[0300] This application provides a computer-readable storage medium storing at least one computer instruction, which is executed by a processor to implement the dialog content display method as described in the above embodiments.

[0301] On the other hand, this application provides a computer program product, which includes computer instructions. When the processor executes the computer instructions, it implements the dialogue content display method as described in the above embodiments.

[0302] Those skilled in the art will recognize that the functions described in the embodiments of this application in one or more of the above examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0303] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for displaying dialogue content, the method being used on a terminal, the method comprising: In response to a dialogue-triggered operation, a conversational interface is displayed, which is an interface through which the user and the terminal interact with each other via dialogue. In response to a first dialogue instruction, a first dialogue content component corresponding to the first dialogue instruction is displayed in the dialogue content sequence of the dialogue interface. The dialogue content sequence is used to display the dialogue content components in the order of the dialogue. The dialogue content component includes a dialogue instruction and an instruction response result to the dialogue instruction. The instruction response result includes at least one of generative content, a called service, and a called application.

2. The method according to claim 1, wherein, The step of responding to a first dialogue instruction by displaying a first dialogue content component corresponding to the first dialogue instruction in the dialogue content sequence of the dialogic interface includes at least one of the following: In response to the first dialogue instruction, if the first dialogue instruction indicates the invocation of a generative function, the first dialogue content component containing the first dialogue instruction and the generative content is displayed in the dialogue content sequence of the dialogue interface. In response to the first dialogue instruction, if the first dialogue instruction indicates the invocation of a target service, the first dialogue content component containing the first dialogue instruction and a target service card is displayed in the dialogue content sequence of the conversational interface, the target service card being used to provide the target service; In response to the first dialogue instruction, if the first dialogue instruction indicates the invocation of a target application, the first dialogue content component containing the first dialogue instruction and a target application card is displayed in the dialogue content sequence of the conversational interface, the target application card being used to trigger the display of the target application.

3. The method according to claim 2, wherein, The first dialogue content component, which includes the first dialogue instruction and generative content, is displayed in the dialogue content sequence of the conversational interface, including: The first dialogue content component, having a first size, containing the first dialogue instruction and the generative content, is displayed in the dialogue content sequence of the conversational interface. The method further includes: In response to a second dialogue instruction, a first dialogue content component with a second size, comprising the first dialogue instruction and the generative content, is displayed in the dialogue content sequence, and a second dialogue content component corresponding to the second dialogue instruction is displayed in the dialogue content sequence of the conversational interface. The second dialogue content component includes the second dialogue instruction and the instruction response result to the second dialogue instruction, and the second size is smaller than the first size.

4. The method according to claim 3, wherein, When displaying the first dialogue content component having the second size, the method further includes: In response to a triggering operation on the first dialogue content component, the first dialogue content component, containing the first dialogue instruction and the generative content, and having the first size, is displayed in the dialogue content sequence.

5. The method according to claim 2, wherein, In response to the first dialogue instruction, when the first dialogue instruction indicates the invocation of a target application, displaying the first dialogue content component, which includes the first dialogue instruction and the target application card, in the dialogue content sequence of the conversational interface includes: In response to the first dialogue instruction, if the first dialogue instruction indicates that the target application is invoked, a target application view of the target application is displayed on top of the conversational interface; In response to a trigger operation on a close control in the target application view, the display of the target application view is stopped, and the first dialogue content component containing the first dialogue instruction and the target application card is displayed in the dialogue content sequence of the conversational interface.

6. The method according to claim 5, wherein, After displaying the target application view of the target application on top of the dialogic interface, the method further includes: In response to the second dialogue instruction, the display of the target application view is stopped, and the first dialogue content component containing the first dialogue instruction and the target application card, as well as the second dialogue content component corresponding to the second dialogue instruction, are displayed in the dialogue content sequence of the conversational interface.

7. The method according to claim 5, wherein, The method further includes: In response to a triggering operation on a full-screen control in the target application view, the target application is displayed in full screen.

8. The method according to claim 7, wherein, The method further includes: In response to a triggering operation on the full-screen control in the target application view, display a dialog return control; in response to a triggering operation on the dialog return control, redisplay the dialog interface; and / or, In response to a multitasking call-out operation, the task card corresponding to the conversational interface is displayed in the multitasking interface; in response to a trigger operation on the task card corresponding to the conversational interface, the conversational interface is redisplayed.

9. The method according to claim 2 or 5, wherein, When the first dialogue content component includes the first dialogue instruction and the target application card, the method further includes: In response to a triggering operation on the first dialogue content component, a target application view of the target application is displayed on top of the dialogue interface.

10. The method according to any one of claims 1 to 9, wherein, The step of responding to a first dialogue instruction by displaying a first dialogue content component corresponding to the first dialogue instruction in the dialogue content sequence of the conversational interface includes: In response to the first dialogue instruction, the instruction response result to the first dialogue instruction is determined based on at least one of the historical dialogue content components in the dialogue content sequence and the application content of the origin application, wherein the origin application is the application displayed in the foreground when the dialogue trigger operation is received. Based on the first dialogue instruction and the instruction response result, the first dialogue content component corresponding to the first dialogue instruction is displayed in the dialogue content sequence.

11. The method according to any one of claims 1 to 10, wherein, The step of displaying a conversational interface in response to a dialogue trigger operation includes: In response to the dialogue triggering operation, if an origin application exists, the dialogic interface is displayed, which includes the origin application view in a first display state, wherein the origin application is the application displayed in the foreground when the dialogue triggering operation is received, and the view size of the origin application view in the first display state is smaller than the full screen size.

12. The method according to claim 11, wherein, The method further includes: If the total display length of the dialogue content components in the dialogue content sequence is greater than a first threshold and less than a second threshold, the origin application view of the second display state is displayed, and the view size of the origin application view of the second display state is smaller than the view size of the origin application view of the first display state. If the total display length of the dialogue content components in the dialogue content sequence is greater than the second threshold, the origin application view of the third display state is displayed, and the view size of the origin application view of the third display state is smaller than the view size of the origin application view of the second display state. The origin application view in the first display state and the origin application view in the second display state support in-view interaction, while the origin application view in the third display state does not support in-view interaction.

13. The method according to claim 12, wherein, The method further includes: In response to a triggering operation on a full-screen control in the origin application view of the first display state and / or the origin application view of the second display state, stop displaying the dialogic interface; and / or, In response to a triggering operation that applies a view to the origin of the third display state, the display of the conversational interface is stopped.

14. The method according to any one of claims 1 to 13, wherein, The method further includes: In response to a trigger operation on an empty area in the dialog interface, stop displaying the dialog interface; and / or, In response to a third dialogue instruction, the dialog interface is stopped from being displayed if the third dialogue instruction indicates that the dialogue should be ended.

15. The method according to any one of claims 1 to 14, wherein, The display area includes a first display layer, a second display layer, and a third display layer, wherein the third display layer is located above the second display layer, and the second display layer is located above the first display layer; The first display layer includes a desktop display area; the second display layer includes an origin application view display area and a dialogue content sequence display area; and the third display layer includes a dialogue command input area. The desktop display area is used to display the desktop or foreground application, the origin application view display area is used to display the application view of the origin application, the origin application is the application displayed in the foreground when the dialogue trigger operation is received, and the dialogue content sequence display area is used to display the dialogue content sequence.

16. The method according to claim 15, wherein, The third display layer also includes an application view display area, which is used to display the application view of the invoked application.

17. A dialog content display device, the device comprising: The interface display module is used to display a conversational interface in response to a dialogue trigger operation. The conversational interface is an interface through which the user and the terminal interact with each other via dialogue. A component display module is configured to respond to a first dialogue instruction by displaying a first dialogue content component corresponding to the first dialogue instruction in a dialogue content sequence of the dialogic interface. The dialogue content sequence is configured to display the dialogue content components in the order of the dialogue. The dialogue content component includes a dialogue instruction and an instruction response result to the dialogue instruction. The instruction response result includes at least one of generative content, a called service, and a called application.

18. A terminal comprising a processor and a memory, the memory storing at least one computer instruction, the at least one computer instruction being loaded and executed by the processor to implement the dialog content display method as described in any one of claims 1 to 16.

19. A computer-readable storage medium storing at least one computer instruction, the at least one computer instruction being executed by a processor to implement the dialog content display method as described in any one of claims 1 to 16.

20. A computer program product comprising computer instructions, wherein a processor, when executing the computer instructions, implements the dialog content display method as described in any one of claims 1 to 16.

Images