An interaction method, device, storage medium and electronic device

Abstract

The application relates to an interaction method and device, a storage medium and an electronic device, and relates to the field of human-computer interaction. The application comprises the following steps: based on interaction information between a target user and an interaction intelligent agent, at least one form of an interaction card is displayed in a target region corresponding to the target user in a target screen. Compared with related technologies, the application can display at least one form of a card in a target region corresponding to a target user in a target screen according to interaction information between the target user and an interaction intelligent agent corresponding to the target screen, so that the application can display at least one form of an interaction card in different regions in the target screen in the case that the target user is in different positions and / or the target user is different, meet the use requirements of users in different scenarios, and improve the user experience.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, specifically to an interaction method, device, storage medium, and electronic device. Background Technology

[0002] In related technologies, during the interaction between users and terminal devices, the terminal devices can only display the interaction results in fixed positions and in fixed interaction forms such as text, which cannot meet the interaction needs of users in different scenarios. Summary of the Invention

[0003] In view of this, this application provides an interaction method, device, storage medium and electronic device, the main purpose of which is to improve the technical problem that in the process of users interacting with terminal devices, the terminal devices can only display the interaction results in a fixed position according to fixed interaction forms such as text, which cannot meet the interaction needs of users in different scenarios.

[0004] Firstly, this application provides an interaction method, including:

[0005] Based on the interaction information between the target user and the interactive intelligent agent, at least one type of interactive card is displayed in the target area corresponding to the target user on the target screen.

[0006] Optionally, at least one aspect includes at least one of position, size, color, and shape.

[0007] Optionally, at least one form of the interactive card includes a first interactive card of a first form and / or a second interactive card of a second form, wherein the second interactive card includes an interactive area and a business area.

[0008] Optionally, the interaction information includes interaction information input by the target user to the interactive agent, and / or interaction information generated by the interactive agent, wherein the interaction information generated by the interactive agent includes at least one of thinking information, execution information, and response information.

[0009] Optionally, the interactive card includes a card embedded in the target display area and / or a card floating on top of the target display area.

[0010] Optionally, the step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent includes: Based on the interaction type of the interaction information, different types of interaction information are displayed in the interaction card, and / or preset information is displayed in the interaction card.

[0011] Optionally, the preset information includes at least one of blank information, custom information, and initial information.

[0012] Optionally, the interaction information includes first interaction information and second interaction information, wherein the first interaction information and the second interaction information are interaction information of different interaction types, the first interaction information includes interaction information of action and / or touch operation, and the second interaction information includes interaction information of voice interaction.

[0013] Optionally, displaying at least one type of interactive card in the target area corresponding to the target user on the target screen includes: The first interactive card in the first form displays the first dialogue information, and / or the second interactive card in the second form displays the second dialogue information and the business information of the target content in the second dialogue information.

[0014] Optionally, displaying the second dialogue information and the business information of the target content in the second dialogue information in the second interactive card of the second form includes: In response to the target user's target instruction based on the first interactive card, the second dialogue information and the business information are displayed in the second interactive card, wherein the target instruction includes at least one of voice instructions, action instructions, and touch operation instructions.

[0015] Optionally, displaying the second dialogue information and the business information of the target content in the second dialogue information in the second interactive card of the second form includes: In response to the target user's touch operation command on the operable control corresponding to the target content, the second dialogue information and the business information of the target content in the second dialogue information are displayed in the second interactive card of the second form.

[0016] Optionally, displaying the first dialogue information in the first interactive card of the first form includes: When the first dialogue information is voice interaction information input by the target user, the text information corresponding to the voice interaction information is displayed, and the text information is updated to target text information, which is obtained by correcting the text information.

[0017] Optionally, the text information corresponding to the voice interaction information may include: The text information is displayed in the text display area of ​​the first interactive card.

[0018] Optionally, the step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent includes: Based on the first type of interactive information, the preset information is displayed in the interactive card, wherein the first type of interactive information is interactive information that is triggered by the target user based on the target interactive window and / or virtual image corresponding to the interactive agent and does not have target interactive content.

[0019] Optionally, the first interaction information and the second interaction information are interaction information of different interaction types. The first interaction information includes interaction information of action and / or touch operation, and the second interaction information includes interaction information of voice interaction.

[0020] Optionally, the business information includes at least one of the following: control information of device components, usage or calling information of application programs, usage or calling information of large models, and usage or calling information of external functions.

[0021] Optionally, the method further includes: displaying the text information corresponding to the voice interaction information, including: The text information is displayed in the text display area of ​​the first interactive card.

[0022] Optionally, the method further includes: The control information of the target device is displayed in the interactive card in the form of the target device, which is the device that the interactive agent connects to.

[0023] Optionally, the step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent includes: When the target user is located in the first area corresponding to the left side of the target screen, at least one type of interactive card is displayed in the first card display area of ​​the left side; or, When the target user is in the second area corresponding to the right side of the target screen, at least one form of the interactive card is displayed in the second card display area of ​​the right side area.

[0024] Optionally, the step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent includes: When the target user interacts with the first interactive agent corresponding to the first screen, based on the interaction information of the target user interacting with the second interactive agent corresponding to the second screen, at least one form of the interactive card is displayed in the target area corresponding to the target user on the second screen.

[0025] Optionally, the method further includes: Based on the interaction information between the target user and the interactive intelligent agent, the target posture of the virtual avatar is displayed.

[0026] Optionally, the method further includes: If the interactive card continues to be displayed for the target duration, cancel the display of the interactive card; and / or, Based on the interaction information between the target user and the interactive agent corresponding to the target screen, the display of the interactive card is canceled.

[0027] Optionally, the method further includes: Based on the wake-up information of the target user, a target interactive window is displayed in the target area, wherein the wake-up information includes at least one of gaze information, voice information, motion information, and touch operation information.

[0028] Optionally, at least one functional control is provided at the bottom of the interactive card, and the functional control includes at least one of the following: an interactive information sending control, a historical information viewing control, and a tool call control.

[0029] Secondly, this application provides an interactive device, comprising: The display module is configured to display at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent.

[0030] Thirdly, this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the interaction method described in the first aspect.

[0031] Fourthly, this application provides an electronic device, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor executes the computer program to implement the interaction method described in the first aspect.

[0032] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the interaction method described in the first aspect.

[0033] By employing the above technical solutions, this application provides an interaction method, apparatus, storage medium, and electronic device, comprising: displaying at least one form of interactive card in a target area corresponding to the target user on the target screen based on interaction information between the target user and the interactive intelligent agent corresponding to the target screen. Compared with related technologies, this application can display at least one form of card in a target area corresponding to the target user on the target screen according to the interaction information between the target user and the interactive intelligent agent. This allows the application to display at least one form of interactive card in different areas of the target screen when the target user is in different locations and / or when the target user is different users, meeting the user's usage needs in different scenarios and improving the user experience.

[0034] The above description is only an overview of the technical solution of this application. In order to better understand the technical means of this application and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this application more obvious and understandable, the following are specific embodiments of this application. Attached Figure Description

[0035] The accompanying drawings, which are included to provide a further understanding of this disclosure and form part of this disclosure, illustrate exemplary embodiments of the present disclosure and are used to explain the disclosure, but do not constitute an undue limitation of the disclosure. In the drawings: Figure 1 A flowchart illustrating an interaction method provided in an embodiment of this disclosure is shown; Figure 2 A schematic diagram illustrating an example provided by an embodiment of this disclosure is shown; Figure 3 A schematic diagram illustrating an example provided by an embodiment of this disclosure is shown; Figure 4 A flowchart illustrating an interaction method provided in an embodiment of this disclosure is shown; Figure 5 A schematic diagram illustrating an example provided by an embodiment of this disclosure is shown; Figure 6 A schematic diagram illustrating an example provided by an embodiment of this disclosure is shown; Figure 7 A schematic diagram illustrating an example provided by an embodiment of this disclosure is shown; Figure 8 A schematic diagram illustrating an example provided by an embodiment of this disclosure is shown; Figure 9 A schematic diagram illustrating an example provided by an embodiment of this disclosure is shown; Figure 10 A schematic diagram of the structure of an interactive device provided in an embodiment of this disclosure is shown; Figure 11A schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure is shown. Detailed Implementation

[0036] To better understand the above-mentioned objectives, features, and advantages of this application, the solution of this application will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described in these embodiments can be combined with each other.

[0037] To address the technical problem that terminal devices can only display interaction results in fixed locations and with fixed interaction formats such as text during user interaction with related technologies, thus failing to meet the interaction needs of users in different scenarios, this embodiment provides an interaction method, such as... Figure 1 As shown, the method includes: Step 101: Based on the interaction information between the target user and the interactive intelligent agent, display at least one type of interactive card in the target area corresponding to the target user on the target screen.

[0038] It should be noted that the execution subject of this application embodiment can be a terminal device, which can be a terminal device equipped with an interactive screen. For example, the terminal device can be, but is not limited to, a vehicle, a robot, etc.; wherein, when the terminal device is a vehicle, the vehicle can be a vehicle of different drive types, such as an electric vehicle, a fuel vehicle, etc.; the vehicle can also be a vehicle of different models, such as a sedan, a commercial vehicle, etc.

[0039] In some examples, the target user can be a user who interacts with the terminal device. For example, the target user can be a user inside the terminal device who interacts with a target screen inside the terminal device, or a user outside the terminal device who interacts with a target screen outside the terminal device. No specific limitation is made here.

[0040] In this application embodiment, the target screen can be a screen of the terminal device that can interact with the user, or it can be a screen that displays interactive cards after the user interacts with other screens; for example, if the terminal device is a vehicle, and the second-row user interacts with the second-row screen, at least one form of interactive card can be displayed on the second-row screen and / or the front vehicle screen, then the second-row screen and / or the front vehicle screen can be the target screen in this application embodiment.

[0041] For example, the target screen can be a screen inside the terminal device that can interact with the target user, or it can be a screen outside the terminal device that can interact with the target user. For instance, if the terminal device is a vehicle, the target screen can be the in-vehicle infotainment screen inside the vehicle; if the terminal device is a robot, the target screen can be a screen set on the robot's shell, and so on. No further examples will be given here.

[0042] In this embodiment, the interactive intelligent agent can be an intelligent agent set on the target screen that can interact with the target user through the target screen; for example, the interactive intelligent agent can be a voice assistant set on the target screen.

[0043] As an alternative approach, the interaction information can be the interaction information between the target user and the interactive agent; for example, it can include the interaction information input by the target user to the interactive agent, and it can also include the interaction information output by the interactive agent to the target user, without being specifically limited here.

[0044] For example, interactive information may include various forms of interactive information; for example, it may include, but is not limited to, voice interactive information, action interactive information, touch operation information, etc.; among which, voice interactive information may include voice information input by the target user to the interactive agent, and may also include voice information broadcast by the interactive agent to the target user.

[0045] In some examples, at least one type of interactive card can be multiple interactive cards of one type, or one interactive card of one type, or one interactive card of multiple types. The specific number of interactive cards is not specifically limited in the embodiments of this application.

[0046] For example, the interactive card can be a card used to display information. For instance, the interactive card can display the interaction information between the target user and the interactive intelligent agent, the device information of the terminal device, and the screen information of the target screen. It should be noted that the interactive card in this embodiment can be a card with information or a blank card, and there is no limitation in this embodiment.

[0047] Optionally, at least one aspect includes at least one of position, size, color, and shape.

[0048] In the embodiments of this application, at least one form can be the form of an interactive card; the interactive card of at least one form may include, but is not limited to, an interactive card with at least one position, an interactive card with at least one size, an interactive card with at least one color, an interactive card with at least one shape, etc., and is not specifically limited here.

[0049] For example, at least one interactive card can be displayed in different locations on the target screen. For instance, it can be displayed in a fixed location on the target screen (such as the left or right area of ​​the target screen), or it can be dynamically displayed on the target screen following the user's location. That is, the same or different cards can be displayed in different locations on the target screen, without any specific limitation.

[0050] For example, interactive cards of at least one size can be interactive cards that can be displayed on the target screen in different sizes or with different proportions on the screen. For example, they can be displayed on the target screen in a fixed size, or they can be displayed in a size that adapts to the target content according to the size or amount of interactive content. That is, the same or different cards can be displayed on the target screen in different sizes, without any specific limitation.

[0051] Optionally, at least one form of interactive card includes a first interactive card of a first form and / or a second interactive card of a second form, wherein the second interactive card includes an interactive area and a business area.

[0052] In the embodiments of this application, at least one type of interactive card may specifically include two different types of interactive cards. For example, it may include a first interactive card of a first form and / or a second interactive card of a second form. The difference between the first form and the second form in terms of form may include, but is not limited to, a difference in at least one of position, size, color and shape, which is not specifically limited here.

[0053] For example, such as Figure 2 As shown, this can be a schematic diagram of the first interactive card in the first form, such as... Figure 3 As shown, this can be a schematic diagram of the second interactive card in the second form. The first interactive card in this embodiment may include an interactive area ( Figure 2 The white area in the middle), the second interactive card can include an interactive area ( Figure 3 (white area in the middle) and business area ( Figure 3 The gray area in the image shows the interaction area of ​​the first interactive card and the second interactive card. The interaction areas in the first interactive card and the second interactive card can be the same or different. For example, in this embodiment, a business area can be spliced ​​on the interaction area of ​​the first interactive card to obtain the second interactive card. In this embodiment, an interaction area and a business area can be generated in other areas to obtain the second interactive card. No specific limitation is made here.

[0054] As an alternative approach, the business area can be a card area used to display business information generated based on interactive information from terminal devices and / or target screens. For example, business information may include, but is not limited to, control information of terminal devices on other devices, application call information, call information of third-party tools, usage information of large models, and so on. No further examples will be given here.

[0055] Optionally, the interaction information includes interaction information input by the target user to the interaction agent, and / or interaction information generated by the interaction agent, wherein the interaction information generated by the interaction agent includes at least one of thinking information, execution information and response information.

[0056] As an alternative approach, the interactive agent can generate different forms of interactive information, such as, but not limited to, thought information based on the interactive information input by the target user, action execution information determined by the interactive agent based on the interactive information input by the target user (e.g., turning on music, opening car windows, etc.), and response information of the interactive agent to the interactive information input by the target user (e.g., the interactive agent can answer when the target user inputs a question), etc., without specific limitations.

[0057] Optionally, interactive cards include cards embedded in the target display area and / or cards that float above the target display area.

[0058] For example, when displaying an interactive card on the target screen, if there is a window displaying other content at the location where the interactive card is displayed in the target display area, the interactive card can be displayed while floating in the target display area; if there is no window displaying other content at the location where the interactive card is displayed in the target display area, the interactive card can be displayed while embedded in the target display area, without any specific limitations.

[0059] Optionally, at least one functional control is provided at the bottom of the interactive card, including at least one of the following: an interactive information sending control, a history information viewing control, and a tool call control.

[0060] In some examples, the interactive card may have at least one functional control, that is, it may have only one functional control or it may have multiple functional controls; the functional controls may include a send control, a history information viewing control, and a tool call control, etc. It should be noted that the specific number and specific functions of the functional controls in the interactive card are not specifically limited in the embodiments of this application.

[0061] Compared with related technologies, this embodiment can display at least one type of card in the target area of ​​the target screen corresponding to the target user based on the interaction information between the target user and the interactive intelligent agent corresponding to the target screen. This allows the embodiment to display at least one type of interactive card in different areas of the target screen when the target user is in different locations and / or when the target user is a different user, thereby meeting the user's usage needs in different scenarios and improving the user experience.

[0062] As a refinement and extension of the above embodiments, this embodiment provides an interaction method. When performing the action of "displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent," this embodiment may include, but is not limited to, the following methods: Figure 4 As shown, the method includes: Step 201: Based on the interaction type of the interaction information, display different types of interaction information in the interaction card, and / or display preset information in the interaction card.

[0063] Optionally, the preset information includes at least one of blank information, custom information, and initial information.

[0064] Optionally, the interaction information includes first interaction information and second interaction information, wherein the first interaction information and the second interaction information are interaction information of different interaction types, the first interaction information includes interaction information of action and / or touch operation, and the second interaction information includes interaction information of voice interaction.

[0065] In the embodiments of this application, the first interaction information can be interaction information that the target screen can execute without thinking. For example, the first interaction information may include, but is not limited to, touch operation information (e.g., may include, but is not limited to, clicking, swiping, etc.) and the target user's action interaction information (e.g., may include, but is not limited to, gestures, body movements, etc.), without specific limitations.

[0066] As an optional approach, preset information can be displayed in the interaction card based on the first interaction information. For example, if the first interaction information is the target user's click information, preset information can be displayed in the interaction card based on the target user's click information, such as including but not limited to blank information, custom information, and initial information. If the first interaction information is the target user's swipe information, preset information can be displayed in the interaction card based on the target user's swipe information, such as including but not limited to blank information, custom information, and initial information, and so on. No further examples will be given here.

[0067] It should be noted that when the target user inputs the first interactive information to the interactive agent, the interactive agent may only display the card without showing the interactive information in the card; for example, if the user does not input any voice or other information that requires the interactive agent to interact with the target user again, the interactive agent may only display the card based on the first interactive information input by the target user.

[0068] Optionally, when performing the action of "displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent", the following methods may be used, but are not limited to: displaying preset information in the interactive card based on the first type of interactive information, wherein the first type of interactive information is interactive information triggered by the target user based on the target interactive window and / or virtual image corresponding to the interactive intelligent agent, and which does not have target interactive content.

[0069] In the embodiments of this application, the first interactive card of the first form can be a dialogue card between the interactive intelligent agent and the target user. The first form can be a pre-set form of the dialogue card, or it can be a form that changes dynamically according to different interactive content, interactive scenarios, etc., without being specifically limited here.

[0070] In some examples, the target interaction window can be a window through which the interactive agent interacts with the target user. The target interaction window can be an interaction window of different shapes, such as a capsule-shaped interaction window, or an interaction window displayed through a virtual avatar, etc., without specific limitations.

[0071] As an alternative approach, if the target interactive window is a capsule window with a virtual avatar on it, and the first interactive information is click information, then this embodiment of the application can display the first interactive card of the first form in the card display area corresponding to the capsule window based on the target user's click information in the capsule window; this embodiment of the application can also display the first interactive card of the first form in the card display area corresponding to the capsule window based on the target user's click information on the virtual avatar in the capsule window, and so on, without further examples here.

[0072] In this embodiment of the application, the second interactive information can be interactive information that the target screen can execute by thinking. For example, the second interactive information may include, but is not limited to, voice interactive information (e.g., the target user interacts with the interactive agent by voice) and text interactive information (e.g., the target user interacts with the interactive agent by inputting text on the target screen). No specific limitation is made here.

[0073] As an alternative approach, based on the second interactive information, different types of interactive information can be displayed in the target area of ​​the target screen. For example, if the second interactive information is the target user's voice information, the target user's voice information and the business information of the target content in the voice information can be displayed on the interactive card. If the first interactive information is the target user's text information, the target user's text information and the business information of the target content in the text information can be displayed on the interactive card, and so on. No further examples will be given here.

[0074] Optionally, business information includes at least one of the following: control information of equipment components, usage or calling information of application programs, usage or calling information of large models, and usage or calling information of external functions.

[0075] As an alternative approach, the control information of the device components may include, but is not limited to, the control information of other devices in the terminal device where the target screen is located; if the target screen is the vehicle infotainment screen in a vehicle, the device control information may be the control information of other devices in the vehicle, such as, but not limited to, the control information of devices such as windows, seats, and air conditioning.

[0076] In some examples, application usage or invocation information may include, but is not limited to, application usage or invocation information on the target screen; if the target screen is the vehicle's infotainment system screen, the application usage or invocation information may include, but is not limited to, application usage or invocation information on the infotainment system screen; for example, music playback information, music program invocation information, video playback information, video program invocation information, etc., without specific limitations.

[0077] In this embodiment, the usage or calling information of the large model can be the usage or calling information of the large model and / or database that the interactive intelligent agent can call; if the target screen is the vehicle screen, the usage or calling information of the large model can be the usage or calling information of the large model or database that the vehicle screen can use, and no specific limitation is made here.

[0078] In some examples, the information on the use or invocation of external functions can be the information on the use or invocation of functions that do not exist in the terminal device where the target screen is located; if the target screen is the in-vehicle infotainment screen in a vehicle, the information on the use or invocation of external functions can be the information on the use or invocation of functions that do not exist in the vehicle, such as the information on the use or invocation of smart home devices, etc.

[0079] Optionally, but not limited to, the following methods may be used, including: displaying the connection entry information of the target intelligent agent in the interactive card, where the target intelligent agent is the intelligent agent that the target user needs to bind and / or log in to.

[0080] In some examples, the target intelligent agent can be an intelligent agent of a smart terminal such as a smart home or a vehicle; when the target intelligent agent is a smart home, the connection entry information of the smart home can be displayed in the interactive card; when the target intelligent agent is a vehicle, the connection entry information of the vehicle can be displayed in the interactive card.

[0081] As an optional method, the access information can be displayed in the form of a QR code or a home button. This application does not impose specific limitations on the display format of the access information.

[0082] In the embodiments of this application, the target intelligent agent can be the intelligent agent that the target user needs to bind; for example, if the intelligent agent that the user needs to bind is the intelligent agent of the smart home, then the intelligent agent of the smart home can be the target intelligent agent of this application embodiment; if the intelligent agent that the user needs to log in to the account is the intelligent agent of the smart home, then the intelligent agent of the smart home can be the target intelligent agent of this application embodiment, and so on.

[0083] Optionally, but not limited to, the following methods may be used: displaying the control information of the target device in the target format in an interactive card, wherein the target device is a device connected to the interactive intelligent agent.

[0084] As an alternative approach, the target device can be a controllable device such as a smart home device, a vehicle seat, or a window. The target device can also be a smart terminal device such as smart glasses or smart headphones; these are not listed here, and this application does not impose specific limitations. For example, when the interactive smart agent communicates with smart glasses, the smart glasses can be the target device in this application's embodiments; when the interactive smart agent communicates with smart headphones, the smart headphones can be the target device in this application's embodiments.

[0085] In the embodiments of this application, displaying control information in the interactive card according to the target format can be as follows: Figure 5 As shown, control information can be located in the lower half of the interactive card; the target format can be one or more of the following: list format, chart format, image format, or text format. Examples are not provided here, and this application embodiment does not impose specific limitations on this.

[0086] Optionally, when performing the action of "displaying at least one type of interactive card in the target area corresponding to the target user on the target screen", the following methods may be used, but not limited to: displaying first dialogue information in the first interactive card of the first type, and / or displaying second dialogue information and business information of the target content in the second interactive card of the second type.

[0087] As an alternative approach, in this embodiment of the application, the dialogue information between the target user and the interactive intelligent agent can be displayed in the first interactive card; the dialogue information between the target user and the interactive intelligent agent and the business information of the target content in the dialogue information can also be displayed in the second interactive card. That is, the dialogue information between the target user and the interactive intelligent agent can be displayed in the first interactive card of the second interactive card, and the business information of the target content in the dialogue information can be displayed in the business area of ​​the second interactive card.

[0088] It should be noted that the response information generated by the interactive agent may include business information; the response information generated by the interactive agent may be displayed only through the first interactive card, or only through the interactive area in the second interactive card; it may also be displayed through both the interactive area and the business area in the second interactive card, without any specific limitations here.

[0089] In some examples, the first dialogue information displayed in the first interactive card and the second dialogue information displayed in the second interactive card may be the same or different, and no specific limitation is made here.

[0090] For example, if the target screen is a screen in a vehicle, and the dialogue information is "Help me find the route to location A", the text information "Help me find the route to location A" and the response information of the interactive agent to "Help me find the route to location A" can be displayed in the first interaction card. The route information to location A can also be displayed in the business area of ​​the second interaction card, and so on. No further examples will be given here.

[0091] Optionally, when performing the action of "displaying second dialogue information and business information of target content in the second interactive card in the second form", the following methods may be used, but are not limited to these, including: in response to the target user's target instruction based on the first interactive card, displaying the second dialogue information and business information in the second interactive card, wherein the target instruction includes at least one of voice instruction, action instruction and touch operation instruction.

[0092] In some examples, the target instruction can be an instruction from the target user based on the first interactive card; for example, the target instruction may include, but is not limited to, the target user's touch operation instruction in the first interactive card, the target user's voice instruction based on the target content in the first interactive card, the action instruction, etc., without specific limitations.

[0093] As an alternative approach, if the target screen is a screen in a vehicle, and the dialogue message is "Help me find the route to location A," the text message "Help me find the route to location A" and the interactive agent's response to "Help me find the route to location A" can be displayed in the first interactive card. Alternatively, based on the target user's touch operation command using the route display control in the first interactive card, the route information to location A can be displayed in the business area of ​​the second interactive card. Or, based on the target user's voice command "Show route," the route information to location A can be displayed in the business area of ​​the second interactive card, and so on. Further examples will not be provided here.

[0094] Optionally, when performing the action of "displaying the second dialogue information and the business information of the target content in the second interactive card in the second form", the following methods may be used, but are not limited to: responding to the target user's touch operation command on the operable control corresponding to the target content, displaying the second dialogue information and the business information of the target content in the second interactive card in the second form.

[0095] As an alternative approach, if the target screen is a screen in a vehicle, and the dialogue message is "Help me play a song with lyrics A", the text message "Help me play a song with lyrics A" and the song information with lyrics A found by the interactive agent can be displayed in the first interactive card. Alternatively, based on the target user's touch operation command on the song information in the first interactive card, the specific song with lyrics A can be displayed in the business area of ​​the second interactive card, and so on. No further examples will be given here.

[0096] As an alternative approach, if the target screen is a screen in a vehicle, and the dialogue message is "Help me find detailed information about content A," the text message "Help me find detailed information about content A," as well as the detailed information about content A found by the interactive agent, can be displayed in the first interaction card. Furthermore, based on the target user's touch operation command on the control corresponding to the detailed information, the model information, database information, acquisition link information, etc., used to obtain the detailed information about content A can be displayed in the business area of ​​the second interaction card, and so on. No further examples will be given here.

[0097] Optionally, when performing "displaying the first dialogue information in the first interactive card of the first form", the following methods may be used, but not limited to these, including: if the first dialogue information is voice interaction information input by the target user, displaying the text information corresponding to the voice interaction information, and updating the text information to the target text information, wherein the target text information is obtained by correcting the text information.

[0098] In some examples, when the target user inputs voice information, the interactive agent can correct the voice information. That is, it can first display the text information converted from the voice (i.e., the text information corresponding to the voice interaction information in this application embodiment), and then update the text information to obtain the corrected text information (i.e., the target text information in this application embodiment). In other words, the interactive agent in this application embodiment can accurately identify the user's intent and improve the user experience.

[0099] As an alternative approach, if the target user inputs voice information, and the target user's input voice is "Call Li Yang, Yang is the ocean", then the interactive intelligent agent can correct the voice information. That is, it can first display the voice converted to text information "Call Li Yang, Yang is the ocean", and then update it according to the text information to obtain the corrected text information "Call Li Yang", thereby accurately identifying the user's intent.

[0100] As an alternative approach, if the target user inputs voice information and the input voice is "I want to go to that target location called something", the interactive agent can correct the voice information. That is, it can first display the voice converted to text information "I want to go to that target location called something", and then update the corrected text information "I want to go to the target location" based on the text information, thereby accurately identifying the user's intention.

[0101] Optionally, when performing the "display text information corresponding to voice interaction information", the following methods may be used, but not limited to these, including: displaying text information in the text display area of ​​the first interaction card.

[0102] As an optional approach, such as Figure 6 As shown, the text display area can be set in the upper half of the first interactive card; the text display area can be a fixed area or a dynamically changing area; when the text display area is a dynamically changing area, the size of the text display area can change according to the length of the text. This application embodiment does not limit the display form of the text display area.

[0103] Optionally, when performing the action of "displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent", the following methods may be used, but are not limited to: when the target user is in the first area corresponding to the left side of the target screen, displaying at least one type of interactive card in the first card display area of ​​the left side; or, when the target user is in the second area corresponding to the right side of the target screen, displaying at least one type of interactive card in the second card display area of ​​the right side.

[0104] In the embodiments of this application, the target area can be divided into left and right areas, top and bottom areas, etc., according to the location of the target user, without specific limitations. For example, when the target screen is the in-vehicle infotainment screen in a vehicle, the target area in the target screen can be divided into left and right areas, and so on, without further examples.

[0105] In some examples, when the target region is divided into a left region and a right region, such as Figure 7 As shown, depending on the target user's position relative to the target screen, at least one type of interactive card can be displayed in the left or right area; for example, if the target user is on the left side of the target screen, at least one type of interactive card can be displayed in the left area; if the target user is on the right side of the target screen, such as... Figure 8 As shown, at least one type of interactive card can be displayed in the right-hand area, so that the target user can clearly see the interactive card displayed on the screen when in different areas, meeting the user's usage needs in different scenarios and improving the user experience.

[0106] As an alternative approach, when the target screen is the vehicle's infotainment screen, if the target user is the primary driver, the target user can be determined to be on the left side of the target screen, and at least one type of interactive card can be displayed in the left area; conversely, if the target user is the secondary driver, the target user can be determined to be on the right side of the target screen, and at least one type of interactive card can be displayed in the right area. Examples will not be listed here.

[0107] In some examples, when the driver interacts with the front-seat infotainment screen, if the driver stops interacting and the passenger starts interacting, the interaction card can be switched from the left side of the front-seat infotainment screen to the right side, or two interaction cards can be displayed simultaneously on both the left and right sides of the front-seat infotainment screen, or the interaction card can remain displayed on the left side of the front-seat infotainment screen. No specific limitation is made here.

[0108] In some examples, when the target screen is a two-row screen, if the user on the left side of the second row stops interacting and the user on the right side starts interacting, the interactive card can switch from being displayed on the left side of the second-row screen to being displayed on the right side. Alternatively, two interactive cards can be displayed simultaneously on both the left and right sides of the second-row screen, or the interactive card can remain displayed on the left side of the second-row screen; no specific limitation is made here. It should be noted that if there are screen size limitations, the initial interactive position of the interactive card can be maintained when switching users, without changing the position of the interactive card.

[0109] Optionally, when performing the action of "displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive agent", the following methods may be used, but are not limited to: when the target user interacts with the first interactive agent corresponding to the first screen, displaying at least one type of interactive card in the target area corresponding to the target user on the second screen based on the interaction information between the target user and the second interactive agent corresponding to the second screen.

[0110] For example, if there are multiple screens in the terminal device, if the target user switches to using the second interactive agent on the second screen to interact while interacting through the first interactive agent corresponding to the first screen, the display of interactive cards on the first screen can be switched to displaying at least one form of interactive card in the target area corresponding to the target user on the second screen.

[0111] As an alternative approach, if the target user interacts with the first interactive agent corresponding to the first screen via voice, and then interacts with the second interactive agent corresponding to the second screen via voice, the display of interactive cards on the first screen can be switched to displaying at least one form of interactive card in the target area corresponding to the target user on the second screen; alternatively, interactive cards can be displayed on both the first and second screens, without specific limitations.

[0112] Optionally, this embodiment may also employ the following methods, but not limited to these, including: displaying the target posture of the virtual avatar based on the interaction information between the target user and the interactive intelligent agent.

[0113] In this embodiment of the application, the virtual avatar can be the virtual avatar corresponding to the interactive intelligent agent, for example, such as Figure 9 As shown, the virtual avatar can be a virtual avatar set on the target screen, a virtual avatar set on the target interactive window, or a virtual avatar set on an interactive card; no specific limitation is made here.

[0114] For example, the virtual avatar can display different virtual images based on the interaction state between the target user and the interactive intelligent agent. For instance, when the target user inputs voice into the interactive intelligent agent, the virtual avatar can display a listening posture; when the interactive intelligent agent is thinking about the target user's voice, the virtual avatar can display a thinking posture; when the interactive intelligent agent replies to the target user's voice, the virtual avatar can display a speaking posture. And so on.

[0115] As an alternative approach, the virtual avatar can display different virtual images based on the interaction state between the target user and the interactive intelligent agent. For example, when the target user inputs voice into the interactive intelligent agent, the virtual avatar can display a listening posture; when the interactive intelligent agent is thinking about the target user's voice, the virtual avatar can display a thinking posture; when the interactive intelligent agent replies to the target user's voice, the virtual avatar can display a speaking posture. Examples will not be listed here.

[0116] As an alternative approach, the virtual avatar can display different virtual images depending on the execution state of the action. For example, when the interactive intelligent agent has completed actions such as control or broadcasting, the virtual avatar can display a happy posture; when the interactive intelligent agent has not completed actions such as control or broadcasting, the virtual avatar can display a head-shaking posture.

[0117] Optionally, this embodiment may also employ the following methods, but not limited thereto: canceling the display of the interactive card if the interactive card is continuously displayed for the target duration; and / or canceling the display of the interactive card based on the interaction information between the target user and the interactive agent corresponding to the target screen.

[0118] In some examples, the target duration can be a fixed duration or a range of durations. In this embodiment, the target duration can be a fixed duration determined based on the screen settings of the target screen, the interaction information of the target user, etc., or it can change with the changes in the screen settings of the target screen, the interaction information of the target user, etc., and is not specifically limited in this embodiment.

[0119] For example, in embodiments of this application, the interactive card can be collapsed when it is continuously displayed for the target duration without any update of interactive information. For instance, if the interactive card is a dialogue card (i.e., the first interactive card in this embodiment), and the dialogue card (i.e., the first interactive card in this embodiment) is continuously displayed for the target duration without any update of interactive information, the dialogue card (i.e., the first interactive card in this embodiment) can be collapsed or canceled from display. If the interactive card is a dialogue card and a business area (i.e., the second interactive card in this embodiment), and the business area is continuously displayed for the target duration without any update of interactive information, the business area can be collapsed or canceled from display, i.e., the display of both the dialogue card and the business area (i.e., the second interactive card in this embodiment) is changed to displaying only the dialogue card (i.e., the first interactive card in this embodiment). Furthermore, if the dialogue card (i.e., the first interactive card in this embodiment) is continuously displayed for the target duration without any update of interactive information, the dialogue card (i.e., the first interactive card in this embodiment) can be collapsed or canceled from display.

[0120] As an alternative approach, this application may also collapse or cancel the display of the target interactive window (e.g., an interactive window with a virtual image set on the capsule area) if no interactive information appears within a certain period of time after the dialog card (i.e., the first interactive card in the embodiment of this application) is collapsed or canceled. No specific limitation is made here.

[0121] Optionally, this embodiment may also employ the following methods, but not limited thereto: displaying a target interactive window in a target area based on the wake-up information of the target user, wherein the wake-up information includes at least one of gaze information, voice information, action information, and operation touch information.

[0122] In this embodiment, the wake-up information can be wake-up information for the target user to wake up the interactive intelligent agent. The wake-up information includes gaze information, voice information, action information, and operation touch information, etc. For example, the target user can wake up the interactive intelligent agent by gazing at the wake-up area in the target screen; the target user can also wake up the interactive intelligent agent by a voice wake-up command; the target user can also wake up the interactive intelligent agent by a terminal device or a wake-up control in the target screen, without specific limitations.

[0123] In some examples, embodiments of this application can display a target interaction window in a target area based on the wake-up information of the target user; for example, when the wake-up information is gaze information, the target interaction window is a capsule area, and a virtual image is set on the capsule area, the target interaction window can be woken up according to the gaze information of the target user gazing at the wake-up area. For example, the capsule area and the virtual image set on the capsule area can be displayed, wherein the virtual image can display a wake-up posture.

[0124] In some examples, when the wake-up information is a voice wake-up command, the target interaction window is a capsule area, and a virtual avatar is set on the capsule area, the target interaction window can be woken up according to the target user's voice wake-up command. For example, the capsule area and the virtual avatar set on the capsule area can be displayed, and the virtual avatar can display the wake-up posture.

[0125] As an optional approach, this application may include, but is not limited to, the following embodiments, including: Example 1: Based on the interaction information between the target user and the interactive intelligent agent, at least one type of interactive card is displayed in the target area corresponding to the target user on the target screen.

[0126] Example 2: At least one morphology includes at least one of position, size, color and shape.

[0127] Example 3: At least one form of interactive card includes a first interactive card of a first form and / or a second interactive card of a second form, wherein the second interactive card includes an interactive area and a business area.

[0128] Example 4: The interactive information includes interactive information input by the target user to the interactive agent, and / or interactive information generated by the interactive agent. The interactive information generated by the interactive agent includes at least one of thinking information, execution information and response information.

[0129] Example 5: Interactive cards include cards embedded in the target display area and / or cards floating on top of the target display area.

[0130] Example 6: Based on the interaction information between the target user and the interactive intelligent agent, at least one type of interactive card is displayed in the target area corresponding to the target user on the target screen, including: displaying different types of interactive information in the interactive card based on the interaction type of the interactive information, and / or displaying preset information in the interactive card.

[0131] Example 7: The preset information includes at least one of blank information, custom information, and initial information.

[0132] Example 8: The interactive information includes first interactive information and second interactive information. The first interactive information and the second interactive information are interactive information of different interaction types. The first interactive information includes interactive information of action and / or touch operation, and the second interactive information includes interactive information of voice interaction.

[0133] Example 9: Displaying at least one type of interactive card in the target area corresponding to the target user on the target screen, including: displaying first dialogue information in a first interactive card of a first form, and / or displaying second dialogue information and business information of the target content in the second interactive card of a second form.

[0134] Example 10: Displaying second dialogue information and business information of target content in the second interactive card in the second form includes: in response to a target user's target instruction based on the first interactive card, displaying the second dialogue information and business information in the second interactive card, wherein the target instruction includes at least one of voice instruction, action instruction and touch operation instruction.

[0135] Example 11: Displaying second dialogue information and business information of target content in the second interactive card in the second form, including: responding to the touch operation command of the target user on the operable control corresponding to the target content, displaying second dialogue information and business information of target content in the second interactive card in the second form.

[0136] Example 12: Displaying first dialogue information in the first interactive card of the first form includes: when the first dialogue information is voice interaction information input by the target user, displaying text information corresponding to the voice interaction information, and updating the text information to target text information, wherein the target text information is obtained by correcting the text information.

[0137] Example 13: Displaying text information corresponding to voice interaction information, including: displaying text information in the text display area of ​​the first interaction card.

[0138] Example 14: Based on the interaction information between the target user and the interactive intelligent agent, display at least one type of interactive card in the target area corresponding to the target user on the target screen, including: displaying preset information in the interactive card based on a first type of interactive information, wherein the first type of interactive information is interactive information triggered by the target user based on the target interactive window and / or virtual image corresponding to the interactive intelligent agent, and does not have target interactive content.

[0139] Example 15: Business information includes at least one of the following: control information of equipment components, usage or calling information of application programs, usage or calling information of large models, and usage or calling information of external functions.

[0140] Example 16: Display the connection entry information of the target intelligent agent in the interactive card. The target intelligent agent is the intelligent agent that the target user needs to bind and / or log in to.

[0141] Example 17: Display the control information of the target device in the target format in the interactive card. The target device is the device that the interactive intelligent agent connects to.

[0142] Example 18: Based on the interaction information between the target user and the interactive agent corresponding to the target screen, at least one type of interactive card is displayed in the target area corresponding to the target user on the target screen, including: when the target user is in the first area corresponding to the left side of the target screen, at least one type of interactive card is displayed in the first card display area in the left side area; or, when the target user is in the second area corresponding to the right side of the target screen, at least one type of interactive card is displayed in the second card display area in the right side area.

[0143] Example 19: Based on the interaction information between the target user and the interactive agent corresponding to the target screen, display at least one form of interactive card in the target area corresponding to the target user in the target screen, including: when the target user interacts with the first interactive agent corresponding to the first screen, display at least one form of interactive card in the target area corresponding to the target user in the second screen based on the interaction information of the target user interacting with the second interactive agent corresponding to the second screen.

[0144] Example 20: Based on the interaction information between the target user and the interactive intelligent agent, display the target posture of the virtual image.

[0145] Example 21: If the interactive card is continuously displayed for the target duration, cancel the display of the interactive card; and / or, based on the interaction information between the target user and the interactive agent corresponding to the target screen, cancel the display of the interactive card.

[0146] Example 22: Based on the wake-up information of the target user, display the target interactive window in the target area. The wake-up information includes at least one of gaze information, voice information, action information and operation touch information.

[0147] Example 23: At least one functional control is provided at the bottom of the interactive card. The functional control includes at least one of the following: interactive information sending control, historical information viewing control, and tool call control.

[0148] It should be noted that the interaction methods involved in the above embodiments may include at least one of embodiments 1 to 20. For example, embodiment 1 can be implemented as an independent embodiment, embodiment 1+2 can be implemented as an independent embodiment, embodiment 1+3 can be implemented as an independent embodiment, embodiment 1+2+3 can be implemented as an independent embodiment, embodiment 1+4 can be implemented as an independent embodiment, embodiment 1+2+4 can be implemented as an independent embodiment, embodiment 1+3+4 can be implemented as an independent embodiment, embodiment 1+2+3+4 can be implemented as an independent embodiment, embodiment 1+5 can be implemented as an independent embodiment, embodiment 1+2+5 can be implemented as an independent embodiment, embodiment 1+3+5 can be implemented as an independent embodiment, embodiment 1+2+3+5 can be implemented as an independent embodiment, and embodiment 1+4+5 can be implemented as an independent embodiment. Examples 1, 2, 4, and 5 can be implemented as independent embodiments, as can examples 1, 3, 4, and 5, as can examples 1, 2 ...

[0149] Compared with related technologies, this embodiment can display at least one type of card in the target area of ​​the target screen corresponding to the target user based on the interaction information between the target user and the interactive intelligent agent corresponding to the target screen. This allows the embodiment to display at least one type of interactive card in different areas of the target screen when the target user is in different locations and / or when the target user is a different user, thereby meeting the user's usage needs in different scenarios and improving the user experience.

[0150] Furthermore, as Figure 1 and Figure 4 To provide a specific implementation of the method shown, this embodiment offers an interactive device, such as... Figure 10 As shown, the device includes: display module 31.

[0151] The display module 31 is configured to display at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent.

[0152] In some examples of this embodiment, at least one form includes at least one of position, size, color, and shape.

[0153] In some examples of this embodiment, at least one type of interactive card includes a first interactive card of a first form and / or a second interactive card of a second form, wherein the second interactive card includes an interactive area and a business area.

[0154] In some examples of this embodiment, the interaction information includes interaction information input by the target user to the interaction agent, and / or interaction information generated by the interaction agent. The interaction information generated by the interaction agent includes at least one of thinking information, execution information, and response information.

[0155] In some examples of this embodiment, the interactive cards include cards embedded in the target display area and / or cards floating above the target display area.

[0156] In some examples of this embodiment, the display module 31 is specifically configured to display different types of interactive information in the interactive card based on the interaction type of the interactive information, and / or display preset information in the interactive card.

[0157] In some examples of this embodiment, the preset information includes at least one of blank information, custom information, and initial information.

[0158] In some examples of this embodiment, the interaction information includes first interaction information and second interaction information. The first interaction information and the second interaction information are interaction information of different interaction types. The first interaction information includes interaction information of action and / or touch operation, and the second interaction information includes interaction information of voice interaction.

[0159] In some examples of this embodiment, the display module 31 is further configured to display first dialogue information in a first interactive card of a first form, and / or to display second dialogue information and business information of the target content in the second interactive card of a second form.

[0160] In some examples of this embodiment, the display module 31 is further configured to display second dialogue information and business information in a second interactive card in response to a target user’s target instruction based on the first interactive card, wherein the target instruction includes at least one of voice instruction, action instruction and touch operation instruction.

[0161] In some examples of this embodiment, the display module 31 is further configured to respond to the touch operation command of the target user on the operable control corresponding to the target content, and display the second dialogue information and the business information of the target content in the second interactive card of the second form.

[0162] In some examples of this embodiment, the display module 31 is further configured to display the text information corresponding to the voice interaction information when the first dialogue information is the voice interaction information input by the target user, and update the text information to the target text information, which is obtained by correcting the text information.

[0163] In some examples of this embodiment, the display module 31 is further configured to display text information in the text display area of ​​the first interactive card.

[0164] In some examples of this embodiment, the display module 31 is further configured to display preset information in an interaction card based on a first type of interaction information. The first type of interaction information is interaction information triggered by the target user based on the target interaction window and / or virtual avatar corresponding to the interactive agent, and does not have target interaction content. In some examples of this embodiment, the first interaction information and the second interaction information are interaction information of different interaction types. The first interaction information includes interaction information involving actions and / or touch operations, and the second interaction information includes interaction information involving voice interaction.

[0165] In some examples of this embodiment, the business information includes at least one of the following: control information of device components, usage or calling information of application programs, usage or calling information of large models, and usage or calling information of external functions.

[0166] In some examples of this embodiment, the display module 31 is further configured to display the connection entry information of the target intelligent agent in the interactive card. The target intelligent agent is the intelligent agent that the target user needs to bind and / or log in to.

[0167] In some examples of this embodiment, the display module 31 is further configured to display the control information of the target device in the interactive card in the target form, wherein the target device is the device connected to the interactive intelligent agent.

[0168] In some examples of this embodiment, the display module 31 is further configured to display at least one type of interactive card in the first card display area in the left area when the target user is in the first area corresponding to the left side of the target screen; or, to display at least one type of interactive card in the second card display area in the right area when the target user is in the second area corresponding to the right side of the target screen.

[0169] In some examples of this embodiment, the display module 31 is further configured to, when the target user interacts with the first interactive agent corresponding to the first screen, display at least one form of interactive card in the target area corresponding to the target user on the second screen based on the interaction information of the target user interacting with the second interactive agent corresponding to the second screen.

[0170] In some examples of this embodiment, the display module 31 is specifically configured to display the target posture of the virtual image based on the interaction information between the target user and the interactive intelligent agent.

[0171] In some examples of this embodiment, the display module 31 is further configured to cancel the display of the interactive card when the interactive card is continuously displayed for a target duration; and / or, based on the interaction information between the target user and the interactive agent corresponding to the target screen, cancel the display of the interactive card.

[0172] In some examples of this embodiment, the display module 31 is further configured to display a target interactive window in a target area based on the wake-up information of the target user. The wake-up information includes at least one of gaze information, voice information, action information, and operation touch information.

[0173] In some examples of this embodiment, at least one functional control is provided at the bottom of the interactive card. The functional control includes at least one of the following: an interactive information sending control, a history information viewing control, and a tool call control.

[0174] It should be noted that other corresponding descriptions of the functional units involved in the interactive device provided in this embodiment can be found in [reference needed]. Figure 1 and Figure 4 The corresponding description in [the document] will not be repeated here.

[0175] Based on the above, Figure 1 and Figure 4Accordingly, this embodiment also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-described method. Figure 1 and Figure 4 The method shown.

[0176] Based on this understanding, the technical solution of this application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, or portable hard drive) and includes several instructions to cause a computer device (such as a personal computer, server, or network device) to execute the methods of various implementation scenarios of this application.

[0177] like Figure 11 The diagram shown is a hardware structure schematic of an electronic device according to the present invention, comprising: At least one processor 401; and, Memory 402 is communicatively connected to at least one processor 401; wherein, The memory 402 stores instructions that can be executed by at least one processor, which enables the at least one processor to perform the interaction method as described above.

[0178] Figure 11 Take a processor 401 as an example.

[0179] The electronic device may also include an input device 403 and a display device 404.

[0180] The processor 401, memory 402, input device 403, and display device 404 can be connected via a bus or other means. Figure 11 Taking the example of a connection between China and Israel via a bus.

[0181] Memory 402, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the interaction method in the embodiments of this application, for example, Figure 1 and Figure 4 The method flow is shown. The processor 401 executes various functional applications and data processing by running non-volatile software programs, instructions, and modules stored in the memory 402, thereby implementing the interactive method in the above embodiments.

[0182] Memory 402 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the interactive method, etc. Furthermore, memory 402 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some embodiments, memory 402 may optionally include memory remotely located relative to processor 401, and these remote memories may be connected to the apparatus performing the interactive method via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0183] Input device 403 can receive user clicks and generate signal inputs related to user settings and function control of the interaction method. Display device 404 may include display devices such as a display screen.

[0184] One or more modules are stored in memory 402, and when run by one or more processors 401, they execute the interactive methods in any of the above method embodiments.

[0185] Optionally, the aforementioned physical devices may also include a user interface, a network interface, a camera, radio frequency (RF) circuitry, sensors, audio circuitry, a Wi-Fi module, etc. The user interface may include a display screen, input units such as a keyboard, etc., and optional user interfaces may also include USB interfaces, card reader interfaces, etc. The network interface may optionally include standard wired interfaces, wireless interfaces (such as Wi-Fi interfaces), etc.

[0186] Those skilled in the art will understand that the physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or combine certain components, or have different component arrangements.

[0187] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the aforementioned physical device, supporting the operation of information processing programs and other software and / or programs. The network communication module is used to enable communication between the various components within the storage medium, as well as communication with other hardware and software in the information processing physical device.

[0188] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware platforms, or it can be implemented by hardware. By applying the solution of this embodiment, compared with related technologies, this embodiment can display at least one form of card in the target area corresponding to the target user on the target screen according to the interaction information between the target user and the interactive intelligent agent corresponding to the target screen. This allows this embodiment to display at least one form of interactive card in different areas of the target screen when the target user is in different positions and / or when the target user is different users, thereby meeting the user's usage needs in different scenarios and improving the user experience.

[0189] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the term "comprising" or any other variations thereof is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.

[0190] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. An interaction method, characterized in that, include: Based on the interaction information between the target user and the interactive intelligent agent, at least one type of interactive card is displayed in the target area corresponding to the target user on the target screen.

2. The method according to claim 1, characterized in that, At least one aspect includes at least one of position, size, color, and shape.

3. The method according to claim 1 or 2, characterized in that, The interactive card in at least one form includes a first interactive card of a first form and / or a second interactive card of a second form, wherein the second interactive card includes an interactive area and a business area.

4. The method according to any one of claims 1 to 3, characterized in that, The interaction information includes the interaction information input by the target user to the interaction agent, and / or the interaction information generated by the interaction agent. The interaction information generated by the interaction agent includes at least one of thinking information, execution information, and response information.

5. The method according to any one of claims 1 to 4, characterized in that, The interactive cards include cards embedded in the target display area and / or cards floating on top of the target display area.

6. The method according to any one of claims 1 to 5, characterized in that, The step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent includes: Based on the interaction type of the interaction information, different types of interaction information are displayed in the interaction card, and / or preset information is displayed in the interaction card.

7. The method according to claim 6, characterized in that, The preset information includes at least one of blank information, custom information, and initial information.

8. The method according to claim 6 or 7, characterized in that, The interactive information includes first interactive information and second interactive information. The first interactive information and the second interactive information are interactive information of different interaction types. The first interactive information includes interactive information of action and / or touch operation, and the second interactive information includes interactive information of voice interaction.

9. The method according to any one of claims 1 to 8, characterized in that, The step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen includes: The first interactive card in the first form displays the first dialogue information, and / or the second interactive card in the second form displays the second dialogue information and the business information of the target content in the second dialogue information.

10. The method according to claim 9, characterized in that, The second interactive card in the second form displays second dialogue information and business information of the target content in the second dialogue information, including: In response to the target user's target instruction based on the first interactive card, the second dialogue information and the business information are displayed in the second interactive card, wherein the target instruction includes at least one of voice instructions, action instructions, and touch operation instructions.

11. The method according to claim 9 or 10, characterized in that, The second interactive card in the second form displays second dialogue information and business information of the target content in the second dialogue information, including: In response to the target user's touch operation command on the operable control corresponding to the target content, the second dialogue information and the business information of the target content in the second dialogue information are displayed in the second interactive card of the second form.

12. The method according to any one of claims 9 to 11, characterized in that, The display of first dialogue information in the first interactive card of the first form includes: When the first dialogue information is voice interaction information input by the target user, the text information corresponding to the voice interaction information is displayed, and the text information is updated to target text information, which is obtained by correcting the text information.

13. The method according to claim 12, characterized in that, The text information corresponding to the voice interaction information includes: The text information is displayed in the text display area of ​​the first interactive card.

14. The method according to any one of claims 9 to 13, characterized in that, The step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent includes: Based on the first type of interactive information, the preset information is displayed in the interactive card, wherein the first type of interactive information is interactive information that is triggered by the target user based on the target interactive window and / or virtual image corresponding to the interactive agent and does not have target interactive content.

15. The method according to any one of claims 9 to 14, characterized in that, The business information includes at least one of the following: control information of equipment components, usage or calling information of application programs, usage or calling information of large models, and usage or calling information of external functions.

16. The method according to any one of claims 1 to 15, characterized in that, The method further includes: The interaction card displays the connection entry information of the target intelligent agent, which is the intelligent agent that the target user needs to bind and / or log in to.

17. The method according to any one of claims 1 to 16, characterized in that, The method further includes: The control information of the target device is displayed in the interactive card in the form of the target device, which is the device that the interactive agent connects to.

18. The method according to any one of claims 1 to 17, characterized in that, The step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent includes: When the target user is located in the first area corresponding to the left side of the target screen, at least one type of interactive card is displayed in the first card display area of ​​the left side; or, When the target user is in the second area corresponding to the right side of the target screen, at least one form of the interactive card is displayed in the second card display area of ​​the right side area.

19. The method according to any one of claims 1 to 18, characterized in that, The step of displaying at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent includes: When the target user interacts with the first interactive agent corresponding to the first screen, based on the interaction information of the target user interacting with the second interactive agent corresponding to the second screen, at least one form of the interactive card is displayed in the target area corresponding to the target user on the second screen.

20. The method according to any one of claims 1 to 19, characterized in that, The method further includes: Based on the interaction information between the target user and the interactive intelligent agent, the target posture of the virtual avatar is displayed.

21. The method according to any one of claims 1 to 20, characterized in that, The method further includes: If the interactive card continues to be displayed for the target duration, cancel the display of the interactive card; and / or, Based on the interaction information between the target user and the interactive agent, the display of the interactive card is cancelled.

22. The method according to any one of claims 1 to 21, characterized in that, The method further includes: Based on the wake-up information of the target user, a target interactive window is displayed in the target area, wherein the wake-up information includes at least one of gaze information, voice information, motion information, and touch operation information.

23. The method according to any one of claims 1 to 22, characterized in that, At least one functional control is provided at the bottom of the interactive card, and the functional control includes at least one of the following: interactive information sending control, historical information viewing control, and tool call control.

24. An interactive device, characterized in that, include: The display module is configured to display at least one type of interactive card in the target area corresponding to the target user on the target screen based on the interaction information between the target user and the interactive intelligent agent.

25. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1 to 23.

26. An electronic device, characterized in that, The invention includes a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, characterized in that the processor, when executing the computer program, implements the method of any one of claims 1 to 23.

27. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method according to any one of claims 1 to 23.

Images