Method, device, equipment, storage medium and product for interface interaction

Abstract

An interface interaction method, device, equipment, storage medium and product are provided. The method includes: receiving a first input of a first user, the first input being used for interaction with a smart system; and outputting first content, the first content being from the smart system, the first content being associated with a first task, the first task including outputting second content by the smart system to a second user, the second user having an association relationship with the first user, and a type of the second content being related to the first input. In this way, not only the efficiency of the user in obtaining information can be improved, but also the consumption of computing resources can be reduced.

Description

Technical Field

[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, apparatuses, devices, storage media, and products for user interface interaction. Background Technology

[0002] With the development of computer technology and continuous breakthroughs in the field of artificial intelligence, various models have emerged. Users can interact with these models through natural language or appropriate interactive operations. For example, users can input conversational content into the interactive interface, and the model can understand the content to provide services such as information consultation, content explanation, and task execution. Summary of the Invention

[0003] In a first aspect, a method for interface interaction is provided. The method includes: receiving a first input from a first user for interaction with an intelligent system; and outputting first content, the first content originating from the intelligent system, the first content being associated with a first task, the first task including the intelligent system outputting second content to a second user, the second user being associated with the first user, and the type of the second content being related to the first input.

[0004] In a second aspect, an apparatus for interface interaction is provided. The apparatus includes: a receiving module configured to receive a first input from a first user, the first input being used for interaction with an intelligent system; and a first output module configured to output first content from the intelligent system, the first content being associated with a first task, the first task including outputting second content from the intelligent system to a second user, the second user being associated with the first user, and the type of the second content being related to the first input.

[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0007] In a fifth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0008] In this way, the example in this paper can output initial content about the first task to the first user, helping the first user better understand the relevant information about the first task and improving the efficiency of information acquisition. Furthermore, the example in this paper can output the first task from the intelligent system immediately after receiving the first input, effectively reducing interaction links and lowering the consumption of computing resources.

[0009] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of the example environment is shown; Figures 2A to 2H Example interfaces for some scenarios are shown; Figure 3 The flowcharts show example processes of interface interactions in some scenarios; Figure 4 Schematic block diagrams of example devices for interface interaction in some scenarios are shown; and Figure 5 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation

[0011] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.

[0012] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.

[0013] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0014] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.

[0015] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.

[0016] As mentioned above, with the development of computer technology and continuous breakthroughs in the field of artificial intelligence, various models have emerged. Users can interact with these models through natural language or appropriate interactive operations. For example, users can input conversational content into the interactive interface, and the model can understand the content to provide services such as information consultation, content explanation, and task execution.

[0017] A user interface interaction scheme is proposed. The scheme includes: receiving a first input from a first user, used for interaction with an intelligent system; and outputting first content, which originates from the intelligent system and is associated with a first task. The first task includes the intelligent system outputting second content to a second user, the second user being associated with the first user, and the type of the second content being related to the first input.

[0018] In this way, the example in this paper can output initial content about the first task to the first user, helping the first user better understand the relevant information about the first task and improving the efficiency of information acquisition. Furthermore, the example in this paper can output the first task from the intelligent system immediately after receiving the first input, effectively reducing interaction links and lowering the consumption of computing resources.

[0019] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.

[0020] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction, including but not limited to: applications for interaction with intelligent systems, search applications, or other suitable applications. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.

[0021] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0022] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0023] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.

[0024] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.

[0025] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.

[0026] The following description of the example will continue with reference to the accompanying drawings.

[0027] Example Interaction Figures 2A to 2H Example interfaces 200A to 200H are shown, illustrating interface interactions under various scenarios. Interfaces 200A to 200H can, for example, be... Figure 1 The electronic device 110 shown is provided.

[0028] In some cases, electronic device 110 receives a first input from a first user. This first input is used for interaction with the intelligent system. For example, such as... Figure 2AAs shown, electronic device 110 can present interface 200A. Interface 200A can be, for example, an interactive interface between a user and an intelligent system. Electronic device 110 can provide interaction between the user and the intelligent system through interface 200A. For example, electronic device 110 can receive a first user input (e.g., input text, input audio, etc.). After receiving the first input, electronic device 110 can provide the first input to the intelligent system. The intelligent system can generate a corresponding response based on the first input. Furthermore, electronic device 110 can output the response generated by the intelligent system. For example, electronic device 110 can present text content corresponding to the response in interface 200A. As another example, electronic device 110 can also play audio content corresponding to the response.

[0029] In some scenarios, electronic device 110 can receive the first user's initial input during a dialogue between the first user and the intelligent system. For example, this dialogue could instruct the first user and the intelligent system to send messages to each other, or it could instruct the first user and the intelligent system to conduct a first call (such as a video call or audio call). Taking the dialogue instructing the first user and the intelligent system to send messages to each other as an example, electronic device 110 can present an input component in interface 200A. Electronic device 110 can receive the first user's initial input via the input component. Such initial input could be content entered by the first user through the input component, including text content, audio content, video content, image content, etc. Taking the dialogue instructing the first user to conduct a first call with the intelligent system as an example, electronic device 110 can present a first control in interface 200A. After the first control is triggered, electronic device 110 can trigger the establishment of the first call between the first user and the intelligent system. During the first call, electronic device 110 can receive the first user's initial input via an image acquisition device or an audio acquisition device. Such initial input could be the first user's initial audio input, or it could be video or image input.

[0030] Upon receiving the first input, if the first input is audio content, the electronic device 110 can transcribe the audio content to determine the text content corresponding to the first input. Further, the electronic device 110 can present a message corresponding to the first input on the interface 200A. Such a message could be, for example, message 205. Message 205 may include the text content obtained by transcribing the first input.

[0031] In this paper, an intelligent system refers to a system capable of autonomous control based on machine learning models. An intelligent system is, for example, a virtual object or physical entity capable of making decisions and autonomously executing actions based on machine learning models to achieve preset goals or complete preset tasks. An intelligent system can be an automated program that understands user intent and can utilize models or invoke tools to complete various types of tasks. In some contexts, examples of intelligent systems may include, but are not limited to: agents, bots, chatbots, digital avatars, intelligent customer service, digital assistants, etc. Alternatively, an intelligent system can also be an intelligent role implemented based on machine learning models. An "intelligent system" can process user requests based on generative models (e.g., language models, multimodal models) to perform specified types of tasks. In some cases, an intelligent system may also relate to virtual accounts, which may have corresponding avatars or nicknames.

[0032] In some cases, electronic device 110 may output a first prompt. The first prompt is used to obtain a description of the second user. Furthermore, electronic device 110 may receive a third input from the first user. The second user is determined at least based on the third input.

[0033] As an example, the first prompt here could indicate that the first user needs to provide information about the second user. The first prompt can correspond to multiple modalities, such as audio, image, and text modalities. The first prompt can be generated by the intelligent system based on the first input. The description can be information provided by the first user that can be used to identify the second user. The description may include, for example, the second user's name, nickname, and contact information. As an example, such as... Figure 2B As shown, electronic device 110 can output a first prompt through a first communication between the user and the intelligent system. For example, electronic device 110 can play audio generated by the intelligent system corresponding to the first prompt. After the audio corresponding to the first prompt is output, electronic device 110 can also display the text content corresponding to the first prompt on interface 200B. Such text content can be presented in the form of a conversational message, such as message 210. Message 210 could be, for example, "Who exactly are you looking for? Please tell me their name."

[0034] After the first prompt is output, the electronic device 110 can receive a third input from the first user. Such a third input may include, for example, audio input, text input, or image input. The third input may be, for example, the first user's response to the first prompt. As an example, the electronic device 110 may receive a second audio input from the first user via a first call between the first user and the intelligent system, using the second audio input as the third input. As another example, the electronic device 110 may also receive text input from the first user via an input component displayed on the interface, using the text input as the third input. In some scenarios, the third input may include a description of the second user, which may include the second user's name, communication method, or the relationship between the second user and the first user. This relationship may, for example, indicate that the first user and the second user are friends, or that the first user and the second user are in the same group.

[0035] Upon receiving a third input, electronic device 110 can provide the third input to the intelligent system. The intelligent system can then determine the second user based on the third input. For example, the intelligent system can determine the second user based on the identification information in the third input. Another example is that the intelligent system can determine the second user based on the communication method in the third input. In some scenarios, the intelligent system can determine the second user not only based on the second input but also based on contextual information. As an example, the first user inputs in a dialogue with the intelligent system: "Please forward that picture to him as well." The intelligent system can perform semantic analysis on the first input, identifying the interaction request as "forwarding the picture," with the target being "him." Since "him" is an ambiguous term, the intelligent system can disambiguate based on contextual information. For example, if the first user's historical dialogue with the intelligent system mentions the second user's identification information, then the intelligent system can determine the second user based on the identification information and the first user's third input.

[0036] In this way, the example in this article can output a first prompt to the user to obtain the description content, thereby effectively improving the efficiency of obtaining the description content.

[0037] In some situations, electronic device 110 may output a first prompt in response to a first input indicating an interaction need associated with another user and the first input not indicating a second user. As an example, the interaction need here may represent a need expressed by the first input to interact with another user. Such an interaction need may, for example, indicate that the intelligent system needs to communicate with other users to perform the task indicated by the first input. The interaction need may be identified by the intelligent system through semantic analysis of the first input. When the first input indicates an interaction need associated with another user (e.g., the intelligent system needs to contact other users to complete a specific task), and the first input does not indicate a specific second user, the intelligent system may generate a first prompt. Such a first prompt is used to obtain a description of the second user to identify the second user. Such a first prompt may, for example, be "Who exactly do you need to contact?" After the first prompt is generated, electronic device 110 may present a message 210 corresponding to the first prompt on interface 200B.

[0038] In this way, the example in this paper can output a first prompt when the first input is to instruct a second user, so as to obtain the description content and thus obtain the description content more accurately.

[0039] In some scenarios, electronic device 110 can output a first prompt in response to multiple third users matching the content of a first input. The first prompt is used to select a second user from the multiple third users. As an example, after receiving the first input, the intelligent system can determine the semantic information of the first input to determine its content. The content of the first input may indicate a specific relationship (e.g., a friend relationship). After determining the content of the first input, the intelligent system can identify multiple third users who are friends with the first user. Further, to determine the second user from the multiple third users, the intelligent system can generate a first prompt. The first prompt may, for example, instruct the first user to select a second user from the third users to send a message to the second user. Such a first prompt could be, for example, "Which friend do you specifically want to find?" After the first prompt is generated, such as... Figure 2C As shown, electronic device 110 can display message 215 corresponding to the first prompt on interface 200C. Furthermore, electronic device 110 can receive a third input from the first user to determine a second user from among multiple third users using an intelligent system based on the third input. Such third input can indicate the selection of a second user among multiple third users, for example, "Find the second user."

[0040] In some scenarios, electronic device 110 outputs first content. The first content originates from an intelligent system. The first content is associated with a first task. The first task includes the intelligent system outputting second content to a second user. The second user is associated with the first user. The type of the second content is related to the first input.

[0041] As an example, upon receiving a first input, the intelligent system can determine, based on the first input, the first task that the first user indicates and needs to perform. Such a first task could be a communication task, instructing the intelligent system to act as an intermediary between the first and second users to output second content to a second user. Examples include establishing a call, sending a message, or sending a notification. The type of the second content can be determined based on the first input. For example, if the first input instructs the intelligent system to conduct a call with the second user, then the intelligent system can determine that the type of the second content is audio. As another example, if the first input instructs the intelligent system to send a text message to the second user, then the intelligent system can determine that the type of the second content is text.

[0042] After determining the first task, the electronic device 110 can output first content generated by the intelligent system. This first content may include any appropriate information associated with the first task, such as a request to perform the first task, the task content of the first task, and process information for performing the first task. For example, the electronic device 110 may output a request to perform the first task (e.g., whether a message can be sent) and the task content of the first task (e.g., sending a message to a second user instructing them to book a mountain climb). In some scenarios, the first content may be output in any appropriate manner. For example, the electronic device 110 may present a message corresponding to the first content. The electronic device 110 may also output audio corresponding to the first content.

[0043] In some cases, electronic device 110 may present the first content within an interactive interface associated with an intelligent system. The first content includes visual components associated with the first task. For example, such as... Figure 2DAs shown, after the first content is generated by the intelligent system, the electronic device 110 can present the first content in the interface 200D. This first content can include visual components. Visual components can include, but are not limited to, cards, containers, panels, etc. For example, the visual components here can include component 220. The electronic device 110 can present information about the first task contained in the first content within the visual components. Taking a call task as an example, the electronic device 110 can present the caller, communication method, and the goal to be achieved through the call in component 220. In some scenarios, the visual components can include not only component 220 but also any other appropriate components. These components can be used to present different parts of the first content. The specific presentation methods and content will be described later.

[0044] In some situations, electronic device 110 can utilize an intelligent system to establish a call with a second user to output second content. The participants in the call include at least the intelligent system and the second user. For example, when a first input indicates that the intelligent system needs to conduct a call with the second user to output second content, electronic device 110 can automatically trigger the establishment of a call involving both the intelligent system and the second user; this call can be referred to as a second call. Such a call can correspond to any appropriate call format, such as a voice call, video call, etc. During the second call between the intelligent system and the second user, the intelligent system can output second content to the second user through the second call. For example, if the first input indicates that the intelligent system needs to call the second user to book a hiking trip, then the intelligent system can output audio content booking the hiking trip to the second user through the second call.

[0045] In some scenarios, the first user can also manually initiate a call between the intelligent system and the second user. For example... Figure 2D As shown, after receiving the first input, the electronic device 110 can display component 220 in interface 200D. Component 220 may include a call control 225. When the call control 225 is triggered (e.g., by clicking or double-clicking), the electronic device 110 can establish a call between the smart system and the second user.

[0046] In other scenarios, electronic device 110 can not only establish a call between the intelligent system and the second user, but also establish a multi-user call between the intelligent system and multiple users. For example, when the first input indicates that the intelligent system needs to call the second user and the fourth user, electronic device 110 can establish a group chat call between the intelligent system and the second user and the fourth user.

[0047] In this way, the example in this paper can trigger the intelligent system to establish a call with a second user to output second content, thereby improving the output efficiency of the second content.

[0048] In some cases, the content displayed by the visualization component is related to the execution status of the first task. As an example, electronic device 110 can adjust the content displayed in the visualization component based on the execution status of the first task. This execution status can, for example, indicate the progress or result of the intelligent system executing the first task, and may include, but is not limited to: task in progress, task preparation, task pending determination, task completed, task failed, etc. As an example, such as... Figure 2D As shown, interface 200D includes visual components (e.g., component 220). Before the first task (e.g., a call task) is executed, electronic device 110 can display information such as the caller, communication method, and call target in component 220. During the execution of the call task, such as... Figure 2E As shown, electronic device 110 can display the avatars of the call participants and the text corresponding to the call content in component 220. After the call task is completed, electronic device 110 can display the complete call content, task execution result, and other information in component 220.

[0049] In this way, the example in this article can dynamically adjust the content displayed by the visualization component according to the execution status of the first task, which can help users better perceive the execution status and process of the first task and improve the efficiency of users obtaining information.

[0050] In some situations, electronic device 110 may output first content related to the call content to the first user. For example, such as... Figure 2E As shown, during the second call, electronic device 110 can display a visual component in interface 200E, such a visual component may include component 230. Electronic device 110 can display first content related to the call content in component 230. This first content may, for example, be first text content obtained by the intelligent system transcribing the call content. This first text content may also be referred to as the subtitle of the second call. When the call content corresponds to a first language (e.g., English), the intelligent system can not only transcribe the call content to obtain the first text content, but also translate the first text content to obtain second text content corresponding to a second language (e.g., Chinese). After the second text content is obtained, electronic device 110 can display the second text content in component 230.

[0051] In this way, the example in this paper can output first content related to the call content to the first user, thereby helping the first user to better understand the process and content of the call, thus improving the efficiency of the user in obtaining information.

[0052] In some situations, electronic device 110 can play audio content corresponding to the call content. For example, such as... Figure 2E As shown, electronic device 110 can display control 235 in interface 200E. Control 235 can be referred to as a listen-in control, which is used to trigger the activation of listen-in mode. Listen-in mode indicates that during the second call, electronic device 110 can play audio content corresponding to the call content. After control 235 is clicked, electronic device 110 can activate listen-in mode and play audio content corresponding to the call content.

[0053] In this way, the examples in this article can help the first user better understand the process and content of the call, thereby further improving the efficiency of the user in obtaining information.

[0054] In some cases, electronic device 110 can receive a second input from the first user during a call. Furthermore, electronic device 110 can trigger the output of third content to the second user via the call. The third content is related to the second input.

[0055] As an example, such as Figure 2F As shown. During a second call between the intelligent system and the second user, when the intelligent system determines that the user needs to make a selection, it can generate a first prompt based on the call content. The first prompt can instruct the user to provide a second input for selection, thereby instructing the intelligent system to output a third content corresponding to the selected object during the call. After the first prompt is generated, the electronic device 110 can present component 240 on the interface 200F. Component 240 is used to present the first prompt. Component 240 also includes multiple options, which may include options 241 and 242. Options 241 and 242 correspond to different candidate contents. The electronic device 110 can receive the second input from the first user via option 241 or option 242. Such second input can be a selection of any option 241 or option 242. Taking option 241 as an example, when option 241 is selected, the electronic device 110 can trigger the intelligent system to output the third content to the second user through the second call. The third content can be matched with the candidate content corresponding to option 241. For example, when a second user says "Which mountain do you want to climb?" during a call, the intelligent system can determine that the user needs to make a selection to determine the destination for the climb. The intelligent system can generate multiple candidate options (e.g., "Mount A" and "Mount B") based on contextual information. Electronic device 110 can present options 241 and 242 on interface 200F, where option 241 corresponds to "Mount A" and option 242 corresponds to "Mount B". Once option 241 is selected, electronic device 110 can trigger the intelligent system to output a third option—climbing Mount A—to the second user via the call.

[0056] In some scenarios, electronic device 110 also supports call takeover by a first user. Call takeover can instruct the first user to directly initiate a second call with a second user. Electronic device 110 can display control 245 on interface 200E. When control 245 is clicked, electronic device 110 can stop the intelligent system from outputting audio during the second call. Furthermore, electronic device 110 can receive a second input from the first user. Such a second input could be, for example, a third audio input from the first user. Upon receiving the third audio input, electronic device 110 can trigger the output of third content corresponding to the third audio input to the second user via the call.

[0057] In other scenarios, electronic device 110 also supports a first user participating in a second call between the smart system and a second user. As an example, electronic device 110 can display control 250 on interface 200E. When control 250 is clicked, electronic device 110 adds the first user to the second call between the smart system and the second user. During the multi-user call involving the smart system, the first user, and the second user, electronic device 110 can receive a second input from the first user. Such a second input could be, for example, a fourth audio input from the first user. Upon receiving the fourth audio input, electronic device 110 can trigger the output of third content corresponding to the fourth audio input to the second user through the second call.

[0058] In this way, the example in this paper can control the output content of the call based on the second input of the first user during the call, and can transmit third content more flexibly during the call, improving the efficiency and flexibility of information transmission.

[0059] In some cases, such as Figure 2G As shown, after the second call ends, electronic device 110 can display a visualization component on interface 200G. This visualization component can include component 255. Component 255 can display first content related to the call content. Such first content can include the complete call log and a summary of the call content. The summary of the call content can include multiple fields, such as time (e.g., the meeting time for a scheduled hike), location (e.g., Mountain A), participants (e.g., the first user and the second user), and the execution result of the first task (e.g., whether the reservation was successful). In some scenarios, electronic device 110 can also display control 256 on interface 200G. When control 256 is clicked, electronic device 110 can play audio content corresponding to the complete call log.

[0060] In some cases, such as Figure 2HAs shown. After the second call ends, the electronic device 110 can also trigger the intelligent system to execute at least one second task associated with the first task. Such a second task can be determined by the intelligent system based on the first task. For example, the first task is to use the intelligent system to make a call with the second user to book a hiking trip for the second user. Then the second task can be any appropriate task to complete the hiking trip. The second task can include creating a schedule, booking a travel service, sending a reminder message about the hiking trip to the second user, etc. After the second task is determined, the electronic device 110 can present component 260 in interface 200H. Component 260 can include the execution status of the second task (e.g., whether the schedule has been created, whether the travel service has been booked, etc.). In some scenarios, the electronic device 110 can also trigger the intelligent system to execute at least one second task after receiving a confirmation instruction from the first user. For example, after the second task is determined, the electronic device 110 can present a confirmation control in interface 200H. When the confirmation control is clicked, the electronic device 110 can trigger the intelligent system to execute tasks such as creating a schedule and booking a travel service.

[0061] In some scenarios, the intelligent system can acquire a first contact identifier of a second user to output second content to the second user based on the first contact identifier. As an example, after identifying the second user, the intelligent system can acquire the second user's first contact identifier. In this document, a contact identifier can represent an identifier used to establish a communication connection or transmit content between objects (e.g., between the intelligent system and a user, or between users), and can be referred to as a communication method. Here, the first contact identifier can be the second user's first communication method. After acquiring the first communication method, the electronic device 110 can establish a communication connection (e.g., a call) between the intelligent system and the second user to output second content to the second user through this communication connection. For example, the electronic device 110 can establish a second call between the intelligent system and the second user to output second content to the second user through the second call.

[0062] In this way, the example in this paper can output the second content to the second user through the first contact identifier, thereby ensuring the accuracy of the output of the second content.

[0063] In some cases, a second user may be associated with multiple types of contact identifiers. The first contact identifier is selected based on the type of the second content. For example, a second user may be associated with multiple types of communication methods, which can be used to support different communication connections (e.g., voice calls, video calls, sending messages, etc.). Before establishing a communication connection between the intelligent system and the second user, the intelligent system can select the first contact identifier (e.g., the first communication method) based on the type of the second content. For example, if the second content is audio, the intelligent system can select the first communication method that supports voice calls from among multiple types of communication methods. Similarly, if the second content is text, the intelligent system can select the first communication method that supports sending text messages from among multiple types of communication methods.

[0064] In this way, the example in this paper can select the corresponding first contact identifier based on the type of the second content before establishing a communication connection, thereby improving the efficiency of communication between the intelligent system and the second user and reducing the consumption of computing resources.

[0065] In some cases, a second contact identifier of the intelligent system can be used to output second content to a second user. Alternatively, a third contact identifier of the first user can be used to output second content to the second user. As an example, electronic device 110 supports establishing a communication connection with a second user using different contact identifiers to output second content to the second user. For instance, electronic device 110 can use the intelligent system's own second contact identifier (e.g., a second communication method) to establish a communication connection (e.g., a call) with the second user, and output second content to the second user through this communication connection. When establishing a communication connection using the intelligent system's second contact identifier, electronic device 110 can trigger the provision of first identification information associated with the intelligent system to the second user. The first identification information may include, for example, the intelligent system's name, avatar, etc. As another example, when a first input indicates the use of the first user's third contact identifier (e.g., a third communication method) to establish a communication connection between the intelligent system and the second user, electronic device 110 can use the third communication method to establish a communication connection (e.g., a call) with the second user to output second content. When establishing a communication connection using the first user's third communication method, electronic device 110 can trigger the provision of second identification information about the first user to the second user. The second identification information may include the first user's name and avatar, etc.

[0066] In this way, the example in this paper can output initial content about the first task to the first user, helping the first user better understand the relevant information about the first task and improving the efficiency of information acquisition. Furthermore, the example in this paper can output the first task from the intelligent system immediately after receiving the first input, effectively reducing interaction links and lowering the consumption of computing resources.

[0067] Example process Figure 3 A flowchart illustrating an example process 300 for interface interaction under certain conditions is shown. Process 300 can be implemented at electronic device 110. See below for reference. Figure 1 To describe process 300.

[0068] like Figure 3 As shown, in block 310, electronic device 110 receives a first input from a first user for interaction with the intelligent system.

[0069] In box 320, electronic device 110 outputs first content, which comes from an intelligent system and is associated with a first task. The first task includes outputting second content from the intelligent system to a second user. The second user is associated with the first user, and the type of the second content is related to the first input.

[0070] In some cases, the first task includes: the intelligent system establishing a call with a second user to output second content, wherein the participants in the call include at least the intelligent system and the second user.

[0071] In this way, the example in this paper can trigger the intelligent system to establish a call with a second user to output second content, thereby improving the output efficiency of the second content.

[0072] In some cases, outputting the first content includes: outputting first content related to the call content to the first user.

[0073] In this way, the example in this paper can output first content related to the call content to the first user, thereby helping the first user to better understand the process and content of the call, thus improving the efficiency of the user in obtaining information.

[0074] In some cases, outputting first content related to the call content to the first user includes playing audio content corresponding to the call content.

[0075] In this way, the examples in this article can help the first user better understand the process and content of the call, thereby further improving the efficiency of the user in obtaining information.

[0076] In some cases, process 300 further includes: receiving a second input from a first user during a call; and triggering the output of third content to a second user via the call, the third content being related to the second input.

[0077] In this way, the example in this paper can control the output content of the call based on the second input of the first user during the call, and can transmit third content more flexibly during the call, improving the efficiency and flexibility of information transmission.

[0078] In some cases, process 300 further includes: outputting a first prompt for obtaining a description of the second user; and receiving a third input from the first user, the second user being determined based at least on the third input.

[0079] In this way, the example in this article can output a first prompt to the user to obtain the description content, thereby effectively improving the efficiency of obtaining the description content.

[0080] In some cases, outputting a first prompt includes: responding to a first input indicating an interaction request associated with another user and the first input not indicating a second user, outputting a first prompt.

[0081] In this way, the example in this paper can output a first prompt when the first input is to instruct a second user, so as to obtain the description content and thus obtain the description content more accurately.

[0082] In some cases, outputting a first prompt includes: in response to multiple third users matching the content of the first input, outputting a first prompt for selecting a second user from the multiple third users.

[0083] In some cases, the intelligent system is configured to: acquire a first contact identifier of a second user, and output second content to the second user based on the first contact identifier.

[0084] In this way, the example in this paper can output the second content to the second user through the first contact identifier, thereby ensuring the accuracy of the output of the second content.

[0085] In some cases, the second user association has multiple types of contact identifiers, and the first contact identifier is selected based on the type of the second content.

[0086] In this way, the example in this paper can select the corresponding first contact identifier based on the type of the second content before establishing a communication connection, thereby improving the efficiency of communication between the intelligent system and the second user and reducing the consumption of computing resources.

[0087] In some cases, the intelligent system is configured to: output second content to a second user using a second contact identifier of the intelligent system; or output second content to a second user using a third contact identifier of the first user.

[0088] In some cases, outputting the first content includes presenting the first content in an interactive interface associated with the intelligent system, the first content including a visualization component associated with the first task.

[0089] In some cases, the content displayed by the visualization component is related to the execution status of the primary task.

[0090] In this way, the example in this article can dynamically adjust the content displayed by the visualization component according to the execution status of the first task, which can help users better perceive the execution status and process of the first task and improve the efficiency of users obtaining information.

[0091] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 4 A schematic structural block diagram of an example device 400 for interface interaction is shown, according to some scenarios. Device 400 can be implemented as or included in electronic device 110. The various modules / components in device 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0092] like Figure 4 As shown, the device 400 includes: a receiving module 410 configured to receive a first input from a first user, the first input being used for interaction with an intelligent system; and a first output module 420 configured to output first content, the first content being from the intelligent system, the first content being associated with a first task, the first task including the intelligent system outputting second content to a second user, the second user being associated with the first user, and the type of the second content being related to the first input.

[0093] In some cases, the first task includes: the intelligent system establishing a call with a second user to output second content, wherein the participants in the call include at least the intelligent system and the second user.

[0094] In some cases, the first output module 420 is also configured to output first content related to the call content to the first user.

[0095] In some cases, the first output module 420 is also configured to play audio content corresponding to the call content.

[0096] In some cases, the device 400 also includes a trigger module configured to receive a second input from a first user during a call; and to trigger the output of third content to a second user via the call, the third content being related to the second input.

[0097] In some cases, the device 400 further includes a second output module configured to output a first prompt for obtaining a description of a second user; and to receive a third input from the first user, the second user being determined at least based on the third input.

[0098] In some cases, the second output module is also configured to output a first prompt in response to an interaction request associated with another user by the first input and the first input not indicating a second user.

[0099] In some cases, the second output module is also configured to output a first prompt in response to multiple third users matching the content of the first input, the first prompt being used to select a second user from the multiple third users.

[0100] In some cases, the intelligent system is configured to: acquire a first contact identifier of a second user, and output second content to the second user based on the first contact identifier.

[0101] In some cases, the second user association has multiple types of contact identifiers, and the first contact identifier is selected based on the type of the second content.

[0102] In some cases, the intelligent system is configured to: output second content to a second user using a second contact identifier of the intelligent system; or output second content to a second user using a third contact identifier of the first user.

[0103] In some cases, the first output module 420 is also configured to present first content in an interactive interface associated with the intelligent system, the first content including a visualization component associated with the first task.

[0104] In some cases, the content displayed by the visualization component is related to the execution status of the primary task.

[0105] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.

[0106] Figure 5 A block diagram of an electronic device 500 in which one or more examples may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5 The electronic device 500 shown can be used to implement the electronic device 110 discussed above.

[0107] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.

[0108] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0109] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.

[0110] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.

[0111] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).

[0112] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0113] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0114] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0115] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0116] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0117] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for user interface interaction, comprising: Receive a first input from a first user, the first input being used for interaction with the intelligent system; as well as The system outputs first content, which originates from the intelligent system and is associated with a first task. The first task includes the intelligent system outputting second content to a second user, who is associated with the first user. The type of the second content is related to the first input.

2. The method according to claim 1, wherein the first task includes: The intelligent system establishes a call with the second user to output the second content, and the participants in the call include at least the intelligent system and the second user.

3. The method according to claim 2, wherein the first output content includes: Output the first content related to the call content to the first user.

4. The method according to claim 3, wherein outputting the first content related to the call content to the first user includes: Play the audio content corresponding to the content of the call.

5. The method according to claim 2, further comprising: During the call, the second input from the first user is received; as well as Triggering the output of third content to the second user through the call, the third content being related to the second input.

6. The method according to claim 1, further comprising: Output a first prompt, which is used to obtain a description of the second user; as well as The system receives a third input from the first user, and the second user is determined based at least on the third input.

7. The method of claim 6, wherein the output of the first prompt comprises: In response to the first input indicating an interaction request associated with another user and the first input not indicating the second user, the first prompt is output.

8. The method of claim 6, wherein the output of the first prompt comprises: In response to multiple third users matching the content of the first input, the first prompt is output, which is used to select the second user from the multiple third users.

9. The method of claim 1, wherein the intelligent system is configured to: Obtain the first contact identifier of the second user, and output the second content to the second user based on the first contact identifier.

10. The method of claim 9, wherein the second user association has multiple types of contact identifiers, and the first contact identifier is selected based on the type of the second content.

11. The method of claim 9, wherein the intelligent system is configured to: Using the second contact identifier of the intelligent system, the second content is output to the second user; or Using the third contact identifier of the first user, the second content is output to the second user.

12. The method according to claim 1, wherein the output of the first content includes: The first content is presented in the interactive interface associated with the intelligent system, and the first content includes a visualization component associated with the first task.

13. The method of claim 12, wherein the content displayed by the visualization component is related to the execution status of the first task.

14. A device for interface interaction, comprising: The receiving module is configured to receive a first input from a first user, the first input being used for interaction with the intelligent system; as well as A first output module is configured to output first content, which comes from the intelligent system and is associated with a first task. The first task includes outputting second content from the intelligent system to a second user, who is associated with the first user. The type of the second content is related to the first input.

15. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 13 when executed by the at least one processor.

16. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 13.

17. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 13.

Images