Methods, apparatus, devices and program products for interface interaction
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-05-29
- Publication Date
- 2026-08-14
AI Technical Summary
[0007]以此方式,能够提高与智能系统的交互效率。
Smart Images

Figure CN122569787A_ABST
Abstract
Description
Technical Field
[0001] The examples in this article generally relate to the field of computers, and in particular to methods, apparatuses, devices, and computer program products for user interface interaction. Background Technology
[0002] With the development of computer technology, various forms of electronic devices have greatly enriched people's daily lives and brought them many conveniences. For example, more and more platforms or applications are able to provide users with intelligent services, such as intelligent conversation systems and digital assistants, which can help users handle certain tasks based on their interactions with users. Summary of the Invention
[0003] In a first aspect, a method for interface interaction is provided. The method includes: presenting a first interactive component on a first interface, the first interactive component displaying a first task, the first interface being used to interact with an intelligent system, the first task being related to the intelligent system, and the first interactive component supporting the receipt of operations associated with the first task; and during the execution of the first task, presenting a second interactive component on the first interface, the second interactive component displaying a second task, the second task being related to the intelligent system.
[0004] In a second aspect, an interface interaction device is provided. The device includes: a first presentation module configured to present a first interactive component on a first interface, the first interactive component displaying a first task, the first interface being used to interact with an intelligent system, the first task being associated with the intelligent system, and the first interactive component supporting the receipt of operations associated with the first task; and a second presentation module configured to present a second interactive component on the first interface during the execution of the first task, the second interactive component displaying a second task, the second task being associated with the intelligent system.
[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.
[0006] In a fourth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.
[0007] This approach can improve the efficiency of interaction with intelligent systems.
[0008] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description
[0009] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of an example environment based on some scenarios is shown; Figures 2A to 2Q The diagram shows sample interfaces for user interaction under various scenarios. Figure 3 A flowchart illustrating example processes for interface interaction is shown, based on several scenarios. Figure 4 A schematic structural block diagram of an example device for interface interaction is shown, based on several scenarios; and Figure 5 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation
[0010] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.
[0011] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.
[0012] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.
[0013] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.
[0014] In this manual and the sample solutions, any processing of personal information will be conducted only under legal grounds (such as obtaining the consent of the data subject or being necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect the user's use of basic functions.
[0015] As mentioned above, with the development of computer technology, various forms of electronic devices have greatly enriched people's daily lives and brought them many conveniences. For example, more and more platforms or applications are able to provide users with intelligent services, such as intelligent conversation systems and digital assistants, which can help users handle certain tasks based on their interactions with users.
[0016] A user interface interaction scheme is proposed. The scheme includes: presenting a first interactive component on a first interface, the first interactive component displaying a first task, the first interface being used to interact with an intelligent system, the first task being related to the intelligent system, and the first interactive component supporting the reception of operations associated with the first task; and during the execution of the first task, presenting a second interactive component on the first interface, the second interactive component displaying a second task, the second task being related to the intelligent system.
[0017] In this way, some examples in this paper can continue to present and support interactive components related to other tasks on the first interface during the execution of the first task. This allows users to initiate, view, and track other tasks related to the intelligent system while waiting for the first task, which takes a long time. This avoids the long-running tasks from interrupting the human-computer interaction process and improves the efficiency of interaction with the intelligent system.
[0018] The following describes various examples of this scheme in further detail with reference to the accompanying drawings.
[0019] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1As shown, example environment 100 may include electronic device 110.
[0020] In this example environment 100, electronic device 110 can run an application 120 that supports user interface interaction. Application 120 can be any suitable type of application for user interface interaction. User 140 can interact with application 120 via electronic device 110 and / or its attached devices.
[0021] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.
[0022] In some cases, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).
[0023] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.
[0024] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.
[0025] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.
[0026] The following description of the example will continue with reference to the accompanying drawings.
[0027] Example Interaction Figures 2A to 2Q Example interfaces 200A to 200Q are shown according to some scenarios. Interfaces 200A to 200Q can, for example, be derived from... Figure 1 The illustrated electronic device 110 is provided via application 120. See below for reference. Figures 2A to 2Q Here are some examples to describe interface interactions.
[0028] In some situations, electronic device 110 may present as follows Figure 2A The interface 200A shown may include an interface for user interaction. As an example, such an interface 200A may be referred to as a first interface, which may be associated with an intelligent system and used to interact with it. An intelligent system refers to a system capable of autonomous control based on a machine learning model. An intelligent system may be a virtual object or entity capable of making decisions and autonomously executing actions based on a machine learning model to achieve preset goals or complete preset tasks. An intelligent system can be an automated program that understands the user's intent and can utilize models or invoke tools to complete various types of tasks. In some cases, examples of intelligent systems may include, but are not limited to: agents, bots, chatbots, digital avatars, intelligent customer service, digital assistants, etc. Alternatively, an intelligent system may also be an intelligent role implemented based on a machine learning model. An "intelligent system" may process user requests based on generative models (e.g., language models, multimodal models) to perform specified types of tasks. In some cases, an intelligent system may also relate to virtual accounts, which may have corresponding avatars or nicknames.
[0029] In some examples, electronic device 110 can receive instructions from a user (e.g., user 140) via an interactive interface and send such instructions to the intelligent system. Accordingly, electronic device 110 can provide response content from the intelligent system.
[0030] As an example, the first interface can be used for any appropriate form of interaction between the user and the intelligent system, such as dialogue interaction, graphical interaction, etc. Thus, the electronic device 110 can receive user input through the first interface, and the user input can be used to interact with the intelligent system.
[0031] As an example, the first interface could be used for dialogue interaction between a user and an intelligent system. The user can trigger the sending of corresponding input content to the intelligent system through dialogue interaction, serving as such user input. For example, ... Figure 2A As shown, the first interface may include, for example, an input component (e.g., input component 210) and a content display area. Additionally, the electronic device 110 may, for example, receive instructions from a user (e.g., user 140) through the input component in the first interface and may display corresponding response content in the content display area. As an example, input component 210 may acquire any appropriate content such as text, video, image, or audio input by the user; this document does not limit the specific input formats supported by input component 210.
[0032] Alternatively or additionally, electronic device 110 may also receive user input through other triggering methods, such as the user waking up electronic device 110 by voice to trigger such user input, etc. This document is not intended to limit the specific implementation of user input.
[0033] In some cases, such as Figure 2A As shown, after receiving user input, electronic device 110 can present message 202 in the content display area. Message 202 may be a message triggered by user 140. As an example, message 202 may include input for triggering the first task (e.g., referred to as the fourth input). For example, message 202 may include the fourth input "Make a document to interpret the cause of typhoon formation in region X".
[0034] Additionally, when the fourth input expresses a task processing requirement, the electronic device 110 can perform a first task based on the fourth input in message 202, and can present an interactive component 204 (also referred to as a first interactive component) on the first interface 200A. As an example, the first interactive component 204 can display a first task 204-1, which can be associated with an intelligent system. Figure 2A As shown, the first task 204-1 could be, for example, "to study the causes of typhoon formation in region X".
[0035] In other examples, if the fourth input does not express a task processing requirement, the electronic device 110 may also provide a message from the intelligent system as a response to message 202. As an example, the specific implementation of providing a corresponding response based on whether the fourth input expresses a task processing requirement can be found in the following description of the first input, and will not be repeated here.
[0036] Alternatively or additionally, the first interactive component 204 supports receiving operations associated with the first task 204-1. For example, such operations may include, but are not limited to, operations for viewing the first task, operations for updating the task, operations for pausing or ending the task, operations for skipping a subtask within the first task, etc. Specific implementations can be found in the following description of interactions with the first interactive component 204. Alternatively or additionally, the first interactive component 204 can also display the first progress 204-2 of the first task to provide the user with a more intuitive view of the task's progress. As an example, the first progress 204-2 can be any suitable display format, such as a progress percentage, progress bar, progress ring, etc. This document uses a progress bar as an example for demonstration. It should be understood that the specific display format of the first progress 204-2 (or the second progress 208-2, etc., task progress described below) in actual applications may depend on project requirements.
[0037] In some scenarios, depending on the complexity of the first task 204-1, the first task 204-1 may provide a result after a certain period of execution. To improve the efficiency of interaction with the intelligent system, in some cases, the electronic device 110 may support the user to continue interacting with the intelligent system during the execution of the first task 204-1, and may support interactive components related to other tasks, such as allowing the user to initiate, view, and track other tasks related to the intelligent system while waiting for the time-consuming first task.
[0038] As an example, such as Figure 2A As shown, during the execution of the first task 204-1, the electronic device 110 can present an interactive component 208 (also referred to as a second interactive component) on the first interface 200A. The second interactive component 208 displays the second task 208-1, which is related to the intelligent system. As an example, such as... Figure 2A As shown, the second task 208-1 could be "help order coffee," which could be accomplished, for example, by using the user's mobile phone to find a nearby coffee shop and order coffee from it. Alternatively or additionally, the second interaction component 208 could also support receiving operations associated with the second task.
[0039] In some examples, the second task may be triggered by the user or automatically executed by the intelligent system based on preset requirements. As an example, during the execution of the first task 204-1, the electronic device 110 may receive a first input from the user and provide the intelligent system with a response to that input. If the first input indicates the second task, the electronic device 110 may present the second interactive component 208 corresponding to the second task based on that first input. Alternatively, during the execution of the first task 204-1, the intelligent system may also proactively provide the second interactive component 208 to the user based on preset requirements (e.g., the reminder time for the second task has arrived, the requirement to display the second task to the user, etc.).
[0040] For ease of description, this document uses the example of a second task corresponding to the second interactive component 208 being triggered by a user as an example. As an example, during the execution of the first task 204-1, the electronic device 110 can receive a first input from the user. Additionally, the electronic device 110 can provide the intelligent system's response to the first input. The response to the first input can be independent of the execution process of the first task.
[0041] In some examples, if the first input represents a task-processing requirement, the intelligent system can provide interactive components corresponding to the task to respond to the user's first input through task processing. However, if the first input represents a non-task-processing requirement (such as a dialogue requirement or question-and-answer requirement), the intelligent system can directly provide corresponding response content without needing task processing to respond to the user's first input. The following will combine... Figure 2A To be continued Figure 2B Some examples from this article are described in detail.
[0042] Alternatively or additionally, the electronic device 110 may understand whether the first input expresses a task processing requirement based on the type of the first input. As an example, such as... Figure 2A As shown, in response to a first input being of a first type, the electronic device 110 can present a second interactive component 208 on a first interface 200A. As an example, the first input of the first type can express a task processing requirement.
[0043] Alternatively, in response to the first input being of the second type, the electronic device 110 may present a first message from the intelligent system as a response to the first input. As an example, the second type of first input may express a non-task processing requirement, such as a dialogue requirement, a question-and-answer requirement, etc.
[0044] As an example, such as Figure 2BAs shown, electronic device 110 can present interface 200B, which can be an example of a first interface. In some cases, electronic device 110 can also, in response to a first input being of a second type, present a first message 214 on the first interface 200B. The first message 214 originates from an intelligent system and is derived based on the first input. Figure 2B As shown, the first interface 200B can display a message 212 including a first input, such as "What's the weather like today?", which is a second type of first input. In response to this second type of first input, the electronic device 110 displays a first message 214 on the first interface 200B. For example, the first message 214 could be "Today's weather in region X: Cloudy to partly cloudy...". In this way, some examples in this paper can support intelligent systems to quickly respond to relatively simple, task-independent needs, thereby improving the response efficiency of intelligent systems and reducing unnecessary task overhead.
[0045] As an example, the first message can be derived from the first input. As an example, after acquiring the first input, electronic device 110 can trigger the sending of the first input to the intelligent system. Additionally, after acquiring the first input, the intelligent system can parse the first input to determine its corresponding request type. As an example, if the first input is of type two, the intelligent system can understand the user's first input based on an appropriate understanding method and provide corresponding response content. For example, if the first input indicates "What's the weather like today?", the intelligent system can provide a first message related to "Today's weather" (such as message 214) as a response to the first input.
[0046] In some examples, the first input can be obtained through input component 210 (also called the first input component), such first input may include natural language input, for example. For instance, a user can input content through the first input component 210 and trigger the sending of the input content to the intelligent system as such first input. As an example, such as... Figure 2A As shown, the first input of the first type may correspond to message 206, for example. As an example, message 206 may include, for example, "Order me another coffee today," which may indicate a task processing request expressing "order a coffee." Alternatively, such as Figure 2B As shown, the first input of the second type may correspond to message 212, for example. Message 212 may include, for example, "How is the weather today?", which may indicate a dialogue or question-and-answer request expressing a need for information about the weather.
[0047] In some cases, the first type can be related to the needs expressed by the natural language input. For example, when the needs expressed by the natural language input are unrelated to the first task, the first input can be determined as the first type, and accordingly, the first input can be asynchronously executed as a second task. In this way, the intelligent system can accurately respond to the user's first input by understanding the needs expressed by the natural language input, thereby improving the efficiency of interaction with the intelligent system.
[0048] Alternatively or additionally, the first and second types can be associated with different needs expressed by the natural language input, such as needs with different interaction dimensions, needs with different interaction granularities, and so on. As an example, the needs expressed by the natural language input can be identified through appropriate recognition methods. For instance, an intelligent system can understand the intent of the natural language input through an appropriate intent recognition model to understand the needs expressed by the natural language input.
[0049] As an example, the needs expressed by natural language input can be categorized into different intent types using an intent recognition model. For instance, the first type might be associated with task-processing intents, such as a user requesting the intelligent system to perform a specific task. The second type might be associated with non-task-processing intents, such as a user asking the intelligent system a question that can be directly answered. Alternatively or additionally, the classification of needs expressed by natural language input can be achieved through any appropriate categorization or semantic understanding method; this paper does not aim to limit the specific implementation process of the intelligent system understanding the needs expressed by natural language input.
[0050] Therefore, intelligent systems can automatically identify user needs and trigger the creation and execution of new tasks (i.e., second tasks) after the user initiates a new task in natural language. This can reduce the user's operational and learning costs, improve the flexibility of input, and enhance the efficiency of interaction with the intelligent system.
[0051] Alternatively or additionally, the first and second tasks can be two independent tasks. For example, the first and second tasks can be executed in parallel without interfering with each other. As an example, the first and second tasks can be executed by different intelligent objects to improve task processing accuracy. As an example, an intelligent object can be an independent intelligent system capable of autonomously performing tasks based on machine learning models; examples include agents, bots, chatbots, digital avatars, intelligent customer service, digital assistants, etc. In some examples, users can also interact with the intelligent object independently.
[0052] Alternatively or additionally, the intelligent system can act as a scheduling unit for multiple intelligent objects to schedule these objects to perform tasks. Additionally, the intelligent system can select a suitable intelligent object based on the analysis of user input and trigger the specified intelligent object to perform the corresponding task. For ease of description, without distinguishing between different intelligent objects performing tasks, the following description uses the intelligent system performing tasks as an example. It should be understood that the specific implementation of the intelligent system performing tasks can be implemented by the intelligent system itself or by the intelligent system scheduling corresponding intelligent objects to perform tasks; this will not be repeated below.
[0053] Alternatively or additionally, the different tasks performed by the intelligent system can be triggered by different requests. Different requests can correspond to different receiving methods, for example. For instance, the first task 204-1 can be triggered by the first request, and the second task 208-1 can be triggered by the second request. The first request and the second request can correspond to different receiving methods.
[0054] As an example, the receiving method can represent the channel through which the intelligent system obtains a request (first request, second request, etc., which can be collectively referred to as a request). For instance, the receiving method can indicate the transmission path through which a request is transmitted to the intelligent system, such a transmission path can indicate the device, application, user, interaction link, etc., through which the information is transmitted. Alternatively or additionally, the intelligent system can have a receiving method corresponding to the request, so that it can respond to the request with an appropriate response method after the task is completed.
[0055] As an example, users can interact with the intelligent system through any appropriate interaction method. For instance, a user can interact with the same intelligent system on different electronic devices. Similarly, different users can interact with the same intelligent system through different electronic devices. Furthermore, users can trigger interactions with the intelligent system through different interaction logics between their electronic devices, such as interacting with the intelligent system through a conversational interface or through external scheduling. Therefore, the intelligent system can accept requests through multiple receiving methods.
[0056] As an example, the first and second requests can be received through different applications. For instance, the first request might be triggered by a user interacting with the smart system in application A, while the second request might be triggered by a user interacting with the smart system in application B. As an example, application A and application B can be deployed on the same electronic device (e.g., electronic device 110). Alternatively, application A and application B can also be deployed on different electronic devices. For instance, a user can trigger the first request through application A on a mobile terminal (e.g., a mobile phone), and trigger the second request through application B on a fixed or portable terminal (e.g., a desktop computer or laptop computer).
[0057] Alternatively or additionally, the first and second requests can be received from different users. As an example, different users can interact with the intelligent system within the same session or the same interactive platform. Taking user interaction with the intelligent system through a session as an example, different users can be participants in the same group chat session. For example, the participants in the group chat session can include at least User 1 and User 2. User 1 and User 2 can both interact with the intelligent system through this group chat session. Additionally, User 1 can trigger the first request through interaction with the intelligent system to trigger the execution of the first task. User 2, for example, can trigger the second request through interaction with the intelligent system to trigger the execution of the second task. Thus, some examples in this paper can support more flexible interaction methods with the intelligent system and allow requests from different sources to be triggered as corresponding tasks in parallel, thereby expanding the applicable scenarios for multi-task parallel processing. Furthermore, some examples in this paper can also support cross-application and cross-user collaborative interaction scenarios through such multi-task parallel processing, thereby further improving the efficiency of interaction with the intelligent system.
[0058] Continue to refer to Figure 2A During the execution of the first task, the first interactive component 204 can be automatically updated according to the execution status of the first task. For example, the first task may include multiple subtasks, and the first interactive component 204 can display the description information of the current subtask (e.g., searching for "typhoon in region X", etc.). Additionally, the first progress 204-1 in the first interactive component 204 can also be automatically updated as the first task is executed.
[0059] In some cases, during the execution of the first task, the intelligent system (or the corresponding intelligent object) may proactively initiate an assistance request to request some user input or request the user to trigger some operations. As an example, during the execution of the first task 204-1, the electronic device 110 may present a first control in the first interactive component 204. Additionally, the electronic device 110 may receive a third input associated with the first task 204-1 based on the triggering operation of the first control.
[0060] As an example, the first control can be associated with the first task, and the first interactive component can support receiving operations associated with the first task through the first control. For example, a user can trigger an update to the first task by interacting with the first control, or can trigger the termination of the first task or a subtask of the first task by interacting with the first control. As an example, a user can trigger interaction with the first control through any appropriate interaction method. For example, a user can trigger interaction with the first control through clicking, swiping, or other actions. Alternatively, a user can also trigger interaction with the first control by directly triggering a third input (such as sending messages like "Append message...", "End task", "Reply directly", etc.).
[0061] In some examples, according to Figure 2C The interface 200C shown may include a first control such as a control 204-3 for "appending messages" and a control 204-4 for "direct responses." For example, the first interactive component 204 can use control 204-3 to support user input for the first task 204-1. Alternatively, the first interactive component 204 can also use control 204-4 to allow the user to end the first task 204-1, providing a direct response to the user's input (such as message 202) through a dialogic approach.
[0062] As an example, in response to a triggering operation on the first control, the electronic device 110 may display a first prompt, which may indicate that the second input component of the first interface is in a triggered state. Additionally, the electronic device 110 may receive a third input through the second input component.
[0063] As an example, according to Figure 2D The interface 200D shown, in response to a trigger operation on control 204-3, allows electronic device 110 to display a first prompt 218 (such as "Understanding the formation of typhoons in region X") on the first interface 200D. As an example, the first prompt 218 may indicate that the second input component 216 is in a triggered state. Therefore, the content entered by the user through the second input component 216 can be associated with the first task 204-1.
[0064] Additionally, the electronic device 110 can receive a third input via the second input component 216, which may be associated with, for example, the first task 204-1. For instance, the third input may reference either the first task 204-1 or the first input component 204. This allows the user to trigger supplementary information about the first task more efficiently, thereby further improving the execution efficiency of the first task and the efficiency of interaction with the intelligent system.
[0065] In some cases, in response to receiving a third input, the electronic device 110 may present a second message on a first interface, the second message of which may correspond, for example, to the third input. As an example, according to... Figure 2E As shown in the interface 200E, the electronic device 110 can also, in response to receiving a third input, present a second message 220 on the interface 200E, the second message 220 corresponding to the third input. As an example, such as... Figure 2E As shown, the second message 220 may include a third input 220-2. As an example, such a third input may be input through the second input component 216 in the interface 200D.
[0066] Alternative or additional land, such as Figure 2E As shown, the second message 220 may include a first element 220-1, which may characterize the association between the second message 220 and the first task 204-1. As an example, the first element 220-1 may be an identifier referencing the first task 204-1 (e.g., "interpreting the formation of the typhoon in region X"), or any other suitable graphic element to characterize the association with the first task 204-1.
[0067] In this way, users can more intuitively understand the relationship between the third input 220-2 and the first task 204-1, and the recognizability in multi-task scenarios can be improved. Furthermore, through the first element 220-1, the intelligent system can also understand the relationship between the third input 220-2 and the first task 204-1 more efficiently, without needing to perform task-related analysis on the second message 220, thereby saving the intelligent system's computing resources.
[0068] Alternatively or additionally, the user can also interact directly with the intelligent system through the first input component 210, and may, for example, trigger an update to the first task. As an example, according to... Figure 2F As shown in the interface 200F, the electronic device 110 can receive user input through the first input component 210. Additionally, after receiving user input through the first input component 210, a message 219 can be presented, which may correspond to the user input, for example.
[0069] Alternatively or additionally, the intelligent system can determine whether the input "Add some more information..." corresponding to message 219 is associated with the first task 204-1. As an example, since message 219 may be a message sent to the intelligent system without specifying an associated task, the intelligent system can decide whether to update the first task or other tasks based on its understanding of message 219.
[0070] As an example, if message 219 is associated with the first task 204-1, the intelligent system can use the input corresponding to message 219 to update the first task. However, if the input received through the first input component 210 is unrelated to the first task 204-1 (for example, receiving input corresponding to message 212 through the first input component 210, receiving input corresponding to message 206 through the first input component 210, etc.), the intelligent system can trigger a task or response unrelated to the first task 204-1 based on the received input.
[0071] In some cases, the electronic device 110 may provide at least one piece of content to assist the user in appending messages more efficiently. Specifically, the electronic device 110 may present at least one piece of content in a first control, the at least one piece of content being related to the execution state of a first task. Additionally, in response to the selection of the first piece of content among the at least one piece of content, the electronic device 110 may present a second message corresponding to the first content.
[0072] As an example, execution status can describe the stage a task is in during its lifecycle. Changes in the execution status of a first task can be automatically triggered based on the execution process of the first task. For instance, if the first task includes multiple subtasks, the execution status of the first task can indicate which subtask is currently being executed. Furthermore, the execution status of the first task can also indicate that the first task is running, the first task is paused, the first task is completed, the first task has been terminated, and so on. As an example, when a task is in a paused state, the task can stop executing subsequent steps.
[0073] Alternatively or additionally, the intelligent system may, during the process of requesting user assistance, switch the execution state of the first task to a paused state and present at least one item in the first control for the user to select. As an example, according to... Figure 2G The interface 200G shown can have a first interactive component 204 in a task paused state (e.g., displaying "Task paused, awaiting user response"), and display at least one piece of content. This content can include content 222-1, content 222-2 (also referred to as the first content), and content 222-3, for example, "Spring," "Autumn," "Summer," and "Winter," respectively. The first interactive component 204 can also display a control 223, which, when triggered, can skip the selection of at least one piece of content.
[0074] As an example, at least one such content could be generated based on the execution of a first task. For instance, during the execution of the first task, an intelligent system (or a corresponding intelligent object) generates at least one such content based on the lack of specified information. As another example, the generation of at least one content could be achieved through a generative model that generates at least one corresponding candidate based on input task content (e.g., "research season"). Thus, electronic device 110 can acquire at least one such candidate as at least one piece of content.
[0075] Alternative or additional land, such as Figure 2G As shown, when no interaction with at least one content or control 223 is received, the first task can be in a paused state. In this state, the electronic device 110 can still continue to receive user input and provide responses to the user input. For example, the user can directly input a specified "season" through the first input component 210 to trigger the continuation of the first task.
[0076] Alternatively or additionally, the user can also input content unrelated to the first interaction component 204 through the first input component 210. Additionally, the intelligent system can respond to the user's input first. Alternatively or additionally, if the first task is paused, the intelligent system can proactively display the first interaction component 204 to the user to request their assistance. For example, the intelligent system can continue to provide the first interaction component 204 in the session after responding to input unrelated to it. That is, when the first task 204-1 is paused, the first interaction component 204 can be used as the last interactive content of the session and can be presented in the content display area.
[0077] Alternatively or additionally, in response to the selection of content 222-2, electronic device 110 may present a message corresponding to content 222-2. As an example, according to... Figure 2H As shown in the interface 200H, the electronic device 110 can, in response to the selection of a first content among at least one content, present a second message 224, which may, for example, correspond to the first content. Figure 2H As shown, the second message 224 may include a third input 224-2 (e.g., "summer" corresponding to the selected first content). In some cases, the second message 224 may also include a first element 224-1, which indicates that the second message 224 is associated with the first task 204-1 (e.g., "interpreting the formation of typhoons in region X"). As an example, for details not fully described in the second message 224, please refer to the above text. Figure 2E The example described.
[0078] Alternatively or additionally, a third input can also be used to terminate a task. As an example, in response to receiving a third input, electronic device 110 can present a second prompt indicating that the first task has been stopped. Additionally, on the first interface, electronic device 110 can present a third message from the intelligent system, which is derived based on a fourth input.
[0079] As an example, the third input can be triggered directly through the first input component 210. For instance, the user can input "answer directly," "end task," etc., through the first input component 210. Alternatively or additionally, on interface 200D, the user can click control 204-4 to trigger the termination of the first task 204-1. Additionally, the intelligent system can provide a termination command to the first task 204-1, thereby stopping the execution of the first task 204-1. The system releases the computing resources and memory occupied by the task. The status of the first task 204-1 changes to "completed." Afterward, the task will no longer respond to any new requests.
[0080] As an example, such as Figure 2I As shown, electronic device 110 can present interface 200I, which can be an example of a first interface. In some cases, the first task 204-1 can be performed based on a fourth input received in the first interface (e.g., the fourth input in message 202). Electronic device 110 can also, in response to receiving a third input (e.g., a third input received based on a trigger operation of control 204-4 for "direct response"), present a second prompt indicating that the first task 204-1 is stopped; and present a third message 226 in the first interface 200I, the third message 226 originating from the intelligent system and obtained based on the fourth input. Figure 2I As shown, the first interface 200I can display a third message 226, for example, the third message 226 could be "The formation of the typhoon in region X is influenced by multiple factors...". In this way, users can quickly obtain a response without waiting for time-consuming tasks to complete, thereby improving the response efficiency of the intelligent system.
[0081] In some cases, electronic device 110 may allow a user to view the processing progress of the first task. Specifically, electronic device 110 may receive a first operation associated with the first interaction component 204. Additionally, in response to the first operation, electronic device 110 may display a second interface that displays the processing progress of the first task.
[0082] As an example, the first operation may include any appropriate interactive operation on the first interactive component 204. For example, such a first operation may include, but is not limited to, at least one of the following: a trigger operation on a specified area in the first interactive component 204, a trigger operation on the first task title in the first interactive component 204, a sliding operation on the first interactive component 204, a trigger operation on a preset control in the first interactive component 204, and so on.
[0083] As an example, the second interface could be, for instance, Figure 2J The interface shown is 200J. (As shown) Figure 2J As shown, the second interface can present the processing flow of the first task 204-1. For example, the second interface 200J can display the processing nodes such as the decomposition and information retrieval of the first task 204-1, as well as the corresponding intermediate results. Therefore, some examples in this paper can improve the efficiency of information retrieval for users regarding the first task.
[0084] Alternatively or additionally, users can interact with the smart object performing the first task through a second interface. As an example, any interaction by the user in the second interface can be directly associated with the first task. Alternatively or additionally, interactions performed by the user through the second interface can also be synchronized in the first interface. For example, messages from a user's conversational interaction with the smart object in the second interface can be synchronized in the content display area of the first interface.
[0085] Alternatively or additionally, the second interface may support appropriate interaction between the user and the smart object. For example, the second interface may include a third input component. The user can interact with the smart object by messaging through the third input component. As an example, the second interface may include, for instance, a third input component. Figure 2K The interface 200K is shown. In some cases, the electronic device 110 may also present a third input component 230 in the second interface 200K.
[0086] Additionally, the electronic device 110 can receive a fifth input via the third input component 230, the fifth input being used to update the first task 204-1. As an example, such as... Figure 2K As shown, the second interface 200K can display message 232 corresponding to the fifth input. As an example, in the second interface, although the fifth input corresponding to message 232 is associated with the first task, it does not need to include prompts such as the first element. Therefore, some examples in this paper can support users to directly intervene in the task while viewing the processing, thereby further improving the efficiency of interface interaction.
[0087] In some cases, the electronic device 110 may also receive a second input during the execution of the first task 204-1; and in response to the second input being relevant to the first task 204-1, present a prompt 217 indicating that the first task 204-1 is updated based on the second input. As an example, such a second input may be the third input described above, or it may be different from the third input described above.
[0088] As an example, according to Figure 2L The interface 200L shown allows the electronic device 110 to display prompts 217 (e.g., "Task updated," "Task supplemented, updated," etc.). As an example, prompt 217 could indicate that the first task was updated based on the input corresponding to message 234, or it could indicate that the first task was updated based on any one of messages 220, 219, or 224; this will not be exhaustively listed here. In this way, the user can promptly know that the first task has been updated based on its supplementary input, thereby improving the perceptibility of the interaction process.
[0089] In some cases, the prompt content displayed by the electronic device 110 may include: stopping the display of the first task 204-1 in the first interaction component 204 and displaying prompt content 217 in the first interaction component 204. For example... Figure 2E As shown, the first interactive component 204 no longer displays the first task 204-1, but instead presents a prompt message 217. In this way, task update information can be conveyed to the user without adding new interactive components, thereby saving interface space.
[0090] Alternatively or additionally, after the first task is updated, the electronic device 110 may present a third interactive component to display the updated first task. As an example, such as... Figure 2L As shown, the electronic device 110 can present an interactive component 236 (also known as a third interactive component) on the first interface 200L, which displays the updated first task 236-1.
[0091] Alternatively or additionally, the first interactive component 204 may display a first progress 204-2 of the first task 204-1. In response to receiving a second input, the electronic device 110 may stop displaying the first progress 204-2 on the first interactive component 204 and display a second progress 236-2 on the third interactive component 236. The second progress 236-2 corresponds to the updated first task 236-1. In this way, the presentation of the task progress is consistent with the updated state of the task, thereby avoiding confusion regarding progress information.
[0092] Alternatively or additionally, in response to a second input being related to the first task, the electronic device 110 may stop displaying the first task in the first interactive component and present prompt content in the first interactive component. As an example, such as... Figure 2L As shown, the first interactive component 204 can display only the prompt content 217 and stop displaying information related to the first task.
[0093] Alternatively or additionally, the content display of the first interactive component 204 can be independent of subsequent updates to the first task. That is, when the first interactive component 204 presents the prompt content 217, subsequent updates to the first task may not affect the content display of the first interactive component 204. Therefore, some examples in this paper can improve interface readability and avoid the impact of repeatedly displaying the first task on the user's information retrieval.
[0094] After the first task is completed, the electronic device 110 can provide the user with the result of the first task. Specifically, the electronic device 110 can present second content, which can be obtained by performing the first task.
[0095] As an example, according to Figure 2M The interface 200M shown allows the electronic device 110 to display second content 240-1, which can be obtained, for example, by performing the first task 204-1. As an example, such as... Figure 2M As shown, the first interface 200M can display message 240, which may include second content 240-1. For example, second content 240-1 may be a research report titled "Report on the Formation Causes of Typhoons in Region X". As an example, message 240 may include any one of the aforementioned first, second, and third interactive components. For ease of description, this document uses the example of message 240 including the first interactive component for illustrative purposes. For instance, the interactive component most recently presented and associated with the first task may be the first interactive component.
[0096] In some examples, if the context of message 240 (e.g., the previous message, for example...) Figure 2M Message 234) is associated with the first task 204-1, and electronic device 110 may not display a reference to the first task. However, if the preceding text of message 240 is unrelated to the first task, then according to... Figure 2N As shown in the interface 200N, the electronic device 110 can include element 240-2 in message 240. This element 240-2 can represent the relationship between message 240 and the first task 204-1. Therefore, the user can more intuitively understand the relationship between the second content 240-1 and the first task 204-1 in message 240.
[0097] Alternative or additional land, such as Figure 2M or Figure 2N As shown, the electronic device 110 can also present a third prompt 240-3 in the first interactive component. The third prompt 240-3 can indicate that the first task 204-1 has been completed. Alternatively or additionally, the third prompt 240-3 can be triggered to enter a third interface, which can, for example, present the generation process of the second content. As an example, the example content and example interaction process of the third interface can be referred to the example description of the second interface, which will not be repeated here. Thus, the user can promptly know the completion status of the task and can trigger the viewing of the task completion process, thereby further improving the efficiency of interface interaction.
[0098] In some cases, the tasks discussed in this article (e.g., the first task, the second task, etc.) can include tasks for deep thinking, tasks for document generation, tasks for device operation, tasks for media content (images, videos, audio, etc.), etc., which will not be exhaustively listed here. In some examples, if the first task is for media content generation, the intelligent system can also show the user one or more intermediate results during the execution of the first task, and continue to execute the first task based on the user's selection or confirmation of the intermediate results, thereby improving the quality of media generation. The following will combine... Figures 20 to 2P This section describes some examples of tasks used for media generation. It should be understood that the following combination... Figures 20 to 2P Examples not described in detail can be found in the above information. Figures 2A to 2N Examples of this will not be repeated here.
[0099] In some situations, electronic device 110 can present Figure 2O The interface 200O shown can be an example of the first interface in a media generation scenario. For example, as shown... Figure 2O As shown, the first interface 200O can display multiple messages triggered by the user, such as message 252-1 and message 252-2. For example, message 252-1 can be reference media content input by the user, and message 252-2 can be the user's input. Additionally, the electronic device 110 can perform a media generation task as a first task based on these multiple messages, and present an interactive component 254 on the first interface 200O. Interactive component 254 can be another example of the first interactive component.
[0100] Alternatively or additionally, during the execution of the first task, electronic device 110 can present... Figure 2P The interface shown is 200P, which can be an example of a first interface. For example... Figure 2PAs shown, the first interactive component 254 can present at least one piece of content, which may include content 254-1 (also referred to as first content), content 254-2, and content 254-3. The at least one piece of content may be related to the execution state of the first task, for example, it may be a selectable style. Alternatively or additionally, the first interactive component 254 can also present a control 254-4. When the control 254-4 is triggered, it can trigger skipping the selection of at least one piece of content and can trigger continuation of the first task.
[0101] Alternatively or additionally, users can select one or more content items from at least one set of content. As an example, according to... Figure 2Q The interface 200Q shown allows the electronic device 110 to display details of at least one content. For example, a user can select content 254-1 from at least one content to learn more about its details 256. Alternatively or additionally, the user can confirm the selected content by triggering control 258. For example, after selecting content 254-1, the user can trigger control 258 to confirm the selection. Thus, the intelligent system can continue performing its first task based on the selected content 254-1.
[0102] In this way, some examples in this paper can continue to present and support interactive components related to other tasks on the first interface during the execution of the first task. This allows users to initiate, view, and track other tasks related to the intelligent system while waiting for the first task, which takes a long time. This avoids the long-running tasks from interrupting the human-computer interaction process and improves the efficiency of interaction with the intelligent system.
[0103] Example process Figure 3 A flowchart illustrating an example process 300 for interface interaction under certain conditions is shown. Process 300 can be implemented at electronic device 110. See below for reference. Figure 1 To describe process 300.
[0104] like Figure 3 As shown in box 310, the electronic device 110 presents a first interactive component on the first interface. The first interactive component displays a first task. The first interface is used to interact with the intelligent system. The first task is related to the intelligent system. The first interactive component supports receiving operations associated with the first task.
[0105] In box 320, during the execution of the first task, the electronic device 110 presents a second interactive component on the first interface. The second interactive component displays a second task, which is related to the intelligent system.
[0106] In some cases, the electronic device 110 may receive a first input during the execution of a first task; and in response to the first input being of a first type, present a second interactive component on a first interface.
[0107] In some cases, the electronic device 110 may present a first input component on a first interface and receive first input via the first input component, the first input including natural language input.
[0108] In some cases, the first type is related to the needs expressed by the natural language input.
[0109] In some cases, electronic device 110 may respond to a first input being of the second type by presenting a first message on a first interface, the first message being from an intelligent system and being obtained based on the first input.
[0110] In this way, some examples in this paper can achieve multi-task parallelism through the first and second interactive components, avoid unnecessary task overhead by distinguishing input types, and reduce the operation threshold by supporting natural language input, thereby improving interaction efficiency, increasing the response speed of intelligent systems, and enhancing the user experience.
[0111] In some cases, the electronic device 110 may receive a second input during the execution of the first task; and in response to the second input being related to the first task, present a prompt indicating that the first task is updated based on the second input.
[0112] In some cases, the electronic device 110 may present a third interactive component on the first interface, which displays the updated first task.
[0113] In some cases, the first interactive component displays a first progress of a first task. In response to receiving a second input, the electronic device 110 may stop displaying the first progress in the first interactive component and display a second progress in the third interactive component, the second progress corresponding to the updated first task.
[0114] In some cases, the electronic device 110 may stop displaying the first task in the first interactive component and present prompt content in the first interactive component.
[0115] In this way, some examples in this article can proactively present task update prompts by obtaining a second input, and display the updated task and its progress through a third interactive component, while presenting the prompt content in the original interactive component (the first interactive component). This allows users to be informed of task changes in a timely manner, avoids information confusion, and improves the readability of the interface.
[0116] In some cases, the electronic device 110 may present a first control in a first interactive component and receive a third input associated with a first task based on a triggering operation on the first control.
[0117] In some cases, electronic device 110 may, in response to receiving a third input, present a second message on a first interface, the second message corresponding to the third input.
[0118] In some cases, the second message includes the first element, which indicates that the second message is associated with the first task.
[0119] In some cases, the electronic device 110 may present at least one piece of content in a first control, the at least one piece of content being related to the execution state of a first task; and in response to the selection of the first piece of content, present a second message corresponding to the first piece of content.
[0120] In some cases, the electronic device 110 may respond to a triggering operation of the first control by presenting a first prompt, the first prompt indicating that the second input component of the first interface is in a triggered state; and receive a third input through the second input component.
[0121] In some cases, the first task is performed based on the fourth input received on the first interface. The electronic device 110 may respond to the receipt of the third input by presenting a second prompt indicating that the first task has been stopped; and present a third message on the first interface, the third message being from the intelligent system and obtained based on the fourth input.
[0122] In this way, some examples in this paper can provide additional input channels and corresponding feedback through the first control, and the first element can be added to the message to identify the task association, thereby further improving the efficiency of user interaction with the intelligent system and the efficiency of user adjustment of the first task.
[0123] In some cases, the electronic device 110 may receive a first operation associated with the first interactive component; and in response to the first operation, present a second interface that displays the processing of the first task.
[0124] In this way, some examples in this paper jump to a second interface to present the processing of the first task by receiving a first operation associated with the first interactive component, thereby enabling traceable viewing of the task processing process and further improving the efficiency of users understanding the first task.
[0125] In some cases, the electronic device 110 may present a third input component on the second interface and receive a fifth input through the third input component, the fifth input being used to update the first task.
[0126] In this way, some examples in this paper can provide a third input component in the second interface, allowing users to directly enter a fifth input to update the first task without having to return to the previous interface. This maintains the continuity of the operation chain, reduces the number of interface jumps, and allows users to intervene in the task in real time while viewing the processing, thus improving the efficiency of interface interaction.
[0127] In some cases, the electronic device 110 may present second content obtained by performing a first task; receive a second operation associated with the second content; and in response to the second operation, present a third interface that shows the generation process of the second content.
[0128] In this way, some examples in this article can jump to a third interface to present the generation process of the second content by receiving a second operation associated with the second content, thereby enabling traceable viewing of the task processing process and helping users to further understand the execution process of the first task.
[0129] In some cases, the electronic device 110 may present a third prompt in the first interactive component, the third prompt indicating that the first task has been completed.
[0130] In this way, some examples in this article can more intuitively inform users of the results of task execution, thereby further improving the efficiency of users in obtaining information.
[0131] In some cases, the first task is triggered by the first request, and the second task is triggered by the second request. The first request and the second request correspond to different receiving methods.
[0132] In some cases, the first request and the second request are received through different applications, or from different users.
[0133] In this way, some examples in this paper can support more flexible interaction methods with intelligent systems and enable requests from different sources to be triggered as corresponding tasks in parallel, thereby expanding the applicable scenarios for multi-task parallel processing. Furthermore, some examples in this paper can also support cross-application and cross-user collaborative interaction scenarios through this multi-task parallel processing approach, thereby further improving the efficiency of interaction with intelligent systems.
[0134] Example devices and equipment A corresponding apparatus for implementing the above methods or processes is also provided. Figure 4A schematic structural block diagram of an example device 400 for interface interaction is shown, according to some scenarios. Device 400 can be implemented as or included in electronic device 110. The various modules / components in device 400 can be implemented by hardware, software, firmware, or any combination thereof.
[0135] Figure 4 A block diagram of a device 400 for interface interaction under certain conditions is shown. Device 400 can be implemented as or included in electronic device 110. The various modules / components in device 400 can be implemented by hardware, software, firmware, or any combination thereof.
[0136] like Figure 4 As shown, the device 400 includes a first presentation module 410 configured to present a first interactive component on a first interface, the first interactive component displaying a first task, the first interface being used to interact with an intelligent system, the first task being related to the intelligent system, and the first interactive component supporting the reception of operations associated with the first task; and a second presentation module 420 configured to present a second interactive component on the first interface during the execution of the first task, the second interactive component displaying a second task, and the second task being related to the intelligent system.
[0137] In some cases, the second presentation module 420 may also be configured to: receive a first input during the execution of the first task; and, in response to the first input being of a first type, present a second interactive component on the first interface.
[0138] In some cases, the second presentation module 420 may also be configured to: present a first input component on a first interface; and receive first input via the first input component, the first input including natural language input.
[0139] In some cases, the first type is related to the needs expressed by the natural language input.
[0140] In some cases, device 400 may also include a message presentation module configured to present a first message on a first interface in response to a first input being of the second type, the first message originating from an intelligent system and being derived based on the first input.
[0141] In some cases, the device 400 may also include a prompt presentation module configured to receive a second input during the execution of the first task; and to present prompt content in response to the second input being related to the first task, the prompt content indicating that the first task is updated based on the second input.
[0142] In some cases, the prompt presentation module can also be configured to present a third interactive component on the first interface, which displays the updated first task.
[0143] In some cases, the first interactive component displays the first progress of the first task, and the prompt presentation module can also be configured to: in response to receiving a second input, stop displaying the first progress in the first interactive component and display the second progress in the third interactive component, the second progress corresponding to the updated first task.
[0144] In some cases, the prompt presentation module can also be configured to: stop displaying the first task in the first interactive component and present the prompt content in the first interactive component.
[0145] In some cases, device 400 may also include a control presentation module configured to present a first control in a first interactive component; and to receive a third input associated with a first task based on a triggering operation on the first control.
[0146] In some cases, the control presentation module can also be configured to present a second message on the first interface in response to receiving a third input, the second message corresponding to the third input.
[0147] In some cases, the second message includes the first element, which indicates that the second message is associated with the first task.
[0148] In some cases, the control rendering module can also be configured to: render at least one piece of content in a first control, the at least one piece of content being related to the execution state of a first task; and, in response to the selection of the first piece of content, render a second message corresponding to the first piece of content.
[0149] In some cases, the control presentation module can also be configured to: present a first prompt in response to a triggering operation on the first control, the first prompt indicating that the second input component of the first interface is in a triggered state; and receive a third input through the second input component.
[0150] In some cases, the first task is performed based on a fourth input received in the first interface, and the control presentation module can also be configured to: in response to receiving a third input, present a second prompt indicating that the first task has been stopped; and present a third message in the first interface, the third message being from the intelligent system and obtained based on the fourth input.
[0151] In some cases, the device 400 may also include an interface presentation module configured to receive a first operation associated with the first interactive component; and in response to the first operation, to present a second interface that presents the processing of the first task.
[0152] In some cases, the interface presentation module can also be configured to: present a third input component in a second interface; and receive a fifth input through the third input component, the fifth input being used to update the first task.
[0153] In some cases, device 400 may further include a content presentation module configured to present second content obtained by performing a first task; receive a second operation associated with the second content; and, in response to the second operation, present a third interface that presents the generation process of the second content.
[0154] In some cases, the content presentation module can also be configured to present a third prompt in the first interactive component, the third prompt indicating that the first task has been completed.
[0155] In some cases, the first task is triggered by the first request, and the second task is triggered by the second request. The first request and the second request correspond to different receiving methods.
[0156] In some cases, the first request and the second request are received through different applications; or the first request and the second request are received from different users.
[0157] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.
[0158] Figure 5 A block diagram of an electronic device 500 in which one or more examples may be implemented is shown. It should be understood that... Figure 5 The electronic device 500 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 5 The electronic device 500 shown can be used to implement the electronic device 110 discussed above.
[0159] like Figure 5 As shown, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 may include, but are not limited to, one or more processing units or processors 510, memory 520, storage devices 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 500.
[0160] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.
[0161] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 5 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various examples.
[0162] The communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.
[0163] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).
[0164] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.
[0165] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0166] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0167] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0168] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0169] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.
Claims
1. A method for interface interaction, comprising: A first interactive component is presented on a first interface. The first interactive component displays a first task. The first interface is used to interact with the intelligent system. The first task is related to the intelligent system. The first interactive component supports receiving operations associated with the first task. as well as During the execution of the first task, a second interactive component is presented on the first interface. The second interactive component displays a second task, which is related to the intelligent system.
2. The method according to claim 1, wherein presenting the second interactive component on the first interface comprises: During the execution of the first task, the first input is received; as well as In response to the first input being of the first type, the second interactive component is presented on the first interface.
3. The method of claim 2, wherein presenting the second interactive component on the first interface in response to the first input being of a first type comprises: On the first interface, the first input component is presented; as well as The first input, including natural language input, is received via the first input component.
4. The method according to claim 2, further comprising: In response to the first input being of the second type, a first message is presented on the first interface. The first message originates from the intelligent system and is obtained based on the first input.
5. The method according to claim 1, further comprising: During the execution of the first task, a second input is received; as well as In response to the second input being relevant to the first task, a prompt is displayed indicating that the first task has been updated based on the second input.
6. The method according to claim 5, wherein the presentation of the prompt content includes: On the first interface, a third interactive component is presented, which displays the updated first task.
7. The method of claim 6, wherein the first interactive component displays a first progress of the first task, the method comprising: In response to receiving the second input, the presentation of the first progress in the first interactive component is stopped, and a second progress corresponding to the updated first task is displayed in the third interactive component.
8. The method according to claim 1, further comprising: In the first interactive component, the first control is presented; as well as Based on the triggering operation of the first control, a third input associated with the first task is received.
9. The method according to claim 8, further comprising: In response to receiving the third input, a second message is presented on the first interface, the second message corresponding to the third input.
10. The method of claim 9, wherein presenting a second message on the first interface in response to receiving the third input comprises: The first control displays at least one piece of content, which is related to the execution status of the first task; as well as In response to the selection of a first content among the at least one content, a second message is presented, the second message corresponding to the first content.
11. The method of claim 8, wherein receiving the third input associated with the first task based on a triggering operation on the first control comprises: In response to the triggering operation on the first control, a first prompt is displayed, the first prompt indicating that the second input component of the first interface is in a triggered state; as well as The third input is received through the second input component.
12. The method according to claim 1, further comprising: Receive a first operation associated with the first interactive component; as well as In response to the first operation, a second interface is displayed, which shows the processing of the first task.
13. The method of claim 12, further comprising: In the second interface, a third input component is presented; as well as The fifth input is received through the third input component, and the fifth input is used to update the first task.
14. The method according to claim 1, further comprising: The second content is presented, which is obtained by performing the first task; Receive a second operation associated with the second content; as well as In response to the second operation, a third interface is presented, which shows the generation process of the second content.
15. The method of claim 14, further comprising: In the first interactive component, a third prompt is presented, indicating that the first task has been completed.
16. The method according to claim 1, wherein the first task is triggered by a first request, the second task is triggered by a second request, and the first request and the second request correspond to different receiving methods.
17. The method of claim 16, wherein: The first request and the second request are received through different applications; or The first request and the second request were received from different users.
18. A device for user interface interaction, comprising: The first presentation module is configured to present a first interactive component on a first interface, the first interactive component displays a first task, the first interface is used to interact with the intelligent system, the first task is related to the intelligent system, and the first interactive component supports receiving operations associated with the first task. as well as The second presentation module is configured to present a second interactive component on the first interface during the execution of the first task. The second interactive component displays a second task, which is related to the intelligent system.
19. An electronic device comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 17 when executed by the at least one processor.
20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 17.