Interaction method and apparatus, device, and storage medium
Patent Information
- Authority / Receiving Office
- AU · AU
- Patent Type
- Applications
- Current Assignee / Owner
- BEIJING ZITIAO NETWORK TECH CO LTD
- Filing Date
- 2024-12-18
- Publication Date
- 2026-07-09
AI Technical Summary
In the prior art, users have low interaction efficiency with target objects on the Internet platform, especially when processing a large number of messages, it is difficult to efficiently conduct multimodal interaction.
By presenting an interactive interface with a virtual object based on the interaction request of the target object, an interactive interface with the virtual object is presented, and a second message generated by reference information associated with the target object is generated based on the message from the current user, providing a multimodal interactive interface.
It provides users with space for multimodal one-to-one interaction with virtual objects, improving interaction efficiency and timeliness of information processing.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Interaction method, device, equipment and storage medium
[0001] This application claims priority to the Chinese invention patent application entitled “Interactive Method, Apparatus, Device and Storage Medium” filed on December 25, 2023, with application number 202311801561.7, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to interactive methods, apparatuses, devices, and computer-readable storage media. Background Art
[0003] With the development of computer technology, the Internet has become an important platform for people to exchange information. For example, people can share various works through the platform and also obtain works shared by other users. Summary of the Invention
[0004] In a first aspect of the present disclosure, an interaction method is provided. The method comprises: presenting an interaction interface with a virtual object based on an interaction request associated with a target object, the virtual object corresponding to the target object, the interaction interface being configured to provide a multimodal interaction between a current user and the target object; and presenting a second message from the virtual object on the interaction interface based on a first message from the current user, wherein the second message is generated based on reference information associated with the target object.
[0005] In a second aspect of the present disclosure, an interactive device is provided. The device includes: an interface presentation module configured to present an interactive interface with a virtual object based on an interaction request associated with a target object, the virtual object corresponding to the target object, the interactive interface being configured to provide a multimodal interaction between a current user and the target object; and a message presentation module configured to present a second message from the virtual object on the interactive interface based on a first message from the current user, wherein the second message is generated based on reference information associated with the target object.
[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.
[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.
[0008] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:
[0010] FIG1 shows a schematic diagram of an example environment in which embodiments according to the present disclosure may be implemented;
[0011] 2A to 2C illustrate example interfaces according to some embodiments of the present disclosure;
[0012] 3A to 3C illustrate example interfaces according to further embodiments of the present disclosure;
[0013] 4A to 4C illustrate example interfaces according to further embodiments of the present disclosure;
[0014] 5A and 5B illustrate example interfaces according to further embodiments of the present disclosure;
[0015] FIG6 shows an example interface according to yet other embodiments of the present disclosure;
[0016] FIG7 shows a flowchart of an example interaction process according to some embodiments of the present disclosure;
[0017] FIG8 shows a schematic structural block diagram of an interaction device according to some embodiments of the present disclosure; and
[0018] FIG9 illustrates a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION
[0019] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.
[0020] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.
[0021] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.
[0022] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects shall comply with the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms them. Accordingly, when implementing the various embodiments of the present disclosure, the types, scope of use, and usage scenarios of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method may vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.
[0023] If this specification and the solutions in the examples involve the processing of personal information, such processing will be done only with a legitimate basis (such as with the consent of the subject of personal information or as necessary for the performance of a contract) and only within the prescribed or agreed scope. A user's refusal to process personal information other than that required for basic functions will not affect the user's use of basic functions.
[0024] The internet provides people with a variety of ways to interact. For example, people can interact with live streamers through live broadcast rooms or interact with other users through private messages. However, users may receive a large number of messages, and ensuring that these messages are processed promptly and efficiently is a key concern.
[0025] Embodiments of the present disclosure propose an interaction solution. According to this solution, an interaction interface with a virtual object can be presented based on an interaction request associated with a target object. The virtual object corresponds to the target object, and the interaction interface is used to provide multimodal interaction between the current user and the target object. Furthermore, based on a first message from the current user, a second message from the virtual object can be presented on the interaction interface, where the second message is generated based on reference information associated with the target object.
[0026] In this way, the embodiments of the present disclosure can provide users with a space for multimodal one-to-one interaction with virtual objects, thereby improving interaction efficiency.
[0027] Various example implementations of this solution are described in detail below in conjunction with the accompanying drawings.
[0028] Sample Environment
[0029] FIG1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG1 , the example environment 100 may include an electronic device 110 .
[0030] In this example environment 100, electronic device 110 may run an application 120 that supports interface interaction. Application 120 may be any suitable type of application for interface interaction, examples of which may include, but are not limited to, video applications, social applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.
[0031] In the environment 100 of FIG. 1 , if the application 120 is in an active state, the electronic device 110 may present an interface 150 for supporting interface interaction through the application 120 .
[0032] In some embodiments, the electronic device 110 communicates with the server 130 to enable the provision of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.).
[0033] The server 130 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. For example, the server 130 may include a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 may provide background services for the application 120 that supports virtual scenes in the electronic device 110.
[0034] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired or wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.
[0035] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.
[0036] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.
[0037] Example Interaction
[0038] An example interaction process according to an embodiment of the present disclosure will be described below with reference to FIG. 2A to FIG. 6 .
[0039] 2A to 2C , which illustrate example interfaces 200A to 200C according to some embodiments of the present disclosure. The interfaces 200A to 200C may be provided by the electronic device 110 as shown in FIG1 .
[0040] 2A may correspond to an interaction interface between the current user and a virtual object. In some embodiments, the electronic device 110 may present the interface 200A shown in FIG2A based on an interaction request associated with a target object from the current user for interaction with the virtual object corresponding to the target object.
[0041] In some embodiments, the target object may include an appropriate user object in the platform, such as “User X.” In some embodiments, the electronic device 110 may provide an access entry for accessing the interface 200A in an interface associated with the target object.
[0042] For example, the electronic device 110 may provide an access entry for accessing the interface 200A in the target object's personal homepage or work viewing interface. Furthermore, the electronic device 110 may receive a user's access request based on the user's selection of the access entry and present the interface 200A accordingly.
[0043] As shown in Figure 2A, interface 200A may include an information display area 205 for displaying information associated with the virtual object. As shown in Figure 2A, information display area 205 may be used to display identification information of the target object (e.g., user X) corresponding to the virtual object, such as a text identifier (e.g., user name) and / or an image identifier (e.g., avatar).
[0044] In some embodiments, the electronic device 110 may also receive a user's selection of identification information or the information display area 205 and further display description information of the virtual object. Such description information may include, but is not limited to, a nickname of the virtual object, an introduction to the virtual object, and a type of the virtual object.
[0045] In some embodiments, at least part of such description information may be determined based on a configuration operation of the target object. For example, the target object (eg, user X) may customize a nickname for the corresponding virtual object.
[0046] In some embodiments, the information display area 205 may further display type information of the virtual object. In some embodiments, the type information may indicate that the virtual object is created based on the image of the first target user, where the first target user is the target object of the published virtual object.
[0047] In some embodiments, the type information may indicate that the virtual object is created based on a virtual character, and the virtual character is a target object corresponding to an animated model image created by the second target user. In some scenarios, such a virtual object is also referred to as a virtual character.
[0048] Additionally, the interface 200A may further include a sharing portal 210 to support the user to share the virtual object with other users. Other users may, for example, access the interactive interface with the virtual object based on accessing the received shared content.
[0049] 2A , the interface 200A may further include an image display area 215 for displaying visual elements 220 corresponding to the virtual object. Such visual elements may include, but are not limited to, two-dimensional images, three-dimensional images, three-dimensional models, and the like.
[0050] In some embodiments, such a visual element 220 may be created based on a configuration operation of a target object. For example, a user may upload a picture or take a photo to create a visual element 220 corresponding to a virtual object.
[0051] Alternatively, such visual element 220 may also be generated based on visual resources associated with the target object. For example, the corresponding visual element 220 may be automatically generated based on the user's avatar.
[0052] In some embodiments, interface 200A further includes a message display area 225. This message display area 225 can be used to present messages from the current user or messages from a virtual object. Taking FIG. 2A as an example, message display area 225 can display the content of a message 255 from a virtual object.
[0053] 2 , the interface 200A may further provide a plurality of controls for interacting with the virtual object. Specifically, the interface 200A may include a set of candidate interaction items, such as a candidate interaction item 230 and a candidate interaction item 235 .
[0054] Furthermore, the electronic device 110 may receive a selection of the interactive item 235 , thereby obtaining a first message corresponding to the interactive item 235 as a message sent by the current user to the virtual object.
[0055] Specifically, as shown in FIG. 2B , the electronic device 110 may display the content of the first message 260 corresponding to the interactive item 235 in the message display area 225 based on the user's selection of the interactive item 235 .
[0056] Further, as shown in FIG. 2C , in the interface 200C, the electronic device 110 may provide a second message 265 from the virtual object as a reply to the first message 260 .
[0057] In some embodiments, the second message 265 may be generated based on the first message 260. As an example, the electronic device 110 may generate the corresponding second message 265 using any appropriate machine learning model (eg, a language model).
[0058] In some embodiments, the generation of the second message 265 may also be based on reference information associated with the target object (e.g., user X). Such reference information may include, for example, descriptive information about a set of target resources associated with the target object. For example, with the knowledge and permission of the target object, the target object may upload or select a set of resources for training a model corresponding to the virtual object so that the virtual object has corresponding knowledge, language style, and / or timbre.
[0059] In some embodiments, the set of target resources associated with the target object may include work resources. For example, the target object may train or fine-tune the model by selecting one or more published works, so that the model can generate a reply to the user's input message with reference to the one or more works.
[0060] In some embodiments, the set of target resources associated with the target object may include product resources. For example, when the target object is selling or promoting a specific product, the target object may provide information about the product to the model for training or fine-tuning the model, so that the model can reference the product information to generate a response to a user's input message.
[0061] 2C , the electronic device 110 may display the target content corresponding to the second message 265 in the message display area 225. As an example, such a second message 265 may include various types of content, such as text content, image content, video content, audio content, link content, and the like.
[0062] Accordingly, text content, image content, video content, link content, etc. can be presented in the message display area 225, and the corresponding audio content can be played by the electronic device 110. For example, the electronic device 110 can provide the audio content corresponding to the second message 265 while presenting the target content of the second message 265.
[0063] 2C as an example, the target content presented in the message display area 225 may include text content, image content, and product link content. The electronic device 110 may also present a page corresponding to the link content, such as a product purchase page, based on the selection of the link content.
[0064] In some embodiments, when displaying the second message, the electronic device 110 may also control the visual element 220 to display a corresponding effect. For example, the electronic device 110 may drive the visual element 220 to perform corresponding movements based on the text content of the second message, such as mouth movements, facial expression changes, etc. This disclosure is not intended to limit the driving method of the visual element 220.
[0065] Continuing with FIG2A , candidate interaction item 230 may correspond to a specific link, for example. Upon receiving a selection of candidate interaction item 230, electronic device 110 may display a window or page corresponding to the specific link. For example, using FIG2A as an example, candidate interaction item 230 may be used to direct users to a page displaying a group of products associated with the target object.
[0066] 2A , in some embodiments, the interface 200A may further provide a first interactive portal 240. In response to receiving a selection of the first interactive portal 240, the electronic device 110 may display an interface 300A as shown in FIG3A .
[0067] 3A , the electronic device 110 may provide an input field 310 in the interface 300A. The electronic device 110 may receive a first message input by the user via the input field 310. For example, the user may input the first message through a keyboard input control, an audio input control, and / or a picture input control in the input field 310.
[0068] Furthermore, as shown in FIG3B , after the user completes inputting the first message and chooses to send, the electronic device 110 may display the content of the first message 320 in the message display area 225 .
[0069] 3C , the electronic device 110 may display the content of the second message 330 from the virtual object in the message display area 225. Similarly, the electronic device 110 may also drive the visual element 220 to perform corresponding motion based on the second message 330, and may also provide audio content corresponding to the second message 330.
[0070] 2A , in some embodiments, the interface 200A may further provide a second interactive portal 250. In response to receiving a selection of the second interactive portal 250, the electronic device 110 may display an interface 400A as shown in FIG4A .
[0071] 4A , the electronic device 110 may provide an image input control 410 in the interface 400A. The electronic device 110 may receive an image message input via the image input control 410 as a first message sent to the virtual object.
[0072] For example, the user can capture a new image, such as a picture or video, as the first message through the capture control in the image input control 410. As another example, the user can also select an existing picture or video (e.g., picture 430) as the first message sent to the virtual object.
[0073] 4B , after the user completes inputting the first message and selects to send, the electronic device 110 may display the content of the first message 440 in the message display area 225. The content may include a preview of the selected image message and a corresponding text description.
[0074] 4C , the electronic device 110 may display the content of the second message 450 from the virtual object in the message display area 225. Similarly, the electronic device 110 may also drive the visual element 220 to perform corresponding motion based on the second message 450, and may also provide audio content corresponding to the second message 450.
[0075] 2A , in some embodiments, the interface 200A may further provide a third interactive portal 245. In response to receiving a selection of the third interactive portal 245, the electronic device 110 may display an interface 500A as shown in FIG5A .
[0076] As shown in Figure 5A, the electronic device 110 can receive the audio message input by the user as the first message based on the selection of the third interactive portal 245. As shown in Figure 5A, during the audio message reception, the electronic device 110 can also, for example, substantially synchronously display the text content 510 corresponding to the audio message in the message display area 225.
[0077] 5C , after the user completes input of the first message and selects to send it, the electronic device 110 may display the content of the second message 520 from the virtual object in the message display area 225. Similarly, the electronic device 110 may also drive the visual element 220 to perform corresponding motion based on the second message 520, and may also provide audio content corresponding to the second message 520.
[0078] In some embodiments, the interface 200A may be configured to provide an interaction container (also referred to as an interaction space) for supporting the multimodal interaction between the current user and the virtual object, wherein the participants of the interaction container include only the current user and the virtual object.
[0079] Based on the interaction process described above, the embodiments of the present disclosure can provide users with a space for multimodal one-to-one interaction with virtual objects, thereby improving interaction efficiency.
[0080] In some embodiments, the message display area 225 as described above with reference to FIG. 2A to FIG. 5B can also be used to trigger the viewing of historical messages.
[0081] Specifically, the electronic device 110 may receive a preset operation for the message display area 225. Accordingly, as shown in FIG6 , the electronic device 110 may present a message viewing window 610 for displaying a set of historical messages 620 between the current user and the virtual object.
[0082] In this way, the embodiments of the present disclosure can further facilitate users to understand the interaction history with virtual objects, thereby improving the efficiency of message interaction.
[0083] Example Process
[0084] FIG7 shows a flow chart of an example interaction process 700 according to some embodiments of the present disclosure. Process 700 may be implemented at electronic device 110. Process 700 is described below with reference to FIG1.
[0085] As shown in Figure 7, in box 710, the electronic device 110 presents an interaction interface with the virtual object based on the interaction request associated with the target object. The virtual object corresponds to the target object, and the interaction interface is used to provide multimodal interaction with the participants being the current user and the target object.
[0086] In box 720, the electronic device 110 presents a second message from the virtual object on the interactive interface based on the first message from the current user, wherein the second message is generated based on reference information associated with the target object.
[0087] In some embodiments, the interactive interface presents visual elements corresponding to the virtual objects.
[0088] In some embodiments, the visual element presents an effect corresponding to the second message.
[0089] In some embodiments, the interactive interface presents identification information of the target object, where the identification information includes a text identification and / or an image identification.
[0090] In some embodiments, process 700 further includes: presenting description information about the virtual object based on a first preset operation on the identification information.
[0091] In some embodiments, at least part of the description information is determined based on a configuration operation of the target object.
[0092] In some embodiments, the interactive interface also includes type information for indicating the virtual object, wherein the type information indicates: the virtual object is created based on the image of a first target user, and the first target user is the target object for publishing the virtual object; or the virtual object is created based on a virtual character, and the virtual character is the target object corresponding to the animated model image created by the second target user.
[0093] In some embodiments, the interactive interface includes a message display area, and presenting the second message from the virtual object on the interactive interface includes: presenting target content corresponding to the second message in the message display area.
[0094] In some embodiments, the target content includes at least one of the following: text content; image content; video content; link content.
[0095] In some embodiments, process 700 further includes: based on the selection of the linked content, presenting a page corresponding to the linked content.
[0096] In some embodiments, process 700 further includes: based on a second preset operation for the message display area, presenting a message viewing window, where the message viewing window displays a set of historical messages between the current user and the virtual object.
[0097] In some embodiments, process 700 further includes providing audio content corresponding to the second message concurrently with presenting the target content.
[0098] In some embodiments, the reference information includes descriptive information about a set of target resources, the set of target resources being associated with the target object.
[0099] In some embodiments, a group of target resources includes at least one of the following: work resources, commodity resources.
[0100] In some embodiments, the interactive interface includes a group of candidate interaction items, and the method further includes: based on a selection of a target interaction item from the group of candidate interaction items, obtaining a first message corresponding to the target interaction item.
[0101] In some embodiments, process 700 further includes: receiving a selection of a first interactive entry in the interactive interface, presenting an input field; and receiving a first message input via the input field.
[0102] In some embodiments, the process 700 further includes: receiving a selection of a second interactive portal in the interactive interface, presenting an image input control; and receiving an image message input via the image input control as the first message.
[0103] In some embodiments, process 700 further includes: receiving a selection of a third interactive entry in the interactive interface, and receiving a voice message as the first message.
[0104] In some embodiments, the interactive interface is configured to provide an interactive container for supporting multimodal interaction between the current user and the virtual object, where participants in the interactive container are the current user and the virtual object.
[0105] Example devices and equipment
[0106] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above-described methods or processes. FIG8 shows a schematic structural block diagram of an interactive apparatus 800 according to certain embodiments of the present disclosure. Apparatus 800 may be implemented as or included in electronic device 110. Each module / component in apparatus 800 may be implemented by hardware, software, firmware, or any combination thereof.
[0107] As shown in Figure 8, the device 800 includes an interface presentation module 810, which is configured to present an interaction interface with a virtual object based on an interaction request associated with a target object, where the virtual object corresponds to the target object, and the interaction interface is used to provide multimodal interaction with the participants being the current user and the target object; and a message presentation module 820, which is configured to present a second message from the virtual object on the interaction interface based on a first message from the current user, where the second message is generated based on reference information associated with the target object.
[0108] In some embodiments, the interactive interface presents visual elements corresponding to the virtual objects.
[0109] In some embodiments, the visual element presents an effect corresponding to the second message.
[0110] In some embodiments, the interactive interface presents identification information of the target object, where the identification information includes a text identification and / or an image identification.
[0111] In some embodiments, the apparatus 900 further includes an object description module configured to present description information about the virtual object based on a first preset operation on the identification information.
[0112] In some embodiments, at least part of the description information is determined based on a configuration operation of the target object.
[0113] In some embodiments, the interactive interface also includes type information for indicating the virtual object, wherein the type information indicates: the virtual object is created based on the image of a first target user, and the first target user is the target object for publishing the virtual object; or the virtual object is created based on a virtual character, and the virtual character is the target object corresponding to the animated model image created by the second target user.
[0114] In some embodiments, the interactive interface includes a message display area, and the message presentation module 820 is further configured to present target content corresponding to the second message in the message display area.
[0115] In some embodiments, the target content includes at least one of the following: text content; image content; video content; link content.
[0116] In some embodiments, the apparatus 800 further includes a page access module configured to present a page corresponding to the link content based on a selection of the link content.
[0117] In some embodiments, the device 800 further includes a history viewing module configured to: based on a second preset operation for the message display area, present a message viewing window, where the message viewing window displays a set of historical messages between the current user and the virtual object.
[0118] In some embodiments, the apparatus 800 further includes an audio providing module configured to provide audio content corresponding to the second message while presenting the target content.
[0119] In some embodiments, the reference information includes descriptive information about a set of target resources, the set of target resources being associated with the target object.
[0120] In some embodiments, a group of target resources includes at least one of the following: work resources, commodity resources.
[0121] In some embodiments, the interactive interface includes a group of candidate interaction items, and the method further includes: based on a selection of a target interaction item from the group of candidate interaction items, obtaining a first message corresponding to the target interaction item.
[0122] In some embodiments, the apparatus 800 further includes a first input module configured to: receive a selection of a first interactive entry in the interactive interface, present an input field; and receive a first message input via the input field.
[0123] In some embodiments, the device 800 further includes a second input module configured to: receive a selection of a second interactive entrance in the interactive interface and present an image input control; and receive an image message input via the image input control as the first message.
[0124] In some embodiments, the device 800 further includes a third input module configured to receive a selection of a third interactive entry in the interactive interface and receive a voice message as the first message.
[0125] In some embodiments, the interactive interface is configured to provide an interactive container for supporting multimodal interaction between the current user and the virtual object, where participants in the interactive container are the current user and the virtual object.
[0126] FIG9 shows a block diagram of an electronic device 900 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 900 shown in FIG9 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 900 shown in FIG9 can be used to implement the electronic device 110 of FIG1 .
[0127] As shown in FIG9 , electronic device 900 is a general-purpose electronic device. Components of electronic device 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. Processing unit 910 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 920. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 900.
[0128] The electronic device 900 typically includes a plurality of computer storage media. Such media can be any accessible media that the electronic device 900 can access, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 930 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 900.
[0129] The electronic device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 9 , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 920 may include a computer program product 925 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.
[0130] The communication unit 940 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 900 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 900 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0131] The input device 950 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 960 may be one or more output devices, such as a display, a speaker, or a printer. The electronic device 900 may also communicate with one or more external devices (not shown) through the communication unit 940 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with the electronic device 900, or with any device that allows the electronic device 900 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0132] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.
[0133] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0134] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.
[0135] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0136] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0137] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.
Claims
1. A method for interaction, comprising:presenting an interactive interface for a virtual object based on an interaction request associated with a target object, the virtual object corresponding to the target object, and the interactive interface being configured to provide a multimodal interaction where participants are a current user and the target object; andpresenting a second message from the virtual object in the interactive interface based on a first message from the current user, wherein the second message is generated based on reference information associated with the target object.
2. The method of claim 1, wherein the interactive interface presents a visual element corresponding to the virtual object.
3. The method of claim 2, wherein the visual element presents an effect corresponding to the second message.
4. The method of claim 1, wherein the interactive interface presents identification information of the target object, the identification information comprising a text identification and / or an image identification.
5. The method of claim 4, further comprising:presenting description information about the virtual object based on a first preset operation for the identification information.
6. The method of claim 5, wherein at least a portion of the description information is determined based on a configuration operation of the target object.
7. The method of claim 1, wherein the interactive interface further comprises type information for indicating the virtual object, and wherein the type information indicates that:the virtual object is created based on a portrait of a first target user, the first target user being the target object who publishes the virtual object; orthe virtual object is created based on a virtual character, and the virtual character is a target object corresponding to an animation model portrait created by a second target user.
8. The method of claim 1, wherein the interactive interface comprises a message display area, and presenting the second message from the virtual object in the interactive interface comprises:presenting target content corresponding to the second message in the message display area.
9. The method of claim 8, wherein the target content comprises at least one of:text content;picture content;video content; orlink content.
10. The method of claim 9, further comprising:presenting a page corresponding to the link content based on a selection of the link content.
11. The method of claim 8, further comprising:presenting a message viewing window based on a second preset operation on the message display area, the message viewing window displaying a group of historical messages between the current user and the virtual object.
12. The method of claim 8, further comprising:providing audio content corresponding to the second message while presenting the target content.
13. The method of claim 1, wherein the reference information comprises description information about a group of target resources associated with the target object.
14. The method of claim 13, wherein the group of target resources comprises at least one of:work resources, orproduct resources.
15. The method of claim 1, wherein the interactive interface comprises a group of candidate interaction items, and the method further comprises:obtaining the first message corresponding to a target interaction item based on a selection of the target interaction item from the group of candidate interaction items.
16. The method of claim 1, further comprising:receiving a selection for a first interactive entry in the interactive interface, and presenting an input bar; andreceiving the first message input via the input bar.
17. The method of claim 1, further comprising:receiving a selection for a second interactive entry in the interactive interface, and presenting an imageinput control; andreceiving an image message input via the image input control as the first message.
18. The method of claim 1, further comprising:receiving a selection for a third interactive entry in the interactive interface, and receiving a voice message as the first message.
19. The method of claim 1, wherein the interactive interface is configured to provide an interactive container for supporting the multimodal interaction between the current user and the virtual object, and the participants of the interactive container are the current user and the virtual object.
20. An apparatus for interaction, comprising:an interface presenting module configured to present an interactive interface for a virtual object based on an interaction request associated with a target object, the virtual object corresponding to the target object, and the interactive interface being configured to provide a multimodal interaction where participants are a current user and the target object; anda message presenting module configured to present a second message from the virtual object in the interactive interface based on a first message from the current user, wherein the second message is generated based on reference information associated with the target object.
21. An electronic device, comprising:at least one processing unit; andat least one memory coupled to the at least one processing unit and storing instructions executable by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method of any of claims 1 to 18.
22. A computer-readable storage medium having a computer program stored thereon, the computer program being executable by a processor to perform the method of any of claims 1 to 18.