Message interaction method and apparatus, device, storage medium, and program product

Abstract

A message interaction method and apparatus, a device, a storage medium, and a program product. The method proposed herein comprises: receiving, in an interactive interface with a virtual object, a first message input by a user; presenting a second message generated by the virtual object on the basis of the first message; and providing a first emoji associated with the second message, the first emoji being determined from a preset first emoji library on the basis of the second message.

Description

Methods, apparatus, devices, storage media, and program products for message interaction

[0001] This application claims priority to Chinese Patent Application No. 202411751208.7, filed on November 29, 2024, entitled "Method, Apparatus, Device and Storage Medium for Message Interaction", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to methods, apparatus, devices, computer-readable storage media, and computer program products for message interaction. Background Technology

[0003] In recent years, with the rapid development of computer technology, some virtual objects have emerged that can help users process messages promptly and improve message processing efficiency. For example, virtual objects can autonomously generate responses to received messages, such as supporting the generation of response messages when the user is offline, or processing large volumes of received messages in a timely manner. Typically, virtual objects only support interaction with users through a text modality. Summary of the Invention

[0004] In a first aspect of this disclosure, a method for message interaction is provided. The method includes: receiving a first message input by a user in an interactive interface with a virtual object; presenting a second message generated by the virtual object based on the first message; and providing a first emoji associated with the second message, the first emoji being determined from a preset first emoji library based on the second message.

[0005] In a second aspect of this disclosure, an apparatus for message interaction is provided. The apparatus includes: a receiving module configured to receive a first message input by a user in an interactive interface with a virtual object; a presenting module configured to present a second message generated by the virtual object based on the first message; and a providing module configured to provide a first emoticon associated with the second message, the first emoticon being determined from a preset first emoticon library based on the second message.

[0006] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of this disclosure, a computer program product is provided, the program product including computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0011] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure may be implemented;

[0012] Figures 2A and 2B illustrate example interfaces according to some embodiments of the present disclosure;

[0013] Figure 2C illustrates an example process for determining facial expressions according to some embodiments of the present disclosure;

[0014] Figure 3 illustrates a flowchart of an example process of message interaction according to some embodiments of the present disclosure;

[0015] Figure 4 shows a schematic structural block diagram of an example device for message interaction according to some embodiments of the present disclosure; and

[0016] Figure 5 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure. Detailed Implementation

[0017] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0018] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0019] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0020] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0021] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0022] Traditionally, users can interact with virtual objects through dialogue, receiving responses from the virtual objects. Typically, virtual objects only support text-based interaction. On one hand, this interaction method is relatively simple and fails to provide users with a realistic conversational experience. On the other hand, this also limits the quality of the content generated by the virtual objects.

[0023] Embodiments of this disclosure propose a message interaction scheme. According to this scheme, a first message input by a user can be received in an interactive interface with a virtual object. Further, a second message generated by the virtual object based on the first message can be presented. Additionally, a first emoticon associated with the second message can be provided, the first emoticon being determined from a preset first emoticon library based on the second message.

[0024] In this way, embodiments of this disclosure can support virtual objects to reply to messages by calling emojis from the application's emoji library, thereby improving the interactive effect.

[0025] The following section provides a detailed description of various example implementations of this scheme, with reference to the accompanying drawings.

[0026] Example Environment

[0027] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include an electronic device 110.

[0028] In this example environment 100, electronic device 110 may run an application 120 that supports user interface interaction. Application 120 may be any suitable type of application for user interface interaction, examples of which may include, but are not limited to, instant messaging applications, video applications, social applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0029] In environment 100 of Figure 1, if application 120 is active, electronic device 110 can use application 120 to present interface 150 for supporting interface interaction.

[0030] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0031] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support content presentation in electronic devices 110.

[0032] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0033] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0034] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.

[0035] Example Interaction

[0036] The following description refers to Figures 2A and 2B to illustrate some example interaction processes according to embodiments of the present disclosure. Figures 2A and 2B show example interactive interfaces 200A to 200B according to some embodiments of the present disclosure, which may be provided, for example, by the electronic device 110 shown in Figure 1.

[0037] As shown in Figure 2A, the electronic device 110 can present an interactive interface 200A between the user and the virtual object 205. In some scenarios, the interactive interface may include a conversational interface associated with the virtual object 205. Such a conversational interface may be associated with a one-on-one chat session between the user and the virtual object 205, or with a group chat session associated with the virtual object 205.

[0038] In some other scenarios, the interactive interface may have other suitable forms. For example, the interactive interface may correspond to the interactive space of the virtual object 205, which may support multiple modal interactions between the user and the virtual object 205.

[0039] In some embodiments, the virtual object 205 may be associated with a target user. As an example, the virtual object 205 may be created based on the target user's configuration actions. With the target user's authorization, the virtual object 205 may be created, for example, based on the target user's reference information. In some embodiments, the virtual object may be generated based on visual data and descriptive text input by the user. The virtual object may include a visual representation of the virtual object and the capabilities possessed by the virtual object (e.g., conversational capabilities, data processing capabilities, etc.). In some scenarios, such a virtual object may also be referred to as a digital object or a virtual entity.

[0040] It should be understood that, on the one hand, a virtual object can have a virtual avatar for interaction. On the other hand, a virtual object can utilize an appropriate model to drive its interactive behavior, such a model can include any suitable machine learning model, for example, a generative model. In this disclosure, the various interactive processes and / or generative operations performed by the virtual object can be actually performed using an appropriate model corresponding to the virtual object.

[0041] The following description uses a session interface as an example of the interaction interface to illustrate the example interaction process of this disclosure. As shown in FIG2A, the electronic device 110 may provide an input control 225 in the interaction interface 200A. Further, the electronic device 110 may receive a first message 210 input by the user via the input control 225.

[0042] As an example, the first message 210 may include messages of any modality, including but not limited to: text messages, voice messages, image messages, video messages, etc. In some embodiments, as shown in FIG2A, the electronic device 110 may provide a second message 215 generated by the virtual object 205 based on the first message 210 in the interactive interface 200A. It should be understood that the virtual object 205 may utilize an associated model to process the first message 210 to generate the second message 215.

[0043] In some embodiments, the virtual object 205 may be associated with a generative model, and the second message 215 may include text content, speech content, or other suitable content generated by the generative model based on the first message 210 and / or contextual information associated with the first message 210.

[0044] Furthermore, the electronic device 110 may provide a first emoticon 220 in the interactive interface 200A as at least part of the response to the first message 210. In some embodiments, the first emoticon 220 may be determined from a preset first emoticon library based on the first message 210.

[0045] In some embodiments, the interactive interface 200A may be associated with a target application, such as a video application or an instant messaging application. The target application may be associated with an application emoticon library. As an example, the application emoticon library may be a public emoticon resource provided by the target application, allowing users within the target application to access and use emoticons from the application emoticon library.

[0046] Using Figure 2A as an example, the second message 215 generated by the virtual object 205 can, for example, be related to "cat". Accordingly, the electronic device 110 can provide a first emoticon associated with "cat" from the application's emoticon library as a response to the first message 210, thereby enriching the content provided by the virtual object 205. In this way, embodiments of the present disclosure can support virtual objects in using existing emoticon resources in the target application to reply to user-inputted messages, thereby improving the message interaction experience.

[0047] In some embodiments, the first emoticon 220 may be determined based on a target user associated with the virtual object 205. As discussed above, the virtual object 205 may be created, for example, based on the target user's configuration actions, or the virtual object 205 may be created based on the target user's reference information.

[0048] Accordingly, the first emoticon 220 can be related to the target user's associated information. As an example, the target user can configure the range of emoticons allowed for the virtual object when replying to messages. For instance, the target user can configure the virtual object to allow the use of emoticons saved by the target user in the target application to reply to messages. For example, the first emoticon 220 could be a "cat"-related emoticon saved by the target user in the target application. As another example, the target user can manage the emoticon library allowed for the virtual object. For instance, the target user can add received emoticons or images to the emoticon library allowed for the virtual object while using the target application.

[0049] In some embodiments, the first emoticon 220 may correspond to emoticon search results for the target user in the target application. For example, the first emoticon 220 may correspond to relevant emoticon search results displayed when the target user enters "cat" in the interactive interface. In this way, the emoticons provided by the virtual object during interaction can be more closely matched to the target user, thereby providing the user with a more realistic interactive experience.

[0050] In some embodiments, the electronic device 110 further provides the first emoticon 220 only after determining that the generated second message 215 matches the first interactive scenario. In some embodiments, an appropriate scene detection model may be used to determine whether the second message 215 matches the preset first interactive scenario. This disclosure is not intended to limit the specific implementation of the scene detection model.

[0051] In some embodiments, the first interaction scenario may be determined based on the configuration operations of the target user. For example, the target user may configure the virtual object to use emoticons to reply to the user when a first type of topic is involved. Exemplarily, electronic device 110 and / or server 130 may determine whether the second message 215 matches the first type of topic to determine whether an emoticon for replying to the user can be further retrieved from the first emoticon library. For example, the first type of topic configured by the user may include "animals". Accordingly, upon determining that the second message 215 is about "cats", electronic device 110 may further retrieve a first emoticon 220 corresponding to "cats" from the first emoticon library and present it to the user accordingly in the interactive interface 200A. In other embodiments, the target user may also configure the virtual object to prohibit the use of emoticons to reply to the user when a first type of topic is involved.

[0052] In some embodiments, the virtual object 205 may be associated with a second emoticon library. The second emoticon library may include one or more emoticons generated based on the virtual object. As described above, the virtual object 205 may have associated image data, and the server 130 may pre-construct a set of emoticons based on the image data of the virtual object 205 as the second emoticon library.

[0053] In some embodiments, as shown in FIG2B, the electronic device 110 may receive a third message 230 input by the user and may display a fourth message 235 generated by the virtual object 205 based on the third message 230. Unlike the example shown in FIG2A, the electronic device 110 may present a second expression 240 determined from a second expression library.

[0054] As shown in Figure 2B, the electronic device 110 can display a second emoticon 240 generated based on the image data of the virtual object 205. In some embodiments, when the virtual object is associated with both a first emoticon library and a second emoticon library, the electronic device 110 and / or the server 130 can determine the output emoticon based on the degree of matching between the second message and the first and second emoticon libraries.

[0055] Alternatively, the electronic device 110 may, for example, prioritize sending emojis from a first emoji library or prioritize sending emojis from a second emoji library. As an example, the electronic device 110 may determine whether to prioritize using emojis from the first or second emoji library based on the target user's configured actions.

[0056] In other embodiments, if it is determined that the generated second message 235 matches a second interaction scenario, the electronic device 110 may, for example, provide a second emoticon determined from a second emoticon library. In some embodiments, the second interaction scenario may be determined based on the target user's configuration actions or associated information.

[0057] In this way, embodiments of the present disclosure can support the mixed use of virtual objects with emoticons created based on virtual objects and emoticons from the application emoticon library, thereby further enriching the types of emoticons allowed to be used in the interaction and improving the message interaction experience.

[0058] The specific process of determining the first emoticon 220 or the second emoticon 240 mentioned above will be further described below with reference to Figure 2C. As shown in Figure 2C, server 130 can determine multiple emoticons associated with the target user and / or virtual objects from application emoticon library 250 based on the target user's configuration operation 252. Furthermore, server 130 can further construct a first emoticon library 254 using multiple emoticons.

[0059] In some embodiments, configuration operation 252 may include, for example, an authorization operation by a target user to instruct the virtual object 205 to use expressions from the application emoji library 250. In some embodiments, configuration operation 252 may, for example, indicate the category of the emoji to be added to the first emoji library 254. For example, the target user may instruct the virtual object to use emojis of the "animal" category. Accordingly, the electronic device 110 may determine multiple emojis from the application emoji library 250 that match the "animal" category to add to the first emoji library 254.

[0060] In some embodiments, one or more emoticons added to the application emoticon library 250 may be determined based on description information of the target user and / or virtual objects. For example, with the authorization of the target user, the server 130 may filter multiple emoticons associated with "food" based on the channel tag "food" corresponding to the target user, and add them to the first emoticon library 254.

[0061] As another example, server 130 can determine one or more emoticons matching the description information (e.g., configuration information) of virtual object 205 from application emoticon library 250 to add to first emoticon library 254. For example, server 130 can obtain the description text and / or system prompts of virtual object 205 and determine that virtual object 205 may correspond to, for example, a lively interactive style. Further, server 130 can determine one or more emoticons matching "lively style" from application emoticon library 250 to add to first emoticon library 254.

[0062] Furthermore, as shown in Figure 2C, in some scenarios, the expression generation tool 260 can generate one or more expressions associated with virtual objects and can construct a second expression library 262 as mentioned above. As an example, the expression generation tool 260 can utilize, for instance, an image generation model to generate expressions associated with different themes, such expressions may have visual elements associated with the virtual object 205.

[0063] Furthermore, the emoji library 256 that the virtual object 205 can use may include the union of a first emoji library 254 and a second emoji library 262. In some embodiments, the emoji library 256 may be provided as knowledge information for a generative model 258 associated with the virtual object 205. Thus, the model 258 can recall emojis suitable for responding to user input from the emoji library 256 based on contextual information.

[0064] Specifically, model 258 may generate a corresponding second message 215 based on the first message 210 input by the user and the associated context message. Further, model 258 may determine at least one keyword based on the second message 215.

[0065] As an example, model 258 can determine the text content corresponding to the second message 215 and identify a set of candidate keywords from the text content. The semantic and / or syntactic information of this set of candidate keywords satisfies preset conditions. It is understood that when the second message includes audio content or other types of content besides text content, the other types of content can be converted into text content, and then a set of candidate keywords can be determined based on the converted text content.

[0066] For example, key semantic recognition can be performed on the text content corresponding to the second message, including identifying key phrases in the text content and obtaining a set of candidate keywords through random filtering and / or deduplication. As an example, model 258 can, for instance, determine one or more keywords with the grammatical attribute of verb from the text content corresponding to the second message 215. As an example, if the second message 215 includes the text "the kitten drinks water," then model 258 can, for instance, determine the verb "drink water" as a keyword.

[0067] In some embodiments, model 258 can determine keywords whose semantic information satisfies the conditions from the text content corresponding to the second message 215. For example, if the second message 215 includes the text "The kitten is happily drinking water," then model 258 can, for example, determine "happy" as a keyword, as the semantic information satisfies the conditions. Exemplarily, server 130 can utilize a language model to process the second message 215 to determine a set of candidate keywords. As an example, server 130 can provide the language model with the text content of the second message 215 and descriptive information related to preset conditions. Further, server 130 can obtain a set of candidate keywords that satisfy preset conditions, output by the language model based on the text content.

[0068] In some embodiments, where a set of candidate keywords includes multiple keywords, server 130 may, for example, determine at least one keyword from the set of candidate keywords. For example, server 130 may randomly select a predetermined number of keywords as at least one keyword to be used. Model 258 may perform a search based on the determined at least one keyword to determine an emoticon matching the at least one keyword from emoticon library 256.

[0069] In some embodiments, before performing the search process, the server 130 may, for example, determine an emoji interaction scenario 264, and may determine, based on the emoji interaction scenario 264, whether only the first emoji library 254 can be used, only the second emoji library 262 can be used, or both can be used.

[0070] As an example, if it is determined that only the first emoji library 254 can be used, the server 130 can search the first emoji library 254 based on at least one keyword, and thus obtain the first emoji 220 as shown in FIG2A. As another example, if it is determined that only the second emoji library 262 can be used, the server 130 can search the second emoji library 262 based on at least one keyword, and thus obtain the second emoji 240 as shown in FIG2B.

[0071] As yet another example, if it is determined that only the first emoji library 254 and the second emoji library 262 can be used simultaneously, the server 130 can search the emoji library 256 based on at least one keyword to determine the emoji to be provided.

[0072] In some embodiments, when a set of candidate expressions is obtained based on the first expression library 254, the second expression library 262, and / or the expression library 256, the server 130 can also determine the expression to be output from the set of candidate expressions based on the association between the set of candidate expressions and virtual objects and / or target users. For example, the server 130 can determine the expression that best matches the target user and / or virtual object from the multiple candidate expressions obtained from the search, as the first expression 220 or the second expression 240. In this way, embodiments of this disclosure can output expressions that are more closely matched to the interaction scenario in a more flexible manner, thereby improving the effect of content interaction.

[0073] Example process

[0074] Figure 3 shows a flowchart of an example information interaction process 300 according to some embodiments of the present disclosure. Process 300 can be implemented at electronic device 110. Process 300 is described below with reference to Figure 1.

[0075] As shown in Figure 3, in box 310, electronic device 110 receives the first message input by the user in the interaction interface with the virtual object.

[0076] In box 320, electronic device 110 presents a second message generated by a virtual object based on the first message.

[0077] In frame 330, the electronic device 110 provides a first emoticon associated with the second message, the first emoticon being determined from a preset first emoticon library based on the second message.

[0078] In some embodiments, the first emoticon is determined based on an application emoticon library of the target application, which is associated with the interactive interface; and / or the first emoticon is determined based on a target user associated with a virtual object.

[0079] In some embodiments, the first emoticon is determined based on the following process: determining at least one keyword based on a second message; and determining a first emoticon from a first emoticon library that matches the at least one keyword.

[0080] In some embodiments, determining at least one keyword based on the second message includes: determining a set of candidate keywords from the text content corresponding to the second message, wherein the semantic and / or grammatical information of the set of candidate keywords satisfies preset conditions; and determining at least one keyword from the set of candidate keywords.

[0081] In some embodiments, determining a set of candidate keywords from the text content corresponding to the second message includes: providing the target model with the text content and descriptive information associated with preset conditions; and obtaining a set of keywords determined by the target model.

[0082] In some embodiments, determining a first emoticon that matches at least one keyword from a first emoticon library includes: determining a set of candidate emoticons that match at least one keyword from the first emoticon library; and determining the first emoticon from the set of candidate emoticons based on the association between the set of candidate emoticons and a virtual object and / or a target user, wherein the target user is associated with the virtual object.

[0083] In some embodiments, the first emoji library is constructed based on the following process: in response to receiving a configuration operation from a target user associated with a virtual object, determining multiple emojis associated with the target user and / or the virtual object from an application emoji library; and constructing the first emoji library based on the multiple emojis.

[0084] In some embodiments, the first emoji library is provided as knowledge information of a generative model associated with virtual objects.

[0085] In some embodiments, providing a first emoticon associated with a second message includes: providing a first emoticon associated with the second message in response to a generated second message matching a first interaction scenario.

[0086] In some embodiments, the virtual object is also associated with a second emoji library, which includes multiple emojis generated based on the virtual object. The method further includes: in response to a generated second message matching a second interaction scenario, providing a second emoji determined from the second emoji library.

[0087] Example devices and equipment

[0088] Embodiments of this disclosure also provide corresponding apparatus for implementing the methods or processes described above. Figure 4 shows a schematic structural block diagram of an example apparatus 400 for interface interaction according to certain embodiments of this disclosure. Apparatus 400 may be implemented as or included in electronic device 110. The various modules / components in apparatus 400 may be implemented by hardware, software, firmware, or any combination thereof.

[0089] As shown in Figure 4, the device 400 includes: a receiving module 410 configured to receive a first message input by a user in an interactive interface with a virtual object; a presenting module 420 configured to present a second message generated by the virtual object based on the first message; and a providing module 430 configured to provide a first emoticon associated with the second message, the first emoticon being determined from a preset first emoticon library based on the second message.

[0090] In some embodiments, the first emoticon is determined based on an application emoticon library of the target application, which is associated with the interactive interface; and / or the first emoticon is determined based on a target user associated with a virtual object.

[0091] In some embodiments, the first emoticon is determined based on the following process: determining at least one keyword based on a second message; and determining a first emoticon from a first emoticon library that matches the at least one keyword.

[0092] In some embodiments, determining at least one keyword based on the second message includes: determining a set of candidate keywords from the text content corresponding to the second message, wherein the semantic and / or grammatical information of the set of candidate keywords satisfies preset conditions; and determining at least one keyword from the set of candidate keywords.

[0093] In some embodiments, determining a set of candidate keywords from the text content corresponding to the second message includes: providing the target model with the text content and descriptive information associated with preset conditions; and obtaining a set of keywords determined by the target model.

[0094] In some embodiments, determining a first emoticon that matches at least one keyword from a first emoticon library includes: determining a set of candidate emoticons that match at least one keyword from the first emoticon library; and determining the first emoticon from the set of candidate emoticons based on the association between the set of candidate emoticons and a virtual object and / or a target user, wherein the target user is associated with the virtual object.

[0095] In some embodiments, the first emoji library is constructed based on the following process: in response to receiving a configuration operation from a target user associated with a virtual object, determining multiple emojis associated with the target user and / or the virtual object from an application emoji library; and constructing the first emoji library based on the multiple emojis.

[0096] In some embodiments, the first emoji library is provided as knowledge information of a generative model associated with virtual objects.

[0097] In some embodiments, providing a first emoticon associated with a second message includes: providing a first emoticon associated with the second message in response to a generated second message matching a first interaction scenario.

[0098] In some embodiments, the virtual object is also associated with a second emoji library, which includes multiple emojis generated based on the virtual object. The method further includes: in response to a generated second message matching a second interaction scenario, providing a second emoji determined from the second emoji library.

[0099] The modules included in device 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the modules in device 400 can be implemented at least partially by one or more hardware logic components. By way of example, and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0100] As shown in Figure 5, the electronic device 500 is in the form of a general-purpose electronic device. Components of the electronic device 500 may include, but are not limited to, one or more processors 510, memory 520, storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processor 510 may be a physical or virtual processor and is capable of performing various processes according to the program stored in memory 520. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0101] Electronic device 500 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 500, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 530 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 500.

[0102] Electronic device 500 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 520 may include computer program product 525 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0103] Communication unit 540 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 500 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0104] Input device 550 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 560 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 500 can also communicate with one or more external devices (not shown) via communication unit 540 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 500, or with any device that enables electronic device 500 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0105] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0106] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0107] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0108] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0109] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0110] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for message interaction, comprising: In the interactive interface with virtual objects, the system receives the first message input by the user. Present a second message generated by the virtual object based on the first message; as well as Provide a first emoticon associated with the second message, the first emoticon being determined from a preset first emoticon library based on the second message.

2. The method according to claim 1, wherein: The first emoticon is determined based on the application emoticon library of the target application, which is associated with the interactive interface; and / or The first emoticon is determined based on the target user associated with the virtual object.

3. The method of claim 1, wherein the first expression is determined based on the following process: Based on the second message, at least one keyword is determined; and The first emoticon that matches the at least one keyword is determined from the first emoticon library.

4. The method of claim 3, wherein determining at least one keyword based on the second message includes: A set of candidate keywords is determined from the text content corresponding to the second message, wherein the semantic and / or syntactic information of the set of candidate keywords meets preset conditions; as well as From the set of candidate keywords, determine at least one keyword.

5. The method of claim 4, wherein determining a set of candidate keywords from the text content corresponding to the second message includes: Provide the target model with the text content and descriptive information associated with the preset conditions; as well as Obtain the set of keywords determined by the target model.

6. The method of claim 3, wherein determining the first emoticon matching the at least one keyword from the first emoticon library comprises: From the first emoji library, determine a set of candidate emojis that match the at least one keyword; as well as Based on the association between the set of candidate emoticons and the virtual object and / or the target user, the first emoticon is determined from the set of candidate emoticons, wherein the target user is associated with the virtual object.

7. The method according to any one of claims 1 to 6, wherein the first emoji library is constructed based on the following process: In response to receiving a configuration operation from a target user associated with the virtual object, determine multiple emoticons from an application emoticon library that are associated with the target user and / or the virtual object; and Based on the multiple expressions, the first expression library is constructed.

8. The method according to any one of claims 1 to 7, wherein the first emoji library is provided as knowledge information of a generative model associated with the virtual object.

9. The method according to any one of claims 1 to 8, wherein providing the first emoticon associated with the second message comprises: In response to the generated second message matching the first interaction scenario, the first emoticon associated with the second message is provided.

10. The method of claim 9, wherein the virtual object is further associated with a second emoji library, the second emoji library comprising a plurality of emojis generated based on the virtual object, the method further comprising: In response to the generated second message matching a second interaction scenario, the second emoticon determined from the second emoticon library is provided.

11. An apparatus for message interaction, comprising: The receiving module is configured to receive the first message input by the user in the interactive interface with the virtual object; The presentation module is configured to present a second message generated by the virtual object based on the first message; as well as A providing module is configured to provide a first emoticon associated with the second message, the first emoticon being determined from a preset first emoticon library based on the second message.

12. An electronic device, comprising: At least one processor; as well as At least one memory, coupled to the at least one processor and storing instructions for execution by the at least one processor, which, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1 to 10.

13. A computer-readable storage medium having stored thereon computer-executable instructions that, when executed by a processor, implement the method according to any one of claims 1 to 10.

14. A computer program product comprising a computer program, wherein the computer program, when executed by a processor, implements the method according to any one of claims 1 to 10.

Images