Interaction processing method and apparatus, electronic device, storage medium and program product
Personalized emoticon images are generated by using user-authorized basic images and machine learning models, which solves the problem of inflexible emoticon image generation in existing technologies and achieves a more efficient and vivid interactive experience.
Patent Information
- Application Number
- PCT/CN2024/084864
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-03-29
- Publication Date
- 2025-10-02
AI Technical Summary
In the prior art, the generation method of emoticon images is not flexible enough to meet the personalized needs of users, and the search and use efficiency is low.
Through user-authorized basic images, combined with machine learning models, sentiment analysis and adjustment of interactive information are performed to generate personalized expression images, including adjustments to facial expressions, body movements, backgrounds, and beautification materials, to meet users' personalized needs and improve generation efficiency.
It realizes the flexible generation of expression images, improves the vividness and fun of interaction, meets the personalized needs of users, and improves the generation and use efficiency.
Smart Images

Figure CN2024084864_02102025_PF_FP_ABST
Abstract
Description
Interactive processing method, device, electronic device, storage medium and program product Technical Field
[0001] The present disclosure relates to the field of computer technology, and in particular to an interactive processing method, device, electronic device, storage medium, and program product. Background Art
[0002] Currently, users and interactive objects can communicate or interact in real time through the Internet, and can send various forms of content such as voice, text, images or videos to the interactive objects.
[0003] Usually, communication applications will pre-install some emoticons (also called emoticon packages). Users can select emoticons and send them to each other based on the context at the time and the meaning they want to express, which is more vivid and vivid.
[0004] Summary of the Invention
[0005] This summary is provided to briefly introduce concepts that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.
[0006] According to some embodiments of the present disclosure, an interaction processing method is provided, including: displaying an interaction interface between a user and an interactive object; in response to a user inputting interaction information in an input area of the interaction interface, generating at least one expression image based on the interaction information and a basic image, wherein the basic image is an image authorized for application by the user, and the basic image is an image including a face; displaying at least one expression image; and in response to a user confirming a first target expression image in the at least one expression image, sending the first target expression image to the interactive object.
[0007] According to other embodiments of the present disclosure, an interaction processing device is provided, including: a first display module, configured to display an interaction interface between a user and an interaction object; a generation module, configured to generate at least one expression image in response to a user inputting interaction information in an input area of the interaction interface, based on the interaction information and a basic image, wherein the basic image is an image authorized for application by the user, and the basic image is an image containing a face; a second display module, configured to display at least one expression image; and a sending module, configured to send a target expression image to the interaction object in response to a user confirming an operation on the target expression image in the at least one expression image.
[0008] According to some further embodiments of the present disclosure, an electronic device is provided, comprising: a processor; and a memory coupled to the processor, for storing instructions, which, when executed by the processor, causes the processor to execute the interactive processing method of any embodiment of the present disclosure.
[0009] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the interactive processing method of any embodiment of the present disclosure is executed.
[0010] According to some further embodiments of the present disclosure, a computer program product is provided, comprising: instructions, which implement the interactive processing method of any embodiment of the present disclosure when the instructions are executed by a processor.
[0011] According to some further embodiments of the present disclosure, a computer program is provided, comprising: instructions, which implement the interactive processing method of any embodiment of the present disclosure when the instructions are executed by a processor.
[0012] Other features, aspects and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure. Each of the drawings, together with the following detailed description, is included in this specification and forms a part of the specification to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and do not constitute a limitation of the present disclosure. In the drawings:
[0014] FIG1 is a schematic diagram showing a flow chart of an interaction processing method according to some embodiments of the present disclosure;
[0015] FIG2 is a schematic diagram showing an interactive interface according to some embodiments of the present disclosure;
[0016] FIG3 is a schematic flow chart showing an interaction processing method according to some other embodiments of the present disclosure;
[0017] FIG4 is a schematic diagram showing an interactive interface of some other embodiments of the present disclosure;
[0018] FIG5 is a schematic structural diagram of an interaction processing device according to some embodiments of the present disclosure;
[0019] FIG6 is a schematic structural diagram of an electronic device according to some embodiments of the present disclosure;
[0020] FIG7 is a schematic diagram showing the structure of a computer system according to some embodiments of the present disclosure.
[0021] It should be understood that, for ease of description, the dimensions of the various parts shown in the drawings are not necessarily drawn to scale. The same or similar reference numerals are used throughout the drawings to indicate the same or similar parts. Therefore, once an item is defined in one drawing, it may not be discussed further in subsequent drawings. DETAILED DESCRIPTION
[0022] The following will be combined with the accompanying drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. However, it is obvious that the embodiments described are only some embodiments of the present disclosure, rather than all embodiments. The following description of the embodiments is actually only illustrative and is in no way intended to limit the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein.
[0023] It should be understood that the various steps described in the method embodiments of the present disclosure can be performed in different orders and / or performed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values of the parts and steps set forth in these embodiments should be interpreted as being merely exemplary and do not limit the scope of the present disclosure.
[0024] As used in this disclosure, the term "include" and its variations are intended to be open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to." Furthermore, the term "comprise" and its variations are intended to be open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to." Therefore, "include" and "include" are synonymous. The term "based on" means "based, at least in part, on."
[0025] Reference throughout this specification to "one embodiment," "some embodiments," or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. For example, the term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Furthermore, the appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment, but may.
[0026] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules, or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules, or units. Unless otherwise specified, concepts such as "first" and "second" are not intended to imply that the objects described in such a manner must be in a given order in time, space, ranking, or any other manner.
[0027] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".
[0028] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0029] The following detailed description of the embodiments of the present disclosure is provided in conjunction with the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. In addition, in one or more embodiments, specific features, structures, or characteristics may be combined in any suitable manner that will be apparent to those skilled in the art from this disclosure.
[0030] The scenario where a user communicates or interacts with an interactive object through a network includes, for example, an instant messaging scenario. The interactive object can be a real object or a virtual object.
[0031] Currently, when users communicate or interact with an interactive object, they can send emoticons to it. Since these emoticons are generally provided by applications, the number and types of emoticons are limited, and users cannot edit them, which fails to meet their personalized needs. Furthermore, users often need to search and find the emoticon that corresponds to the meaning they want to express, which is inefficient.
[0032] In view of the problem that the current generation method of expression images is not flexible enough and has low efficiency, the present disclosure proposes an interactive processing method, which is described below with reference to Figures 1 to 4.
[0033] Figure 1 is a flow chart of some embodiments of the interactive processing method disclosed herein. As shown in Figure 1 , the method of this embodiment includes steps S102 to S108.
[0034] In step S102, an interaction interface between the user and the interaction object is displayed.
[0035] For example, the interactive object is a real object or a virtual object. For example, the interactive interface is an instant messaging interface (e.g., a chat interface), and the interactive interface may include an interactive information display area and an input area. The interactive information display area may be used to display interactive information sent between the user and the interactive object. The input area may be used to input interactive information and display interactive information to be sent.
[0036] In step S104 , in response to the user inputting interaction information in the input area of the interaction interface, at least one expression image is generated according to the interaction information and the basic image.
[0037] Interactive information can be in the form of text or voice. An emoticon image can be a static image or a dynamic image. An emoticon image, also known as an emotional image or emoticon package, can be used to express specific emotions or feelings. An emoticon image can include the face of a real person or a virtual character (such as an animated character), and the face can have a specific expression. Of course, an emoticon image can also include body parts, backgrounds, and other features, and can also include text and embellishment materials, without being limited to the examples listed above.
[0038] For example, a base image is an image that a user authorizes for use, and a base image includes a face. Users can authorize the use of permitted images in various ways, without limitation. Base images that include faces facilitate the generation of emoticon images. For example, the base image can be a user's profile picture, an image uploaded by the user, or other similar images, without limitation to these examples.
[0039] For example, a machine learning model is used to analyze and understand the interaction information, and the base image is adjusted based on the interaction information to generate at least one expression image. For example, the facial expression and / or orientation in the base image can be adjusted. For example, the background in the base image can be adjusted. For example, if the base image includes a body part, the body movement and / or orientation in the base image can be adjusted. For example, aesthetic enhancement materials can be added to the base image. Adjustments to the base image can make the base image more consistent with the intended meaning of the interaction information.
[0040] In step S106 , at least one expression image is displayed.
[0041] For example, at least one emoticon image is displayed in the emoticon recommendation area. The emoticon recommendation area may not be displayed when no emoticon image is generated, and is used to display at least one emoticon image after at least one emoticon image is generated. For example, the emoticon recommendation area may be displayed in the form of a pop-up window, a floating layer, a bubble, etc., and is not limited to the examples given. The emoticon recommendation area may be displayed in a position adjacent to the input area. In the case of multiple emoticon images, the emoticon recommendation area may display some of the emoticon images, and display the remaining emoticon images in response to the user's switching operation (for example, a sliding switching operation). After the user inputs the interactive information, at least one emoticon image is displayed in real time.
[0042] In step S108 , in response to the user's confirmation operation on the first target facial expression image in the at least one facial expression image, the first target facial expression image is sent to the interactive object.
[0043] The user can select any emoticon image as the first target emoticon image. For example, the user selects the first target emoticon image by clicking and sends the first target emoticon image to the interactive object. For example, in response to the user's selection of the first target emoticon, the first target emoticon image is displayed in the input area, and in response to the user's send operation, the first target emoticon image is sent to the interactive object.
[0044] In the method of the above embodiment, the user inputs interactive information in the input area of the interactive interface, and at least one emoticon image can be directly generated and displayed based on the interactive information and the basic image. The user can select and send the first target emoticon image from the at least one emoticon image, and use the first target emoticon image to convey the content that the user wants to express to the interactive object. Since the basic image is the image that the user authorizes to use, that is, the image that the user chooses to use, generating an emoticon image based on the interactive information and the basic image can more accurately express what the user wants to express, generate personalized emoticon images for the user, improve the flexibility of emoticon image generation, improve the vividness and fun of interaction, and better meet the needs of users. In addition, the emoticon image can be automatically generated by the user inputting interactive information, without the need for the user to search and find, thereby improving the efficiency of generating and using emoticon images.
[0045] In some embodiments, the base image is a user's avatar, or the base image is an image selected by the user from a plurality of authorized candidate images that have been uploaded.
[0046] The user's avatar can be displayed in the interactive interface, for example, the user's avatar is displayed next to each interactive message of the user. After the user authorizes the use of the avatar, at least one emoticon image can be directly generated using the user's avatar. The user can pre-configure the image used to generate the emoticon image as the base image. For example, the user can upload multiple candidate images and specify the image to be used as the avatar, the image to be used to generate the emoticon image, and the image for other purposes. Alternatively, when the user interacts with the interactive object, an image selected from the multiple authorized candidate images that have been uploaded can be used as the base image. By using the user's avatar or the image uploaded by the user, personalized emoticon images can be generated for each user to meet the user's personalized needs while improving the efficiency of emoticon image generation.
[0047] The following describes how to generate at least one expression image in conjunction with some embodiments.
[0048] In some embodiments, sentiment analysis is performed on the interaction information to determine the sentiment information corresponding to the interaction information; and at least one expression image is generated based on the sentiment information and the basic image.
[0049] For example, the interaction information and the basic image are input into a generative model, and at least one expression image is output. For example, a machine learning model is used to perform sentiment analysis on the interaction information, determine the sentiment information corresponding to the interaction information, and generate at least one expression image based on the sentiment information and the basic image. For example, sentiment information includes sentiment type, and the sentiment type can be various types such as happy, angry, sad, etc. For example, a machine learning model is used to perform sentiment recognition on the interaction information, determine the sentiment type, and then generate at least one expression image based on the sentiment type and the basic image. The emotion reflected by the at least one expression image is the same as the emotion expressed by the interaction information. For example, if the interaction information is "The weather is so nice today, let's go out and play", the sentiment type can be determined to be happy, and the facial expression in the generated expression image indicates happiness.
[0050] When the interactive information is text, sentiment analysis can be performed directly. When the interactive information is voice, the voice can be converted into text for sentiment analysis, or sentiment analysis can be performed directly on the voice.
[0051] Emotional analysis is performed on the interactive information, and then at least one expression image is generated in combination with the basic image, so that the generated expression image is more consistent with the emotion that the user wants to express, which improves the flexibility of expression image generation, improves the vividness and fun of the interaction, and better meets the needs of users.
[0052] In some cases, sentiment analysis alone on interactive messages is insufficient to accurately determine sentiment. It's necessary to incorporate context to improve the accuracy of sentiment analysis. For example, the same sentence can convey different sentiments when combined with different contexts.
[0053] In some embodiments, sentiment analysis is performed based on the interaction information and the interaction records before the interaction information to determine the sentiment information corresponding to the interaction information; and at least one expression image is generated based on the sentiment information and the basic image.
[0054] A preset number of interaction records can be obtained, and a machine learning model can be used to determine the emotional information corresponding to the interaction information based on the interaction information and the interaction records, and then at least one expression image can be generated based on the emotional information and the basic image.
[0055] At least one expression image is generated based on the interaction information, interaction record and basic image, so that the expression image can more accurately express what the user wants to express, meet the user's personalized needs, and at the same time improve the generation efficiency of the expression image.
[0056] In some embodiments, a face in a base image is identified; and at least one of an expression and an angle of the face is adjusted based on the emotional information to generate an image of the face in at least one expression image.
[0057] For example, facial recognition technology can be used to identify faces in a base image. Some emotional information can be expressed not only through facial expressions but also by rotating the face at different angles. For example, a laughing expression combined with a raised face at a certain angle can convey a sense of deep joy. For example, a face facing away from the screen can convey a feeling of depression and unwillingness to speak. Machine learning models can be used to identify emotional information and, based on this emotional information, adjust at least one of the facial expression and angle in the base image to generate at least one facial image in an expression image.
[0058] If the original facial expression in the base image can convey the emotional information corresponding to the interaction information, no adjustment is required. By adjusting the facial expression and / or angle in the base image based on the emotional information, the expression image can more accurately convey the user's intended meaning, meeting their personalized needs. This can also improve the efficiency of expression image generation.
[0059] In addition to the facial expressions and angles that can be adjusted to express different emotions, if the basic image also includes body parts such as the body and limbs, the limbs can be adjusted to express different emotions.
[0060] In some embodiments, a limb in a base image is identified; and based on the emotional information, at least one of the movement and angle of the limb is adjusted to generate an image of the limb in at least one expression image.
[0061] The recognition and adjustment of faces and body parts can be performed simultaneously. The facial expression and angle should be coordinated with the body movements and angles, expressing the same emotion and appearing coordinated. For example, if the face is facing away from the screen, the body angle should also be adjusted to face away from the screen. For example, if the facial expression is helpless, the body movement can be adjusted to open arms. Machine learning models can be used to identify emotional information and, based on this emotional information, adjust at least one of the body movements and angles in the base image to generate at least one image of the body parts in the expression image.
[0062] If the base image doesn't recognize body parts, you can adjust only the facial expression and / or angle. If body parts are recognized in the base image, you can adjust the body movements and / or angle. If the base image doesn't recognize body parts, you can also add body movements to convey emotion. For example, to create a smile with a hand covering the mouth, you can add hand movements.
[0063] If the original facial expression in the base image can convey the emotional information corresponding to the interaction information, no adjustments are required, and only the body movements and / or angles can be adjusted. If the original body movements in the base image can convey the emotional information corresponding to the interaction information, no adjustments are required. By adjusting the body movements and / or angles in the base image based on the emotional information, the expression image can more accurately express the user's intended meaning, meeting their personalized needs. This can also improve the efficiency of expression image generation.
[0064] In addition to adjusting the face and limbs in the basic image, you can also adjust elements such as the background to improve the display effect of the expression image.
[0065] In some embodiments, a background image in at least one expression image is generated based on the emotion information; and / or beautification material added to at least one expression image is generated based on the emotion information.
[0066] For example, beautification materials include stickers, special effects materials, and the like, but are not limited to these examples. Background images and / or beautification materials can enhance the emotional message being expressed. For example, if a user wants to express a fondness, they can replace the background with a heart pattern or add a heart sticker to their face.
[0067] When adjusting the face and limbs, the images of the face and limbs can be extracted, and after generating a background image, the generated background image can be synthesized with the images of the face and limbs to produce an expression image. Beautification materials can be added to corresponding locations on the face, limbs, or background. For example, a machine learning model can be used to identify the emotional information corresponding to the interaction information, and based on this emotional information, a background image can be generated for at least one expression image, and / or beautification materials can be generated for at least one expression image based on this emotional information.
[0068] Generating background images and / or beautifying materials based on emotional information can make the generated expression images more vivid and vivid, strengthen the emotional information to be expressed, meet the user's personalized needs, and also improve the efficiency of expression image generation.
[0069] In the above embodiment, the background image is generated based on the emotional information, and the background image can also be generated by extracting environmental features based on the interactive information.
[0070] In some embodiments, environmental feature information is determined based on the interaction information; and a background image in at least one expression image is generated based on the environmental feature information.
[0071] For example, environmental features include features representing weather and scene. For example, if the interaction information is "The weather is great today, and I'm in a good mood," the generated background image may be an image of sunny weather. For example, if the interaction information is "Let's go to Disneyland this weekend," the generated background image may be a scene from Disneyland. For example, a machine learning model can be used to determine environmental feature information based on the interaction information, and based on the environmental feature information, a background image for at least one expression image is generated.
[0072] The current interaction information may not include environmental features, and the environmental features can be determined more accurately by combining the context information.
[0073] In some embodiments, environmental feature information is determined based on the interaction information and interaction records before the interaction information; and a background image in at least one expression image is generated based on the environmental feature information.
[0074] A preset number of interaction records can be obtained, and a machine learning model can be used to determine environmental feature information based on the interaction information and the interaction records; and a background image in at least one expression image can be generated based on the environmental feature information.
[0075] The generated background image is synthesized with the adjusted face or human body (face and limbs) image to obtain an expression image.
[0076] In the above embodiment, environmental feature information is determined based on interaction information to generate a background image in at least one expression image. This can make the generated at least one expression image more compatible with the user's interaction content, making the expression image more vivid and vivid, improving the display effect, meeting the user's personalized needs, and at the same time improving the efficiency of expression image generation.
[0077] The background image in at least one expression image may be generated by combining the emotion information and the environmental characteristic information, or may be generated based on the emotion information or the environmental characteristic information.
[0078] In some embodiments, when at least one expression image is a plurality of expression images, at least one of facial expressions, facial angles, body movements, body angles, background images, and beautification materials in the plurality of expression images is different.
[0079] For example, facial expressions all express happy emotions, but the form of the smile can be different, the angle of the face can be different, the body movements can be different... Multiple expression images are generated for users to choose from, which can better meet the user's personalized needs.
[0080] The styles or forms of expression of multiple emoticon images can be different. For example, multiple emoticon images correspond to oil painting style, anime style, etc.
[0081] In some embodiments, at least one emoticon image includes text corresponding to the interaction information, and the interaction information is text or voice.
[0082] The interactive information input by the user can be text or voice. If it is voice, the voice can be converted into corresponding text and added to the emoticon image. In this way, the emoticon image can accurately and vividly express the content that the user wants to express by combining images and text.
[0083] Some application examples of the present disclosure are described below with reference to FIG2 .
[0084] Figure 2 shows the conversation (interaction) interface between users A and B. User A sent the interactive message, "My mood today is just like the weather, overcast." An emoticon image was generated based on user A's interactive message and user A's profile picture. User A's expression in the emoticon image was adjusted based on the interactive message, and a dark cloud pattern was added to the background based on the interactive message. User B sent the interactive message, "Dear, don't be sad. I'm here to chat with you." An emoticon image was generated based on user B's interactive message and user B's profile picture. User B's expression in the emoticon image was adjusted based on the interactive message, and the background was adjusted based on the interactive message, with a heart sticker added. It can be seen that the generation and use of emoticons makes the interaction process between users more vivid and lifelike, enhances the interactive experience, and better meets the personalized needs of users.
[0085] At least one emoticon image may be generated for each interactive message sent by the user, or, if the user sends multiple interactive messages continuously, at least one emoticon image may be generated based on the multiple interactive messages. Alternatively, if the user sends multiple interactive messages continuously, at least one emoticon image may be generated based on the first interactive message.
[0086] In order to further enrich the form and content of expression images, expression images of two people can be generated with the authorization of the user and the interaction object.
[0087] In some embodiments, at least one expression image is generated based on the interaction information, the base image, and the image of the interaction object, wherein the image of the interaction object is an image of an authorized application of the interaction object, and the image of the interaction object is an image including a face.
[0088] For example, the interactive object's image can be the interactive object's avatar, or it can be an image selected by the interactive object from multiple authorized candidate images that have been uploaded. Similar to the base image, the interactive object's image can be obtained and authorized in various ways, which will not be discussed further here. The at least one generated expression image can include an image corresponding to the face in the base image and an image corresponding to the face in the interactive object's image.
[0089] In some embodiments, an image of a first character in a base image and an image of a second character in an image of an interactive object are extracted; based on interaction information, the image of the first character and the image of the second character are adjusted to obtain at least one adjusted image of the first character and at least one adjusted image of the second character; at least one background image is generated based on at least one of the interaction information, the background image in the base image, and the background image in the image of the interactive object; at least one expression image is generated based on at least one adjusted image of the first character, at least one adjusted image of the second character, and at least one background image.
[0090] The first character and the second character may include faces and limbs. The first character and the second character may be real characters or virtual characters (eg, animated characters).
[0091] In some embodiments, adjusting the image of the first person and the image of the second person based on the interaction information includes: performing an emotional analysis on the interaction information, determining emotional information corresponding to the interaction information, and adjusting the image of the first person and the image of the second person based on the emotional information. The expression and / or angle of the first person's face and the expression and / or angle of the second person's face can be adjusted, and the movement and / or angle of the first person's body and the movement and / or angle of the second person's body can also be adjusted. For details, please refer to the embodiment of how to generate an expression image based on a basic image, and will not be repeated here.
[0092] The adjustment of the images of the first person and the second person can be performed synchronously, so that the expression, action, etc. of the first person can be coordinated with the expression, action of the second person to conform to the meaning to be expressed by the interactive information.
[0093] In some embodiments, at least one of emotional information and environmental characteristic information corresponding to the interaction information is determined based on the interaction information, and at least one background image is generated based on the at least one of the emotional information and environmental characteristic information. Alternatively, the background image in the base image and / or the background image in the image of the interactive object may be adjusted based on the emotional information and environmental characteristic information to generate the at least one background image.
[0094] In some embodiments, beautification material to be added to at least one expression image is generated according to the interaction information, and the beautification material is added to the at least one expression image.
[0095] Those skilled in the art will appreciate that the method for generating at least one expression image based on interaction information and a base image in the aforementioned embodiments is also applicable to generating expression images for two people, and will not be further described here. When generating and displaying multiple expression images for a user, some may be generated based solely on the base image, while others may be generated based on the base image and an image of the interaction object.
[0096] After generating and displaying at least one emoticon image, the user can also adjust some or all of the emoticons to better meet personalized needs and more accurately express what the user wants to express.
[0097] Figure 3 is a flow chart of some embodiments of the interactive processing method disclosed herein. As shown in Figure 3 , the method of this embodiment includes: steps S302 to S316.
[0098] In step S302, an interaction interface between the user and the interaction object is displayed.
[0099] In step S304, in response to the user inputting interaction information in the input area of the interaction interface, at least one expression image is generated according to the interaction information and the basic image.
[0100] In step S306, at least one expression image is displayed.
[0101] In step S308 , in response to the user's update operation on the second target expression image in the at least one displayed expression image, the second target expression image is updated according to the interaction information and the basic image.
[0102] There may be one or more second-target emoji images. An update control may be provided for each emoji image, and in response to a user triggering the update control for a second-target emoji image, the second-target emoji image is updated. Alternatively, a single update control may be provided, and in response to a user triggering the update control, all emoji images are updated. The updated second-target emoji image is different from the previous one.
[0103] In step S310 , in response to the user inputting adjustment information for a third target facial expression image in the at least one displayed facial expression image, the third target facial expression image is adjusted according to the adjustment information.
[0104] For example, in response to a user selecting a third target expression image and entering adjustment information, the third target expression image is adjusted according to the adjustment information. For example, the adjustment information may include adjustment information for at least one of facial expression, facial angle, body movement, body angle, background image, beautification material, or style. For example, the adjustment information may include "Change to a smiling expression." Users can adjust various aspects of the third target expression image based on their needs. The adjustment information can be entered in voice, text, or other formats.
[0105] In step S312 , at least one candidate adjustment item is displayed, wherein different candidate adjustment items correspond to different adjustment information.
[0106] Candidate adjustment items can be used to adjust one or more emoticon images. Each candidate adjustment item can serve as an adjustment control, allowing you to adjust different aspects of an emoticon image. Candidate adjustment items can be displayed when the interactive interface is opened or when at least one emoticon image is displayed. There is no restriction on when these items will be displayed.
[0107] In step S314 , in response to the user applying a target adjustment item from at least one candidate adjustment item to a fourth target facial expression image in the at least one displayed facial expression image, the fourth target facial expression image is adjusted according to the target adjustment item.
[0108] There may be one or more fourth target expression images, and the fourth target expression images may be adjusted by triggering a target adjustment item. In the case of multiple fourth target expression images, different target adjustment items may be applied to different fourth target expression images.
[0109] As shown in Figure 4, a user enters the interactive message "Dear, don't be sad, I'm here to chat with you." An emoticon image is generated and displayed as a thumbnail in the emoticon recommendation area. Multiple adjustment options, such as "Change emoticon" or "Oil painting style," can be displayed above the input box in the input area. The user can apply a target adjustment to the displayed emoticon image. For example, if the user selects "Oil painting style," the displayed emoticon image will be adjusted to an oil painting style.
[0110] The order of the above steps S308 , S310 , and S312 to S314 is not limited, and all of them are optional steps.
[0111] In some embodiments, at least one emoticon image is displayed in the emoticon recommendation area, and in response to a user selecting any emoticon image from the at least one emoticon image, the selected emoticon image is displayed in a preview form.
[0112] Users can trigger the preview function of emoticon images by clicking, double-clicking, and other methods. As shown in Figure 4, emoticon images are presented as small images in the emoticon recommendation area, and the preview can be displayed in normal size for user convenience.
[0113] In step S316 , in response to the user's confirmation operation on the first target facial expression image in the at least one facial expression image, the first target facial expression image is sent to the interactive object.
[0114] In the method of the above embodiment, after generating at least one emoticon image, the user can update and adjust any emoticon image, which improves the flexibility of emoticon image generation, better meets the user's personalized needs, and improves the generation efficiency and use efficiency of emoticon images.
[0115] The present disclosure also provides an interactive processing device, which is described below in conjunction with FIG5 .
[0116] FIG5 is a structural diagram of some embodiments of the interaction processing device of the present disclosure. As shown in FIG5 , the interaction processing device 50 of this embodiment includes: a first display module 510 , a generation module 520 , a second display module 530 , and a sending module 540 .
[0117] The first display module 510 is configured to display an interaction interface between a user and an interaction object.
[0118] The generation module 520 is configured to generate at least one expression image in response to the user inputting interaction information in the input area of the interaction interface, based on the interaction information and the basic image, wherein the basic image is an image authorized by the user and the basic image is an image containing a face.
[0119] The second display module 530 is configured to display at least one expression image;
[0120] The sending module 540 is configured to send the target facial expression image to the interactive object in response to the user's confirmation operation on the target facial expression image in the at least one facial expression image.
[0121] In some embodiments, the generation module 520 is configured to perform sentiment analysis on the interaction information to determine the sentiment information corresponding to the interaction information; and generate at least one expression image based on the sentiment information and the basic image.
[0122] In some embodiments, the generation module 520 is configured to perform sentiment analysis based on the interaction information and the interaction records before the interaction information, and determine the sentiment information corresponding to the interaction information.
[0123] In some embodiments, the generation module 520 is configured to recognize a face in a base image; adjust at least one of the expression and angle of the face according to the emotional information, and generate an image of the face in at least one expression image.
[0124] In some embodiments, the generation module 520 is configured to identify limbs in a base image; adjust at least one of the movement and angle of the limbs according to the emotional information, and generate an image of the limbs in at least one expression image.
[0125] In some embodiments, the generation module 520 is configured to perform at least one of the following: generating a background image in at least one expression image based on the emotion information; generating beautification material added to at least one expression image based on the emotion information.
[0126] In some embodiments, the generation module 520 is configured to determine environmental feature information based on the interaction information; and generate a background image in at least one expression image based on the environmental feature information.
[0127] In some embodiments, the generation module 520 is configured to determine the environmental feature information based on the interaction information and the interaction record before the interaction information.
[0128] In some embodiments, the interaction processing device further includes: an updating module 550 configured to update the second target expression image in the at least one displayed expression image according to the interaction information and the basic image in response to a user's updating operation on the second target expression image.
[0129] In some embodiments, the interaction processing device further includes: an adjustment module 560 configured to adjust the third target expression image according to the adjustment information in response to user input of adjustment information for the third target expression image in the at least one expression image displayed.
[0130] In some embodiments, the display module 530 is configured to display at least one candidate adjustment item, and the adjustment module 560 is configured to adjust the fourth target expression image according to the target adjustment item in response to the user applying a target adjustment item from at least one candidate adjustment item to the fourth target expression image in the displayed at least one expression image.
[0131] In some embodiments, the generation module 520 is configured to generate at least one expression image based on the interaction information, the base image and the image of the interaction object, wherein the image of the interaction object is an image of the interaction object authorized application, and the image of the interaction object is an image including a face.
[0132] In some embodiments, the generation module 520 is configured to extract the image of the first character in the base image and the image of the second character in the image of the interactive object; adjust the image of the first character and the image of the second character according to the interaction information to obtain at least one adjusted image of the first character and at least one adjusted image of the second character; generate at least one background image according to the interaction information, the background image in the base image, and at least one background image in the image of the interactive object; generate at least one expression image according to at least one adjusted image of the first character, at least one adjusted image of the second character, and at least one background image.
[0133] In some embodiments, the display module 530 is configured to display at least one emoticon image in the emoticon recommendation area, and in response to a user selecting any emoticon image from the at least one emoticon image, display the selected emoticon image in a preview form.
[0134] In some embodiments, the base image is a user's avatar, or the base image is an image selected by the user from a plurality of authorized candidate images that have been uploaded.
[0135] In some embodiments, when at least one expression image is a plurality of expression images, at least one of facial expressions, facial angles, body movements, body angles, background images, and beautification materials in the plurality of expression images is different.
[0136] In some embodiments, at least one emoticon image includes text corresponding to the interaction information, and the interaction information is text or voice.
[0137] It should be noted that the above-mentioned units (modules) are merely logical modules divided according to the specific functions they implement, and are not intended to limit specific implementation methods. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned units are shown with dotted lines in the drawings to indicate that these units may not actually exist, and the operations / functions they implement can be implemented by the processing circuit itself.
[0138] In addition, although not shown, the device may also include a memory that can store various information generated by the device and the various units contained in the device during operation, programs and data used for operation, data to be sent by the communication unit, etc. The memory can be volatile memory and / or non-volatile memory. For example, the memory can include but is not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. Of course, the memory can also be located outside the device. Optionally, although not shown, the device may also include a communication unit that can be used to communicate with other devices. In one example, the communication unit can be implemented in an appropriate manner known in the art, for example, including communication components such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, etc. This will not be described in detail here. In addition, the device may also include other components not shown, such as a radio frequency link, a baseband processing unit, a network interface, a processor, a controller, etc. This will not be described in detail here.
[0139] Some embodiments of the present disclosure also provide an electronic device. Figure 6 shows a block diagram of some embodiments of the electronic device of the present disclosure. For example, in some embodiments, the electronic device 60 can be various types of devices, for example, including but not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 60 may include a display panel for displaying data and / or execution results utilized in the scheme of the present disclosure. For example, the display panel can be of various shapes, such as a rectangular panel, an elliptical panel, or a polygonal panel. In addition, the display panel can be not only a flat panel, but also a curved panel or even a spherical panel.
[0140] As shown in FIG6 , the electronic device 60 of this embodiment includes a memory 61 and a processor 62 coupled to the memory 61. It should be noted that the components of the electronic device 60 shown in FIG6 are merely exemplary and non-limiting. The electronic device 60 may also include other components as required by actual applications. The processor 62 may control the other components in the electronic device 60 to perform desired functions.
[0141] In some embodiments, the memory 61 is configured to store one or more computer-readable instructions. When the processor 62 is configured to execute the computer-readable instructions, the computer-readable instructions, when executed by the processor 62, implement a method according to any of the above-described embodiments. The specific implementation and related explanations of each step of the method can be found in the above-described embodiments, and any repetitive details are omitted here.
[0142] For example, the processor 62 and the memory 61 may communicate with each other directly or indirectly. For example, the processor 62 and the memory 61 may communicate with each other via a network. The network may include a wireless network, a wired network, and / or any combination of wireless networks and wired networks. The processor 62 and the memory 61 may also communicate with each other via a system bus, which is not limited in this disclosure.
[0143] For example, the processor 62 can be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The central processing unit (CPU) can be an X86 or ARM architecture, etc. For example, the memory 61 can include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 61 can include, for example, a system memory, which stores, for example, an operating system, an application, a boot loader (Boot Loader), a database, and other programs. Various applications and various data can also be stored in the storage medium.
[0144] In addition, according to some embodiments of the present disclosure, when various operations / processes according to the present disclosure are implemented through software and / or firmware, the programs constituting the software can be installed from a storage medium or a network to a computer system having a dedicated hardware structure, such as the computer system (or electronic device) 70 shown in Figure 7. When the various programs are installed, the computer system can perform various functions, including functions such as those described above. Figure 7 is a block diagram illustrating an example structure of a computer system that can be used in embodiments of the present disclosure.
[0145] In Figure 7, a central processing unit (CPU) 701 performs various processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage part 708 to a random access memory (RAM) 703. In the RAM 703, data required when the CPU 701 performs various processes, etc., is also stored as needed. The central processing unit is merely exemplary and may also be other types of processors, such as the various processors described above. The ROM 702, RAM 703, and storage part 708 may be various forms of computer-readable storage media, as described below. It should be noted that although ROM 702, RAM 703, and storage device 708 are shown separately in Figure 7, one or more of them may be combined or located in the same or different memory or storage modules.
[0146] The CPU 701, the ROM 702, and the RAM 703 are connected to one another via a bus 704. An input / output interface 705 is also connected to the bus 704.
[0147] The following components are connected to the input / output interface 705: an input portion 706, such as a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; an output portion 707, including a display, such as a cathode ray tube (CRT), liquid crystal display (LCD), speaker, vibrator, etc.; a storage portion 708, including a hard disk, magnetic tape, etc.; and a communication portion 709, including a network interface card, such as a LAN card, modem, etc. The communication portion 709 allows communication processing to be performed via a network, such as the Internet. It will be readily understood that although FIG7 shows that the various devices or modules in the computer system 70 communicate via the bus 704, they may also communicate via a network or other means, where the network may include a wireless network, a wired network, and / or any combination of wireless and wired networks.
[0148] A drive 710 is also connected to the input / output interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 710 as needed so that a computer program read therefrom is installed in the storage section 708 as needed.
[0149] In the case of realizing the above-described series of processing by software, a program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 711 .
[0150] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the CPU 701, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.
[0151] It should be noted that in the context of the present disclosure, a computer-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.
[0152] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0153] In some embodiments, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to perform the method of any of the above embodiments. For example, the instructions may be embodied as computer program codes.
[0154] In embodiments of the present disclosure, computer program code for performing the operations of the present disclosure can be written in one or more programming languages or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In situations involving a remote computer, the remote computer can be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or can be connected to an external computer (e.g., using an Internet service provider to connect via the Internet).
[0155] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0156] The modules, components, or units described in the embodiments of the present disclosure may be implemented in software or hardware. The names of the modules, components, or units do not necessarily limit the modules, components, or units themselves.
[0157] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, and without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0158] According to some embodiments of the present disclosure, an interaction processing method is provided, including: displaying an interaction interface between a user and an interactive object; in response to a user inputting interaction information in an input area of the interaction interface, generating at least one expression image based on the interaction information and a basic image, wherein the basic image is an image authorized for application by the user, and the basic image is an image including a face; displaying at least one expression image; and in response to a user confirming a first target expression image in at least one expression image, sending the first target expression image to the interactive object.
[0159] In some embodiments, generating at least one expression image based on the interaction information and the basic image includes: performing sentiment analysis on the interaction information to determine the sentiment information corresponding to the interaction information; and generating at least one expression image based on the sentiment information and the basic image.
[0160] In some embodiments, performing sentiment analysis on the interaction information to determine the sentiment information corresponding to the interaction information includes: performing sentiment analysis based on the interaction information and interaction records before the interaction information to determine the sentiment information corresponding to the interaction information.
[0161] In some embodiments, generating at least one expression image based on emotional information and a base image includes: identifying a face in the base image; adjusting at least one of the expression and angle of the face based on the emotional information to generate an image of the face in at least one expression image.
[0162] In some embodiments, generating at least one expression image based on emotional information and a basic image includes: identifying limbs in the basic image; adjusting at least one of the movement and angle of the limbs based on the emotional information to generate an image of the limbs in at least one expression image.
[0163] In some embodiments, generating at least one expression image based on emotional information and a basic image includes at least one of the following: generating a background image in at least one expression image based on the emotional information; generating beautification materials added to at least one expression image based on the emotional information.
[0164] In some embodiments, generating at least one expression image based on the interaction information and the base image includes: determining environmental feature information based on the interaction information; and generating a background image in the at least one expression image based on the environmental feature information.
[0165] In some embodiments, determining the environmental characteristic information according to the interaction information includes: determining the environmental characteristic information according to the interaction information and an interaction record before the interaction information.
[0166] In some embodiments, the interaction processing method further includes: in response to a user's update operation on a second target expression image in the at least one displayed expression image, updating the second target expression image according to the interaction information and the basic image.
[0167] In some embodiments, the interaction processing method further includes: in response to the user inputting adjustment information for the third target expression image in the at least one expression image displayed, adjusting the third target expression image according to the adjustment information.
[0168] In some embodiments, the interactive processing method also includes: displaying at least one candidate adjustment item, wherein different candidate adjustment items correspond to different adjustment information; in response to the user applying a target adjustment item in at least one candidate adjustment item to a fourth target expression image in the displayed at least one expression image, adjusting the fourth target expression image according to the target adjustment item.
[0169] In some embodiments, generating at least one expression image based on the interaction information and the base image includes: generating at least one expression image based on the interaction information, the base image and the image of the interaction object, wherein the image of the interaction object is an image of an authorized application of the interaction object, and the image of the interaction object is an image including a face.
[0170] In some embodiments, generating at least one expression image based on interaction information, a base image, and an image of an interaction object includes: extracting an image of a first character in the base image and an image of a second character in the image of an interaction object; adjusting the image of the first character and the image of the second character based on the interaction information to obtain at least one adjusted image of the first character and at least one adjusted image of the second character; generating at least one background image based on at least one of the interaction information, a background image in the base image, and a background image in the image of an interaction object; generating at least one expression image based on at least one adjusted image of the first character, at least one adjusted image of the second character, and at least one background image.
[0171] In some embodiments, displaying at least one emoticon image includes displaying at least one emoticon image in an emoticon recommendation area, and the interaction processing method further includes: in response to a user's selection operation of any emoticon image among the at least one emoticon image, displaying the selected emoticon image in preview form.
[0172] In some embodiments, the base image is a user's avatar, or the base image is an image selected by the user from a plurality of authorized candidate images that have been uploaded.
[0173] In some embodiments, when at least one expression image is a plurality of expression images, at least one of facial expressions, facial angles, body movements, body angles, background images, and beautification materials in the plurality of expression images is different.
[0174] In some embodiments, at least one emoticon image includes text corresponding to the interaction information, and the interaction information is text or voice.
[0175] According to other embodiments of the present disclosure, an interaction processing device is provided, including: a first display module, configured to display an interaction interface between a user and an interaction object; a generation module, configured to generate at least one expression image in response to a user inputting interaction information in an input area of the interaction interface, based on the interaction information and a basic image, wherein the basic image is an image authorized for application by the user, and the basic image is an image containing a face; a second display module, configured to display at least one expression image; and a sending module, configured to send a target expression image to the interaction object in response to a user confirming an operation on the target expression image in the at least one expression image.
[0176] According to some further embodiments of the present disclosure, an electronic device is provided, comprising: a processor; and a memory coupled to the processor, for storing instructions, which, when executed by the processor, causes the processor to execute the interactive processing method of any embodiment of the present disclosure.
[0177] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the interactive processing method of any embodiment of the present disclosure is executed.
[0178] According to some further embodiments of the present disclosure, a computer program product is provided, comprising: instructions, which implement the interactive processing method of any embodiment of the present disclosure when the instructions are executed by a processor.
[0179] According to some further embodiments of the present disclosure, a computer program is provided, comprising: instructions, which implement the interactive processing method of any embodiment of the present disclosure when the instructions are executed by a processor.
[0180] The above descriptions are merely some embodiments of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but also encompasses other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in the present disclosure.
[0181] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the present invention may be practiced without these specific details. In other cases, well-known methods, structures, and techniques are not presented in detail in order not to obscure the understanding of the description.
[0182] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0183] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art will appreciate that the above examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Those skilled in the art will appreciate that modifications may be made to the above embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.
Claims
1. An interactive processing method, comprising: Display the interactive interface between the user and the interactive object; In response to the user inputting interaction information in the input area of the interaction interface, generating at least one expression image according to the interaction information and a basic image, wherein the basic image is an image authorized by the user for application, and the basic image is an image including a face; displaying the at least one emoticon image; In response to the user's confirmation operation on a first target expression image in the at least one expression image, the first target expression image is sent to the interactive object.
2. The interactive processing method according to claim 1, wherein: Generating at least one expression image according to the interaction information and the basic image includes: Performing sentiment analysis on the interaction information to determine sentiment information corresponding to the interaction information; At least one expression image is generated based on the emotion information and the basic image.
3. The interactive processing method according to claim 2, wherein: The performing sentiment analysis on the interaction information to determine the sentiment information corresponding to the interaction information includes: Perform sentiment analysis based on the interaction information and interaction records before the interaction information to determine sentiment information corresponding to the interaction information.
4. The interactive processing method according to claim 2 or 3, wherein: Generating the at least one expression image according to the emotion information and the basic image includes: Recognizing a face in the base image; At least one of the facial expression and angle is adjusted according to the emotional information to generate an image of the face in the at least one expression image.
5. The interactive processing method according to any one of claims 2 to 4, wherein: Generating the at least one expression image according to the emotion information and the basic image includes: identifying a limb in the base image; At least one of the movement and angle of the limb is adjusted according to the emotional information to generate an image of the limb in the at least one expression image.
6. The interactive processing method according to any one of claims 2 to 5, wherein: Generating the at least one expression image according to the emotion information and the basic image includes at least one of the following: generating a background image in the at least one expression image according to the emotion information; Beautification material added to the at least one expression image is generated according to the emotion information.
7. The interactive processing method according to any one of claims 1 to 5, wherein: Generating at least one expression image according to the interaction information and the basic image includes: determining environmental feature information based on the interaction information; A background image in the at least one expression image is generated according to the environmental feature information.
8. The interactive processing method according to claim 7, wherein: The determining of the environmental characteristic information according to the interaction information includes: Environmental feature information is determined according to the interaction information and interaction records before the interaction information.
9. The interaction processing method according to any one of claims 1 to 8, further comprising: In response to the user's update operation on a second target expression image in the at least one displayed expression image, the second target expression image is updated according to the interaction information and the basic image.
10. The interaction processing method according to any one of claims 1 to 9, further comprising: In response to the user inputting adjustment information for a third target facial expression image in the at least one facial expression image, the third target facial expression image is adjusted according to the adjustment information.
11. The interactive processing method according to any one of claims 1 to 10, further comprising: displaying at least one candidate adjustment item, wherein different candidate adjustment items correspond to different adjustment information; In response to the user applying a target adjustment item from the at least one candidate adjustment item to a fourth target expression image in the at least one expression image, the fourth target expression image is adjusted according to the target adjustment item.
12. The interactive processing method according to any one of claims 1 to 11, wherein: Generating at least one expression image according to the interaction information and the basic image includes: At least one expression image is generated according to the interaction information, the basic image and the image of the interaction object, wherein the image of the interaction object is an image of an authorized application of the interaction object and is an image including a face.
13. The interactive processing method according to claim 12, wherein: Generating at least one expression image according to the interaction information, the basic image, and the image of the interaction object includes: extracting an image of a first person in the base image and an image of a second person in the image of the interactive object; Adjusting the image of the first person and the image of the second person according to the interaction information to obtain at least one adjusted image of the first person and at least one adjusted image of the second person; generating at least one background image according to at least one of the interaction information, the background image in the base image, and the background image in the image of the interaction object; The at least one expression image is generated according to the at least one adjusted image of the first character, the at least one adjusted image of the second character, and the at least one background image.
14. The interactive processing method according to any one of claims 1 to 13, wherein: The displaying of the at least one emoticon image includes displaying the at least one emoticon image in an emoticon recommendation area, and the interaction processing method further includes: In response to the user's selection operation of any emoticon image among the at least one emoticon image, the selected emoticon image is displayed in a preview form.
15. The interactive processing method according to any one of claims 1 to 14, wherein: The basic image is the user's avatar, or the basic image is an image selected by the user from a plurality of authorized candidate images that have been uploaded.
16. The interactive processing method according to any one of claims 1 to 15, wherein: When the at least one expression image is a plurality of expression images, at least one of facial expressions, facial angles, body movements, body angles, background images, and beautification materials in the plurality of expression images is different.
17. The interactive processing method according to any one of claims 1 to 16, wherein: The at least one expression image includes text corresponding to the interaction information, and the interaction information is text or voice.
18. An interactive processing device, comprising: A first display module is configured to display an interaction interface between a user and an interaction object; a generating module configured to generate at least one emoticon image in response to the user inputting interaction information in the input area of the interaction interface, based on the interaction information and a basic image, wherein the basic image is an image authorized by the user for application and is an image containing a face; a second display module, configured to display the at least one expression image; The sending module is configured to send the target expression image to the interactive object in response to the user's confirmation operation on the target expression image in the at least one expression image.
19. An electronic device comprising: processor; as well as A memory coupled to the processor, for storing instructions, wherein when the instructions are executed by the processor, the processor executes the interactive processing method according to any one of claims 1 to 17.
20. A computer-readable storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the interactive processing method according to any one of claims 1 to 17 is implemented.
21. A computer program product comprising: An instruction, which, when executed by a processor, implements the interactive processing method according to any one of claims 1 to 17.
22. A computer program comprising: An instruction, which, when executed by a processor, implements the interactive processing method according to any one of claims 1 to 17.
Citation Information
Patent Citations
Method, client and system for filling instant image in instant communication message
CN102780649A
Information sending method, device and equipment
CN107612815A
Video processing method, device and system, terminal device and storage medium
CN110286756A
Social method, device and system, terminal equipment and storage medium
CN110599359A
Data processing method, apparatus and system, and electronic device and readable storage medium
WO2022193910A1