Interaction processing method and device, electronic equipment, storage medium and program product
By generating and sending personalized expression images in the interactive interface, the problem of inflexible expression images generation in the prior art is solved, and the accuracy of user expression and interactive experience are improved.
Patent Information
- Application Number
- CN202480002167.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-29
- Publication Date
- 2024-12-20
AI Technical Summary
In the prior art, the generation method of emoticon images is not flexible enough, and users cannot edit emoticon images, resulting in low usage efficiency and inability to meet personalized needs.
By displaying the interaction interface between the user and the interactive object, emoticon images are generated and displayed based on the interaction information and basic images (images containing faces) input by the user, and allowing users to confirm and send them, using machine learning models for sentiment analysis and image adjustment to generate personalized expression images that are more in line with emotions and context.
It improves the flexibility and efficiency of generation of expression images, meets users' personalized needs, enables users to express their intentions more accurately, and enhances the vividness and fun of interactions.
Smart Images

Figure CN119173843A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of computer technology, and in particular to an interactive processing method, device, electronic device, storage medium and program product. Background Art
[0002] Currently, users and interactive objects can communicate or interact in real time through the network, and can send various forms of content such as voice, text, image or video to the interactive object.
[0003] Usually, communication applications will pre-set some emoticons (also called emoticon packages). Users can select emoticons and send them to the other party based on the context at the time and the meaning they want to express, which is more vivid and vivid. Summary of the invention
[0004] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.
[0005] According to some embodiments of the present disclosure, an interaction processing method is provided, including: displaying an interaction interface between a user and an interaction object; in response to a user inputting interaction information in an input area of the interaction interface, generating at least one expression image based on the interaction information and a basic image, wherein the basic image is an image authorized for application by the user, and the basic image is an image including a face; displaying at least one expression image; and in response to a user confirming a first target expression image in at least one expression image, sending the first target expression image to the interaction object.
[0006] According to some other embodiments of the present disclosure, there is provided an interaction processing device, comprising: a first display module, configured to display an interaction interface between a user and an interaction object; a generation module, configured to generate at least one expression image in response to a user inputting interaction information in an input area of the interaction interface, according to the interaction information and a basic image, wherein the basic image is an image authorized for application by the user, and the basic image is an image containing a face; a second display module, configured to display at least one expression image; and a sending module, configured to send a target expression image to the interaction object in response to a user confirming an operation on the target expression image in the at least one expression image.
[0007] According to some further embodiments of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory coupled to the processor, for storing instructions, which, when executed by the processor, causes the processor to execute the interactive processing method of any embodiment of the present disclosure.
[0008] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the interactive processing method of any embodiment of the present disclosure is performed.
[0009] According to some further embodiments of the present disclosure, a computer program product is provided, comprising: instructions, which, when executed by a processor, implement the interactive processing method of any embodiment of the present disclosure.
[0010] According to some further embodiments of the present disclosure, a computer program is provided, comprising: instructions, which implement the interactive processing method of any embodiment of the present disclosure when the instructions are executed by a processor.
[0011] Other features, aspects and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] The preferred embodiments of the present disclosure are described below with reference to the accompanying drawings. The drawings described herein are used to provide a further understanding of the present disclosure. Each of the drawings together with the following detailed description is included in this specification and forms a part of the specification, and is used to explain the present disclosure. It should be understood that the drawings described below only relate to some embodiments of the present disclosure and do not constitute a limitation on the present disclosure. In the drawings:
[0013] Figure 1 A schematic diagram showing a flow chart of an interactive processing method according to some embodiments of the present disclosure;
[0014] Figure 2 A schematic diagram showing an interactive interface of some embodiments of the present disclosure;
[0015] Figure 3 A schematic diagram showing a flow chart of an interaction processing method according to some other embodiments of the present disclosure;
[0016] Figure 4 Schematic diagrams showing interaction interfaces of other embodiments of the present disclosure;
[0017] Figure 5 A schematic diagram showing the structure of an interactive processing device in some embodiments of the present disclosure;
[0018] Figure 6 A schematic diagram showing the structure of an electronic device according to some embodiments of the present disclosure;
[0019] Figure 7 A schematic diagram showing the structure of a computer system according to some embodiments of the present disclosure.
[0020] It should be understood that, for ease of description, the sizes of the various parts shown in the drawings are not necessarily drawn according to the actual proportional relationship. The same or similar reference numerals are used in the various drawings to represent the same or similar parts. Therefore, once an item is defined in one drawing, it may not be further discussed in subsequent drawings. DETAILED DESCRIPTION
[0021] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure, but it is obvious that the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. The following description of the embodiments is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. It should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein.
[0022] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be performed in different orders, and / or performed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown in the execution. The scope of the present disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement, numerical expressions and numerical values of the parts and steps set forth in these embodiments should be interpreted as being merely exemplary and do not limit the scope of the present disclosure.
[0023] The term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". In addition, the term "include" and its variations used in the present disclosure mean an open term that includes at least the following elements / features but does not exclude other elements / features, that is, "including but not limited to". Therefore, include is synonymous with include. The term "based on" means "based at least in part on".
[0024] References throughout this specification to "one embodiment," "some embodiments," or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. For example, the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments." Furthermore, the appearances of the phrases "in one embodiment," "in some embodiments," or "in an embodiment" in various places throughout this specification do not necessarily all refer to the same embodiment, but may do so.
[0025] It should be noted that the concepts of "first", "second", etc. mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units. Unless otherwise specified, the concepts of "first", "second", etc. are not intended to imply that the objects described in this way must be in a given order in time, space, ranking, or any other manner.
[0026] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0027] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0028] The embodiments of the present disclosure are described in detail below in conjunction with the accompanying drawings, but the present disclosure is not limited to these specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. In addition, in one or more embodiments, specific features, structures or characteristics can be combined in any suitable manner that will be clear from the present disclosure by a person of ordinary skill in the art.
[0029] The scenario in which a user communicates or interacts with an interactive object through a network includes, for example, an instant messaging scenario. The interactive object can be a real object or a virtual object.
[0030] Currently, when users communicate or interact with an interactive object, they can send emoticons to the interactive object. Since these emoticons are generally provided by applications, on the one hand, the number and types of emoticons are limited, and users cannot edit emoticons, which cannot meet the personalized needs of users. On the other hand, users usually need to search and find emoticons corresponding to the meaning they want to express, which is inefficient.
[0031] In view of the problem that the current generation method of expression images is not flexible enough and the use efficiency is low, the present disclosure proposes an interactive processing method. Figures 1 to 4 Give a description.
[0032] Figure 1 Flowcharts of some embodiments of the interactive processing method disclosed herein. Figure 1 As shown, the method of this embodiment includes: steps S102 to S108.
[0033] In step S102, an interaction interface between the user and the interaction object is displayed.
[0034] For example, the interactive object is a real object or a virtual object. For example, the interactive interface is an instant messaging interface (e.g., a chat interface, etc.), and the interactive interface may include an interactive information display area and an input area. The interactive information display area may be used to display interactive information sent between the user and the interactive object. The input area may be used to input interactive information and display interactive information to be sent, etc.
[0035] In step S104, in response to the user inputting interaction information in the input area of the interaction interface, at least one expression image is generated according to the interaction information and the basic image.
[0036] The interactive information may be in the form of text or voice. The expression image may be a static image or a dynamic image. The expression image may also be called an emotional image, an expression package, etc., and may be used to express specific emotions or feelings. The expression image may include the face of a real person or the face of a virtual character (such as an animated character), and the face may have a specific expression. Of course, the expression image may also include body parts, backgrounds, etc., and may also be supplemented with text, beautification materials, etc., and is not limited to the examples given.
[0037] For example, the basic image is an image that the user authorizes to use, and the basic image is an image that includes a face. The user can authorize the image that is allowed to be used, and the authorization can be done in various ways, which are not limited here. The basic image includes an image of the face to facilitate the generation of an expression image. For example, the basic image can be a user's avatar, an image uploaded by the user, etc., and is not limited to the examples given.
[0038] For example, a machine learning model is used to analyze and understand the interactive information, and the basic image is adjusted according to the interactive information to generate at least one expression image. For example, the facial expression and / or direction in the basic image can be adjusted. For example, the background in the basic image can be adjusted. For example, when the basic image includes limbs, the limb movements and / or directions in the basic image can be adjusted. For example, beautification materials can be added to the basic image. Adjustment of the basic image can make the basic image more consistent with the meaning that the interactive information wants to express.
[0039] In step S106, at least one expression image is displayed.
[0040] For example, at least one emoticon image is displayed in the emoticon recommendation area. The emoticon recommendation area may not be displayed if no emoticon image is generated, and is used to display at least one emoticon image after at least one emoticon image is generated. For example, the emoticon recommendation area may be displayed in the form of a pop-up window, a floating layer, a bubble, etc., and is not limited to the examples given. The emoticon recommendation area may be displayed in a position adjacent to the input area. In the case of multiple emoticon images, the emoticon recommendation area may display some of the emoticon images, and display the remaining emoticon images in response to the user's switching operation (for example, a sliding switching operation). After the user inputs the interactive information, at least one emoticon image is displayed in real time.
[0041] In step S108, in response to the user's confirmation operation on the first target expression image in the at least one expression image, the first target expression image is sent to the interactive object.
[0042] The user can select any expression image as the first target expression image. For example, the user selects the first target expression image by clicking and sends the first target expression image to the interactive object. For example, in response to the user's selection of the first target expression, the first target expression is displayed in the input area, and in response to the user's sending operation, the first target expression image is sent to the interactive object.
[0043] In the method of the above embodiment, the user inputs the interaction information in the input area of the interactive interface, and at least one expression image can be directly generated and displayed based on the interaction information and the basic image. The user can select and send the first target expression image in the at least one expression image, and use the first target expression image to convey the content that the user wants to express to the interactive object. Since the basic image is the image authorized by the user, that is, the image selected by the user, the expression image generated based on the interaction information and the basic image can more accurately express the meaning that the user wants to express, and generate personalized expression images for the user, thereby improving the flexibility of expression image generation, improving the vividness and fun of interaction, and better meeting the needs of users. In addition, the expression image can be automatically generated when the user inputs the interaction information, without the need for the user to search and find, thereby improving the generation efficiency and use efficiency of the expression image.
[0044] In some embodiments, the base image is a user's avatar, or the base image is an image selected by the user from a plurality of authorized candidate images that have been uploaded.
[0045] The user's avatar can be displayed in the interactive interface, for example, the user's avatar is displayed next to each interactive message of the user. After the user authorizes the right to use the avatar, at least one expression image can be directly generated using the user's avatar. The user can pre-configure an image used to generate an expression image as a basic image. For example, the user can upload multiple candidate images and specify the image used as the avatar, the image used to generate the expression image, and the image for other purposes. Alternatively, when the user interacts with the interactive object, an image selected from the uploaded authorized multiple candidate images can be used as the basic image. Using the user's avatar or the image uploaded by the user, a personalized expression image can be generated for each user to meet the user's personalized needs while improving the efficiency of generating expression images.
[0046] The following describes how to generate at least one expression image in conjunction with some embodiments.
[0047] In some embodiments, sentiment analysis is performed on the interaction information to determine the sentiment information corresponding to the interaction information; and at least one expression image is generated based on the sentiment information and the basic image.
[0048] For example, the interaction information and the basic image are input into a generative model, and at least one expression image is output. For example, a machine learning model is used to perform sentiment analysis on the interaction information, to determine the sentiment information corresponding to the interaction information, and to generate at least one expression image based on the sentiment information and the basic image. For example, sentiment information includes sentiment type, and the sentiment type can be various types such as happy, angry, sad, etc. For example, a machine learning model is used to perform sentiment recognition on the interaction information, to determine the sentiment type, and then to generate at least one expression image based on the sentiment type and the basic image. The emotion reflected by at least one expression image is the same as the emotion expressed by the interaction information. For example, if the interaction information is "Today's weather is so good, let's go out and play", it can be determined that the sentiment type is happy, and then the facial expression in the generated expression image indicates happiness.
[0049] When the interactive information is text, sentiment analysis can be performed directly. When the interactive information is voice, the voice can be converted into text for sentiment analysis, or sentiment analysis can be performed directly on the voice.
[0050] Emotional analysis is performed on the interactive information, and then at least one expression image is generated in combination with the basic image, so that the generated expression image is more consistent with the emotion that the user wants to express, the flexibility of expression image generation is improved, the liveliness and fun of the interaction are improved, and it is more in line with user needs.
[0051] In some cases, it is difficult to accurately determine the emotional information by only performing sentiment analysis on the interactive information. It is necessary to combine the context to improve the accuracy of the sentiment analysis of the interactive information. For example, the same sentence can express different emotions when combined with different contexts.
[0052] In some embodiments, sentiment analysis is performed based on the interaction information and the interaction records before the interaction information to determine the sentiment information corresponding to the interaction information; and at least one expression image is generated based on the sentiment information and the basic image.
[0053] A preset number of interaction records can be obtained, and a machine learning model can be used to determine the emotional information corresponding to the interaction information based on the interaction information and the interaction records, and then at least one expression image can be generated based on the emotional information and the basic image.
[0054] At least one expression image is generated based on the interaction information, the interaction record and the basic image, so that the expression image can more accurately express what the user wants to express, meet the user's personalized needs, and also improve the generation efficiency of the expression image.
[0055] In some embodiments, a face in a base image is identified; and at least one of an expression and an angle of the face is adjusted based on the emotional information to generate an image of the face in at least one expression image.
[0056] For example, face recognition technology can be used to identify the face in the basic image. Some emotional information can be expressed not only through facial expressions, but also by rotating the face at different angles. For example, a laughing expression combined with a face raised at a certain angle can express a very happy emotion. For example, a face facing away from the screen, that is, turning the head away, expresses a very depressed emotion of not wanting to talk. A machine learning model can be used to identify emotional information, and at least one of the facial expression and angle in the basic image can be adjusted according to the emotional information to generate an image of the face in at least one expression image.
[0057] If the original facial expression in the basic image can express the emotional information corresponding to the interactive information, no adjustment is required. By adjusting the facial expression and / or angle in the basic image according to the emotional information, the expression image can more accurately express the meaning that the user wants to express, and meet the personalized needs of the user. At the same time, the generation efficiency of the expression image can also be improved.
[0058] In addition to the facial expressions and angles that can be adjusted to express different emotions, if the basic image also includes body parts such as the body and limbs, the limbs can be adjusted to express different emotions.
[0059] In some embodiments, a limb in a base image is identified; and at least one of a movement and an angle of the limb is adjusted based on the emotional information to generate an image of the limb in at least one expression image.
[0060] The recognition and adjustment of the face and body can be performed simultaneously. The facial expression and angle should be coordinated with the body movements and angles, so that they can express the same emotion and look coordinated. For example, when the face is facing away from the screen, the body is also adjusted to face away from the screen. For example, when the facial expression is a helpless expression, the body movement can be adjusted to the movement of spreading the hands. A machine learning model can be used to identify emotional information, and based on the emotional information, at least one of the body movements and angles in the basic image can be adjusted to generate an image of the body in at least one expression image.
[0061] If the base image does not recognize the body parts, you can adjust only the facial expression and / or angle. If the base image can recognize the body parts, you can adjust the body movements and / or angle. If the base image does not recognize the body parts, you can also add body movements to express emotional information. For example, for an expression of covering the mouth and laughing, you can add hand movements.
[0062] If the original facial expression in the basic image can express the emotional information corresponding to the interactive information, no adjustment is required, and only the body movements and / or angles are adjusted. If the original body movements in the basic image can express the emotional information corresponding to the interactive information, no adjustment is required. By adjusting the body movements and / or angles in the basic image according to the emotional information, the expression image can more accurately express the meaning that the user wants to express and meet the user's personalized needs. At the same time, the generation efficiency of the expression image can also be improved.
[0063] In addition to adjusting the face and body parts in the basic image, you can also adjust elements such as the background to improve the display effect of the expression image.
[0064] In some embodiments, a background image in at least one expression image is generated based on the emotion information; and / or a beautification material added to at least one expression image is generated based on the emotion information.
[0065] For example, the beautification materials include stickers, special effects materials, etc., and are not limited to the examples cited. The emotional information to be expressed can be strengthened through the background image and / or the beautification materials. For example, if the user wants to express the emotion of liking, the background can be replaced with a heart pattern, and a heart sticker can be added to the face.
[0066] When adjusting the face and limbs, the images of the face and limbs can be extracted, and after the background image is generated, the generated background image can be synthesized with the images of the face and limbs to obtain an expression image. Beautification materials can be added to the corresponding positions of the face, limbs or background. For example, a machine learning model is used to identify the emotional information corresponding to the interaction information, and a background image in at least one expression image is generated based on the emotional information, and / or a beautification material added to at least one expression image is generated based on the emotional information.
[0067] Generating background images and / or beautifying materials based on emotional information can make the generated expression images more vivid and vivid, strengthen the emotional information to be expressed, meet the personalized needs of users, and also improve the generation efficiency of expression images.
[0068] In the above embodiment, the background image is generated based on the emotional information, and the background image can also be generated by extracting environmental features based on the interactive information.
[0069] In some embodiments, environmental feature information is determined based on the interaction information; and a background image in at least one expression image is generated based on the environmental feature information.
[0070] For example, environmental features include features indicating weather, scenes, and the like. For example, if the interactive information is "Today's weather is very good, and my mood is also very good", the generated background image may be an image of sunny weather. For example, if the interactive information is "Let's go to Disneyland this weekend", the generated background image may be a scene of Disneyland. For example, a machine learning model is used to determine environmental feature information based on interactive information; and a background image in at least one expression image is generated based on the environmental feature information.
[0071] The current interaction information may not include environmental features, but the environmental features can be determined more accurately by combining the context information.
[0072] In some embodiments, environmental feature information is determined based on the interaction information and the interaction record before the interaction information; and a background image in at least one expression image is generated based on the environmental feature information.
[0073] A preset number of interaction records may be obtained, and a machine learning model may be used to determine environmental feature information based on the interaction information and the interaction records; and a background image in at least one expression image may be generated based on the environmental feature information.
[0074] The generated background image is synthesized with the adjusted face or human body (face and body parts) image to obtain the expression image.
[0075] In the above embodiment, environmental feature information is determined based on interaction information to generate a background image in at least one expression image. This can make the generated at least one expression image more matching the user's interaction content, making the expression image more vivid and figurative, improving the display effect, meeting the user's personalized needs, and at the same time improving the efficiency of generating expression images.
[0076] The background image in at least one expression image may be generated by combining the emotion information and the environmental characteristic information, or may be generated based on the emotion information or the environmental characteristic information.
[0077] In some embodiments, when at least one expression image is a plurality of expression images, at least one of facial expressions, facial angles, body movements, body angles, background images, and beautification materials in the plurality of expression images is different.
[0078] For example, facial expressions all express a happy emotion, but the form of the smile can be different, the angle of the face can be different, the body movements can be different... multiple expression images are generated for users to choose from, thereby better meeting the user's personalized needs.
[0079] The styles or forms of expression of multiple expression images may be different. For example, multiple expression images may correspond to oil painting style, cartoon style, etc.
[0080] In some embodiments, at least one expression image includes text corresponding to the interaction information, and the interaction information is text or voice.
[0081] The interactive information input by the user can be text or voice. If it is voice, the voice can be converted into corresponding text and the text can be added to the emoticon image. In this way, the emoticon image can accurately and vividly express what the user wants to express by combining images and text.
[0082] Combine the following Figure 2 Some application examples of the present disclosure are described.
[0083] like Figure 2The figure shows the dialogue (interaction) interface between users A and B. User A sent the interaction message "My mood today is just like the weather today, overcast". An expression image was generated based on the interaction information of user A and the avatar of user A. The expression of user A in the expression image was adjusted according to the interaction information, and the background was added with a dark cloud pattern according to the interaction information. User B sent the interaction message "Dear, don't be unhappy, I'm here to chat with you". An expression image was generated based on the interaction information of user B and the avatar of user B. The expression of user B in the expression image was adjusted according to the interaction information, and the background was adjusted according to the interaction information, and love stickers were added. It can be seen that the generation and use of expression images make the interaction process between users more vivid and vivid, improve the interaction experience, and better meet the personalized needs of users.
[0084] At least one expression image may be generated for each interactive message of the user, or, when the user sends multiple interactive messages continuously, at least one expression image may be generated based on the multiple interactive messages. Or, when the user sends multiple interactive messages continuously, at least one expression image may be generated based on the first interactive message.
[0085] In order to further enrich the form and content of expression images, expression images of two people can be generated with the authorization of the user and the interactive object.
[0086] In some embodiments, at least one expression image is generated based on the interaction information, the base image and the image of the interaction object, wherein the image of the interaction object is an image of an authorized application of the interaction object, and the image of the interaction object is an image including a face.
[0087] For example, the image of the interactive object is the avatar of the interactive object, or the image of the interactive object is an image selected by the interactive object from multiple authorized candidate images that have been uploaded. The image of the interactive object is similar to the basic image and can be obtained and authorized in various forms, which will not be described in detail here. The at least one expression image generated may include an image corresponding to the face in the basic image and an image corresponding to the face in the image of the interactive object.
[0088] In some embodiments, an image of a first character in a base image and an image of a second character in an image of an interactive object are extracted; based on interaction information, the image of the first character and the image of the second character are adjusted to obtain at least one adjusted image of the first character and at least one adjusted image of the second character; based on at least one of the interaction information, the background image in the base image, and the background image in the image of the interactive object, at least one background image is generated; based on at least one adjusted image of the first character, at least one adjusted image of the second character, and at least one background image, at least one expression image is generated.
[0089] The first character and the second character may include faces and limbs. The first character and the second character may be real characters or virtual characters (eg, animated characters).
[0090] In some embodiments, adjusting the image of the first person and the image of the second person according to the interaction information includes: performing an emotion analysis on the interaction information, determining the emotion information corresponding to the interaction information, and adjusting the image of the first person and the image of the second person according to the emotion information. The expression and / or angle of the face of the first person can be adjusted, the expression and / or angle of the face of the second person can be adjusted, the movement and / or angle of the limbs of the first person can be adjusted, and the movement and / or angle of the limbs of the second person can be adjusted. For details, please refer to the embodiment of how to generate an expression image based on a basic image, which will not be repeated here.
[0091] The adjustment of the images of the first person and the second person can be performed synchronously, so that the expression, action, etc. of the first person can be coordinated with the expression, action of the second person to conform to the meaning to be expressed by the interactive information.
[0092] In some embodiments, at least one of the emotion information and the environmental feature information corresponding to the interaction information is determined based on the interaction information, and at least one background image is generated based on the emotion information and the environmental feature information. The background image in the base image and / or the background image in the image of the interaction object can also be adjusted based on the emotion information and the environmental feature information to obtain at least one background image.
[0093] In some embodiments, the beautification material to be added to the at least one expression image is generated according to the interaction information, and the beautification material is added to the at least one expression image.
[0094] Those skilled in the art can understand that the method of generating at least one expression image based on the interaction information and the basic image in the above-mentioned embodiment is also applicable to generating two-person expression images, and will not be described in detail here. When multiple expression images are generated and displayed for the user, some may be expression images generated based only on the basic image, and some may be expression images generated based on the basic image and the image of the interaction object.
[0095] After generating and displaying at least one expression image, the user can also adjust some or all of the expression images to better meet personalized needs and more accurately express what the user wants to express. Figure 3 Other embodiments of the interaction processing method disclosed in the present invention are described.
[0096] Figure 3 Flowcharts of some embodiments of the interactive processing method disclosed herein. Figure 3As shown, the method of this embodiment includes: steps S302 to S316.
[0097] In step S302, an interaction interface between the user and the interaction object is displayed.
[0098] In step S304, in response to the user inputting interaction information in the input area of the interaction interface, at least one expression image is generated according to the interaction information and the basic image.
[0099] In step S306, at least one expression image is displayed.
[0100] In step S308 , in response to the user's update operation on the second target expression image in the at least one displayed expression image, the second target expression image is updated according to the interaction information and the basic image.
[0101] The second target expression image may be one or more. An update control may be set for each expression image, and in response to a user triggering the update control of the second target expression image, the second target expression image is updated. Alternatively, one update control may be set, and in response to a user triggering the update control, all expression images are updated. The updated second target expression image is different from the previous one.
[0102] In step S310 , in response to the user inputting adjustment information for a third target expression image in the at least one expression image displayed, the third target expression image is adjusted according to the adjustment information.
[0103] For example, in response to the user selecting the third target expression image and inputting adjustment information, the third target expression image is adjusted according to the adjustment information. For example, the adjustment information is adjustment information for at least one of facial expression, facial angle, body movement, body angle, background image, beautification material, and style. For example, the adjustment information is "change to a smiling expression". The user can make various adjustments to the third target expression image according to his or her needs. The adjustment information can be input in the form of voice, text, etc.
[0104] In step S312, at least one candidate adjustment item is displayed, wherein different candidate adjustment items correspond to different adjustment information.
[0105] The candidate adjustment items can be used to adjust one or more emoticon images. Each candidate adjustment item can be used as an adjustment control to adjust different aspects of the emoticon images. The candidate adjustment items can be displayed when the interactive interface is opened, or when at least one emoticon image is displayed, and there is no restriction on the display timing.
[0106] In step S314, in response to the user applying a target adjustment item from among the at least one candidate adjustment item to a fourth target expression image in the at least one expression image displayed, the fourth target expression image is adjusted according to the target adjustment item.
[0107] There may be one or more fourth target expression images, and the fourth target expression images may be adjusted by triggering the target adjustment item. In the case where there are multiple fourth target expression images, different target adjustment items may be applied to different fourth target expression images.
[0108] like Figure 4 As shown, the user inputs the interactive information "Dear, don't be unhappy, I'll chat with you", and an expression image is generated and displayed as a small image in the expression recommendation area. A plurality of candidate adjustment items may be displayed above the input box in the input area, such as "Change expression", "Oil painting style", etc. The user may apply a target adjustment item to the displayed expression image. For example, if the user selects "Oil painting style", the displayed expression image may be adjusted to oil painting style.
[0109] The order of the above steps S308, S310, and S312 to S314 is not limited, and they are all optional steps.
[0110] In some embodiments, at least one emoticon image is displayed in the emoticon recommendation area, and in response to a user's selection operation of any emoticon image among the at least one emoticon image, the selected emoticon image is displayed in a preview form.
[0111] Users can trigger the preview function of the emoticon image by clicking, double-clicking, etc. Figure 4 As shown, the emoticon images are presented as small images in the emoticon recommendation area, and the preview form can be displayed in normal size for user convenience.
[0112] In step S316, in response to the user's confirmation operation on the first target expression image in the at least one expression image, the first target expression image is sent to the interactive object.
[0113] In the method of the above embodiment, after generating at least one expression image, the user can update and adjust any expression image, which improves the flexibility of expression image generation, better meets the user's personalized needs, and improves the generation efficiency and use efficiency of expression images.
[0114] The present disclosure also provides an interactive processing device, Figure 5 Give a description.
[0115] Figure 5 FIG. 1 is a structural diagram of some embodiments of the interactive processing device disclosed in the present invention. Figure 5As shown, the interaction processing device 50 of this embodiment includes: a first display module 510 , a generating module 520 , a second display module 530 , and a sending module 540 .
[0116] The first display module 510 is configured to display an interaction interface between a user and an interaction object.
[0117] The generation module 520 is configured to generate at least one expression image in response to the user inputting interaction information in the input area of the interaction interface, based on the interaction information and a basic image, wherein the basic image is an image authorized by the user for application, and the basic image is an image containing a face.
[0118] The second display module 530 is configured to display at least one expression image;
[0119] The sending module 540 is configured to send a target expression image to the interactive object in response to a user's confirmation operation on the target expression image in the at least one expression image.
[0120] In some embodiments, the generation module 520 is configured to perform sentiment analysis on the interaction information to determine the sentiment information corresponding to the interaction information; and generate at least one expression image based on the sentiment information and the basic image.
[0121] In some embodiments, the generation module 520 is configured to perform sentiment analysis based on the interaction information and the interaction records before the interaction information, and determine the sentiment information corresponding to the interaction information.
[0122] In some embodiments, the generation module 520 is configured to recognize a face in a base image; adjust at least one of an expression and an angle of the face according to the emotional information, and generate an image of the face in at least one expression image.
[0123] In some embodiments, the generation module 520 is configured to identify a limb in a base image; adjust at least one of the movement and angle of the limb according to the emotional information, and generate an image of the limb in at least one expression image.
[0124] In some embodiments, the generation module 520 is configured to perform at least one of the following: generating a background image in at least one expression image based on the emotion information; generating beautification material added to at least one expression image based on the emotion information.
[0125] In some embodiments, the generation module 520 is configured to determine environmental feature information according to the interaction information; and generate a background image in at least one expression image according to the environmental feature information.
[0126] In some embodiments, the generation module 520 is configured to determine the environmental feature information according to the interaction information and the interaction record before the interaction information.
[0127] In some embodiments, the interaction processing device further includes: an updating module 550 configured to update the second target expression image in the at least one displayed expression image according to the interaction information and the basic image in response to a user's updating operation on the second target expression image.
[0128] In some embodiments, the interaction processing device further includes: an adjustment module 560 configured to adjust the third target expression image according to the adjustment information in response to the user inputting adjustment information for the third target expression image in the at least one expression image displayed.
[0129] In some embodiments, the display module 530 is configured to display at least one candidate adjustment item, and the adjustment module 560 is configured to adjust the fourth target expression image according to the target adjustment item in response to the user applying a target adjustment item from at least one candidate adjustment item to a fourth target expression image in the at least one expression image displayed.
[0130] In some embodiments, the generation module 520 is configured to generate at least one expression image based on the interaction information, the base image and the image of the interaction object, wherein the image of the interaction object is an image of an authorized application of the interaction object and the image of the interaction object is an image including a face.
[0131] In some embodiments, the generation module 520 is configured to extract the image of the first character in the base image and the image of the second character in the image of the interactive object; adjust the image of the first character and the image of the second character according to the interaction information to obtain at least one adjusted image of the first character and at least one adjusted image of the second character; generate at least one background image according to at least one of the interaction information, the background image in the base image, and the background image in the image of the interactive object; generate at least one expression image according to at least one adjusted image of the first character, at least one adjusted image of the second character, and at least one background image.
[0132] In some embodiments, the display module 530 is configured to display at least one emoticon image in the emoticon recommendation area, and in response to a user's selection operation on any emoticon image among the at least one emoticon image, display the selected emoticon image in a preview form.
[0133] In some embodiments, the base image is a user's avatar, or the base image is an image selected by the user from a plurality of authorized candidate images that have been uploaded.
[0134] In some embodiments, when at least one expression image is a plurality of expression images, at least one of facial expressions, facial angles, body movements, body angles, background images, and beautification materials in the plurality of expression images is different.
[0135] In some embodiments, at least one expression image includes text corresponding to the interaction information, and the interaction information is text or voice.
[0136] It should be noted that the above-mentioned units (modules) are only logical modules divided according to the specific functions they implement, and are not used to limit the specific implementation methods. For example, they can be implemented in software, hardware, or a combination of software and hardware. In actual implementation, the above-mentioned units can be implemented as independent physical entities, or can also be implemented by a single entity (for example, a processor (CPU or DSP, etc.), an integrated circuit, etc.). In addition, the above-mentioned units are shown with dotted lines in the drawings to indicate that these units may not actually exist, and the operations / functions they implement can be implemented by the processing circuit itself.
[0137] In addition, although not shown, the device may also include a memory, which may store various information generated by the device, various units contained in the device during operation, programs and data for operation, data to be sent by the communication unit, etc. The memory may be a volatile memory and / or a non-volatile memory. For example, the memory may include, but is not limited to, a random access memory (RAM), a dynamic random access memory (DRAM), a static random access memory (SRAM), a read-only memory (ROM), and a flash memory. Of course, the memory may also be located outside the device. Optionally, although not shown, the device may also include a communication unit, which may be used to communicate with other devices. In one example, the communication unit may be implemented in a suitable manner known in the art, such as including communication components such as an antenna array and / or a radio frequency link, various types of interfaces, communication units, etc. It will not be described in detail here. In addition, the device may also include other components not shown, such as a radio frequency link, a baseband processing unit, a network interface, a processor, a controller, etc. It will not be described in detail here.
[0138] Some embodiments of the present disclosure also provide an electronic device. Figure 6 Block diagrams of some embodiments of the electronic device of the present disclosure are shown. For example, in some embodiments, the electronic device 60 can be various types of devices, for example, can include but are not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. For example, the electronic device 60 can include a display panel for displaying data and / or execution results used in the scheme of the present disclosure. For example, the display panel can be in various shapes, such as a rectangular panel, an elliptical panel, or a polygonal panel, etc. In addition, the display panel can be not only a flat panel, but also a curved panel, or even a spherical panel.
[0139] like Figure 6 As shown, the electronic device 60 of this embodiment includes: a memory 61 and a processor 62 coupled to the memory 61. It should be noted that Figure 6 The components of the electronic device 60 shown are only exemplary and non-limiting. The electronic device 60 may also have other components according to actual application requirements. The processor 62 may control other components in the electronic device 60 to perform desired functions.
[0140] In some embodiments, the memory 61 is used to store one or more computer-readable instructions. When the processor 62 is used to execute the computer-readable instructions, the computer-readable instructions are executed by the processor 62 to implement the method according to any of the above embodiments. For the specific implementation of each step of the method and the related explanation content, please refer to the above embodiments, and the repetition will not be repeated here.
[0141] For example, the processor 62 and the memory 61 may communicate with each other directly or indirectly. For example, the processor 62 and the memory 61 may communicate with each other through a network. The network may include a wireless network, a wired network, and / or any combination of a wireless network and a wired network. The processor 62 and the memory 61 may also communicate with each other through a system bus, which is not limited by the present disclosure.
[0142] For example, the processor 62 may be embodied as various appropriate processors, processing devices, etc., such as a central processing unit (CPU), a graphics processing unit (GPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The central processing unit (CPU) may be an X86 or ARM architecture, etc. For example, the memory 61 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The memory 61 may include, for example, a system memory, which may store, for example, an operating system, an application, a boot loader (Boot Loader), a database, and other programs. Various applications and various data may also be stored in the storage medium.
[0143] In addition, according to some embodiments of the present disclosure, various operations / processes according to the present disclosure, when implemented by software and / or firmware, can be transmitted from a storage medium or a network to a computer system having a dedicated hardware structure, such as Figure 7The computer system (or electronic device) 70 shown is installed with the programs constituting the software, and when the various programs are installed, the computer system can execute various functions, including the functions described above and the like. Figure 7 is a block diagram illustrating an example structure of a computer system that can be employed in an embodiment according to the present disclosure.
[0144] exist Figure 7 In the embodiment, the central processing unit (CPU) 701 performs various processes according to the program stored in the read-only memory (ROM) 702 or the program loaded from the storage part 708 to the random access memory (RAM) 703. In the RAM 703, data required when the CPU 701 performs various processes, etc. are also stored as needed. The central processing unit is only exemplary, and it can also be other types of processors, such as the various processors mentioned above. The ROM 702, RAM 703 and the storage part 708 can be various forms of computer-readable storage media, as described below. It should be noted that although Figure 7 ROM 702, RAM 703 and storage device 708 are shown separately in FIG. 7 , but one or more of them may be combined or located in the same or different memory or storage modules.
[0145] The CPU 701, the ROM 702, and the RAM 703 are connected to one another via a bus 704. An input / output interface 705 is also connected to the bus 704.
[0146] The following components are connected to the input / output interface 705: an input portion 706, such as a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output portion 707, including a display, such as a cathode ray tube (CRT), a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage portion 708, including a hard disk, a magnetic tape, etc.; and a communication portion 709, including a network interface card such as a LAN card, a modem, etc. The communication portion 709 allows communication processing to be performed via a network such as the Internet. It is easy to understand that although Figure 7 The various devices or modules in the computer system 70 are shown to communicate via a bus 704, but they may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of wireless networks and wired networks.
[0147] A drive 710 is also connected to the input / output interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like is mounted on the drive 710 as needed so that a computer program read therefrom is installed into the storage section 708 as needed.
[0148] In the case where the above-described series of processing is implemented by software, a program constituting the software can be installed from a network such as the Internet or a storage medium such as the removable medium 711 .
[0149] According to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 709, or installed from a storage device 708, or installed from a ROM 702. When the computer program is executed by the CPU 701, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0150] It should be noted that in the context of the present disclosure, a computer-readable medium may be a tangible medium that may contain or store a program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. A computer-readable storage medium may be, for example, but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that may be used by an instruction execution system, device or device or used in combination with it. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0151] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0152] In some embodiments, a computer program is further provided, comprising: instructions, which, when executed by a processor, cause the processor to execute any of the methods in the above embodiments. For example, the instructions may be embodied as computer program codes.
[0153] In embodiments of the present disclosure, computer program codes for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In situations involving a remote computer, the remote computer may be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet).
[0154] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0155] The modules, components or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the names of the modules, components or units do not, in some cases, limit the modules, components or units themselves.
[0156] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0157] According to some embodiments of the present disclosure, an interaction processing method is provided, including: displaying an interaction interface between a user and an interaction object; in response to a user inputting interaction information in an input area of the interaction interface, generating at least one expression image based on the interaction information and a basic image, wherein the basic image is an image authorized for application by the user, and the basic image is an image including a face; displaying at least one expression image; and in response to a user confirming a first target expression image in at least one expression image, sending the first target expression image to the interaction object.
[0158] In some embodiments, generating at least one expression image based on the interaction information and the basic image includes: performing sentiment analysis on the interaction information to determine the sentiment information corresponding to the interaction information; and generating at least one expression image based on the sentiment information and the basic image.
[0159] In some embodiments, performing sentiment analysis on the interaction information to determine the sentiment information corresponding to the interaction information includes: performing sentiment analysis based on the interaction information and interaction records before the interaction information to determine the sentiment information corresponding to the interaction information.
[0160] In some embodiments, generating at least one expression image based on emotional information and a base image includes: identifying a face in the base image; adjusting at least one of the expression and angle of the face based on the emotional information to generate an image of the face in at least one expression image.
[0161] In some embodiments, generating at least one expression image based on emotional information and a basic image includes: identifying a limb in the basic image; and adjusting at least one of the movement and angle of the limb based on the emotional information to generate an image of the limb in at least one expression image.
[0162] In some embodiments, generating at least one expression image based on the emotion information and the base image includes at least one of the following: generating a background image in at least one expression image based on the emotion information; generating beautification material added to at least one expression image based on the emotion information.
[0163] In some embodiments, generating at least one expression image according to the interaction information and the basic image includes: determining environmental feature information according to the interaction information; and generating a background image in the at least one expression image according to the environmental feature information.
[0164] In some embodiments, determining the environmental characteristic information according to the interaction information includes: determining the environmental characteristic information according to the interaction information and the interaction record before the interaction information.
[0165] In some embodiments, the interaction processing method further includes: in response to a user's update operation on a second target expression image in the at least one displayed expression image, updating the second target expression image according to the interaction information and the basic image.
[0166] In some embodiments, the interaction processing method further includes: in response to a user inputting adjustment information for a third target expression image in the at least one expression image displayed, adjusting the third target expression image according to the adjustment information.
[0167] In some embodiments, the interactive processing method also includes: displaying at least one candidate adjustment item, wherein different candidate adjustment items correspond to different adjustment information; in response to the user applying a target adjustment item from at least one candidate adjustment item to a fourth target expression image in the at least one expression image displayed, adjusting the fourth target expression image according to the target adjustment item.
[0168] In some embodiments, generating at least one expression image based on the interaction information and the base image includes: generating at least one expression image based on the interaction information, the base image and the image of the interaction object, wherein the image of the interaction object is an image of an authorized application of the interaction object, and the image of the interaction object is an image including a face.
[0169] In some embodiments, generating at least one expression image based on interaction information, a base image, and an image of an interaction object includes: extracting an image of a first character in the base image and an image of a second character in the image of an interaction object; adjusting the image of the first character and the image of the second character based on the interaction information to obtain at least one adjusted image of the first character and at least one adjusted image of the second character; generating at least one background image based on at least one of the interaction information, a background image in the base image, and a background image in the image of an interaction object; generating at least one expression image based on at least one adjusted image of the first character, at least one adjusted image of the second character, and at least one background image.
[0170] In some embodiments, displaying at least one emoticon image includes displaying at least one emoticon image in an emoticon recommendation area, and the interaction processing method also includes: in response to a user's selection operation of any emoticon image among the at least one emoticon image, displaying the selected emoticon image in a preview form.
[0171] In some embodiments, the base image is a user's avatar, or the base image is an image selected by the user from a plurality of authorized candidate images that have been uploaded.
[0172] In some embodiments, when at least one expression image is a plurality of expression images, at least one of facial expressions, facial angles, body movements, body angles, background images, and beautification materials in the plurality of expression images is different.
[0173] In some embodiments, at least one expression image includes text corresponding to the interaction information, and the interaction information is text or voice.
[0174] According to some other embodiments of the present disclosure, an interaction processing device is provided, comprising: a first display module, configured to display an interaction interface between a user and an interaction object; a generation module, configured to generate at least one expression image in response to a user inputting interaction information in an input area of the interaction interface, according to the interaction information and a basic image, wherein the basic image is an image authorized for application by the user, and the basic image is an image containing a face; a second display module, configured to display at least one expression image; and a sending module, configured to send a target expression image to the interaction object in response to a user confirming an operation on a target expression image in at least one expression image.
[0175] According to some further embodiments of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory coupled to the processor, for storing instructions, which, when executed by the processor, causes the processor to execute the interactive processing method of any embodiment of the present disclosure.
[0176] According to some further embodiments of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the interactive processing method of any embodiment of the present disclosure is performed.
[0177] According to some further embodiments of the present disclosure, a computer program product is provided, comprising: instructions, which, when executed by a processor, implement the interactive processing method of any embodiment of the present disclosure.
[0178] According to some further embodiments of the present disclosure, a computer program is provided, comprising: instructions, which implement the interactive processing method of any embodiment of the present disclosure when the instructions are executed by a processor.
[0179] The above descriptions are only some embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, a technical solution formed by replacing the above features with the technical features with similar functions disclosed in the present disclosure (but not limited to).
[0180] In the description provided herein, many specific details are set forth. However, it is understood that embodiments of the present invention can be implemented without these specific details. In other cases, well-known methods, structures, and techniques are not presented in detail in order not to obscure the understanding of the description.
[0181] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0182] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.
Claims
1. An interactive processing method, include: Display the interactive interface between the user and the interactive object; In response to the user inputting interaction information in the input area of the interaction interface, generating at least one expression image according to the interaction information and a basic image, wherein the basic image is an image authorized to be applied by the user and the basic image is an image including a face; displaying the at least one expression image; In response to the user's confirmation operation on a first target expression image in the at least one expression image, the first target expression image is sent to the interactive object.
2. The interactive processing method according to claim 1, in, The generating at least one expression image according to the interaction information and the basic image comprises: Performing sentiment analysis on the interaction information to determine sentiment information corresponding to the interaction information; Generate at least one expression image based on the emotion information and the basic image.
3. The interactive processing method according to claim 2, in, The performing sentiment analysis on the interaction information to determine the sentiment information corresponding to the interaction information comprises: Perform sentiment analysis based on the interaction information and interaction records before the interaction information to determine sentiment information corresponding to the interaction information.
4. The interactive processing method according to claim 2 or 3, in, The generating the at least one expression image according to the emotion information and the basic image comprises: recognizing a face in the base image; At least one of the facial expression and angle is adjusted according to the emotional information to generate an image of the face in the at least one expression image.
5. The interactive processing method according to any one of claims 2 to 4, in, The generating the at least one expression image according to the emotion information and the basic image comprises: identifying a limb in the base image; At least one of the movement and angle of the limb is adjusted according to the emotional information to generate an image of the limb in the at least one expression image.
6. The interactive processing method according to any one of claims 2 to 5, in, The generating of the at least one expression image according to the emotion information and the basic image comprises at least one of the following: generating a background image in the at least one expression image according to the emotion information; Beautification material added to the at least one expression image is generated according to the emotion information.
7. The interactive processing method according to any one of claims 1 to 5, in, The generating at least one expression image according to the interaction information and the basic image comprises: Determining environmental feature information according to the interactive information; A background image in the at least one expression image is generated according to the environmental feature information.
8. The interactive processing method according to claim 7, in, The determining of the environmental characteristic information according to the interaction information includes: Environmental feature information is determined according to the interaction information and interaction records before the interaction information.
9. The interactive processing method according to any one of claims 1 to 8, further comprising: include: In response to the user's update operation on a second target expression image in the at least one expression image displayed, the second target expression image is updated according to the interaction information and the basic image.
10. The interactive processing method according to any one of claims 1 to 9, further comprising: include: In response to the user inputting adjustment information for a third target expression image in the at least one expression image, the third target expression image is adjusted according to the adjustment information.
11. The interactive processing method according to any one of claims 1 to 10, further comprising: include: displaying at least one candidate adjustment item, wherein different candidate adjustment items correspond to different adjustment information; In response to the user applying a target adjustment item from among the at least one candidate adjustment item to a fourth target expression image in the at least one expression image, the fourth target expression image is adjusted according to the target adjustment item.
12. The interactive processing method according to any one of claims 1 to 11, in, The generating at least one expression image according to the interaction information and the basic image comprises: At least one expression image is generated according to the interaction information, the basic image and the image of the interaction object, wherein the image of the interaction object is an image of an authorized application of the interaction object, and the image of the interaction object is an image including a face.
13. The interactive processing method according to claim 12, in, The generating at least one expression image according to the interaction information, the basic image and the image of the interaction object comprises: Extracting an image of a first person in the base image and an image of a second person in the image of the interactive object; According to the interaction information, the image of the first person and the image of the second person are adjusted to obtain at least one adjusted image of the first person and at least one adjusted image of the second person; generating at least one background image according to at least one of the interaction information, the background image in the base image, and the background image in the image of the interaction object; The at least one expression image is generated according to at least one adjusted image of the first character, at least one adjusted image of the second character, and the at least one background image.
14. The interactive processing method according to any one of claims 1 to 13, in, The displaying of the at least one expression image includes displaying the at least one expression image in an expression recommendation area, and the interaction processing method further includes: In response to the user's selection operation on any expression image among the at least one expression image, the selected expression image is displayed in a preview form.
15. The interactive processing method according to any one of claims 1 to 14, in, The basic image is the user's avatar, or the basic image is an image selected by the user from a plurality of authorized candidate images that have been uploaded.
16. The interactive processing method according to any one of claims 1 to 15, in, When the at least one expression image is a plurality of expression images, at least one of facial expressions, facial angles, body movements, body angles, background images, and beautification materials in the plurality of expression images is different.
17. The interactive processing method according to any one of claims 1 to 16, in, The at least one expression image includes text corresponding to the interaction information, and the interaction information is text or voice.
18. An interactive processing device, include: A first display module is configured to display an interaction interface between a user and an interaction object; A generating module, configured to generate at least one expression image in response to the user inputting interaction information in the input area of the interaction interface, according to the interaction information and a basic image, wherein the basic image is an image authorized by the user to apply, and the basic image is an image including a face; A second display module, configured to display the at least one expression image; The sending module is configured to send the target expression image to the interactive object in response to the user's confirmation operation on the target expression image in the at least one expression image.
19. An electronic device, include: processor; as well as A memory coupled to the processor, for storing instructions, wherein when the instructions are executed by the processor, the processor executes the interactive processing method according to any one of claims 1 to 17.
20. A computer-readable storage medium having a computer program stored thereon, in, When the program is executed by a processor, the interactive processing method described in any one of claims 1 to 17 is implemented.
21. A computer program product, include: An instruction, which, when executed by a processor, implements the interactive processing method described in any one of claims 1 to 17.
22. A computer program, include: An instruction, which, when executed by a processor, implements the interactive processing method described in any one of claims 1 to 17.
Citation Information
Cited By
Interaction method and device based on intelligent agent, intelligent agent and electronic equipment
CN121434452A
