Image processing method, device and computer-readable storage medium
By displaying expression interaction animations between session members in an instant messaging client, the problem of rigid expression modes in the prior art is solved, and more interesting and diverse image processing is achieved, and users' emotional expression ability is enhanced.
Patent Information
- Application Number
- CN202110558940.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-05-21
- Publication Date
- 2025-08-29
- Estimated Expiration
- 2041-05-21
AI Technical Summary
In existing mobile instant communication technology, the expression expression methods are rigid, the user's emotional expression ability is weak, and the diversity of image processing is poor.
In the session page of the instant messaging client, when the expressions sent by at least two session members meet the trigger conditions, the interactive animation between them is displayed, including identifying the expression type through the convolutional neural network and playing the corresponding interactive animation, and controlling the display level and time of the animation taking into account the correlation degree and friend relationship of the session members.
It improves the fun and diversity of instant messaging interactions, enhances the user's ability to express emotions, and greatly enriches the diversity of image processing.
Smart Images

Figure CN115373577B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to an image processing method, device, and computer-readable storage medium. Background Art
[0002] With the development of the Internet, instant messaging has become an indispensable way of online communication in people's lives. In recent years, mobile instant messaging technology has also emerged. This technology is based on instant messaging on various mobile communication devices (such as mobile phones).
[0003] In the prior art, mobile users can send emoticons during chats to add fun to the chat and enrich the user experience. Moreover, in order to enrich the expression dimension of emoticons, simple effects can be triggered according to the style of the emoticon after sending the emoticon.
[0004] During the research and practice of the prior art, the inventors of the present application found that the expression methods in the prior art are relatively rigid, the user's ability to express emotions is relatively weak, and the diversity of image processing is relatively poor. Summary of the Invention
[0005] The embodiments of the present application provide an image processing method, apparatus, and computer-readable storage medium, which can enhance the diversity of image processing.
[0006] To solve the above technical problems, the embodiments of the present application provide the following technical solutions:
[0007] An image processing method, comprising:
[0008] Displaying a session page of a target session in an instant messaging client, wherein the target session includes at least two session members;
[0009] When expressions sent by at least two conversation members meet a triggering condition of a first expression interaction animation, the first expression interaction animation is displayed on the conversation page. The first expression interaction animation includes an interaction animation between the expressions sent by the at least two conversation members.
[0010] An image processing device, comprising:
[0011] A display unit, configured to display a session page of a target session in an instant messaging client, wherein the target session includes at least two session members;
[0012] The first display unit is used to display the first expression interaction animation on the conversation page when the expressions sent by at least two conversation members meet the triggering condition of the first expression interaction animation, where the first expression interaction animation includes the interaction animation between the expressions sent by the at least two conversation members.
[0013] In some embodiments, the image processing apparatus further includes:
[0014] The second display unit is used to display the second expression interaction animation on the conversation page when the target expression sent by the new conversation member and the expression meet the triggering conditions of the second expression interaction animation, the second expression interaction animation including the interaction animation between the expressions sent by the at least two conversation members and the target expression, and the new conversation member is a conversation member in the target conversation who is not the at least two conversation members.
[0015] In some embodiments, the first display unit is used to:
[0016] When the expressions sent by at least two conversation members and the expression sending time meet the triggering condition of the first expression interaction animation, the first expression interaction animation is displayed on the conversation page.
[0017] In some embodiments, the second display unit is used to:
[0018] When the target expression sent by the new conversation member and the expression as well as the target expression sending time and the expression sending time meet the triggering conditions of the second expression interaction animation, the second expression interaction animation is displayed on the conversation page.
[0019] In some embodiments, the second display unit is further used to:
[0020] When the target expression sent by the new conversation member and the expression meet the triggering condition of the second expression interaction animation; and
[0021] When it is detected that the first expression interaction animation is completed, the second expression interaction animation is displayed on the conversation page;
[0022] When it is detected that the first expression interaction animation has not been played completely, the second expression interaction animation is superimposed and displayed on the conversation page.
[0023] In some embodiments, the apparatus further comprises:
[0024] The first display unit is further configured to display the first expression interaction animation on the conversation page when expressions sent by at least two conversation members meet a triggering condition of the first expression interaction animation and when it is detected that the relationship between each pair of conversation members among the at least two conversation members is a friend relationship;
[0025] The prompt unit is used to display friend adding prompt information on the conversation page when the expressions sent by at least two conversation members meet the triggering condition of the first expression interaction animation and when it is detected that the relationship between at least two conversation members is not a friend relationship.
[0026] In some embodiments, the first display unit is used to:
[0027] When the expressions sent by at least two conversation members meet the triggering condition of the first expression interaction animation, the first expression interaction animation is played in full screen on the conversation page.
[0028] In some embodiments, the first display unit is used to:
[0029] When expressions sent by at least two conversation members meet a triggering condition of a first expression interaction animation, obtaining correlation values of the at least two conversation members;
[0030] Determining a target display level of the first expression interaction animation according to the correlation value;
[0031] A first expression interaction animation corresponding to the target display level is displayed on the conversation page.
[0032] In some embodiments, the first display unit is used to:
[0033] When expressions sent by at least two conversation members meet a triggering condition of a first expression interaction animation, obtaining correlation values of the at least two conversation members;
[0034] Determining a play time of the first expression interaction animation according to the correlation value;
[0035] The first expression interaction animation is displayed on the conversation page based on the playback time.
[0036] A computer-readable storage medium stores a plurality of instructions, wherein the instructions are suitable for being loaded by a processor to execute the steps in the above-mentioned image processing method.
[0037] A computer device comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor implements the steps of the above-mentioned image processing method when executing the computer program.
[0038] A computer program product or computer program includes computer instructions stored in a storage medium. A processor of a computer device reads the computer instructions from the storage medium and executes the computer instructions, causing the computer device to perform the steps of the image processing method provided above.
[0039] The embodiment of the present application displays a conversation page of a target conversation in an instant messaging client, the target conversation including at least two conversation members; and when expressions sent by the at least two conversation members meet a triggering condition for a first expression interaction animation, displays a first expression interaction animation on the conversation page. The first expression interaction animation includes an interaction animation between the expressions sent by the at least two conversation members. Thus, when the expressions sent by the at least two conversation members meet the triggering condition for the first expression interaction animation, the first expression interaction animation based on the interaction between the expressions sent by the at least two conversation members can be played in real time, thereby enhancing the fun and diversity of instant messaging interactions and greatly increasing the diversity of image processing. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0041] Figure 1 is a schematic diagram of a scenario of an image processing system provided by an embodiment of the present application;
[0042] Figure 2 Schematic diagram of the image processing method provided in the embodiment of the present application;
[0043] Figure 3 is another flowchart of the image processing method provided in an embodiment of the present application;
[0044] Figure 4a Schematic diagram of a scene of the image processing method provided in an embodiment of the present application;
[0045] Figure 4b is another scenario diagram of the image processing method provided in an embodiment of the present application;
[0046] Figure 4c is another scenario diagram of the image processing method provided in an embodiment of the present application;
[0047] Figure 4d is another scenario diagram of the image processing method provided in an embodiment of the present application;
[0048] Figure 5 is a structural diagram of an image processing device provided in an embodiment of the present application;
[0049] Figure 6 It is a schematic diagram of the structure of the terminal provided in an embodiment of the present application. DETAILED DESCRIPTION
[0050] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.
[0051] Embodiments of the present application provide an image processing method, apparatus, and computer-readable storage medium.
[0052] See also Figure 1 , Figure 1 The scene diagram of the image processing system provided in the embodiment of the present application includes: a terminal 11 and a server 20. The terminal 11 and the server 20 can be connected through a communication network. The communication network includes a wireless network and a wired network, wherein the wireless network includes a combination of one or more of a wireless wide area network, a wireless local area network, a wireless metropolitan area network, and a wireless personal network. The network includes network entities such as routers and gateways, which are not shown in the figure. The terminal 11 can exchange information with the server 20 through the communication network. For example, the terminal 11 synchronizes the emoticons sent by the user to the server 20, and the server 20 distributes them to the terminals 11 in the same chat environment, thereby realizing instant communication between different terminals 11.
[0053] The image processing system may include an image processing device, which may be integrated into a terminal having a storage unit and a microprocessor and having computing capabilities, such as a tablet computer, a mobile phone, a laptop computer, or a desktop computer. Figure 1 In the example, the terminal is Figure 1 Terminal 11 in the instant messaging client may be installed with various client applications required by the user, such as an instant messaging client. Terminal 11 may be used to display a session page of a target conversation in the instant messaging client, where the target conversation includes at least two conversation members. When expressions sent by at least two conversation members meet the triggering conditions of a first expression interaction animation, the first expression interaction animation, which includes the interaction animation between the expressions sent by the at least two conversation members, is displayed on the session page. It should be noted that there may be multiple terminals 11.
[0054] The image processing system may further include a server 20, which may be used to receive expressions sent by the terminal 11 and synchronize the expressions to the terminal 11 in the same chat environment.
[0055] It should be noted that Figure 1The scene diagram of the image processing system shown is only an example. The image processing system and scene described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided by the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the image processing system and the emergence of new business scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.
[0056] The following are detailed descriptions of each.
[0057] An embodiment of the present application provides an image processing method, which can be executed by a terminal or a server, or jointly by a terminal and a server; the embodiment of the present application takes the image processing method executed by a terminal as an example for explanation.
[0058] See also Figure 2 , Figure 2 : is a flow chart of an image processing method provided in an embodiment of the present application. The image processing method includes:
[0059] In step 101, a session page of a target session in an instant messaging client is displayed.
[0060] The instant messaging client is software that enables online chatting and communication through instant messaging technology. The target session can be understood as a chat room, a single-person session, or a multi-person session group. The single-person session is a session in the instant messaging client where a single session member speaks to a single session member, while the multi-person session group is a session group where multiple session members conduct simultaneous conversations. The session can be established in real time based on user needs. The target session includes at least two session members, each of whom can have a unique session identifier. The session page is the chat interface of the target session and can be composed of a public chat window component. Users can use this session page to conduct conversations with other session users, such as sending text, voice, images, emoticons, or videos.
[0061] In an embodiment of the present application, a session page of a target session in an instant messaging client may be displayed. The session page may display information sent by a local client and information sent by other session members in the target session. The information may be emoticons, which may be emoji images or user-defined emoticon images, which are not specifically limited here.
[0062] In step 102, when expressions sent by at least two conversation members meet a triggering condition of a first expression interaction animation, the first expression interaction animation is displayed on the conversation page.
[0063] In related technologies, conversation members can add fun to the chat and enrich the user experience by sending emoticons, but the emoticons can only perform simple actions. For example, a smiley face emoticon can only be used through a simple smile, and the expression and interaction effects are very poor.
[0064] In an embodiment of the present application, expression-triggered interactive effect logic can be added, that is, when the expressions sent by at least two conversation members meet the triggering conditions of the first expression interaction animation, the interactive effect logic can be triggered. The triggering conditions include that the expressions sent by at least two members are the same expressions and the association relationship between at least two sent expressions is a preset association relationship.
[0065] For example, when the expressions sent by at least two conversation members are the same love, the trigger condition can be met, and the first expression interaction animation between the same love is displayed on the conversation page.
[0066] In an embodiment of the present application, the first expression interaction animation includes the interaction animation sent by the at least two conversation members, that is, the first expression animation can be a first expression interaction animation for interaction between heart expressions. In one embodiment, the heart expressions can be dynamically moved together to collide and amplify, and then explode and scatter into multiple small hearts.
[0067] For another example, when at least two conversation members send the same beer emoticon, the trigger condition may be met, and the first expression interaction animation between the same beer emoticons may be displayed on the conversation page. The first expression interaction animation in this scenario may be the first expression interaction animation of clinking glasses between beer emoticons.
[0068] The preset association relationship can be an association table between expressions with association relationships. For example, the association relationship between the dog shit expression and the bomb expression or the association relationship between the smiley expression and the knocking expression can be recorded. When the dog shit expression and the bomb expression appear in at least two sent expressions respectively, it is determined that the association relationship between the at least two sent expressions is a preset association relationship. In this scenario, a first expression interaction animation can be generated in which a bomb flies to the dog shit expression and explodes, scattering into multiple dog shit expressions.
[0069] In some embodiments, the type of expression can be identified by using a convolutional neural network (CNN). The convolutional neural network can be constructed by imitating the visual perception mechanism of a living being, so that the convolutional neural network can be used to identify the type of expression sent by a conversation member.
[0070] In one embodiment, the first expression interaction animation can be stored in the terminal or in the server. When the expressions sent by at least two conversation members meet the triggering conditions of the first expression interaction animation, the first expression interaction animation stored on the terminal can be directly read for playback, or the server can be requested in real time to send the first expression interaction animation for playback.
[0071] In one embodiment, displaying the first expression interaction animation on the conversation page is to simultaneously display the first expression interaction animation on the conversation page of each conversation member of the target conversation, and the first expression interaction animation play command can be issued by the server at the same time, that is, the first expression interaction animation is simultaneously played on the conversation page of the target drawing of each instant messaging client of the target conversation.
[0072] It should be noted that there are many types of the first expression interaction animation depending on the combination of expressions. The above examples are not intended to be specific limitations. Moreover, since the first expression interaction animation can include interaction animations between expressions, it can better enhance the ability of interaction and emotional expression between users, greatly improving the diversity of image processing.
[0073] In some embodiments, the trigger condition may also include that the interval between emoticon sending times is within a preset time. When the emoticons sent by at least two session members meet the trigger condition of the first emoticon interaction animation, the step of displaying the first emoticon interaction animation on the session page may include: when the emoticons sent by at least two session members and the emoticon sending time meet the trigger condition of the first emoticon interaction animation, displaying the first emoticon interaction animation on the session page.
[0074] Since instant messaging is real-time, it can be stipulated that the interval between the expression sending times cannot exceed the preset time. The preset time can be set by the system, such as 60 seconds, 90 seconds, etc. Therefore, when the expressions sent by at least two members are the same expression and the association relationship between at least two sent expressions is the preset association relationship and the interval between the expression sending times does not exceed the preset time, the first expression interaction animation is displayed on the conversation page.
[0075] In some embodiments, before the step of displaying the first expression interaction animation on the conversation page, the method further includes:
[0076] (1) when it is detected that the relationship between each pair of conversation members among at least two conversation members is a friend relationship, executing displaying the first expression interaction animation on the conversation page;
[0077] (2) When it is detected that the relationship between at least two conversation members is not a friend relationship, a friend adding prompt message is displayed on the conversation page.
[0078] Among them, the friend relationship is that two conversation members add each other as communication friends in the instant messaging client. In order to increase the fun of instant messaging, when the expressions sent by at least two conversation members meet the triggering conditions of the first expression interaction animation, the relationship between each pair of conversation members among the at least two conversation members is continued to be detected to see whether they are friends.
[0079] If it is detected that each pair of at least two conversation members is a friend, it indicates that they are all friends and can engage in real-time, fun interaction. If it is detected that one pair of at least two conversation members is not a friend, it indicates that there is a stranger between them. In this case, the first expression interaction animation may not be displayed on the conversation page, and a friend addition prompt may be displayed on the conversation page to prompt conversation users who have not added each other as friends to add each other as friends.
[0080] In some embodiments, displaying the first expression interaction animation on the conversation page includes:
[0081] (1.1) Obtaining the association value of the at least two session members;
[0082] (1.2) determining a target display level of the first expression interaction animation according to the correlation value;
[0083] (1.3) Displaying a first expression interaction animation corresponding to the target display level on the conversation page.
[0084] Among them, the correlation value of the at least two conversation members can be obtained, and the correlation value can be an intimacy value. The intimacy can be determined by the number of chats, remark relationships and interactions between the conversation members. The larger the correlation value, the closer the relationship between the two, and the smaller the correlation value, the less intimate the relationship between the two.
[0085] Furthermore, the first expression interaction animation can be set to multiple display levels, for example, three display levels. Assume that the first display level has a higher priority than the second display level, and the second display level has a higher priority than the third display level. The higher the priority display level, the better the display effect of the first expression interaction animation, and the lower the priority display level, the worse the display effect of the first expression interaction animation. A correlation degree can be set for the corresponding interval for each display level, so that the interval corresponding to the higher priority display level is higher than the interval corresponding to the lower priority display level.
[0086] In this way, the target display level of the first expression interaction animation is determined according to the interval corresponding to the display level of the correlation value, and the first expression interaction animation corresponding to the target display level is displayed on the conversation page.
[0087] In some embodiments, displaying the first expression interaction animation on the conversation page includes:
[0088] (2.1) obtaining the association value of the at least two session members;
[0089] (2.2) determining the playback time of the first expression interaction animation according to the correlation value;
[0090] (2.3) Displaying the first expression interaction animation on the conversation page based on the playback time.
[0091] Among them, the correlation value of the at least two conversation members can be obtained, and the correlation value can be an intimacy value. The intimacy can be determined by the number of chats, remark relationships and interactions between the conversation members. The larger the correlation value, the closer the relationship between the two, and the smaller the correlation value, the less intimate the relationship between the two.
[0092] Furthermore, the playback time of the first expression interaction animation can be set to multiple time periods, for example, three playback times. Assume that the first playback time is greater than the second playback time, and the second playback time is greater than the third playback time. The longer the playback time, the better the display effect of the first expression interaction animation; the shorter the playback time, the worse the display effect of the first expression interaction animation. Thus, a correlation degree can be set for each playback time interval, with the corresponding interval for longer playback time being higher than the corresponding interval for shorter playback time.
[0093] In this way, the play time of the first expression interaction animation is determined according to the interval of the correlation value, and then the first expression interaction animation of a corresponding duration is displayed on the conversation page based on the play time.
[0094] In some embodiments, the method further includes: when the target expression sent by the new session member and the expression meet the triggering conditions of the second expression interaction animation, displaying the second expression interaction animation on the session page, and the second expression interaction animation includes the interaction animation between the expressions sent by the at least two session members and the target expression.
[0095] Among them, the new session member is a session member in the target session who is not the at least two session members, that is, the new session member can be a newly joined session member in the target session and a session member who has not currently sent a message. The triggering condition of the second expression interaction animation can be the interactive effect logic of multi-person interaction, at least including that the expressions sent by at least three members are the same expression and the association relationship between at least three sent expressions is the target association relationship.
[0096] For example, when at least three conversation members send the same expression of beer, the trigger condition may be met, and the first expression interaction animation between the three glasses of beer may be displayed on the conversation page.
[0097] In an embodiment of the present application, the second expression interaction animation includes the interaction animation sent by the at least three conversation members. The first expression interaction animation between the at least three beer expressions can be displayed on the conversation page. The second expression interaction animation in this scenario can be a second expression interaction animation of clinking glasses between the at least three beer expressions.
[0098] In some embodiments, when the target expression sent by the new session member and the expression meet the triggering conditions of the second expression interaction animation, the second expression interaction animation is displayed on the session page, including: when the target expression sent by the new session member and the expression and the target expression sending time and the expression sending time meet the triggering conditions of the second expression interaction animation, the second expression interaction animation is displayed on the session page.
[0099] Since instant messaging is real-time, it can be stipulated that the interval between the target expression and the time when the expression is sent cannot exceed a preset time. The preset time can be set by the system, such as 60 seconds, 90 seconds, etc. It should be noted that since there are at least two expressions, in the embodiment of the present application, the time interval between the target expression and the time when the last expression of the at least two expressions is sent is calculated.
[0100] Thus, when the target expression sent by the new conversation member and the expression as well as the target expression sending time and the expression sending time simultaneously meet the triggering conditions of the second expression interaction animation, the second expression interaction animation is displayed on the conversation page.
[0101] In one embodiment, displaying the second expression interaction animation on the conversation page includes:
[0102] (3.1) When it is detected that the first expression interaction animation is completed, the second expression interaction animation is displayed on the conversation page;
[0103] (3.2) When it is detected that the first expression interaction animation has not been played to completion, the second expression interaction animation is displayed superimposed on the conversation page.
[0104] Among them, since the previous first expression interaction animation may not be completed when the second expression interaction animation is displayed, before the second expression interaction animation is displayed on the conversation page, it can be detected whether the first expression interaction animation is completed.
[0105] When the first expression interaction animation is detected to be complete, the second expression interaction animation is directly displayed on the conversation page. If the first expression interaction animation is detected to be not complete, the second expression interaction animation can be directly displayed on the conversation page without waiting for the first expression interaction animation to play, achieving a simultaneous playback overlay effect and enriching the expression interaction effect.
[0106] As can be seen from the foregoing, the embodiments of the present application display a conversation page of a target conversation in an instant messaging client, the target conversation including at least two conversation members; and when expressions sent by the at least two conversation members satisfy a triggering condition for a first expression interaction animation, display a first expression interaction animation on the conversation page. The first expression interaction animation includes an interaction animation between the expressions sent by the at least two conversation members. Thus, when the expressions sent by the at least two conversation members satisfy the triggering condition for the first expression interaction animation, the first expression interaction animation based on the interaction between the expressions sent by the at least two conversation members can be played in real time, thereby enhancing the fun and diversity of instant messaging interactions and greatly increasing the diversity of image processing.
[0107] In combination with the method described in the above embodiment, the following examples are given to further illustrate the method in detail.
[0108] In this embodiment, the image processing device is specifically integrated into a server as an example for description, and the details are described below.
[0109] See also Figure 3 , Figure 3 This is another flowchart of the image processing method provided in an embodiment of the present application. The method may include:
[0110] In step 201, the terminal displays a session page of a target session in an instant messaging client.
[0111] Please also refer to Figure 4a As shown, the terminal 11 displays the conversation page of the target conversation in the instant messaging client, in which conversation members can realize conversation functions with other conversation users through the conversation page, such as sending text, voice, image, emoticon or video and so on.
[0112] For example, Figure 4a The first conversation user 11 and the second conversation user 12 are included. The first conversation user can be a conversation user in an instant messaging client on a terminal. An emoticon input panel can be displayed in the conversation page. The emoticon input panel includes multiple emoticons, such as a love emoticon. The user can touch the love emoticon. In response to the touch operation of selecting the love emoticon from the multiple emoticons, the love emoticon is displayed in the message editing box.
[0113] The response stated in the embodiments of the present application is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed may be in real time or have a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations executed are executed.
[0114] In step 202, when the terminal detects that expressions sent by at least two conversation members and the expression sending time meet the triggering condition of the first expression interaction animation.
[0115] Please also refer to Figure 4b As shown, the first conversation user 11 can touch the send control 12, and the terminal 10 responds to the touch operation of the send control 12 and displays the heart emoticon displayed in the message editing box on the conversation page. At this time, the terminal 10 detects that the emoticons sent by the two conversation members are the same heart and the time interval between the two emoticons is within 10 seconds. When it is determined that the terminal detects that the emoticons sent by at least two conversation members and the emoticon sending time meets the triggering condition of the first emoticon interactive animation, step 203 is executed.
[0116] For example, please also refer to Figure 4c and Figure 4d As shown, an emoticon input panel can be displayed on the conversation page. The emoticon input panel includes multiple emoticons, such as a bomb emoticon. A user can touch the dog shit emoticon. In response to the touch operation of selecting the bomb emoticon from the multiple emoticons, the bomb emoticon is displayed in the message editing box. The first conversation user 11 can touch the send control 12. In response to the touch operation of the send control 12, the terminal 10 displays the bomb emoticon displayed in the message editing box on the conversation page. At this time, the terminal 10 detects that the emoticons sent by two conversation members are the dog shit emoticon and the bomb emoticon, respectively, and that the time interval between the two emoticons is within 8 seconds. If the terminal detects that the emoticons sent by at least two conversation members and the time interval between the emoticons are satisfied, the triggering condition of the first emoticon interaction animation is met, and step 203 is executed.
[0117] In step 203, the terminal detects whether the relationship between each pair of at least two conversation members is a friend relationship.
[0118] Among them, the friend relationship is that two conversation members add each other as communication friends in the instant messaging client. In order to increase the fun of instant messaging, when the expressions sent by at least two conversation members meet the triggering conditions of the first expression interaction animation, the terminal continues to detect whether the relationship between each pair of conversation members among the at least two conversation members is a friend relationship.
[0119] When the terminal detects that the relationship between each pair of at least two session members is not a friend relationship, step 204 is executed; when the terminal detects that the relationship between each pair of at least two session members is a friend relationship, step 205 is executed.
[0120] In step 204, the terminal displays a friend adding prompt message on the conversation page.
[0121] Among them, when it is detected that the relationship between one pair of conversation members among at least two conversation members is not a friend relationship, it means that there is a stranger among them. At this time, the first expression interaction animation may not be displayed on the conversation page, and a friend adding prompt message may be displayed on the conversation page, for example, "The second conversation member is not your friend, please add him / her" is displayed to prompt conversation users who have not added each other as friends to add each other as friends.
[0122] In step 205, the terminal plays the first expression interaction animation in full screen on the conversation page.
[0123] When it is detected that the relationship between each pair of conversation members among at least two conversation members is a friend relationship, it means that they are all friends with each other and can have real-time fun interaction. The terminal can directly play the first expression interaction animation in full screen on the conversation page, that is, the first expression interaction animation can be displayed in the full-screen area such as the chat interface, information input box, and message bubble.
[0124] The first expression interaction animation includes an interaction animation between expressions sent by the at least two conversation members, and the first expression interaction animation has multiple types, for example, please continue to refer to Figure 4b As shown, when the expressions of the first conversation member 11 and the second conversation member 12 are both heart expressions, the heart expressions can be dynamically moved together to collide and amplify, and then explode and scatter into multiple small hearts for the first expression interaction animation 13 to be played. For example, please continue to refer to Figure 4d As shown, when the second conversation member 12 sends a dog shit expression and the first conversation member 11 sends a bomb expression, a second expression interaction animation 14 can be generated in which a bomb flies to the dog shit expression and explodes, and scatters into multiple dog shit expressions for playback.
[0125] It should be noted that, based on the relationship between expressions, the first expression interaction animation can also be performed between other expressions, and the examples given here are not intended to be a specific limitation.
[0126] In step 206, when the terminal detects that the target expression and expression sent by the new conversation member, as well as the target expression sending time and the expression sending time, meet the triggering condition of the second expression interaction animation.
[0127] Among them, the new session member is a session member in the target session that is not the at least two session members, that is, the new session member can be a newly joined session member in the target session and a session member who has not currently sent a message, that is, a member who is not the first session member 11 and the second session member 12 in the target session. The triggering condition of the second expression interaction animation can be the interactive effect logic of multi-person interaction, at least including that the expressions sent by at least three members are the same expression and the association relationship between the at least three sent expressions is the target association relationship.
[0128] For example, when the emoticon sent between the first session member 11 and the second session member 12 is a beer emoticon, the target emoticon sent by the new session member is also a beer emoticon, and the time interval between the time when the first session member 11 and the second session member 12 last sent the beer emoticon and the time when the new session member sends the target emoticon is 11 seconds, which is less than the preset time of 90 seconds, it is determined that the terminal detects that the target emoticon and the emoticon sent by the new session member, as well as the target emoticon sending time and the emoticon sending time, meet the triggering conditions of the second emoticon interaction animation, and step 207 is executed.
[0129] In step 207, the terminal detects whether the first expression interaction animation is played completely.
[0130] Among them, since the previous first expression interaction animation may not be completed when the second expression interaction animation is displayed, before the second expression interaction animation is displayed on the conversation page, it can be detected whether the first expression interaction animation is completed.
[0131] When the terminal detects that the first expression interaction animation is played, step 208 is executed. When the terminal detects that the first expression interaction animation is played, step 209 is executed.
[0132] In step 208, the terminal displays the second expression interaction animation on the conversation page.
[0133] When it is detected that the first expression interaction animation is finished playing, the second expression interaction animation is directly displayed on the conversation page. For example, the second expression interaction animation can be a second expression interaction animation of clinking glasses between three beer expressions.
[0134] In step 209, the terminal displays the second expression interaction animation superimposed on the conversation page.
[0135] Among them, when it is detected that the first expression interaction animation has not been played completely, the second expression interaction animation can be directly superimposed and displayed on the conversation page without waiting for the first expression interaction animation to be played, thereby achieving a superimposed effect of simultaneous playback and enriching the effect of expression interaction.
[0136] For example, if the first expression interaction animation is a first expression interaction animation of two beer emojis clinking glasses, and the second expression interaction animation is a second expression interaction animation of three beer emojis clinking glasses, the second expression interaction animation of three beer emojis clinking glasses can be superimposed on the first expression interaction animation of the two beer emojis clinking glasses to enhance the interactive atmosphere and further enhance the diversity of image processing.
[0137] As can be seen from the foregoing, the embodiments of the present application display a conversation page of a target conversation in an instant messaging client, the target conversation including at least two conversation members; and when expressions sent by the at least two conversation members satisfy a triggering condition for a first expression interaction animation, display a first expression interaction animation on the conversation page. The first expression interaction animation includes an interaction animation between the expressions sent by the at least two conversation members. Thus, when the expressions sent by the at least two conversation members satisfy the triggering condition for the first expression interaction animation, the first expression interaction animation based on the interaction between the expressions sent by the at least two conversation members can be played in real time, thereby enhancing the fun and diversity of instant messaging interactions and greatly increasing the diversity of image processing.
[0138] Furthermore, the embodiment of the present application can also continue to detect the relationship between the target expression and expression of the new conversation member under the premise of playing the first expression interaction animation to trigger the playback of the second interaction animation, thereby better improving the interaction effect and further enhancing the diversity of information processing.
[0139] To facilitate better implementation of the image processing method provided in the embodiment of the present application, the embodiment of the present application also provides a device based on the above image processing method. The meanings of the terms herein are the same as those in the above image processing method, and the specific implementation details can be referred to the description in the method embodiment.
[0140] See also Figure 5 , Figure 5 This is a structural diagram of an image processing device provided in an embodiment of the present application, wherein the image processing device may include a display unit 301 and a first display unit 302, etc.
[0141] A display unit 301 is configured to display a session page of a target session in an instant messaging client, where the target session includes at least two session members;
[0142] The first display unit 302 is configured to display a first expression interaction animation on the conversation page when expressions sent by at least two conversation members meet a triggering condition of the first expression interaction animation. The first expression interaction animation includes an interaction animation between the expressions sent by the at least two conversation members.
[0143] In some embodiments, the first display unit 302 is used to:
[0144] When the expressions sent by at least two conversation members and the expression sending time meet the triggering condition of the first expression interaction animation, the first expression interaction animation is displayed on the conversation page.
[0145] In some embodiments, the first display unit 302 is used to:
[0146] When the expressions sent by at least two conversation members meet the triggering condition of the first expression interaction animation, the first expression interaction animation is played in full screen on the conversation page.
[0147] In some embodiments, the first display unit 302 is used to:
[0148] When expressions sent by at least two conversation members meet a triggering condition of the first expression interaction animation, obtaining correlation values of the at least two conversation members;
[0149] Determining a target display level of the first expression interaction animation according to the correlation value;
[0150] The first expression interaction animation corresponding to the target display level is displayed on the conversation page.
[0151] In some embodiments, the first display unit 302 is used to:
[0152] When expressions sent by at least two conversation members meet a triggering condition of the first expression interaction animation, obtaining correlation values of the at least two conversation members;
[0153] Determining a play time of the first expression interaction animation according to the correlation value;
[0154] The first expression interaction animation is displayed on the conversation page based on the playback time.
[0155] In some embodiments, the image processing apparatus further includes:
[0156] The second display unit is used to display the second expression interaction animation on the conversation page when the target expression sent by the new conversation member and the expression meet the triggering conditions of the second expression interaction animation. The second expression interaction animation includes the interaction animation between the expressions sent by the at least two conversation members and the target expression. The new conversation member is a conversation member in the target conversation who is not the at least two conversation members.
[0157] In some embodiments, the second display unit is used to:
[0158] When the target expression sent by the new conversation member and the expression as well as the target expression sending time and the expression sending time meet the triggering conditions of the second expression interaction animation, the second expression interaction animation is displayed on the conversation page.
[0159] In some embodiments, the second display unit is further used to:
[0160] When the target expression sent by the new conversation member and the expression meet the triggering condition of the second expression interaction animation; and
[0161] When it is detected that the first expression interaction animation is completed, the second expression interaction animation is displayed on the conversation page;
[0162] When it is detected that the first expression interaction animation has not been played completely, the second expression interaction animation is superimposed and displayed on the conversation page.
[0163] In some embodiments, the apparatus further comprises:
[0164] The first display unit 302 is further configured to display the first expression interaction animation on the conversation page when expressions sent by at least two conversation members meet a triggering condition of the first expression interaction animation and when it is detected that the relationship between each pair of conversation members among the at least two conversation members is a friend relationship;
[0165] The prompt unit is used to display friend adding prompt information on the conversation page when the expressions sent by at least two conversation members meet the triggering condition of the first expression interaction animation and when it is detected that the relationship between at least two conversation members is not a friend relationship.
[0166] The specific implementation of each of the above units can be found in the previous embodiments and will not be described again here.
[0167] As can be seen from the above, in the embodiment of the present application, display unit 301 displays a conversation page of a target conversation in an instant messaging client, where the target conversation includes at least two conversation members. When expressions sent by at least two conversation members meet the triggering conditions of a first expression interaction animation, first display unit 302 displays a first expression interaction animation on the conversation page. The first expression interaction animation includes an interaction animation between the expressions sent by at least two conversation members. Thus, when the expressions sent by at least two conversation members meet the triggering conditions of the first expression interaction animation, the first expression interaction animation based on the interaction between the expressions sent by at least two conversation members can be played in real time, thereby enhancing the fun and diversity of instant messaging interactions and greatly increasing the diversity of image processing.
[0168] The embodiment of the present application also provides a computer device, which can be a server or a terminal. Figure 6 As shown, it shows a schematic diagram of the structure of the terminal involved in the embodiment of the present application, specifically:
[0169] The computer device may include components such as a radio frequency (RF) circuit 401, a memory 402 including one or more computer-readable storage media, an input unit 403, a display unit 404, a sensor 405, an audio circuit 406, a wireless fidelity (WiFi) module 407, a processor 408 including one or more processing cores, and a power supply 409. It will be understood by those skilled in the art that Figure 6 The terminal structure shown in the figure does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0170] The RF circuit 401 can be used to receive and send signals during information transmission or calls. In particular, after receiving downlink information from the base station, it is handed over to one or more processors 408 for processing; in addition, uplink data is sent to the base station. Generally, the RF circuit 401 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc. In addition, the RF circuit 401 can also communicate with the network and other devices through wireless communication. Wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.
[0171] The memory 402 can be used to store software programs and modules. The processor 408 executes various functional applications and image processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area may store data created according to the use of the terminal (such as audio data, a phone book, etc.). In addition, the memory 402 may include a high-speed random access memory and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 408 and the input unit 403 with access to the memory 402.
[0172] The input unit 403 can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and function control. Specifically, in one embodiment, the input unit 403 may include a touch-sensitive surface and other input devices. A touch-sensitive surface, also known as a touch display or touchpad, can detect user touch operations on or near it (for example, operations performed by a user using a finger, stylus, or any other suitable object or accessory on or near the touch-sensitive surface) and drive corresponding connected devices according to a pre-set program. Optionally, the touch-sensitive surface may include a touch detection device and a touch controller. The touch detection device detects the user's touch direction and detects signals generated by the touch operation, transmitting the signals to the touch controller. The touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 408. It can also receive and execute commands from the processor 408. In addition, touch-sensitive surfaces can be implemented using various types, such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface, the input unit 403 may also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.
[0173] The display unit 404 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 404 may include a display panel. Optionally, the display panel may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch-sensitive surface may cover the display panel. When the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 408 to determine the type of touch event. The processor 408 then provides corresponding visual output on the display panel according to the type of touch event. Although in Figure 6 In the embodiment, the touch-sensitive surface and the display panel are used as two independent components to realize input and output functions, but in some embodiments, the touch-sensitive surface and the display panel can be integrated to realize input and output functions.
[0174] The terminal may also include at least one sensor 405, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel according to the brightness of the ambient light, and the proximity sensor may turn off the display panel and / or backlight when the terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the terminal, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be described here.
[0175] Audio circuit 406, a speaker, and a microphone provide an audio interface between the user and the terminal. Audio circuit 406 converts received audio data into electrical signals and transmits them to the speaker, which then converts them into sound signals for output. Conversely, the microphone converts collected sound signals into electrical signals, which are then received by audio circuit 406 and converted into audio data. The audio data is then processed by processor 408 and transmitted via RF circuit 401 to, for example, another terminal. Alternatively, the audio data can be output to memory 402 for further processing. Audio circuit 406 may also include an earphone jack to allow communication between an external headset and the terminal.
[0176] WiFi is a short-range wireless transmission technology. The terminal can help users send and receive emails, browse web pages and access streaming media through the WiFi module 407. It provides users with wireless broadband Internet access. Figure 6 A WiFi module 407 is shown, but it is understandable that it is not an essential component of the terminal and can be omitted as needed without changing the essence of the invention.
[0177] Processor 408 is the terminal's control center, connecting all components of the phone using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 402 and accessing data stored in memory 402, it executes various terminal functions and processes data, thereby providing overall monitoring of the phone. Optionally, processor 408 may include one or more processing cores; preferably, processor 408 may integrate an application processor and a modem processor, with the application processor primarily handling the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 408.
[0178] The terminal also includes a power supply 409 (e.g., a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 408 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 409 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.
[0179] Although not shown, the terminal may also include a camera, a Bluetooth module, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 408 in the terminal will load the executable files corresponding to the processes of one or more applications into the memory 402 according to the following instructions, and the processor 408 will run the applications stored in the memory 402 to implement various functions:
[0180] A session page of a target session in an instant messaging client is displayed, where the target session includes at least two session members; when expressions sent by the at least two session members meet a triggering condition of a first expression interaction animation, the first expression interaction animation is displayed on the session page, where the first expression interaction animation includes an interaction animation between the expressions sent by the at least two session members.
[0181] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of the image processing method above and will not be repeated here.
[0182] As can be seen from the foregoing, a computer device according to an embodiment of the present application can display a conversation page of a target conversation in an instant messaging client, the target conversation including at least two conversation members; and when expressions sent by the at least two conversation members meet the triggering conditions of a first expression interaction animation, display a first expression interaction animation on the conversation page. The first expression interaction animation includes an interaction animation between the expressions sent by the at least two conversation members. Thus, when the expressions sent by the at least two conversation members meet the triggering conditions of the first expression interaction animation, the first expression interaction animation based on the interaction between the expressions sent by the at least two conversation members can be played in real time, thereby enhancing the fun and diversity of instant messaging interactions and greatly increasing the diversity of image processing.
[0183] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0184] To this end, an embodiment of the present application provides a computer-readable storage medium storing a plurality of instructions that can be loaded by a processor to execute the steps of any of the image processing methods provided in the embodiments of the present application. For example, the instructions can execute the following steps:
[0185] A session page of a target session in an instant messaging client is displayed, where the target session includes at least two session members; when expressions sent by the at least two session members meet a triggering condition of a first expression interaction animation, the first expression interaction animation is displayed on the session page, where the first expression interaction animation includes an interaction animation between the expressions sent by the at least two session members.
[0186] According to one aspect of the present application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations provided in the above embodiments.
[0187] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.
[0188] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0189] Since the instructions stored in the computer-readable storage medium can execute the steps in any image processing method provided in the embodiments of the present application, the beneficial effects that can be achieved by any image processing method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.
[0190] The above is a detailed introduction to an image processing method, device and computer-readable storage medium provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, based on the ideas of the present application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. An image processing method, characterized in that: The method comprises: Displaying a session page of a target session in an instant messaging client, wherein the target session includes at least two session members; When expressions sent by at least two conversation members meet a triggering condition of a first expression interaction animation, displaying the first expression interaction animation on the conversation page, where the first expression interaction animation includes an interaction animation between the expressions sent by the at least two conversation members; When the target expression sent by the new session member and the expressions sent by the at least two session members meet the triggering conditions of the second expression interaction animation, the second expression interaction animation is displayed on the session page, and the second expression interaction animation includes the interaction animation between the expressions sent by the at least two session members and the target expression. The new session member is a session member in the target session who is not the at least two session members.
2. The image processing method according to claim 1, wherein: When the expressions sent by at least two conversation members meet the triggering condition of the first expression interaction animation, displaying the first expression interaction animation on the conversation page includes: When the expressions sent by at least two conversation members and the expression sending time meet the triggering condition of the first expression interaction animation, the first expression interaction animation is displayed on the conversation page.
3. The image processing method according to claim 1, wherein: When the target expression sent by the new conversation member and the expressions sent by the at least two conversation members meet the triggering condition of the second expression interaction animation, displaying the second expression interaction animation on the conversation page includes: When the target expression sent by the new conversation member and the expressions sent by the at least two conversation members, as well as the target expression sending time and the expression sending time sent by the at least two conversation members meet the triggering conditions of the second expression interaction animation, the second expression interaction animation is displayed on the conversation page.
4. The image processing method according to claim 1, wherein: The displaying of the second expression interaction animation on the conversation page includes: When it is detected that the first expression interaction animation is completed, the second expression interaction animation is displayed on the conversation page; When it is detected that the first expression interaction animation has not been played completely, the second expression interaction animation is superimposed and displayed on the conversation page.
5. The image processing method according to claim 1, wherein: Before displaying the first expression interaction animation on the conversation page, the method further includes: When it is detected that the relationship between each pair of at least two conversation members is a friend relationship, performing displaying the first expression interaction animation on the conversation page; When it is detected that a pair of at least two conversation members have a relationship that is not a friend relationship, friend adding prompt information is displayed on the conversation page.
6. The image processing method according to claim 1, wherein: The displaying of the first expression interaction animation on the conversation page includes: The first expression interaction animation is played in full screen on the conversation page.
7. The image processing method according to claim 1, wherein: The displaying of the first expression interaction animation on the conversation page includes: Obtaining a correlation value of the at least two session members; Determining a target display level of the first expression interaction animation according to the correlation value; A first expression interaction animation corresponding to the target display level is displayed on the conversation page.
8. The image processing method according to claim 1, wherein: The displaying of the first expression interaction animation on the conversation page includes: Obtaining a correlation value of the at least two session members; Determining a play time of the first expression interaction animation according to the correlation value; The first expression interaction animation is displayed on the conversation page based on the playback time.
9. The image processing method according to claim 1, wherein: The triggering condition includes that the expressions sent by at least two members are the same expression, or the association relationship between at least two sent expressions is a preset association relationship.
10. An image processing device, characterized in that: include: A display unit, configured to display a session page of a target session in an instant messaging client, wherein the target session includes at least two session members; a first display unit, configured to display a first expression interaction animation on the conversation page when expressions sent by at least two conversation members meet a triggering condition of the first expression interaction animation, the first expression interaction animation including an interaction animation between the expressions sent by the at least two conversation members; When the target expression sent by the new session member and the expressions sent by the at least two session members meet the triggering conditions of the second expression interaction animation, the second expression interaction animation is displayed on the session page, and the second expression interaction animation includes the interaction animation between the expressions sent by the at least two session members and the target expression. The new session member is a session member in the target session who is not the at least two session members.
11. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the image processing method according to any one of claims 1 to 9.
12. A computer device, characterized in that: The image processing method comprises a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor implements the steps of the image processing method according to any one of claims 1 to 9 when executing the computer program.
13. A computer program product, characterized in that The method comprises computer instructions, wherein the computer instructions are stored in a storage medium, a processor of a computer device reads the computer instructions from the storage medium, and the processor executes the computer instructions, so that when the processor executes the computer program, the steps in the image processing method according to any one of claims 1 to 9 are implemented.
Citation Information
Patent Citations
Method and device for processing expression information in instant messaging process
CN104780093A
Message processing method and equipment
CN112035206A