Expression sending method and device, storage medium and computer program product

Abstract

The invention discloses an expression sending method and device, a storage medium and a computer program product, and relates to the technical field of network communication, the method comprises the following steps: obtaining expression data of a user, the expression data comprising a face image; emotion information of the user is recognized based on the expression data, candidate expressions matched with the emotion information in a preset target expression set are searched, and the emotion information comprises emotion labels; and if the plurality of candidate expressions exist, selecting at least one target expression from the plurality of candidate expressions, and sending the target expression. According to the method and the device, expressions meeting user willingness are efficiently screened and sent, and the interestingness of expression sending is improved.

Description

Technical Field

[0001] The present application relates to the field of network communication technology, and in particular to an expression sending method, device, storage medium and computer program product. Background Art

[0002] Currently, in the interaction of various communication data, the use of emoticons to exchange and transmit information is becoming more and more common. This method can not only quickly show the sender's current mood and emotions, but also enable the receiver to receive the sender's information vividly and vividly, which is conducive to showing the most authentic emotional expression of both parties in social interaction.

[0003] The existing method of sending emoticons mainly involves selecting emoticons that meet one's own expression intention from a large number of pre-acquired or downloaded emoticon packages and sending them. When sending emoticons, users need to first use their eyes to select and then manually click, which takes a lot of time to find emoticons that meet the user's wishes. In addition, due to the basic functions of emoticons, all emoticons can be directly listed, resulting in users having no desire to explore emoticons. In this way, the current method of sending emoticons is relatively simple, resulting in low interest in emoticon sending. Summary of the invention

[0004] The main purpose of the present application is to provide an emoticon sending method, device, storage medium and computer program product, aiming to solve the technical problem that the current emoticon sending method requires a lot of time to find emoticons that meet the user's wishes and has low interest.

[0005] To achieve the above object, the present application provides an expression sending method, the expression sending method comprising:

[0006] Acquire the user's expression data, wherein the expression data includes a face image;

[0007] Identifying the user's emotional information based on the expression data, and searching for a candidate expression matching the emotional information in a preset target expression set, wherein the emotional information includes an emotional label;

[0008] If there are multiple candidate expressions, at least one target expression is selected from the multiple candidate expressions, and the target expression is sent.

[0009] In one embodiment, the step of selecting at least one target expression from the plurality of candidate expressions comprises:

[0010] Outputting each candidate expression in a preset expression display area;

[0011] If an expression selection instruction is obtained, the candidate expression selected by the expression selection instruction is determined to be the target expression.

[0012] In one embodiment, the step of selecting at least one target expression from the plurality of candidate expressions comprises:

[0013] Obtain the historical sending times of each candidate expression, and determine the highest historical sending times among the historical sending times;

[0014] The candidate expression corresponding to the highest number of historical sending times is determined as the target expression.

[0015] In one embodiment, the step of selecting at least one target expression from the plurality of candidate expressions and sending the target expression comprises:

[0016] If the emotion information includes multiple emotion tags, for each emotion tag, selecting at least one target expression from candidate expressions corresponding to the emotion tag;

[0017] The target expressions are combined in sequence according to the change order of all the emotion tags to obtain a target expression animated image, and the target expression animated image is sent.

[0018] In one embodiment, after the step of sending the target expression, the method further includes:

[0019] Displaying the target expression in a preset content display area;

[0020] In response to an indication operation on the target expression, acquiring an emotion label corresponding to the target expression;

[0021] The emotion tag of the target expression is sent, and the emotion tag of the target expression is displayed within a preset range of the target expression.

[0022] In one embodiment, the method is applied to a server, and before the step of searching for a candidate expression matching the emotion information in a preset target expression set, the method further includes:

[0023] Get the user ID of the emoticon sender;

[0024] If there is a preset expression set whose set identifier is consistent with the user identifier among all preset expression sets, determining the preset expression set whose set identifier is consistent with the user identifier as the preset target expression set;

[0025] If there is no preset expression set whose set identifier is consistent with the user identifier in all preset expression sets, a new preset expression set is created, and the new preset expression set is determined as the preset target expression set, and the user identifier is determined as the set identifier of the new preset expression set.

[0026] In one embodiment, the step of creating a new preset expression set includes:

[0027] Acquire a local expression set from the expression sending end;

[0028] If the local expression set is successfully obtained, then determining that the local expression is a new preset expression set;

[0029] If the local expression set fails to be obtained, determining the preset default expression set as the new preset expression set;

[0030] The new preset expression set includes at least one expression subset, each of the expression subsets includes at least one expression, and the expressions in each of the expression subsets have the same emotion label.

[0031] In addition, to achieve the above-mentioned purpose, the present application also provides an expression sending device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the expression sending method as described above.

[0032] In addition, to achieve the above-mentioned purpose, the present application also provides a readable storage medium, which is a computer-readable storage medium, and a program for implementing the expression sending method is stored on the computer-readable storage medium. The program for implementing the expression sending method is executed by a processor to implement the steps of the expression sending method as described above.

[0033] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned expression sending method when executed by a processor.

[0034] One or more technical solutions proposed in this application have at least the following technical effects:

[0035] Acquire the user's expression data, wherein the expression data includes a face image; identify the user's emotional information based on the expression data, search for candidate expressions that match the emotional information in a preset target expression set, wherein the emotional information includes an emotional tag; if there are multiple candidate expressions, select at least one target expression from the multiple candidate expressions, and send the target expression. Therefore, compared with the expression sending method in which the user selects an expression that meets his or her expression intention from a large number of pre-acquired or downloaded expression packages, the embodiment of the present application identifies the user's emotional information based on the user's expression data, filters the target expression based on the user's emotional information, and sends the target expression. In this way, the target expression that matches the user's emotional information is intelligently filtered and sent, without the user spending a lot of time manually filtering, thereby achieving efficient filtering of expressions that meet the user's wishes and sending, and can automatically filter out target expressions that meet the user's emotions based on the user's emotional information and send them. Different target expressions can be sent for different user emotional information, thereby improving the fun of expression sending. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0037] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0038] Figure 1 This is a flow chart of the first embodiment of the expression sending method of the present application;

[0039] Figure 2 This is a schematic diagram of an expression set involved in an embodiment of an expression sending method of the present application;

[0040] Figure 3 This is a brief flowchart of the expression sending method of this application;

[0041] Figure 4 This is a flow chart of the second embodiment of the expression sending method of the present application;

[0042] Figure 5 Schematic diagram of the device structure of the hardware operating environment involved in the expression sending device in the embodiment of the present application.

[0043] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0044] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work belong to the scope of protection of the present invention.

[0045] At present, with the continuous development of social networking, watch, video and bracelet products are gradually increasing. In order to improve user stickiness, more and more emoticon functions are added to chat and social tool products.

[0046] Since the current emoticon packages are designed by humans, users selectively send emoticons based on the designed emoticon packages. This emoticon sending process is complicated and difficult to reflect the user's emotions. The expressions are inaccurate and slow, and it is impossible to achieve an accurate and appropriate state.

[0047] Based on this, the main solution of the present application is: obtaining the user's expression data, wherein the expression data includes a facial image; identifying the user's emotional information based on the expression data, and searching for candidate expressions that match the emotional information in a preset target expression set, wherein the emotional information includes an emotional label; if there are multiple candidate expressions, selecting at least one target expression from the multiple candidate expressions, and sending the target expression.

[0048] The present application identifies the user's emotional information based on the user's emotional information, filters the target expressions based on the user's emotional information, and sends the target expressions. In this way, the target expressions matching the user's emotional information are intelligently filtered and sent without the user having to spend a lot of time on manual filtering, thereby achieving efficient filtering and sending of expressions that meet the user's wishes, and can automatically filter out and send target expressions that match the user's emotions based on the user's emotional information. Different target expressions can be sent for different user emotional information, thereby increasing the fun of expression sending.

[0049] It should be noted that the execution subject of each embodiment of the expression sending method of the present application can be on the server side or on the user terminal side. Specifically, the server and the user terminal can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an expression sending device capable of realizing the above functions, such as a watch, a bracelet, etc. The embodiments of the expression sending method of the present application do not make specific restrictions on this.

[0050] Based on this, the present application proposes a method for sending emoticons in the first embodiment, please refer to Figure 1 The expression sending method includes steps S10 to S30:

[0051] Step S10, obtaining the user's expression data, wherein the expression data includes a face image;

[0052] In a preferred embodiment, the expression sending method is applied to the server side, so that the preset target expression set can be stored on the server side, and there is no need to store the preset target expression set locally on the user terminal, thereby reducing the occupancy of local storage resources of the user terminal, and even if the user terminal does not store expressions locally, expressions can be sent based on the expressions in the server side, thereby improving the universality of the expression sending method.

[0053] The expression data includes but is not limited to facial images, and may also include voice data input by the user, text data input by the user, and the like.

[0054] It should be noted that the expression data may include one or more frames of facial images, and this embodiment does not impose any specific limitation on this.

[0055] Furthermore, for acquiring a facial image, the camera of the user terminal may be turned on, the environmental image may be collected through the camera, and facial images meeting preset conditions may be screened from the collected environmental images. The preset conditions may be pre-set conditions, such as the environmental image containing a complete face and the image clarity being greater than or equal to a preset clarity threshold, so as to improve the accuracy and effectiveness of the subsequently recognized emotional information.

[0056] Step S20, identifying the user's emotional information based on the expression data, and searching for a candidate expression matching the emotional information in a preset target expression set, wherein the emotional information includes an emotional tag;

[0057] Identify the user's emotional information based on expression data. The emotional information is information that represents the user's emotions, including but not limited to emotional labels. Emotional labels include but are not limited to happiness, sadness, anger, surprise, fear, and disgust.

[0058] Specifically, the expression data can be input into a preset algorithm or a preset model, and the emotional information can be output. The preset algorithm can be an algorithm for recognizing emotions set in advance, such as RFB (Region-based Fully Convolutional Network) algorithm, VGG (Visual Geometry Group Network) algorithm, FER (Facial Expression Recognition) algorithm, etc., and this embodiment does not make specific restrictions on this. The preset model can be a model for recognizing emotions that has been trained in advance, such as a neural network model, a deep learning model, etc., and this embodiment does not make specific restrictions on this.

[0059] It should be noted that if the expression data includes multiple frames of facial images, the emotion label corresponding to each frame of facial image can be identified in turn, and the emotion label corresponding to each frame of facial image can be combined to obtain the emotion information.

[0060] Furthermore, if the emotion labels corresponding to consecutive frames of face images are the same, then only one emotion label can be retained. For example, the expression data includes 4 frames of face images, namely [face image 1, face image 2, face image 3 and face image 4]. The emotion label identified by face image 1 is surprise, the emotion label identified by face image 2 is happiness, the emotion label identified by face image 3 is happiness, and the emotion label identified by face image 4 is fear. Then face image 2 and face image 3 can retain only one emotion label of happiness, that is, the emotion information corresponding to these 4 frames of face images can be [surprise, happiness, fear].

[0061] After the emotion information is identified, candidate expressions matching the emotion information are screened in the preset target expression set. It should be noted that the preset target expression set includes at least one expression, and each expression can be a static image content, a continuous animation, or a short video, etc., which is not limited here.

[0062] Furthermore, each expression in the preset target expression set is associated with a corresponding emotion label, such as happiness, sadness, anger, surprise, fear and disgust, and each expression can be associated with one or more emotion labels. For example, assuming that each expression in the preset target expression set is associated with an emotion label, the preset target expression set can be as follows: Figure 2 The set shown includes multiple expressions. Specifically, the expressions with the emotion label of happiness are [expression 1_1, expression 1_2...expression 1_n], and the expressions with the emotion label of disgust are [expression p_1, expression p_2...expression p_r].

[0063] For the convenience of subsequent elaboration and explanation, the emotion label identified based on the expression data is referred to as the first emotion label (i.e., the emotion label in the emotion information), the emotion label of the expression is referred to as the second emotion label, and the candidate expression can be specifically an expression in the preset target expression set whose second emotion label is consistent with the first emotion label. For example, if the identified first emotion label is happy, and the expressions in the preset target expression set whose second emotion label is happy include [expression 1_1, expression 1_2...expression 1_n], then the candidate expressions include [expression 1_1, expression 1_2...expression 1_n].

[0064] It should be noted that if there are multiple first emotion labels, the candidate expressions may specifically be expressions whose second emotion labels are consistent with any first emotion label in the preset target expression set. For example, if the recognized first emotion labels are anger and shame, the expressions whose second emotion labels are anger in the preset target expression set include [expression 3_1, expression 3_2...expression 3_s], and the expressions whose second emotion labels are shame in the preset target expression set include [expression 7_1, expression 7_2...expression 7_t], then the candidate expressions include [expression 3_1, expression 3_2...expression 3_s], [expression 7_1, expression 7_2...expression 7_t].

[0065] Step S30: If there are multiple candidate expressions, select at least one target expression from the multiple candidate expressions, and send the target expression.

[0066] When there are multiple candidate expressions, at least one target expression is selected from the multiple candidate expressions. Specifically, at least one target expression may be selected randomly or based on a preset rule. This embodiment does not impose any specific restrictions on this.

[0067] As one implementation method, the preset rule is:

[0068] Step S301, outputting each candidate expression in a preset expression display area;

[0069] The preset expression display area may specifically be an area for displaying expressions set on a graphical interface of the user terminal.

[0070] Outputting each candidate expression in the preset expression display area may specifically be displaying each candidate expression in the preset expression display area for the user to select.

[0071] Step S302: If an expression selection instruction is obtained, determining that the candidate expression selected by the expression selection instruction is a target expression.

[0072] The expression selection instruction may be: performing a preset selection operation on the expression displayed in the preset expression display area. The preset selection operation may be clicking, long pressing, etc., which is not specifically limited in this embodiment.

[0073] The candidate expression selected by the expression selection instruction is determined as the target expression, that is, the candidate expression selected by the user is determined as the target expression.

[0074] By outputting each candidate expression in a preset expression display area, users can choose an expression that better suits their wishes to send. In this way, expressions that suit the user's emotions are displayed for the user to choose, rather than a fixed display of expression packages downloaded locally by the user's terminal for the user to choose. This reduces the user's screening range, allowing the user to more efficiently screen out expressions that suit their wishes.

[0075] As another implementation, the preset rule is:

[0076] Step S303, obtaining the historical sending times of each candidate expression, and determining the highest historical sending times among the historical sending times;

[0077] The historical sending times may specifically be the total number of times the candidate expression has been sent in history, and this embodiment does not impose any specific restrictions on this. For example, assuming that the server S and user terminal A, user terminal B and user terminal C, user terminal A has sent a candidate expression a total of 10 times in history, user terminal B has sent the candidate expression a total of 20 times in history, user terminal C has sent the candidate expression a total of 30 times in history, and the user terminal that currently needs to send an expression is user terminal A, then the historical sending times of the candidate expression is 10.

[0078] Step S304: determine the candidate expression corresponding to the highest number of historical sending times as the target expression.

[0079] The candidate expression corresponding to the highest number of historical sending times is selected as the target expression, that is, the most frequently sent candidate expression is selected as the target expression, so that the selected target expression conforms to the user's habits and realizes the personalized sending of the target expression.

[0080] If there is only one candidate expression, the candidate expression can be determined as the target expression and the target expression request is sent.

[0081] Furthermore, after sending the target expression, the expression package to which the target expression belongs can be determined, and the expression package can be displayed so that the user can choose whether to download or collect the expression package according to their own needs. It can be understood that an expression package can include one or more expressions, and correspondingly, each expression may belong to a certain expression package, and the expressions belonging to the same expression package have a certain correlation, such as reflecting the same theme content.

[0082] For example, in order to help understand the technical concept or technical principle of the expression sending method of this embodiment, a specific embodiment is first listed. In this specific embodiment, please refer to Figure 3 , the expression sending process is as follows:

[0083] 1. First, the user opens the camera in social software (such as WeChat, QQ, etc.) to shoot a video or take a photo of the face;

[0084] 2. Save the captured facial image to the system memory to obtain expression data;

[0085] 3. Use algorithm libraries such as RFB-320, VGG13 or FER2013 to perform sentiment analysis on the saved expression data;

[0086] 4. Determine the emotion type, i.e., the emotion label (such as happiness, sadness, anger, shock, fear, and disgust) based on the analysis results;

[0087] 5. Matching the expressions in the existing expression package database (i.e., the preset target expression set) through the emotion tag;

[0088] 6. After the match is completed, send the matching target expression and / or display the expression package to which the target expression belongs.

[0089] It should be noted that the above examples are only used to assist in understanding the present application and do not constitute a limitation on the expression sending method of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0090] In this embodiment, the user's expression data is obtained, wherein the expression data includes a face image; the user's emotional information is identified based on the expression data, and a candidate expression matching the emotional information in a preset target expression set is searched, wherein the emotional information includes an emotional tag; if there are multiple candidate expressions, at least one target expression is selected from the multiple candidate expressions, and the target expression is sent. Therefore, compared with the expression sending method in which the user selects an expression that meets his or her expression intention from a large number of pre-acquired or downloaded expression packages, the present embodiment identifies the user's emotional information based on the user's expression data, filters the target expression based on the user's emotional information, and sends the target expression. In this way, the target expression matching the user's emotional information is intelligently filtered and sent, without the user spending a lot of time manually filtering, thereby realizing efficient filtering of expressions that meet the user's intention and sending, and the target expression that meets the user's emotion can be automatically filtered out based on the user's emotional information and sent, and different target expressions can be sent for different user emotional information, thereby improving the fun of expression sending.

[0091] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 4 As shown, the step of selecting at least one target expression from a plurality of candidate expressions and sending the target expression comprises:

[0092] Step A10, if the emotion information includes multiple emotion tags, then for each emotion tag, at least one target expression is selected from candidate expressions corresponding to the emotion tag;

[0093] It should be noted that the candidate expressions corresponding to the emotion labels are specifically the emotion labels associated with the candidate expressions that are consistent with the emotion labels in the emotion information, that is, the second emotion labels associated with the candidate expressions are consistent with the first emotion labels. Exemplarily, assuming that the emotion labels included in the emotion information are anger and shame, the candidate expressions are [expression 3_1, expression 3_2...expression 3_s], [expression 7_1, expression 7_2...expression 7_t], the emotion label associated with [expression 3_1, expression 3_2...expression 3_s] is anger, and the emotion label associated with [expression 7_1, expression 7_2...expression 7_t] is shame, then the candidate expressions corresponding to the emotion label of anger are [expression 3_1, expression 3_2...expression 3_s], and the candidate expressions corresponding to the emotion label of shame are [expression 7_1, expression 7_2...expression 7_t].

[0094] If the emotional information includes multiple emotional labels, at least one target expression is selected from the candidate expressions corresponding to each emotional label. For example, assuming that the emotional information includes the emotional labels anger and shame, the candidate expressions corresponding to the emotional label anger are [expression 3_1, expression 3_2...expression 3_s], and the candidate expressions corresponding to the emotional label shame are [expression 7_1, expression 7_2...expression 7_t], then at least one target expression is selected from [expression 3_1, expression 3_2...expression 3_s], and at least one target expression is selected from [expression 7_1, expression 7_2...expression 7_t].

[0095] Furthermore, at least one target expression may be randomly selected from the candidate expressions corresponding to each emotion label, or at least one target expression may be selected from the candidate expressions corresponding to each emotion label based on a preset rule, and this embodiment does not impose any specific limitation on this.

[0096] If the emotion information includes only one emotion label, at least one target expression is selected from all candidate expressions.

[0097] Step A20, combining the target expressions in sequence according to the change order of all the emotion tags, obtaining a target expression animated image, and sending the target expression animated image.

[0098] The change order of the emotion labels can specifically be the order of the emotion labels. For example, when the expression data includes multiple frames of face images, the emotion label corresponding to each frame of the face image can be identified. The change order of the emotion labels is also the time sequence of the face images corresponding to the emotion labels. For example, the expression data includes 5 frames of face images arranged in time sequence [face image 1, face image 2, face image 3, face image 4, face image 5], the emotion label identified by face image 1 is surprise, the emotion labels identified by face image 2 and face image 3 are happiness, and the emotion label identified by face image 4 is anger. For example, when the expression data is voice data, the changing order of the emotion labels may be specifically the time sequence of the voice. For example, in a 5-second voice data, the emotion label recognized from the voice from 0 seconds to 1 second is surprise, the emotion label recognized from the voice from 1 second to 3 seconds is happiness, the emotion label recognized from the voice from 3 seconds to 4 seconds is anger, and the emotion label recognized from the voice from 4 seconds to 5 seconds is surprise. Then the changing order of the emotion labels is [surprise, happiness, anger, surprise].

[0099] According to the change order of the emotion labels, each target expression is combined in sequence to obtain the target expression animated picture. For example, assuming that there are emotion labels [surprise, happiness, anger, surprise] in the emotion information, and the selected target expressions are [target expression 1, target expression 2, target expression 3, target expression 4] in sequence, then target expression 1, target expression 2, target expression 3, target expression 4 are combined in sequence to obtain the target expression animated picture. In this way, based on the change of the user's emotion, the target expression animated picture that can reflect the change of the emotion is sent, which further improves the intelligence and fun of expression sending and improves the user experience.

[0100] Based on the first embodiment and / or the second embodiment of the present application, in the third embodiment of the present application, the same or similar contents as those in the first and second embodiments can be referred to the above description, and will not be described in detail later. On this basis, after the step of sending the target expression, the method further includes:

[0101] Step B10, displaying the target expression in a preset content display area;

[0102] The preset content display area is specifically an area set on the graphical interface of the user terminal for displaying sent emoticons. For example, in a chat application scenario, the preset content display area can specifically be a chat interface.

[0103] Step B20, in response to the instruction operation for the target expression, obtaining the emotion label corresponding to the target expression;

[0104] In actual applications, the sending time of the target expression and the current time can be determined, and then the difference between the sending time and the current time can be determined. When the difference is less than a preset threshold, the indication operation for the target expression can be responded to. When the difference is greater than the preset threshold, the indication operation for the target expression cannot be responded to.

[0105] The indication operation may specifically be a preset operation on the target expression in the preset content display area. The preset operation may be a long press, a click, etc. This embodiment does not impose any specific limitation on this.

[0106] Step B30, sending the emotion tag of the target expression, and displaying the emotion tag of the target expression within a preset range of the target expression.

[0107] The emotion tag of the target expression is sent to display the emotion tag of the target expression on the message receiving end.

[0108] The emotion tag can be displayed within a preset range of the target expression, which can be set by the user, obtained from the network, or preset by a software application, and this embodiment does not make specific restrictions. As an example, the preset range of the target expression can be represented as a rectangular frame of a certain size, or as a circular frame of a certain size.

[0109] In this embodiment, by sending the target expression and also sending the emotion tag of the target expression, the display of the emotion tag of the target expression is realized, avoiding the situation where different understandings of the emotions expressed by the expression due to human factors are avoided, which can well help understand the user's current emotional state, avoid misunderstandings, and improve the quality of expression sending.

[0110] Based on the first embodiment, the second embodiment and / or the third embodiment of the present application, in the fourth embodiment of the present application, the same or similar contents as those in the first embodiment, the second embodiment and the third embodiment can be referred to the above description, and will not be repeated in the following. On this basis, the method is applied to the server, and before the step of searching for a candidate expression matching the emotion information in the preset target expression set, the method further includes:

[0111] Step C10, obtaining the user ID of the expression sending end;

[0112] The expression sending end is a user terminal that sends the target expression, and the user identification indicates the user who sends the target expression. In a specific embodiment, such as in a WeChat chat scenario, the user identification can be a WeChat account.

[0113] Step C20, if there is a preset expression set whose set identifier is consistent with the user identifier among all preset expression sets, determining the preset expression set whose set identifier is consistent with the user identifier as the preset target expression set;

[0114] It should be noted that the server can set one or more preset expression sets. Specifically, the server can only set a general preset expression set, that is, all user terminals filter target expressions from this preset expression set. A corresponding preset expression set can also be set for each user terminal to achieve personalized settings of the preset expression set.

[0115] If the server only sets one common preset expression set, the common preset expression set is determined as the preset target expression set.

[0116] If the server sets a corresponding preset expression set for each user terminal, a preset expression set whose set identifier is consistent with the user identifier is selected from all preset expression sets as the preset target expression set.

[0117] Step C30, if there is no preset expression set whose set identifier is consistent with the user identifier in all preset expression sets, create a new preset expression set, determine the new preset expression set as the preset target expression set, and determine the user identifier as the set identifier of the new preset expression set.

[0118] When there is no preset expression set whose collection identifier is consistent with the user identifier, a new preset expression set can be created, and this new preset expression set can be determined as the preset target expression set, and the user identifier can be determined as the collection identifier of the new preset expression set. In this way, the user identifier is used as the index of the new preset expression set, which facilitates the subsequent search for the corresponding preset target expression set through the user identifier.

[0119] In a possible implementation, the step of creating a new preset expression set includes:

[0120] Step D10, obtaining a local expression set from the expression sending end;

[0121] Users can create an expression set based on local expressions (such as local self-made expressions, expressions in local downloaded expression packages). Specifically, users can set the emotion label of each local expression to obtain a local expression set. It can also automatically identify the emotion label of each local expression, and obtain a local expression set based on the identified emotion label and the association with the local expression.

[0122] Step D20, if the local expression set is successfully acquired, then determining that the local expression is a new preset expression set;

[0123] If the expression sending end has a local expression set and the local expression set is successfully obtained, then the obtained local expression set is determined to be a new preset expression set. In this way, the created new preset expression set contains the local expressions of the expression sending end, thereby realizing the personalized setting of the expression set, and further ensuring the personalization of the target expressions subsequently screened out, thereby realizing the personalized sending of expressions.

[0124] Step D30, if the local expression set acquisition fails, determining the preset default expression set as the new preset expression set;

[0125] The new preset expression set includes at least one expression subset, each of the expression subsets includes at least one expression, and the expressions in each of the expression subsets have the same emotion label.

[0126] If the local expression set fails to be obtained, the preset default expression set is determined as the new preset expression set, and the preset default expression set can be an expression set set in advance in the server, and each expression in the preset default expression set is associated with an emotion tag. In this way, even if there is no local expression in the expression sending end (such as the user has not downloaded any expression package), expressions can be selected from the preset default expression set for sending, thereby improving the user experience.

[0127] In addition, an embodiment of the present application also proposes an expression sending device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the expression sending method as described above.

[0128] refer to Figure 5 , which shows a schematic diagram of the structure of an expression sending device suitable for implementing the embodiment of the present application. The expression sending device in the embodiment of the present application may also include but is not limited to mobile terminals such as watches, bracelets, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The emoticon sending device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0129] like Figure 5As shown, the expression sending device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the expression sending device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the expression sending device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows an expression sending device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.

[0130] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program sensor, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0131] The emoticon sending device provided in the embodiment of the present application adopts the emoticon sending method in the above embodiment, which can solve the technical problem of emoticon sending. Compared with the prior art, the beneficial effects of the emoticon sending device provided in the present application are the same as the beneficial effects of the emoticon sending method provided in the above embodiment, and other technical features in the emoticon sending device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0132] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0133] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0134] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also provides a readable storage medium having computer-readable program instructions (ie, computer program) stored thereon, and the computer-readable program instructions are used to execute the expression sending method in the above-mentioned embodiment.

[0135] The computer-readable storage medium provided in the embodiment of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0136] The computer-readable storage medium may be included in the expression sending device; or may exist independently without being assembled into the expression sending device.

[0137] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by an expression sending device, the expression sending device: obtains the user's expression data, wherein the expression data includes a facial image; identifies the user's emotional information based on the expression data, and searches for candidate expressions matching the emotional information in a preset target expression set, wherein the emotional information includes an emotional label; if there are multiple candidate expressions, selects at least one target expression from the multiple candidate expressions, and sends the target expression.

[0138] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0139] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program sensor according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0140] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.

[0141] The readable storage medium provided by the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned expression sending method, and can solve the technical problem of expression sending. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by the present application are the same as the beneficial effects of the expression sending method provided by the above-mentioned embodiment, and will not be repeated here.

[0142] In addition, an embodiment of the present application further proposes a computer program sensor, including an expression sending program, and when the expression sending program is executed by a processor, the steps of the expression sending method described above are implemented.

[0143] The specific implementation of the computer program sensor of the present application is basically the same as the above-mentioned embodiments of the expression sending method, and will not be repeated here.

[0144] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0145] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0146] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software sensor, which is stored in a storage medium (such as ROM / RAM, disk, CD) as described above, including a number of instructions for a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0147] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for sending an expression, characterized in that: The expression sending method comprises the following steps: Acquire the user's expression data, wherein the expression data includes a face image; Identifying the user's emotional information based on the expression data, and searching for a candidate expression matching the emotional information in a preset target expression set, wherein the emotional information includes an emotional label; If there are multiple candidate expressions, at least one target expression is selected from the multiple candidate expressions, and the target expression is sent.

2. The method according to claim 1, characterized in that The step of selecting at least one target expression from a plurality of candidate expressions comprises: Outputting each candidate expression in a preset expression display area; If an expression selection instruction is obtained, the candidate expression selected by the expression selection instruction is determined to be the target expression.

3. The method according to claim 1, characterized in that The step of selecting at least one target expression from a plurality of candidate expressions comprises: Obtain the historical sending times of each candidate expression, and determine the highest historical sending times among the historical sending times; The candidate expression corresponding to the highest number of historical sending times is determined as the target expression.

4. The method according to claim 1, characterized in that The step of selecting at least one target expression from the plurality of candidate expressions and sending the target expression comprises: If the emotion information includes multiple emotion tags, for each emotion tag, selecting at least one target expression from candidate expressions corresponding to the emotion tag; The target expressions are combined in sequence according to the change order of all the emotion tags to obtain a target expression animated image, and the target expression animated image is sent.

5. The method according to claim 1, characterized in that After the step of sending the target expression, the method further includes: Displaying the target expression in a preset content display area; In response to an indication operation on the target expression, acquiring an emotion label corresponding to the target expression; The emotion tag of the target expression is sent, and the emotion tag of the target expression is displayed within a preset range of the target expression.

6. The method according to any one of claims 1 to 5, characterized in that: The method is applied to a server, and before the step of searching for a candidate expression matching the emotion information in a preset target expression set, the method further comprises: Get the user ID of the emoticon sender; If there is a preset expression set whose set identifier is consistent with the user identifier among all preset expression sets, determining the preset expression set whose set identifier is consistent with the user identifier as the preset target expression set; If there is no preset expression set whose set identifier is consistent with the user identifier in all preset expression sets, a new preset expression set is created, and the new preset expression set is determined as the preset target expression set, and the user identifier is determined as the set identifier of the new preset expression set.

7. The method according to claim 6, characterized in that The step of creating a new preset expression set includes: Acquire a local expression set from the expression sending end; If the local expression set is successfully obtained, then determining that the local expression is a new preset expression set; If the local expression set fails to be obtained, determining the preset default expression set as the new preset expression set; The new preset expression set includes at least one expression subset, each of the expression subsets includes at least one expression, and the expressions in each of the expression subsets have the same emotion label.

8. An expression sending device, characterized in that: The expression sending device comprises: a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the expression sending method according to any one of claims 1 to 7.

9. A readable storage medium, characterized in that: The readable storage medium is a computer-readable storage medium, and a computer program is stored on the readable storage medium. When the computer program is executed by a processor, the steps of the expression sending method according to any one of claims 1 to 7 are implemented.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the expression sending method according to any one of claims 1 to 7 are implemented.

Images