Expression processing method, device, equipment and computer readable storage medium

Abstract

The application provides an expression processing method, device and equipment and a computer readable storage medium; the method comprises the following steps: presenting a conversation message containing a first expression in a conversation interface; in response to a replacement instruction for the first expression, presenting one or more candidate expressions; in response to a sliding operation for a candidate expression, if the sliding direction of the sliding operation is a first target direction, presenting at least one candidate expression with a matching expression label of the candidate expression, if the sliding direction of the sliding operation is a second target direction, presenting at least one candidate expression with a non-matching expression label of the first expression, in response to an expression selection operation triggered by a candidate expression presented in a candidate expression presentation area, replacing the first expression with a second expression selected by the expression selection operation at the presentation position of the first expression. Through the application, the first expression can be quickly replaced with the second expression, and the human-computer interaction efficiency is improved.

Description

[0001] This application is a divisional application of the Chinese patent application filed on January 4, 2021, with patent application number 2021100046221 and the invention title "Method, Apparatus, Device and Computer-readable Storage Medium for Processing Facial Expressions". Technical Field

[0002] This application relates to the field of computer technology, and in particular to a method, apparatus, device, and computer-readable storage medium for processing facial expressions. Background Technology

[0003] Social networking applications typically provide users with internet-based instant messaging services, allowing two or more people to exchange text messages, files, voice, and video messages instantly over the network. With the development of social networking applications, they have permeated people's lives, and more and more people are using them for communication.

[0004] When communicating through social applications, if a user finds that the emoji they sent is inappropriate, they usually need to recall the emoji within a specified time and then resend a new one. This leads to complicated operations and low efficiency in human-computer interaction. Summary of the Invention

[0005] This application provides a method, apparatus, computer device, and computer-readable storage medium for processing facial expressions, which can quickly replace a first facial expression with a second facial expression, thereby improving the efficiency of human-computer interaction.

[0006] The technical solution of this application embodiment is implemented as follows: This application provides a method for processing facial expressions, including: Display the conversation message containing the first emoticon in the conversation interface; In response to a replacement instruction for the first expression, a candidate expression display area is presented, and one or more candidate expressions are presented in the candidate expression display area; In response to a swipe operation on the candidate expression, if the swipe direction is a first target direction, at least one candidate expression with a matching expression tag is displayed in the candidate expression display area. If the sliding direction of the sliding operation is the second target direction, at least one candidate expression that does not match the expression label of the first expression will be presented in the candidate expression presentation area; In response to an expression selection operation triggered by a candidate expression displayed in the candidate expression display area, at the display position of the first expression, the first expression is replaced by the second expression selected by the expression selection operation.

[0007] This application provides an expression processing device, including: The first presentation module is used to present conversation messages containing the first emoticon in the conversation interface; The second presentation module is used to present a candidate expression presentation area in response to a replacement instruction for the first expression, and to present one or more candidate expressions in the candidate expression presentation area; The second presentation module is further configured to respond to a sliding operation on the candidate expression, and if the sliding direction of the sliding operation is a first target direction, to present at least one candidate expression with a matching expression tag in the candidate expression presentation area. If the sliding direction of the sliding operation is the second target direction, at least one candidate expression that does not match the expression label of the first expression will be presented in the candidate expression presentation area; The replacement module is configured to, in response to an expression selection operation triggered by a candidate expression displayed in the candidate expression display area, replace the first expression with the second expression selected by the expression selection operation at the display position of the first expression.

[0008] In the above scheme, the first presentation module is further configured to present a candidate expression presentation area in response to a replacement instruction for the first expression, and before presenting one or more candidate expressions in the candidate expression presentation area, to present a replacement function item in response to a press operation on the first expression in the conversation message; In response to a trigger operation for the replacement function item, a replacement instruction for the first expression is generated.

[0009] In the above scheme, the first presentation module is further configured to present a toolbar corresponding to the first expression in response to a press operation on the first expression; The replacement function item is presented in the toolbar.

[0010] In the above scheme, the first presentation module is further configured to respond to the replacement instruction for the first expression, present a candidate expression presentation area, and before presenting one or more candidate expressions in the candidate expression presentation area, receive a target gesture operation triggered at the presentation position of the first expression; When the target gesture operation is a gesture operation corresponding to the replacement instruction, the replacement instruction for the first expression is triggered.

[0011] In the above scheme, the second presentation module is further configured to present one or more candidate expressions that match the expression tag of the first expression in the candidate expression presentation area.

[0012] In the above scheme, the number of candidate expressions is multiple, and the second presentation module is further used to present multiple candidate expressions that match the expression tag of the first expression, and the multiple candidate expressions are arranged in order of matching degree from high to low; The matching degree is the matching degree between the expression tag of the first expression and each of the candidate expressions.

[0013] In the above scheme, the second presentation module is further configured to present one or more candidate expressions determined based on user behavior data regarding expressions in the candidate expression presentation area.

[0014] In the above scheme, the second presentation module is also used to present the emoji search box; Receive emoji information based on the emoji search box; In response to a search command triggered based on the expression information, one or more candidate expressions that match the expression information are displayed in the candidate expression display area.

[0015] In the above scheme, the second presentation module is also used to present the voice search function item; In response to a trigger action on the voice search function, voice recording is started to input facial expression information via voice. In response to a search command triggered based on the expression information, one or more candidate expressions that match the expression information are displayed in the candidate expression display area.

[0016] In the above scheme, the second presentation module is further configured to present a candidate expression presentation area in response to a replacement instruction for the first expression, and to present an editing function item for the first expression before presenting one or more candidate expressions in the candidate expression presentation area; In response to an operation triggered by an editing function item, an editing interface corresponding to the first emoticon is displayed; In response to an editing operation on the first emoticon triggered by the editing interface, the edited emoticon is presented and used as a candidate emoticon.

[0017] In the above scheme, the second presentation module is also used to respond to the text addition operation triggered based on the editing interface, and to overlay the input text on the first emoticon to present the edited emoticon in real time.

[0018] In the above scheme, the second presentation module is also used to present audio addition function items for facial expressions; In response to an action triggered by the audio addition feature, the audio addition page is displayed; Receive the audio file input based on the audio addition page; Replacing the first emoticon with the second emoticon selected by the emoticon selection operation includes: Cancel displaying the first emoticon and display the second emoticon selected by the emoticon selection operation; When the second expression is displayed, the audio file is played.

[0019] In the above scheme, the second presentation module is also used for If the sliding direction of the sliding operation is the first target direction, one or more candidate expressions will be moved in and out of the candidate expression display area simultaneously with the sliding operation; Among them, the candidate expressions that move into the candidate expression display area and the candidate expressions that move out of the candidate expression display area have matching expression tags.

[0020] In the above scheme, the second presentation module is further configured to increase the size of the candidate expression presentation area if the sliding direction of the sliding operation is the second target direction, and present one or more candidate expressions with expression tags that do not match the first expression in the enlarged candidate expression presentation area.

[0021] In the above scheme, the second presentation module is further configured to present one or more candidate expressions obtained by filtering based on the first filtering rule in the candidate expression presentation area; The second presentation module is further configured to receive a switching operation for the candidate expression after presenting one or more candidate expressions in the candidate expression presentation area; In response to the switching operation, the presented one or more candidate expressions obtained based on the first filtering rule are switched to one or more candidate expressions obtained based on the second filtering rule; The first filtering rule is different from the second filtering rule.

[0022] In the above scheme, the second presentation module is further configured to present a first target number of candidate expressions in the candidate expression presentation area; In the above scheme, the second presentation module is further configured to, in response to a switching operation for the candidate expressions, switch the first target number of candidate expressions to the second target number of candidate expressions after presenting one or more candidate expressions in the candidate expression presentation area. The first target quantity is different from the second target quantity.

[0023] In the above scheme, the second presentation module is also used to present the confirmation and replacement function item; In response to the triggering operation of the confirmation replacement function item, the presentation of the one or more candidate expressions is canceled, and a prompt message indicating successful replacement is displayed.

[0024] In the above scheme, the second presentation module is further configured to, in response to the trigger operation for the confirmation replacement function item, before canceling the presentation of the one or more candidate expressions and presenting the replacement success prompt message, update the presented second expression at the presentation position of the first expression to the expression selected by the re-emoji selection operation in response to the re-emoji selection operation triggered based on the one or more candidate expressions.

[0025] In the above scheme, the first presentation module is further configured to receive a conversation message containing a third emoticon and present the conversation message containing the third emoticon on the conversation interface; A fourth expression is received to replace the third expression; At the location where the third expression is displayed, the third expression will be replaced with the fourth expression.

[0026] In the above scheme, the first presentation module is also used to present a prompt message containing a third emoticon in the conversation message list; A fourth expression is received to replace the third expression; In response to a presentation instruction for a conversation message triggered based on the prompt information, a conversation message containing the fourth emoticon is presented in the conversation interface.

[0027] In the above scheme, the first presentation module is also used to present a conversation message containing a first emoticon and text; In the above scheme, the replacement module is also used to keep the text unchanged and replace the first emoticon presented in the conversation message with the second emoticon.

[0028] This application provides a computer device, including: Memory, used to store executable instructions; The processor, when executing executable instructions stored in the memory, implements the facial expression processing method provided in the embodiments of this application.

[0029] This application provides a computer-readable storage medium storing executable instructions for inducing a processor to execute and implement the facial expression processing method provided in this application.

[0030] This application provides a computer program product, including computer-executable instructions or a computer program, wherein when the computer-executable instructions or the computer program are executed by a processor, a method for processing facial expressions is implemented. The embodiments of this application have the following beneficial effects: By applying the above embodiments, a conversation message containing a first emoticon is presented in the conversation interface; in response to a replacement instruction for the first emoticon, one or more candidate emoticons are presented; in response to an emoticon selection operation triggered based on one or more of the candidate emoticons, the first emoticon is replaced with the second emoticon selected by the emoticon selection operation at the presentation position of the first emoticon; thus, the first emoticon in the conversation message can be directly replaced with the second emoticon through the replacement instruction, without first withdrawing the conversation message containing the first emoticon and then resending the conversation message containing the second emoticon, thereby improving the efficiency of human-computer interaction. Furthermore, when the swipe direction is the first target direction, candidate emoticons with matching emoticon tags can be displayed; when the swipe direction is the second target direction, candidate emoticons with mismatched emoticon tags can be displayed, which can improve the efficiency of human-computer interaction, realize multi-dimensional emoticon recommendation, enrich the diversity of interaction methods, and improve the resource utilization of electronic devices. Attached Figure Description

[0031] Figure 1 This is a schematic diagram of the interface for the facial expression replacement process provided by the relevant technology; Figure 2 This is an optional architecture diagram of the facial expression processing system 100 provided in this application embodiment; Figure 3 This is a schematic diagram of the structure of the computer device 500 provided in the embodiments of this application; Figure 4 This is a flowchart illustrating the facial expression processing method provided in an embodiment of this application; Figures 5A-5B This is a schematic diagram of the session interface provided in an embodiment of this application; Figure 6 This is a schematic diagram of the interface for generating replacement instructions provided in an embodiment of this application; Figure 7 This is a schematic diagram of the presentation interface of the candidate expressions provided in the embodiments of this application; Figure 8 This is a schematic diagram of the presentation interface of the candidate expressions provided in the embodiments of this application; Figure 9 This is a schematic diagram of the presentation interface of the candidate expressions provided in the embodiments of this application; Figure 10 This is a schematic diagram of the interface for presenting candidate expressions provided in an embodiment of this application; Figure 11 This is a schematic diagram of the interface for presenting candidate expressions according to an embodiment of this application; Figure 12 This is a schematic diagram of the interface for emoji replacement provided in an embodiment of this application; Figure 13 This is a schematic diagram of the session interface provided in an embodiment of this application; Figure 14 This is a schematic diagram of the facial expression replacement interface provided in an embodiment of this application; Figure 15 This is a flowchart illustrating the facial expression processing method provided in an embodiment of this application; Figure 16 This is a flowchart illustrating the facial expression processing method provided in the embodiments of this application. Detailed Implementation

[0032] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0033] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0034] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0035] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0036] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0037] 1) Emoticons, which have become a popular culture after the rise of social applications, are used to express specific emotions, such as the emotions displayed on a user's face or posture. In practical applications, emoticons can be divided into symbol emoticons, static image emoticons, dynamic image emoticons, video emoticons, etc. For example, emoticons can use faces that express various user emotions as material, or use currently popular celebrities, anime, movie screenshots, etc. as material, and then add a series of matching text.

[0038] 2) In response, used to indicate the conditions or states on which the operation performed depends. When the conditions or states on which it depends are met, one or more operations performed may be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0039] Figure 1 This is a schematic diagram of the interface for the facial expression replacement process provided by the relevant technology. See [link / reference]. Figure 1 The system displays a sent conversation message containing emoticon 101 in the conversation interface. Upon receiving a user-triggered recall command, it cancels the display of the conversation message containing emoticon 101 and displays a prompt message 102 stating "You recalled a message" to indicate successful recall. After recalling the emoticon, the user can reselect the emoticon 103 to send. Upon receiving a send command for emoticon 103, a conversation message containing emoticon 103 is displayed. Here, after the user triggers the recall command, the message receiver will display a prompt message stating "The other party recalled a message."

[0040] When implementing the embodiments of this application, the applicant found that in the above solution, the user needs to perform a recall operation on the conversation message containing emoticon 101, and then reselect the emoticon to be sent, which makes the operation complicated and the human-computer interaction inefficient; in addition, after the message is recalled, the message receiving end will display a prompt message "the other party has recalled a message", leaving a trace of the recall and wasting display resources.

[0041] Based on this, embodiments of this application provide a method, apparatus, device, and computer-readable storage medium for processing facial expressions, which can quickly replace a first facial expression with a second facial expression, thereby improving the efficiency of human-computer interaction.

[0042] See Figure 2 , Figure 2 This is an optional architecture diagram of the facial expression processing system 100 provided in this application embodiment. To support an exemplary application, the terminals (including terminals 400-1 and 400-2) are connected to the server 200 via a network 300. The network 300 can be a wide area network (WAN), a local area network (LAN), or a combination of both. The terminals may be equipped with a social networking client, such as an instant messaging client. Users of terminals 400-1 and 400-2 can communicate by sending conversation messages through the social networking client.

[0043] Terminal 400-1 is used to send a conversation message containing a first emoticon and to display the conversation message containing the first emoticon in the conversation interface; Server 200 is used to receive a session message containing a first emoticon and send the session message containing the first emoticon to terminal 400-2; Terminal 400-2 is used to display a prompt message containing the first emoticon in the conversation message; Terminal 400-1 is used to present one or more candidate expressions in response to a replacement instruction for a first expression; and in response to an expression selection operation triggered based on one or more candidate expressions, at the presentation position of the first expression, to replace the presentation of the first expression with the presentation of the second expression selected by the expression selection operation, and send the second expression to server 200. Server 200 is used to send the second emoticon to terminal 400-2; Terminal 400-2 is used to present a conversation message triggered by a prompt message, and to present the conversation message containing the second emoticon in the conversation interface.

[0044] In some embodiments, server 200 may be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. Terminals may be smartphones, tablets, laptops, desktop computers, smart speakers, smartwatches, in-vehicle devices, smart TVs, etc., but are not limited to these.

[0045] See Figure 3 , Figure 3 This is a schematic diagram of the structure of the computer device 500 provided in the embodiments of this application. In practical applications, the computer device 500 can be... Figure 1 The terminal (such as 400-1) or server 200 in the middle, with computer equipment as Figure 2 Taking the terminal shown as an example, a computer device that implements the facial expression processing method of the present application embodiment will be described. Figure 3 The computer device 500 shown includes one or more processors 510, memory 550, one or more network interfaces 520, and a user interface 530. The various components in the computer device 500 are coupled together via a bus system 540. It is understood that the bus system 540 is used to implement communication between these components. In addition to a data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 3 The general labeled all buses as Bus System 540.

[0046] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.

[0047] User interface 530 includes one or more output devices 531 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0048] The memory 550 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 550 may optionally include one or more storage devices physically located away from the processor 510.

[0049] The memory 550 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 550 described in this application embodiment is intended to include any suitable type of memory.

[0050] In some embodiments, memory 550 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.

[0051] Operating system 551 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks; The network communication module 552 is used to reach other computing devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc. Presentation module 553 is used to enable the presentation of information (e.g., user interface for operating peripheral devices and displaying content and information) via one or more output devices 531 (e.g., display screen, speaker, etc.) associated with user interface 530. The input processing module 554 is used to detect and translate one or more user inputs or interactions from one or more input devices 532.

[0052] In some embodiments, the facial expression processing apparatus provided in this application can be implemented in software. Figure 2 An expression processing device 555 stored in memory 550 is shown. It can be software in the form of programs and plug-ins, including the following software modules: a first presentation module 5551, a second presentation module 5552, and a replacement module 5553. These modules are logically related and can therefore be arbitrarily combined or further split according to the functions implemented.

[0053] The functions of each module will be explained below.

[0054] In other embodiments, the facial expression processing apparatus provided in this application can be implemented in hardware. As an example, the facial expression processing apparatus provided in this application can be a processor in the form of a hardware decoding processor, which is programmed to execute the facial expression processing method provided in this application. For example, the processor in the form of a hardware decoding processor can be one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0055] The method for processing facial expressions provided in this application will be described in conjunction with exemplary applications and implementations of the terminals provided in the embodiments of this application.

[0056] See Figure 4 , Figure 4 This is a flowchart illustrating the facial expression processing method provided in the embodiments of this application, which will be combined with... Figure 4 The steps shown are explained.

[0057] Step 401: The terminal displays a conversation message containing the first emoticon in the conversation interface.

[0058] In practice, the terminal is equipped with a social client, such as an instant messaging client, which presents a conversation interface. Users can communicate with other users through this interface. During this communication, users can send conversation messages, which are then displayed in the conversation interface. Correspondingly, upon receiving the message, the receiving end outputs a notification, such as "A message received."

[0059] In practical applications, a conversation message containing the first emoticon can be a standalone emoticon message or a conversation message consisting of emoticons and text. Emoticons are not limited to animated GIFs, static images, short videos, etc. Figures 5A-5B This is a schematic diagram of the session interface provided in the embodiments of this application. Figure 5A The conversation interface displays a conversation message 501 containing the first emoticon; here, conversation message 501 is a standalone emoticon message. See also... Figure 5B The conversation interface displays a conversation message 502 containing the first emoticon. This conversation message is a combination of emoticons and text, with two emoticons. Here, a conversation message can contain one or more emoticons.

[0060] Step 402: In response to the replacement instruction for the first expression, present one or more candidate expressions.

[0061] Here, when a user sends an inappropriate emoji and needs to replace the first emoji, a replacement command can be triggered. At this time, the terminal will present one or more candidate emojis for the user to choose from, so as to quickly replace the emoji.

[0062] In actual implementation, after receiving the replacement instruction for the first emoticon, the terminal can directly present one or more candidate emoticons in the conversation interface, or it can present an emoticon interface independent of the conversation interface, and then present one or more candidate emoticons in the emoticon interface, such as presenting the emoticon interface in a floating manner and presenting one or more candidate emoticons in the emoticon interface, or it can present one or more candidate emoticons in other forms. Here, there is no limitation on the presentation form of the candidate emoticons.

[0063] The replacement command can be triggered by the corresponding function item, by inputting a voice command, or by other means, such as by using a shortcut key. There are no restrictions on this.

[0064] In some embodiments, a replacement instruction for a first emoji can be generated by: presenting a replacement function item in response to a press operation on the first emoji in a conversation message; and generating a replacement instruction for the first emoji in response to a trigger operation on the replacement function item.

[0065] In practice, the terminal detects received operations. When the user presses the position of the first emoji, the terminal detects the press and obtains its location to determine that it is a press operation targeting the first emoji in the conversation message, thus displaying the replacement function item. The replacement function item can be displayed as a standalone item or as a toolbar containing replacement function items. The triggering operation for the replacement function item can be a click, double-click, or swipe, etc.

[0066] As an example, Figure 6 This is a schematic diagram of the interface for the replacement instruction generation process provided in an embodiment of this application. See also: Figure 6 When a user triggers a press operation at the presentation location of the conversation message 601 containing the first emoticon, the terminal presents a toolbar corresponding to the first emoticon, which includes a replacement function item 602; when the user clicks the replacement function item, a replacement instruction for the first emoticon is generated; after receiving the replacement instruction, the terminal presents multiple candidate emoticons.

[0067] In this embodiment, a replacement function is presented in response to a press operation on the first emoticon in a conversation message; thus, a replacement command for the first emoticon can be quickly triggered by triggering the replacement function.

[0068] It should be noted that other trigger operations for presenting the replacement function item can also be set, such as click operation, double click operation, etc. That is, as long as the association between the corresponding trigger operation and the presentation of the replacement function item is set in advance, the replacement function item can be presented when the corresponding trigger operation is received.

[0069] In some embodiments, a persistent replacement function can be set in the conversation interface, that is, there is no need to perform a press operation on the first emoji, reducing the user's operations. Here, a replacement function can be set for each emoji in the conversation message. In this way, the replacement instruction for the first emoji in the corresponding conversation message can be generated directly by triggering the replacement function corresponding to the conversation message; alternatively, a replacement function can be set, and the emoji to be replaced can be selected after the replacement function is triggered.

[0070] In some embodiments, a replacement instruction for the first expression can be triggered in the following manner: receiving a target gesture operation triggered at the display position of the first expression; when the target gesture operation is a gesture operation corresponding to the replacement instruction, a replacement instruction for the first expression is triggered.

[0071] In practice, replacement commands can be triggered by quick gestures. That is, the association between gesture operations and replacement commands can be preset. When a target gesture operation is received at the display position of the first expression, the gesture operation associated with the replacement command is obtained. Then, the target gesture operation and the gesture operation associated with the replacement command are matched. When the target gesture operation and the gesture operation associated with the replacement command match, the target gesture operation is determined to be the gesture operation corresponding to the replacement command.

[0072] The gesture operation here can be a click, a swipe, a two-finger click, etc. In practical applications, it can be determined whether the target gesture operation and the gesture operation associated with the replacement command are the same. If they are the same, it means that the target gesture operation and the gesture operation associated with the replacement command match.

[0073] When the gesture operation associated with the replacement command is a swipe operation, the swipe trajectory can also be set. The replacement command will only be triggered when the received target gesture operation is a swipe operation and the swipe trajectory matches the set swipe trajectory.

[0074] This application embodiment receives a target gesture operation triggered at the display position of the first expression; when the target gesture operation is a gesture operation corresponding to the replacement instruction, a replacement instruction for the first expression is triggered; thus, a replacement instruction for the first expression can be quickly triggered through gestures, and display resources can be saved.

[0075] In some embodiments, one or more candidate expressions may be presented by presenting one or more candidate expressions that match the expression tag of the first expression.

[0076] The emoji tags here can be the semantics of the emoji, the category of the pattern in the emoji, the emoji album to which the emoji belongs, etc. In practice, the first emoji can have one or more emoji tags. When the first emoji has multiple emoji tags, candidate emojis that match any of the multiple tags can be presented. The emoji tags of the first emoji can be manually set or obtained through image recognition. For example, the text contained in the emoji can be recognized, and the recognized text in the emoji can be used as the emoji tag; or the pattern in the emoji can be recognized, and the recognized pattern category can be used as the emoji tag.

[0077] As an example, when the emoji label is the semantic meaning of the emoji, see [link to example]. Figure 7 , Figure 7 This is a schematic diagram of the presentation interface of the candidate emoticons provided in the embodiments of this application. The semantics of the first emoticon 701 are "thank you". The emoticon interface 702 is presented in a floating form, and the candidate emoticons with the corresponding semantics of "thank you" are presented in the emoticon interface.

[0078] In practical applications, the terminal obtains the emoji tag of the first emoji and the emoji tags of each emoji in the emoji library. It then matches the emoji tag of the first emoji with the emoji tags of each emoji to obtain the matching degree between the first emoji and the emoji tags of each emoji. Emoji tags with matching degrees reaching a matching degree threshold are then selected as one or more candidate emojis that match the first emoji's emoji tag, and these candidate tags are then presented. Here, when there are multiple candidate tags, they can be presented in descending order of matching degree, or they can be sorted according to other parameters before presentation.

[0079] In some embodiments, one or more candidate emojis may be determined by: acquiring user behavior data regarding emojis; and determining one or more emojis preferred by the user as candidate emojis based on the behavior data.

[0080] In practice, behavioral data regarding emojis can include data on emoji collection, usage, and likes. By acquiring and analyzing this data, the user's preference for each emoji can be determined, identifying one or more preferred emojis as candidate emojis. For example, the system can collect data on emojis used by the user, the usage time of each emoji, and the usage frequency of each emoji. Analysis reveals that more recent usage and higher usage frequency generally indicate greater preference for the emoji. This allows the system to determine the user's preference level for each emoji and, based on this preference level, select one or more preferred emojis as candidate emojis for presentation.

[0081] In practical applications, one can acquire and analyze the current user's behavioral data to determine candidate emojis; alternatively, one can acquire and analyze the behavioral data of users with whom the current user has a social relationship to determine candidate emojis. These social relationships can include friends, users who have sent conversation messages within a target time period, etc. For example, one can obtain the most frequently used emojis from the users who chat most frequently with the current user as candidate emojis.

[0082] In some embodiments, one or more candidate expressions can be presented in the following manner: presenting one or more candidate expressions: presenting an expression search box; receiving expression information based on the expression search box input; and, in response to a search instruction triggered based on the expression information, presenting one or more candidate expressions that match the expression information.

[0083] In practice, users can input the corresponding emoji information according to the meaning they want to express, and search for emojis that match their meaning. In this way, the candidate emojis presented can better meet the user's needs, enabling the user to quickly find the emoji they need and improving the efficiency of human-computer interaction.

[0084] For example, see Figure 8 , Figure 8 This is a schematic diagram of the candidate emoticon presentation interface provided in the embodiments of this application. When a user wants to obtain an emoticon to express "happy", they can enter "happy" in the emoticon search box 801, and then click the search function item 802 to trigger the search command and present multiple candidate emoticons 803 that match "happy".

[0085] In some embodiments, the terminal may also present a voice search function. Users can trigger the voice search function to record voice messages and input facial expressions via voice. The terminal then presents candidate facial expressions that match the voice messages.

[0086] In some embodiments, the terminal may present one or more candidate expressions in the following ways: presenting an editing function item for a first expression; in response to an operation triggered on the editing function item, presenting an editing interface corresponding to the first expression; in response to an editing operation on the first expression triggered based on the editing interface, presenting the edited expression and using the edited expression as a candidate expression.

[0087] In practice, users can edit the first emoticon as needed, such as adding widgets, adding text, cropping, etc., and use the edited emoticon as a candidate emoticon.

[0088] For example, see Figure 9 , Figure 9 This is a schematic diagram of the presentation interface of the candidate emoticon provided in the embodiment of this application. It presents an editing function item 901. When the terminal receives the user's click operation on the editing function item, the terminal presents the editing interface corresponding to the first emoticon. In the editing interface, the first emoticon and the editing function item are presented so that the candidate emoticon can be edited through the editing function item, such as adding the text "hahaha". The edited emoticon is presented in real time and the edited emoticon is used as the candidate emoticon.

[0089] In some embodiments, at the position where the first expression is displayed, before replacing the first expression with the second expression selected by the expression selection operation, the terminal may also display an audio addition function item for the expression; in response to a trigger operation for the audio addition function item, display an audio addition page; receive an audio file input based on the audio addition page; replace the first expression with the second expression selected by the expression selection operation; cancel the display of the first expression and display the second expression selected by the expression selection operation; and play the audio file while displaying the second expression.

[0090] In practice, the input audio file can be pre-stored locally, and then selected from the local storage; it can also be recorded through the voice function, whereby the user triggers the voice function to activate the terminal's voice capture function and record their voice to obtain an audio file; or it can be obtained from a server, whereby the user triggers an audio file retrieval request to obtain the audio file from the server. For example, the terminal can present multiple selectable audio file selection options, and when it receives a trigger operation for a selection option, it sends an audio file retrieval request corresponding to that selection option to the server to obtain the audio file from the server.

[0091] After acquiring the audio file, the terminal can associate the audio file with the second emoticon, or combine the audio file with the second emoticon. Thus, when the terminal displays the second emoticon, the audio file can be played. The audio file can be played in a loop or only once.

[0092] In some embodiments, after the terminal presents one or more candidate expressions, it can also receive a swipe operation on the candidate expressions, the swipe direction of which is a first target direction; accompanied by the swipe operation, one or more candidate expressions are simultaneously moved in and out of the candidate expression presentation area corresponding to the candidate expression; wherein the candidate expressions moved into the candidate expression presentation area and the candidate expressions moved out of the candidate expression presentation area have matching expression tags.

[0093] In practice, after acquiring candidate emojis, the terminal can initially display a subset of them. When the user triggers a swipe action on a candidate emoji, more candidate emojis are displayed. Here, the movement direction of the candidate emojis can be consistent with the swipe direction. For example, when the swipe direction is to the left, the displayed candidate emojis move to the left, causing one or more candidate emojis on the far left to move out, while one or more candidate emojis move in from the right.

[0094] For example, see Figure 10 , Figure 10This is a schematic diagram of the candidate emoticon presentation interface provided in this application embodiment. An emoticon interface is presented above the conversation message containing the first emoticon. This emoticon interface is the candidate emoticon presentation area, and four candidate emoticons matching the emoticon label "thank you" of the first emoticon are presented in the emoticon interface. When a user's swipe operation on a candidate emoticon is received, the swipe direction is obtained. For example, if the swipe is to the left, then following the swipe operation, all candidate emoticons are moved to the left, so that the leftmost candidate emoticon 1001 is moved out, and at the same time, a candidate emoticon is moved in from the right. Here, the moved-in candidate emoticon 1002 is also a candidate emoticon matching the emoticon label "thank you" of the first emoticon.

[0095] In some embodiments, the terminal may present one or more candidate expressions in the following manner: presenting one or more candidate expressions that have a matching expression tag with the first expression; after presenting one or more candidate expressions, it may also receive a swipe operation on the candidate expressions, wherein the swipe direction of the swipe operation is a second target direction; in response to the swipe operation, increasing the size of the candidate expression presentation area corresponding to the candidate expression, and presenting one or more candidate expressions that do not match the first expression within the presentation area.

[0096] In actual implementation, the terminal first presents one or more candidate emoticons that have matching emoticon tags with the first emoticon. If the user does not want to select one or more candidate emoticons that have matching emoticon tags with the first emoticon, a swipe operation can be triggered for the candidate emoticons, and the swipe direction can be obtained. When the swipe direction is determined to be the second target direction, the size of the candidate emoticon presentation area is determined. After the size of the candidate emoticon presentation area is increased, one or more candidate emoticons that do not have matching emoticon tags with the first emoticon are presented in the newly added presentation area relative to the original candidate emoticon presentation area.

[0097] For example, see Figure 11 , Figure 11 This is a schematic diagram of the candidate emoticon presentation interface provided in this application embodiment. An emoticon interface is presented above the conversation message containing the first emoticon. This emoticon interface is the candidate emoticon presentation area 1101, and four candidate emoticons matching the emoticon tag "thank you" of the first emoticon are presented in the emoticon interface. When a user's swipe operation on the candidate emoticons is received, the swipe direction is obtained. For example, if the swipe is upward, the candidate emoticon presentation area is expanded. Then, in the expanded candidate emoticon presentation area 1102, above the candidate emoticons matching the emoticon tag "thank you" of the first emoticon, multiple candidate emoticons with emoticon tags that do not match the first emoticon are presented, namely, candidate emoticons with the emoticon tag "happy", candidate emoticons with the emoticon tag "like", candidate emoticons with the emoticon tag "angry" and candidate emoticons with the emoticon tag "meme battle".

[0098] In some embodiments, one or more emoji tags that do not match the first emoji can be obtained first, and then candidate emojis that match the obtained emoji tags can be obtained and presented. These one or more emoji tags that do not match the first emoji can be determined based on the current user's behavior data, such as the emoji tag most frequently used by the current user; they can also be determined based on the emoji behavior data of all users on the platform, such as statistically analyzing the emoji tags used by all users on the platform and obtaining the emoji tag with the most usage; or they can be determined based on other data. The method of obtaining emoji tags that do not match the first emoji is not limited here.

[0099] In some embodiments, multiple emoticons can be determined first based on user behavior data. Then, from the determined multiple emoticons, emoticons whose emoticon tags match the first emoticon are removed to obtain candidate emoticons whose emoticon tags do not match the first emoticon. For example, the 20 most recently used emoticons of the user can be obtained, and then emoticons whose emoticon tags match the first emoticon can be filtered to obtain candidate emoticons whose emoticon tags do not match the first emoticon, and the filtered candidate emoticons are presented.

[0100] In some embodiments, the terminal may also present one or more candidate expressions in the following manner: presenting one or more candidate expressions filtered based on a first filtering rule; after presenting one or more candidate expressions, it may also receive a switching operation for the candidate expressions; in response to the switching operation, the presented one or more candidate expressions filtered based on the first filtering rule are switched to one or more candidate expressions filtered based on a second filtering rule; wherein the first filtering rule is different from the second filtering rule.

[0101] In actual implementation, the terminal can also filter the expressions in the expression library through at least two filtering rules, such as the first filtering rule and the second filtering rule, to obtain candidate expressions corresponding to each filtering rule. First, one or more candidate expressions obtained based on the first filtering rule are presented. After receiving the switching operation, one or more candidate expressions obtained based on the second filtering rule are presented.

[0102] For example, if the first filtering rule is based on when the user saved the emojis, then the five emojis saved most recently are selected; if the second filtering rule is based on when the user used the emojis, then the five emojis used most recently are selected. In this case, the five emojis saved most recently would be displayed first, followed by the emojis received. Here, when there are three filtering rules, after receiving a switching operation again, it is possible to switch from one or more candidate expressions obtained based on the second filtering rule to one or more candidate expressions obtained based on the third filtering rule.

[0103] In some embodiments, the terminal may present one or more candidate expressions in the following manner: presenting a first target number of candidate expressions; after presenting one or more candidate expressions, the terminal may also switch the first target number of candidate expressions to a second target number of candidate expressions in response to a switching operation for candidate expressions; the first target number of candidate expressions is different from the second target number of candidate expressions.

[0104] In actual implementation, after receiving the switching instruction, the terminal can first present a first target number of candidate expressions. Then, after receiving the switching operation, it will switch all the presented candidate expressions, that is, cancel the presentation of the first target number of candidate expressions and present the second target number of candidate expressions.

[0105] Here, the number of first targets and the number of second targets can be the same or different. For example, three candidate expressions A, B, and C can be presented first, and after receiving the switching operation, candidate expressions A, B, and C can be switched to candidate expressions D, E, F, and G.

[0106] In practical applications, multiple candidate expressions can be obtained first, and then the obtained candidate expressions can be sorted and presented according to the sorting result. That is, starting from the first of the sorted candidate expression sequence, a first target number of candidate expressions are obtained and presented. After receiving the switching operation, starting from the next candidate expression that has been presented, a second target number of candidate expressions are selected and presented.

[0107] As an example, the obtained candidate emojis are sorted according to the user's preference for them to obtain a candidate emoji sequence. Assuming the first target number is 5 and the second target number is 6, then, starting from the first candidate emoji in the candidate emoji sequence, 5 candidate emojis are obtained and presented. After receiving the switching operation, starting from the 6th candidate emoji in the sorted candidate emoji sequence, 6 candidate emojis are selected and presented.

[0108] Step 403: In response to an expression selection operation triggered based on one or more candidate expressions, at the presentation location of the first expression, replace the presentation of the first expression with the presentation of the second expression selected by the expression selection operation.

[0109] In practice, users can select the desired candidate emoji from the presented candidate emojis. The emoji selection operation can be a click operation on the candidate emoji or other operations; there are no restrictions here.

[0110] Taking the selection of an emoji as an example (click operation), see [link / reference] Figure 12 , Figure 12This is a schematic diagram of the interface for replacing emoticons provided in this application embodiment. It presents a conversational emoticon including a first emoticon 1201 and 5 candidate emoticons. When a click operation is received on the candidate emoticon 1202, the first emoticon 1201 is replaced with the candidate emoticon 1202.

[0111] In some embodiments, after replacing the first emoticon with the second emoticon selected by the emoticon selection operation, the terminal may also present a confirmation replacement function item; in response to the triggering operation of the confirmation replacement function item, the presentation of one or more candidate emoticons is canceled, and a prompt message indicating successful replacement is presented.

[0112] In actual implementation, when an emoji selection operation is received, the replacement preview function is first implemented. Although the first emoji is replaced with the second emoji selected by the emoji selection operation, the second emoji is not sent to the receiving end at this time. Only when the user triggers the confirmation replacement function will the sending operation for the second emoji be executed to instruct the receiving end to replace the first emoji with the second emoji. After the terminal executes the sending operation, it will cancel the presentation of one or more candidate emojis and present a prompt message indicating that the replacement was successful.

[0113] For example, Figure 13 This is a schematic diagram of the session interface provided in an embodiment of this application. See also: Figure 13 When an expression selection operation is received, the first expression 1301 is replaced with the second expression 1302 selected by the expression selection operation, and a confirmation replacement function 1303 is displayed; when the user clicks the confirmation replacement function, multiple candidate expressions are canceled 1304, and a success message 1305 is displayed.

[0114] In practical applications, before the user triggers the confirmation to replace the first emoji, the second emoji used to replace the first emoji can be changed. That is, the user can perform an emoji selection operation again based on one or more candidate emojis to change the selected second emoji. Upon receiving the confirmation to replace the first emoji, the emoji selected in the last emoji selection operation is sent to the receiving end as the second emoji to replace the first emoji.

[0115] In some embodiments, at the presentation position of the first emoticon, after replacing the presentation of the first emoticon with the second emoticon selected by the emoticon selection operation, a sending operation for the second emoticon is directly performed so that the receiving end replaces the first emoticon with the second emoticon.

[0116] In some embodiments, the terminal may also receive a conversation message containing a third emoticon and display the conversation message containing the third emoticon on the conversation interface; receive a fourth emoticon to replace the third emoticon; and replace the display of the third emoticon with the fourth emoticon at the display position of the third emoticon.

[0117] In practice, the current terminal can receive conversation messages containing a third emoticon from other terminals. If the terminal is currently displaying a conversation interface with the corresponding terminal, the terminal will display a conversation message containing the third emoticon in the conversation interface. When the terminal that sent the conversation message receives a replacement instruction for the third emoticon and triggers a selection operation for the fourth emoticon, the terminal that sent the conversation message will send the fourth emoticon to the current terminal. When the current terminal receives the fourth emoticon, it will replace the displayed third emoticon with the fourth emoticon.

[0118] For example, Figure 14 This is a schematic diagram of the facial expression replacement interface provided in an embodiment of this application. See also... Figure 14 When a conversation message containing a third emoticon is received, a conversation message containing the third emoticon 1401 is presented; when a fourth emoticon is received to replace the third emoticon, the third emoticon 1401 is replaced with the fourth emoticon 1402.

[0119] In some embodiments, the terminal may also present a prompt message containing a third emoticon in the conversation message list; receive a fourth emoticon for replacing the third emoticon; and, in response to a presentation instruction for a conversation message triggered based on the prompt message, present the conversation message containing the fourth emoticon in the conversation interface.

[0120] In actual implementation, the current terminal can receive conversation messages containing a third emoticon from other terminals. If the terminal displays a conversation message list at this time, a prompt message containing the third emoticon will be displayed in the conversation message list. If a fourth emoticon is received to replace the third emoticon, and a conversation message display instruction is triggered, then the conversation message containing the fourth emoticon will be displayed directly in the conversation interface, instead of the conversation message containing the third emoticon.

[0121] In some embodiments, as long as the conversation interface has not been presented before the fourth emoji for replacing the third emoji is received (e.g., the home screen, the interface before entering the application), the conversation message containing the fourth emoji will be presented directly after the user triggers the presentation instruction of the conversation message.

[0122] By applying the above embodiments, a conversation message containing a first emoticon is presented in the conversation interface; one or more candidate emoticons are presented in response to a replacement instruction for the first emoticon; and in response to an emoticon selection operation triggered based on one or more candidate emoticons, the first emoticon is replaced with the second emoticon selected by the emoticon selection operation at the presentation position of the first emoticon. In this way, the first emoticon in the conversation message can be replaced with the second emoticon directly through the replacement instruction, without having to first withdraw the conversation message containing the first emoticon and then resend the conversation message containing the second emoticon.

[0123] Figure 15 This is a flowchart illustrating the facial expression processing method provided in this application embodiment. See also... Figure 15 The facial expression processing method provided in this application embodiment is implemented collaboratively by a first terminal and a second terminal. The facial expression processing method provided in this application embodiment includes: Step 1501: The first terminal sends a conversation message containing the first emoticon and displays the conversation message containing the first emoticon in the conversation interface.

[0124] Step 1502: The second terminal receives the conversation message containing the first emoticon and presents the corresponding prompt information.

[0125] Step 1503: The first terminal responds to the press operation on the first emoticon in the conversation message and presents the replacement function item.

[0126] Step 1504: In response to the trigger operation for the replacement function item, the first terminal presents one or more candidate expressions that match the expression tag of the first expression.

[0127] Step 1505: The first terminal presents multiple candidate expressions that match the expression tag of the first expression.

[0128] Step 1506: The first terminal receives a horizontal swipe operation for the candidate expression.

[0129] Step 1507: The first terminal, accompanied by a horizontal swiping operation, simultaneously moves multiple candidate expressions into and out of the candidate expression display area corresponding to multiple candidate expressions.

[0130] Step 1508: The first terminal receives an upward swipe operation for the candidate expression.

[0131] Step 1509: The first terminal increases the size of the candidate expression display area and displays multiple candidate expressions with expression tags that do not match the first expression within the display area.

[0132] 1510: In response to a selection operation of a second expression among multiple candidate expressions, the first terminal replaces the presentation of the first expression with the presentation of the second expression selected by the expression selection operation at the presentation position of the first expression.

[0133] 1511: The first terminal displays the confirmation and replacement function.

[0134] 1512: In response to the trigger operation for the confirmation replacement function item, the first terminal cancels the presentation of one or more candidate emojis and sends a second emoji to the second terminal.

[0135] Here, the second emoticon is sent to the second terminal to instruct the second terminal to replace the first emoticon in the session message with the second emoticon.

[0136] 1513: The first terminal responds to the presentation instruction of the conversation message triggered by the prompt information and presents the conversation message containing the second emoticon in the conversation interface.

[0137] 1514: The first terminal displays a message indicating that the replacement was successful.

[0138] By applying the above embodiments, the first emoticon in a conversation message can be replaced with the second emoticon directly through the replacement instruction, without having to first recall the conversation message containing the first emoticon and then resend the conversation message containing the second emoticon.

[0139] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario. Figure 16 This is a flowchart illustrating the facial expression processing method provided in this application embodiment. See also... Figure 16 The emoticon processing method provided in this application embodiment is implemented collaboratively by the sending client, the receiving client, and the server. The emoticon processing method provided in this application embodiment includes: Step 1601: The sending client sends a conversation message containing the first emoticon to the server.

[0140] Here, the sender selects the first emoticon to send through the sender's client and executes the sending operation. After receiving the sending operation, the sender's client sends a session message containing the first emoticon to the server.

[0141] Step 1602: The server sends a conversation message containing the first emoticon to the receiving client.

[0142] Step 1603: The sending client presents a conversation message containing the first emoticon.

[0143] Here, after the server sends the conversation message containing the first emoticon to the receiving client, the sending client will display the conversation message containing the first emoticon to indicate that the conversation message was sent successfully.

[0144] Step 1604: The sending client receives the long press operation of the sending party for the first emoji.

[0145] Step 1605: The sending client displays a toolbar containing the "One-Click Replace" function.

[0146] Here, a button is added to the existing toolbar and named "One-Click Replacement". When the user clicks the button, an onclick event is triggered, which wakes up the emoji loading view. The view displays selectable emojis (candidate emojis) that match the emoji label of the first emoji. The user can click on the desired emoji as the second emoji to replace the first emoji.

[0147] Step 1606: The sending client receives a click operation for the "One-click Replace" function and sends a request to the server to obtain the first emoji library.

[0148] Here, the first emoji library is the emoji library that matches the emoji tag of the first emoji. In actual implementation, when the sender clicks the "One-click Replace" function, the sending client sends a request to the server to obtain the first emoji library, so as to obtain the emoji library that matches the emoji tag of the first emoji, and then display the candidate emojis that match the emoji tag of the first emoji.

[0149] For example, see Figure 6 When a user triggers a press operation at the presentation location of the conversation message 601 containing the first emoticon, the terminal presents a toolbar corresponding to the first emoticon, which includes a replacement function item 602 ("one-click replacement" function item).

[0150] Step 1607: The server sends the data from the first emoji library to the sending client.

[0151] Step 1608: The sending client presents multiple candidate emoticons from the first emoticon library.

[0152] Step 1609: The sending client receives a swipe gesture for the candidate emoji, displaying more candidate emojis from the emoji library.

[0153] Here, with the horizontal swipe operation, one or more candidate expressions are simultaneously moved in and out of the candidate expression display area corresponding to the candidate expression.

[0154] For example, see Figure 10 Above the conversation message containing the first emoticon, an emoticon interface is displayed. This emoticon interface is the candidate emoticon display area, and five candidate emoticons matching the emoticon label "thank you" of the first emoticon are displayed in the emoticon interface. When a user's swipe operation on a candidate emoticon is received, the swipe direction is obtained. For example, if the swipe is to the left, then all candidate emoticons are moved to the left following the swipe operation, so that the leftmost candidate emoticon 1001 is moved out, and at the same time, a candidate emoticon is moved in from the right. Here, the moved-in candidate emoticon 1002 is also a candidate emoticon matching the emoticon label "thank you" of the first emoticon.

[0155] Step 1610: The sending client receives the swipe-up operation and sends a request to the server to retrieve the second emoji library.

[0156] Step 1611: The server sends data from the second emoji library to the sending client.

[0157] Step 1612: The sending client presents multiple candidate emojis from the second emoji library.

[0158] Here, upon receiving an up swipe operation, the candidate emoji display area is expanded, and multiple candidate emojis from the second emoji library are displayed within the display area. These are candidate emojis whose emoji tags do not match those of the first emoji, such as emojis sorted by platform popularity and user-common categories.

[0159] For example, see Figure 11 An emoji interface is displayed above the conversation message containing the first emoji. This emoji interface is the candidate emoji display area 1101, and five candidate emojis matching the emoji tag "thank you" of the first emoji are displayed in the emoji interface. When the user swipes up on the candidate emojis, the candidate emoji display area is expanded. Then, in the expanded candidate emoji display area 1102, above the candidate emojis matching the emoji tag "thank you" of the first emoji, multiple candidate emojis with emoji tags that do not match the first emoji are displayed, namely, candidate emojis with the emoji tag "happy", candidate emojis with the emoji tag "like", candidate emojis with the emoji tag "angry" and candidate emojis with the emoji tag "meme war".

[0160] Step 1613: Received the selection operation for the second expression among multiple candidate expressions.

[0161] Step 1614: Load the locally cached emojis and replace the first emoji with the second emoji for a preview.

[0162] Here, the selection operation can be a click operation on the second emoji. That is, after the sender clicks on the second emoji, the first emoji will be replaced with the second emoji in the position where the first emoji is displayed, so as to preview the replacement.

[0163] Step 1615: Received a trigger operation for the confirmation replacement function item.

[0164] Step 1616: Send a replacement request carrying the second emoji to the server.

[0165] Step 1617: The server sends the replacement request to the receiving client.

[0166] In actual implementation, a `t_user_icon` data table is created, where the fields `id` store the user ID, `type` store the specific emoji category (e.g., 2D, 3D, etc.), `keywords` store the specific emoji tags, and `md5` store the emoji's MD5 value. When a user clicks the "One-Click Replacement" function, a file storing frequently used emojis is automatically generated in the ` / tmp` directory on the mobile device. After the user selects an emoji to replace, the client sends the MD5 and ID of the selected second emoji to the server, synchronizing the message body content (where `user_id` is the ID of the user replacing the emoji, `icon_md5` contains the MD5 values ​​of the emoji before and after replacement, and `chat_id` is the chat). { "user_id":xx, "icon_md5": [xxxxx,xxxxx], "chat_id":xxx } Upon receiving the message, the server broadcasts the emoji replacement request, returning a success status message if successful, and an error status message otherwise. This requires cooperation between the client and server. First, the sending client needs to send the replacement request to the server via a JSON message body. After receiving the JSON message body, the server replaces the existing emoji (the first emoji) in its message log. After updating the message log, the server pushes the message log to all clients. The receiving client receives the replacement request and first checks if its version supports displaying the emoji. If it does, it replaces the `image_URL` in its local cache; otherwise, the message remains unchanged.

[0167] Step 1618: When the receiving client receives the replacement request, the sending client displays a message indicating that the replacement was successful.

[0168] For example, see Figure 13 When an emoji selection operation is received, the first emoji 1301 is replaced with the second emoji 1302, and a confirmation replacement function 1303 is displayed; when the user clicks the confirmation replacement function, the display of multiple candidate emojis is canceled 1304, and a success message 1305 is displayed.

[0169] By applying the above embodiments, the cumbersome operation of recalling and resending conversation messages can be reduced; and a quick display and selection replacement of emoticons that match the emoticon tag of the first emoticon or emoticons that do not match the emoticon tag of the first emoticon can be provided; making it more efficient for users to regret and replace emoticons when they send the wrong or inappropriate ones.

[0170] The following description continues to illustrate the exemplary structure of the expression processing device 555 provided in the embodiments of this application as a software module. In some embodiments, such as... Figure 3 As shown, the software module in the expression processing device 555 stored in the memory 540 may include: The first presentation module is used to present conversation messages containing the first emoticon in the conversation interface; The second presentation module is used to present one or more candidate expressions in response to a replacement instruction for the first expression; A replacement module is configured to, in response to an expression selection operation triggered based on one or more of the candidate expressions, replace the presentation of the first expression with the presentation of the second expression selected by the expression selection operation at the presentation location of the first expression.

[0171] In some embodiments, the first presentation module is further configured to present a replacement function item in response to a press operation on the first emoticon in the conversation message; In response to a trigger operation for the replacement function item, a replacement instruction for the first expression is generated.

[0172] In some embodiments, the second presentation module is further configured to present one or more candidate expressions that match the expression tag of the first expression.

[0173] In some embodiments, the first presentation module is further configured to receive a target gesture operation triggered at the presentation location of the first expression; When the target gesture operation is a gesture operation corresponding to the replacement instruction, the replacement instruction for the first expression is triggered.

[0174] In some embodiments, the second presentation module is further configured to acquire user behavior data related to facial expressions; Based on the behavioral data, one or more emojis preferred by the user are identified as candidate emojis.

[0175] In some embodiments, the second presentation module is further configured to present an emoji search box; Receive emoji information based on the emoji search box; In response to a search command triggered based on the facial expression information, one or more candidate facial expressions that match the facial expression information are presented.

[0176] In some embodiments, the second presentation module is further configured to present editing function items for the first expression; In response to an operation triggered by an editing function item, an editing interface corresponding to the first emoticon is displayed; In response to an editing operation on the first emoticon triggered by the editing interface, the edited emoticon is presented and used as a candidate emoticon.

[0177] In some embodiments, the second presentation module is further configured to present audio addition features for facial expressions; In response to an action triggered by the audio addition feature, the audio addition page is displayed; Receive the audio file input based on the audio addition page; The switching module is also used to cancel the presentation of the first emoticon and present the second emoticon selected by the emoticon selection operation; When the second expression is displayed, the audio file is played.

[0178] In some embodiments, the second presentation module is further configured to receive a sliding operation for the candidate expression, wherein the sliding direction of the sliding operation is a first target direction; Along with the sliding operation, one or more candidate expressions are simultaneously moved in and out of the candidate expression display area corresponding to the candidate expression; Among them, the candidate expressions that move into the candidate expression display area and the candidate expressions that move out of the candidate expression display area have matching expression tags.

[0179] In some embodiments, the second presentation module is further configured to present one or more candidate expressions that have matching expression tags to the first expression; A swipe operation is received for the candidate expression, wherein the swipe direction is the second target direction; In response to the sliding operation, the size of the candidate expression display area corresponding to the candidate expression is increased, and Within the presentation area, one or more candidate expressions with expression tags that do not match the first expression are presented.

[0180] In some embodiments, the second presentation module is further configured to present one or more candidate expressions obtained based on the first filtering rule; After presenting one or more candidate expressions, the method further includes: A switching operation for the candidate expression has been received; In response to the switching operation, the presented one or more candidate expressions obtained based on the first filtering rule are switched to one or more candidate expressions obtained based on the second filtering rule; The first filtering rule is different from the second filtering rule.

[0181] In some embodiments, the second presentation module is further configured to present a confirmation replacement function item; In response to a trigger operation on the confirmed replacement function item, the presentation of one or more candidate expressions is canceled, and A message indicating successful replacement is displayed.

[0182] In some embodiments, the first presentation module is further configured to receive a conversation message containing a third emoticon and present the conversation message containing the third emoticon on the conversation interface; A fourth expression is received to replace the third expression; At the location where the third expression is displayed, the third expression will be replaced with the fourth expression.

[0183] In some embodiments, the first presentation module is further configured to present a prompt message containing a third emoticon in the conversation message list; A fourth expression is received to replace the third expression; In response to a presentation instruction for a conversation message triggered based on the prompt information, a conversation message containing the fourth emoticon is presented in the conversation interface.

[0184] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method described in this application.

[0185] This application provides a computer-readable storage medium storing executable instructions. When these executable instructions are executed by a processor, they cause the processor to perform the method provided in this application, for example... Figure 4 The method shown.

[0186] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.

[0187] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0188] As an example, executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple collaborating files (e.g., a file that stores one or more modules, subroutines, or code sections).

[0189] As an example, executable instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0190] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. A method for processing facial expressions, characterized in that, The method includes: Display the conversation message containing the first emoticon in the conversation interface; In response to a replacement instruction for the first expression, a candidate expression display area is presented, and one or more candidate expressions are presented in the candidate expression display area; In response to a swipe operation on the candidate expression, if the swipe direction is a first target direction, at least one candidate expression with a matching expression tag is displayed in the candidate expression display area. If the sliding direction of the sliding operation is the second target direction, at least one candidate expression that does not match the expression label of the first expression will be presented in the candidate expression presentation area; In response to an expression selection operation triggered by a candidate expression displayed in the candidate expression display area, at the display position of the first expression, the first expression is replaced by the second expression selected by the expression selection operation.

2. The method as described in claim 1, characterized in that, Before presenting a candidate expression display area in response to a replacement instruction for the first expression, and before presenting one or more candidate expressions in the candidate expression display area, the method further includes: In response to a press operation on the first emoticon in the conversation message, a replacement function item is displayed; In response to a trigger operation for the replacement function item, a replacement instruction for the first expression is generated.

3. The method as described in claim 2, characterized in that, The response to a press operation on the first emoticon in the conversation message, presenting a replacement function item, includes: In response to a press operation on the first emoji, a toolbar corresponding to the first emoji is displayed; The replacement function item is presented in the toolbar.

4. The method as described in claim 1, characterized in that, Before presenting a candidate expression display area in response to a replacement instruction for the first expression, and before presenting one or more candidate expressions in the candidate expression display area, the method further includes: Receive the target gesture operation triggered at the display position of the first expression; When the target gesture operation is a gesture operation corresponding to the replacement instruction, the replacement instruction for the first expression is triggered.

5. The method as described in claim 1, characterized in that, Presenting one or more candidate expressions in the candidate expression presentation area includes: In the candidate expression display area, one or more candidate expressions that match the expression tag of the first expression are displayed.

6. The method as described in claim 5, characterized in that, The number of candidate expressions is multiple, and the presentation of one or more candidate expressions that match the expression tag of the first expression includes: Multiple candidate expressions that match the expression tag of the first expression are presented, and the multiple candidate expressions are arranged in order of matching degree from high to low; The matching degree is the matching degree between the expression tag of the first expression and each of the candidate expressions.

7. The method as described in claim 1, characterized in that, The method of presenting one or more candidate expressions in the candidate expression presentation area further includes: In the candidate expression display area, one or more candidate expressions determined based on user behavior data regarding expressions are displayed.

8. The method as described in claim 1, characterized in that, Presenting one or more candidate expressions in the candidate expression presentation area includes: Display the emoji search box; Receive emoji information based on the emoji search box; In response to a search command triggered based on the expression information, one or more candidate expressions that match the expression information are displayed in the candidate expression display area.

9. The method as described in claim 1, characterized in that, Presenting one or more candidate expressions in the candidate expression presentation area includes: Present the voice search function; In response to a trigger action on the voice search function, voice recording is started to input facial expression information via voice. In response to a search command triggered based on the expression information, one or more candidate expressions that match the expression information are displayed in the candidate expression display area.

10. The method as described in claim 1, characterized in that, Before presenting a candidate expression display area in response to a replacement instruction for the first expression, and before presenting one or more candidate expressions in the candidate expression display area, the method further includes: Present the editing functions for the first expression; In response to an operation triggered by an editing function item, an editing interface corresponding to the first emoticon is displayed; In response to an editing operation on the first emoticon triggered by the editing interface, the edited emoticon is presented and used as a candidate emoticon.

11. The method as described in claim 10, characterized in that, The step of responding to an editing operation on a first emoticon triggered by the editing interface and presenting the edited emoticon includes: In response to a text addition operation triggered by the editing interface, the input text is overlaid on the first emoticon to present the edited emoticon in real time.

12. The method as described in claim 1, characterized in that, Before replacing the presentation of the first expression with the presentation of the second expression selected by the expression selection operation at the presentation position of the first expression, the method further includes: Add audio features specifically for facial expressions; In response to an action triggered by the audio addition feature, the audio addition page is displayed; Receive the audio file input based on the audio addition page; Replacing the first emoticon with the second emoticon selected by the emoticon selection operation includes: Cancel displaying the first emoticon and display the second emoticon selected by the emoticon selection operation; When the second expression is displayed, the audio file is played.

13. The method as described in claim 1, characterized in that, If the sliding direction of the sliding operation is a first target direction, at least one candidate expression with a matching expression tag is presented in the candidate expression display area, including: If the sliding direction of the sliding operation is the first target direction, one or more candidate expressions will be moved in and out of the candidate expression display area simultaneously with the sliding operation; Among them, the candidate expressions that move into the candidate expression display area and the candidate expressions that move out of the candidate expression display area have matching expression tags.

14. The method as described in claim 1, characterized in that, If the sliding direction of the sliding operation is the second target direction, at least one candidate expression that does not match the expression label of the first expression will be presented in the candidate expression display area, including: If the sliding direction of the sliding operation is the second target direction, the size of the candidate expression display area is increased, and one or more candidate expressions with expression labels that do not match the first expression are displayed in the increased candidate expression display area.

15. The method as described in claim 1, characterized in that, Presenting one or more candidate expressions in the candidate expression presentation area includes: In the candidate expression display area, one or more candidate expressions obtained based on the first filtering rule are displayed; After presenting one or more candidate expressions in the candidate expression presentation area, the method further includes: A switching operation for the candidate expression has been received; In response to the switching operation, the presented one or more candidate expressions obtained based on the first filtering rule are switched to one or more candidate expressions obtained based on the second filtering rule; The first filtering rule is different from the second filtering rule.

16. The method as described in claim 1, characterized in that, Presenting one or more candidate expressions in the candidate expression presentation area includes: A first target number of candidate expressions are displayed in the candidate expression display area; After presenting one or more candidate expressions in the candidate expression presentation area, the method further includes: In response to the switching operation for the candidate expressions, the first target number of candidate expressions is switched to the second target number of candidate expressions; The first target quantity is different from the second target quantity.

17. The method as described in claim 1, characterized in that, After replacing the presentation of the first expression with the presentation of the second expression selected by the expression selection operation at the presentation position of the first expression, the method further includes: Present the confirmation / replacement function item; In response to the triggering operation of the confirmation replacement function item, the presentation of the one or more candidate expressions is canceled, and a prompt message indicating successful replacement is displayed.

18. The method as described in claim 17, characterized in that, Before canceling the presentation of the one or more candidate emojis and presenting a successful replacement message in response to a trigger operation on the confirmed replacement function item, the method further includes: In response to a re-emoji selection operation triggered based on the one or more candidate emojis, at the presentation location of the first emoji, the presented second emoji is updated to the emoji selected by the re-emoji selection operation.

19. The method as described in claim 1, characterized in that, The method further includes: Receive a conversation message containing a third emoticon, and display the conversation message containing the third emoticon on the conversation interface; A fourth expression is received to replace the third expression; At the position where the third expression is displayed, the displayed third expression is replaced with the fourth expression.

20. The method as described in claim 1, characterized in that, The method further includes: Display a notification message in the chat message list that includes a third emoticon; A fourth expression is received to replace the third expression; In response to a presentation instruction for a conversation message triggered based on the prompt information, a conversation message containing the fourth emoticon is presented in the conversation interface.

21. The method as described in claim 1, characterized in that, The presentation of the conversation message containing the first emoticon in the conversation interface includes: Presents conversation messages including the first emoticon and text; The step of replacing the presentation of the first emoticon with the presentation of the second emoticon selected by the emoticon selection operation at the presentation position of the first emoticon includes: Keeping the text unchanged, replace the first emoticon presented in the conversation message with the second emoticon.

22. An expression processing device, characterized in that, The device includes: The first presentation module is used to present conversation messages containing the first emoticon in the conversation interface; The second presentation module is used to present a candidate expression presentation area in response to a replacement instruction for the first expression, and to present one or more candidate expressions in the candidate expression presentation area; The second presentation module is further configured to respond to a sliding operation on the candidate expression, and if the sliding direction of the sliding operation is a first target direction, to present at least one candidate expression with a matching expression tag in the candidate expression presentation area. If the sliding direction of the sliding operation is the second target direction, at least one candidate expression that does not match the expression label of the first expression will be presented in the candidate expression presentation area; The replacement module is configured to, in response to an expression selection operation triggered by a candidate expression displayed in the candidate expression display area, replace the first expression with the second expression selected by the expression selection operation at the display position of the first expression.

23. A computer device, characterized in that, include: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the facial expression processing method according to any one of claims 1 to 21.

24. A computer-readable storage medium, characterized in that, It stores executable instructions for implementing the facial expression processing method according to any one of claims 1 to 21 when executed by a processor.

25. A computer program product comprising computer-executable instructions or a computer program, characterized in that, When the computer-executable instructions or computer program are executed by a processor, the facial expression processing method according to any one of claims 1 to 21 is implemented.

Images