Expression use method and device, equipment and storage medium

Abstract

According to the embodiment of the invention, a method, a device and equipment for expression use and a storage medium are provided. In the method, in response to detection of a preset triggering operation on a first message in a message receiving and sending interface, a terminal device provides a plurality of expression sets corresponding to a plurality of expression types, and the plurality of expression sets at least comprise a first expression set corresponding to the first expression type; wherein the expression image in the first expression set is generated by using an image generation model based on an image input by a user; and in response to detection of selection of at least one expression image in the plurality of expression sets, displaying the at least one expression image in association with the first message, where the at least one expression image is at least partially superimposed on the first message. In this way, the interestingness of the interaction process between different users is improved.

Description

Technical Field

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for using emoticons. Background Art

[0002] Currently, more and more applications are designed to provide various services to users. Many applications can support message interaction between users. Messages can include various types of messages, such as video, image, audio, text, etc. In the process of message interaction with other users, users can send emoticons to enhance the fun of interaction. Users expect to be able to interact with multiple emoticons in order to further improve the amount of information and interaction efficiency in the message interaction process. Summary of the invention

[0003] In a first aspect of the present disclosure, a method for using emoticons is provided. The method includes: in response to detecting a preset trigger operation on a first message in a message sending and receiving interface, providing multiple emoticon sets corresponding to multiple emoticon types, the multiple emoticon sets at least including a first emoticon set corresponding to a first emoticon type, and the emoticon images in the first emoticon set are generated based on images input by a user using an image generation model; and in response to detecting a selection of at least one emoticon image in the multiple emoticon sets, displaying the at least one emoticon image in association with the first message, and at least partially superimposing the at least one emoticon image on the first message.

[0004] In a second aspect of the present disclosure, a device for using emoticons is provided. The device includes: an emoticon providing module configured to provide multiple emoticon sets corresponding to multiple emoticon types respectively in response to detecting a preset trigger operation on a first message in a message sending and receiving interface, wherein the multiple emoticon sets at least include a first emoticon set corresponding to a first emoticon type, and the emoticon images in the first emoticon set are generated based on images input by a user using an image generation model; and an associated display module configured to: in response to detecting a selection of at least one emoticon image in the multiple emoticon sets, display at least one emoticon image in association with the first message, wherein the at least one emoticon image is at least partially superimposed on the first message.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit. When the instructions are executed by the at least one processing unit, the device executes the method of the first aspect.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the contents described in this content section are not intended to limit the key features or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0010] Figure 2 A schematic diagram showing an example architecture for expression creation according to some embodiments of the present disclosure;

[0011] Figure 3 shows an example user interface according to some embodiments of the present disclosure;

[0012] Figure 4A and 4B shows an example user interface according to some embodiments of the present disclosure;

[0013] Figures 5 to 17 shows an example user interface according to some embodiments of the present disclosure;

[0014] Fig.18 A flowchart of a method for using emoticons according to some examples of the present disclosure is shown;

[0015] Fig.19 A block diagram showing an apparatus for using emoticons according to some embodiments of the present disclosure; and

[0016] Fig. 20 A block diagram of a device capable of implementing various embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0018] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0019] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0020] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0021] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0022] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information, so that the user can independently choose whether to provide personal information to software or hardware such as electronic devices, applications, servers or storage media that perform operations of the technical solution of the present disclosure based on the prompt message.

[0023] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information is sent to the user in a manner such as a pop-up window, in which the prompt information can be presented in text form. In addition, the pop-up window can also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0024] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0025] In the field of information interaction, compared with pure text, emoticons can express the user's intentions more vividly. Therefore, more and more users tend to use emoticons to communicate. With the further development of image and artificial intelligence (AI) technology, emoticons based on AI technology have gradually come into people's view. In other words, when interacting with information, users can use both traditional emoticons and AI-based emoticons. In this case, the presentation and interaction logic of the user interface will become more complex and diverse. Therefore, while supporting both traditional emoticons and AI-based emoticons, how to coordinate the presentation and processing of the interaction logic of the two types of emoticons is a problem that needs to be solved urgently.

[0026] According to an embodiment of the present disclosure, a method, apparatus, device and storage medium for using emoticons are provided. In this scheme, in response to detecting a preset trigger operation on a first message in a message sending and receiving interface, a terminal device provides multiple emoticon sets corresponding to multiple emoticon types, respectively, wherein the multiple emoticon sets include at least a first emoticon set corresponding to a first emoticon type, and the emoticon images in the first emoticon set are generated based on images input by the user using an image generation model. Further, in response to detecting a selection of at least one emoticon image in the multiple emoticon sets, the terminal device displays at least one emoticon image in association with the first message, and at least one emoticon image is at least partially superimposed on the first message. In this way, the fun of the interaction process between different users is enhanced.

[0027] The term "work" in the present disclosure refers to any type of media work, including but not limited to audio files, video files, picture files, text files, etc. Specifically, the work can be a short video, music, pictures, picture collections, multimedia clips, audio-visual materials, etc. The present disclosure is not limited in this respect.

[0028] The term "expression image" in the present disclosure is also referred to as expression, expression sticker, expression icon, etc. In the present disclosure, the expression image generated by the model is also referred to as artificial expression image or AI expression for short, to distinguish it from the expression not generated by the model.

[0029] The term "expression library" of the present disclosure is also referred to as an expression panel or sticker panel in a message sending and receiving interface. A general entrance to the expression library is usually provided in the message sending and receiving interface, through which all expression sets associated with the user can be viewed. In some embodiments, each expression set in the expression library has a corresponding navigation label, and by selecting different navigation labels, the expression images in the corresponding expression set can be viewed.

[0030] Example Environment

[0031] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. The environment 100 includes one or more users 110-1, 110-2, 110-3, ..., 110-N that can send and receive messages through their respective associated terminal devices 120-1, 120-2, 120-3, ..., 120-N. For ease of discussion, users 110-1, 110-2, 110-3, ..., 110-N may be collectively or individually referred to as users 110, and terminal devices 120-1, 120-2, 120-3, ..., 120-N may be collectively or individually referred to as terminal devices 120. In some scenarios, user 110 may publish and comment on works in a target platform through associated terminal devices 120. In some scenarios, user 110 is also referred to as the publisher of the work.

[0032] The terminal device 120 may be installed with an application 125 that supports message interaction (i.e., the terminal device 120-1 has application 125-1 installed, the terminal device 120-2 has application 125-2 installed, the terminal device 120-3 has application 125-3 installed, ..., the terminal device 120-N has application 125-N installed). It should be noted that the applications 125 installed in different terminal devices 120 may be exactly the same applications or different applications (e.g., different versions). The application 125 may be any appropriate application with message sending and receiving functions, such as a dedicated chat application, a social application, a content sharing application, an office support application, and the like.

[0033] exist Figure 1 In the environment 100 of FIG. 1 , if the application 125 is in an active state, the terminal device 120 can present the user interface of the application 125. This user interface can include various interfaces that the application 125 can provide, such as a user interface that supports message interaction, a user interface that supports content browsing, a message sending and receiving interface, etc. Through different user interfaces, the application 125 can provide different content to the user 110. Through appropriate means, such as clicking or selecting any appropriate element in the user interface, the application 125 can also provide the user 110 with the selection and switching of the presentation mode of the associated content.

[0034] In some embodiments, different terminal devices 120 may also communicate with the server 130 via the network 132 to provide message interaction services. The server 130 may provide management, configuration, and maintenance functions for the application 125.

[0035] The terminal device 120 can be any type of mobile terminal, fixed terminal or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication systems (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, television receivers, radio broadcast receivers, e-book devices, gaming devices, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 120 can also support any type of interface for the user (such as "wearable" circuits, etc.). The server 130 can be various types of computing systems / servers that can provide computing power, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0036] It should be understood that the structure and function of the various elements in the environment 100 are described for exemplary purposes only and do not imply any limitation on the scope of the present disclosure.

[0037] Various example implementations of the present disclosure will be described in detail below.

[0038] Example Framework

[0039] Figure 2 FIG. 2 is a schematic diagram showing an example architecture 200 for creating emoticons according to some embodiments of the present disclosure. Figure 2 As shown, the architecture 200 involves the terminal device 120 and the image generation model 210 .

[0040] The image generation model 210 can be run locally on the terminal device 120 or deployed remotely, for example, on a server (e.g., server 130), in a cloud environment, etc. In the case of local operation, the terminal device 120 can directly provide the model input to the image generation model 210 installed locally, and obtain the model output generated by the image generation model 210. In the case of remote operation, the terminal device 120 provides data to other electronic devices through a communication connection with other electronic devices. Other electronic devices determine the model input based on the acquired data and provide the model input to the image generation model 210. After the other electronic devices obtain the model output of the image generation model 210, they provide the model output to the terminal device 120 through the communication connection with the terminal device 120 so that the terminal device 120 obtains the model output. For the convenience of description, the following is an exemplary description using the image generation model 210 installed locally on the terminal device 120 (that is, the terminal device 120 can directly provide the model input to the image generation model 210 and can directly obtain the model output from the image generation model 210).

[0041] When the application 125 is active, the terminal device 120 may present a user interface supporting message interaction provided by the application 125. In an embodiment of the present disclosure, the terminal device 120 detects an expression creation operation corresponding to the first type in the user interface supporting message interaction. The first type here may be, for example, a type corresponding to an AI expression. This user interface supporting message interaction may include, for example, a first expression creation entry for creating an expression corresponding to the first type. The terminal device 120 may determine that an expression creation operation corresponding to the first type is detected in response to detecting a trigger operation of the user 110 on the first expression creation entry. It can be understood that in some embodiments, multiple creation entries corresponding to multiple types of expressions may be provided in the user interface supporting message interaction, and these multiple creation entries include a first expression creation entry and creation entries corresponding to other types of expressions. The present disclosure does not limit the number of creation entries included in the user interface and the types of expressions corresponding to other creation entries.

[0042] In response to detecting the expression creation operation, the terminal device 120 obtains the target image 202 (also referred to as the target image 202) including the face input by the user 110. The target image 202 is an image including at least the face of the target object, where the target object may be an object with various facial expressions, such as a person or an animal. The terminal device 120 may, for example, capture the target image 202 input by the user 110 through an image acquisition device (such as a camera). The terminal device 120 may also, for example, obtain the target image 202 selected by the user 110 and stored locally in the terminal device 120.

[0043] The terminal device 120 can then use the image generation model 210 to generate at least one expression image 212 of the first type based on the target image 202 and the prompt word input (for example, it can include expression images 212-1, 212-2, 212-3, ..., 212-N, where N is a positive integer, and the expression images 212-1, 212-2, 212-3, ..., 212-N can be collectively or individually referred to as expression images 212). The prompt word input indicates at least one expression style to be generated. Different expression styles can convey different facial expressions and emotions, such as smiling, laughing, sadness, crying, etc.

[0044] Herein, the image generation model 210 may be any appropriate machine learning model with image generation capability. For example, the image generation model 210 may be based on a diffusion model, such as a three-dimensional animation diffusion model.

[0045] The quality of the image generated by the image generation model 210 will be affected by the model training data and the currently input target image 202. In some embodiments, in order to ensure the quality of the generated expression image 212 as much as possible, the terminal device 120 can also use a series of facial detection models (for example, it can include an eye detection model, an angle detection model, an expression detection model, etc.) to detect the target image 202. For example, the terminal device 120 can only provide the target image 202 to the image generation model 210 after the target image 202 passes the detection of a series of facial detection models. In some embodiments, this series of facial detection models can also be used to guide the user 110 to provide a target image 202 that meets the requirements. For example, if the target image 202 fails to pass the detection, the terminal device 120 can present prompt information to prompt the user 110 how to obtain a target image 202 that meets the requirements based on the detection results output by the series of facial detection models.

[0046] In some embodiments, the expression style specified for generating the expression image 212 may include at least one predefined expression style, at least one expression style indicated by the user, and / or at least one expression style determined based on a trend event, and the like. The predefined expression style here may be, for example, a default expression style acquired in advance, that is, an expression style that the model outputs by default during the expression creation process. The expression style indicated by the user may be, for example, an expression style that the user can select or customize. For example, before creating an expression image, a list of optional expression styles may be provided to the user, from which the user may select one or more expression styles to be created. In some implementations, the user may also be allowed to define the expression style to be generated by inputting a natural language or providing a reference image. The expression style determined based on a trend event here may be at least one expression style that matches the trend event determined by the terminal device 120 analyzing the trend event. For example, if the current time is a festival, the terminal device 120 may determine at least one expression style that matches the festival, and automatically use the determined expression style to generate an expression image when the user needs to create an expression.

[0047] The prompt word input is used to at least guide the image generation model 210 to generate the indicated expression style. In some embodiments, the prompt word input and the expression style can be a one-to-one, one-to-many or many-to-one relationship. That is, one expression style can correspond to one prompt word input, one prompt word input can correspond to multiple expression styles, or one expression style can correspond to multiple prompt word inputs. Exemplarily, Table 1 shows an example of the corresponding relationship between expression styles and prompt word inputs.

[0048] Table 1

[0049]

[0050] As shown in Table 1, the terminal device 120 can determine the corresponding prompt word input based on the expression style, or determine the corresponding expression style based on the prompt word input. For example, the terminal device 120 can obtain at least one expression style corresponding to at least one expression image 212 to be generated, and determine at least one prompt word input corresponding to the at least one expression style based on Table 1.

[0051] The terminal device 120 can provide the target image 202 input by the user and the constructed prompt word input to the image generation model 210, so that the image generation model 210 generates at least one expression image 212 based on the prompt word input and the target image 202. In this article, the expression image may also be referred to as an expression, an emoticon, an expression sticker, etc. In this article, the expression image 212 generated by the model is also called an AI expression image or simply an AI expression to distinguish it from an expression that is not generated by the model. The number of expression images 212 generated can be, for example, the number indicated by the prompt word input. In some embodiments, the expression image 212 can be a static expression image or a dynamic expression image (i.e., a gif).

[0052] It should be noted that, in the case where a certain expression style corresponds to multiple prompt word inputs, the terminal device 120 can, for example, provide all of the multiple prompt word inputs as prompt word inputs corresponding to the expression style to the image generation model 210 to obtain multiple expression images 212 corresponding to the multiple prompt word inputs generated by the image generation model 210. Although the multiple expression images 212 correspond to the same expression style, they are different images. That is, the image generation model 210 can generate multiple different expression images 212 corresponding to one expression style based on multiple prompt word inputs.

[0053] Each expression image 212 includes a change object corresponding to the target object, and the face of the change object has a corresponding expression style. The change object refers to converting the target image into a specific image or appearance style. For example, the change object included in the expression image 212 can be designed according to a specific painting style such as a cartoon character, a sketch, or an oil painting.

[0054] The terminal device 120 may store the at least one acquired expression image 212 in an expression library associated with the user 110 for use in message interaction. The expression library may be, for example, an expression library of the account corresponding to the user 110 in the application 125. After the user 110 logs in to the corresponding account, the expression image desired by the user 110 may be selected from the expression library to interact with the message during the message interaction. In some embodiments, the terminal device 120 may also review the at least one acquired expression image 212 to determine whether the at least one expression image 212 includes an inappropriate expression image (for example, whether it includes an expression image with an expression that is too strange or distorted). The terminal device 120 may then store the expression images that have passed the review. Alternatively or additionally, in some embodiments, the image generation model 210 may also review the generated at least one expression image 212 by itself, and only provide the expression image 212 that has passed the review to the terminal device 120.

[0055] In some embodiments, if the image generation model 210 is installed on other electronic devices, after the image generation model 210 generates at least one expression image 212 , the other electronic devices (or the image generation model 210 ) can immediately delete the acquired target image 202 to ensure the information security of the user 110 .

[0056] In this way, the model's image generation capability can be used to enable users to customize emoticon images by simply providing target images and obtain their own unique emoticon images. This image creation process is simple and can provide different emoticon images for different users, making the message interaction process richer.

[0057] Continue to refer to Figures 3 to 17 The example interface / example page shown is used to describe an example embodiment of emoticon creation.

[0058] Example Process

[0059] Only for a better understanding of the various embodiments of the present disclosure, reference is made to the following exemplary embodiments. Figures 3 to 17 The example user interfaces 300 to 1700 are shown. It should be understood that Figures 3 to 17 The user interfaces shown are merely examples, and various designs may exist in practice. For example, the various graphical elements and / or controls in the user interface may have different arrangements and different visual representations, one or more of the elements and / or controls may be omitted or replaced, and one or more other elements and / or controls may also exist. In addition, any appropriate content may be included in the user interface. The scope of the present disclosure is not limited in this respect.

[0060] Further, the user can switch and jump between user interfaces by activating controls / entries in each user interface. It should be understood that the logic of switching and jumping can be set arbitrarily. For example, in an example embodiment, the user jumps from the first user interface to the second user interface by activating a control. In other embodiments, the user can jump from the first user interface to the third user interface by activating another control. The present disclosure is not limited in this respect. It should also be understood that although multiple user interfaces are described in a specific embodiment, any user interface described in the present disclosure can be independently implemented and protected as a separate embodiment.

[0061] In an example embodiment of the present disclosure, the example user interfaces 300 to 1700 may be implemented at the terminal device 120. For ease of discussion, reference will be made to Figure 1 Example user interfaces 300 to 1700 are described with reference to the environment 100 of FIG.

[0062] In operation, the terminal device 120 detects a preset trigger operation of the first message in the message sending and receiving interface. If the preset trigger operation of the first message in the message sending and receiving interface is detected, the terminal device 120 provides multiple expression sets corresponding to multiple expression types respectively.

[0063] In the present disclosure, the message sending and receiving interface includes at least a message area and an input area, wherein the message area refers to an area used to display interactive messages between users and system messages, and the input area includes various controls for inputting messages, including an input box, an entrance to an emoticon library, etc.

[0064] In some embodiments, the plurality of expression sets at least includes a first expression set corresponding to a first expression type. The expression images in the first expression set are generated based on the image input by the user using an image generation model. The generation of the first expression set is responsive to the generation of the expression images in the first expression set. Figure 2 Example embodiments discussed.

[0065] See also Figure 3 The example user interface 300 is shown. The example user interface 300 is a message sending and receiving interface and includes a first message 305. If a preset trigger operation on the first message 305 is detected, the terminal device 120 provides multiple expression sets corresponding to multiple expression types respectively. Figure 3 In the example embodiment of , the plurality of expression sets include a first expression set and a second expression set, wherein the expression image 340 in the first expression set is generated using an image generation model. In view of this, the expression image 340 in the first expression set can also be called an AI-expression.

[0066] In some embodiments, the terminal device 120 detects a selection of at least one emoticon image from a plurality of emoticon sets. If the selection of at least one emoticon image from a plurality of emoticon sets is detected, the terminal device 120 displays the at least one emoticon image in association with the first message, for example, the selected at least one emoticon image is at least partially superimposed on the first message. In this document, the display area of ​​the message is also referred to as a message bubble.

[0067] It should be understood that the selection operation includes but is not limited to single-point contact, multi-point touch, sliding, etc. in the corresponding area. It should be understood that this is only exemplary and is not intended to limit the solution of the present disclosure. In other embodiments, the selection operation may also be other gesture operations, stylus operations, or other interactive operations. The present disclosure is not limited in this respect.

[0068] By superimposing emoticon images on corresponding messages, the visual presentation process of message interaction is enriched.

[0069] In some embodiments, the selected expression image is superimposed and presented in the lower middle of the display area of ​​the first message. In other embodiments, the selected expression image is superimposed and presented in the lower right corner of the display area of ​​the first message. It should be understood that the present disclosure does not limit the position where the expression image is superimposed and displayed.

[0070] Additionally, in some embodiments, the at least one expression image selected from the multiple expression sets includes: at least one expression image from the first expression set, and at least one expression image from the second expression set from the multiple expression sets.

[0071] See also Figure 4A The example user interface 400A is shown. Figure 4A As shown, the emoticon images 410 in the first emoticon set are superimposed on the corresponding message. Alternatively, the emoticon images 420 in the second emoticon set can also be superimposed on the corresponding message.

[0072] In some embodiments, the interaction process of the first expression set and the second expression set may be independent of each other. Specifically, for the same message, the user may select multiple expression images, including a first expression image from the first expression set and a second expression image from the second expression set.

[0073] Additionally, in some embodiments, the number of expression images selected by the user may be restricted. Specifically, the user can only select one expression image in the first expression set.

[0074] See also Figure 4A .exist Figure 4AIn the example embodiment of , the display size of the expression image 410 is larger than the display size of the expression 420. This is because the expression image generated by AI contains richer information and can be designed to be larger in size. In this way, the visual display of the superimposed display is further enhanced.

[0075] In some embodiments, multiple emoticon images in multiple emoticon sets can be selected. For example, the user selects the displayed emoticon images by clicking multiple times. In this way, the user can overlay the same or different emoticon images on multiple messages or overlay different emoticon images on the same message.

[0076] In some embodiments, the preset trigger operation includes at least a long press operation. Figure 3 In the example embodiment of , the user can trigger the presentation of multiple emoticon sets by long pressing the first message 305. In other embodiments, the preset trigger operation may also include hovering of the mouse, clicking of the right button of the mouse, and double-clicking of the left button of the mouse. The present disclosure is not limited in the specific implementation of the preset trigger operation.

[0077] As discussed below, according to some embodiments of the present disclosure, interfaces corresponding to multiple expression sets may be presented to the user in a more user-friendly manner so that the user may quickly select a corresponding expression image.

[0078] In some embodiments, the terminal device 120 detects a preset operation for the first message. If the preset operation for the first message is detected, the terminal device 120 displays an expression bar superimposed on the message area of ​​the message sending and receiving interface, wherein the expression bar at least includes a first navigation label corresponding to the first expression set and a second navigation label corresponding to the second expression set, and the navigation labels in the expression bar can be selected respectively so that the corresponding expression set is displayed in the expression bar. In some embodiments, when the expression bar is displayed, the first navigation label is selected by default so that the first expression set is displayed in the expression bar.

[0079] See also Figure 3 An example user interface 300 is shown. Figure 3 In the example embodiment, when the terminal device 120 detects a preset operation for the first message 305, the terminal device 120 overlays and displays an expression bar 350 on the message area of ​​the message sending and receiving interface, wherein the expression bar at least includes a first navigation label 320 corresponding to the first expression set and a second navigation label 330 corresponding to the second expression set, and the navigation labels in the expression bar 350 can be selected respectively so that the corresponding expression set is displayed in the expression bar 350. Figure 3 As shown, when the emoticon bar 350 is displayed, the first navigation tab 320 is selected by default, so that the first emoticon set is displayed in the emoticon bar 350 .

[0080] In some embodiments, except for the first navigation tag, the order of the remaining navigation tags can be determined based on at least one of the following: the most recent navigation tag order setting, historical usage information of emoticons, etc.

[0081] As discussed below, according to some embodiments of the present disclosure, when multiple emoticon images are superimposed on the same message, the presentation process of the multiple emoticon images can be further optimized.

[0082] In some embodiments, if a selection of multiple emoticon images from multiple emoticon sets is detected, the terminal device 120 displays an emoticon container in association with the first message, wherein the emoticon container includes thumbnails of each of the multiple emoticon images, and the emoticon container is at least partially superimposed on the display area of ​​the first message.

[0083] In some embodiments, the emoticon container is superimposed and presented in the lower middle of the display area of ​​the first message. In other embodiments, the emoticon container is superimposed and presented in the lower right corner of the display area of ​​the first message. It should be understood that the present disclosure does not limit the presentation position of the emoticon container.

[0084] See also Figure 4B An example user interface 400B is shown. Figure 4B In the example embodiment, the terminal device 120 displays the emoticon container 450 in association with the first message, wherein the emoticon container 450 includes thumbnails of each of the plurality of emoticon images and the emoticon container is at least partially superimposed on the display area of ​​the first message.

[0085] Additionally, in some embodiments, the emoticon container is associated with the first emoticon set. In other words, only emoticon images in the first emoticon set are added to the emoticon container.

[0086] In some embodiments, when a first message has at least one other emoticon image that has been associated with it and displayed, if the terminal device 120 detects a selection of at least one emoticon image from a plurality of emoticon sets, the terminal device 120 displays an emoticon container in association with the first message, wherein the emoticon container includes at least one other emoticon image and a thumbnail of each of the at least one emoticon image, and the emoticon container is at least partially superimposed on a display area of ​​the first message.

[0087] As discussed below, according to some embodiments of the present disclosure, the terminal device 120 may provide an expression viewing panel so that the user can know which user posted the superimposed expression.

[0088] In some embodiments, if a selection of an emoticon image displayed in association with a first message is detected, the terminal device 120 presents an emoticon viewing panel in the message sending and receiving interface, wherein the emoticon viewing panel includes the emoticon image displayed in association with the first message and the sending user of the emoticon image.

[0089] See also Figure 5 An example user interface 500 is shown. Figure 5 In the example embodiment of , the terminal device 120 detects the selection of an emoticon image displayed in association with the first message, for example, the selection of the emoticon container 510 or any emoticon in the emoticon container 510, and the terminal device 120 presents the emoticon viewing panel 520 in the message sending and receiving interface. Figure 5 As shown, the expression viewing panel 520 includes an expression image displayed in association with the first message and a sending user of the expression image.

[0090] Additionally, in some embodiments, the emoticon viewing panel includes an entry to the user details page of the user who sent the emoticon image.

[0091] See also Figure 5 An example user interface 500 is shown. Figure 5 In the example embodiment, the expression viewing panel 520 includes an expression image displayed in association with the first message and the sending user of the expression image. If an activation operation is detected for the presented expression image and / or the area associated with the sending user of the expression image, the user is redirected to the user details page of the sending user, also known as a personal homepage, a user profile page, for displaying user related information.

[0092] In some embodiments, the presentation of the expression preview panel can be cancelled. Specifically, in response to the user's sliding operation in the area where the expression viewing panel 520 is located, the terminal device 120 can cancel the display of the expression viewing panel 520.

[0093] As discussed below, according to some embodiments of the present disclosure, the terminal device 120 may preferentially recommend expression images in the first expression set to the user through the expression preview panel.

[0094] In some embodiments, if it is detected that the message sending and receiving interface is presented, the terminal device 120 presents an expression preview panel in the message area of ​​the message sending and receiving interface, wherein the expression preview panel includes one or more expression images in the first expression set.

[0095] See also Figure 6 An example user interface 600 is shown. Figure 6In the example embodiment of , the initial message sending and receiving interface is presented. Further, the terminal device 120 presents an expression preview panel 610 in the message area 605 of the message sending and receiving interface, wherein the expression preview panel 610 includes one or more expression images in the first expression set.

[0096] See also Figure 7 An example user interface 700 is shown. Figure 7 In the example embodiment, a message sending and receiving interface including historical messages is presented. Further, the terminal device 120 presents an expression preview panel 710 in the message area 705 of the message sending and receiving interface, wherein the expression preview panel 710 includes one or more expression images in the first expression set.

[0097] According to some embodiments of the present disclosure, in order to avoid excessive disturbance to the user, the number of times the expression preview panel is presented can be limited. For example, after the first expression set is created, the expression preview panel is only displayed to the user once.

[0098] As discussed below, according to some embodiments of the present disclosure, the presentation of the preview panel may be canceled. Specifically, in some embodiments, if a selection of at least one expression image in the expression preview panel is detected, the terminal device 120 cancels the presentation of the expression preview panel. Alternatively, in some embodiments, if a closing operation for the expression preview panel is detected, the terminal device 120 cancels the presentation of the expression preview panel.

[0099] See also Figure 7 The illustrated example user interface 700 . If the user triggers a closing operation for the expression preview panel 710 in the user interface 700 , for example, by clicking the close control 720 , the terminal device 120 cancels presenting the expression preview panel 710 .

[0100] Alternatively, if the user selects any expression image in the expression preview panel 710 in the user interface 700 , the terminal device 120 will cancel presenting the expression preview panel 710 .

[0101] Additionally, in some embodiments, in response to the presentation of the emoticon preview panel being cancelled, the terminal device 120 presents an embedded message in the message area of ​​the message sending and receiving interface, wherein the embedded message at least includes an access entry of the first emoticon set in the emoticon library. Further, in response to the selection of the access entry, the display of the emoticon image in the first emoticon set can be triggered.

[0102] See also Figure 8 An example user interface 800 is shown. Figure 8In the example embodiment, the presentation of the emoticon preview panel is cancelled, and an embedded message 810 is presented in the message area of ​​the message sending and receiving interface, wherein the embedded message at least includes an access entry of the first emoticon set in the emoticon library. Further, if the user clicks on the embedded message, the presentation of the emoticon image in the first emoticon set can be triggered.

[0103] As discussed below, according to some embodiments of the present disclosure, when receiving user input, emoticon images may be recommended to the user, wherein emoticon images included in the first emoticon set are preferentially recommended. Specifically, in some embodiments, in response to receiving user input in a message sending and receiving interface, the terminal device 120 provides a recommendation list of emoticon images that match the user input, and if the recommendation list includes a second emoticon image from the first emoticon set, the terminal device 120 preferentially displays the second emoticon image in the recommendation list.

[0104] Specifically, the terminal device 120 determines a first number of emoticon images according to the user input. In some embodiments, if the first number is greater than the maximum number that can be presented in the recommendation list, the emoticon images in the first emoticon set are preferentially presented in the recommendation list. Furthermore, when presenting the recommendation list, the presentation position of the emoticon images in the first emoticon set is brought forward.

[0105] See also Fig. 9 An example user interface 900 is shown. Fig. 9 In the example embodiment of , when the user inputs "happy", the terminal device 120 provides a recommendation list 920 of expression images that match the user input. Fig. 9 As shown, the expression image 930 included in the first expression set is preferentially displayed in the recommendation list 920, that is, as the first recommended expression image.

[0106] In some embodiments, in response to an emoticon image in the recommendation list being selected, the selected emoticon image is sent. Fig.10 An example user interface 1000 is shown. Fig.10 In the example embodiment of FIG. 1 , the selected expression image 1010 is presented in the user interface 1000 .

[0107] In some embodiments, an already sent emoticon image can be withdrawn. Fig.10 In the example embodiment of FIG. 1 , if the user long presses the expression image 1010 , the terminal device 120 may present a pop-up window to assist the user in withdrawing the expression image 1010 .

[0108] As discussed below, according to some embodiments of the present disclosure, when the main entrance of the expression library is triggered, the navigation tag of the first expression set can be displayed preferentially. Specifically, in some embodiments, if a triggering operation on the main entrance of the expression library is detected, an expression panel corresponding to the expression library is presented, wherein the expression panel at least includes a list of navigation tags corresponding to each of the plurality of expression sets, and the navigation tags in the expression panel can be selected respectively so that the corresponding expression set is displayed in the expression panel, and wherein the first navigation tag corresponding to the first expression set is preferentially displayed in the list of navigation tags.

[0109] See also Fig.11 An example user interface 1100 is shown. Fig.11 In the example embodiment, when a trigger operation is detected on the main entrance 1110 of the expression library, the terminal device 120 presents an expression panel 1130 corresponding to the expression library, wherein the expression panel 1130 at least includes a list 1120 of navigation tags corresponding to each of a plurality of expression sets, wherein the navigation tags in the expression panel can be selected to display the corresponding expression set in the expression panel. Fig.11 As shown, the first navigation tag 1140 corresponding to the first emoticon set is preferentially displayed in the list of navigation tags, that is, the first navigation tag 1140 is presented as the second navigation tag, that is, it is presented immediately after the navigation tag of the favorite emoticons.

[0110] In some embodiments, in response to detecting that presentation of the emoticon panel is triggered for the first time after the first emoticon set is created, the terminal device 120 enables the first navigation tab to be selected by default, so that the first emoticon set is displayed in the emoticon panel. Fig.11 An example user interface 1100 is shown. Fig.11 In the example embodiment of FIG. 1 , the first navigation tab 1140 is selected by default.

[0111] In some embodiments, the emoticon images in the first emoticon set can be collected. Fig.12 An example user interface 1200 is shown. Fig.12 In the example embodiment, the expression image 1210 in the first expression set can be activated, for example, by long pressing. The terminal device 120 pops up a prompt window 1220. Based on the prompt window 1220, the user can set the expression 1210 as a favorite expression.

[0112] As discussed below, according to some embodiments of the present disclosure, the first expression set may be updated, including but not limited to replacement, deletion, editing, modification, etc.

[0113] In some embodiments, in response to the first expression set being displayed in the expression panel, the terminal device 120 provides at least one of the following in the expression panel: an expression creation portal for triggering the use of an image generation model to generate an expression image of the first expression type, and a deletion control for the first expression set.

[0114] See also Fig.13 An example user interface 1300 is shown. Fig.13 In an example embodiment, in response to the first expression set being displayed in the expression panel, the terminal device 120 provides in the expression panel: an expression creation entry 1310 for triggering the use of an image generation model to generate an expression image of the first expression type, and a deletion control 1320 for the first expression set.

[0115] In some embodiments, since the first expression set occupies a large storage space, the user is only allowed to create one set of the first expression set. In this case, when the user creates a new first expression set, the existing first expression set will be removed.

[0116] In some embodiments, if the user triggers Fig.13 , then the removal operation of the first expression set is activated. Fig.14 As shown, when the user's removal operation of the first expression set is activated, the terminal device 120 presents a pop-up window 1410 to prompt the user that when a new expression set is created, the current first expression set will be removed. If the user confirms the operation, the operation process of creating the first expression set is activated.

[0117] See also Fig.13 If the delete control 1320 for the first expression set is activated, the delete operation of the first expression set is activated. Fig.15 As shown, the terminal device 120 presents a pop-up window 1510 to prompt the user that an operation of deleting / removing the first emoticon set is currently being performed.

[0118] In some embodiments, in order to avoid improper removal caused by user error, the user is required to confirm again before removing the first emoticon set from the system. If the user confirms to remove the first emoticon set, for example, by clicking Fig.15 , and the first expression set is removed.

[0119] In some embodiments, the expression creation portal 1310 is presented only when a predetermined presentation condition is met. As an example implementation, the expression creation portal 1310 is presented only when it is detected that the user has not performed the creation process of the first expression set within a predetermined period (such as one day, one hour, etc.).

[0120] As discussed below, according to some embodiments of the present disclosure, the emoticons in the first emoticon set can be published in any other user interface that supports publishing emoticons except the message sending and receiving interface. Next, a comment reply interface will be discussed as an example.

[0121] In some embodiments, in response to detecting presentation of a comment reply interface for a work, the terminal device 120 displays at least a first set of expressions in the comment reply interface.

[0122] See also Fig.16 An example user interface 1600 is shown. Fig.16 In the example embodiment, works posted by users are presented, and at least a first expression set 1610 is displayed in the comment reply interface.

[0123] How to present the navigation label of the first emoticon set in the comment reply interface, how to display the emoticon image selected in the first emoticon set, how to add multiple emoticon messages to the emoticon container, how to trigger the presentation of the emoticon viewing panel when the emoticon image / emoticon container is triggered, etc. Figure 3-15 The example processes discussed are similar. For the purpose of brevity only, the same or similar contents will not be repeated.

[0124] In some embodiments, if the selection of a fourth expression image in the first expression set is detected, the terminal device 120 sends a second message in another messaging interface with the user who published the work, wherein the second message includes thumbnail information of the work and the fourth expression image that is at least partially superimposed and displayed on the thumbnail information.

[0125] See also Fig.17 The example user interface 17 is shown. Fig.17 In the exemplary embodiment, the terminal device 120 sends a second message in another message sending and receiving interface with the user who published the work, wherein the second message includes a fourth expression image 1720 partially superimposed on the thumbnail information 1710 of the work and displayed on the thumbnail information.

[0126] In some embodiments, if a user comments on another user's work, in another message sending and receiving interface, the second message may include the first description information, such as "You commented on his story", in addition to the thumbnail information of the work and the fourth expression image at least partially superimposed and displayed on the thumbnail information.

[0127] Accordingly, if the work of the user receives comments from other users, in another message sending and receiving interface, the second message may include second description information, such as "Zhang San commented on your story", in addition to the thumbnail information of the work and the fourth expression image at least partially superimposed and displayed on the thumbnail information.

[0128] In some embodiments, if a third expression image of the first expression type sent by another user is received, the terminal device 120 may provide a message notification to the user, wherein the message notification indicates at least one of the following: receipt of the first expression type, or a preview of the third expression image.

[0129] In some embodiments, the message notification may be a prompt message of the operating system. Alternatively, in some embodiments, the message notification may be a prompt message of the application. In this case, the message notification may be sent to the user's system message list, where the system message list is sometimes also referred to as an inbox or inbox.

[0130] In some embodiments, the message notification at least prompts the following information: the publisher of the comment and the content of the comment at least used emoticon images in the first set, for example, Zhang San sent an AI emoticon.

[0131] In some embodiments, the first expression set is valid only within a predetermined time period after creation. In some embodiments, the first expression set is automatically deleted 24 hours after creation. Additionally, the validity period of the first expression set can be configured by the user. The present disclosure is not limited in this respect.

[0132] In some embodiments, even if the first emoticon set is removed by the user, the emoticon images in the first emoticon set previously sent by the user can still be displayed normally. In some embodiments, if the user's account is disabled, the emoticon images in the first emoticon set that the user has sent will not be displayed normally, for example, they will be replaced by default emoticons or texts pre-configured by the system.

[0133] In summary, according to various embodiments of the present disclosure, a solution for using emoticons is provided. According to the solution of the present disclosure, after an AI-emoticon is created, a user can use the AI-emoticon in a message sending and receiving interface, a comment reply interface, and the like. Since the AI-emoticon can include richer information, the interaction process between users is more interesting, thereby effectively improving the user experience.

[0134] Example Method

[0135] Fig.18 1 is a flowchart of a method 1800 for content presentation according to some embodiments of the present disclosure. The method 1800 may be implemented at the terminal device 120. Figure 1 Describe method 1800.

[0136] In box 1810, in response to detecting a preset trigger operation on a first message in a message sending and receiving interface, the terminal device 120 provides multiple expression sets corresponding to multiple expression types, respectively, and the multiple expression sets include at least a first expression set corresponding to a first expression type, wherein the expression images in the first expression set are generated based on an image input by a user using an image generation module.

[0137] In box 1820, in response to detecting the selection of at least one emoticon image from the plurality of emoticon sets, the terminal device 120 displays the at least one emoticon image in association with the first message, and the at least one emoticon image is at least partially superimposed on the first message.

[0138] In some embodiments, in response to detecting a preset operation for the first message, the terminal device 120 displays an emoticon bar superimposed on the message area of ​​the message sending and receiving interface, and the emoticon bar includes at least a first navigation tag corresponding to the first emoticon set and a second navigation tag corresponding to the second emoticon set. The navigation tags in the emoticon bar can be selected separately to display the corresponding emoticon set in the emoticon bar.

[0139] In some embodiments, the first navigation tab is selected by default when the emoticon bar is displayed, so that the first emoticon set is displayed in the emoticon bar.

[0140] In some embodiments, in response to detecting a selection of multiple emoticon images from a plurality of emoticon sets, the terminal device 120 displays an emoticon container in association with a first message, wherein the emoticon container includes thumbnails of each of the multiple emoticon images, and the emoticon container is at least partially superimposed on a display area of ​​the first message.

[0141] In some embodiments, the first message has at least one other emoticon image that has been displayed in association with it, and in response to detecting a selection of at least one emoticon image from a plurality of emoticon sets, the terminal device 120 displays an emoticon container in association with the first message, wherein the emoticon container includes at least one other emoticon image and a thumbnail of each of the at least one emoticon image, and the emoticon container is at least partially superimposed on a display area of ​​the first message.

[0142] In some embodiments, the preset trigger operation includes at least a long press operation.

[0143] In some embodiments, in response to detecting selection of an emoticon image displayed in association with a first message, the terminal device 120 presents an emoticon viewing panel in the message sending and receiving interface, the emoticon viewing panel including the emoticon image displayed in association with the first message and the sending user of the emoticon image.

[0144] In some embodiments, the emoticon viewing panel includes an entry to the user profile page of the sending user of the emoticon image.

[0145] In some embodiments, the at least one expression image selected from the plurality of expression sets includes: at least one expression image from a first expression set, and at least one expression image from a second expression set from the plurality of expression sets.

[0146] In some embodiments, in response to detecting that the messaging interface is presented, the terminal device 120 presents an expression preview panel in the message area of ​​the messaging interface, where the expression preview panel includes one or more expression images in the first expression set.

[0147] In some embodiments, in response to detecting the selection of at least one emoticon image in the emoticon preview panel or in response to detecting a closing operation on the emoticon preview panel, the terminal device 120 cancels the presentation of the emoticon preview panel, and presents an embedded message in the message area of ​​the message sending and receiving interface, wherein the embedded message includes at least an access entry for the first emoticon set in the emoticon library.

[0148] In some embodiments, in response to receiving user input in a messaging interface, the terminal device 120 provides a recommendation list of emoticon images that match the user input, and if the recommendation list includes a second emoticon image from a first emoticon set, the terminal device 120 preferentially displays the second emoticon image in the recommendation list.

[0149] In some embodiments, the message sending and receiving interface includes a general entrance to the expression library. In response to detecting a trigger operation on the general entrance, the terminal device 120 presents an expression panel corresponding to the expression library, wherein the expression panel at least includes a list of navigation tags corresponding to each of a plurality of expression sets, and the navigation tags in the expression panel can be selected to display the corresponding expression set in the expression panel, and the first navigation tag corresponding to the first expression set is preferentially displayed in the list of navigation tags.

[0150] In some embodiments, in response to detecting that presentation of the expression panel is triggered for the first time after the first expression set is created, the terminal device 120 enables the first navigation tab to be selected by default so that the first expression set is displayed in the expression panel.

[0151] In some embodiments, in response to the first expression set being displayed in the expression panel, the terminal device 120 provides at least one of the following in the expression panel: an expression creation portal for triggering the use of an image generation model to generate an expression image of the first expression type, and a deletion control for the first expression set.

[0152] In some embodiments, if a third expression image of the first expression type sent by another user is received, the terminal device 120 provides a message notification, wherein the message notification indicates at least one of the following: receipt of the first expression type, or a preview of the third expression image.

[0153] In some embodiments, in response to detecting the presentation of a comment reply interface for a work, the terminal device 120 displays at least a first expression set in the comment reply interface, and in response to detecting the selection of a fourth expression image in the first expression set, the terminal device 120 sends a second message in another messaging interface with the user who published the work, wherein the second message includes thumbnail information of the work and a fourth expression image that is at least partially superimposed and displayed on the thumbnail information.

[0154] Example devices and equipment

[0155] Fig.19 1 shows a schematic structural block diagram of an apparatus 1900 for using emoticons according to some embodiments of the present disclosure. The apparatus 1900 may be implemented as or included in the terminal device 120. Each module / component in the apparatus 1900 may be implemented by hardware, software, firmware or any combination thereof.

[0156] As shown in the figure, the device 1900 includes an expression providing module 1910, which is configured to provide multiple expression sets corresponding to multiple expression types respectively in response to detecting a preset trigger operation on a first message in a message sending and receiving interface, and the multiple expression sets include at least a first expression set corresponding to a first expression type, wherein the expression images in the first expression set are generated based on the images input by the user using an image generation model; and an associated display module 1920, which is configured to display at least one expression image in association with the first message in response to detecting a selection of at least one expression image in the multiple expression sets, and the at least one expression image is at least partially superimposed on the first message.

[0157] In some embodiments, the expression providing module 1910 is further configured to, in response to detecting a preset operation for the first message, overlay and display an expression bar on the message area of ​​the message sending and receiving interface, the expression bar at least including a first navigation label corresponding to the first expression set and a second navigation label corresponding to the second expression set, and the navigation labels in the expression bar can be selected respectively so that the corresponding expression set is displayed in the expression bar. In some embodiments, when the expression bar is displayed, the first navigation label is selected by default so that the first expression set is displayed in the expression bar.

[0158] In some embodiments, the associated display module 1920 is also configured to display an emoticon container in association with the first message in response to detecting a selection of multiple emoticon images from a plurality of emoticon sets, wherein the emoticon container includes thumbnails of each of the multiple emoticon images and the emoticon container is at least partially superimposed on the display area of ​​the first message.

[0159] In some embodiments, the first message has at least one other emoticon image that has been displayed in association with it, and the associated display module 1920 is further configured to display an emoticon container in association with the first message in response to detecting a selection of at least one emoticon image from a plurality of emoticon sets, wherein the emoticon container includes at least one other emoticon image and a thumbnail of each of the at least one emoticon image, and the emoticon container is at least partially superimposed on a display area of ​​the first message.

[0160] In some embodiments, the preset trigger operation includes at least a long press operation.

[0161] In some embodiments, the associated display module 1920 is also configured to present an emoticon viewing panel in the message sending and receiving interface in response to detecting a selection of an emoticon image displayed in association with the first message, the emoticon viewing panel including the emoticon image displayed in association with the first message and the sending user of the emoticon image.

[0162] In some embodiments, the emoticon viewing panel includes an entry to the user profile page of the sending user of the emoticon image.

[0163] In some embodiments, the at least one expression image selected from the plurality of expression sets includes: at least one expression image from a first expression set, and at least one expression image from a second expression set from the plurality of expression sets.

[0164] In some embodiments, device 1900 also includes a preview panel presentation module (not shown), which is configured to present an expression preview panel in the message area of ​​the messaging interface in response to detecting that the messaging interface is presented, the expression preview panel including one or more expression images in the first expression set.

[0165] In some embodiments, device 1900 also includes a preview panel closing module (not shown), which is configured to cancel the presentation of the expression preview panel in response to detecting a selection of at least one expression image in the expression preview panel or in response to detecting a closing operation on the expression preview panel, and to present an embedded message in the message area of ​​the message sending and receiving interface, wherein the embedded message includes at least an access entry for the first expression set in the expression library.

[0166] In some embodiments, the device 1900 also includes a recommendation list module (not shown), which is configured to provide a recommendation list of emoticon images that match the user input in response to receiving user input in the messaging interface, and if the recommendation list includes a second emoticon image from the first emoticon set, the terminal device 120 will preferentially display the second emoticon image in the recommendation list.

[0167] In some embodiments, the message sending and receiving interface includes a general entrance to the expression library. The device 1900 also includes an expression panel presentation module (not shown), which is configured to present an expression panel corresponding to the expression library in response to detecting a trigger operation on the general entrance, wherein the expression panel at least includes a list of navigation tags corresponding to each of a plurality of expression sets, and the navigation tags in the expression panel can be selected to display the corresponding expression set in the expression panel, and wherein the first navigation tag corresponding to the first expression set is preferentially displayed in the list of navigation tags.

[0168] In some embodiments, device 1900 also includes a default presentation module (not shown) configured to cause the first navigation tab to be selected by default in response to detecting that the presentation of the expression panel is triggered for the first time after the first expression set is created, so that the first expression set is displayed in the expression panel.

[0169] In some embodiments, the apparatus 1900 further includes an expression update module (not shown), which is configured to cause the terminal device 120 to provide at least one of the following in the expression panel in response to the first expression set being displayed in the expression panel: an expression creation entry for triggering generation of an expression image of the first expression type using an image generation model, and a deletion control for the first expression set.

[0170] In some embodiments, the apparatus 1900 further includes a message notification module (not shown), which is configured such that if a third expression image of a first expression type sent by another user is received, the terminal device 120 provides a message notification, wherein the message notification indicates at least one of the following: receipt of the first expression type, or a preview of the third expression image.

[0171] In some embodiments, apparatus 1900 further includes a comment module (not shown), which is configured to, in response to detecting the presentation of a comment reply interface for a work, cause terminal device 120 to display at least a first set of expressions in the comment reply interface, and in response to detecting the selection of a fourth expression image in the first set of expressions, cause terminal device 120 to send a second message in another messaging interface with the user who published the work, wherein the second message includes thumbnail information of the work and a fourth expression image that is at least partially superimposed and displayed on the thumbnail information.

[0172] Fig. 20 2 shows a block diagram of an electronic device 2000 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Fig. 20 The electronic device 2000 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Fig. 20 The electronic device 2000 shown can be used to implement Figure 1 terminal device 120.

[0173] like Fig. 20 As shown, the electronic device 2000 is in the form of a general electronic device. The components of the electronic device 2000 may include, but are not limited to, one or more processors or processing units 2010, a memory 2020, a storage device 2030, one or more communication units 2040, one or more input devices 2050, and one or more output devices 2060. The processing unit 2010 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 2020. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 2000.

[0174] The electronic device 2000 typically includes a plurality of computer storage media. Such media may be any accessible media that is accessible to the electronic device 2000, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 2020 may be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 2030 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data (e.g., training data for training) and may be accessed within the electronic device 2000.

[0175] The electronic device 2000 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig. 20 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. Memory 2020 may include a computer program product 2025 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0176] The communication unit 2040 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 2000 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 2000 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0177] The input device 2050 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 2060 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 2000 may also communicate with one or more external devices (not shown) through the communication unit 2040 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 2000, or communicate with any device that allows the electronic device 2000 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0178] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0179] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0180] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0181] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0182] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0183] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for using expressions, comprising: In response to detecting a preset trigger operation on a first message in a message sending and receiving interface, providing a plurality of expression sets corresponding to a plurality of expression types, respectively, wherein the plurality of expression sets include at least a first expression set corresponding to a first expression type, and expression images in the first expression set are generated based on an image input by a user using an image generation model; as well as In response to detecting a selection of at least one emoticon image from the plurality of emoticon sets, the at least one emoticon image is displayed in association with the first message, the at least one emoticon image being at least partially superimposed on the first message.

2. The method according to claim 1, wherein providing a plurality of selectable expression sets comprises: In response to detecting a preset operation for the first message, an emoticon bar is displayed superimposed on the message area of ​​the message sending and receiving interface, and the emoticon bar includes at least a first navigation label corresponding to the first emoticon set and a second navigation label corresponding to the second emoticon set. The navigation labels in the emoticon bar can be selected separately to display the corresponding emoticon set in the emoticon bar. 3 . The method according to claim 2 , wherein the first navigation tab is selected by default when the emoticon bar is displayed, so that the first emoticon set is displayed in the emoticon bar.

4. The method of claim 1 , wherein displaying the at least one emoticon image in association with the first message comprises: In response to detecting a selection of multiple emoticon images from the multiple emoticon sets, an emoticon container is displayed in association with the first message, the emoticon container includes thumbnails of each of the multiple emoticon images, and the emoticon container is at least partially superimposed on a display area of ​​the first message.

5. The method of claim 1 , wherein the first message has at least one other emoticon image that has been displayed in association therewith, and displaying the at least one emoticon image in association with the first message comprises: In response to detecting a selection of at least one emoticon image from the plurality of emoticon sets, an emoticon container is displayed in association with the first message, the emoticon container including thumbnails of each of the at least one other emoticon image and the at least one emoticon image, and the emoticon container is at least partially superimposed on a display area of ​​the first message. The method according to claim 1 , wherein the preset trigger operation at least includes a long press operation.

7. The method according to claim 1, further comprising: In response to detecting selection of the emoticon image displayed in association with the first message, an emoticon viewing panel is presented in the message sending and receiving interface, the emoticon viewing panel including the emoticon image displayed in association with the first message and the sending user of the emoticon image. 8 . The method according to claim 7 , wherein the expression viewing panel includes an entrance to a user details page of a user who sent the expression image.

9. The method according to claim 1, wherein the at least one expression image selected from the plurality of expression sets comprises: At least one expression image from the first expression set, and at least one expression image from a second expression set of the plurality of expression sets.

10. The method according to claim 1, further comprising: In response to detecting that the messaging interface is presented, presenting an expression preview panel in a message area of ​​the messaging interface, the expression preview panel including one or more expression images in the first expression set.

11. The method according to claim 10, further comprising: In response to detecting a selection of at least one expression image in the expression preview panel or in response to detecting a closing operation on the expression preview panel, cancelling the presentation of the emoticon preview panel, and An embedded message is presented in the message area of ​​the message sending and receiving interface, and the embedded message at least includes an access entry of the first emoticon set in an emoticon library.

12. The method according to claim 1, further comprising: In response to receiving a user input in the message sending and receiving interface, providing a recommendation list of emoticon images matching the user input; as well as If the recommendation list includes a second emoticon image from the first emoticon set, the second emoticon image is preferentially displayed in the recommendation list.

13. The method according to claim 1, wherein the message sending and receiving interface includes a general entrance to an expression library, and the method further comprises: In response to detecting a trigger operation on the main entrance, an expression panel corresponding to the expression library is presented, wherein the expression panel at least includes a list of navigation tags corresponding to each of the plurality of expression sets, and the navigation tags in the expression panel can be selected to display the corresponding expression set in the expression panel. The first navigation tag corresponding to the first emoticon set is preferentially displayed in the list of navigation tags.

14. The method according to claim 13, further comprising: In response to detecting that presentation of the emoticon panel is triggered for the first time after the first emoticon set is created, the first navigation tab is selected by default so that the first emoticon set is displayed in the emoticon panel.

15. The method according to claim 13, further comprising: In response to the first expression set being displayed in the expression panel, at least one of the following is provided in the expression panel: an expression creation entry, used to trigger the use of the image generation model to generate an expression image of the first expression type, and A delete control for the first emoticon set.

16. The method according to claim 1, further comprising: If a third emoticon image of the first emoticon type sent by another user is received, a message notification is provided, wherein the message notification indicates at least one of the following: reception of the first emoticon type, or a preview of the third emoticon image.

17. The method according to claim 1, further comprising: In response to detecting the presentation of a comment reply interface for the work, displaying at least the first set of expressions in the comment reply interface; as well as In response to detecting the selection of the fourth expression image in the first expression set, a second message is sent in another messaging interface with the user who published the work, the second message including thumbnail information of the work and the fourth expression image at least partially superimposed and displayed on the thumbnail information.

18. A device for using expressions, comprising: The expression providing module is configured to: in response to detecting a preset trigger operation on a first message in a message sending and receiving interface, provide a plurality of expression sets corresponding to a plurality of expression types respectively, wherein the plurality of expression sets include at least a first expression set corresponding to a first expression type, and expression images in the first expression set are generated based on images input by a user using an image generation model; as well as The associated display module is configured to: in response to detecting a selection of at least one emoticon image in the plurality of emoticon sets, display the at least one emoticon image in association with the first message, with the at least one emoticon image at least partially superimposed on the first message.

19. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 17 when executed by the at least one processing unit.

20. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 17.

Images