Methods, systems, and related devices for displaying facial expressions during conversations

Abstract

Embodiments of this disclosure provide a method, system, electronic device, computer-readable medium, and computer program product for displaying emoticons in a conversation. The method includes: displaying a conversation interface, the conversation interface including a conversation display area and an emoticon display area, the emoticon display area displaying at least one emoticon image, the at least one emoticon image including a first emoticon image; causing the conversation display area to enter a point-and-draw state according to a first selection operation on the first emoticon image in the emoticon display area; and displaying the first emoticon image in the first selected area according to a first target operation on the first selected area in the conversation display area. The method, system, electronic device, computer-readable medium, and computer program product for displaying emoticons in a conversation provided by embodiments of this disclosure can achieve efficient user communication based on operations on emoticons.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more specifically, to a method, system, electronic device, computer-readable medium, and computer program product for displaying facial expressions during a conversation. Background Technology

[0002] With the development of communication technology, instant messaging based on social applications has gradually become a common communication method. On social application platforms, two or more users can communicate instantly. During communication, users can send text and emoticons to other users. However, after a user sends an emoticon, the displayed effect of the sent emoticon is a pre-set fixed pattern, and it cannot be changed based on user-defined settings after sending. This mechanism results in the current emoticon display lacking a mechanism to guide users to engage in effective communication.

[0003] Therefore, there is a need for a new method, system, electronic device, computer-readable medium, and computer program product for displaying facial expressions in a conversation. Summary of the Invention

[0004] This disclosure provides a method, system, electronic device, computer-readable medium, and computer program product for displaying emoticons during a conversation. These methods can enrich the display effects of emoticons based on user-defined operations, thereby enhancing the interactive experience between users.

[0005] This disclosure proposes a method for displaying emoticons in a conversation, applied to conversations between terminals. The terminals include a sending end and a receiving end. The method is executed by the sending end and includes: displaying a conversation interface, the conversation interface including a conversation display area and an emoticon display area, the emoticon display area displaying at least one emoticon image, the at least one emoticon image including a first emoticon image; causing the conversation display area to enter a point-and-draw state according to a first selection operation on the first emoticon image in the emoticon display area; and displaying the first emoticon image in the first selected area according to a first target operation on the first selected area in the conversation display area.

[0006] This disclosure proposes a method for displaying emoticons in a conversation, applied to conversations between terminals. The terminals include a sending end and a receiving end. The method is executed by the receiving end and includes: displaying a conversation interface of the conversation, the conversation interface including a conversation display area; displaying a first emoticon sent by the sending end within a first selected area of ​​the conversation display area; wherein, the first selected area is generated by the sending end based on a first target operation in the conversation display area of ​​the sending end when the sending end enters a dot-draw state, the first target operation being for the first selected area.

[0007] This disclosure provides an apparatus for displaying emoticons during a conversation, applied to conversations between terminals. The terminals include a sending end and a receiving end. The sending end displays a conversation interface, which includes a conversation display area and an emoticon display area. The emoticon display area displays at least one emoticon image, including a first emoticon image. Based on a first selection operation on the first emoticon image in the emoticon display area, the conversation display area enters a point-and-draw state. Based on a first target operation on a first selected area in the conversation display area, the first emoticon image is displayed in the first selected area. The receiving end displays the conversation interface, which includes a conversation display area. The first emoticon image is displayed in a first selected area within the conversation display area.

[0008] In one exemplary embodiment of this disclosure, when the sending end causes the session display area to enter the point-and-draw state according to the first selection operation on the first expression image in the expression image display area, it is configured to display a predetermined identifier image at a predetermined position in the session display area when the first selection operation on the first expression image in the expression image display area reaches a set duration, so as to indicate that the session display area has entered the point-and-draw state.

[0009] In one exemplary embodiment of this disclosure, the at least one emoticon image further includes a second emoticon image, and the sending end is further configured to: display the second emoticon image in the second selected area according to a second selection operation on the second emoticon image in the emoticon image display area and a second target operation on the second selected area in the session display area.

[0010] In an exemplary embodiment of this disclosure, the sending end is further configured to: if the interval between the second selection operation and the first target operation is less than a predetermined time, and the first selected area and the second selected area have a first overlapping area, then display a first combined expression image of the first expression image and the second expression image in the first overlapping area.

[0011] In one exemplary embodiment of this disclosure, the first target operation includes a click operation; wherein, when the sending end displays the first emoticon image in the first selected area according to the first target operation on the first selected area in the session display area, it is configured to: display the first emoticon image in the first selected area according to the click operation on the first selected area in the session display area.

[0012] In an exemplary embodiment of this disclosure, the click operation includes a first click operation and a second click operation, the first selected area includes a first sub-selected area and a second sub-selected area, the first click operation acts on the first sub-selected area, and the second click operation acts on the second sub-selected area; wherein, when the sending end displays the first emoticon image in the first selected area according to the click operation on the first selected area in the session display area, it is configured to: if the interval between the first click operation and the second click operation is less than a predetermined duration, and the first sub-selected area and the second sub-selected area have a second overlapping area, then display a second combined emoticon image of the first emoticon image in the second overlapping area.

[0013] In an exemplary embodiment of this disclosure, the first target operation includes a sliding operation; wherein, when the sending end displays the first emoticon image in the first selected area according to the first target operation on the first selected area in the session display area, it is configured to: generate a sliding trajectory in the first selected area according to the sliding operation on the first selected area in the session display area; and display a plurality of the first emoticon images on the sliding trajectory.

[0014] In an exemplary embodiment of this disclosure, when the sending end displays multiple first expression images on the sliding trajectory, it is configured to: if the sliding trajectory has a third overlapping region, then display a second combined expression image of the first expression images in the third overlapping region.

[0015] In one exemplary embodiment of this disclosure, the sending end is further configured to: display a third emoticon image sent by the receiving end within a third selected area of ​​the session display area.

[0016] In an exemplary embodiment of this disclosure, when the sending end displays a third emoticon image sent by the receiving end in a third selected area of ​​the session display area, it is configured to: if the time interval between the first target operation and the time of receiving the third emoticon image is less than a predetermined time, and there is a third overlapping area between the first selected area and the third selected area, then display a third combined emoticon image of the first emoticon image and the third emoticon image in the third overlapping area.

[0017] In one exemplary embodiment of this disclosure, the conversation interface in the receiving end further includes an emoticon image display area, and the receiving end is further configured to: display the third emoticon image in the third selected area according to a third selection operation on the third emoticon image in the emoticon image display area and a third target operation on the third selected area in the conversation display area.

[0018] In an exemplary embodiment of this disclosure, the receiving end is further configured to: if the interval between the first target operation and the third target operation is less than a predetermined time, and the first selected area and the third selected area have a third overlapping area, then display a third combined expression image of the first expression image and the third expression image in the third overlapping area.

[0019] This disclosure provides an electronic device, including: at least one processor; and a storage device for storing at least one program, which, when executed by the at least one processor, causes the at least one processor to implement the method for displaying emoticons in a session as described in the above embodiments.

[0020] This disclosure provides a computer-readable medium storing a computer program adapted to be loaded and executed by a processor, such that a computer device having the processor performs a method for displaying facial expressions in a session, as described in this disclosure.

[0021] This disclosure provides a computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various alternative embodiments of this disclosure.

[0022] In some embodiments of the present disclosure, in the conversation interface between the sending end and the receiving end, based on the first selection operation of the first emoticon image in the emoticon image display area, the conversation display area in the conversation interface can enter a dot-draw state, guiding the user to send the first emoticon image using a dot-draw format. In the dot-draw state, the user can perform a first target operation on the first selected area in the conversation display area. Based on the user-defined first target operation, the first emoticon image can be displayed in the first selected area, thereby realizing the customized display of the first emoticon image. This allows the user to express more multi-dimensional emotions based on emoticon images with only fixed emotions, improving the efficiency of user communication. Moreover, the communication process only needs to transmit the first emoticon image and the first selected area, without transmitting too much text information, which can effectively reduce the amount of data transmission and reduce the server pressure.

[0023] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0024] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0025] Figure 1 This is a schematic diagram of the implementation architecture provided in the embodiments of this disclosure.

[0026] Figure 2 A flowchart illustrating a method for displaying facial images in a session according to an embodiment of the present disclosure is shown schematically.

[0027] Figure 3 A flowchart illustrating a method for displaying facial images in a session according to another embodiment of the present disclosure is shown schematically.

[0028] Figure 4 A flowchart illustrating a method for displaying emoticons in a session according to yet another embodiment of the present disclosure is shown.

[0029] Figure 5 A flowchart illustrating a method for displaying facial images in a session according to another embodiment of the present disclosure is shown schematically.

[0030] Figure 6 A flowchart illustrating a method for displaying facial images in a session according to another embodiment of the present disclosure is shown schematically.

[0031] Figure 7 A flowchart illustrating a method for displaying facial images in a session according to another embodiment of the present disclosure is shown schematically.

[0032] Figure 8 A flowchart illustrating a method for displaying facial images in a session according to another embodiment of the present disclosure is shown schematically.

[0033] Figure 9 The illustration shows a schematic diagram of an expression image display according to one embodiment of the present disclosure.

[0034] Figure 10 The illustration shows a schematic diagram of an expression image display according to one embodiment of the present disclosure.

[0035] Figure 11 A flowchart illustrating a method for displaying facial images in a session according to another embodiment of the present disclosure is shown schematically.

[0036] Figure 12 A block diagram illustrating an apparatus for displaying facial images in a session according to an embodiment of the present disclosure is shown schematically.

[0037] Figure 13 A schematic diagram of the structure of an electronic device suitable for implementing embodiments of the present disclosure is shown. Detailed Implementation

[0038] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0039] In this disclosure embodiment, please refer to Figure 1 , Figure 1 This is a schematic diagram of the implementation architecture provided in the embodiments of this disclosure.

[0040] like Figure 1 As shown, this implementation architecture 100 is used to realize inter-terminal sessions. The terminals may include a sender 101 and a receiver 102. The architecture also includes a server 103. The sender 101, receiver 102, and server 103 are connected via network 104. Clients of a social application configured by server 103 run on the sender 101 and receiver 102. Based on this social application, they can log in to server 103, thereby establishing a communication link between the sender 101 and receiver 102, and thus realizing inter-terminal sessions.

[0041] The sending end 101 can display the session interface of the session, which includes a session display area and an emoticon display area. The emoticon display area displays at least one emoticon image, including a first emoticon image. Based on a first selection operation on the first emoticon image in the emoticon display area, the session display area enters a point-and-draw state. Based on a first target operation on the first selected area in the session display area, the first emoticon image is displayed in the first selected area.

[0042] The receiving end can display the conversation interface of the conversation, which includes a conversation display area; the first emoticon image is displayed in a first selected area of ​​the conversation display area.

[0043] It should be understood that Figure 1 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, there can be any number of terminal devices, networks, and servers. For example, server 105 could be a server cluster composed of multiple servers.

[0044] Users can interact with server 103 via network 104 using sender 101 and receiver 102 to receive or send messages, etc. Sender 101 and receiver 102 can be various electronic devices with displays and capable of installing the social application, including but not limited to smartphones, tablets, laptops, desktop computers, wearable devices, virtual reality devices, smart home devices, etc. Receiver 102 can be one or more, and this disclosure does not impose a special limitation on the number of receivers 102. For example, when there is one receiver 102, this embodiment can be applied to a two-person conversation; when there are multiple receivers 102, this embodiment can be applied to a multi-person (three or more) conversation.

[0045] Server 103 can be a server that provides various services, a server cluster consisting of several servers, or a cloud computing server center.

[0046] Figure 2 A flowchart illustrating a method for displaying emoticons in a session according to an embodiment of the present disclosure is shown schematically. The method provided in this disclosure can be processed by any electronic device with computing power, such as the one described above. Figure 1 The transmitting end 101 and / or other terminal devices with transmitting functions in the embodiments.

[0047] like Figure 2As shown in the embodiments of this disclosure, the method for displaying emoticons in a session can be applied to sessions between terminals. The terminal includes a sending end and a receiving end. The method is executed by the sending end and may include the following steps.

[0048] In step S210, the session interface of the session is displayed. The session interface includes a session display area and an emoticon display area. The emoticon display area displays at least one emoticon image, and the at least one emoticon image includes a first emoticon image.

[0049] The session display area is used to show the session records between the sender and receiver. For example... Figure 9 As shown, 90 represents the conversation interface, where 901 is the conversation display area and 902 is the emoticon display area. At least one emoticon image is displayed, for example, one of the emoticons in 902. The first emoticon image can be any one of the images in 902; this embodiment uses 903 in 902 as an example of the first emoticon image, but it is not limited thereto.

[0050] In step S220, the session display area is put into a dot-draw state according to the first selection operation of the first facial expression image in the facial expression image display area.

[0051] For example, a conversational interface in dotted state Figure 9 As shown in Figure 91. The first selection operation is, for example, a click operation whose duration exceeds a predetermined time. In one embodiment, when the first selection operation on the first emoticon image in the emoticon image display area reaches a set time, a predetermined identifier image may be displayed at a predetermined position in the session display area to indicate that the session display area has entered the dot-draw state. The predetermined identifier image is, for example... Figure 9 As shown at 911 in the conversation interface 91, the predetermined identifier image is an image highlighting the first emoticon image, but it can also be other effect images with identifier functions, such as text display effects in the conversation display area that guide or prompt operation steps, or text display effects in the emoticon image display area that guide or prompt operation steps. Figure 9 The 911 example is just an example.

[0052] In step S230, the first emoticon image is displayed in the first selected area according to the first target operation on the first selected area in the session display area.

[0053] The first target operation is, for example, a click operation on any location within the session display area, or a swipe operation on any location within the session display area. The clicked location or the location where the swipe operation is detected is the first selected area. The display effect of displaying the first emoticon image within the first selected area is as follows: Figure 9 As shown in 92 (click operation) 921 and 93 (slide operation) 931. The first selected area in 92 is, for example, the dashed area where 921 is located, and the first selected area in 93 is, for example, the dashed area where 931 is located.

[0054] The receiving end can receive the first emoticon image sent by the sending end and the first target operation on the first selected area, thereby enabling the receiving end to display the first emoticon image in the first selected area of ​​its session interface.

[0055] The method for displaying emoticons in a conversation provided in this disclosure allows the conversation display area in the conversation interface between the sending end and the receiving end to enter a point-and-draw state based on a first selection operation of a first emoticon image in the emoticon image display area. This guides the user to send the first emoticon image using point-and-draw. In the point-and-draw state, the user can perform a first target operation on the first selected area in the conversation display area. Based on this user-defined first target operation, the first emoticon image can be displayed in the first selected area, thereby realizing the customized display of the first emoticon image. This allows the user to express more multi-dimensional emotions based on emoticons with only fixed emotions, improving the efficiency of user communication. Moreover, the communication process only needs to transmit the first emoticon image and the first selected area, without transmitting too much text information, which can effectively reduce the amount of data transmission and reduce server pressure.

[0056] Figure 3 A flowchart illustrating a method for displaying facial images in a session according to another embodiment of the present disclosure is shown schematically.

[0057] In the method for displaying emoticons in a session provided in this disclosure embodiment, the at least one emoticon image further includes a second emoticon image. The second emoticon image is, for example... Figure 10 As shown in 1010 of 101, but only as an example, this disclosure does not specifically limit the specific pattern of the second emoticon image. Furthermore, the first emoticon image and the second emoticon image may be the same emoticon image or different emoticon images. For example... Figure 3 As shown, the method may include the following steps.

[0058] In step S310, the session interface of the session is displayed. The session interface includes a session display area and an emoticon display area. The emoticon display area displays at least one emoticon image, and the at least one emoticon image includes a first emoticon image.

[0059] This step can be performed in a similar manner to S210, and will not be described in detail here.

[0060] In step S320, the session display area is put into a dot-draw state according to the first selection operation of the first facial expression image in the facial expression image display area.

[0061] This step can be performed in a similar manner to S220, and will not be described in detail here.

[0062] In step S330, the first emoticon image is displayed in the first selected area according to the first target operation on the first selected area in the session display area.

[0063] This step can be performed in a similar manner to S230, and will not be described in detail here.

[0064] In step S340, the second expression image is displayed in the second selected area according to the second selection operation on the second expression image in the expression image display area and the second target operation on the second selected area in the session display area.

[0065] In this embodiment of the disclosure, the second selection operation is, for example, a click operation with a duration exceeding a predetermined time. That is, the second selection operation is performed on the second facial expression image in the facial expression image display area for a set duration. The second target operation is, for example, a click operation on any location in the conversation display area, or, for example, a swipe operation on any location in the conversation display area. The clicked location or the location where the swipe operation is detected is the second selected area. For example, using... Figure 9 Taking the session display area of ​​the interface in section 92, which displays the first emoticon image in the first selected area, as an example, the display effect of displaying the second emoticon image in the second selected area based on the second target operation is further illustrated below. Figure 10 In the context of 101, the first selected area within 101 is the dashed area where 921 is located, and the second selected area is the dashed area where 1011 is located.

[0066] In an exemplary embodiment, if the interval between the second selection operation and the first target operation is less than a predetermined time, and the first selected area and the second selected area have a first overlapping area, then a first combined expression image of the first expression image and the second expression image is displayed in the first overlapping area.

[0067] For example Figure 10 As shown in the session interface 102, Figure 9Taking the session display area of ​​the interface in 92, where the first emoticon image is displayed in the first selected area, as an example, the second selected area overlaps with the first selected area, that is, 921 and 1011 have overlapping areas. In the session interface 102, 921 and 1011 are not completely overlapping as an example, but they can also be completely overlapping. The first combined label image of the first emoticon image and the second emoticon image is shown, for example, in the gray area of ​​1011.

[0068] Figure 4 A flowchart illustrating a method for displaying emoticons in a session according to yet another embodiment of the present disclosure is shown.

[0069] like Figure 4 As shown in the embodiments of this disclosure, the method for displaying emoticons in a session may include a first target operation, such as a click operation. The method may include the following steps.

[0070] In step S410, the session interface of the session is displayed. The session interface includes a session display area and an emoticon display area. The emoticon display area displays at least one emoticon, and the at least one emoticon includes a first emoticon.

[0071] This step can be performed in a similar manner to S210, and will not be described in detail here.

[0072] In step S420, the session display area is put into a dot-draw state according to the first selection operation of the first facial expression image in the facial expression image display area.

[0073] This step can be performed in a similar manner to S220, and will not be described in detail here.

[0074] In step S430, the first emoticon image is displayed in the first selected area according to the click operation on the first selected area in the session display area.

[0075] For example, the click operation on the first selected area can be found in [reference needed]. Figure 9 The session display area in section 92 is shown as 921.

[0076] In an exemplary embodiment, the click operation includes a first click operation and a second click operation. The first selected area includes a first sub-selected area and a second sub-selected area. The first click operation is applied to the first sub-selected area, and the second click operation is applied to the second sub-selected area. If the interval between the first click operation and the second click operation is less than a predetermined duration, and the first sub-selected area and the second sub-selected area overlap in a second region, then a second combined expression image of the first expression image is displayed within the second overlapping region.

[0077] For example Figure 10 As shown in the session interface 103, Figure 9 Taking the session display area of ​​the interface in the first selected area 921 as an example, where the first selected area 921 displays the first emoticon image, the first selected area 921 includes a first sub-selected area 9211 and a second sub-selected area 9212. The first sub-selected area 9211 overlaps with the second sub-selected area 9212 (the illustration shows complete overlap, but it can also be partially overlapped). The first combined label image of the first emoticon image and the second emoticon image is, for example... Figure 10 The image indicated by 921 in the Chinese session interface is shown.

[0078] Figure 5 A flowchart illustrating a method for displaying emoticons in a session according to yet another embodiment of the present disclosure is shown.

[0079] like Figure 5 As shown in the embodiments of this disclosure, the method for displaying emoticons in a session includes a first target operation involving a swiping operation. The method may include the following steps.

[0080] In step S510, the session interface of the session is displayed. The session interface includes a session display area and an emoticon display area. The emoticon display area displays at least one emoticon image, and the at least one emoticon image includes a first emoticon image.

[0081] This step can be performed in a similar manner to S210, and will not be described in detail here.

[0082] In step S520, the session display area is put into a dotted state according to the first selection operation of the first facial expression image in the facial expression image display area.

[0083] This step can be performed in a similar manner to S220, and will not be described in detail here.

[0084] In step S530, a sliding trajectory is generated within the first selected area based on the sliding operation on the first selected area in the session display area.

[0085] In this embodiment of the disclosure, Figure 9 As shown in the middle conversation interface 93, the sliding operation can be, for example, a trajectory in the shape of a "cow" character.

[0086] In step S540, multiple first expression images are displayed on the sliding trajectory.

[0087] Among them, the display effect is as follows: Figure 9 As shown in Figure 931.

[0088] Further, if there is a third overlapping area in the sliding trajectory, a second combined expression image of the first expression image is displayed within the third overlapping area.

[0089] Among them, as Figure 10 shown in the conversation interface 104 of, the third overlapping area is, for example, the overlapping part of the stroke "horizontal" and "vertical" in the Chinese character "niu". The second combined expression image in the third overlapping area is, for example, shown in the image at the intersection of the stroke "horizontal" and "vertical" of 1041 in the conversation interface 104.

[0090] Figure 6 Schematically shows a flowchart of a method for implementing expression image display in a conversation according to another embodiment of the present disclosure.

[0091] As Figure 6 shown, the method for implementing expression image display in a conversation provided by the embodiments of the present disclosure may include the following steps.

[0092] In step S610, display the conversation interface of the conversation, the conversation interface includes a conversation display area and an expression image display area, at least one expression image is displayed in the expression image display area, and the at least one expression image includes a first expression image.

[0093] This step may adopt steps similar to S210, which will not be elaborated here.

[0094] In step S620, according to a first selection operation on the first expression image in the expression image display area, make the conversation display area enter the dot-drawing state.

[0095] This step may adopt steps similar to S220, which will not be elaborated here.

[0096] In step S630, according to a first target operation on a first selected area in the conversation display area, display the first expression image within the first selected area.

[0097] This step may adopt steps similar to S230, which will not be elaborated here.

[0098] In step S640, display a third expression image sent by the receiving end within a third selected area of the conversation display area.

[0099] Among them, the receiving end may send a third expression image to the sending end according to a third selection operation of the receiving end user on the third expression image in the expression image display area. The third expression image may be, for example, the same expression image as the first expression image, or may be a different expression image, and the present disclosure does not make special limitations on this.

[0100] In an exemplary embodiment, if the time interval between the first target operation and the time of receiving the third emoticon image is less than a predetermined time, and there is a third overlapping area between the first selected area and the third selected area, then a third combined emoticon image of the first emoticon image and the third emoticon image is displayed in the third overlapping area.

[0101] The third set of emoticon images is displayed in the following way: Figure 10 As shown in the session interface 102, in this embodiment, 921 is, for example, a first emoticon image displayed in a first selected area, and 1011 is, for example, a third emoticon image displayed in a third selected area. The third combined emoticon image, consisting of the first tag image and the third emoticon image, is, for example, the gray portion in 1011.

[0102] Figure 7 A flowchart illustrating a method for displaying emoticons in a session according to another embodiment of the present disclosure is shown schematically. The method provided by the embodiments of the present disclosure can be processed by any electronic device with computing power, such as the one described above. Figure 1 The receiving end 102 and / or other terminal devices with receiving functions in the embodiments.

[0103] like Figure 7 As shown, the method for displaying emoticons in a session provided in this disclosure embodiment can be applied to sessions between terminals. The terminal includes a sending end and a receiving end. The method is executed by the receiving end and may include the following steps.

[0104] In step S710, the session interface of the session is displayed, and the session interface includes a session display area.

[0105] In step S720, the first emoticon image sent by the sending end is displayed in the first selected area of ​​the session display area.

[0106] The first selected area is generated by the sending end when the session display area of ​​the sending end enters the point-and-click state, based on a first target operation in the session display area of ​​the sending end. The first target operation is for the first selected area. For example, when the user of the sending end performs the first selection operation on the first emoticon image in the emoticon image display area for a set duration, the sending end may display a predetermined identifier image at a predetermined position in the session display area to indicate that the session display area has entered the point-and-click state.

[0107] Figure 8 A flowchart illustrating a method for displaying facial images in a session according to another embodiment of the present disclosure is shown schematically.

[0108] like Figure 8As shown in the embodiments of this disclosure, the method for displaying emoticons in a session includes an emoticon display area in the session interface, and the method may include the following steps.

[0109] In step S810, the session interface of the session is displayed, and the session interface includes a session display area.

[0110] In step S820, the first emoticon image sent by the sending end is displayed in the first selected area of ​​the session display area.

[0111] In step S830, the third expression image is displayed in the third selected area according to the third selection operation on the third expression image display area and the third target operation on the third selected area in the session display area.

[0112] In an exemplary embodiment, if the interval between the first target operation and the third target operation is less than a predetermined time, and the first selected area and the third selected area have a third overlapping area, then a third combined expression image of the first expression image and the third expression image is displayed in the third overlapping area.

[0113] The third set of emoticon images is displayed in the following way: Figure 10 As shown in the session interface 102, in this embodiment, 921 is, for example, a first emoticon image displayed in a first selected area, and 1011 is, for example, a third emoticon image displayed in a third selected area. The third combined emoticon image, consisting of the first tag image and the third emoticon image, is, for example, the gray portion in 1011.

[0114] The method for displaying emoticons in a session disclosed herein can be applied to social applications, such as WeChat. When the sending user long-presses an emoticon in the emoticon display area, the session display area enters a drawing mode. At this time, the sending user can use a pen or finger to tap or slide within the session display area on the screen, drawing a trajectory of the pen or finger on the screen using that emoticon as the pen stroke. The trajectory is displayed on both the sending and receiving screens for N seconds before disappearing, where N > 0.

[0115] This can also include special brushstrokes; for example, the "cleaver" emoji image is "cutting up" other emojis. For example... Figure 10 The session interface 102 is shown. When multiple facial expression strokes are in the session display area, the same facial expression images can be combined into a combined facial expression image when their trajectories overlap. For example, two "smiling" facial expression images can be combined into a larger "smiling" facial expression.

[0116] Both the sending and receiving users can "draw" in the session display area. Real-time interaction between the sending and receiving users can be achieved through different expressions or combinations of the same expressions, such as an interactive process similar to the "Fruit Ninja" game, thereby improving the user experience.

[0117] Furthermore, image recognition can be performed on the first selected area of ​​the first emoticon image displayed in the session display area. If the recognition result is a predetermined shape, the animation effect of the first emoticon image can be displayed at a predetermined position (e.g., within 10 pixels around) of the first selected area. For example, when the recognition result of the first selected area is a heart, a blinking effect of the first emoticon image can be displayed within 10 pixels around the first selected area.

[0118] To implement the method for displaying emoticons in a session provided in this disclosure, a combination of emoticons and triggering logic can be designed, and relevant resource files can be sent to the sending end and the receiving end. Figure 11 A flowchart illustrating a method for displaying emoticons in a session according to another embodiment of the present disclosure is shown schematically. The method may be implemented by... Figure 1 Execute on server 103.

[0119] like Figure 11 As shown, in step S1110, a combined facial expression image and triggering logic are received, and the combined facial expression image and triggering logic are sent to the sending end and the receiving end.

[0120] The combined emoji images include, for example, a first combined emoji image and a second emoji image, a second combined emoji image of the first emoji image, and a third combined emoji image of the first emoji image and a third emoji image. Each combined emoji image corresponds to a trigger logic. For example, the trigger logic for the first combined emoji image could be: the first selected area and the second selected area have a first overlapping area. The trigger logic for the second combined emoji image could be: the first sub-selected area and the second sub-selected area have a second overlapping area, and the sliding trajectory has a third overlapping area. The trigger logic for the third combined emoji image could be: the first selected area and the third selected area have a third overlapping area.

[0121] In step S1120, when the sender receives the entry dot drawing status message and the first target operation, the first expression image, the combined expression image of the first expression image, user information and other fields are transparently transmitted to the sender.

[0122] Among them, the dot-draw status message is generated by the sending end based on the first selection operation of the first emoticon image in the emoticon image display area, and the first target operation is the operation of the first selected area detected by the sending end in the session display area.

[0123] Specifically, when the user on the sending end long-presses the first emoticon image to enter the point drawing mode, the first emoticon image, the combined emoticon image, user information and other fields can be passed through to the front end.

[0124] In step S1130, the creation of the front-end rendering canvas is initiated.

[0125] A canvas is an element in which images can be drawn using scripts. It can be used for real-time video processing and rendering. A canvas is a drawable area defined by HTML code along with height and width attributes. JavaScript code can access this area and dynamically generate graphics using a complete set of drawing functions. The front-end can include, for example, a sending end and a receiving end.

[0126] In step S1140, the touch events of the sending end and / or receiving end are intercepted and passed through to the front end so that the front end can render the animation of the user's hand-drawn trajectory onto the screen.

[0127] The touch event can be, for example, a first target operation on a first selected area in the session display area, a second target operation on a second selected area in the session display area, or a third target operation on a third selected area in the session display area. The first, second, and third selected areas can be generated based on the user's hand-drawn trajectory. For example, the first, second, or third selected areas are determined based on the user's hand-drawn trajectory at the sending or receiving end. The rendered animation can be, for example, displaying a first emoticon image in the first selected area, a second emoticon image in the second selected area, a third emoticon image in the third selected area, a first combined emoticon image of the first and second emoticons in a first overlapping area, a second combined emoticon image of the first emoticon image in the second overlapping area, a second combined emoticon image of the first emoticon image in the third overlapping area, or a third combined emoticon image of the first and third emoticons in the third overlapping area.

[0128] The following describes a system embodiment of this disclosure, which can be used to execute the method for displaying emoticons in a session as described above. For details not disclosed in the system embodiments of this disclosure, please refer to the embodiments of the method for displaying emoticons in a session as described above.

[0129] Figure 12 A block diagram illustrating a system for displaying facial expressions in a session according to an embodiment of the present disclosure is shown schematically.

[0130] Reference Figure 12As shown, a system 1200 for displaying facial expressions in a session according to an embodiment of the present disclosure can be applied to a session between terminals, wherein the terminals include a sending end 1210 and a receiving end 1220.

[0131] The sending end 1210 can be used to display the session interface of the session, the session interface including a session display area and an emoticon display area, the emoticon display area displaying at least one emoticon image, the at least one emoticon image including a first emoticon image; according to a first selection operation on the first emoticon image in the emoticon display area, the session display area is made to enter a point-and-draw state; according to a first target operation on the first selected area in the session display area, the first emoticon image is displayed in the first selected area;

[0132] The receiver 1220 can be used to display the session interface of the session, the session interface including a session display area; the first emoticon image is displayed in a first selected area of ​​the session display area.

[0133] The system for displaying emoticons in a conversation provided by this disclosure, in the conversation interface displayed on the sending end and the receiving end, can enter a dot-draw state based on a first selection operation on a first emoticon image in the emoticon image display area, guiding the user to send the first emoticon image using dot-draw. In the dot-draw state, the user can perform a first target operation on the first selected area in the conversation display area. Based on this user-defined first target operation, the first emoticon image can be displayed in the first selected area, thereby realizing the customized display of the first emoticon image. This allows the user to express more multi-dimensional emotions based on emoticons with only fixed emotions, improving the efficiency of user communication. Moreover, the communication process only needs to transmit the first emoticon image and the first selected area, without transmitting too much text information, which can effectively reduce the amount of data transmission and reduce the server pressure.

[0134] In an exemplary embodiment, when the sending end 1210 causes the session display area to enter the dot-draw state according to the first selection operation on the first expression image in the expression image display area, it can be used to display a predetermined identifier image at a predetermined position in the session display area to indicate that the session display area has entered the dot-draw state when the first selection operation on the first expression image in the expression image display area reaches a set duration.

[0135] In an exemplary embodiment, the at least one facial expression image further includes a second facial expression image, and the transmitting end 1210 is further configured to: display the second facial expression image in the second selected area according to a second selection operation on the second facial expression image in the facial expression image display area and a second target operation on the second selected area in the session display area.

[0136] In an exemplary embodiment, the sending end 1210 is further configured to: if the interval between the second selection operation and the first target operation is less than a predetermined time, and the first selected area and the second selected area have a first overlapping area, then display a first combined expression image of the first expression image and the second expression image in the first overlapping area.

[0137] In an exemplary embodiment, the first target operation includes a click operation; wherein, when the sending end 1210 displays the first emoticon image in the first selected area according to the first target operation on the first selected area in the session display area, it can be used to: display the first emoticon image in the first selected area according to the click operation on the first selected area in the session display area.

[0138] In an exemplary embodiment, the click operation includes a first click operation and a second click operation, the first selected area includes a first sub-selected area and a second sub-selected area, the first click operation acts on the first sub-selected area, and the second click operation acts on the second sub-selected area; wherein, when the sending end 1210 displays the first emoticon image in the first selected area according to the click operation on the first selected area in the session display area, it can be used to: if the interval between the first click operation and the second click operation is less than a predetermined duration, and there is a second overlapping area between the first sub-selected area and the second sub-selected area, then display a second combined emoticon image of the first emoticon image in the second overlapping area.

[0139] In an exemplary embodiment, the first target operation includes a sliding operation; wherein, when the sending end 1210 displays the first emoticon image in the first selected area according to the first target operation on the first selected area in the session display area, it can be used to: generate a sliding trajectory in the first selected area according to the sliding operation on the first selected area in the session display area; and display a plurality of the first emoticon images on the sliding trajectory.

[0140] In an exemplary embodiment, when the sending end 1210 displays multiple first expression images on the sliding trajectory, it can be used to: if there is a third overlapping area on the sliding trajectory, then display a second combination of the first expression images in the third overlapping area.

[0141] In an exemplary embodiment, the sending end 1210 can also be used to display a third emoticon image sent by the receiving end within a third selected area of ​​the session display area.

[0142] In an exemplary embodiment, when the sending end 1210 displays the third emoticon image sent by the receiving end in the third selected area of ​​the session display area, it can be used to: if the time interval between the first target operation and the time of receiving the third emoticon image is less than a predetermined time, and there is a third overlapping area between the first selected area and the third selected area, then a third combined emoticon image of the first emoticon image and the third emoticon image is displayed in the third overlapping area.

[0143] In an exemplary embodiment, the conversation interface in the receiver 1220 further includes an emoticon image display area. The receiver 1220 can also be used to: display the third emoticon image in the third selected area according to a third selection operation on the third emoticon image in the emoticon image display area and a third target operation on the third selected area in the conversation display area.

[0144] In an exemplary embodiment, the receiver 1220 may also be used to: if the interval between the first target operation and the third target operation is less than a predetermined time, and the first selected area and the third selected area have a third overlapping area, then display a third combined expression image of the first expression image and the third expression image in the third overlapping area.

[0145] Figure 13 A schematic diagram of an electronic device suitable for implementing embodiments of the present disclosure is shown. It should be noted that... Figure 13 The illustrated electronic device 1300 is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0146] like Figure 13As shown, the electronic device 1300 includes a central processing unit (CPU) 1301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1302 or a program loaded from a storage section 1308 into a random access memory (RAM) 1303. The RAM 1303 also stores various programs and data required for system operation. The CPU 1301, ROM 1302, and RAM 1303 are interconnected via a bus 1304. An input / output (I / O) interface 1305 is also connected to the bus 1304.

[0147] The following components are connected to I / O interface 1305: an input section 1306 including a keyboard, mouse, etc.; an output section 1307 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 1308 including a hard disk, etc.; and a communication section 1309 including a network interface card such as a LAN card, modem, etc. The communication section 1309 performs communication processing via a network such as the Internet. Drive 1310 is also connected to I / O interface 1305 as needed. Removable media 1311, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 1310 as needed so that computer programs read from them can be installed into storage section 1308 as needed.

[0148] In particular, according to embodiments of this disclosure, the processes described below with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 1309, and / or installed from removable medium 1311. When the computer program is executed by central processing unit (CPU) 1301, it performs various functions defined in the system of this application.

[0149] It should be noted that the computer-readable medium disclosed herein may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having at least one wire, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0150] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing at least one executable instruction for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0151] The modules and / or units and / or sub-units described in the embodiments of this disclosure can be implemented in software or hardware, and the described modules and / or units and / or sub-units can also be located in a processor. The names of these modules and / or units and / or sub-units do not, in some cases, constitute a limitation on the module and / or unit and / or sub-unit itself.

[0152] On the other hand, this application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiments; or it may exist independently and not assembled into the electronic device. The computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to perform the methods described in the following embodiments. For example, the electronic device may perform... Figure 2 or Figure 3 or Figure 4 or Figure 5 or Figure 6 or Figure 7 or Figure 8 or Figure 11 The steps shown.

[0153] It should be noted that although several modules, units, or sub-units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules, units, or sub-units described above can be embodied in one module, unit, or sub-unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules, units, or sub-units.

[0154] From the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, touch terminal, or network device, etc.) to execute the method according to the embodiments of this disclosure.

[0155] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0156] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for displaying emoticons during a conversation, characterized in that, Applied to inter-terminal sessions, the terminals include a sending end and a receiving end, the method is executed by the sending end, and the method includes: The session interface displays the session, which includes a session display area and an emoticon display area. The emoticon display area displays at least one emoticon, which includes a first emoticon. Based on the first selection operation of the first emoticon image in the emoticon image display area, the session display area is made to enter the dot-draw state to guide the object to send the first emoticon image in dot-draw form; In response to a first target operation on a first selected area in the session display area, the trajectory of the first target operation drawn with the first emoticon image as the brush stroke is displayed in the first selected area; Send the first emoticon image and perform a first target operation on the first selected area, so that the receiving end displays the trajectory of the first target operation drawn with the first emoticon image as the brush stroke within the first selected area of ​​the session interface of the session.

2. The method as described in claim 1, characterized in that, Based on a first selection operation on the first facial expression image in the facial expression image display area, the session display area is brought into a point-and-draw state, including: When the first selection operation is performed on the first facial expression image in the facial expression image display area for a set duration, a predetermined identifier image is displayed at a predetermined position in the session display area to indicate that the session display area enters the dot-draw state.

3. The method as described in claim 1, characterized in that, The at least one facial expression image further includes a second facial expression image, and the method further includes: Based on a second selection operation on the second emoticon image in the emoticon image display area, and a second target operation on the second selected area in the session display area, the second emoticon image is displayed in the second selected area.

4. The method as described in claim 3, characterized in that, The method further includes: If the interval between the second selection operation and the first target operation is less than a predetermined time, and the first selected area and the second selected area have a first overlapping area, then a first combined expression image of the first expression image and the second expression image is displayed in the first overlapping area.

5. The method as described in claim 1, characterized in that, The first target operation includes a click operation; wherein, in response to the first target operation on a first selected area in the session display area, the trajectory of the first target operation drawn with the first emoticon image as the brush stroke is displayed in the first selected area, including: Based on the click operation on the first selected area in the session display area, the trajectory of the click operation, drawn with the first emoticon image as the brush stroke, is displayed in the first selected area.

6. The method as described in claim 5, characterized in that, The click operation includes a first click operation and a second click operation. The first selected area includes a first sub-selected area and a second sub-selected area. The first click operation is applied to the first sub-selected area, and the second click operation is applied to the second sub-selected area. Specifically, in response to a click operation on the first selected area in the session display area, displaying the trajectory of the first target operation drawn with the first emoticon image as the brush stroke within the first selected area includes: If the interval between the first click operation and the second click operation is less than a predetermined time, and there is a second overlapping area between the first sub-selected area and the second sub-selected area, then the second combined expression image of the first expression image is displayed in the second overlapping area.

7. The method as described in claim 1, characterized in that, The first target operation includes a sliding operation; Specifically, in response to a first target operation on a first selected area in the session display area, displaying the trajectory of the first target operation drawn with the first emoticon image as a brush stroke within the first selected area includes: In response to a sliding operation on the first selected area in the session display area, a sliding trajectory drawn with the first emoticon image as the brush stroke is generated within the first selected area; The sliding trajectory is displayed.

8. The method as described in claim 7, characterized in that, Displaying the sliding trajectory includes: If the sliding trajectory has a third overlapping region, then the second combined expression image of the first expression image is displayed in the third overlapping region.

9. The method as described in claim 1, characterized in that, Also includes: The third emoticon image sent by the receiving end is displayed in the third selected area of ​​the session display area.

10. The method as described in claim 9, characterized in that, The third emoticon image sent by the receiving end is displayed in the third selected area of ​​the session display area, including: If the time interval between the first target operation and the receipt of the third emoticon image is less than a predetermined time, and there is a third overlapping area between the first selected area and the third selected area, then a third combined emoticon image of the first emoticon image and the third emoticon image is displayed in the third overlapping area.

11. A method for displaying emoticons during a conversation, characterized in that, Applied to a session between terminals, the terminals include a sending end and a receiving end, the method is executed by the receiving end, and the method includes: The session interface displays the session, and the session interface includes a session display area; The trajectory of the first target operation, drawn with the first emoticon image as the brush stroke, sent by the sending end is displayed in the first selected area of ​​the session display area; The first selected area is generated by the sending end when it enters the dot-draw state in the session display area of ​​the sending end to guide the object to send the first emoticon image in the dot-draw form, based on the first target operation in the session display area of ​​the sending end. The first target operation is for the first selected area.

12. The method as described in claim 11, characterized in that, The conversation interface also includes an emoji display area, and the method further includes: Based on a third selection operation on the third emoticon image in the emoticon image display area, and a third target operation on the third selected area in the session display area, the third emoticon image is displayed in the third selected area.

13. The method as described in claim 12, characterized in that, Also includes: If the interval between the first target operation and the third target operation is less than a predetermined time, and the first selected area and the third selected area have a third overlapping area, then a third combined expression image of the first expression image and the third expression image is displayed in the third overlapping area.

14. A system for displaying facial expressions during a conversation, characterized in that, This is used in inter-terminal sessions, where the terminals include a sender and a receiver. The sending end is used to display the session interface of the session, which includes a session display area and an emoticon display area. The emoticon display area displays at least one emoticon image, including a first emoticon image. Based on a first selection operation on the first emoticon image in the emoticon display area, the session display area enters a dot-drawing state to guide the object to send the first emoticon image using a dot-drawing method. In response to a first target operation on the first selected area in the session display area, the trajectory of the first target operation drawn with the first emoticon image as the brush stroke is displayed in the first selected area. The receiving end is used to display the session interface of the session, the session interface including a session display area; within a first selected area of ​​the session display area, the trajectory of the first target operation drawn with the first emoticon image as the brush stroke is displayed.

15. An electronic device, characterized in that, include: At least one processor; Storage device for storing at least one program; When the at least one program is executed by the at least one processor, the at least one processor implements the method as described in any one of claims 1-13.

16. A computer-readable medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-13.

17. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method of any one of claims 1-13.

Images