Interaction method and device based on expression image, electronic equipment and storage medium

Abstract

The invention provides an interaction method and device based on an expression image, electronic equipment and a storage medium, and belongs to the technical field of multimedia. The method comprises the following steps: displaying various expression images in a virtual space; in response to a layout operation on at least one expression image in the plurality of expression images, displaying a plurality of target expression images belonging to the at least one expression image and arranging the target expression images into a target pattern; and in response to an expression sending operation, arranging and displaying the plurality of target expression images according to the target pattern in the virtual space. According to the technical scheme, the operability and interestingness during interaction based on the expression image are improved, and the interaction requirements of audience objects are met, so that the interaction rate in the virtual space is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of multimedia technology, and in particular to an interactive method, device, electronic device and storage medium based on expression images. Background Art

[0002] With the development of multimedia technology, people can interact with each other online through the Internet. During the interaction, one party can send an expression image to the other party to convey his or her mood. However, when sending multiple expression images during the above interaction, they are only displayed to the user in the order from left to right and from top to bottom. The style is single and the interest is low, which makes it difficult to meet the interaction needs of users. Summary of the invention

[0003] The present disclosure provides an interactive method, device, electronic device and storage medium based on expression images, which improves the operability and fun of interaction based on expression images, helps meet the interactive needs of audience objects, and thus improves the interactive rate in virtual space. The technical solution of the present disclosure is as follows.

[0004] According to one aspect of an embodiment of the present disclosure, there is provided an interactive method based on an expression image, comprising: Displaying multiple expression images in virtual space; In response to a layout operation on at least one of the plurality of expression images, displaying a plurality of target expression images belonging to the at least one expression image arranged into a target pattern; In response to an expression sending operation, the plurality of target expression images are displayed in the virtual space in an arrangement according to the target pattern.

[0005] According to another aspect of the present disclosure, there is provided an interactive device based on expression images, comprising: A first display unit is configured to display a plurality of expression images in a virtual space; A second display unit is configured to perform a layout operation in response to at least one of the plurality of expression images, and display a plurality of target expression images belonging to the at least one expression image arranged into a target pattern; The first display unit is further configured to execute, in response to an expression sending operation, displaying the plurality of target expression images in the virtual space in an arrangement according to the target pattern.

[0006] In some embodiments, the second display unit includes: A first display subunit is configured to execute, in response to the expression layout function being triggered, displaying a preset area, wherein the preset area is used to layout the expression image to be sent; The second display subunit is configured to execute, in response to a trigger operation on any position in the preset area, when an expression image of a target type is selected, display a target expression image belonging to the target type at the position, wherein the target expression image of the target type is an expression image of any type among the multiple expression images, and all target expression images displayed in the preset area constitute the target pattern.

[0007] In some embodiments, the target pattern is displayed in the preset area; The second display subunit is configured to display a target expression image belonging to the target type at a trigger position on the target pattern in response to a trigger operation on any position on the target pattern when an expression image of the target type is selected.

[0008] In some embodiments, the apparatus further comprises: The third display unit is configured to, when an expression image of a target type is selected, display a target expression image belonging to the target type at a position on the target pattern closest to the trigger position in response to a trigger operation on any position in the preset area.

[0009] In some embodiments, the predetermined area includes a plurality of patterns; The device also includes: The fourth display unit is configured to execute a pattern switching operation in response to the preset area, and switch a display pattern in the preset area from the target pattern to a next pattern.

[0010] In some embodiments, the apparatus further comprises: The deleting unit is configured to execute, in response to an expression deletion operation, deleting a target expression image indicated by the expression deletion operation in the preset area.

[0011] In some embodiments, the deleting unit is configured to execute, in response to a triggering operation on the first deletion control, deleting the target expression image with the latest appearance time in the preset area.

[0012] In some embodiments, the deletion unit is configured to execute a second deletion control corresponding to the target expression image in response to an editing operation on any target expression image in the preset area; and to delete the target expression image corresponding to the second deletion control in the preset area in response to a triggering operation on the second deletion control.

[0013] In some embodiments, the apparatus further comprises: The moving unit is configured to execute, for any target expression image in the preset area, in response to a moving operation on the target expression image, displaying the target expression image in the preset area moving to a position indicated by the moving operation.

[0014] In some embodiments, the apparatus further comprises: The replacement unit is configured to execute, for any target expression image in the preset area, in response to a replacement operation on the target expression image, display an expression image indicated by the replacement operation at a position of the target expression image in the preset area.

[0015] In some embodiments, the first display unit is configured to perform at least one of the following: In response to an expression sending operation, displaying the plurality of target expression images in an upper layer of a comment area in the virtual space in an arrangement according to the target pattern; In response to the expression sending operation, the plurality of target expression images are displayed in an upper layer of the live broadcast picture in the virtual space in an arrangement according to the target pattern.

[0016] In some embodiments, the first display unit is further configured to execute, in response to an expression sending operation, displaying the plurality of target expression images moving along a preset trajectory in the virtual space.

[0017] According to another aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising: one or more processors; A memory for storing program codes executable by the processor; The processor is configured to execute the program code to implement the above-mentioned interaction method based on expression images.

[0018] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When a program code in the computer-readable storage medium is executed by a processor of an electronic device, the electronic device is enabled to perform the above-mentioned interaction method based on expression images.

[0019] According to another aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program / instruction, which implements the above-mentioned interaction method based on expression images when executed by a processor.

[0020] According to the solution provided by the disclosed embodiment, before sending an expression image in the virtual space, the audience object can select at least one expression image from a plurality of expression images for layout, so as to arrange a plurality of target expression images belonging to the at least one expression image into a target pattern, so that after sending the expression image, the plurality of target expression images can be arranged and displayed in the virtual space according to the target pattern, that is, the audience object can create any pattern through the existing expression images and display the pattern in the virtual space, which not only improves the operability and fun of interaction based on expression images, helps to meet the interaction needs of the audience objects, and improves the interaction rate in the virtual space, but also can further display the intention of the audience objects through the target pattern on the basis of the expression image, thereby helping to improve the information transparency.

[0021] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0023] Figure 1 The present invention is a schematic diagram of an implementation environment of an interactive method based on expression images according to an exemplary embodiment.

[0024] Figure 2 The present invention is a flowchart of an interactive method based on expression images according to an exemplary embodiment.

[0025] Figure 3 The figure is a flow chart showing another interactive method based on expression images according to an exemplary embodiment.

[0026] Figure 4 is a schematic diagram of an expression panel according to an exemplary embodiment.

[0027] Figure 5 The figure is a schematic diagram showing a preset area according to an exemplary embodiment.

[0028] Figure 6 is a schematic diagram of a function switch control according to an exemplary embodiment.

[0029] Figure 7 It is a schematic diagram showing a layout operation according to an exemplary embodiment.

[0030] Figure 8 The figure is a schematic diagram showing startup prompt information according to an exemplary embodiment.

[0031] Fig. 9 The figure is a schematic diagram showing a layout of expression images according to an exemplary embodiment.

[0032] Fig.10 The figure is a schematic diagram showing another layout of expression images according to an exemplary embodiment.

[0033] Fig.11 is a schematic diagram showing yet another layout of expression images according to an exemplary embodiment.

[0034] Fig.12 is a schematic diagram showing a switching pattern according to an exemplary embodiment.

[0035] Fig.13 The diagram is a schematic diagram showing a method of displaying an expression image according to an exemplary embodiment.

[0036] Fig.14 is a schematic diagram of a trajectory according to an exemplary embodiment.

[0037] Fig.15 is a schematic diagram of a first deletion control according to an exemplary embodiment.

[0038] Fig.16 is a schematic diagram of a second deletion control according to an exemplary embodiment.

[0039] Fig.17 The figure is a schematic diagram showing a method of replacing an expression image according to an exemplary embodiment.

[0040] Fig.18 The figure is a flow chart showing a method of laying out an expression image according to an exemplary embodiment.

[0041] Fig.19 The present invention is a block diagram of an interactive device based on expression images according to an exemplary embodiment.

[0042] Fig. 20 It is a block diagram of a terminal according to an exemplary embodiment. DETAILED DESCRIPTION

[0043] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0044] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0045] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions. For example, the emoticon images involved in this disclosure are all obtained with full authorization.

[0046] Figure 1 FIG. 1 is a schematic diagram of an implementation environment of an interactive method based on expression images according to an exemplary embodiment. Figure 1 , the implementation environment specifically includes: a terminal 101 and a server 102.

[0047] The terminal 101 is at least one of a smart phone, a smart watch, a desktop computer, a laptop, an MP3 player, an MP4 player, and a portable laptop computer. An application supporting interaction is running on the terminal 101, and a user can log in to the application through the terminal 101 to obtain the services provided by the application. The application can be a multimedia application, a game application, a social application, etc., which is not limited in the embodiments of the present disclosure. The terminal 101 can be connected to the server 102 through a wireless network or a wired network, and can then send the interactive information (such as emoticon images) input by the user on the terminal 101 to the server 102, and the server 102 sends the interactive information to the terminals of other users specified by the terminal 101.

[0048] The terminal 101 generally refers to one of a plurality of terminals, and the present embodiment is described by taking the terminal 101 as an example. Those skilled in the art may know that the number of the above terminals may be more or less. For example, the above terminals may be several, or the above terminals may be dozens or hundreds, or a greater number. The present embodiment does not limit the number and device type of the terminals.

[0049] The server 102 is at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. The server 102 can be connected to the terminal 101 and other terminals through a wireless network or a wired network. The server 102 can receive interactive information sent by the terminal 101 and send the received interactive information to other terminals so that users can interact through users of other terminals. In some embodiments, the number of the above servers can be more or less, and the embodiments of the present disclosure are not limited to this. Of course, the server 102 also includes other functional servers to provide more comprehensive and diversified services.

[0050] Figure 2 is a flowchart of an interactive method based on expression images according to an exemplary embodiment. Figure 2 , the interactive method based on expression images is applied in a terminal and includes the following steps.

[0051] In step 201, the terminal displays a variety of expression images in a virtual space.

[0052] In the embodiments of the present disclosure, the virtual space may be a virtual live studio or a virtual room, which is not limited in the embodiments of the present disclosure. The virtual space includes a host object and an audience object. In the virtual space, the audience object and the host object can interact with each other. The virtual space may provide a variety of interactive methods such as sending comment information or barrage messages, and following the host object in the virtual space, which is not limited in the embodiments of the present disclosure. The audience object in the virtual space can perform the above-mentioned multiple interactive behaviors in the virtual space through the terminal operated by itself, thereby interacting with the host object in the virtual space.

[0053] The comment message or bullet screen message in the virtual space may be a text message or an image message, which is not limited in the embodiments of the present disclosure. That is, the audience object in the virtual space can send text messages in the virtual space, or send expression images to convey their own moods, etc. In the process of sending expression images, the terminal can first display a variety of expression images to the audience object in the virtual space for the audience object to choose.

[0054] In step 202, in response to a layout operation on at least one expression image among a plurality of expression images, the terminal displays a plurality of target expression images belonging to the at least one expression image arranged into a target pattern.

[0055] In the disclosed embodiment, before sending an expression, the audience object can lay out the expression images to be sent so as to arrange the multiple target expression images to be sent into a target pattern. Among them, for at least one expression image among the multiple expression images, when at least one expression image is laid out, the terminal displays multiple target expression images belonging to the at least one expression image arranged into a target pattern. That is, the target pattern is the layout of multiple target expression images.

[0056] The target pattern may be a graphic, such as a heart, circle, square, etc., or the target pattern may be text, such as "heart", "love", "come on", etc., which is not limited in the embodiments of the present disclosure. The multiple target expression images arranged into the target pattern may be expression images of the same type or different types, etc., which is not limited in the embodiments of the present disclosure. The same type refers to the same display style.

[0057] In step 203, in response to the expression sending operation, the terminal displays a plurality of target expression images in a virtual space in a target pattern arrangement.

[0058] In the embodiment of the present disclosure, after the layout of the multiple target expression images to be sent is completed, in response to the sending operation of the multiple target expression images, the terminal arranges and displays the multiple target expression images in the virtual space according to the style of the target pattern. That is, in response to the expression sending operation, the terminal can arrange and display the multiple target expression images sent by the audience object in the virtual space according to the layout mode (i.e., the target pattern) indicated by the audience object.

[0059] The disclosed embodiments provide an interactive method based on expression images. Before sending an expression image in a virtual space, an audience object can select at least one expression image from a plurality of expression images for layout, so as to arrange a plurality of target expression images belonging to the at least one expression image into a target pattern. After sending the expression image, the plurality of target expression images can be arranged and displayed in the virtual space according to the target pattern. That is, the audience object can create any pattern through existing expression images and display the pattern in the virtual space. This not only improves the operability and fun of interaction based on expression images, helps meet the interaction needs of the audience object, and improves the interaction rate in the virtual space, but also can further display the intention of the audience object through the target pattern on the basis of the expression image, thereby helping to improve the information transparency.

[0060] In some embodiments, in response to a layout operation on at least one of the plurality of expression images, displaying a plurality of target expression images belonging to the at least one expression image arranged into a target pattern includes: In response to the expression layout function being triggered, a preset area is displayed, where the preset area is used to layout the expression image to be sent; When an expression image of a target type is selected, in response to a trigger operation on any position in the preset area, a target expression image belonging to the target type is displayed at the position. The target expression image of the target type is any type of expression image among a variety of expression images, and all target expression images displayed in the preset area constitute a target pattern.

[0061] The solution provided by the embodiment of the present disclosure is that when any type of expression image is selected, whenever a certain position in the preset area is triggered, the expression image of the selected type can be displayed at that position. Since the triggered position is the position actively triggered by the object, it can accurately reflect the expression position desired by the object. By directly displaying the expression image of the selected type at this position, not only is the operation simple and beneficial to improving the efficiency of human-computer interaction, but it also meets the interaction needs of the object and ensures the accuracy of interaction based on expression images.

[0062] In some embodiments, a target pattern is displayed in the preset area; When an expression image of a target type is selected, in response to a trigger operation on any position in a preset area, a target expression image belonging to the target type is displayed at the position, including: When an expression image of a target type is selected, in response to a trigger operation on any position on the target pattern, a target expression image belonging to the target type is displayed at the trigger position on the target pattern.

[0063] The solution provided by the embodiment of the present disclosure provides a target pattern in a preset area, so that the object can layout the expression image according to the target pattern. The object does not need to consider the layout method of the expression image, and only needs to layout it according to the target pattern. The operation is simple and can improve the efficiency of human-computer interaction. Moreover, compared with the solution in which the object randomly layouts the expression images, this solution ensures the neatness and regularity of the expression layout by providing the target pattern.

[0064] In some embodiments, the method further comprises: When an expression image of a target type is selected, in response to a trigger operation on any position in the preset area, a target expression image belonging to the target type is displayed at a position on the target pattern closest to the trigger position.

[0065] The solution provided by the disclosed embodiment can accurately reflect the desired expression position of the object, because the triggered position is the position actively triggered by the object. By displaying the expression image at the position closest to the trigger position on the target pattern, it not only meets the interaction needs of the object and ensures the accuracy of interaction based on the expression image, but also is simple to operate and does not require the object to adjust itself to the target pattern, which is beneficial to improving the efficiency of human-computer interaction, and meets the interaction needs of the object and ensures the accuracy of interaction based on the expression image. Moreover, compared with the solution in which the object arbitrarily arranges the expression images, this solution ensures the neatness and regularity of the expression layout by providing the target pattern.

[0066] In some embodiments, the predetermined area includes a plurality of patterns; The method also includes: In response to the pattern switching operation on the preset area, the display pattern in the preset area is switched from the target pattern to the next pattern.

[0067] The solution provided by the embodiment of the present disclosure provides multiple patterns in a preset area, so that the object can select a suitable pattern to layout the expression image according to its own interaction needs. This is not only simple to operate, but also helpful in meeting the interaction needs of the object, thereby helping to improve the interaction rate in the virtual space.

[0068] In some embodiments, the method further comprises: In response to the expression deletion operation, a target expression image indicated by the expression deletion operation is deleted in the preset area.

[0069] The solution provided by the embodiment of the present disclosure supports the object to delete unnecessary expression images according to its own interaction needs, avoids the subsequent sending of unnecessary expression images in the virtual space, and is conducive to meeting the interaction needs of the object.

[0070] In some embodiments, in response to an expression deletion operation, deleting a target expression image indicated by the expression deletion operation in a preset area includes: In response to the triggering operation on the first deletion control, the target expression image with the latest appearance time is deleted in the preset area.

[0071] The solution provided by the embodiment of the present disclosure provides a first deletion control so that the object can delete the most recently added expression image through the first deletion control. The operation is simple and can improve the efficiency of human-computer interaction.

[0072] In some embodiments, in response to an expression deletion operation, deleting a target expression image indicated by the expression deletion operation in a preset area includes: In response to an editing operation on any target expression image in the preset area, displaying a second deletion control corresponding to the target expression image; In response to the triggering operation on the second deletion control, the target expression image corresponding to the second deletion control is deleted in the preset area.

[0073] The solution provided by the embodiment of the present disclosure provides a corresponding second deletion control for each laid out target expression image in a preset area, so that the object can delete any target expression image in the preset area according to its own interaction needs without destroying the layout of other target expression images. The operation is simple and can improve the efficiency of human-computer interaction.

[0074] In some embodiments, the method further comprises: For any target expression image in the preset area, in response to a move operation on the target expression image, the target expression image is displayed in the preset area and moves to a position indicated by the move operation.

[0075] The solution provided by the embodiments of the present disclosure allows an object to change the layout of expression images by moving expression images in a preset area according to its own interaction needs, without having to delete the expression images and then add new expression images in appropriate locations. The operation is simple and can improve the efficiency of human-computer interaction.

[0076] In some embodiments, the method further comprises: For any target expression image in the preset area, in response to a replacement operation on the target expression image, an expression image indicated by the replacement operation is displayed at the position of the target expression image in the preset area.

[0077] The solution provided by the disclosed embodiment allows the object to directly replace any expression image that does not meet the requirements in a preset area according to its own interaction needs, without having to delete the expression image and then add a new expression image in the same position. The operation is simple and can improve the efficiency of human-computer interaction.

[0078] In some embodiments, in response to the expression sending operation, in the virtual space, multiple target expression images are displayed in a target pattern arrangement, including at least one of the following: In response to the expression sending operation, a plurality of target expression images are displayed in an upper layer of the comment area in the virtual space in an arrangement according to a target pattern; In response to the expression sending operation, a plurality of target expression images are displayed in an upper layer of the live broadcast picture in the virtual space in an arrangement according to a target pattern.

[0079] The solution provided by the disclosed embodiment, by displaying multiple target expression images arranged in a target pattern on the upper layer of the comment area or the upper layer of the live broadcast screen, makes it easy for each object in the virtual space to see the multiple target expression images arranged in the target pattern in a timely and clear manner, thereby improving the efficiency of information transmission and interaction.

[0080] In some embodiments, the method further comprises: In response to the expression sending operation, multiple target expression images are displayed in the virtual space to move along a preset trajectory.

[0081] The solution provided by the disclosed embodiment facilitates each object in the virtual space to see the multiple target expression images arranged in a target pattern in a timely manner by displaying the movement of multiple target expression images, thereby improving the efficiency of information transmission and interaction.

[0082] Above Figure 2 The following is only a basic process of the present disclosure. The solution provided by the present disclosure is further described based on a specific implementation method. Figure 3 FIG. 1 is a flow chart of another interactive method based on expression images according to an exemplary embodiment. Figure 3 ,The interaction method based on expression images includes the following steps.

[0083] In step 301, the terminal displays a variety of expression images in a virtual space.

[0084] In the disclosed embodiment, in response to the audience object entering the virtual space, the terminal displays the virtual space, which includes the host object. The host object and the audience object can interact in the virtual space. For example, the audience object can send a comment message or a bullet message in the virtual space to interact with the host object in the virtual space. Among them, the audience object can select an expression image as a comment message or a bullet message to interact.

[0085] The virtual space includes an expression control, and the embodiment of the present disclosure does not limit the display style and display position of the expression control. In response to the triggering operation of the expression control, the terminal displays an expression panel in the virtual space. The expression panel includes a variety of expression images.

[0086] For example, Figure 4 is a schematic diagram of an expression panel according to an exemplary embodiment. Figure 4 , the virtual space includes a message input box 401. The message input box 401 is used to obtain a comment message or a bullet message input by an audience object. The message input box 401 includes an expression control 402. When the expression control 402 is triggered, the terminal displays an expression panel 403 in the virtual space. The expression panel 403 displays a variety of expression images.

[0087] In step 302, in response to the expression layout function being triggered, the terminal displays a preset area, where the preset area is used to layout the expression image to be sent.

[0088] In the embodiment of the present disclosure, when the expression layout function is triggered, the terminal displays a preset area in the virtual space so that the audience object can layout the expression image to be sent in the preset area. The embodiment of the present disclosure does not limit the display position of the preset area. Optionally, the terminal displays the preset area in the upper layer of the layer to which the comment area belongs in the virtual space. That is, the terminal displays the preset area in the form of a floating layer (or mask) in the virtual space.

[0089] In some embodiments, while displaying the preset area, the terminal may also display layout prompt information in the preset area. The layout prompt information is used to prompt that the expression image to be sent can be laid out in the preset area. The solution provided by the embodiment of the present disclosure facilitates the audience to quickly understand the purpose of the preset area by displaying the layout prompt information, so that the expression image to be sent can be laid out in the preset area quickly, thereby improving the efficiency of information transmission and human-computer interaction.

[0090] For example, Figure 5 is a schematic diagram showing a preset area according to an exemplary embodiment. Figure 5 The terminal displays the preset area 501 in a gray, semi-transparent floating layer in the virtual space. The preset area 501 includes layout prompt information 502 to prompt the audience to layout the expression image to be sent in the preset area 501.

[0091] The embodiment of the present disclosure does not limit the triggering method (or starting method) of the expression layout function.

[0092] In some embodiments, the terminal may provide a function switch control in the virtual space to control the opening and closing of the expression layout function. Accordingly, the terminal displays the function switch control in the virtual space, and in response to the opening operation of the function switch control, the terminal determines that the expression layout function is turned on, and then the terminal displays the preset area in the virtual space. The disclosed embodiment provides a solution to directly control the opening and closing of the expression layout function through the function switch control, which is simple to operate and can improve the efficiency of human-computer interaction.

[0093] The embodiment of the present disclosure does not limit the display style and display position of the function switch control. For example, Figure 6 FIG. 1 is a schematic diagram of a function switch control according to an exemplary embodiment. Figure 6 , the terminal displays a function switch control 602 in the expression panel 601. When the function switch control 602 is triggered, the terminal displays a preset area 603 in the virtual space.

[0094] In other embodiments, the audience object can also enable the expression layout function by triggering an expression image. Accordingly, for any one of the multiple expression images, in response to the layout operation of the expression image, the terminal determines that the expression layout function is enabled, and then the terminal displays the preset area in the virtual space. The disclosed embodiment provides a solution without adding additional operation controls in the virtual space, simplifies the content in the virtual space, and improves the utilization rate of the expression images.

[0095] The layout operation for the expression image can be a double-click operation, a long-press operation, a sliding operation (left sliding or right sliding), etc. Figure 7 , Figure 7 This is a schematic diagram of a layout operation according to an exemplary embodiment. The layout operation can be single-click, long press, double-click, pinch, zoom in, slide left, slide right, slide up, slide down, slide left and right, slide up and down, drag right, drag left, drag down or drag up, etc., which is not limited to the embodiments of the present disclosure.

[0096] In some embodiments, before the expression layout function is triggered, the terminal may also display a startup prompt message in the virtual space. The startup prompt message is used to prompt the method of starting (or triggering) the expression layout function. The solution provided by the embodiment of the present disclosure facilitates the audience to quickly understand the method of triggering the expression layout function by displaying the startup prompt message, so that the expression layout function can be used to interact more quickly, thereby improving the efficiency of information transmission and human-computer interaction.

[0097] The embodiments of the present disclosure do not limit the specific content and display location of the startup prompt information. Figure 8 FIG. 1 is a schematic diagram showing a startup prompt message according to an exemplary embodiment. Figure 8 The terminal displays a startup prompt message 802 on the upper layer of the expression panel 801 to prompt the audience to double-click any expression image in the expression panel to start the expression layout function. Then, in response to a double-click operation on any expression image in the plurality of expression images, the terminal displays a preset area 803 in the virtual space.

[0098] In other embodiments, in addition to the triggering method for starting the expression layout function, the terminal can also automatically trigger the expression layout function when the display time of multiple expression images reaches a preset time, thereby displaying a preset area in the virtual space. This method does not require object operation, can automatically start the expression layout function, and directly display the preset area where the expression layout can be performed to the audience object, which is conducive to improving the efficiency of human-computer interaction.

[0099] In step 303, in response to a layout operation on at least one of the plurality of expression images, the terminal displays a plurality of target expression images belonging to the at least one expression image in a preset area arranged into a target pattern.

[0100] In an embodiment of the present disclosure, the audience object can select at least one expression image from a plurality of expression images, and lay out the selected type of expression images in a preset area, so as to arrange the multiple target expression images to be sent into a target pattern. Among them, for any one of the multiple expression images, when the expression image is selected, the terminal can display the target expression image belonging to the expression image in the preset area, and the embodiment of the present disclosure does not limit the number of the same expression images. The styles of target expression images of the same kind (type) are the same. The audience object can arrange multiple target expression images belonging to at least one expression image into a target pattern, which can be regarded as drawing the target pattern through expression images. The embodiment of the present disclosure does not limit the style of the target pattern.

[0101] The embodiments of the present disclosure do not limit the layout of the expression images. In some embodiments, the audience object can indicate the display position of the selected expression image in the preset area. Accordingly, when the expression image of the target type is selected, in response to the triggering operation of any position in the preset area, the terminal displays the target expression image belonging to the target type at the position. The target expression image of the target type is an expression image of any type among a plurality of expression images. That is, when any expression image is selected, each time the audience object is triggered once in the preset area, the terminal displays the expression image at the triggering position. Thus, the audience object can layout multiple target expression images in the preset area in the above manner. Multiple target expression images may belong to the same type, or may not all belong to the same type. For example, the types (or styles) of multiple target expression images are all different, or there are expression images of the same type among multiple target expression images. The embodiments of the present disclosure do not limit this. All target expression images displayed in the preset area constitute a target pattern.

[0102] The disclosed embodiment provides a solution. When any type of expression image is selected, whenever a certain position in a preset area is triggered, the expression image of the selected type can be displayed at that position. Since the triggered position is the position actively triggered by the object, it can accurately reflect the expression position desired by the object. By directly displaying the expression image of the selected type at this position, not only is the operation simple and conducive to improving the efficiency of human-computer interaction, but it also meets the interaction needs of the object and ensures the accuracy of interaction based on expression images.

[0103] For example, Fig. 9 FIG. 1 is a schematic diagram showing a layout of expression images according to an exemplary embodiment. Fig. 9 , when the first expression image 901 is selected, in response to a triggering operation on any position in the preset area 902, the terminal displays the first expression image 901 at the triggered position. Fig. 9 As shown, the audience object triggers 5 positions in the preset area 902, and the terminal displays the first expression image 901 at the corresponding position, so that 5 first expression images 901 can be seen. Then, the audience object can continue to switch other expression images for layout. Fig. 9 As shown, the second expression image 903, the third expression image 904, the fourth expression image 905, and the fifth expression image 906 are selected in sequence and arranged in the preset area, and all the expression images displayed in the preset area constitute a target pattern - a heart shape.

[0104] In other embodiments, the terminal is able to provide a target pattern in a preset area so that the audience object can layout the expression according to the target pattern. Accordingly, the terminal displays the target pattern in the preset area. Then, in the case where an expression image of a target type is selected, in response to a trigger operation on any position on the target pattern, the terminal displays a target expression image of the target type at the trigger position on the target pattern. The disclosed embodiment provides a solution, which facilitates the object to layout the expression image according to the target pattern by providing a target pattern in a preset area. The object does not need to consider the layout method of the expression image, but only needs to layout it according to the target pattern. The operation is simple, and the efficiency of human-computer interaction can be improved. Moreover, compared with the solution in which the object arbitrarily layouts the expression image, the present solution ensures the neatness and regularity of the expression layout by providing a target pattern.

[0105] For example, Fig.10 FIG. 1 is a schematic diagram showing another layout of expression images according to an exemplary embodiment. Fig.10 , a target pattern 1002, a heart shape, is displayed in the preset area 1001. When the first expression image 1003 is selected, in response to a triggering operation on any edge position on the target pattern 1002, the terminal displays the first expression image 1003 at the triggered edge position on the target pattern 1002. Fig.10 As shown, the audience object triggers 5 positions on the target pattern 1002, and the terminal displays the first expression image 1003 at the corresponding position, thereby showing 5 first expression images 1003. Then, the audience object can continue to switch other expression images for layout. Fig.10 As shown, the second expression image 1004, the third expression image 1005, the fourth expression image 1006, and the fifth expression image 1007 are selected in sequence and arranged on the target pattern 1002. All the expression images displayed in the preset area form a heart shape.

[0106] In other embodiments, the terminal can also assist the object to layout the expression image in a suitable position. Accordingly, a target pattern is displayed in the preset area. When the expression image of the target type is selected, in response to the trigger operation of any position in the preset area, the terminal displays the target expression image belonging to the target type at the position closest to the trigger position on the target pattern. That is, when the position triggered by the object is not on the target pattern (that is, when the trigger position is not aligned with the target pattern), the terminal can directly display the expression image at the position closest to the trigger position on the target pattern. The disclosed embodiment provides a solution, because the triggered position is the position where the object actively triggers, it can accurately reflect the expression position desired by the object, by displaying the expression image at the position closest to the trigger position on the target pattern, not only meets the interaction requirements of the object, but also ensures the accuracy of the interaction based on the expression image, and the operation is simple, without the need for the object to adjust itself to the target pattern, which is conducive to improving the efficiency of human-computer interaction, and meets the interaction requirements of the object, ensuring the accuracy of the interaction based on the expression image, and, compared with the solution of the object arbitrarily laying out the expression image, this solution ensures the neatness and regularity of the expression layout by providing the target pattern.

[0107] In other embodiments, the target pattern displayed in the preset area may also include a preset number of expression positions. Each expression position is used to accommodate (or display) an expression image. Then, for any expression position in the preset number of expression positions, when an expression image of the target type is selected, in response to a trigger operation on the expression position, the terminal displays a target expression image of the target type at the expression position. The disclosed embodiment provides a solution that further ensures the neatness and regularity of the expression layout by providing a preset number of expression positions on the target pattern, and limits the number of expression images sent at one time. This can not only avoid the interaction process being stuck due to excessive message data volume and reduce the interaction burden, but also minimize the interference of too many expression images on the screen in the virtual space after the expression images are sent.

[0108] In other embodiments, in addition to placing multiple target expression images on the edge of the target pattern, the terminal may also place multiple target expression images inside the target pattern, which is equivalent to filling the target pattern with multiple target expression images, which is not limited in the embodiments of the present disclosure.

[0109] For example, Fig.11 FIG. 1 is a schematic diagram showing another layout of expression images according to an exemplary embodiment. Fig.11, a target pattern 1102, a heart shape, is displayed in the preset area 1101. When the first expression image 1103 is selected, in response to a triggering operation on any position on the target pattern 1102, the terminal displays the first expression image 1103 at the triggered position inside the target pattern 1102. Fig.11 As shown, the audience object triggers 5 positions on the target pattern 1102, and the terminal displays the first expression image 1103 at the corresponding position, thereby showing 5 first expression images 1103. Then, the audience object can switch to the second expression image 1004 to continue the layout to gradually fill the target pattern 1102.

[0110] In some embodiments, a preset area may include multiple patterns for the audience to select. Accordingly, in response to the pattern switching operation on the preset area, the terminal switches the pattern displayed in the preset area from the target pattern to the next pattern. The solution provided by the embodiment of the present disclosure provides multiple patterns in the preset area, so that the object can select a suitable pattern to layout the expression image according to its own interaction needs. Not only is the operation simple, but it is also conducive to meeting the interaction needs of the object, thereby helping to improve the interaction rate in the virtual space.

[0111] For example, Fig.12 is a schematic diagram showing a switching pattern according to an exemplary embodiment. Fig.12 , a target pattern 1202 (heart shape) and a pattern switching control 1203 are displayed in the preset area 1201. In response to the triggering operation of the pattern switching control 1203, the pattern in the preset area 1201 displayed by the terminal is switched from the target pattern 1202 to the next pattern 1204 (circle).

[0112] In step 304, in response to the expression sending operation, the terminal displays a plurality of target expression images in a virtual space in a target pattern arrangement.

[0113] In the embodiment of the present disclosure, in response to the sending operation of multiple target expression images in the preset area, the terminal displays the multiple target expression images in a target pattern arrangement in the virtual space. The expression layout before and after the expression is sent is the same.

[0114] The embodiments of the present disclosure do not limit the display positions of multiple target expression images in the virtual space. In some embodiments, in response to an expression sending operation, the terminal displays multiple target expression images arranged in a target pattern in the upper layer of the comment area in the virtual space. Alternatively, in response to an expression sending operation, the terminal displays multiple target expression images arranged in a target pattern in the upper layer of the live broadcast screen in the virtual space. The solution provided by the embodiments of the present disclosure facilitates each object in the virtual space to see the multiple target expression images arranged in the target pattern in a timely and clear manner by displaying the multiple target expression images arranged in the target pattern in the upper layer of the comment area or the upper layer of the live broadcast screen, thereby improving the efficiency of information transmission and interaction.

[0115] For example, Fig.13 FIG. 1 is a schematic diagram showing a display of an expression image according to an exemplary embodiment. Fig.13 The terminal may display a plurality of target expression images arranged in a heart shape on the upper layer of the comment area or on the upper layer of the live broadcast screen.

[0116] In the process of displaying multiple target expression images, the multiple target expression images arranged into a target pattern can be fixedly displayed at a certain position in the virtual space, or the multiple target expression images arranged into a target pattern can also be moved in the virtual space, which is not limited in the embodiments of the present disclosure.

[0117] In some embodiments, multiple target expression images arranged in a target pattern can move in a virtual space. Accordingly, in response to the expression sending operation, the terminal displays multiple target expression images moving along a preset trajectory in the virtual space. The solution provided by the embodiment of the present disclosure facilitates each object in the virtual space to see the multiple target expression images arranged in a target pattern in a timely manner by displaying the movement of multiple target expression images, thereby improving the efficiency of information transmission and interaction.

[0118] The embodiments of the present disclosure do not limit the preset trajectories of the multiple target expression images. Furthermore, during the movement, the multiple target expression images can maintain the layout of the target pattern unchanged, or the layout of the multiple target expression images can change with the movement based on the target pattern, which is also not limited in the embodiments of the present disclosure.

[0119] For example, Fig.14 is a schematic diagram of a trajectory according to an exemplary embodiment. Fig.14The preset track can be right floating screen, left floating screen, bottom floating screen, top floating screen, appearing in place, etc. During the movement, the layout of the target pattern of multiple target expression images remains unchanged. Alternatively, the preset track can also be gathering floating screen (multiple target expression images gather toward the center), diffusion floating screen (multiple target expression images diffuse in all directions), etc. During the movement, the layout of the target pattern of multiple target expression images remains unchanged.

[0120] The disclosed embodiments provide an interactive method based on expression images. Before sending an expression image in a virtual space, an audience object can select at least one expression image from a plurality of expression images for layout, so as to arrange a plurality of target expression images belonging to the at least one expression image into a target pattern. After sending the expression image, the plurality of target expression images can be arranged and displayed in the virtual space according to the target pattern. That is, the audience object can create any pattern through existing expression images and display the pattern in the virtual space. This not only improves the operability and fun of interaction based on expression images, helps meet the interaction needs of the audience object, and improves the interaction rate in the virtual space, but also can further display the intention of the audience object through the target pattern on the basis of the expression image, thereby helping to improve the information transparency.

[0121] In the process of laying out the emoticon images in the preset area, in addition to adding a new emoticon image in the preset area, the terminal can also edit the emoticon images that have been laid out. The editing operation can be deleting the emoticon images that have been laid out in the preset area, moving the emoticon images that have been laid out in the preset area, or replacing the emoticon images that have been laid out in the preset area, etc., which is not limited in the embodiments of the present disclosure.

[0122] In some embodiments, the terminal can delete the expression images that have been arranged in the preset area. Accordingly, in response to the expression deletion operation, the terminal deletes the target expression image indicated by the expression deletion operation in the preset area. The solution provided by the embodiment of the present disclosure supports the object to delete unnecessary expression images according to its own interaction needs, avoids the subsequent sending of unnecessary expression images in the virtual space, and is conducive to meeting the interaction needs of the object.

[0123] The embodiments of the present disclosure do not limit the manner of deleting expression images. In some embodiments, the terminal can provide a first deletion control in the virtual space. The first deletion control is used to delete the target expression image that appears latest in the preset area, that is, to delete the expression image that is most recently added in the preset area. Accordingly, the process of the terminal deleting the expression image includes: in response to the triggering operation of the first deletion control, the terminal deletes the target expression image that appears latest in the preset area. The solution provided by the embodiments of the present disclosure, by providing a first deletion control, allows the object to delete the most recently added expression image through the first deletion control, which is simple to operate and can improve the efficiency of human-computer interaction.

[0124] The embodiment of the present disclosure does not limit the display style and display position of the first deletion control. For example, Fig.15 FIG. 1 is a schematic diagram showing a first deletion control according to an exemplary embodiment. Fig.15 , the terminal displays a first deletion control 1502 on the expression panel 1501. When the first deletion control 1502 is triggered, the terminal deletes the expression image 1504 newly added in the preset area 1503.

[0125] In other embodiments, the terminal can also provide a corresponding second deletion control for each laid out target expression image in the virtual space. The first deletion control is used to delete the corresponding target expression image. Accordingly, the process of the terminal deleting an expression image includes: in response to an editing operation on any target expression image in a preset area, the terminal displays a second deletion control corresponding to the target expression image. Then, in response to a triggering operation on the second deletion control, the terminal deletes the target expression image corresponding to the second deletion control in the preset area. The solution provided by the embodiment of the present disclosure provides a corresponding second deletion control for each laid out target expression image in the preset area, so that the object can delete any target expression image in the preset area according to its own interaction needs without destroying the layout of other target expression images. The operation is simple and can improve the efficiency of human-computer interaction.

[0126] The embodiment of the present disclosure does not limit the display style and display position of the second delete control. Fig.16 FIG. 1 is a schematic diagram showing a second deletion control according to an exemplary embodiment. Fig.16 , taking the target expression image 1602 in the preset area 1601 as an example, in response to the long press operation on the target expression image 1602, the terminal displays the operation panel 1603 of the target expression image 1602. The operation panel 1603 displays a second deletion control 1604. When the second deletion control 1604 is triggered, the terminal deletes the target expression image 1602 from the preset area 1601.

[0127] In some embodiments, the terminal is able to move the expression images that have been laid out in a preset area. Accordingly, for any target expression image in the preset area, in response to a move operation on the target expression image, the terminal displays the target expression image in the preset area moving to the position indicated by the move operation. For example, in response to a drag operation on any target expression image in the preset area, the terminal displays the target expression image moving to the position where the drag operation stops. The disclosed embodiments provide a solution that supports objects to change the layout of expression images by moving expression images in a preset area according to their own interaction needs. There is no need to delete the expression images and then add new expression images in appropriate positions. The operation is simple and can improve the efficiency of human-computer interaction.

[0128] In some embodiments, the terminal can also replace the emoticon images that have been laid out in the preset area. Accordingly, for any target emoticon image in the preset area, in response to the replacement operation of the target emoticon image, the terminal displays the emoticon image indicated by the replacement operation at the position of the target emoticon image in the preset area. The disclosed embodiment provides a solution that supports the object to directly replace any emoticon image that does not meet the requirements in the preset area according to its own interaction needs, without having to delete the emoticon image and then add a new emoticon image in the same position. The operation is simple and can improve the efficiency of human-computer interaction.

[0129] For example, Fig.17 FIG. 1 is a schematic diagram showing a method of replacing an expression image according to an exemplary embodiment. Fig.17 , taking the target expression image 1702 in the preset area 1701 as an example, in response to the long press operation on the target expression image 1702, the terminal displays the operation panel 1703 of the target expression image 1702. A replacement control 1704 is displayed in the operation panel 1703. When the replacement control 1704 is triggered, in response to the selection operation on the expression image 1705, the terminal displays the target expression image 1702 in the preset area and replaces it with the expression image 1705.

[0130] In order to more clearly describe the interactive method based on expression images provided by the embodiment of the present disclosure, the interactive method is further described below in conjunction with the accompanying drawings. Fig.18 FIG. 1 is a flow chart showing a layout of an expression image according to an exemplary embodiment. Fig.18After the audience object enters the virtual space, it can interact with the anchor object or other audience objects in the virtual space by sending expression images. Among them, the audience object opens the expression panel in the virtual space. In response to the double-click operation of any expression image in the expression panel, the terminal starts the expression layout function and displays the preset area in the virtual space. Then, the terminal detects whether the audience object switches the selected expression image. If not, in response to the trigger operation of any position in the preset area, the terminal displays the selected expression image at the position. If the selected expression image is switched, in response to the trigger operation of any position in the preset area, the terminal displays the expression image after switching at the position. In the meantime, the terminal can also detect whether the audience object edits the laid out expression image. If the editing operation is detected, the terminal edits the laid out expression image. Finally, in response to the expression sending operation, the terminal sends multiple target expression images in the preset area, and then the terminal displays multiple target expression images in the virtual space according to the target pattern arrangement.

[0131] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, and will not be described in detail here.

[0132] Fig.19 is a block diagram of an interactive device based on expression images according to an exemplary embodiment. Fig.19 The interactive device based on expression images includes: a first display unit 1901 and a second display unit 1902.

[0133] The first display unit 1901 is configured to display a plurality of expression images in a virtual space; The second display unit 1902 is configured to execute a layout operation in response to at least one of the plurality of expression images, and display a plurality of target expression images belonging to the at least one expression image arranged into a target pattern; The first display unit 1901 is further configured to execute, in response to an expression sending operation, a plurality of target expression images arranged in a target pattern in a virtual space.

[0134] In some embodiments, the second display unit 1902 includes: A first display subunit is configured to execute, in response to the expression layout function being triggered, displaying a preset area, where the preset area is used to layout the expression image to be sent; The second display subunit is configured to execute, when an expression image of a target type is selected, in response to a trigger operation on any position in a preset area, displaying a target expression image belonging to the target type at the position, the target expression image of the target type being any type of expression image among a plurality of expression images, and all target expression images displayed in the preset area constituting a target pattern.

[0135] In some embodiments, a target pattern is displayed in the preset area; The second display subunit is configured to display a target expression image belonging to the target type at a triggering position on the target pattern in response to a triggering operation on any position on the target pattern when an expression image of the target type is selected.

[0136] In some embodiments, the apparatus further comprises: The third display unit is configured to display a target expression image belonging to the target type at a position closest to the trigger position on the target pattern in response to a trigger operation on any position in the preset area when the expression image of the target type is selected.

[0137] In some embodiments, the predetermined area includes a plurality of patterns; The device also includes: The fourth display unit is configured to execute a pattern switching operation in response to the preset area, and switch the display pattern in the preset area from the target pattern to the next pattern.

[0138] In some embodiments, the apparatus further comprises: The deleting unit is configured to execute, in response to the expression deleting operation, deleting a target expression image indicated by the expression deleting operation in a preset area.

[0139] In some embodiments, the deleting unit is configured to delete the target expression image with the latest appearance time in the preset area in response to a triggering operation on the first deletion control.

[0140] In some embodiments, the deletion unit is configured to execute a second deletion control corresponding to the target expression image in response to an editing operation on any target expression image in a preset area; and to delete the target expression image corresponding to the second deletion control in the preset area in response to a triggering operation on the second deletion control.

[0141] In some embodiments, the apparatus further comprises: The moving unit is configured to execute, for any target expression image in the preset area, in response to a moving operation on the target expression image, displaying the target expression image in the preset area and moving it to a position indicated by the moving operation.

[0142] In some embodiments, the apparatus further comprises: The replacement unit is configured to execute, for any target expression image in the preset area, in response to a replacement operation on the target expression image, display the expression image indicated by the replacement operation at the position of the target expression image in the preset area.

[0143] In some embodiments, the first display unit 1901 is configured to perform at least one of the following: In response to the expression sending operation, a plurality of target expression images are displayed in an upper layer of the comment area in the virtual space in an arrangement according to a target pattern; In response to the expression sending operation, a plurality of target expression images are displayed in an upper layer of the live broadcast picture in the virtual space in an arrangement according to a target pattern.

[0144] In some embodiments, the first display unit 1901 is further configured to execute, in response to an expression sending operation, displaying multiple target expression images moving along a preset trajectory in a virtual space.

[0145] The disclosed embodiment provides an interactive device based on expression images. Before sending an expression image in a virtual space, an audience object can select at least one expression image from a plurality of expression images for layout, so as to arrange a plurality of target expression images belonging to the at least one expression image into a target pattern. After sending the expression image, the plurality of target expression images can be arranged and displayed in the virtual space according to the target pattern. That is, the audience object can create any pattern through existing expression images and display the pattern in the virtual space. This not only improves the operability and fun of interaction based on expression images, helps meet the interaction needs of the audience objects, and improves the interaction rate in the virtual space, but also can further display the intention of the audience objects through the target pattern on the basis of the expression image, thereby helping to improve the information transparency.

[0146] It should be noted that, when the interactive device based on facial expressions provided in the above embodiments sends facial expressions in a virtual space, only the division of the above functional units is used as an example. In actual applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the interactive device based on facial expressions provided in the above embodiments and the method embodiment based on facial expressions belong to the same concept. The specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0147] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0148] When an electronic device is provided as a terminal, Fig. 20 is a block diagram of a terminal according to an exemplary embodiment. Fig. 20The structure block diagram of a terminal 2000 provided by an exemplary embodiment of the present disclosure is shown. The terminal 2000 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The terminal 2000 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0149] Typically, the terminal 2000 includes: a processor 2001 and a memory 2002 .

[0150] The processor 2001 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 2001 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 2001 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 2001 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 2001 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0151] The memory 2002 may include one or more computer-readable storage media, which may be non-transitory. The memory 2002 may also include a high-speed random access memory and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 2002 is used to store at least one computer program, which is used to be executed by the processor 2001 to implement the interactive method based on expression images provided in the method embodiment of the present application.

[0152] In some embodiments, the terminal 2000 may further optionally include: a peripheral device interface 2003 and at least one peripheral device. The processor 2001, the memory 2002 and the peripheral device interface 2003 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 2003 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 2004, a display screen 2005, a camera assembly 2006, an audio circuit 2007 and a power supply 2008.

[0153] The peripheral device interface 2003 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 2001 and the memory 2002. In some embodiments, the processor 2001, the memory 2002, and the peripheral device interface 2003 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 2001, the memory 2002, and the peripheral device interface 2003 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0154] The radio frequency circuit 2004 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 2004 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 2004 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. In some embodiments, the radio frequency circuit 2004 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 2004 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 2004 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0155] The display screen 2005 is used to display a UI (User Interface). The UI may include patterns, texts, icons, videos, and any combination thereof. When the display screen 2005 is a touch display screen, the display screen 2005 also has the ability to collect touch signals on the surface or above the surface of the display screen 2005. The touch signal can be input as a control signal to the processor 2001 for processing. At this time, the display screen 2005 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 2005 can be one, set on the front panel of the terminal 2000; in other embodiments, the display screen 2005 can be at least two, respectively set on different surfaces of the terminal 2000 or in a folding design; in other embodiments, the display screen 2005 can be a flexible display screen, set on a curved surface or a folding surface of the terminal 2000. Even, the display screen 2005 can also be set to a non-rectangular irregular pattern, that is, a special-shaped screen. The display screen 2005 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0156] The camera component 2006 is used to capture images or videos. In some embodiments, the camera component 2006 includes a front camera and a rear camera. Usually, the front camera is set on the front panel of the terminal, and the rear camera is set on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera component 2006 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0157] The audio circuit 2007 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 2001 for processing, or input them into the radio frequency circuit 2004 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 2000. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 2001 or the radio frequency circuit 2004 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 2007 may also include a headphone jack.

[0158] The power supply 2008 is used to power various components in the terminal 2000. The power supply 2008 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 2008 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery charged through a wired line, and a wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0159] Those skilled in the art will understand that Fig. 20 The structure shown in the figure does not constitute a limitation on the terminal 2000, and the terminal 2000 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0160] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 2002 including instructions, and the instructions can be executed by a processor 2001 of a terminal 2000 to complete the above-mentioned interactive method based on expression images. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0161] A computer program product includes a computer program / instruction, which implements the above-mentioned interactive method based on expression images when executed by a processor.

[0162] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0163] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An interactive method based on expression images, characterized in that: The method comprises: Displaying multiple expression images in virtual space; In response to a layout operation on at least one of the plurality of expression images, displaying a plurality of target expression images belonging to the at least one expression image arranged into a target pattern; In response to an expression sending operation, the plurality of target expression images are displayed in the virtual space in an arrangement according to the target pattern.

2. The interactive method based on facial expression images according to claim 1, characterized in that: The method of displaying a plurality of target expression images belonging to at least one expression image arranged into a target pattern in response to a layout operation on at least one expression image among the plurality of expression images comprises: In response to the expression layout function being triggered, a preset area is displayed, wherein the preset area is used to layout the expression image to be sent; When an expression image of a target type is selected, in response to a trigger operation on any position in the preset area, a target expression image belonging to the target type is displayed at the position, and the target expression image of the target type is an expression image of any type among the multiple expression images, and all target expression images displayed in the preset area constitute the target pattern.

3. The interactive method based on facial expression images according to claim 2, characterized in that: The target pattern is displayed in the preset area; When an expression image of a target type is selected, in response to a trigger operation on any position in the preset area, displaying a target expression image belonging to the target type at the position includes: When an expression image of a target type is selected, in response to a trigger operation on any position on the target pattern, a target expression image belonging to the target type is displayed at the trigger position on the target pattern.

4. The interactive method based on facial expression images according to claim 3, characterized in that: The method further comprises: When an expression image of a target type is selected, in response to a trigger operation on any position in the preset area, a target expression image belonging to the target type is displayed at a position on the target pattern closest to the trigger position.

5. The interactive method based on facial expression images according to claim 2, characterized in that: The preset area includes a plurality of patterns; The method further comprises: In response to a pattern switching operation on the preset area, a pattern displayed in the preset area is switched from the target pattern to a next pattern.

6. The interactive method based on facial expression images according to claim 2, characterized in that: The method further comprises: In response to an expression deletion operation, a target expression image indicated by the expression deletion operation is deleted in the preset area.

7. The interactive method based on facial expression images according to claim 6, characterized in that: In response to the expression deletion operation, deleting the target expression image indicated by the expression deletion operation in the preset area includes: In response to the triggering operation of the first deletion control, the target expression image with the latest appearance time is deleted in the preset area.

8. The interactive method based on facial expression images according to claim 6, characterized in that: In response to the expression deletion operation, deleting the target expression image indicated by the expression deletion operation in the preset area includes: In response to an editing operation on any target expression image in the preset area, displaying a second deletion control corresponding to the target expression image; In response to the triggering operation on the second deletion control, the target expression image corresponding to the second deletion control is deleted in the preset area.

9. The interactive method based on facial expression images according to claim 2, characterized in that: The method further comprises: For any target expression image in the preset area, in response to a move operation on the target expression image, the target expression image is displayed in the preset area and moved to a position indicated by the move operation.

10. The interactive method based on facial expression images according to claim 2, characterized in that: The method further comprises: For any target expression image in the preset area, in response to a replacement operation on the target expression image, an expression image indicated by the replacement operation is displayed at the position of the target expression image in the preset area.

11. The interactive method based on facial expression images according to claim 1, characterized in that: In response to the expression sending operation, in the virtual space, displaying the plurality of target expression images in an arrangement according to the target pattern includes at least one of the following: In response to an expression sending operation, displaying the plurality of target expression images in an upper layer of a comment area in the virtual space in an arrangement according to the target pattern; In response to the expression sending operation, the plurality of target expression images are displayed in an upper layer of the live broadcast picture in the virtual space in an arrangement according to the target pattern.

12. The interactive method based on facial expression images according to claim 1, characterized in that: The method further comprises: In response to the expression sending operation, the plurality of target expression images are displayed in the virtual space to move along a preset trajectory.

13. An interactive device based on facial expression images, characterized in that: The device comprises: A first display unit is configured to display a plurality of expression images in a virtual space; A second display unit is configured to perform a layout operation in response to at least one of the plurality of expression images, and display a plurality of target expression images belonging to the at least one expression image arranged into a target pattern; The first display unit is further configured to execute, in response to an expression sending operation, displaying the plurality of target expression images in the virtual space in an arrangement according to the target pattern.

14. An electronic device, characterized in that: The electronic device comprises: one or more processors; a memory for storing program code executable by the processor; Wherein, the processor is configured to execute the program code to implement the expression image-based interaction method as described in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the expression image-based interaction method as described in any one of claims 1 to 12.

16. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the interactive method based on expression images described in any one of claims 1 to 12 is implemented.

Images