Interaction method, user equipment, server, interaction system and related equipment

Abstract

The invention discloses an interaction method, user equipment, a server, an interaction system and related equipment. The method comprises the steps of displaying a second interface in response to a first operation of a user; in response to a second operation of the user for the second interface, first request information is sent to the server, a third interface is displayed, and the first request information is used for requesting to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template; if the special effect media information is successfully generated, first response information for the first request information is received from the server, and a first interface is displayed in response to the first response information; in response to touch of the user for the first function button, a fourth interface is displayed, the fourth interface comprises a second image display area and a second function button, the second image display area displays the special effect media information and the media information, and the second function button is used for supporting release of the special effect media information and the media information.

Description

Technical Field

[0001] The present application relates to the field of human-computer interaction technology, and in particular to an interaction method, user equipment, a server, an interaction system and related equipment. Background Art

[0002] With the rise of Internet communities, users can achieve diversified social interaction in Internet communities, such as publishing, commenting on, and browsing various types of media information (such as text, images, videos, etc.) in Internet communities. In particular, when users publish media information in Internet communities, after selecting an original image, they can also select a special effect template stored locally in the Internet community to render the original image to generate a new image, and then the user can publish the new image. However, currently, the images generated by any special effect template after rendering each original image are relatively similar, and the correlation and difference between the generated image and the original image selected by the user cannot be reflected, which reduces the fun. Furthermore, if the user publishes the generated image, it will also produce a stereotyped phenomenon, reducing the user experience. Summary of the invention

[0003] The present application provides an interactive method, user equipment, server, interactive system and related equipment, which increase the diversity of user-published content, and improve the relevance of user-published content with media information, i.e., original images, and reduce the probability of producing a stereotyped phenomenon.

[0004] In a first aspect, the present application provides an interaction method, applied to a user equipment, the method comprising:

[0005] In response to a user operation, sending a first request message to a server, wherein the first request message includes the media information and the target special effect template selected by the user, and the first request message is used to request generation of special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, wherein the special effect media information includes at least dynamic media information;

[0006] Receive first response information for the first request information from the server, and display a first interface in response to the first response information, wherein the first response information includes the special effect media information, the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0007] In a second aspect, the present application provides another interaction method, applied to a server, the method comprising:

[0008] Receiving first request information from a user device, wherein the first request information includes media information and a target special effect template selected by a user;

[0009] Based on the media information and the target special effect template, generating special effect media information corresponding to the type of the target special effect template, wherein the special effect media information at least includes dynamic media information;

[0010] A first response message is sent to the user device so that the user device displays a first interface in response to the first response message, wherein the first response message includes the special effect media information, the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0011] In a third aspect, the present application provides a user equipment, the user equipment comprising: a transceiver unit and a response unit;

[0012] The response unit is used to send a first request message to the server in response to a user operation, wherein the first request message includes the media information and the target special effect template selected by the user, and the first request message is used to request to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, and the special effect media information includes at least dynamic media information;

[0013] The transceiver unit is used to receive first response information for the first request information from the server, and the response unit is also used to display a first interface in response to the first response information, wherein the first response information includes the special effect media information, and the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0014] In a fourth aspect, the present application provides a server, comprising: a transceiver unit and a processing unit;

[0015] The transceiver unit is used to receive first request information from a user device, wherein the first request information includes media information and a target special effect template selected by a user;

[0016] The processing unit is configured to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, wherein the special effect media information at least includes dynamic media information;

[0017] The transceiver unit is also used to send a first response message to the user device so that the user device displays a first interface in response to the first response message, wherein the first response message includes the special effect media information, the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0018] In a fifth aspect, the present application provides an interactive system, including: a user device and a server;

[0019] The user equipment is configured to send a first request message to the server in response to a user operation, wherein the first request message includes media information and a target special effect template selected by the user;

[0020] The server is configured to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, wherein the special effect media information at least includes dynamic media information;

[0021] The server is further configured to send first response information to the user equipment, wherein the first response information includes the special effect media information;

[0022] The user device is also used to receive first response information for the first request information from the server, and display a first interface in response to the first response information, wherein the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0023] In a sixth aspect, the present application provides an electronic device, comprising: a processor and a memory, the processor being connected to the memory, the memory being used to store a computer program, and the processor being used to execute the computer program stored in the memory, so that the electronic device executes the method of the first aspect or the second aspect.

[0024] In a seventh aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program enables a computer to execute the method of the first aspect or the second aspect.

[0025] In an eighth aspect, the present application provides a computer program product, the computer program product comprising a non-transitory computer-readable storage medium storing a computer program, and the computer is operable to cause the computer to execute the method of the first aspect or the second aspect.

[0026] The implementation of this application has the following beneficial effects:

[0027] First, in response to a user operation, a first request message is sent to a server, wherein the first request message includes media information and a target special effect template selected by the user, and the first request message is used to request generation of special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, wherein the special effect media information includes at least dynamic media information;

[0028] A first response message for the first request message is received from the server, and a first interface is displayed in response to the first response message, wherein the first response message includes the special effect media information, and the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information. Dynamic media information is displayed in the first image display area of ​​the first interface, which is more vivid and interesting than static special effect media information. Users can intuitively see the correlation and comparison between dynamic media information and media information. For all users, it also reflects that the special effect media information is generated based on the change of media information, so that subsequent users can avoid the phenomenon of monotony when publishing the special effect media information, thereby increasing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0030] Figure 1 A schematic diagram of an interactive system provided in an embodiment of the present application;

[0031] Figure 2 A flowchart of an interactive method provided in an embodiment of the present application;

[0032] Figure 3 A schematic diagram of an initial interface provided in an embodiment of the present application;

[0033] Figure 4 A schematic diagram of a fifth interface provided in an embodiment of the present application;

[0034] Figure 5 A schematic diagram of a sixth interface provided in an embodiment of the present application;

[0035] Figure 6 A schematic diagram of a seventh interface provided in an embodiment of the present application;

[0036] Figure 7 A schematic diagram of a second interface provided in an embodiment of the present application;

[0037] Figure 8 A schematic diagram of an eighth interface provided in an embodiment of the present application;

[0038] Fig. 9 A schematic diagram of a third interface provided in an embodiment of the present application;

[0039] Fig.10A schematic diagram of another third interface provided in an embodiment of the present application;

[0040] Fig.11 A schematic diagram of a first interface provided in an embodiment of the present application;

[0041] Fig.12 A schematic diagram of a fourth interface provided in an embodiment of the present application;

[0042] Fig.13 A schematic diagram of a ninth interface provided in an embodiment of the present application;

[0043] Fig.14 A schematic diagram of another ninth interface provided in an embodiment of the present application;

[0044] Fig.15 A schematic diagram of another initial interface provided in an embodiment of the present application;

[0045] Fig.16 A schematic diagram of a first pop-up window in an initial interface provided in an embodiment of the present application;

[0046] Fig.17 A schematic diagram of a first mark of an initial interface provided in an embodiment of the present application;

[0047] Fig.18 A schematic diagram of a message interface provided in an embodiment of the present application;

[0048] Fig.19 A schematic diagram of a tenth interface provided in an embodiment of the present application;

[0049] Fig. 20 A schematic diagram of an eleventh interface provided in an embodiment of the present application;

[0050] Fig.21 A schematic diagram of a draft box page when special effect media information is successfully generated provided in an embodiment of the present application;

[0051] Fig. 22 A schematic diagram of a draft box page when special effect media information generation fails provided in an embodiment of the present application;

[0052] Fig.23 A schematic diagram of a draft box page when special effect media information is being generated provided in an embodiment of the present application;

[0053] Fig.24 A schematic diagram of a twelfth interface provided in an embodiment of the present application;

[0054] Fig.25 A schematic diagram of a thirteenth interface provided in an embodiment of the present application;

[0055] Fig.26 A schematic diagram of a fourteenth interface provided in an embodiment of the present application;

[0056] Fig. 27 A schematic diagram of a fifteenth interface provided in an embodiment of the present application;

[0057] Fig.28 A block diagram of the functional units of a user equipment provided in an embodiment of the present application;

[0058] Fig.29 A block diagram of the functional units of a server provided in an embodiment of the present application;

[0059] Fig.30 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0061] The terms "first", "second", "third" and "fourth" etc. in the specification, claims and drawings of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0062] Reference to "embodiments" herein means that a particular feature, result, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0063] See also Figure 1 , Figure 1 A schematic diagram of an interactive system provided in an embodiment of the present application. The interactive system includes a user device and a server.

[0064] Among them, the server can be a local server or a cloud server, etc. For example, the server can be a File Transfer Protocol Server (FTP) server, a Hypertext Transfer Protocol (HTTP) server, etc., which is not limited in this application.

[0065] The user device may be a laptop, tablet computer, smart phone, wearable device, personal digital assistant, etc., which is not limited in this application; the user device is installed with a target application, and the user can use the target application to publish media information based on the interactive method provided in the embodiment of this application, specifically:

[0066] The user device is used to send a first request message to the server in response to a user operation, wherein the first request message includes the media information and the target special effect template selected by the user, and the first request message is used to request the generation of special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, and the special effect media information includes at least dynamic media information; the user device is also used to receive a first response message to the first request message from the server, and display a first interface in response to the first response message, wherein the first response message includes the special effect media information, and the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0067] See also Figure 2 , Figure 2 A flowchart of an interaction method provided in an embodiment of the present application is shown. The method is applied to a user device. The method includes but is not limited to steps 201-203:

[0068] 201: The user equipment sends first request information to the server in response to a user operation.

[0069] Among them, the first request information includes the media information and the target special effect template selected by the user. The media information may include an image or a video, which is not limited in this application. The first request information is used to request the generation of special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template. The special effect media information at least includes dynamic media information. Among them, the special effect media information may be an image. Accordingly, when the special effect media information is an image, the dynamic media information may be understood as a dynamic image; of course, the special effect media information may also be a video, in which case the dynamic media information may be understood as the video, which is not specifically limited in this application. It should be noted that the dynamic media information of this application will also present differences in the subsequent display of dynamic media based on different user devices, for example, an image in a dynamic format is displayed, or a video and the cover frame of the video are displayed.

[0070] In an embodiment of the present application, step 201 may specifically include:

[0071] First, the user device displays a second interface in response to the user's first operation, wherein the second interface includes one or more local images, or the second interface can be understood as an album page; the first operation includes the user selecting a target special effects template, that is, after responding to the first operation, the user device can obtain the target special effects template. Exemplarily, the user device displays the fifth interface in response to the user touching the fourth function button in the initial interface, wherein the fifth interface includes the fifth function button, and the function of the fifth function button is to switch the fifth interface to a page displaying special effect templates, i.e., the sixth page; then the user device displays the sixth interface in response to the user touching the fifth function button, and the sixth interface is used to display a first number of special effect templates. It should be noted that in the secondary creation of media information such as images, the categories of special effect templates used may include pure video, graphic, special effects, etc. The first number of special effect templates displayed in the sixth interface of the present application can be understood as one of the above categories, such as some templates under the special effects category. Of course, the sixth interface can also simultaneously display the first number of special effect templates corresponding to each category under the above multiple categories. The present application does not limit this. The sixth interface includes the sixth function button, and the function of the sixth function button is to switch the sixth interface to a page for displaying a second number of special effect templates under the category corresponding to the above first number of special effect templates, i.e., the eighth interface. ; If the target special effect template exists in the first number of special effect templates in the sixth interface, and the user device responds to the user's touch on the target special effect template in the sixth interface, such as a touch on the area where the cover of the template special effect template is located, to display the seventh interface, wherein the seventh interface includes a seventh function button; in response to the user's touch on the seventh function button, the second interface is displayed; if the target special effect template does not exist in the first number of special effect templates in the sixth interface, and the user device responds to the user's touch operation on the sixth function button, the eighth interface is displayed, wherein the eighth interface is used to display the second number of special effect templates under the above-mentioned category, such as the special effect category, the second number of special effect templates include the first number of special effect templates, and the target special effect template exists in the second number of special effect templates in the eighth interface. In a specific implementation, the user can browse the second number of special effect templates and find the target special effect template from the second number of special effect templates by sliding the eighth interface up and down; then the user device displays the second interface in response to the user's third operation on the eighth interface.

[0072] In an optional embodiment, the eighth interface also includes an eighth function button corresponding to the target special effects template, and the eighth function button indicates the use of the target special effects template. Therefore, the user device displays the second interface in response to the user's third operation on the eighth interface. It can also be specifically as follows: if the third operation is touching the eighth function button, then in response to the third operation, the second interface is displayed; if the third operation is touching the area where the cover of the target special effects template in the eighth interface is located, then in response to the third operation, the seventh interface is displayed; in response to the user touching the seventh function button, the second interface is displayed. This embodiment describes two different ways of displaying the second interface, i.e., entering the album page, which increases the diversity of interaction and improves the user's selection experience.

[0073] In an optional embodiment, before displaying the second interface, the user device detects whether the first operation is the first operation; if so, in response to the user touching the seventh function button, displaying the second interface specifically includes: in response to the user touching the seventh function button, displaying a second pop-up window on the seventh interface, the text in the second pop-up window is used to inform the user of usage instructions; in response to the user's confirmation touch on the second pop-up window, displaying the second interface.

[0074] Then, the user device sends a first request message to the server in response to the user's second operation on the second interface, and displays the third interface. In an embodiment of the present application, the second interface also includes a first virtual button, and the user's second operation on the second interface can be understood as: the user selects media information from one or more local images displayed on the second interface, and then touches the first virtual button, and after the user device responds to the operation, the third interface is displayed and the first request message is sent to the server, the first request message includes media information and a target special effect template, and the first request message is used to request the server to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template. It should be noted that the sixth interface described above can display special effect templates corresponding to multiple categories, and there are multiple types of special effect templates under each category. For example, the types of special effect templates under the above special effect category may include "image-to-animation (indicating that one or more images are generated into special effect animation)", "image-to-static image (indicating that one or more images are generated into special effect static image)", "image-to-video (indicating that one or more images are generated into video)", "real person photo (indicating that one or more character images are generated into photo images)", "audio and video special effects (indicating that one or more images are generated into audio and video)", etc. This application will pre-set the special effect media information generated corresponding to each type of special effect template, such as For example, when the type of special effects template is "picture-to-live-image", "picture-to-still image", "audio-video special effects", "real-person photo", etc., the corresponding special effects media information generated includes special effects animated images and special effects static images. When it is "picture-to-video", the corresponding special effects media information generated is special effects video. That is to say, when it is "picture-to-live-image", in addition to generating special effects animated images, special effects static images must also be generated. When it is "picture-to-still image", in addition to generating special effects static images, special effects animated images must also be generated. When it is "audio-video special effects", the generated audio and video can be understood as special effects animated images. In addition, a special effects static image must be generated. The generation principles of special effects animated images and special effects static images will be explained in detail below, which will not be elaborated here.Therefore, when the target special effect template is used to generate a special effect image (that is, understood as the above-mentioned special effect dynamic image and special effect static image), the special effect media information includes a first special effect media and a first special effect image, wherein the format of the first special effect media is a dynamic format, and the format of the first special effect image is a static format (that is, a static image). That is to say, when the target special effect template is used to generate a special effect image, the special effect media information includes not only dynamic media information but also a first special effect image. At this time, the first special effect media can be understood as the above-mentioned dynamic media information, and the display form will also be different based on different user devices. For example, when the display form is an image in a dynamic format, the first special effect media information can be understood as a dynamic image, and when the display form is a video and its cover frame, the first special effect media information can be understood as a video; when the target special effect template is used to generate a special effect video, the special effect media information includes a special effect video, and the special effect video can be understood as the above-mentioned dynamic media information; in addition, the present application does not limit the number of first special effect media, first special effect image, and special effect video.

[0075] Therefore, in an optional embodiment, the server can obtain configuration information of the target special effects template, which is used to configure the target special effects template to generate special effects images or special effects videos. The server then parses the configuration information to determine whether the target special effects template is used to generate special effects images or special effects videos. If the configuration information indicates generating a special effects video, the server generates a special effects video based on the media information and the target special effects template; if the configuration information indicates generating a special effects image, the server generates a first special effects media and a first special effects image based on the media information and the target special effects template. Exemplary: The server determines the style model corresponding to the target special effects template based on the target special effects template. It should be noted that in the embodiments of the present application, each special effects template is configured with a style (such as "campus style", "rural style", "national style", etc.), and each style corresponds to a trained style model; then the server generates a style image based on the media information and the style model; then the server detects whether the configuration information of the target special effects template includes the configuration of the special effects; if not, the server directly determines the style image as the first special effects image, and at this time the first special effects image is only a style image and does not include rendering special effects; if included, the server obtains the special effects video corresponding to the target special effects template, wherein the special effects video corresponding to the target special effects template is pre-set OK, the special effects video is composed of multiple frames; the server obtains the target frame in the special effects video, wherein the target frame can be understood as the frame with the best effect in the special effects video, which is also pre-set; the server renders the style image based on the target frame to obtain the first special effects image, and at this time the first special effects image has the special effects corresponding to the target frame; the server generates a third special effects image based on the media information, the style image and the target special effects template, wherein the format of the third special effects image is a dynamic format, that is, the third special effects image is a moving picture, which is specifically manifested as a transition from media information to the style image, and is a transition animation special effect; then the server renders the third special effects image based on the special effects video to obtain the first special effects media, that is, superimposing a special effect on the third special effects image.

[0076] In an optional embodiment, the server generates an interactive schematic diagram of special effect media information based on media information and a target special effect template, including but not limited to: first, in response to the first operation of the user, the user device sends a request message to the server, the request message includes the target special effect template selected by the user, and accordingly, the server obtains the target special effect template; then, the server parses the configuration information of the target special effect template to obtain a media information slot corresponding to the target special effect template, wherein the number of image slots is the fifth number, the fifth number of image slots corresponds to the special effect media information, and the image slot represents a virtual card slot for scaling and storing the generated special effect media information. For example, if the special effect media information includes 1 first special effect media information, i.e., dynamic media information, and 2 second special effect media information, the corresponding number of image slots is 3; then, the server filters the fifth number of media information slots to obtain a sixth number of image slots, for example, the media information slots include A, B, and C, and the material used by the final generated special effect media information corresponding to A and B, i.e., the image selected by the user, is the same, and the material used by the final generated special effect media information corresponding to C is different, then A or B can be filtered out. Then, the server sends a second message to the user device, wherein the second message includes a sixth number of image slots; the user device responds to the second message by displaying the sixth number of image slots on the second interface; after the user selects the corresponding sixth number of media information based on the sixth number of image slots, the user device responds to the operation and sends the sixth number of media information selected by the user to the server; for any media information, such as media information P, the server obtains the special effect configuration information of the image slot corresponding to the media information P, and then determines whether the special effect configuration information of the image slot corresponding to the media information P is used to generate a special effect picture or to generate a special effect video.

[0077] If the special effects image is generated, the server sends the media information P to the algorithm server, and the algorithm server generates a style image corresponding to the media information P based on the media information P and the style model corresponding to the target special effects template, and the algorithm server sends the style image corresponding to the media information P to the server; then the server sends the target special effects template, the style image corresponding to the media information P and the media information P, as well as the target frame special effects in the pre-set special effects video (i.e., special effects package) corresponding to the target special effects template to the cloud rendering end; the cloud rendering end renders the style image corresponding to the media information P based on the target frame special effects to obtain the special effects image corresponding to the media information P, and then the cloud rendering end sends the special effects image corresponding to the media information P to the server; the server then embeds the special effects image corresponding to the media information P and the media information P into the target special effects template (this is a graphic template) to obtain dynamic media information, and determines the special effects image corresponding to the media information P as the above-mentioned first special effects image.

[0078] If the purpose is to generate a special effect video (such as the audio and video special effects mentioned above), the server first sends the media information P to the cropping server, so that the cropping server crops the media information P into the target format to obtain the media information P1, and then the server receives the media information P1 from the cropping server; then the server obtains the pre-set audio special effects and video special effects corresponding to the target special effect template; then the server sends the audio special effects, special effect video, and media information P1 to the cloud rendering end; then the cloud rendering end renders the media information P1 based on the audio special effects and video special effects to obtain special effect media; then the cloud rendering end sends the special effect media material to the server, and then the server generates a special effect video, i.e., audio and video, based on the target special effect template (this is the video template), the media information P1, and the special effect media material.

[0079] In this embodiment, corresponding special effects animations and special effects static images are generated based on media information and target special effects templates. The special effects animations can show the gradual transition process from media information to image static images. When the special effects animations, special effects static images and media information are displayed simultaneously on the subsequent fourth interface, the correlation between the media information and the special effects images is reflected, so that a contrast is formed between the media information and the generated special effects images, which is convenient for users to intuitively experience. Users can also freely choose (i.e. delete or retain) based on the displayed special effects animations, special effects static images and media information, thereby increasing the selection space, thereby making the content published by users diverse, and making the published content have a correlation or causal relationship, that is, the published special effects images are generated based on the transformation of media information, thereby improving the user experience.

[0080] In an optional embodiment, the third interface includes a first image display area and a first text display area, the first image display area in the third interface displays a noise image, and the sixth text in the first text display area in the third interface is used to prompt that special effect media information is being generated and the time required to generate the special effect media information.

[0081] In an optional embodiment, the third interface also includes a third function button, wherein the type of the third function button is the first type or the second type, and the type of the third function button is determined based on the configuration information of the target special effect template. For example, when the time for the target special effect template to generate special effect media information is greater than a time threshold, the type of the third function button is determined to be the second type; when it is less than the time threshold, the type of the third function button is determined to be the first type. The first type indicates exiting the third interface and interrupting the generation of special effect media information; the second type indicates exiting the third interface without interrupting the generation of special effect media information. That is to say, after the user device sends the first request information to the server, the server will generate a special effect media information based on the media information and the target special effect template. The corresponding special effect media information is generated, and when the user exits the third interface based on the touch operation and performs the corresponding touch operation in other interfaces, the user device responds to the operation and sends the first information to the server. The first information is used to prompt the user that the user has exited the waiting. After receiving the first information, the server will not interrupt the generation, but continue to generate the corresponding special effect media information based on the media information and the target special effect template in an asynchronous manner. It is generally understood that the user can perform touch operations on any interface except the third interface. At the same time, the server will asynchronously generate special effect media information, and then the server will send a prompt message to the user end to prompt the generation success, generation failure or being generated. The specific principle is elaborated below and will not be elaborated here. In this embodiment, based on the length of the special effect media information generation time, the type of the third function button is flexibly determined. For example, when it is the second type, that is, the user needs to wait for a long time. At this time, by setting the second type of the third function button, the user can exit the third interface to other interfaces and the generation of the special effect media information is not interrupted, which can avoid the user waiting for the generation of the special effect media information for a long time on the third interface, thereby improving the user experience.

[0082] Further, in an optional embodiment, when the third function button is of the second type and the target special effect template exists in the first number of special effect templates in the sixth interface, the user device switches the third interface to the sixth interface in response to the user's touch on the third function button. When the third function button is of the second type and the target special effect template does not exist in the first number of special effect templates in the sixth interface, if the third operation is touching the eighth function button, the user device switches the third interface to the eighth interface in response to the user's touch on the third function button, and if the third operation is touching the area where the cover of the target special effect template in the eighth interface is located, the user device switches the third interface to the seventh interface in response to the user's touch on the third function button.

[0083] In an optional embodiment, when the target special effect template is used to generate a special effect image that is a real-life photo image corresponding to the user, that is, when the type of the target special effect template is the above-mentioned "real-life photo" type, the above-mentioned user device displays the second interface in response to the user's touch on the seventh function button. It can also be specifically as follows: the user device displays the twelfth interface in response to the user's touch on the seventh function button, wherein the twelfth interface includes the twelfth function button, the fourth text, the fifth text, and the example image corresponding to the fourth text and the example image corresponding to the fifth text. The twelfth function button is used to inform the user that multiple images need to be selected. Since a real-life photo image is generated, the multiple images can be portrait photos or selfies. The fourth text indicates the correct standard of the image, and the fifth text indicates the incorrect standard of the image. The user device displays the second interface in response to the user's touch on the twelfth function button.

[0084] Further, the user device sends a first request message to the server in response to the user's second operation on the second interface, and displays the third interface. It can also be: the user device sends a second request message to the server in response to the user's image selection operation on the second interface, wherein the second request message includes a third image obtained by the user based on the image selection operation, the number of the third images is a third number, and the second request message is used to request to detect whether the third image meets the standard; the user device displays a thirteenth interface in response to third response information to the second request information received from the server, wherein the third response information includes a fourth image, the fourth image represents an image that meets the standard and the number is a fourth number, the fourth number is greater than or equal to the first threshold and less than or equal to the third number, and the thirteenth interface includes a thirteenth function button and a fourth image, and the thirteenth function button represents generating multiple virtual image images corresponding to the user; the user device sends a third request message to the server in response to the user's touch on the thirteenth function button, and displays the fourteenth interface, wherein the third request message is used to request to generate multiple virtual image images corresponding to the user based on the fourth image, The fourteenth interface includes a third function button and multiple fourth image display areas corresponding to multiple virtual image images, and each fourth image display area in the fourteenth interface displays a noise image, that is, by generating a corresponding virtual image based on multiple qualified portrait images selected by the user, the characteristics of the portrait image are integrated, and generally the virtual image image is more aesthetically pleasing than the original image, i.e., the third image, so the virtual image image is generated first, so that the effect of subsequently generating special effect media information based on the virtual image image is better; the user device displays the fifteenth interface in response to the fourth response information received from the server for the third request information, wherein the fourth response information includes multiple virtual image images, the fifteenth interface includes the fourteenth function button and multiple fourth image display areas, and each fourth image display area in the fifteenth interface displays a corresponding virtual image image; the user device sends the first request information to the server in response to the user's touch on the fourteenth function button, and displays the third interface, wherein the media information is one of the multiple virtual image images, and the first request information is used to request the generation of special effect media information based on the media information and the target special effect template.

[0085] 202: The user equipment receives first response information for the first request information from the server.

[0086] In step 202, when the special effect media information is generated successfully, the user equipment receives first response information for the first request information from the server.

[0087] 203: The user equipment displays a first interface in response to the first response information.

[0088] Among them, the first response information includes special effect media information, the first interface includes a first image display area and a first function button, and the first image display area of ​​the first interface is used to display special effect media information and media information. That is to say, when the special effect media information is successfully generated, the first image display area of ​​the first interface displays the special effect media information and media information; in an optional embodiment, when the special effect media information includes the first special effect media and the first special effect image, the first image display area of ​​the first interface displays the first special effect media, the first special effect image and media information. Specifically, the first image display area of ​​the first interface first displays the first special effect media by default. Since the first special effect media is a dynamic image, it will be played in a loop, and then the first image display area in the first interface can be slid left and right to switch the first image display area to display the first special effect image or media information; when the special effect media information includes a special effect video, the first image display area of ​​the first interface displays the special effect video and media information at this time. Of course, only the special effect video can be displayed; the first interface can also include a first text display area, and the text in the first text display area of ​​the first interface indicates the regeneration of the special effect media information.

[0089] In an optional embodiment, if the special effect media information generation fails, the user device receives a second response message from the server for the first request message, wherein the second response message includes the reason why the special effect media information generation failed; the user device displays a ninth interface in response to the second response message, wherein the ninth interface includes a first image display area, a first text display area, and a ninth function button, the first image display area of ​​the ninth interface displays a noise image, the text in the first text display area of ​​the ninth interface is the reason for the generation failure, and the type of the ninth function button includes a third type and a fourth type, and the third type of the ninth function button is used to prompt the user to generate the special effect media again based on the media information and the target special effect template. The ninth function button of the fourth type is used to prompt the user to select new media information from the second interface. The type of the ninth function button corresponds to the type of reason for generation failure. That is to say, the reasons for generation failure can be classified into two categories, one type of reason corresponds to the ninth function button of the third type, and the other type of reason corresponds to the ninth function button of the fourth type. For example, the reasons for generation failure may include generation failure, image upload failure, poor network, image recognition failure, image does not meet the requirements, etc. Image recognition failure, image does not meet the requirements, etc. can correspond to the fourth type, and generation failure, image upload failure, poor network, etc. can correspond to the third type. This application does not make specific limitations and is only for example support.

[0090] In an optional embodiment, before displaying the first interface, that is, before the special effect media information is successfully generated, if the type of the third function button in the third interface is the second type, the user device responds to the user's fourth operation and returns to the initial interface, wherein the fourth operation includes an operation of returning from the third interface to the initial interface. Exemplarily, the third interface also includes a return function button, and touching the return function button returns to one of the sixth interface, the seventh interface, and the eighth interface. The specific interface to return to depends on which interface is displayed in the previous step of the above-mentioned first operation before displaying the second interface, that is, it is the inverse of the first operation, which is not elaborated here; if the special effect media information is successfully generated, the user device responds to the first response information and also displays a first pop-up window on the initial interface, or displays a first sign on the initial interface. The text in the first pop-up window is used to inform the user that the special effect media information is successfully generated. The first response information also includes the text in the first pop-up window, and the first sign is used to inform the user that there is a new message notification.

[0091] In an optional embodiment, the initial interface also includes a tenth function button. When the user touches the tenth function button, the user device displays a tenth interface in response to the user's touch of the tenth function button, wherein the tenth interface includes a first message notification, and the first message notification is used to inform the user that the special effect media information is generated successfully.

[0092] In an optional example, the initial interface also includes an eleventh function button, and the user device displays the eleventh interface in response to the user's touch on the eleventh function button; the user device displays a draft box page in response to the user's touch on the eleventh interface, wherein the draft box page includes a first display area corresponding to the special effect media information, the first display area includes a third image display area and a second text display area, specifically, if the special effect media information is generated successfully, the second image display area is used to display the special effect media information, and the second text display area is used to display the first text, and the first text is used to inform the user that the special effect media information is generated successfully; if the special effect media information fails to be generated, or if the special effect media information is being generated, the second image display area is used to display the third image display area .... The display area is used to display a noise image, and the second text area is used to display a second text and a third text respectively, the second text is used to inform the user that the special effect media information generation fails, and the third text is used to inform the user that the special effect media information is being generated; if the special effect media information is successfully generated, the user device jumps to the first interface in response to the user's touch on the second image display area; if the special effect media information generation fails, the user device jumps to the ninth interface in response to the user's touch on the second image display area; if the special effect media information is being generated, the user device displays a second pop-up window on the draft box page in response to the user's touch on the second image display area, wherein the text in the second pop-up window is used to inform the user that the special effect media information is being generated. In this embodiment, after the user exits the third interface, the eleventh function button of the initial interface can be touched to enter the draft box page, and then the generation status of the special effect media information can be known through the first display area and the second image display area in the draft box page, and the generation success or failure can also be directly switched to the first interface or the ninth interface through the draft box page, thereby improving efficiency, eliminating the need for the user to wait for a long time in the third interface, and improving the user experience.

[0093] In a possible embodiment, after the first interface is displayed, in response to the user touching the first function button, a fourth interface is displayed, the second function button is used to support the release of special effect media information and media information, and the fourth interface includes a second image display area and a second function button, the second image display area displays the special effect media information and the media information respectively, specifically, if the special effect media information includes the first special effect media and the first special effect image, the second image display area can display the first special effect media, the first special effect image and media information, and then the second function button is used to support the release of the first special effect media, the first special effect image and media information; if the special effect media information is a special effect video, the second image display area can display the special effect video and media information, or can only display the special effect video, and then the second function button is used to support the release of the special effect video and media information, or to support the release of the special effect video.

[0094] It can be seen that the user device displays a second interface in response to the user's first operation, wherein the second interface includes one or more local images, and the first operation includes the user selecting a target special effect template; then the user device sends a first request message to the server in response to the user's second operation on the second interface, and displays the third interface, wherein the first request message includes media information and a target special effect template, and the first request message is used to request generation of special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, that is, when the user performs the second operation on the second interface, media information is selected from the second interface; if the special effect media information is generated successfully, a first response message to the first request message is received from the server, and in response to the first response message, the first interface is displayed, wherein the first response message includes special effect media information, and the third interface includes a first image display area and a first function button, and the first interface The first image display area is used to display special effect media information; then the user device displays a fourth interface in response to the user's touch on the first function button, the fourth interface including a second image display area and a second function button, the second image display area displays special effect media information and media information respectively, the second function button is used to support the release of special effect media information and media information, that is, the fourth interface can be understood as an interface for publishing content, in addition to displaying the corresponding special effect media information, the second image display area in the interface for publishing content also displays media information, that is, the original image selected by the user, by displaying special effect media and media information, the final user releases media information and special effect media information, thereby increasing the diversity of the published content, and for all users it also reflects that the special effect media information is generated based on the change of media information, thereby ensuring the relevance of the published content and media information, avoiding the phenomenon of uniformity, and increasing the user experience.

[0095] In order to further understand the above embodiments, the present application will be explained below with reference to specific example diagrams.

[0096] See also Figure 3 , Figure 3 A schematic diagram of an initial interface provided in an embodiment of the present application, Figure 3 The initial interface includes a fourth function button. When the user touches the fourth function button, the user device displays a fifth interface in response to the user's touch on the fourth function button in the initial interface. Figure 4 A schematic diagram of a fifth interface provided in an embodiment of the present application, Figure 4 The fifth interface shown includes a fifth function button (i.e. Figure 4 When the user touches the fourth function button, the fifth interface displayed by the user device defaults to the page corresponding to the "XX" function button (the application does not limit the specific type of the "XX" function button). Figure 4The underline under the "XX" shown indicates that the fifth interface displays the page content corresponding to the "XX". The fifth function button is used to switch the fifth interface to a page displaying a special effect template. When the user touches the fifth function button, the sixth interface is displayed. Figure 5 A schematic diagram of a sixth interface provided in an embodiment of the present application, in which the sixth interface also includes Figure 4 The "XX" function button and the fifth function button are shown, and the fifth function button in the sixth interface, namely, the word "Template", is underlined, indicating that the sixth interface displays the page content corresponding to the fifth function button, that is, the sixth interface displays the first number of special effect templates under the "Special Effect" category (i.e. Figure 5 The ABCDE shown correspond to a special effects template respectively. It should be noted that the number and arrangement of the first number of special effects templates shown in the sixth interface are only examples and are not limited in this application). The sixth interface also includes a sixth function button (i.e., the word "more"). The function of the sixth function button is to switch the sixth interface to a page for displaying the second number of special effects templates under the category corresponding to the above-mentioned first number of special effects templates.

[0097] If the target special effect template exists in the first number of special effect templates in the sixth interface, for example, the target special effect template is Figure 5 The special effect template corresponding to "A" in the sixth interface shown, if the user touches the special effect template "A", the user device responds to the touch and displays the seventh interface, Figure 6 A schematic diagram of a seventh interface provided in an embodiment of the present application, wherein the seventh interface includes a seventh function button (i.e., the words "Use Now"), and the seventh interface displays the cover of a target special effect template; then the user touches the seventh function button in the seventh interface, and the user device responds to the touch to display the second interface, Figure 7 A schematic diagram of a second interface provided in an embodiment of the present application, the second interface includes one or more local images and a first virtual button (ie, the word "Next").

[0098] If the target special effect template does not exist in the first number of special effect templates in the sixth interface, that is, the target special effect template does not exist in Figure 5 In the first number of special effect templates corresponding to ABCDE shown, if the user touches the sixth function button, the user device displays the eighth interface in response to the touch operation. Figure 8 A schematic diagram of an eighth interface provided in an embodiment of the present application, in which the eighth interface displays a second number of special effect templates under the "special effect" category, specifically, displays the cover of each special effect template, and the user can browse the second number of special effect templates by sliding the eighth interface up and down until the target special effect template is found, and then the user can touch the area where the cover of the target special effect template is located, and the user device responds to the touch and displays Figure 7The second interface shown; Figure 8 Each special effect template in the eighth interface shown corresponds to an eighth function button (i.e., the word "use"). When the user touches the eighth function button, the user device responds to the touch and displays Figure 7 The second interface is shown.

[0099] When the user selects media information from the local image displayed on the second interface and touches the first virtual button on the second interface, the user device responds to the operation and sends the first request information to the server and displays the third interface. Fig. 9 A schematic diagram of a third interface provided in an embodiment of the present application, Fig. 9 The third interface shown includes a first image display area and a first text display area. The first image display area displays a noise image (visually presenting a blurred state). The text in the first text display area is used to prompt that special effect media information is being generated and the time required to generate the special effect media information. Fig. 9 The third interface shown also includes a third function button of the first type (i.e., the words "Cancel Waiting"), indicating that the time for the target special effect template to generate special effect media information is less than the time threshold; of course, if the time for the target special effect template to generate special effect media information is greater than the time threshold, the third function button in the third interface is of the second type, such as Fig.10 As shown, Fig.10 A schematic diagram of another third interface provided in an embodiment of the present application, Fig.10 The third interface shown still includes the first image display area, the first text display area, and the third function button of the second type (i.e., the words "Exit Wait"). Fig.10 The functions of the first image display area and the first text display area in the third interface shown are similar to Fig. 9 The same as shown will not be repeated here.

[0100] If the special effect media is generated successfully, and the special effect media information includes the first special effect media and the first special effect image, the user equipment receives the first response information for the first request information from the server, and displays the first interface in response to the first response information. Fig.11 A schematic diagram of a first interface provided in an embodiment of the present application, the first interface includes a first image display area, a first text display area, a first function button, and three “circular marks” in the first image display area (the three “circular marks” correspond to the first special effect media, the first special effect image, and the media information from left to right, respectively). Fig.11The first image display area shown displays the first special effect media by default, and the circular mark corresponding to the first special effect media is filled, and the circular mark corresponding to the first special effect image and media information is not filled. The user can browse the first special effect media, the first special effect image and media information by sliding the first image display area left and right. The text in the first text display area in the first interface is used to prompt the regeneration of special effect media information; then when the user touches the first function button, the user device responds to the touch and displays the fourth interface. Fig.12 A schematic diagram of a fourth interface provided in an embodiment of the present application, Fig.12 The fourth interface shown includes a second image display area and a second function button. The second image display area displays the first special effect media, the first special effect image and media information respectively. When the user touches the second function button, the first special effect media, the first special effect image and media information can be published.

[0101] If the special effect media generation fails, the user equipment receives a second response message for the first request message from the server, and displays a ninth interface in response to the second response message. Fig.13 A schematic diagram of a ninth interface provided in an embodiment of the present application, Fig.13 The ninth interface shown includes a first image display area, a first text display area and a ninth function button of the third type (i.e., the word "generate again"); the first image display area in the ninth interface displays a noise image, and the text in the first text display area in the ninth interface is the reason for the generation failure corresponding to the third type; in addition, Fig.14 A schematic diagram of another ninth interface provided in an embodiment of the present application, Fig.14 The first image display area in the ninth interface shown also displays a noise image, and the text in the first text display area is the reason for the generation failure corresponding to the fourth type. Fig.14 The ninth interface shown also includes a ninth function button of the fourth type (ie, the words "select other images").

[0102] In response to the first response information, before the first interface is displayed, that is, before the special effect media is successfully generated, if the third function button is of the second type, and Fig.10 The third interface shown is based on user touch Figure 6 The seventh function button of the seventh interface shown is obtained, and when the user touches Fig.10 When the third function button of the second type is displayed, the user device responds to the touch and returns to Figure 6The seventh interface shown; further, the user device responds to the user's fourth operation and returns to the initial interface, which can be understood as: the seventh interface can also include a return function button, when the user touches the return function button of the seventh interface, the user device responds to the touch and returns from the seventh interface to the sixth interface or the eighth interface (specifically, if the seventh interface is based on the user touch Figure 5 If the display is obtained based on the area where the cover of the target special effects template in the sixth interface shown is located, then the display returns to the sixth interface; if the seventh interface is obtained based on the area where the cover of the target special effects template in the eighth interface is located when the user touches it, then the display returns to the eighth interface); then the sixth interface and the eighth interface also include a return function button. If the display returns to the sixth interface, then in response to the user touching the return function button in the sixth interface, the display returns to the initial interface; if the display returns to the eighth interface, then in response to the user touching the return function button in the eighth interface, the display returns to the sixth interface, and then in response to the user touching the return function button in the sixth interface, the display returns to the initial interface. If Fig.10 The third interface shown is based on user touch Figure 8 The eighth function button corresponding to the target special effect template in the eighth interface shown is obtained, and when the user touches Fig.10 When the third function button of the second type is displayed, the user device responds to the touch and returns to Figure 8 The eighth interface is shown; further, the user device returns to the initial interface in response to the user's fourth operation, which can be understood as: the user device returns to the sixth interface in response to the user's touch of the return function button in the eighth interface, and then returns to the initial interface in response to the user's touch of the return function button in the sixth interface.

[0103] based on Figure 3 The initial interface shown, Fig.15 A schematic diagram of another initial interface provided in an embodiment of the present application, Fig.15 The initial interface shown includes a tenth function button (ie, the word "Message") and an eleventh function button (ie, the word "Me").

[0104] Therefore, when returning to Fig.15 After the initial interface is displayed, if the special effect media information is generated successfully, the user device responds to the first response information and displays a first pop-up window on the initial interface, such as Fig.16 , Fig.16 A schematic diagram of a first pop-up window in an initial interface provided in an embodiment of the present application. The text in the first pop-up window is used to inform the user that the special effect media information has been successfully generated. It should be noted that the present application does not specifically limit the specific shape of the first pop-up window; when the user touches the first pop-up window and the user device responds to the touch, it can jump directly to the first interface.

[0105] Alternatively, the user device displays a first mark on the initial interface in response to the first response information, and the first mark is used to inform the user that there is a new message notification, such as Fig.17 , Fig.17 A schematic diagram of a first mark of an initial interface provided in an embodiment of the present application, Fig.17 The first mark shown is a circular mark on the upper right of the tenth function button "Message", or the first mark can also be a number displayed on the upper right of "Message" to indicate the number of message notifications, which is not limited in this application. Further, in response to the user's touch on the tenth function button, the user device displays a message interface, and the word "Message" is bold to indicate the selected state. The message interface includes a message notification button, Fig.18 A schematic diagram of a message interface provided in an embodiment of the present application, Fig.18 The message interface shown includes a message notification button (i.e., the words "message notification"), and also includes Figure 3 and Fig.15 The function buttons in the initial interface shown are not described in detail here; when the user touches the area where the message notification button is located, the user device responds to the touch and displays the tenth interface. Fig.19 A schematic diagram of a tenth interface provided in an embodiment of the present application, Fig.19 The tenth interface shown includes a first message notification, namely, the words "Special effects creation has been completed, click to view". When the user touches the first message notification, the user device responds to a high touch and jumps directly to the first interface.

[0106] Of course, when the user touches the eleventh function button, the user device responds to the touch and displays the eleventh interface, such as Fig. 20 As shown, Fig. 20 A schematic diagram of an eleventh interface provided in an embodiment of the present application, Fig. 20 The eleventh interface shown includes the fourth function button, the tenth function button and the eleventh function button in the initial interface (at this time, the eleventh function button "I" is bold, indicating a selected state), which will not be described in detail. The eleventh interface also includes a second virtual button (i.e., the words "Local Draft"); when the user touches the second virtual button, the user device responds to the touch and displays a draft box page, wherein the draft box page includes a first display area corresponding to the special effect media information, and the first display area includes a third image display area and a second text display area;

[0107] If the special effect media information is generated successfully, the third image display area is used to display the special effect media information, and the second text display area is used to display the first text, and the first text is used to inform the user that the special effect media information is generated successfully. Fig.21 As shown, Fig.21 A schematic diagram of a draft box page when special effect media information is successfully generated provided by an embodiment of the present application, Fig.21The third image display area shown displays special effect media information, and the first text in the second text display area is "Effect Generated". When the user touches the special effect media information displayed in the third image display area, the user device jumps to the first interface in response to the user's touch on the third image display area.

[0108] If the special effects media information generation fails, such as Fig. 22 , Fig. 22 A schematic diagram of a draft box page when special effect media information generation fails provided in an embodiment of the present application, Fig. 22 The third image display area shown displays a noise image, and the second text in the second text display area (i.e., "Effect generation failed") is used to inform the user that the special effect media information generation failed. When the user touches the third image display area, the user device jumps to the ninth interface in response to the user's touch on the third image display area.

[0109] If special effects media information is being generated, such as Fig.23 , Fig.23 A schematic diagram of a draft box page when special effect media information is being generated provided in an embodiment of the present application, Fig.23 The third image display area shown displays a noise image, and the second text in the second text display area (i.e., "Effects are being generated") is used to inform the user that special effect media information is being generated. When the user touches the third display area, the user device responds to the user's touch on the third image display area and displays a second pop-up window on the draft box page, wherein the text in the second pop-up window is used to inform the user that special effect media information is being generated.

[0110] When the special effect image generated by the target special effect template is a real-life photo image corresponding to the user, if the user touches the seventh function button, the user device displays the twelfth interface in response to the user's touch on the seventh function button, such as Fig.24 As shown, Fig.24 A schematic diagram of a twelfth interface provided in an embodiment of the present application, Fig.24 The twelfth interface shown includes a twelfth function button (i.e., "Select N selfie photos", N is not limited in this application), a fourth text (for example, it can be "close-up selfie, clear face, various angles and expressions", which is not limited in this application), a fifth text (for example, it can be "group photo, wearing sunglasses, unclear face, there are animals", which is not limited in this application), an example image corresponding to the fourth text, and an example image corresponding to the fifth text, and the present application does not limit the number of example images; when the user touches the twelfth function button, the user device displays the second interface in response to the user's touch on the twelfth function button.

[0111] Then, after the user selects N images on the second interface, the user touches the first virtual button on the second interface, and the user device responds to the operation and sends a second request message to the server, the second request message including a third image (i.e., the N images) obtained by the user based on the image selection operation, and the second request message is used to request to detect whether the third image meets the standard; then the user device responds to the third response message received from the server for the second request message and displays the thirteenth interface, such as Fig.25 As shown, Fig.25 A schematic diagram of a thirteenth interface provided in an embodiment of the present application, Fig.25 The thirteenth interface shown includes a thirteenth function button (i.e., the words "Generate virtual image immediately"), qualified photos (i.e., the fourth image of the fourth number), and photos that failed recognition (i.e., unqualified images). It should be noted that the number of qualified images finally obtained in this application should be equal to the third number, that is, the user originally selected the third image of the third number. If the number of fourth images obtained after detection is less than the third number, the user can return to the second interface and re-select new images until the number of qualified images obtained after detection is the third number; when the user touches the thirteenth function button, the user device sends a third request message to the server in response to the user's touch on the thirteenth function button, and displays the fourteenth interface, such as Fig.26 As shown, Fig.26 A schematic diagram of a fourteenth interface provided in an embodiment of the present application, Fig.26 The fourteenth interface shown includes a plurality of fourth image display areas, each of which displays a noise image. The fourteenth interface also includes a first text display area (the text in the first text display area is used to indicate that the virtual image is being generated and the time required for the generation). Fig.26 The fourteenth interface shown also includes a third function button of the second type (i.e., the words "Exit Waiting"). Of course, the third function button can also be determined to be of the first type based on the time required for generation. The principle is the same as Fig. 9 After the multiple virtual avatar images are generated, the server sends a fourth response message to the user device, and the user device displays a fifteenth interface in response to the fourth response message, such as Fig. 27 As shown, Fig. 27 A schematic diagram of a fifteenth interface provided in an embodiment of the present application, Fig. 27The fifteenth interface shown includes a fourteenth function button (i.e., "generate style map"), and multiple virtual image images. At this time, multiple fourth image display areas in the fifteenth interface display corresponding virtual image images. Since the third images selected by the user are all portrait images, i.e., selfies, the fourth images after detection are portrait images of multiple angles that meet the standards, and then multiple virtual image images are generated based on the qualified fourth images, that is, the virtual image images are generated based on the multi-angle and standard portrait images selected by the user, thereby making the special effect map generated based on the virtual image image better. Further, the user can select a target virtual image image from the multiple virtual image images displayed on the fifteenth interface, and then when the user touches the fourteenth function button, the user device responds to the user's touch on the fourteenth function button, and obtains the target virtual image image, and then sends the first request information to the server, and displays the third interface. At this time, the media information in the first request information is the target virtual image image, which is used to request the server to generate special effect media information based on the target virtual image image and the target special effect template.

[0112] See also Fig.28 , Fig.28 A functional unit composition block diagram of a user equipment provided in an embodiment of the present application. The user equipment 2800 includes: a transceiver unit 2801 and a response unit 2802;

[0113] The responding unit 2802 is used to send a first request message to the server in response to a user operation, wherein the first request message includes the media information and the target special effect template selected by the user, and the first request message is used to request to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, and the special effect media information includes at least dynamic media information;

[0114] The transceiver unit 2801 is used to receive first response information for the first request information from the server, and the response unit is also used to display a first interface in response to the first response information, wherein the first response information includes the special effect media information, and the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0115] In a specific implementation, the transceiver unit 2801 and the responding unit 2802 described in the embodiment of the present invention can execute the implementation methods described in all embodiments based on the interactive method provided in the embodiment of the present invention, which will not be repeated here.

[0116] See also Fig.29 , Fig.29 A block diagram of the functional units of a server provided in an embodiment of the present application, the server comprising: a transceiver unit and a processing unit;

[0117] The transceiver unit is used to receive first request information from a user device, wherein the first request information includes media information and a target special effect template selected by a user;

[0118] The processing unit is configured to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, wherein the special effect media information at least includes dynamic media information;

[0119] The transceiver unit is also used to send a first response message to the user device so that the user device displays a first interface in response to the first response message, wherein the first response message includes the special effect media information, the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0120] In a specific implementation, the transceiver unit and the processing unit described in the embodiment of the present invention can execute the implementation methods described in all embodiments based on the interactive method provided in the embodiment of the present invention, which will not be repeated here.

[0121] See also Fig.30 , Fig.30 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig.30 As shown, the electronic device 3000 includes a transceiver 3001, a processor 3002 and a memory 3003. They are connected via a bus 3004. The memory 3003 is used to store computer programs and data, and can transmit the data stored in the memory 3003 to the processor 3002.

[0122] The processor 3002 is used to read the computer program in the memory 3003 and perform the following operations:

[0123] In response to a user operation, the control transceiver 3001 sends a first request message to the server, wherein the first request message includes the media information and the target special effect template selected by the user, and the first request message is used to request to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, and the special effect media information includes at least dynamic media information;

[0124] Receive first response information for the first request information from the server, and display a first interface in response to the first response information, wherein the first response information includes the special effect media information, the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

[0125] Specifically, the transceiver 3001 may be Fig.28 The transceiver unit 2801 of the user equipment 2800 or Fig.29 The transceiver unit in the server of the embodiment, the processor 3002 may be Fig.28 The response unit 2802 of the user equipment 2800 of the embodiment or Fig.29 A processing unit of a server in an embodiment.

[0126] In a specific implementation, the transceiver 3001, processor 3002, and memory 3003 described in the embodiments of the present invention may respectively correspond to the implementation methods described in all embodiments of the interactive method provided in the embodiments of the present invention, which will not be repeated here.

[0127] It should be understood that the electronic devices in this application may include smart phones (such as Android phones, iOS phones, Windows Phone phones, etc.), tablet computers, PDAs, laptops, mobile Internet devices MID (Mobile Internet Devices, referred to as: MID) or wearable devices, etc. The above electronic devices are only examples, not exhaustive, and include but are not limited to the above electronic devices. In practical applications, the above electronic devices may also include: smart vehicle terminals, computer equipment, etc.

[0128] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. The computer program is executed by a processor to implement part or all of the steps of any one of the interactive methods recorded in the above method embodiments.

[0129] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any one of the interactive methods recorded in the above method embodiments.

[0130] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily required by the present application.

[0131] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0132] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0133] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0134] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of a software program module.

[0135] If the integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of each embodiment method of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0136] A person skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash drive, a read-only memory (English: Read-Only Memory, abbreviated as: ROM), a random access memory (English: Random Access Memory, abbreviated as: RAM), a magnetic disk or an optical disk, etc.

[0137] The embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An interactive method, characterized in that: Applied to user equipment, the method comprises: In response to a user operation, sending a first request message to a server, wherein the first request message includes the media information and the target special effect template selected by the user, and the first request message is used to request generation of special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, wherein the special effect media information includes at least dynamic media information; Receive first response information for the first request information from the server, and display a first interface in response to the first response information, wherein the first response information includes the special effect media information, the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

2. The method according to claim 1, characterized in that The step of sending first request information to the server in response to the user operation includes: In response to the first operation of the user, displaying a second interface, wherein the second interface includes one or more local images, and the first operation includes an operation of the user selecting a target special effect template; In response to the user's second operation on the second interface, first request information is sent to the server, and a third interface is displayed.

3. The method according to claim 2, characterized in that The first interface further includes a first function button. After displaying the first interface, the method further includes: In response to the user touching the first function button, a fourth interface is displayed, the fourth interface including a second image display area and a second function button, the second image display area is used to display the special effect media information and the media information, and the second function button is used to support the release of the special effect media information and the media information.

4. The method according to claim 3, characterized in that The third interface includes a third function button, wherein the type of the third function button is the first type or the second type, and the type of the third function button is determined based on the configuration information of the target special effect template; When the type of the third function button is the first type, the third function button is used to exit the third interface and interrupt the generation of the special effect media information; When the type of the third function button is the second type, the third function button is used to exit the third interface without interrupting the generation of the special effect media information.

5. The method according to claim 4, characterized in that The step of displaying a second interface in response to a first operation by a user includes: In response to the user touching the fourth function button in the initial interface, displaying a fifth interface, wherein the fifth interface includes a fifth function button; In response to the user touching the fifth function button, displaying a sixth interface, the sixth interface being used to display a first number of special effect templates, and the sixth interface including a sixth function button; If the target special effect template exists in the first number of special effect templates in the sixth interface, and in response to the user touching the target special effect template in the sixth interface, displaying a seventh interface, wherein the seventh interface includes a seventh function button; In response to the user touching the seventh function button, displaying the second interface; If the target special effect template does not exist in the first number of special effect templates in the sixth interface, and in response to the user's touch operation on the sixth function button, an eighth interface is displayed, wherein the eighth interface is used to display a second number of special effect templates, the second number of special effect templates include the first number of special effect templates, and the target special effect template exists in the second number of special effect templates in the eighth interface; In response to the user's third operation on the eighth interface, the second interface is displayed.

6. The method according to claim 5, characterized in that The eighth interface includes an eighth function button corresponding to the target special effect template, the eighth function button indicates using the target special effect template, and the displaying of the second interface in response to the third operation of the user on the eighth interface includes: If the third operation is touching the eighth function button, in response to the third operation, displaying the second interface; If the third operation is touching the area where the cover of the target special effect template is located in the eighth interface, then in response to the third operation, the seventh interface is displayed; In response to the user touching the seventh function button, the second interface is displayed.

7. The method according to claim 6, characterized in that Before displaying the first interface in response to the first response information, the method further includes: When the third function button is of the second type and the target special effect template exists in the first number of special effect templates in the sixth interface, in response to the user touching the third function button, the third interface is switched to the sixth interface.

8. The method according to claim 7, characterized in that Before displaying the first interface in response to the first response information, the method further includes: When the third function button is of the second type and the target special effect template does not exist in the first number of special effect templates in the sixth interface, if the third operation is touching the eighth function button, then in response to the user touching the third function button, the third interface is switched to the eighth interface; if the third operation is touching the area where the cover of the target special effect template in the eighth interface is located, then in response to the user touching the third function button, the third interface is switched to the seventh interface.

9. The method according to claim 8, characterized in that The method further comprises: If the special effect media information generation fails, receiving second response information for the first request information from the server, wherein the second response information includes a reason why the special effect media information generation fails; In response to the second response information, a ninth interface is displayed, wherein the ninth interface includes the first image display area, the first text display area and a ninth function button, the first image display area of ​​the ninth interface displays a noise image, the text in the first text display area of ​​the ninth interface is the reason for the failure to generate the special effect media information, and the ninth function button is used to prompt the user to generate the special effect media information again based on the media information and the target special effect template, or to prompt the user to select new media information from the second interface.

10. The method according to claim 9, characterized in that If the third function button is of the second type, before displaying the first interface, the method further includes: In response to a fourth operation of the user, returning to the initial interface, wherein the fourth operation includes an operation of returning from the third interface to the initial interface; If the special effect media information is generated successfully, in response to the first response information, a first pop-up window is displayed on the initial interface, or a first sign is displayed on the initial interface, and the text in the first pop-up window is used to inform the user that the special effect media information is generated successfully. The first response information also includes the text in the first pop-up window, and the first sign is used to inform the user that there is a new message notification.

11. The method according to claim 10, characterized in that The initial interface includes a tenth function button, and the method further includes: When the user touches the tenth function button, the tenth interface is displayed in response to the user's touching of the tenth function button, wherein the tenth interface includes a first message notification, and the first message notification is used to inform the user that the special effect media information is generated successfully.

12. The method according to claim 11, characterized in that The initial interface further includes an eleventh function button, and the method further includes: In response to the user touching the eleventh function button, displaying an eleventh interface; In response to the user touching the eleventh interface, displaying a draft box page, wherein the draft box page includes a first display area corresponding to the special effect media information, and the first display area includes a third image display area and a second text display area; If the special effect media information is generated successfully, in response to the user touching the third image display area, jumping to the first interface; If the special effect media information generation fails, in response to the user touching the third image display area, jumping to the ninth interface; If the special effect media information is being generated, in response to the user's touch on the third image display area, a second pop-up window is displayed on the draft box page, wherein the text in the second pop-up window is used to inform the user that the special effect media information is being generated.

13. The method according to claim 12, characterized in that If the special effect media information is generated successfully, the third image display area is used to display the special effect media information, and the second text display area is used to display a first text, and the first text is used to inform the user that the special effect media information is generated successfully; If the special effect media information fails to be generated, or if the special effect media information is being generated, the third image display area is used to display a noise image, and the second text area is used to display a second text and a third text, respectively, the second text is used to inform the user that the special effect media information fails to be generated, and the third text is used to inform the user that the special effect media information is being generated.

14. The method according to claim 13, characterized in that When the special effect image generated by the target special effect template is a real-life photo image corresponding to the user, the second interface is displayed in response to the user touching the seventh function button, including: In response to the user touching the seventh function button, a twelfth interface is displayed, wherein the twelfth interface includes the twelfth function button, a fourth text, a fifth text, and an example image corresponding to the fourth text and an example image corresponding to the fifth text, the twelfth function button is used to inform the user that multiple images need to be selected, the fourth text indicates a correct standard for an image, and the fifth text indicates an incorrect standard for an image; In response to the user touching the twelfth function button, the second interface is displayed.

15. The method according to claim 14, characterized in that The step of sending first request information to a server in response to a second operation of the user on the second interface, and displaying a third interface includes: In response to the user's image selection operation on the second interface, sending a second request message to the server, wherein the second request message includes a third image obtained by the user based on the image selection operation, the number of the third images is a third number, and the second request message is used to request to detect whether the third image meets the standard; In response to third response information received from the server for the second request information, displaying a thirteenth interface, wherein the third response information includes a fourth image, the fourth image represents images that meet the criteria and the number is a fourth number, the fourth number is greater than or equal to the first threshold and less than or equal to the third number, and the thirteenth interface includes a thirteenth function button and the fourth image, the thirteenth function button represents generating a plurality of avatar images corresponding to the user; In response to the user touching the thirteenth function button, sending a third request message to the server, and displaying a fourteenth interface, wherein the third request message is used to request generation of a plurality of virtual avatar images corresponding to the user based on the fourth image, the fourteenth interface includes the third function button, a plurality of fourth image display areas corresponding to the plurality of virtual avatar images, and each fourth image display area in the fourteenth interface displays a noise image; In response to fourth response information received from the server for the third request information, displaying a fifteenth interface, wherein the fourth response information includes the plurality of avatar images, the fifteenth interface includes a fourteenth function button and the plurality of fourth image display areas, and each fourth image display area in the fifteenth interface displays a corresponding avatar image; In response to the user touching the fourteenth function button, the first request information is sent to the server, and the third interface is displayed, wherein the media information is one of the multiple virtual image images, and the first request information is used to request generation of the special effect media information based on the media information and the target special effect template.

16. The method according to claim 15, characterized in that Before displaying the second interface, the method further includes: Detecting whether the first operation is a first operation; If yes, displaying the second interface in response to the user touching the seventh function button includes: In response to the user touching the seventh function button, displaying a second pop-up window on the seventh interface; In response to the user's confirmation touch on the second pop-up window, the second interface is displayed.

17. An interactive method, characterized in that: Applied to a server, the method comprises: Receiving first request information from a user device, wherein the first request information includes media information and a target special effect template selected by a user; Based on the media information and the target special effect template, generating special effect media information corresponding to the type of the target special effect template, wherein the special effect media information at least includes dynamic media information; A first response message is sent to the user device so that the user device displays a first interface in response to the first response message, wherein the first response message includes the special effect media information, the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

18. A user equipment, characterized in that: The user equipment comprises: a transceiver unit and a response unit; The response unit is used to send a first request message to the server in response to a user operation, wherein the first request message includes the media information and the target special effect template selected by the user, and the first request message is used to request to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, and the special effect media information includes at least dynamic media information; The transceiver unit is used to receive first response information for the first request information from the server, and the response unit is also used to display a first interface in response to the first response information, wherein the first response information includes the special effect media information, and the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

19. A server, characterized in that: The server comprises: a transceiver unit and a processing unit; The transceiver unit is used to receive first request information from a user device, wherein the first request information includes media information and a target special effect template selected by a user; The processing unit is configured to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, wherein the special effect media information at least includes dynamic media information; The transceiver unit is also used to send a first response message to the user device so that the user device displays a first interface in response to the first response message, wherein the first response message includes the special effect media information, the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

20. An interactive system, characterized in that: The interactive system includes a user device and a server; The user equipment is configured to send a first request message to the server in response to a user operation, wherein the first request message includes media information and a target special effect template selected by the user; The server is configured to generate special effect media information corresponding to the type of the target special effect template based on the media information and the target special effect template, wherein the special effect media information at least includes dynamic media information; The server is further configured to send first response information to the user equipment, wherein the first response information includes the special effect media information; The user device is also used to receive first response information for the first request information from the server, and display a first interface in response to the first response information, wherein the first interface includes a first image display area, and the first image display area of ​​the first interface is at least used to display the dynamic media information.

21. An electronic device, characterized in that: include: A processor and a memory, the processor is connected to the memory, the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the electronic device executes the method as described in any one of claims 1-17.

22. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is executed by a processor to implement the method according to any one of claims 1 to 17.

Images