Special effect interaction method and apparatus, device and storage medium

Abstract

Provided in the embodiments of the present disclosure are a special effect interaction method and apparatus, a device and a storage medium. The method comprises: detecting an application request for a target special effect style, the application request instructing applying the target special effect style to a target image; in response to detecting the application request for the target special effect style, determining a special effect generation constraint associated with the target special effect style in a special effect constraint configuration, the special effect generation constraint indicating at least one of the following: the maximum number of special effect images for the target special effect style, and the number of pre-loaded special effect images for the target special effect style; on the basis of the determined special effect generation constraint, initiating at least one special effect generation request to a server device, each special effect generation request instructing generating, on the basis of the target image, a special effect picture having the target special effect style; and receiving from the server device at least one special effect image corresponding to the at least one special effect generation request for presentation. Thus, the request pressure on the target special effect style can be relieved.

Description

Method, device, equipment and storage medium for special effect interaction

[0001] This application claims priority to the Chinese invention patent application entitled “Methods, devices, equipment and storage media for special effects interaction” filed on January 15, 2024, with application number 202410059711.X. The entire contents of that application are incorporated by reference into this application. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for special effect interaction. Background Art

[0003] Currently, more and more applications are designed to provide various services to users. For example, users can publish, browse, and view various types of content in applications, including multimedia content such as videos, images, image collections, and sounds. Users can also apply special effects styles to images in applications. In some applications, the generation of some special effects images is performed on the server device, so each use of a special effect style triggers a corresponding network request. Therefore, when a large number of special effects images need to be presented to users, it will place a lot of pressure on the server. It is desirable to provide effective methods to control and alleviate the processing pressure on the server.

[0004] Summary of the Invention

[0005] In a first aspect of the present disclosure, a method for special effect interaction is provided. The method includes: detecting an application request for a target special effect style, the application request indicating application of the target special effect style on a target image; in response to detecting the application request for the target special effect style, determining a special effect generation constraint associated with the target special effect style in a special effect constraint configuration, the special effect generation constraint indicating at least one of the following: a maximum number of special effect images for the target special effect style, and a number of preloaded special effect images for the target special effect style; based on the determined special effect generation constraint, initiating at least one special effect generation request to a server device, each special effect generation request indicating generation of a special effect image with the target special effect style based on the target image; and receiving at least one special effect image corresponding to each of the at least one special effect generation requests from the server device for presentation.

[0006] In the second aspect of the present disclosure, a device for special effect interaction is provided. The device includes: a detection module, configured to detect an application request for a target special effect style, the application request indicating the application of the target special effect style on the target image; a determination module, configured to determine the special effect generation constraint associated with the target special effect style in the special effect constraint configuration in response to detecting the application request for the target special effect style, the special effect generation constraint indicating at least one of the following: the maximum number of special effect images for the target special effect style, the number of preloaded special effect images for the target special effect style; a sending module, configured to initiate at least one special effect generation request to a server device based on the determined special effect generation constraint, each special effect generation request indicating the generation of a special effect image with the target special effect style based on the target image; and a receiving module, configured to receive at least one special effect image corresponding to the at least one special effect generation request from the server device for presentation.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0008] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0009] In a fifth aspect of the present disclosure, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions, which, when executed by a device, cause the device to perform the method of the first aspect.

[0010] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0012] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0013] FIG2 shows a flowchart of a process of special effect interaction according to some embodiments of the present disclosure;

[0014] FIG3 shows a flowchart of a process of special effect interaction according to other embodiments of the present disclosure;

[0015] 4A and 4B illustrate examples of special effect display pages according to some embodiments of the present disclosure;

[0016] FIG5 shows a flowchart of a process of special effect interaction according to other embodiments of the present disclosure;

[0017] 6A to 6B show examples of special effect display pages according to other embodiments of the present disclosure;

[0018] FIG7 shows a block diagram of an apparatus for special effect interaction according to some embodiments of the present disclosure; and

[0019] FIG8 shows a block diagram of a device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0020] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0021] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0022] Herein, unless explicitly stated otherwise, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0023] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0024] As used herein, the term "model" can learn the association between corresponding inputs and outputs from training data, so that after training is completed, corresponding outputs can be generated for given inputs. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multiple layers of processing units. In this article, "model" may also be referred to as "machine learning model", "machine learning network" or "network", and these terms are used interchangeably in this article. A model can also include different types of processing units or networks.

[0025] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0026] For example, in response to receiving a user's active request, a prompt message is sent to the user to clearly remind the user that the operation requested to be performed will require obtaining and using the user's personal information, so that the user can independently choose whether to provide personal information to the electronic device, application, server or storage medium and other software or hardware that performs the operation of the technical solution of the present disclosure based on the prompt message.

[0027] As an optional but non-limiting implementation, in response to receiving a user's active request, a prompt message may be sent to the user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0028] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0029] 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In the example environment 100, an application 120 is installed in a terminal device 110. A user 140 can interact with the application 120 via the terminal device 110 and / or a device attached to the terminal device 110.

[0030] In some embodiments, application 120 may be a content sharing application (e.g., a video application primarily focused on video sharing) that can provide various services related to media content items to user 140, including browsing, commenting, forwarding, creating (e.g., filming and / or editing), and publishing content. In some embodiments, application 120 may also be any other appropriate application that can display media content items. In this document, each "media content item" includes one or more types of content, such as video, image, animated image, image collection, audio, text, and the like.

[0031] In the environment 100 of Figure 1, if the application 120 is in an active state, the terminal device 110 can present a page 150 of the application 120. The page 150 may include various types of pages that the application 120 can provide, such as a content presentation page, a content creation page, a content publishing page, a message page, a personal homepage, and the like. The application 120 may provide a content viewing function to view various types of content published in the application 120. Via the corresponding page, the application 120 may provide the user 140 with content associated with media content or shopping content. Through appropriate means, such as clicking or selecting a page element, the application 120 may also provide the user 140 with the selection and switching of the presentation method of the associated content. In this article, "media content" includes one or more types of content, such as images, image collections, videos, animated images, audio, text, and the like.

[0032] In some embodiments, the terminal device 110 communicates with the server device 130 to implement the provision of services for the application 120. In the environment 100, the target model 135 communicates with the server device 135. In some examples, the server device 130 can provide services for the application 120 installed in the terminal device 110 by calling the target model 135. In some embodiments of the present disclosure, for the use of special effect styles, for example, when applying special effect styles to specific content (including images and videos), the server device 130 can call the target model 135 to process the image or video in response to a user request from the terminal device 110 to convert the image or video into an image or video with a corresponding special effect style. Although only a single target model 135 is shown in Figure 1, it can be understood that depending on the specific application needs, there may be more models, and different models may be configured to process different special effect styles, or provide other functions in the application 120, and so on.

[0033] In some embodiments, the terminal device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.). The server device 130 can be various types of computing systems / servers that can provide computing capabilities, including but not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0034] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0035] As briefly mentioned above, users can apply special effects styles to images in the app. For example, currently, when entering an app's editing page and applying a special effect style, an application request is triggered for each effect image. This means that when entering the special effect style editing page, as many application requests are triggered as the number of effect images the user is allowed to view. This places significant pressure on the server. While solutions exist to control the number of effect images, existing solutions can only control all special effect styles simultaneously and cannot provide fine-grained control over specific effects or a few.

[0036] According to an embodiment of the present disclosure, an improved special effect interaction solution is proposed. According to the solution of the embodiment of the present disclosure, the terminal device detects an application request for applying a target special effect style on a target image for a target special effect style. If the terminal device detects an application request for a target special effect style, the special effect generation constraint associated with the target special effect style in the special effect constraint configuration is determined. The special effect generation constraint indicates at least one of the following: the maximum number of special effect images for the target special effect style, and the number of preloaded special effect images for the target special effect style. The terminal device initiates at least one special effect generation request to the server device based on the special effect generation constraint it determines, and each special effect generation request indicates the generation of a special effect image with a target special effect style based on the target image. The terminal device receives at least one special effect image corresponding to the at least one special effect generation request from the server device for presentation. Thus, in this way, special effect constraints for certain special effect styles can be implemented to finely control the maximum number of special effect images and / or the number of preloaded special effect images for each special effect style, thereby achieving the purpose of alleviating network processing pressure.

[0037] Some example embodiments of the present disclosure will be described below with reference to the accompanying drawings. Figure 2 shows a flow chart of a process 200 of special effect interaction according to some embodiments of the present disclosure. For ease of discussion, these embodiments will be described with reference to the environment 100 of Figure 1 .

[0038] At block 210, terminal device 110 detects a request to apply a target special effect style. The application request detected by terminal device 110 indicates that user 140 desires to apply the target special effect style to a target image. In other words, terminal device 110 detects that user 140 desires to apply the special effect style and enters the editing page.

[0039] In some embodiments, the terminal device 110 detects a request to apply a target special effect style, which may be a request to continue editing initiated from a draft saved for the target image. The terminal device 110 may also detect a request to apply a target special effect style when the user 140 selects the "Take Same Style" function when viewing images posted by other users with a certain special effect style, then selects the target image to be edited and enters the editing page. Some examples of triggering the application request of a special effect style are provided here. It should be understood that in actual applications, there may be more or different examples of triggering the use of special effect styles.

[0040] In box 220, if the terminal device 110 detects an application request for the target special effect style, the special effect generation constraint associated with the target special effect style in the special effect constraint configuration is determined. In some examples, the special effect generation constraint determined by the terminal device 110 can be used to indicate the maximum number of special effect graphs for the target special effect style. Hereinafter, for the convenience of discussion, the maximum number of special effect graphs for the target special effect style can be expressed as "max_count". The special effect generation constraint determined by the terminal device 110 can be used to indicate the number of preloaded special effect graphs for the target special effect style. Hereinafter, for the convenience of discussion, the number of preloaded special effect graphs for the target special effect style can be expressed as "preload_count".

[0041] In some embodiments, a special effect constraint configuration includes a mapping between the identifier of at least one special effect and the special effect generation constraints associated with at least one special effect style. For example, a special effect constraint configuration can be represented as: {"id1":max_cout1; "id2":max_cout2,preload_count2; "id3":max_cout3; "id4":preload_cout4}. It can be seen that depending on specific configuration needs, some special effect styles can be configured with a maximum number of special effect images, some special effect styles can be configured with a preloaded number of special effect images, and some special effect styles can be configured with both a maximum number of special effect images and a preloaded number of special effect images.

[0042] In some examples, the terminal device 110 receives the special effect constraint configuration from the server device 130. If the server device 130 updates the special effect constraint configuration, the terminal device 110 may also receive an update to the special effect constraint configuration from the server device 130.

[0043] In some embodiments, the special effect constraint configuration can be static. In some embodiments, the special effect constraint configuration can be dynamically updated by the server device 130. In some embodiments, the special effect constraint configuration can be determined based on the popularity of the special effect style. For example, the number of times certain special effect styles are requested by users over a period of time may suddenly increase, for example, the user popularity of certain special effect styles has increased significantly. In order to alleviate the processing pressure of these special effect styles on the server, the server device can choose to impose special effect generation constraints on these special effect styles separately, for example, reducing the maximum number of special effect images and / or the number of preloaded special effect images for these special effect styles. That is, if it is detected that a special effect style is highly popular (for example, the popularity or user usage frequency over a period of time exceeds a threshold), then the special effect generation constraints for the special effect style can be added to the special effect constraint configuration to constrain the maximum number of special effect images and / or the number of preloaded special effect images for the special effect style. In this way, when a large number of users request to use this special effect style, the server device can meet the needs of different users within the constraints without causing excessive processing pressure.

[0044] The following describes how the terminal device 110 determines the special effect generation constraints associated with the target special effect style.

[0045] In some embodiments, if the terminal device 110 determines that the target special effect style is not a sub-style of another special effect style, the terminal device 110 determines the special effect generation constraint mapped to the first identifier of the target special effect style from the special effect constraint configuration. For example, if the target special effect style does not have a previous-level special effect style, the terminal device 110 determines the maximum number of special effect images corresponding to the identifier of the target special effect style based on the identifier of the target special effect style, or determines the number of preloaded special effect images.

[0046] In some embodiments, if the terminal device 110 determines that the target special effect style is a sub-style of the second special effect style, the terminal device 110 can search the special effect generation constraint mapped to the second identifier of the second special effect style from the special effect constraint configuration. The second special effect style may, for example, include one or more sub-styles, and such a second special effect style is sometimes also referred to as a "parent special effect style" or "upper-level special effect style." For example, if the target special effect style is a sub-style of the second special effect style, the terminal device 110, based on the identifier of the second special effect style, determines the maximum number of special effect images and / or the number of preloaded special effect images corresponding to the identifier of the second special effect style from the special effect constraint configuration.

[0047] For example, if the target effect style belongs to a certain category of effects styles, or is a sub-effect style under a parent effect style, the effect generation constraints under that category will be applied to the target effect style. In other words, the effect generation constraints associated with the parent effect style will apply to all sub-effect styles under that parent effect style. However, the effect generation constraints associated with a sub-effect style will only apply to that sub-effect style, and not to the parent effect style or other sub-effect styles.

[0048] In other embodiments, when the terminal device 110 detects a request for continued editing initiated by the user 140 on a draft saved for a target image, the terminal device 110 may determine the special effect generation constraints associated with the target special effect style in the following manner. The terminal device 110 determines the special effect generation constraints associated with the target special effect style from the configuration information corresponding to the draft. For example, if the user 140 initiates a request for continued editing on a draft saved for a target image, the terminal device 110 may read the maximum number of special effect images saved (max_count value) or the number of preloaded special effect images (preload_count value) from the draft.

[0049] Continuing with process 200, in box 230, the terminal device 110 initiates at least one special effect generation request to the server device 130 based on the special effect generation constraints determined by it. Each special effect generation request initiated by the terminal device 110 to the server device 130 is used to indicate: generate a special effect graph with a target special effect style based on the target image. In some embodiments, the server device 130 can generate a special effect graph with a target special effect style by calling the target model 135. Due to the diversity of special effect styles processed by the model, for the same special effect style, multiple different special effect graphs can be generated based on the same target image. One special effect generation request can correspond to one model call, thereby triggering the generation of a special effect graph.

[0050] In block 240 , the terminal device 110 receives and presents at least one special effect image corresponding to at least one special effect generation request from the server device 130 .

[0051] In some embodiments, the special effect generation constraint determined by the terminal device 110 is used to indicate the maximum number of special effect images for the target special effect style. The at least one special effect generation request sent by the terminal device 110 to the server device 130 may include sending a special effect generation request to the server device 130 that includes at most the maximum number of special effect images. In other words, for the target special effect style, the maximum number of special effect images limits the maximum number of special effect generation requests that the terminal device 110 can initiate.

[0052] In other embodiments, the special effect generation constraint determined by the terminal device 110 is used to indicate the number of preloaded special effect images of the target special effect style. At least one special effect generation request sent by the terminal device 110 to the server device 130 may be: the terminal device 110 detects an application request for the target special effect style, and sends a number of special effect generation requests equal to the number of preloaded special effect images to the server device 130. In some examples, the terminal device 110 also presents special effect images received from the server device 130 that are equal to the number of preloaded special effect images. For the target special effect style, the number of preloaded special effect images limits the maximum number of special effect generation requests initiated for the first time by the terminal device 110.

[0053] In some embodiments, based on the preloaded special effect images generated initially, the user may be allowed to trigger the generation of more special effect images in the target special effect style (if the number of preloaded special effect images is less than the maximum number of special effect images) according to user needs. Specifically, if the terminal device 110 detects an additional special effect generation request for the target special effect style, it initiates at least one additional special effect generation request to the server device 130. At the same time, the terminal device 110 receives and presents at least one additional special effect image corresponding to the at least one additional special effect generation request from the server device 130.

[0054] In some examples, the number of special effect images obtained after the initial request, equal to the number of preloaded special effect images, can be presented on the special effect style editing page for the user to view. On the editing page, the terminal device 110 detects a request to generate an additional special effect image in response to the user 140 switching from a pre-recorded special effect image to a blank slot. In some embodiments, a corresponding interface element or control can be configured on the editing page for the user to trigger the request to generate an additional special effect image.

[0055] In some embodiments, the total number of special effect generation requests equal to the number of preloaded special effect images and at least one additional special effect generation request does not exceed the maximum number of special effect images. For example, for a certain special effect style, if both the maximum number of special effect images and the number of preloaded special effect images are configured, then when initiating additional special effect image generation requests, the maximum number of special effect images that can be generated does not exceed the configured maximum number of special effect images.

[0056] In some examples, if the terminal device 110 determines from the special effect constraint configuration that the number of preloaded special effect images of the target special effect style is greater than the maximum number of special effect images, the terminal device 110 will modify the number of preloaded special effect images of the target special effect style (preload_count value) to be equal to the maximum number of special effect images (max_count value).

[0057] The following will refer to two examples and illustrate the scheme for special effect interaction provided by the embodiment of the present disclosure in conjunction with Figures 3 to 6. For the convenience of discussion, the following description will refer to Figure 1. The two examples referenced below are merely illustrative and are not limited to this disclosure.

[0058] The following first describes the maximum number of effect images that user 140 can generate during use, in conjunction with Figures 3 and 4A-4B. That is, the special effect generation constraint determined by terminal device 110 indicates the maximum number of special effect images for the target special effect style. Figure 3 shows a flowchart of a special effect interaction process 300 according to some embodiments of the present disclosure.

[0059] In block 311, the terminal device 110 detects a request to apply the target special effect style. The terminal device 110 detects that the user 140 has entered the editing page and started to use the target special effect style. In block 312, the terminal device 110 starts calculating the maximum number of special effect images (getMaxCount()) for the target special effect style.

[0060] In block 313, terminal device 110 determines whether user 140 entered the edit page from a draft. In block 314, if user 140 entered the edit page from a draft, terminal device 110 reads the maximum number of special effect images (max_count value) for the target special effect style that was previously saved from the draft of the target image. Based on the max_count value, terminal device 110 initiates a special effect generation request to server device 130, which will be described in detail below in block 318.

[0061] At block 315, if user 140 is not entering from a draft, terminal device 110 determines whether the maximum number of associated special effect images (max_count value) can be found in the special effect constraint configuration based on the identifier of the parent special effect style to which the target special effect style belongs. In some embodiments, terminal device 110 may also determine whether the special effect constraint configuration is applicable to the current user, i.e., whether special effect constraints need to be applied to the user. If applicable, terminal device 110 determines whether the maximum number of associated special effect images can be found in the special effect constraint configuration based on the identifier of the parent special effect style.

[0062] At block 316, the terminal device 110 searches the special effect constraint configuration for an associated max_count value based on the identifier of the target special effect style. If a max_count value is found, the max_count value is used as the max_count value. The terminal device 110 then initiates a special effect generation request to the server device 130 based on the max_count value. At block 317, if a max_count value is not found in the special effect constraint configuration, the terminal device 110 determines a default maximum number of special effect images. The default maximum number of special effect images can be the maximum number of special effect images applicable to all special effect styles.

[0063] At block 318, the terminal device 110 initiates a special effect generation request for the target special effect style to the server device 130 based on the determined max_count value. For example, the max_count value calculated by the terminal device 110 is sent via a message link to the function responsible for special effect generation, which then initiates a special effect generation request to the server device 130 based on the maximum number of special effect images. The maximum number of special effect images constrains the maximum number of special effect images that the terminal device 110 can request from the server device 130.

[0064] In some embodiments, the terminal device 110 can present a maximum of max_count+2 slots in the user interface, and each slot corresponds to the interface element to be presented. In some examples, the number of slots presented by the terminal device 110 can be determined in the following manner. Figures 4A to 4B show examples of special effects display pages according to some embodiments of the present disclosure. As shown in Figure 4A, if the current user request uses "special effects style A" and the maximum number of special effects images max_count=3 specific to "special effects style A" is determined, then the terminal device 110 presents 3 special effects image slots (i.e., special effects image slots 414, 416, 418, each slot includes a special effects image generated by requesting the server device) on the editing page 401, and the original image slot 412 (for presenting the target image to which the special effects style is to be applied). In the example of Figure 4B, if the current user request uses "special effects style B" and the maximum number of special effects images max_count=1 specific to "special effects style A" is determined. The terminal device 110 presents max_count+2 slots on the editing page 402, including, from left to right, an original image slot 412 for the target image input by the user, max_count special effect image slots (e.g., a special effect image slot 424), and a plus sign slot 426. The plus sign slot 426 is used to be triggered by the user to add other special effect styles.

[0065] In an embodiment of the present disclosure, by responding to a detected application request for a target special effect style, a special effect generation constraint indicating the maximum number of special effect images for the target special effect style is determined. For one or some special effect styles, it is possible to dynamically configure the maximum number of special effect images that a user can see and obtain through the special effect style without affecting other special effects.

[0066] The following, in conjunction with Figures 5 and 6A-6B, describes the first batch of application requests initiated by user 140 when first entering the edit page. Specifically, the special effect generation constraints determined by terminal device 110 indicate the number of preloaded special effect images for the target special effect style. Figure 5 shows a flowchart of a special effect interaction process 500 according to other embodiments of the present disclosure.

[0067] In block 511, the terminal device 110 detects a request to apply the target special effect style. The terminal device 110 detects that the user 140 has entered the edit page and has started to use the target special effect style. In block 512, the terminal device 110 starts calculating the number of preloaded special effect images (getPreloadCount()) for the target special effect style.

[0068] At block 513 , terminal device 110 determines whether user 140 accessed the session from a draft. At block 514 , if user 140 accessed the session from a draft, terminal device 110 reads the number of preloaded special effect images (preload_count value) of the target special effect style saved from the draft. Based on the preload_count value, terminal device 110 initiates a special effect generation request to server device 130 , as described in detail below in block 519 .

[0069] At block 515, if user 140 did not enter the game from a draft, terminal device 110 determines whether the associated preloaded special effect images can be found based on the identifier of the parent special effect style. In some embodiments, terminal device 110 may also determine whether the special effect constraint configuration applies to the current user, i.e., whether special effect constraints need to be applied to the user. If applicable, terminal device 110 determines whether the associated preloaded special effect images can be found based on the identifier of the parent special effect style.

[0070] In block 516 , if no associated preload_count value is found based on the identifier of the parent special effect style, the terminal device 110 searches the special effect constraint configuration for an associated preload_count value based on the identifier of the target special effect style.

[0071] At block 517, if the terminal device 110 cannot find the associated preload_count value from the special effect constraint configuration based on the identifier of the target special effect style, it determines a default number of preloaded special effect images. The default number of preloaded special effect images can be a value applicable to all special effect styles. In some embodiments, the default number of preloaded special effect images can be determined to be equal to the maximum number of special effect images for the special effect style, or the default maximum number of special effect images.

[0072] At block 518, if a preload_count value is found in the effect constraint configuration based on the identifier of the parent effect style or based on the identifier of the target effect style, the terminal device 110 may compare the maximum number of effect images (max_count) with the determined number of preloaded effect images (preload_count) to select the minimum of the two as the number of preloaded effect images. This ensures that the number of preloaded effect images for the target effect style does not exceed the required maximum number of effect images.

[0073] In block 519, the terminal device 110 initiates a special effect generation request to the server device 130 based on the final number of preloaded special effect images. For example, the preload_count value calculated by the terminal device 110 is sent to the prop package via a message link. After receiving the message, the prop package requests preload_count special effect images from the server in the first batch of application requests when the user enters the edit page. At the same time, for the remaining max_count-preload_count slots, a request failure message is sent to the terminal device 110. After receiving the message, the terminal device 110 considers these slots to be in a failed state, so that when the user 140 switches to these slots, it can automatically initiate a retry request.

[0074] Figures 6A and 6B illustrate examples of special effects display pages according to other embodiments of the present disclosure. In the edit page 601 of Figure 6A or the edit page 602 of Figure 6B, slot 611 is the original image slot for the target image entered by the user. In the example of Figure 6A, the preload count for "Special Effect Style A" is 1. Therefore, when the user is requested to use "Special Effect Style A," a special effects generation request is initiated to the server device 130 to obtain a special effects image. Slot 612 provides a special effects image that is automatically loaded based on the target image. Additionally, in the edit page 601, slots 614 and 616 can be left blank to request the generation of additional special effects images. If the user 140 clicks the blank slot 614 shown in Figure 6A to request the generation of additional special effects images, the terminal device 110 can present the generated additional special effects images in slot 622 shown in Figure 6B in response to the user 140 clicking the blank slot 614. In this way, the processing pressure on the server caused by a single batch request for too many special effects images can be alleviated, and the server device can be progressively requested to provide more special effects images according to user needs.

[0075] The disclosed embodiment determines a special effect generation constraint indicating the number of preloaded special effect images for the target special effect style in response to detecting an application request for the target special effect style. For one or several special effect styles, it is possible to dynamically configure the maximum number of special effect images to be requested to be generated when the first special effect generation request for the special effect style is made without affecting other special effects.

[0076] The disclosed embodiments determine special effect generation constraints in response to detecting a user's application request to apply a target special effect style to a target image. Based on the special effect generation constraints, the terminal device initiates a special effect request to the server device, and simultaneously receives and presents the special effect image corresponding to the special effect generation request from the server device. This enables precise control of the target special effect style while alleviating network request pressure.

[0077] 7 shows a schematic structural block diagram of an apparatus 700 for special effect interaction according to certain embodiments of the present disclosure. Apparatus 700 may be implemented as or included in terminal device 110. Each module / component in apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0078] As shown in the figure, the apparatus 700 includes a page detection module 710 configured to detect an application request for a target special effect style, where the application request indicates application of the target special effect style on a target image.

[0079] The device 700 also includes a determination module 720, which is configured to determine the special effect generation constraints associated with the target special effect style in the special effect constraint configuration in response to detecting an application request for the target special effect style, and the special effect generation constraints indicate at least one of the following: the maximum number of special effect images for the target special effect style, and the number of preloaded special effect images for the target special effect style.

[0080] The apparatus 700 further includes a sending module 730 configured to initiate at least one special effect generation request to the server device based on the determined special effect generation constraints, each special effect generation request instructing to generate a special effect image having a target special effect style based on the target image.

[0081] The apparatus 700 further includes a receiving module 740 configured to receive at least one special effect image corresponding to at least one special effect generation request from a server device for presentation.

[0082] In some embodiments, the special effect constraint configuration includes a mapping between an identification of at least one special effect and a special effect generation constraint associated with each of at least one special effect style.

[0083] In some embodiments, the receiving module 740 is further configured to receive a special effect constraint configuration or an update to the special effect constraint configuration from the server device.

[0084] In some embodiments, the determination module 720 is further configured to determine, from the special effect constraint configuration, the special effect generation constraint to which the first identifier of the target special effect style is mapped if it is determined that the target special effect style does not belong to a sub-style of other special effect styles; and to determine, from the special effect constraint configuration, the special effect generation constraint to which the second identifier of the second special effect style is mapped if it is determined that the target special effect style belongs to a sub-style of the second special effect style.

[0085] In some embodiments, the application request for the target special effect style includes a request for continued editing initiated from a draft saved for the target image, and the determination module 720 is further configured to determine the special effect generation constraints associated with the target special effect style from the configuration information corresponding to the draft.

[0086] In some embodiments, the special effect generation constraint indicates a maximum number of special effect images for a target special effect style, and the sending module 730 is further configured to initiate a special effect generation request with a maximum number of special effect images to the server device.

[0087] In some embodiments, the special effect generation constraint indicates the number of preloaded special effect images for the target special effect style, and the sending module 730 is further configured to, in response to an application request for the target special effect style, initiate a number of special effect generation requests to the server device equal to the number of preloaded special effect images. The receiving module 740 also includes a rendering module configured to render the special effect images received from the server device equal to the number of preloaded special effect images.

[0088] In some embodiments, the sending module 730 is further configured to, in response to detecting a request to generate an additional special effect image for a target special effect style, initiate at least one additional special effect generation request to the server device. The receiving module 740 is further configured to receive at least one additional special effect image corresponding to each of the at least one additional special effect generation request from the server device for presentation.

[0089] In some embodiments, the total number of special effect generation requests equal to the number of preloaded special effect maps and at least one additional special effect generation request does not exceed the maximum number of special effect maps.

[0090] In some embodiments, the determination module 720 is further configured to modify the number of preloaded special effect images for the target special effect style to be equal to the maximum number of special effect images if it is determined from the special effect constraint configuration that the number of preloaded special effect images for the target special effect style is greater than the maximum number of special effect images.

[0091] FIG8 shows a block diagram of an electronic device 800 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 800 shown in FIG8 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 800 shown in FIG8 can be used to implement the terminal device 110 of FIG1 or the apparatus 700 of FIG7.

[0092] As shown in FIG8 , electronic device 800 is a general-purpose electronic device. Components of electronic device 800 may include, but are not limited to, one or more processors or processing units 810, memory 820, storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. Processing unit 810 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 820. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 800.

[0093] The electronic device 800 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 820 can be a volatile memory (e.g., a register, a cache, a random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 830 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data (e.g., training data for training) and can be accessed within the electronic device 800.

[0094] The electronic device 800 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG8 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 820 may include a computer program product 825 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0095] The communication unit 840 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 800 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 800 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0096] The input device 850 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 860 may be one or more output devices, such as a display, a speaker, or a printer. The electronic device 800 may also communicate with one or more external devices (not shown) via the communication unit 840 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with the electronic device 800, or with any device that allows the electronic device 800 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0097] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0098] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0099] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0100] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0101] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0102] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for special effect interaction, comprising: Detecting an application request for a target special effect style, the application request indicating to apply the target special effect style to a target image; In response to detecting the application request for the target special effect style, determining a special effect generation constraint associated with the target special effect style in a special effect constraint configuration, the special effect generation constraint indicating at least one of the following: The maximum number of special effect maps for the target special effect style, The number of pre-loaded special effect maps for the target special effect style; Based on the determined special effect generation constraint, initiating at least one special effect generation request to a server device, each special effect generation request respectively indicating to generate a special effect map with the target special effect style based on the target image; and Receiving at least one special effect map corresponding to each of the at least one special effect generation request from the server device for presentation.

2. The method according to claim 1, wherein the special effect constraint configuration includes a mapping between the identifier of at least one special effect and the special effect generation constraint respectively associated with each of the at least one special effect style; and / or wherein the method further includes: Receiving the special effect constraint configuration or an update to the special effect constraint configuration from the server device.

3. The method according to claim 1 or 2, wherein determining the special effect generation constraint associated with the target special effect style includes: If it is determined that the target special effect style does not belong to a sub-style of other special effect styles, determining the special effect generation constraint mapped by the first identifier of the target special effect style from the special effect constraint configuration; and If it is determined that the target special effect style belongs to a sub-style of a second special effect style, determining the special effect generation constraint mapped by the second identifier of the second special effect style from the special effect constraint configuration.

4. The method according to any one of claims 1 to 3, wherein the application request for the target special effect style includes a continue editing request initiated from a draft saved for the target image, and wherein determining the special effect generation constraint associated with the target special effect style includes: Determining the special effect generation constraint associated with the target special effect style from the configuration information corresponding to the draft.

5. The method according to any one of claims 1 to 4, wherein the special effect generation constraint indicates the maximum number of special effect maps for the target special effect style, and wherein initiating at least one special effect generation request to the server device includes: Initiating at most the maximum number of special effect generation requests to the server device.

6. The method according to any one of claims 1 to 5, wherein the special effect generation constraint indicates the number of pre-loaded special effect maps for the target special effect style, and wherein initiating at least one special effect generation request to the server device includes: In response to the application request for the target special effect style, initiating the same number of special effect generation requests as the number of pre-loaded special effect maps to the server device, and wherein the method further includes: presenting the same number of special effect maps received from the server device as the number of pre-loaded special effect maps.

7. The method according to claim 6, further comprising: In response to detecting an additional special effect map generation request for the target special effect style, initiate at least one additional special effect generation request to the server device; And Receive at least one additional special effect map respectively corresponding to the at least one additional special effect generation request from the server device for presentation.

8. The method according to claim 7, wherein the total number of special effect generation requests equal to the number of pre-loaded special effect maps and the at least one additional special effect generation request does not exceed the maximum number of special effect maps.

9. The method according to any one of claims 1 to 8, wherein determining the special effect generation constraint includes: If it is determined from the special effect constraint configuration that the number of pre-loaded special effect maps for the target special effect style is greater than the maximum number of special effect maps, modify the number of pre-loaded special effect maps for the target special effect style to be equal to the maximum number of special effect maps.

10. An apparatus for special effect interaction, comprising: A detection module configured to detect an application request for a target special effect style, the application request indicating applying the target special effect style to a target image; A determination module configured to, in response to detecting the application request for the target special effect style, determine a special effect generation constraint associated with the target special effect style in a special effect constraint configuration, the special effect generation constraint indicating at least one of the following: The maximum number of special effect maps for the target special effect style, The number of pre-loaded special effect maps for the target special effect style; A sending module configured to, based on the determined special effect generation constraint, initiate at least one special effect generation request to a server device, each special effect generation request respectively indicating generating a special effect map with the target special effect style based on the target image; And A receiving module configured to receive at least one special effect map respectively corresponding to the at least one special effect generation request from the server device for presentation.

11. An electronic device, comprising: At least one processing unit; And At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions when executed by the at least one processing unit cause the electronic device to execute the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, having stored thereon a computer program, the computer program being executable by a processor to implement the method according to any one of claims 1 to 9.

13. A computer program product, the computer program product being tangibly stored in a computer storage medium and including computer-executable instructions, the computer-executable instructions when executed by a device cause the device to execute the method according to any one of claims 1 to 9.

Images