Special effect processing method and apparatus, electronic device, and storage medium

By implementing dynamic display and editing of special effects elements in the special effects production tool, the problem that users cannot preview dynamic special effects elements on static template images is solved, and the flexibility of user experience and special effects editing is improved.

WO2025036375A1PCT designated stage expired Publication Date: 2025-02-20BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/111906
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-08-17
Filing Date
2024-08-13
Publication Date
2025-02-20

AI Technical Summary

Technical Problem

During the special effects production process, users cannot preview the display effect of dynamic special effects elements on the static template image, affecting the user's preview experience.

Method used

By providing a special effect processing method, the pending image is acquired in response to the special effect trigger operation, and the special effect preview image is displayed in the target display area. The user can select the special effect element and display the corresponding selected box, and the selected box can update its display position as the special effect element moves.

Benefits of technology

It realizes dynamic display and editing of special effects elements in the special effects preview scene, improves the user's preview experience, and enhances the flexibility of the special effects editing process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024111906_20022025_PF_FP_ABST
    Figure CN2024111906_20022025_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present invention provide a special effect processing method and apparatus, an electronic device, and a storage medium. The method comprises: in response to a special effect triggering operation, acquiring an image to be processed, and displaying in a target display area a special effect preview image corresponding to the image to be processed, wherein at least one special effect element is displayed in the special effect preview image; in response to a selection triggering operation for the special effect element, using the selected special effect element as a target element, and displaying a selection box corresponding to the target element; and upon detecting that the display position of the target element in the target display area changes or the special effect type corresponding to the target element is a preset type, updating the display position of the selection box in the target display area on the basis of the changed display position of the target element. According to the technical solution, in the preview scenario of a special effect, dynamic display and editing of special effect elements are supported, a special effect element to be edited can be identified through a selection box, and the selection box can follow the special effect element.
Need to check novelty before this filing date? Find Prior Art

Description

Special effects processing method, device, electronic device and storage medium

[0001] This application claims priority to the Chinese invention patent application with application number 202311041770.6 filed on August 17, 2023 and titled “Special effects processing method, device, electronic device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present disclosure relate to the field of human-computer interaction technology, and in particular to a special effects processing method, device, electronic device, and storage medium. Background Art

[0003] In image processing or video production scenarios, special effects creation tools are very popular among users. Typically, different types of special effects can be created based on the special effects preview results of the special effects creation tools, and then the created special effects can be applied to the image or video.

[0004] In the related art, when creating special effects based on special effects production work, a static template image is generally used as the input source for the special effects production, and the special effects objects included in the static image are all facing the screen. When the user needs to preview the special effects, the effect of the special effects applied to the template image is displayed.

[0005] However, there are many different types of special effects. In some special effects, special effect elements can move with the movement of the special effect object. The static template image often displays the special effect elements in a static state, which makes it impossible for users to preview the dynamic display effect of the special effect elements during the special effect editing process, affecting the user's preview experience.

[0006] Summary of the Invention

[0007] The embodiments of the present disclosure provide a special effects processing method, device, electronic device and storage medium to realize the dynamic display and editing of special effects elements in a special effects preview scenario, and can mark the special effects elements to be edited in the form of a selection box, and ensure that the selection box can follow the effect of the special effects element to be edited.

[0008] In a first aspect, an embodiment of the present disclosure provides a special effects processing method, the method comprising: in response to a special effects trigger operation, acquiring an image to be processed, and displaying a special effects preview image corresponding to the image to be processed in a target display area, wherein at least one special effects element is displayed in the special effects preview image; in response to a selection trigger operation for the special effects element, taking the selected special effects element as a target element, and displaying a selection box corresponding to the target element; in a case where it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, updating the display position of the selection box in the target display area based on the changed display position of the target element, wherein the shape of the outer contour line of the selection box is a preset shape.

[0009] In a second aspect, an embodiment of the present disclosure further provides a special effects processing device, which includes: a special effects triggering module for acquiring an image to be processed in response to a special effects triggering operation, and displaying a special effects preview image corresponding to the image to be processed in a target display area, wherein at least one special effects element is displayed in the special effects preview image; an element selection module for taking the selected special effects element as a target element in response to a selection triggering operation for the special effects element, and displaying a selection box corresponding to the target element; a display update module for updating the display position of the selection box in the target display area based on the changed display position of the target element when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, wherein the shape of the outer contour line of the selection box is a preset shape.

[0010] In a third aspect, an embodiment of the present disclosure further provides an electronic device comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a special effects processing method as described in any one of the embodiments of the present disclosure.

[0011] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium comprising computer-executable instructions, which, when executed by a computer processor, are used to execute the special effects processing method as described in any one of the embodiments of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0013] FIG1 is a schematic flow chart of a special effects processing method provided by an embodiment of the present disclosure;

[0014] FIG2 is a schematic flow chart of a special effects processing method provided by an embodiment of the present disclosure;

[0015] FIG3 is a schematic flow chart of a special effects processing method provided by an embodiment of the present disclosure;

[0016] FIG4 is a schematic diagram showing a target element and a corresponding selection box displayed in a target display area according to an embodiment of the present disclosure;

[0017] FIG5 is a schematic flow chart of a special effects processing method provided by an embodiment of the present disclosure;

[0018] FIG6 is a schematic structural diagram of a special effects processing device provided by an embodiment of the present disclosure;

[0019] FIG7 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0020] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0021] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0022] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0023] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0024] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0025] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0026] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0027] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0028] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0029] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0030] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions. In addition, during the collection and use of data, the user's personal information will not be collected or processed in a manner that does not reveal the user's identity.

[0031] Before introducing this technical solution, an example of the application scenario can be given. In the case where the input source for special effects production is a dynamic video frame, the special effects added to the special effects object in the dynamic video frame can move with the movement of the special effects object. In this case, the special effects selection box drawn with preset parameters in the related art is difficult to match with the selected special effects; moreover, the related art does not support the editing of special effects in the scenario of dynamic video frames, resulting in the user being unable to preview the display effect of the special effects from multiple angles during the special effects editing process, affecting the user's experience.

[0032] The technical solution of the disclosed embodiment can be applied to a scenario where the selected box corresponding to the special effect element displayed in the special effect preview image is determined when the input source of the special effect production tool is a dynamic video frame. For example, in the process of producing special effect props, the special effect display effect of the special effect prop can be determined based on the special effect preview image, and for any special effect prop added to the special effect object, the selected box corresponding to the special effect prop can be drawn based on the predetermined selected box drawing parameters, so that the user can edit the corresponding special effect prop based on the selected box. However, in the case where the input source of the special effect production is a dynamic video frame, the special effect added to the special effect object in the dynamic video frame can move with the movement of the special effect object, while the selected box cannot move with the movement of the special effect. Therefore, in the scenario of dynamic video frames, it is impossible or difficult to edit the special effect based on the selected box, resulting in the user being unable to preview the display effect of the special effect during the special effect editing process. At this time, based on the technical solution of the embodiment of the present disclosure, when displaying a special effect preview image including at least one special effect element, any special effect element can be selected as the target element, and a check box corresponding to the target element can be displayed. Furthermore, when it is detected that the display position corresponding to the target element has changed, the display position of the check box can be updated according to the updated display position of the target element. Therefore, the effect of dynamic display and editing of special effect elements in the special effect preview scenario is achieved, and the special effect element to be edited can be marked in the form of a check box, and the check box can be guaranteed to follow the special effect element to be edited.

[0033] Before introducing the present technical solution, it should be noted that the device for executing the special effects processing method provided by the embodiment of the present disclosure can be integrated into the application software that currently supports the special effects element processing function, and the software can be installed in an electronic device. Optionally, the electronic device can be a mobile terminal or a PC terminal, etc. The application software can be a type of software that processes special effects elements added to an image. The specific application software will not be described here one by one, as long as the special effects element processing can be realized. It can also be a specially developed application program, which is integrated into the software that realizes the special effects element processing, or it can be integrated into the corresponding page. The user can realize the processing of special effects elements through the page integrated in the PC terminal.

[0034] Figure 1 is a flow chart of a special effects processing method provided by an embodiment of the present disclosure. This embodiment of the present disclosure is applicable to situations where, when a special effect element in a special effect preview image moves, the selection box of the special effect element moves along with the movement of the special effect element. This method can be executed by a special effects processing device, which can be implemented in software and / or hardware. Optionally, it can be implemented by an electronic device, such as a mobile terminal, a PC, or a server.

[0035] As shown in FIG. 1 , the method of this embodiment may specifically include steps S110 , S120 , and S130 .

[0036] S110 . In response to a special effect triggering operation, obtain an image to be processed, and display a special effect preview image corresponding to the image to be processed in a target display area, wherein at least one special effect element is displayed in the special effect preview image.

[0037] In this embodiment, in the application software or application program supporting the special effect processing function, a control for triggering the special effect can be developed in advance. Then, when it is detected that the user triggers the control, the trigger operation can be responded to, thereby obtaining the image to be processed.

[0038] In some embodiments, the image to be processed may be an image that needs to be processed with special effects. Optionally, the image to be processed may be an image captured based on the terminal device, or an image pre-stored by the application software from the storage space. The terminal device may refer to an electronic product with an image capture function, such as a camera, a smart phone, and a tablet computer. In actual applications, when it is detected that a user triggers a special effect operation, the terminal device may be oriented towards the special effect object to realize the acquisition of the image to be processed; or, when it is detected that a user triggers a special effect operation, multiple images associated with the special effect are determined in a specific database, and then one or more of the images may be determined as the image to be processed according to pre-set screening rules.

[0039] It should be noted that the technical solution of this embodiment can be executed while the user is shooting a video, that is, a special effects video can be generated in real time based on the special effects elements selected by the user and the video shot, or the video uploaded by the user can be used as the original data basis to generate a special effects video based on the solution of this embodiment.

[0040] In actual applications, the image to be processed can usually be obtained only when certain special effects operations are triggered. Optionally, the special effects triggering operation may include at least one of the following: triggering special effects props; audio information triggering special effects wake-up words; current body movements are consistent with preset body movements.

[0041] In this embodiment, a control for triggering special effects props can be pre-set. When the user triggers this control, a special effects prop display interface can pop up on the display interface, displaying multiple special effects props. The user can trigger the corresponding special effects prop. When it is detected that the user has triggered the special effects prop corresponding to the image to be processed, it can be indicated that the special effects triggering operation has been triggered. Another implementation method can be to pre-collect the user's audio information and analyze and process the collected audio information. Furthermore, text corresponding to the audio information can be recognized. If the recognized text includes a pre-set wake-up word, for example, a wake-up word such as "Please capture the current image" or "Please enable XX special effects function," it can be indicated that the image to be processed in the display interface can be retrieved. Another implementation method can be to pre-set certain physical movements as special effects triggering actions. When it is detected that the physical movement currently performed by the special effects subject in the terminal device's field of view matches the pre-set physical movement, it can be determined that the special effects operation has been triggered. Optionally, the pre-set physical movement can be raising a hand, opening the mouth, or turning the head.

[0042] In this embodiment, when an image to be processed is acquired, a special effects preview image corresponding to the image to be processed can be displayed in the target display area. In some embodiments, the target display area can be understood as a special effects preview area for performing special effects processing on the image. The special effects preview image can be understood as an image obtained by adding special effects elements to the image to be processed. The special effects preview image displays at least one special effects element. A special effects element can be a special effects prop added to an image or video to make the image or video present a corresponding special effects display effect. It should be noted that the special effects preview image can display one or more special effects elements.

[0043] It should be noted that, in response to a special effect trigger operation, while obtaining the image to be processed, the element identifiers of multiple candidate special effect elements can also be displayed in the special effect display area. In actual application, the user can input a selection trigger operation for a candidate special effect element through an input device. Furthermore, when a selection trigger operation is detected for any candidate special effect element, the candidate special effect element corresponding to the selection trigger operation can be added as a special effect element to the image to be processed. Furthermore, a special effect preview image corresponding to the image to be processed can be obtained and displayed in the target display area.

[0044] S120 : In response to a selection triggering operation on a special effect element, the selected special effect element is used as a target element, and a selection box corresponding to the target element is displayed.

[0045] In this embodiment, each special effect element displayed in the special effect preview image can be set to a selectable state in advance. Then, when the special effect element is a selected special effect element, subsequent processing is performed on the special effect element.

[0046] In actual applications, the selection trigger operation for the special effect element can be any operation acting on the special effect element. Optionally, a click operation for the special effect element. Specifically, when it is detected that the user inputs a click operation on the special effect element displayed in the special effect preview image through an input device or a touch point, the special effect element can be used as the selected special effect element. Then, the special effect element can be subsequently processed. In some embodiments, the click operation can be a single click operation or multiple click operations (such as a double-click operation, etc.). In order to facilitate user operations, the selection trigger operation for the special effect element can also be that when it is detected that the user's pause time on the special effect element based on the input device or touch point reaches a preset time length, the special effect element can be used as the selected special effect element. Then, the special effect element can be subsequently processed.

[0047] In a specific implementation, after the special effect preview image is displayed in the target display area, the user can select from the special effect elements displayed in the special effect preview image. Upon detecting a selection trigger operation for a special effect element input by the user via an input device or a touch point, the user can respond to the selection trigger operation, select the special effect element as the selected special effect element, and set the special effect element as the target element. Furthermore, a check box corresponding to the target element can be determined and displayed in the target display area.

[0048] In some embodiments, the target element can be understood as a special effect element that needs to be processed by special effect editing. The selection box can be understood as a bounding box used to characterize the target element as being in a selected state, and the bounding box can enclose the boundary of the target element. The shape of the outer contour line of the selection box is a preset shape. The preset shape can be any shape, and optionally, the preset shape can be a regular shape. In this embodiment, the shape of the outer contour line of the selection box can be any regular shape. Optionally, a regular shape can at least include a symmetrical shape. A symmetrical shape can be understood as a shape including a central axis of symmetry. Exemplarily, a symmetrical shape can be a rectangle, a circle or other symmetrical shapes. It should be noted that the advantage of the outer contour line of the selection box being a regular shape is that it is convenient for users to perform multi-dimensional editing of special effect elements through the selection box, and it simplifies the amount of computational data in the special effect element editing process, improves the editing efficiency of special effect elements and the special effect display effect of special effect elements.

[0049] In actual applications, when a selection trigger operation is detected for a special effect element, the selection trigger operation can be responded to by selecting the selected special effect element as the target element and displaying a check box corresponding to the target element. Furthermore, the edit state of the target element can be switched to an editable state, and the corresponding edit trigger operation can be input for the target element. Thus, the target element can be edited according to the edit trigger operation.

[0050] Based on this, after displaying the check box corresponding to the target element, the method further includes: editing the target element in response to an edit trigger operation input for the target element.

[0051] In some embodiments, the edit trigger operation can be understood as an edit operation acting on a target element. Optionally, the edit trigger operation can include at least one of a display information adjustment trigger operation, a delete trigger operation, and a replace trigger operation.

[0052] In some embodiments, the display information adjustment trigger operation can be understood as a trigger operation for adjusting the display information of the target element in the target display area. The display information adjustment operation may include any operation for adjusting the display information corresponding to the target element. Optionally, the display information adjustment operation includes at least one of a display size adjustment trigger operation, a display position adjustment trigger operation, and a display color adjustment trigger operation. The display size adjustment trigger operation can be understood as a trigger operation for adjusting the display size of the target element in the target display area. Exemplarily, the display size adjustment trigger operation may include a display size increase trigger operation or a display size decrease trigger operation. The display position adjustment trigger operation can be understood as a trigger operation for adjusting the display position of the target element in the target display area. It should be noted that the display size adjustment trigger operation and the display position adjustment trigger operation can be implemented in a variety of ways, optionally including a drag trigger operation or a parameter change input operation. The display color adjustment trigger operation can be understood as a trigger operation for adjusting the display color of the target element in the target display area.

[0053] In some embodiments, the delete trigger operation can be understood as an operation corresponding to deleting the target element from the target display area. The replace trigger operation can be understood as a trigger operation corresponding to replacing the target element in the selected box.

[0054] In actual applications, after determining a target element and displaying a checkbox corresponding to the target element, an edit trigger operation can be input for the target element. If an edit trigger operation is detected for the target element, a response is performed to the detected edit trigger operation. Furthermore, the target element can be edited based on the edit trigger operation, and the edited target element and a checkbox corresponding to the edited target element are displayed.

[0055] It should be noted that the checkbox corresponding to the target element can also be used to receive user edit operations on the target element, and then the display state of the target element can be updated based on the edit operation. In actual applications, when the checkbox corresponding to the target element is displayed, an element edit operation on the target element can be input into the checkbox. Furthermore, after detecting the element edit operation on the checkbox, the element edit operation can be responded to and the target element can be updated based on the element edit operation.

[0056] In actual applications, the checkbox corresponding to the target element can be used to receive an element edit trigger operation for the target element. Therefore, after displaying the checkbox corresponding to the target element in the target display area, an element edit trigger operation can be input into the displayed checkbox. Furthermore, the target element can be edited based on the input element edit trigger operation.

[0057] Based on this, after displaying the check box corresponding to the target element, the method further includes: in response to a zoom trigger operation input on the check box, zooming the check box and the target element corresponding to the check box.

[0058] In this embodiment, when the check box corresponding to the target element is displayed in the target display area, the check box can be in an editable state, and then, when an edit trigger operation is received for the check box, the check box and the target element corresponding to the check box can be edited.

[0059] In this embodiment, there are multiple ways to generate a zoom trigger operation, such as determining based on a drag trigger operation or determining based on input parameters. Optionally, in response to a zoom trigger operation inputted for a check box, zooming the check box and the target element corresponding to the check box includes: in response to a drag trigger operation inputted for the check box, zooming the check box and the target element corresponding to the check box.

[0060] In some embodiments, a drag-triggered operation for a selected box input may be an operation corresponding to moving any point within the selected box as a starting point within the target display area using an input device (e.g., a mouse). Optionally, the drag-triggered operation may include stretching, compressing, or diagonally stretching or compressing the border of the selected box.

[0061] In practical applications, after displaying a checkbox corresponding to a target element in the target display area, an input device can be used to control the movement of any point within the checkbox within the target display area, starting from a predetermined point within the checkbox. Furthermore, if the point is detected to have paused for a predetermined period of time at any location within the target display area, the location of the pause point can be used as the endpoint, confirming the completion of the drag trigger operation. Furthermore, the checkbox and the target element corresponding to the checkbox can be scaled based on the input drag trigger operation.

[0062] Optionally, in response to a zoom trigger operation input for the selected box, the selected box and the target element corresponding to the selected box are zoomed, including: responding to a zoom editing parameter input for the selected box, and zooming the selected box and the target element corresponding to the selected box based on the zoom editing parameter.

[0063] In some embodiments, the zoom editing parameters can be understood as the parameters that the selected box and the target element corresponding to the selected box rely on during the zooming process, and can also be understood as the parameters used to determine the final effect presented by the selected box and the target element corresponding to the selected box.

[0064] In actual applications, an element editing control can be pre-set. Moreover, when the target element is determined, at least one display attribute parameter corresponding to the check box corresponding to the target element can be obtained. When a trigger operation for the element editing control is detected, the parameter editing page can be displayed based on the display interface. Furthermore, according to the determined special effect element editing requirements, the corresponding scaling editing parameters can be entered in the edit box corresponding to at least one display attribute parameter displayed in the parameter editing page. Thus, the selected box and the target element corresponding to the selected box can be scaled based on the input scaling editing parameters. The advantage of this setting is that the special effect element can be edited based on the check box, thereby simplifying the special effect editing method and improving the special effect editing efficiency.

[0065] For example, it is assumed that the outer contour shape of the selected box corresponding to the target element is a rectangle. When a zoom trigger operation is input to the selected box, any point on the outer contour of the rectangular box can be determined as the zoom trigger starting point through an input device (such as a mouse, etc.) or a touch point, and the symmetry axis corresponding to the zoom trigger starting point in the rectangular box can be determined. The direction corresponding to the symmetry axis can be used as the zoom direction of the selected box. Furthermore, the selected box can be zoomed in the zoom direction. For example, if the zoom trigger starting point is located on the wide border line of the rectangular box, the rectangular box can be zoomed in the direction of the long border line according to the zoom trigger operation.

[0066] It should be noted that the advantage of the symmetrical shape of the outer contour of the selection box is that it facilitates the user to perform multi-dimensional editing of the selection box, reduces the amount of data generated during the editing process, and thus improves the editing response efficiency and editing display effect.

[0067] S130. When it is detected that the display position of the target element in the target display area changes or the special effect type corresponding to the target element is a preset type, update the display position of the selection box in the target display area based on the changed display position of the target element.

[0068] In some embodiments, the display position of the target element in the target display area can be understood as the corresponding position of the target element when displayed in the target display area. Correspondingly, the display position of the check box in the target display area can be understood as the corresponding position of the check box when displayed in the target display area.

[0069] In some embodiments, the preset type can be understood as a predetermined special effect type. The preset type can include multiple special effect types. Optionally, the preset type can include at least a follow-up special effect. The follow-up special effect can be understood as a type of special effect prop that moves along with the movement of the special effect object. The follow-up special effect can include a special effect element that moves along with the movement of the special effect object. The special effect object can be understood as an object to which special effect elements are added in the image to be processed. Optionally, the special effect object can include the user's facial features, the user's limbs, pets, plants or buildings, etc. Exemplarily, the follow-up special effects can include facial effects, AR tracking effects or other follow-up special effect elements, etc.

[0070] In this embodiment, determining whether the display position of a target element in the target display area has changed can include various methods. Optionally, determining whether the display position of the target element in the target display area has changed can include, for each special effects preview image frame, determining the display coordinates of the target element's display position in the current special effects preview image frame, and then determining the display coordinates of the target element's display position in the previous special effects preview image frame. Furthermore, the display coordinates of these two display positions can be compared. If an inconsistency is detected between the two display coordinates, it can be determined that the display position of the target element in the target display area has changed. Alternatively, since the special effects image processing process involved in this embodiment is displayed in the target display area in the form of a camera stream, that is, the acquired image to be processed can be any frame of an already acquired video, and the special effects subject in each frame of the image to be processed may move or undergo changes in physical movements. Therefore, when adding a special effects element to the image to be processed, the type of special effects of the target element can be determined when determining the display position of the target element in the target display area. Furthermore, when the special effect type of the target element is a preset special effect type, it can be determined that the display position of the target element in the target display area has changed. Alternatively, it can be determined that the display position of the target element in the target display area has changed by other means.

[0071] In actual applications, after determining the target element displayed in the special effect preview image, element attribute parameters corresponding to the target element can be obtained. Furthermore, the special effect type corresponding to the target element can be determined based on the obtained element attribute parameters. Furthermore, if the special effect type corresponding to the target element is determined to be a preset type, it can be determined that the display position of the target element in the target display area has changed.

[0072] It should be noted that since the special effect preview image displayed in the target display area can dynamically change as the object being affected by the special effect moves, the target element displayed in the special effect preview image may also change. Based on this, before determining that a change in the display position of the target element in the target display area has been detected, the special effect preview image can be inspected to determine the target element in the special effect preview image. Furthermore, based on the special effect type corresponding to the target element, it can be determined whether the display position of the target element in the target display area has changed.

[0073] In actual applications, after determining the target element and displaying the check box corresponding to the target element in the target display area, the display position of the target element in the target display area can be detected to determine whether the display position of the target element in the target display area has changed. Alternatively, the special effect type corresponding to the target element can be determined to determine whether the special effect type corresponding to the target element is a preset type. Further, when it is detected that the display position of the target element in the target display area has changed, the display position of the target element after the change can be determined. Alternatively, when it is detected that the special effect type corresponding to the target element is a preset type, the display position of the target element after the change can be determined. Furthermore, the display position of the check box in the target display area can be updated according to the display position of the target element after the change. Thereby, the check box can always move with the target element.

[0074] The technical solution of the disclosed embodiment obtains an image to be processed in response to a special effect trigger operation, and displays a special effect preview image corresponding to the image to be processed in a target display area, wherein at least one special effect element is displayed in the special effect preview image, providing a user with an interactive entry for processing the special effect element; further, in response to a selection trigger operation for a special effect element, the selected special effect element is used as the target element, and a check box corresponding to the target element is displayed, supporting editing of the special effect element, and accurately obtaining the special effect element selected by the user and marking it with a check box for user viewing; finally, when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, the display position of the check box in the target display area is updated based on the changed display position of the target element. In this way, the problem of the special effect element moving with the movement of the special effect object in the related art that the user cannot preview the dynamic display effect of the special effect element during the editing process of these special effect elements is solved, and the dynamic display and editing effect of the special effect element in the special effect preview scenario is realized. Furthermore, the special effect element to be edited can be marked in the form of a check box, and the check box can be guaranteed to follow the special effect element to be edited. In addition, the flexibility of the special effect editing process is improved and the diversity of special effect editing methods is enhanced.

[0075] Figure 2 is a flow chart of a special effects processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment is based on the above embodiment. When the special effect type of the target element is detected to be a preset type, it is determined that the display position of the target element in the target display area has changed. For specific implementation methods, please refer to the description of this embodiment. Technical features that are the same or similar to those of the above embodiments are not repeated here.

[0076] As shown in FIG. 2 , the method of this embodiment may specifically include steps S210 , S220 , S230 , S240 , and S250 .

[0077] S210 . In response to a special effect triggering operation, obtain an image to be processed, and display a special effect preview image corresponding to the image to be processed in a target display area, wherein at least one special effect element is displayed in the special effect preview image.

[0078] S220 : In response to a selection triggering operation on a special effect element, the selected special effect element is used as a target element, and a selection box corresponding to the target element is displayed.

[0079] S230: When a special effect frame refresh signal is detected, the special effect preview image is detected to determine a target element in the special effect preview image.

[0080] In some embodiments, the special effect frame refresh signal can be understood as a signal for refreshing the map frame corresponding to the special effect element displayed in the image. It should be noted that the special effect frame refresh signal is for the map frame corresponding to the special effect element displayed in the image. However, the image frame refresh signal can be for the entire image frame. For example, assuming that the special effect elements displayed in the special effect preview image include special effect element 1, special effect element 2 and special effect element 3, when the special effect frame refresh signal is detected, the map frames corresponding to special effect element 1, special effect element 2 and special effect element 3 can be refreshed. When the image frame refresh signal is detected, the special effect preview image frame can be refreshed. It should also be noted that the special effect refresh rate corresponding to the special effect frame refresh signal can be less than or equal to the image refresh rate corresponding to the image frame refresh signal. The advantage of this setting is that when the special effect element is displayed in the image, it can be ensured that the special effect element always moves with the movement of the special effect object, thereby improving the special effect image display effect.

[0081] In this embodiment, the target element in the special effects preview image can be determined in a variety of ways. Optionally, the target element determination method may include checkbox detection or element identification detection. In practical applications, when the target element is determined, a checkbox corresponding to the target element will be displayed in the target display area. Therefore, when a special effects refresh signal is detected, the previous special effects preview image can be inspected to detect each special effects element displayed in that special effects preview image. Furthermore, when a checkbox corresponding to any special effects element is detected in that special effects preview image, that special effects element can be determined as the target element, and the presence of the target element in the special effects preview image can be determined. Alternatively, for the current special effects preview image, in response to a selection trigger operation for a special effects element displayed in the special effects preview image, the selected special effects element is designated as the target element, and a flag corresponding to the target element is set in the image properties corresponding to the special effects preview image. Furthermore, when a special effects refresh signal is detected, the image properties corresponding to the special effects preview image can be obtained, and the obtained image properties can be inspected to determine whether the image properties include a flag corresponding to the target element. Furthermore, if the image attributes include a target element flag, it can be determined that the target element exists in the special effect preview image. Alternatively, the target element in the special effect preview image can be determined by other methods, which are not specifically limited in the present embodiment.

[0082] In practical applications, the special effect frame refresh signal can be detected regularly or periodically. Further, when the special effect frame refresh signal is detected, the special effect preview image can be detected to determine whether the special effect preview image contains the selected special effect element.

[0083] S240: When a target element exists in the special effect preview image, a display position of the target element in the target display area is detected, or a special effect type corresponding to the target element is detected based on a preset type.

[0084] In this embodiment, when it is determined that a selected special effect element exists in the special effect preview image, that is, when a target element exists in the special effect preview image, the display position of the target element in the target display area can be checked to determine whether the display position of the target element in the target display area has changed. Alternatively, when it is determined that a target element exists in the special effect preview image, the special effect type corresponding to the target element can be determined. Furthermore, a preset type can be obtained, and the preset type can be compared with the determined special effect type to determine whether the special effect type corresponding to the target element is the preset type. Therefore, when it is detected that the special effect type corresponding to the target element is the preset type, it can be determined that the display position of the target element in the target display area has changed. The advantage of this setting is that it achieves the effect of refreshing the special effect element selection box when the special effect frame is refreshed, and further, it achieves the effect of ensuring that the selection box can change with the change of the special effect element.

[0085] S250. When it is detected that the display position of the target element in the target display area changes or the special effect type corresponding to the target element is a preset type, update the display position of the selection box in the target display area based on the changed display position of the target element.

[0086] It should be noted that the target element displayed in the special effect preview image can be updated not only based on the special effect change mode corresponding to the special effect element, but also based on the user's editing operation information on the target element. Therefore, before updating the display position of the check box in the target display area based on the target element's changed display position, it is also possible to detect whether the target element is being edited by the user. Furthermore, the basis for updating the display position of the check box in the target display area can be determined based on the detection result.

[0087] In actual applications, users can edit special effects through input devices or touch points. When the user moves or zooms / rotates with two fingers, the interface will be called to update the special effect parameters of the target element, thereby changing the size, position and rotation angle of the target element. However, in the case where the image to be processed is a dynamic video frame, the user's operation will also affect these parameters. Considering that the user's operation should be the main focus in the special effects editing situation. Therefore, it is possible to determine whether the target element is currently in the user operation state. Then, after receiving the special effects frame refresh signal, it can be decided whether to update the parameter changes caused by the algorithm based on the operation state of the target element. If so, the parameter changes caused by the algorithm will not be updated, but the interface will be directly called to update the changes caused by the user operation, thereby achieving the effect that the user operation priority is higher than the special effects element algorithm priority.

[0088] Based on this, before updating the display position of the selection box in the target display area based on the display position after the target element changes, it also includes: determining the operation status of the target element; when the target element is in a state where it is not operated by the user, obtaining the display position of the target element after the change based on the preset change method.

[0089] In some embodiments, the operation state can be understood as the triggering operation of the special effect element by the user. Optionally, the operation state includes a state being operated by the user and a state not being operated by the user. The state being operated by the user can be understood as the state in which the editing operation is currently being triggered by the user, or it can be understood as the state corresponding to when the user is currently inputting an editing trigger operation to the special effect element through an input device. The state not being operated by the user can be understood as the state in which the editing operation is not currently triggered by the user. The preset change mode can be understood as a preset special effect change mode corresponding to the special effect element. The preset change mode is associated with the special effect type corresponding to the target element. In actual applications, when determining special effect elements of different special effect types, the special effect change mode corresponding to the special effect element of each special effect type can be pre-determined. Furthermore, the preset change mode corresponding to the special effect element of each special effect type can be obtained, and the preset change mode can be associated with the special effect type to determine the mapping between the special effect type and the preset change mode.

[0090] In this embodiment, there are multiple ways to determine the operating state of the target element. Optionally, element attribute parameters corresponding to the target element can be obtained, and the element attribute parameters can include operating state attribute parameters. Furthermore, the operating state of the target element can be determined based on the obtained operating state attribute parameters. Alternatively, user gesture detection can be performed on the target element to determine whether the target element is in a user gesture editing state. Furthermore, the operating state of the target element can be determined based on the judgment result. Alternatively, the operating state of the target element can also be determined by other methods, which are not specifically limited in the embodiments of the present disclosure.

[0091] In actual applications, when it is determined that the display position of the target element in the target display area has changed, the operation state of the target element can be determined. Furthermore, when it is determined that the target element is in a state where it is not operated by the user, the preset change method corresponding to the target element can be obtained according to the special effect type of the target element. Then, the target element can be processed according to the preset change method to determine the display position of the target element after the change. Then, the display position of the target element after the change can be obtained, and the display position of the selection box in the target display area can be updated based on the display position of the target element after the change. The advantage of this setting is that it realizes that the selection box can change based on the change of the special effect element, thereby improving the update flexibility of the selection box.

[0092] In practical applications, to enhance user experience and meet user editing needs for special effect elements, if the target element is determined to be in the user-operated state, the user's editing operation on the target element can be used as the priority for display position change. Furthermore, the display position of the target element after the change can be determined based on the user's editing operation on the target element.

[0093] Optionally, after determining the operation state of the target element, the method further includes: when the target element is in a state of being operated by the user, acquiring a changed display position of the target element based on user operation information.

[0094] In some embodiments, user operation information can be understood as information obtained after a user performs an edit operation on a target element. In actual applications, after determining the target element in the special effect preview image and displaying the corresponding checkbox in the target display area, the user can input an edit trigger operation on the checkbox via an input device or touch point. Furthermore, user operation information can be generated based on the received edit trigger operation.

[0095] In actual applications, when it is determined that the target element is being operated by the user, the edit trigger operation of the selected box of the target element can be detected. Then, the detected edit trigger operation can be responded to and user operation information can be generated. Therefore, the display position of the target element after the change can be determined based on the user operation information. The advantage of this setting is that it realizes the effect of achieving the effect of user operation priority over the special effect change algorithm priority, ensuring that the special effect editing situation is mainly based on user operation, and improving the user's editing experience of special effect elements.

[0096] The technical solution of the embodiment of the present disclosure obtains a to-be-processed image in response to a special effect trigger operation, and displays a special effect preview image corresponding to the to-be-processed image in a target display area, wherein at least one special effect element is displayed in the special effect preview image; further, in response to a selection trigger operation for the special effect element, the selected special effect element is used as the target element, and a check box corresponding to the target element is displayed; further, when a special effect refresh frame signal is detected, the special effect preview image is detected to determine the target element in the special effect preview image; when the target element exists in the special effect preview image, the display position of the target element in the target display area is detected, or the special effect type corresponding to the target element is detected based on a preset type; finally, when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, the display position of the check box in the target display area is updated based on the changed display position of the target element. In this way, the effect of determining whether the display position of the target element has changed based on the special effect type of the target element is achieved, thereby improving the efficiency of detecting changes in the display position of the target element and, in turn, improving the efficiency of updating the display position of the check box.

[0097] Figure 3 is a flowchart of a special effects processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment, based on the above-mentioned embodiment, draws and displays a check box corresponding to the target element based on the screen display coordinates and screen rotation angle corresponding to at least one key point of the target element. For specific implementation methods, please refer to the description of this embodiment. Technical features that are the same or similar to those of the above-mentioned embodiments are not repeated here.

[0098] As shown in FIG3 , the method of this embodiment may specifically include steps S310 , S320 , S330 , S340 , and S350 .

[0099] S310: In response to a special effect triggering operation, obtain an image to be processed, and display a special effect preview image corresponding to the image to be processed in a target display area, wherein at least one special effect element is displayed in the special effect preview image.

[0100] S320: In response to a selection trigger operation on a special effect element, the selected special effect element is used as a target element, at least one element key point corresponding to the target element is determined, and the screen display coordinates corresponding to the element key point are determined.

[0101] In some embodiments, the element key point can be understood as the key point corresponding to the special effect element in the model space, and the key point can be used to construct the special effect model of the special effect element in the model space. It should be noted that the element key point can be located on the outer contour of the target element, or outside the outer contour of the target element, or inside the outer contour of the target element, etc. The position of the element key point is associated with the shape and size of the determined selection box. It should also be noted that the element key point corresponding to the target element can be used to construct the selection box corresponding to the target element. Therefore, the number of element key points corresponding to the target element can correspond to the outer contour shape of the selection box corresponding to the target element. The number of element key points corresponding to the target element can be one or more. Optionally, the number of element key points can be 4. For example, when the shape of the selection box corresponding to the target element is a rectangle, the number of element key points corresponding to the target element can be 4. The screen display coordinates can be understood as the coordinate information of the element key point in the screen space, and can also be understood as the position information of the element key point displayed on the screen. The screen display coordinates can be

[0102] In practical applications, once a target element is identified, the element raw data corresponding to the target element can be obtained. Furthermore, at least one element key point corresponding to the target element can be determined based on the element attribute parameters of the target element and a predetermined selection box shape. Furthermore, the three-dimensional coordinates of the element key point in model space can be obtained from the acquired element raw data, and the three-dimensional coordinates of the key point can be converted to screen display coordinates based on the coordinate conversion relationship between model space and screen space. Thus, the mapping of element key points from three-dimensional model space to two-dimensional screen space can be completed.

[0103] S330: Determine the screen rotation angle corresponding to the target element.

[0104] In some embodiments, the screen rotation angle can be understood as the rotation angle of the target element in the three-dimensional model space. In this embodiment, the screen rotation angle can at least include the roll angle (i.e., the Roll angle) in the Euler angle. Those skilled in the art will understand that the Euler angle is a set of three independent angular parameters used to determine the position of a fixed-point rotating rigid body, consisting of a pitch angle, a yaw angle, and a roll angle. The roll angle included in the screen rotation angle can be understood as the angle obtained by rotating the target element counterclockwise or clockwise in a plane perpendicular to the screen with the midline of the plane as the axis.

[0105] In practical applications, the display position of the target element in the target display area can change dynamically. Therefore, during the display position change process of the target element, for each display position change moment, the screen rotation angle corresponding to the current display position change moment can be determined based on the original element data of the target element. Thus, the screen rotation angle corresponding to the target element can be obtained.

[0106] S340: Draw a check box corresponding to the target element based on the screen display coordinates and the screen rotation angle, and display the check box.

[0107] In this embodiment, after the screen display coordinates and the screen rotation angle corresponding to the target element are obtained, the selection box corresponding to the target element can be determined and drawn based on the screen display coordinates and the screen rotation angle.

[0108] In practical applications, after determining the screen display coordinates and screen rotation angle of the key point of the target element, multiple candidate bounding boxes can be determined based on the determined screen display coordinates, each of which can correspond to a candidate rotation angle. Furthermore, based on the determined screen rotation angle, a candidate bounding box with a candidate rotation angle that matches the screen rotation angle can be selected from the multiple candidate bounding boxes. Furthermore, based on the selected candidate bounding box, a selected box corresponding to the target element can be determined.

[0109] It should be noted that since the selected box corresponding to the target element can be a border surrounding the target element, when determining the selected box corresponding to the target element, the minimum bounding box corresponding to the target element can be determined first. Then, the selected box corresponding to the target element can be determined based on the minimum bounding box.

[0110] Optionally, drawing a selection box corresponding to the target element based on the screen display coordinates and the screen rotation angle includes: drawing a minimum enclosing box corresponding to the target element based on the screen display coordinates and the screen rotation angle, and determining the selection box corresponding to the target element based on the minimum enclosing box.

[0111] In some embodiments, the minimum bounding box can be understood as a frame with the smallest size that can enclose the target element, or can be understood as a bounding box that is closest to the boundary of the target element.

[0112] In practical applications, when the screen display coordinates corresponding to the target element are obtained, the screen display coordinates corresponding to each element key point include a horizontal coordinate and a vertical coordinate. Furthermore, the maximum horizontal coordinate, minimum horizontal coordinate, maximum vertical coordinate, and minimum vertical coordinate can be determined from the screen display coordinates corresponding to at least one element key point. Furthermore, a straight line can be drawn through the element key point with the maximum horizontal coordinate toward the horizontal axis of the screen space coordinate system; through the element key point with the minimum horizontal coordinate toward the horizontal axis of the screen space coordinate system; through the element key point with the maximum vertical coordinate toward the vertical axis of the screen space coordinate system; and through the element key point with the minimum vertical coordinate toward the vertical axis of the screen space coordinate system. Because the rotation direction of the drawn straight lines through the element key points is not determined, multiple candidate boxes with different rotation angles can be obtained. Furthermore, the screen rotation angle corresponding to the target element can be obtained, and based on the screen rotation angle, a candidate box matching the screen rotation angle can be determined from the multiple candidate boxes. The determined candidate box is then used as the minimum bounding box corresponding to the target element. Furthermore, a selected box corresponding to the target element can be determined based on the minimum bounding box. The advantage of this setting is that no matter what screen rotation angle the target element is at, it ensures that the check box always surrounds the target element. For example, Figure 4 is a schematic diagram of the target element and the corresponding check box displayed in the target display area. As shown in Figure 4, the user's head can be used as the object of the special effect, the star glasses special effect can be used as the target element, and the border surrounding the star glasses special effect is the check box. When the user's head moves to the side facing the screen, the star glasses special effect will also move with the user's face. At this time, the screen display coordinates and screen rotation angle corresponding to the star glasses special effect can be determined. Furthermore, the check box corresponding to the moved star glasses special effect can be drawn according to the determined screen display coordinates and screen rotation angle. Therefore, it is possible to achieve the effect of ensuring that the corresponding check box always surrounds the target element when the target element is not facing the screen head-on.

[0113] In actual applications, there may be multiple ways to determine the check box corresponding to the target element, and each of the ways will be described below.

[0114] The first method may be to use the minimum bounding box as the selection box corresponding to the target element.

[0115] In practical applications, after determining the minimum bounding box corresponding to the target element, the minimum bounding box can be directly used as the selection box corresponding to the target element.

[0116] The second method may be: scaling the minimum bounding box according to a preset ratio, and using the scaled minimum bounding box as the selection box corresponding to the target element.

[0117] In some embodiments, the preset ratio can be understood as a preset border scaling ratio. The preset ratio can be any value. The preset ratio can be the ratio between the border size of the minimum bounding box and the border size of the selected box. For example, if the preset ratio is 1:2, the border size of the minimum bounding box can be doubled, and the enlarged minimum bounding box can be used as the selected box corresponding to the target element.

[0118] In this embodiment, the preset ratio can be determined in a variety of ways, such as by database retrieval or real-time editing. Optionally, the preset ratio can be associated with the special effect type of the special effect element. Different preset ratios can be determined for special effect elements of different special effect types, and a mapping between the special effect type and the preset ratio can be established and stored in a relevant database. Furthermore, after obtaining the target element, the corresponding preset ratio can be retrieved from the relevant database based on the special effect type of the target element, and the minimum bounding box can be scaled based on the retrieved preset ratio. Alternatively, a scaling ratio setting control can be pre-set, and then, upon detecting a trigger operation for the control, a scaling setting page can be displayed in the target display area, the scaling setting page including scaling settings items. Furthermore, in response to an edit trigger operation for the scaling settings items, the preset ratio is retrieved. Furthermore, the minimum bounding box can be scaled based on the retrieved preset ratio. Alternatively, the preset ratio for scaling the minimum bounding box can be obtained through other methods, which are not specifically limited in the present embodiment.

[0119] In practical applications, after obtaining the minimum bounding box corresponding to the target element, the preset ratio corresponding to the target element can be determined. Then, the minimum bounding box can be scaled according to the determined preset ratio, and the scaled minimum bounding box can be used as the selection box corresponding to the target element.

[0120] A third method may be to determine an inscribed circle or a circumscribed circle of a minimum bounding box as a selection box corresponding to the target element.

[0121] In some embodiments, the inscribed circle may be a circle that is tangent to each border of the minimum bounding box, and the circumscribed circle may be a circle that intersects each vertex of the minimum bounding box.

[0122] In practical applications, to facilitate user editing of the target element based on the checkbox, the checkbox corresponding to the target element can be set to a circular shape. If the checkbox is circular, after obtaining the minimum bounding box corresponding to the target element, the inscribed circle or circumscribed circle of the minimum bounding box can be determined. The determined inscribed circle or circumscribed circle can then be used as the checkbox corresponding to the target element.

[0123] A fourth method may be: using the target pixel point in the minimum bounding box as the center point of the border, and using a preset distance as the border radius; and determining a selection box corresponding to the target element based on the border center point and the border radius.

[0124] In some embodiments, the target pixel point can be understood as any pixel point located within the minimum bounding box. For example, the target pixel point can be the center point of the minimum bounding box. The preset distance can be a preset border construction distance. The preset distance can be any value.

[0125] In practical applications, after obtaining the minimum bounding box corresponding to the target element, you can arbitrarily select a pixel within the minimum bounding box as the target pixel, and use the target pixel as the center point of the bounding box. Next, you can obtain a preset distance and use the preset distance as the bounding box radius. Then, you can draw a bounding box with the bounding box center as the center point and the bounding box radius as the radius, and use the drawn bounding box as the selection box corresponding to the target element.

[0126] It should be noted that the advantages of using multiple methods to determine the selected box are: enhancing the diversity of the selected box and improving the flexibility of determining the selected box.

[0127] S350. When it is detected that the display position of the target element in the target display area changes or the special effect type corresponding to the target element is a preset type, update the display position of the selection box in the target display area based on the changed display position of the target element.

[0128] The technical solution of the disclosed embodiment obtains an image to be processed in response to a special effect trigger operation, and displays a special effect preview image corresponding to the image to be processed in a target display area, wherein at least one special effect element is displayed in the special effect preview image; then, in response to a selection trigger operation for the special effect element, the selected special effect element is used as the target element, at least one element key point corresponding to the target element is determined, the screen display coordinates corresponding to the element key point are determined, and the screen rotation angle corresponding to the target element is determined; further, a check box corresponding to the target element is drawn based on the screen display coordinates and the screen rotation angle, and the check box is displayed; finally, when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, the display position of the check box in the target display area is updated based on the changed display position of the target element. In this way, the effect of drawing a check box that can surround the special effect element in a two-dimensional screen space is achieved. Furthermore, the check box is ensured to always change with changes in the special effect element.

[0129] FIG5 is a flow chart of a special effects processing method provided by an embodiment of the present disclosure. This embodiment of the present disclosure is an optional embodiment of the above-mentioned embodiments. As shown in FIG5, the method of the embodiment of the present disclosure may include the following steps.

[0130] 1. For the special effects engine layer, when it is determined that the special effects frame refresh time has been reached, a special effects frame refresh signal can be sent based on the script;

[0131] 2. For the special effects editing layer, the frame refresh signal is detected periodically or regularly. When a special effects frame refresh signal is detected, the detected special effects frame refresh signal can be modified into a signal detectable by the client and the modified signal can be forwarded to the client;

[0132] 3. For the client, when receiving the special effect frame refresh signal, the special effect preview image is detected to determine whether the special effect preview image includes the selected special effect element, that is, the target element. If so, step 4 is executed;

[0133] 4. Determine whether the special effect type of the target element is a follow-up special effect. If so, proceed to step 5;

[0134] 5. Determine whether the target element is currently being operated by the user. If so, proceed to step 6; if not, proceed to step 7.

[0135] 6. Prioritize processing the user's operation information on the target element, and obtain the changed display position of the target element based on the operation information;

[0136] 7. Refresh the special effect data of the current editing layer according to the preset change method corresponding to the target element. Then, the display position of the target element after the change can be obtained;

[0137] 8. For the special effects editing layer, obtain the original data corresponding to the target element from the special effects engine layer. The original data may include the 3D world coordinates, size, and Euler angle data of at least one key point of the target element;

[0138] 9. Based on the mapping relationship between the world coordinate system and the screen coordinate system, the three-dimensional world coordinates of the key points of the element are converted into screen display coordinates;

[0139] 10. Calculate the minimum bounding box based on the screen display coordinates and the roll angle in the Euler angle data;

[0140] 11. For the client, a selection box corresponding to the target element can be drawn based on the minimum bounding box.

[0141] It should be noted that the special effects engine layer, special effects editing layer and client can be different application layers all deployed in the same terminal device; or they can be application layers deployed in different terminal devices respectively, and each terminal device is interconnected.

[0142] The technical solution of the disclosed embodiment obtains an image to be processed in response to a special effect trigger operation, and displays a special effect preview image corresponding to the image to be processed in a target display area, wherein at least one special effect element is displayed in the special effect preview image, providing a user with an interactive entry for processing the special effect element; further, in response to a selection trigger operation for a special effect element, the selected special effect element is used as the target element, and a check box corresponding to the target element is displayed, supporting editing of the special effect element, and accurately obtaining the special effect element selected by the user and marking it with a check box for user viewing; finally, when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, the display position of the check box in the target display area is updated based on the changed display position of the target element. In this way, the problem of the special effect element moving with the movement of the special effect object in the related art that the user cannot preview the dynamic display effect of the special effect element during the editing process of these special effect elements is solved, and the dynamic display and editing effect of the special effect element in the special effect preview scenario is realized. Furthermore, the special effect element to be edited can be marked in the form of a check box, and the check box can be guaranteed to follow the special effect element to be edited. In addition, the flexibility of the special effect editing process is improved and the diversity of special effect editing methods is enhanced.

[0143] FIG6 is a schematic structural diagram of a special effect processing device provided by an embodiment of the present disclosure. As shown in FIG6 , the device includes: a special effect triggering module 410 , an element selecting module 420 and a display updating module 430 .

[0144] In some embodiments, the special effects trigger module 410 is used to obtain an image to be processed in response to a special effects trigger operation, and display a special effects preview image corresponding to the image to be processed in a target display area, wherein at least one special effects element is displayed in the special effects preview image. The element selection module 420 is used to, in response to a selection trigger operation for the special effects element, use the selected special effects element as a target element and display a check box corresponding to the target element. The display update module 430 is used to update the display position of the check box in the target display area based on the changed display position of the target element when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, wherein the shape of the outer contour line of the check box is a preset shape.

[0145] On the basis of the above technical solutions, the device further includes: an image detection module and a special effect type determination module.

[0146] An image detection module is used to detect the special effect preview image when a special effect frame refresh signal is detected, before it is determined that the display position of the target element in the target display area has changed, when the special effect type corresponding to the target element is detected to be a preset type, to determine the target element in the special effect preview image.

[0147] The special effect type determination module is used to detect the display position of the target element in the target display area when the target element exists in the special effect preview image, or to detect the special effect type corresponding to the target element based on a preset type.

[0148] On the basis of the above technical solutions, the device further includes: an editing trigger operation response module.

[0149] An edit trigger operation response module is configured to edit the target element in response to an edit trigger operation input for the target element after the check box corresponding to the target element is displayed. The edit trigger operation includes at least one of a display information adjustment trigger operation, a delete trigger operation, and a replace trigger operation. The display information adjustment operation includes at least one of a display size adjustment trigger operation, a display position adjustment trigger operation, and a display color adjustment trigger operation.

[0150] On the basis of the above technical solutions, the device further includes: an operation state determination module and a display position first acquisition module.

[0151] An operation status determination module is used to determine the operation status of the target element, wherein the operation status includes a state being operated by the user and a state not being operated by the user; a display position first acquisition module is used to obtain the display position of the target element after the target element is changed based on a preset change method when the target element is in the state not being operated by the user, wherein the preset change method is associated with the special effect type corresponding to the target element.

[0152] On the basis of the above technical solutions, the device further includes: a second display position acquisition module.

[0153] The second display position acquisition module is configured to acquire the changed display position of the target element based on user operation information when the target element is in the state of being operated by the user.

[0154] On the basis of the above technical solutions, the element selection module 420 includes: a key point determination unit, a rotation angle determination unit, and a selection box drawing unit.

[0155] A key point determination unit is used to determine at least one element key point corresponding to the target element, and determine the screen display coordinates corresponding to the element key point.

[0156] The rotation angle determining unit is configured to determine a screen rotation angle corresponding to the target element, wherein the screen rotation angle at least includes a roll angle in the Euler angle.

[0157] A selection box drawing unit is configured to draw a selection box corresponding to the target element based on the screen display coordinates and the screen rotation angle, and display the selection box.

[0158] On the basis of the above technical solutions, the selected box drawing unit includes: a minimum bounding box drawing sub-unit.

[0159] The minimum bounding box drawing subunit is used to draw a minimum bounding box corresponding to the target element based on the screen display coordinates and the screen rotation angle, and determine a selection box corresponding to the target element based on the minimum bounding box.

[0160] Based on the above technical solutions, the minimum enclosing box drawing sub-unit is used to perform at least one of the following operations: using the minimum enclosing box as the selection box corresponding to the target element; scaling the minimum enclosing box according to a preset ratio, and using the scaled minimum enclosing box as the selection box corresponding to the target element; determining the inscribed circle or circumscribed circle of the minimum enclosing box as the selection box corresponding to the target element.

[0161] On the basis of the above technical solutions, the device further includes: an element scaling processing module.

[0162] The element zoom processing module is used to perform zoom processing on the selection box and the target element corresponding to the selection box in response to a zoom trigger operation input for the selection box.

[0163] On the basis of the above technical solutions, the preset shape is a regular shape, and the regular shape at least includes a symmetrical shape.

[0164] On the basis of the above technical solutions, the preset types include at least follow-up special effects, and the follow-up special effects include special effect elements that move along with the movement of the special effect object.

[0165] The technical solution of the disclosed embodiment obtains an image to be processed in response to a special effect trigger operation, and displays a special effect preview image corresponding to the image to be processed in a target display area, wherein at least one special effect element is displayed in the special effect preview image, providing a user with an interactive entry for processing the special effect element; further, in response to a selection trigger operation for a special effect element, the selected special effect element is used as the target element, and a check box corresponding to the target element is displayed, supporting editing of the special effect element, and accurately obtaining the special effect element selected by the user and marking it with a check box for user viewing; finally, when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, the display position of the check box in the target display area is updated based on the changed display position of the target element. In this way, the problem of the special effect element moving with the movement of the special effect object in the related art that the user cannot preview the dynamic display effect of the special effect element during the editing process of these special effect elements is solved, and the dynamic display and editing effect of the special effect element in the special effect preview scenario is realized. Furthermore, the special effect element to be edited can be marked in the form of a check box, and the check box can be guaranteed to follow the special effect element to be edited. In addition, the flexibility of the special effect editing process is improved and the diversity of special effect editing methods is enhanced.

[0166] The special effects processing device provided by the embodiments of the present disclosure can execute the special effects processing method provided by any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method.

[0167] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0168] FIG7 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Referring to FIG7 , a schematic diagram of the structure of an electronic device (such as a terminal device or server in FIG7 ) 500 suitable for implementing an embodiment of the present disclosure is shown below. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG7 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0169] As shown in FIG7 , the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.

[0170] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 7 shows the electronic device 500 with various devices, it should be understood that not all of the devices shown are required to be implemented or present. More or fewer devices may alternatively be implemented or present.

[0171] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0172] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0173] The electronic device provided by the embodiment of the present disclosure and the special effects processing method provided by the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0174] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon. When the program is executed by a processor, the special effect processing method provided in the above embodiment is implemented.

[0175] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0176] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0177] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0178] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: responds to a special effect trigger operation, obtains an image to be processed, and displays a special effect preview image corresponding to the image to be processed in a target display area, wherein at least one special effect element is displayed in the special effect preview image; responds to a selection trigger operation for the special effect element, takes the selected special effect element as the target element, and displays a selection box corresponding to the target element; when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, updates the display position of the selection box in the target display area based on the changed display position of the target element, wherein the shape of the outer contour line of the selection box is a preset shape.

[0179] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0180] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0181] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0182] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0183] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0184] According to one or more embodiments of the present disclosure, [Example 1] provides a special effects processing method, the method comprising: in response to a special effects trigger operation, acquiring an image to be processed, and displaying a special effects preview image corresponding to the image to be processed in a target display area, wherein at least one special effects element is displayed in the special effects preview image; in response to a selection trigger operation for the special effects element, taking the selected special effects element as a target element, and displaying a selection box corresponding to the target element; upon detecting that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, updating the display position of the selection box in the target display area based on the changed display position of the target element, wherein the shape of the outer contour line of the selection box is a preset shape.

[0185] According to one or more embodiments of the present disclosure, [Example 2] provides the method of Example 1, further including: optionally, before updating the display position of the selection box in the target display area based on the display position after the change of the target element, it also includes: when a special effect frame refresh signal is detected, detecting the special effect preview image to determine the target element in the special effect preview image; when the target element exists in the special effect preview image, detecting the display position of the target element in the target display area, or, detecting the special effect type corresponding to the target element based on a preset type.

[0186] According to one or more embodiments of the present disclosure, [Example Three] provides the method of Example One, further including: optionally, after the display of the check box corresponding to the target element, it also includes: in response to an edit trigger operation input for the target element, editing the target element, wherein the edit trigger operation includes at least one of a display information adjustment trigger operation, a deletion trigger operation, and a replacement trigger operation, and the display information adjustment operation includes at least one of a display size adjustment trigger operation, a display position adjustment trigger operation, and a display color adjustment trigger operation.

[0187] According to one or more embodiments of the present disclosure, [Example 4] provides the method of Example 1, further including: optionally, before updating the display position of the selection box in the target display area based on the display position of the target element after the change, it also includes: determining the operation state of the target element, wherein the operation state includes a state being operated by the user and a state not being operated by the user; when the target element is in the state not being operated by the user, obtaining the display position of the target element after the change based on a preset change method, wherein the preset change method is associated with the special effect type corresponding to the target element.

[0188] According to one or more embodiments of the present disclosure, [Example 5] provides the method of Example 4, further including: optionally, after determining the operation status of the target element, further including: when the target element is in the state of being operated by the user, obtaining the display position of the target element after the change based on the user operation information.

[0189] According to one or more embodiments of the present disclosure, [Example Six] provides the method of Example One, further including: optionally, displaying a check box corresponding to the target element includes: determining at least one element key point corresponding to the target element, and determining the screen display coordinates corresponding to the element key point; determining the screen rotation angle corresponding to the target element, wherein the screen rotation angle includes at least the roll angle in the Euler angle; drawing the check box corresponding to the target element based on the screen display coordinates and the screen rotation angle, and displaying the check box.

[0190] According to one or more embodiments of the present disclosure, [Example 7] provides the method of Example 6, further including: optionally, drawing a selection box corresponding to the target element based on the screen display coordinates and the screen rotation angle includes: drawing a minimum enclosing box corresponding to the target element based on the screen display coordinates and the screen rotation angle, and determining the selection box corresponding to the target element based on the minimum enclosing box.

[0191] According to one or more embodiments of the present disclosure, [Example 8] provides the method of Example 7, further including: optionally, determining the selection box corresponding to the target element based on the minimum enclosing box includes at least one of the following operations: using the minimum enclosing box as the selection box corresponding to the target element; scaling the minimum enclosing box according to a preset ratio, and using the scaled minimum enclosing box as the selection box corresponding to the target element; determining the inscribed circle or circumscribed circle of the minimum enclosing box as the selection box corresponding to the target element.

[0192] According to one or more embodiments of the present disclosure, [Example 9] provides the method of Example 1, further including: optionally, after the display of the check box corresponding to the target element, it also includes: in response to a zoom trigger operation input for the check box, scaling the check box and the target element corresponding to the check box.

[0193] According to one or more embodiments of the present disclosure, [Example 10] provides the method of Example 1, further including: optionally, the preset shape is a regular shape, and the regular shape at least includes a symmetrical shape.

[0194] According to one or more embodiments of the present disclosure, [Example 11] provides the method of Example 1, further including: optionally, the preset type includes at least a follow-up special effect, and the follow-up special effect includes a special effect element that moves along with the movement of the special effect object.

[0195] According to one or more embodiments of the present disclosure, [Example 12] provides a special effects processing device, which includes: a special effects triggering module for acquiring an image to be processed in response to a special effects triggering operation, and displaying a special effects preview image corresponding to the image to be processed in a target display area, wherein at least one special effects element is displayed in the special effects preview image; an element selection module for taking the selected special effects element as a target element in response to a selection triggering operation for the special effects element, and displaying a selection box corresponding to the target element; a display update module for updating the display position of the selection box in the target display area based on the changed display position of the target element when detecting that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, wherein the shape of the outer contour line of the selection box is a preset shape.

[0196] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0197] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0198] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A special effects processing method, comprising: In response to the special effect triggering operation, an image to be processed is acquired, and a special effect preview image corresponding to the image to be processed is displayed in a target display area, wherein at least one special effect element is displayed in the special effect preview image; In response to a selection trigger operation on the special effect element, taking the selected special effect element as a target element, and displaying a selection box corresponding to the target element; When it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, the display position of the selection box in the target display area is updated based on the changed display position of the target element, wherein the shape of the outer contour line of the selection box is a preset shape.

2. The special effect processing method according to claim 1, wherein: Before updating the display position of the check box in the target display area based on the changed display position of the target element, the method further includes: In the case where a special effect frame refresh signal is detected, detecting the special effect preview image to determine a target element in the special effect preview image; In the case where the target element exists in the special effect preview image, the display position of the target element in the target display area is detected, or the special effect type corresponding to the target element is detected based on a preset type.

3. The special effect processing method according to claim 1, wherein: After displaying the check box corresponding to the target element, the method further includes: In response to an edit trigger operation inputted for the target element, editing the target element, Among them, the editing trigger operation includes at least one of a display information adjustment trigger operation, a deletion trigger operation and a replacement trigger operation, and the display information adjustment operation includes at least one of a display size adjustment trigger operation, a display position adjustment trigger operation and a display color adjustment trigger operation.

4. The special effect processing method according to claim 1, wherein: Before updating the display position of the check box in the target display area based on the changed display position of the target element, the method further includes: Determine the operation state of the target element, wherein the operation state includes a state of being operated by a user and a state of not being operated by a user; When the target element is in the state of being operated by the user, the changed display position of the target element is acquired based on the user operation information.

5. The special effect processing method according to claim 4, wherein: After determining the operation state of the target element, the method further includes: When the target element is in the state where no user operation is performed, a display position of the target element after the change based on a preset change mode is obtained, wherein the preset change mode is associated with a special effect type corresponding to the target element.

6. The special effect processing method according to claim 1, wherein: The displaying a check box corresponding to the target element includes: Determine at least one element key point corresponding to the target element, and determine the screen display coordinates corresponding to the element key point; Determine a screen rotation angle corresponding to the target element, wherein the screen rotation angle at least includes a roll angle in the Euler angle; Draw the selection corresponding to the target element based on the screen display coordinates and the screen rotation angle The selected box is displayed.

7. The special effect processing method according to claim 6, wherein: Drawing a check box corresponding to the target element based on the screen display coordinates and the screen rotation angle includes: A minimum enclosing box corresponding to the target element is drawn based on the screen display coordinates and the screen rotation angle, and a selection box corresponding to the target element is determined based on the minimum enclosing box.

8. The special effect processing method according to claim 7, wherein: The determining, based on the minimum bounding box, a selected box corresponding to the target element comprises at least one of the following operations: Using the minimum bounding box as a selected box corresponding to the target element; Scaling the minimum bounding box according to a preset ratio, and using the scaled minimum bounding box as a selected box corresponding to the target element; An inscribed circle or a circumscribed circle of the minimum bounding box is determined as a selected box corresponding to the target element.

9. The special effect processing method according to claim 1, wherein: After displaying the check box corresponding to the target element, the method further includes: In response to a zoom trigger operation input for the selection box, the selection box and the target element corresponding to the selection box are zoomed.

10. The special effect processing method according to claim 1, wherein: The preset shape is a regular shape, and the regular shape at least includes a symmetrical shape.

11. The special effect processing method according to claim 1, wherein: The preset types at least include follow-up special effects, and the follow-up special effects include special effect elements that move along with the movement of the special effect object.

12. A special effects processing device, comprising: The special effect trigger module is used to obtain the image to be processed in response to the special effect trigger operation, and display the special effect preview image corresponding to the image to be processed in the target display area, wherein the special effect preview image At least one special effect element is shown in the image; An element selection module, for responding to a selection trigger operation on the special effect element, taking the selected special effect element as a target element, and displaying a selection box corresponding to the target element; A display update module is used to update the display position of the selection box in the target display area based on the changed display position of the target element when it is detected that the display position of the target element in the target display area has changed or the special effect type corresponding to the target element is a preset type, wherein the shape of the outer contour line of the selection box is a preset shape.

13. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the special effect processing method as described in any one of claims 1-11.

14. A storage medium comprising computer executable instructions, wherein the computer executable instructions are used to execute the special effect processing method according to any one of claims 1 to 11 when executed by a computer processor.

Citation Information

Patent Citations

  • Special effect transforming method of video image

    CN101227568A

  • Image special effect generation method, device and electronic device

    CN109064387A

  • Target tracking and semantic segmentation method and device for sports video, and plug-in

    CN112347852A

  • Method and device for generating special effect video, electronic equipment and storage medium

    CN114531553A

  • Special effect display method and device, equipment and storage medium

    CN115174985A