Special effect processing method and apparatus, and electronic device and storage medium
By introducing special effect material editing and target prospect information processing into special effect processing technology, the problems of monotonous and poor interactivity in the existing technology are solved, and more rich and flexible special effect processing effects are achieved.
Patent Information
- Application Number
- PCT/CN2024/132317
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-05
- Filing Date
- 2024-11-15
- Publication Date
- 2025-06-12
AI Technical Summary
In the existing special effect processing technology, there is a fixed mapping relationship between the special effect props and the special effect elements, resulting in the special effect being relatively monotonous, lacking interest and interactivity. The changes in the special effect elements depend on new special effect props or re-editing, and the implementation method is complex.
Provides a special effect processing method, which displays the special effect editing page, including special effect material editing items, in response to the special effect editing trigger operation. In response to the material addition operation, obtain the initial video material and display the target special effect material, where the target video material includes the target prospect information of the initial video material. In response to the special effect display operation, obtain the special effect image and display the target special effect image.
It realizes refined special effects processing, enriches the special effects display effect of the target special effects image, solves the problems of monotonous and poor interactivity of the special effects, and supports customized editing and diversified presentation of special effects materials.
Smart Images

Figure CN2024132317_12062025_PF_FP_ABST
Abstract
Description
Special effects processing method, device, electronic device and storage medium
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to the Chinese patent application filed on December 5, 2023, with application number 202311661835.7 and invention name “Special effects processing method, device, electronic device and storage medium”. The entire contents of that application are incorporated by reference into this application. Technical Field
[0003] The embodiments of the present disclosure relate to computer application technology, and more particularly to a special effects processing method, device, electronic device, and storage medium. Background Art
[0004] With the development of special effect processing technology, the styles of special effect props are becoming more and more diverse. Some special effect props enrich the special effect effect by adding special effect elements to the image to be processed.
[0005] In related technologies, there's often a fixed mapping relationship between special effects props and special effects elements. In other words, when using special effects props for special effects processing, the special effects elements employed are often limited to a pre-set range, resulting in monotonous special effects, lacking in interest, and poor interactivity. Furthermore, changes to special effects elements often rely on the emergence of new special effects props or the re-editing of special effects props, making implementation complex. Summary of the Invention
[0006] Embodiments of the present disclosure provide a special effects processing method, device, electronic device, and storage medium.
[0007] In a first aspect, an embodiment of the present disclosure provides a special effects processing method, the method comprising:
[0008] In response to a special effect editing trigger operation, displaying a special effect editing page, wherein the special effect editing page includes at least a special effect material editing item;
[0009] In response to a material adding triggering operation acting on the special effect material editing item, acquiring the added initial video material, and displaying a target special effect material corresponding to the initial video material, wherein the target video material includes target foreground information of the initial video material;
[0010] In response to the special effect display triggering operation, a special effect action image is acquired, and a target special effect image after the target special effect material is applied to the special effect action image is displayed.
[0011] In a second aspect, an embodiment of the present disclosure further provides a special effects processing device, the device comprising:
[0012] A special effect editing trigger module, configured to display a special effect editing page in response to a special effect editing trigger operation, wherein the special effect editing page at least includes a special effect material editing item;
[0013] a special effect material processing module, configured to, in response to a material adding triggering operation acting on the special effect material editing item, obtain an added initial video material and display a target special effect material corresponding to the initial video material, wherein the target video material includes target foreground information of the initial video material;
[0014] The special effect image display module is used to respond to the special effect display triggering operation, obtain a special effect action image, and display a target special effect image after the target special effect material is applied to the special effect action image.
[0015] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:
[0016] one or more processors;
[0017] a storage device for storing one or more programs,
[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the special effects processing method as described in any one of the embodiments of the present disclosure.
[0019] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium comprising computer-executable instructions, which, when executed by a computer processor, are used to execute the special effects processing method as described in any one of the embodiments of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.
[0021] FIG1 is a schematic flow chart of a special effects processing method provided by an embodiment of the present disclosure;
[0022] FIG2 is a schematic diagram of a display effect of a target special effect image provided by an embodiment of the present disclosure;
[0023] FIG3 is a flow chart of another special effect processing method provided by an embodiment of the present disclosure.
[0024] FIG4 is a schematic structural diagram of a special effects processing device provided by an embodiment of the present disclosure;
[0025] FIG5 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION
[0026] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.
[0027] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0028] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.
[0029] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0030] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".
[0031] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0032] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0033] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.
[0034] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0035] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0036] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.
[0037] Figure 1 is a flow chart of a special effects processing method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to situations where an object is deleted and the object is restored after deletion. The method can be executed by a special effects processing device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC or a server, etc.
[0038] As shown in FIG1 , the method of this embodiment may specifically include:
[0039] S110 . In response to a special effect editing triggering operation, display a special effect editing page, wherein the special effect editing page at least includes a special effect material editing item.
[0040] The special effects editing trigger operation can be understood as an operation used to enter the special effects editing process after being triggered. The special effects editing page can be understood as an interactive page that supports special effects editing operations. The special effects material editing items can be understood as page components of the special effects editing page, such as controls or operation areas, used to edit target special effects materials. The target special effects material can be understood as the special effects material displayed in the target special effects image.
[0041] Optionally, the special effects material editing item may include a material adding control, such as at least one of a special effects material uploading control, a special effects material adding control, and a special effects material deleting control. If special effects material already exists, the special effects material editing item may also include information items for re-editing the special effects material, such as operations such as selecting and / or extracting content from the special effects material. Exemplarily, the special effects material editing item may be displayed in the form of a tray, in which a material adding control may be displayed, as well as preset special effects materials and / or added special effects materials, for the user to select and use.
[0042] It should be noted that, in addition to the special effect material editing items, the special effect editing page may also include an image display area, and the image display area may be used to display the image to be processed and / or the special effect image corresponding to the image to be processed.
[0043] In the disclosed embodiments, there may be multiple special effects editing triggering operations. For example, the special effects editing triggering operation may be a control triggering operation acting on a preset special effects editing control; or the special effects editing triggering operation may be a triggering operation based on inputting preset sound information and / or action information, etc. The special effects editing control may be a physical control or a virtual control displayed on the application display interface, which is not specifically limited here. The control triggering operation may be a click operation, a press operation, or a slide operation acting on the special effects editing control.
[0044] As an optional technical solution of an embodiment of the present disclosure, specifically, in response to a control trigger operation acting on a special effect editing control, a special effect shooting page can be displayed, and special effect material editing items can be displayed on the special effect shooting page. The special effect shooting page can be understood as a special effect editing page that displays a special effect image captured by a preset camera device.
[0045] S120 . In response to a material adding triggering operation acting on the special effect material editing item, obtaining an added initial video material, and displaying a target special effect material corresponding to the initial video material.
[0046] The material adding trigger operation can be understood as an operation for adding special effects material after triggering the special effects material editing item. The initial video material can be understood as the original video material added based on the material adding trigger operation. The target video material can be understood as the special effects material regenerated based on the processing results after processing the initial video material.
[0047] Optionally, the target video material may include target foreground information of the initial video material. It should be noted that the target foreground information and background information in the initial video material are relative concepts. The specific content of the initial video material used as foreground information can be set according to actual needs and is defined herein. As an optional implementation of the embodiment of the present disclosure, the target foreground information of the initial video material can be extracted using a preset graph segmentation algorithm.
[0048] In the embodiment of the present disclosure, optionally, in response to the material adding trigger operation acting on the special effect material editing item, obtaining the added initial video material includes: in response to the material uploading trigger operation acting on the special effect material editing item, obtaining the uploaded video material as the initial video material; and / or, in response to the material shooting trigger operation acting on the special effect material editing item, obtaining the shot video material as the initial video material. In short, during the special effect processing process, the initial video material can be uploaded or the video material can be shot in real time, supporting flexible setting of the initial video material, making the target video material displayed in the generated target special effect image more diverse, thereby enriching the display effect of the target special effect image.
[0049] In the disclosed embodiment, after acquiring the initial special effects material, the initial special effects material is processed to obtain target foreground information of the initial special effects material. Furthermore, based on the target foreground information, a target special effects material corresponding to the initial video material is generated and displayed. This technical solution can highlight the display of the target foreground information in the initial video material.
[0050] S130 . In response to the special effect display triggering operation, obtain a special effect action image, and display a target special effect image after the target special effect material is applied to the special effect action image.
[0051] The special effects display trigger operation can be understood as an operation for displaying a target special effects image obtained after special effects processing after being triggered. The special effects image can be understood as an image to be processed with the target special effects material. For example, the special effects image can be an image captured in real time by a camera or an uploaded image. It should be noted that in the scenario of video processing, the image can be a video frame in the video.
[0052] Optionally, the target special effect material is displayed on an upper layer of the special effect image. Specifically, after the target special effect material is displayed on an upper layer of the special effect image, the captured special effect image and the target special effect material are rendered through a shooting trigger operation to obtain the target special effect image.
[0053] In order to enrich the display effect of the target special effect image, optionally, after generating the target special effect image based on the target special effect material and the special effect action image, it also includes: in response to an audio adding trigger operation for the target special effect image, determining the special effect audio corresponding to the target special effect image based on the added first audio.
[0054] The audio adding trigger operation can be understood as an operation for adding special effect audio to the target special effect image after being triggered. The first audio is audio information added based on the audio adding trigger operation. For example, the first audio can be a real-time recorded sound or audio selected from existing audio data. The first audio can be speech or music, etc.
[0055] Optionally, in response to an audio adding trigger operation for the target special effect image, an audio setting page is displayed, wherein the audio setting page displays at least one audio identifier and / or audio input control; and in response to an audio setting trigger operation based on the audio setting page, the set audio information is obtained as the first audio. The audio input control may include an audio recording control and / or an audio upload control, etc.
[0056] Exemplarily, in response to an audio setting trigger operation based on the audio setting page, it includes: in response to an identifier selection operation for the audio representation, obtaining audio information corresponding to the selected audio identifier as the first audio; and / or, in response to a trigger operation acting on the audio input control, obtaining the input audio information as the first audio.
[0057] As an optional implementation in the embodiment of the present disclosure, when the target special effect material carries a second audio, when the second audio is played, the first audio is stopped, and when the second audio stops playing, the first audio continues to play.
[0058] In the embodiment of the present disclosure, considering that the first audio is audio information added during special effects processing, the first audio can be mainly displayed. Optionally, the special effects audio corresponding to the target special effects image is determined based on the added first audio, including: when the target special effects material carries the second audio, the first audio and the second audio are played, and the volume of the second audio is controlled based on the adding position of the first audio to obtain the special effects audio corresponding to the target special effects image. Among them, the adding position can specifically be the time when the first audio is played, and can specifically be the start and end time of the playback of the first audio relative to the playback time of the target special effects image. For example, at which second of the target special effects video playback starts and when the playback ends, etc.
[0059] By adopting this technical solution, the first audio and the second audio can be combined to generate special effect audio. Compared with the method of only supporting the display using the first audio, the display content of the special effect audio is richer. Moreover, by using the first audio to control the second audio, while meeting the display requirements of the first audio, the display effect of the special effect audio can also be enriched through the second audio.
[0060] It should be noted that the second audio carried by the target special effects material is derived from the source audio carried by the initial video material. The second audio carried by the target special effects material can be all or part of the source audio carried by the initial video material. The association between the target special effects material and the second audio can be the same as the association between the initial video material and the source audio.
[0061] Specifically, controlling the volume of the second audio based on the adding position of the first audio includes: while playing the first audio, continuing to play the second audio, reducing the volume of the second audio, or setting the second audio to a mute state.
[0062] This technical solution not only allows the display of special effect audio alongside the target special effect image, but also supports flexible settings for the first audio, enriching the special effect display format and content and meeting differentiated audio setting requirements. By playing both the first and second audio when the target special effect material also carries the second audio, the first audio and the target special effect material can be displayed synchronously, thus ensuring the special effect display effect.
[0063] As an optional technical solution of the embodiment of the present disclosure, when the target special effects material carries a second audio, the audio playback progress of the second audio can be controlled based on the audio component, the video playback progress of the target special effects material can be controlled based on the video component, and the video playback progress can be periodically adjusted based on the audio playback progress. In short, the audio and video of the target special effects material are controlled separately by two components, and then the audio and video playback progress is periodically synchronized. Specifically, the audio progress can be used regularly to calibrate the video progress to achieve synchronous playback of the audio and video of the target special effects material. The use of this technical solution supports separate adjustment of audio and video.
[0064] As another optional technical solution in the disclosed embodiments, when the target special effects material carries a second audio, the playback progress of the target special effects material's video and the second audio can be controlled based on a preset control component. Specifically, the target special effects material's audio and video can be controlled by a single component, with each frame acquiring a video frame texture aligned with the audio progress. This allows for simple and convenient synchronized playback of the target special effects material's audio and video without requiring special adjustments.
[0065] In order to enrich the special effect interaction mode, optionally, after displaying the target special effect image, it also includes: displaying a special effect editing page in response to a control triggering operation acting on a preset special effect control, and displaying the target special effect material in the special effect editing page.
[0066] The preset special effect control can be displayed in association with the target special effect image. For example, the preset special effect control can be displayed on a display page of the target special effect image. The preset special effect control can be displayed as a button or a hyperlink, etc. The preset special effect control can be displayed at an edge area of the target special effect image, etc. It should be noted that the above is merely an exemplary explanation of the preset special effect control and does not limit the display method of the preset special effect control.
[0067] As shown in Figure 2, when the target special effects material in the target special effects image is the dancer in the lower left corner, in response to the control trigger operation acting on the preset special effects control, this dancer can be displayed on the special effects editing page to generate a special effects image containing the same dancer based on the new special effects image.
[0068] By adopting this technical solution, the target special effect material can be reused through preset special effect controls, and it can support the generation of diverse special effect effects based on the target special effect material, thereby increasing the fun of special effect interaction and further enriching the special effect effects.
[0069] As an optional technical solution of the disclosed embodiment, after displaying the target special effects material corresponding to the initial video material, the method may further include: adjusting the material display information of the target special effects material in response to a display adjustment trigger operation for the target special effects material. This technical solution enables flexible adjustment of the material display information of the target special effects material to meet differentiated material display requirements.
[0070] The display adjustment trigger operation can be understood as an operation for adjusting the material display information of the target special effect material after being triggered. For example, it can be one or more trigger operations such as a rotation trigger operation, a movement trigger operation, and a zoom trigger operation inputted for the target special effect material.
[0071] For example, the material display information may include at least one of a material display position, a material display size, and a material display mode, wherein the material display mode may include at least one of a static display mode, a dynamic display mode, and a display mode associated with a material-associated object.
[0072] The technical solution of the embodiment of the present disclosure is to display a special effect editing page in response to a special effect editing trigger operation. Since the special effect editing page includes a special effect material editing item, it can support custom editing of the special effect material; by responding to a material addition trigger operation acting on the special effect material editing item, the added initial video material is obtained, and the target special effect material corresponding to the initial video material is displayed, wherein the target video material includes the target foreground information of the initial video material. Compared with using the original initial video material, the background information of the initial video material can be reduced while effectively retaining the target foreground information. By responding to the special effect display trigger operation, the special effect image is obtained, and the target special effect image after the target special effect material is applied to the special effect image is displayed, which solves the technical problems of lack of fun, poor interactivity and cumbersome adjustment methods of special effects due to the way of adding preset special effect materials, realizes refined special effect processing, and thus enriches the special effect display effect of the target special effect image.
[0073] Figure 3 is a flow chart of another special effects processing method provided by an embodiment of the present disclosure. The technical solution of this embodiment further refines the method for generating the target special effects material on the basis of the above-mentioned embodiment. Optionally, the initial video material is displayed, and in response to a segment selection trigger operation for the initial video material, the selected video segment in the initial video material is used as the target video material; the target foreground information of the target video material is extracted, and the target special effects material is generated based on the target foreground information, and the target special effects material is displayed. For specific implementation methods, please refer to the description of this embodiment. Among them, the technical features that are the same or similar to those in the above-mentioned embodiments are not repeated here.
[0074] As shown in FIG3 , the method of this embodiment may specifically include:
[0075] S310 . In response to a special effect editing triggering operation, display a special effect editing page, wherein the special effect editing page at least includes a special effect material editing item.
[0076] S320: In response to a material adding triggering operation acting on the special effect material editing item, obtain the added initial video material, and display the initial video material.
[0077] Specifically, displaying the initial video material may include displaying an image sequence (ie, a plurality of video frames) corresponding to the initial video material.
[0078] In the embodiment of the present disclosure, the added initial video material may be one or more, and the generated target video material may also be one or more. In the case where there are multiple initial video materials, material identifiers of the initial video materials may also be displayed.
[0079] S330: In response to a segment selection triggering operation on the initial video material, use the selected video segment in the initial video material as the target video material.
[0080] The segment selection trigger operation may be understood as a trigger operation for selecting a video segment for producing a target special effects material from the initial video material.
[0081] Optionally, when displaying the image sequence corresponding to the initial video material, a segment selection window of a preset duration can be displayed. Based on this, a selected video segment from the initial video material can be determined in response to a window edit operation on the segment selection window of the initial video material. This technical solution allows for simple and rapid selection of video segments.
[0082] The window editing operation includes triggering an adjustment of the window length of the segment selection window. The window length of the segment selection window is associated with a preset duration corresponding to the segment selection window. The window editing operation includes triggering an adjustment of the window position of the segment selection window. By moving the window position of the segment selection window, a different video segment in the initial video material can be selected as the target video material. The video segment selected from the initial video material is the video segment located in the segment selection window.
[0083] It should be noted that the video segment selected from the initial video material may be the entire initial video material or a portion of the video segment from the initial video material.
[0084] S340: Extract target foreground information of the target video material, generate target special effects material based on the target foreground information, and display the target special effects material.
[0085] Specifically, the extracting of target foreground information of the target video material may include: determining, for each video frame to be processed in the target video material, a foreground mask image corresponding to the target foreground information of the video frame to be processed, and determining the target foreground information corresponding to the video frame to be processed based on the foreground mask image and the video frame to be processed.
[0086] Wherein, each to-be-processed video frame in the target video material may be each frame or a portion of the video frames in the target video material. As mentioned above, the target foreground information may be set according to actual needs, for example, it may be the entire or partial area of a preset type of target object, and its content is not limited here.
[0087] Exemplarily, determining a foreground mask image corresponding to the target foreground information of the video frame to be processed includes: determining an image segmentation algorithm corresponding to the target foreground information, performing image segmentation processing on the video frame to be processed based on the image segmentation algorithm, and obtaining a foreground mask image corresponding to the target foreground information of the video frame to be processed.
[0088] As an optional implementation manner of the embodiment of the present disclosure, determining the target foreground information corresponding to the video frame to be processed based on the foreground mask image and the video frame to be processed may specifically include: performing cutout processing on the video frame to be processed based on the foreground mask image to obtain a green screen video frame; then, performing color extraction on the green screen video frame to determine green pixels; and determining the target foreground information corresponding to the video frame to be processed based on the adjusted transparency corresponding to the green pixels and the video frame to be processed.
[0089] Among them, color extraction is performed on the green screen video frame, and the green screen video frame can be converted from RGB (red, green and blue) color space to YUV (brightness, chroma and concentration) color space, and then color extraction is performed on the chroma and concentration components. The green pixel point can be determined by the difference between the color value of the green screen video frame and the color value corresponding to green. Furthermore, the transparency can also be adjusted according to the difference value. The larger the difference value, the lower the transparency, and the smaller the difference value, the higher the transparency. The advantage of this setting is that the original color of the target special effects material can be completely preserved.
[0090] It is also possible to read the pixel color of each green screen video frame and determine its similarity with the green chromaticity value. Only when the similarity is within a certain interval will it be set as a transparent pixel. Optionally, further de-greening processing is performed. Among them, the de-greening processing method can be: converting the RGB color space into the HSV (hue, saturation and brightness) color space. Since the hue value of green is usually between 85 and 135, within the interval, the saturation of the video frame can be multiplied by a value less than 1 to reduce the saturation of the green part. Then, the green screen video frame is converted from the HSV color space to the RGB color space. The advantage of this setting is that it can retain the effective area as much as possible and make the semi-transparent part more complete.
[0091] As another optional implementation of the embodiment of the present disclosure, determining the target foreground information corresponding to the video frame to be processed based on the foreground mask image and the video frame to be processed may specifically include: setting the transparency value of the transparent channel of the video frame to be processed based on the foreground mask image, and then determining the target foreground information corresponding to the video frame to be processed based on the transparency value of the transparent channel and the video frame to be processed. That is, by generating a video with a transparent channel, the transparent channel is directly used to control the display of the target foreground information at runtime. The target foreground information can be accurately displayed based on the foreground mask image while retaining the original image information of the video frame to be processed.
[0092] Optionally, before determining the target foreground information corresponding to the video frame to be processed based on the foreground mask image and the video frame to be processed, it also includes: processing the foreground mask image based on a preset processing method, and updating the foreground mask image based on the processing result, wherein the preset processing method includes edge blurring processing and / or adjusting the pixel values of pixel points at the edge.
[0093] Adjusting the pixel values of the pixels at the edge may specifically involve mapping the pixel values of the pixels at the edge from a first value to a second value based on a preset mapping function. Specifically, the pixel values of the pixels at the edge may be mapped from a smaller first value to a larger second value, or from a larger first value to a smaller second value, thereby adjusting the exit area (the area with a value greater than a preset threshold) in the foreground mask image. This processing method is particularly suitable for edge processing using feathering or other methods when generating the foreground mask image, and can enable the foreground mask image to more closely fit the target foreground information in the initial video material.
[0094] By adopting the above technical solution, the edge of the foreground mask image can be made smoother through edge blurring processing, retaining more effective information; by adjusting the pixel values of the pixels at the edge, the exit area of the foreground mask image can be adjusted, so that the foreground mask image can be more consistent with the target foreground information in the initial video material, providing data support for accurately extracting the target foreground information in the initial video material.
[0095] In the embodiment of the present disclosure, the added initial video material may be one or more, and the generated target video material may also be one or more. In the case where there is only one initial video material, generating the target special effects material based on the target foreground information may be to generate a target special effects material that only includes the target foreground information. In the case where there are multiple initial video materials, generating the target special effects material based on the target foreground information may be to: generate the target special effects material using the target foreground information corresponding to each of the initial video materials; or generate the target special effects material based on the target foreground information corresponding to multiple initial video materials, etc.
[0096] As an optional technical solution of the embodiment of the present disclosure, after the material addition trigger operation acting on the special effect material editing item in response, before the target special effect material corresponding to the initial video material is displayed, it also includes: displaying a preset transition page, wherein the preset transition page displays processing status prompt information corresponding to the initial video material.
[0097] The preset transition page may be a transition page pre-set to display target special effect materials after receiving a material addition trigger operation. The page content displayed on the preset transition page may be set according to actual needs, for example, it may be one or more of preset image information, animation information, and text information.
[0098] Exemplarily, the processing status prompt information may be processing progress information for prompting processing the initial video material into target special effect material.
[0099] By adopting this technical solution, when the initial video material is processed into the target special effect material, processing status prompt information can be provided, so that the progress of the special effect processing can be understood in a timely manner, thereby improving the visual experience.
[0100] S350 , in response to the special effect display triggering operation, obtaining a special effect action image, and displaying a target special effect image after the target special effect material is applied to the special effect action image.
[0101] The technical solution of the embodiment of the present disclosure, by responding to a segment selection trigger operation for the initial video material, uses the selected video segment in the initial video material as the target video material, thereby realizing customized selection of video segments in the initial video material, making the presentation effect of the special effect material more diversified; by extracting the target foreground information of the target video material, generating the target special effect material based on the target foreground information, and displaying the target special effect material, the target video material can be reprocessed, the target foreground information can be extracted from the target video material, the interference of the background information in the initial video material on the special effect image can be reduced, and the adaptability of the target special effect material and the special effect image can be improved, thereby ensuring the special effect display effect of the target special effect image.
[0102] FIG4 is a structural diagram of a special effect processing device provided by an embodiment of the present disclosure. As shown in FIG4 , the special effect processing device includes: a special effect editing trigger module 410 , a special effect material processing module 420 and a special effect image display module 430 .
[0103] Among them, the special effects editing trigger module 410 is used to display a special effects editing page in response to a special effects editing trigger operation, wherein the special effects editing page at least includes a special effects material editing item; the special effects material processing module 420 is used to obtain the added initial video material in response to a material addition trigger operation acting on the special effects material editing item, and display the target special effects material corresponding to the initial video material, wherein the target video material includes the target foreground information of the initial video material; the special effects image display module 430 is used to obtain a special effects action image in response to the special effects display trigger operation, and display the target special effects image after the target special effects material is applied to the special effects action image.
[0104] The technical solution of the embodiment of the present disclosure is as follows: a special effect editing trigger module responds to a special effect editing trigger operation to display a special effect editing page; since the special effect editing page includes a special effect material editing item, it can support custom editing of the special effect material; a special effect material processing module responds to a material adding trigger operation acting on the special effect material editing item to obtain the added initial video material and display the target special effect material corresponding to the initial video material, wherein the target video material includes target foreground information of the initial video material. Compared with using the original initial video material, the background information of the initial video material can be reduced while effectively retaining the target foreground information while reducing the interference of the background information of the initial video material on the special effect effect image; a special effect image display module responds to the special effect display trigger operation to obtain a special effect effect image and display the target special effect image after the target special effect material is applied to the special effect effect image, thereby solving the technical problems that the special effect effect lacks fun, has poor interactivity and is cumbersome to adjust due to the method of adding preset special effect materials, and realizes refined special effect processing, thereby enriching the special effect display effect of the target special effect image.
[0105] Based on the above-mentioned optional technical solutions, the special effect editing trigger module optionally includes: a video material uploading unit and / or a video material shooting unit. The video material uploading unit is configured to, in response to a material upload triggering operation applied to the special effect material editing item, obtain the uploaded video material as the initial video material; and the video material shooting unit is configured to, in response to a material shooting triggering operation applied to the special effect material editing item, obtain the shot video material as the initial video material.
[0106] Based on the above-mentioned optional technical solutions, the special effects material processing module 320 optionally includes: a video material display unit, a video clip selection unit, and a special effects material generation unit. The video material display unit is configured to display the initial video material; the video clip selection unit is configured to, in response to a clip selection trigger operation on the initial video material, use a selected video clip from the initial video material as a target video material; and the special effects material generation unit is configured to extract target foreground information from the target video material, generate target special effects material based on the target foreground information, and display the target special effects material.
[0107] Based on the above-mentioned optional technical solutions, optionally, the special effects material generation unit is used to: determine, for each video frame to be processed in the target video material, a foreground mask image corresponding to the target foreground information of the video frame to be processed, and determine the target foreground information corresponding to the video frame to be processed based on the foreground mask image and the video frame to be processed.
[0108] Based on the above-mentioned optional technical solutions, the special effects processing device may further include a foreground mask updating module. The foreground mask updating module is configured to process the foreground mask image based on a preset processing method before determining target foreground information corresponding to the video frame to be processed based on the foreground mask image and the video frame to be processed, and update the foreground mask image based on the processing result. The preset processing method may include edge blurring and / or adjusting pixel values of pixels at edges.
[0109] Based on the above-mentioned optional technical solutions, the special effects processing device may further include a transition page display module, wherein the transition page display module is configured to display a preset transition page after the material addition triggering operation is performed on the special effects material editing item and before the target special effects material corresponding to the initial video material is displayed, wherein the preset transition page displays processing status prompt information corresponding to the initial video material.
[0110] Based on the above optional technical solutions, the special effect processing device may further include a special effect audio setting module, wherein the special effect audio setting module is configured to, after generating a target special effect image based on the target special effect material and the special effect image, determine a special effect audio corresponding to the target special effect image based on the added first audio in response to an audio adding trigger operation for the target special effect image.
[0111] Based on the above-mentioned optional technical solutions, optionally, the special effect audio setting module is used to: when the target special effect material carries a second audio, play the first audio and the second audio, and control the volume of the second audio based on the adding position of the first audio to obtain the special effect audio corresponding to the target special effect image.
[0112] Based on the above-mentioned optional technical solutions, optionally, the special effects processing device further includes: a first playback control module and a second playback control module. The first playback control module is configured to, after the target special effects material corresponding to the initial video material is displayed, control the audio playback progress of the second audio based on the audio component, control the video playback progress of the target special effects material based on the video component, and periodically adjust the video playback progress based on the audio playback progress, if the target special effects material carries the second audio, and periodically adjust the video playback progress based on the audio playback progress; and the first playback control module is configured to, after the target special effects material corresponding to the initial video material is displayed, control the playback progress of the video and the second audio of the target special effects material based on the preset control component, if the target special effects material carries the second audio.
[0113] Based on the above-mentioned optional technical solutions, the special effect processing device may further include a special effect material reuse module, wherein the special effect material reuse module is configured to, after displaying the target special effect image, display a special effect editing page in response to a control triggering operation on a preset special effect control, and display the target special effect material on the special effect editing page.
[0114] Based on the above-mentioned optional technical solutions, the special effects processing device optionally further comprises: a material display adjustment module. The material display adjustment module is configured to, after displaying the target special effects material corresponding to the initial video material, adjust material display information of the target special effects material in response to a display adjustment triggering operation for the target special effects material; the material display information includes at least one of a material display position, a material display size, and a material display mode; and the material display mode includes at least one of a static display mode, a dynamic display mode, and display associated with a material-associated object.
[0115] The special effects processing device provided by the embodiments of the present disclosure can execute the special effects processing method provided by any embodiment of the present disclosure, and has corresponding functional modules and beneficial effects for executing the special effects processing method.
[0116] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.
[0117] FIG5 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Referring to FIG5 , a schematic diagram of the structure of an electronic device (such as a terminal device or server in FIG5 ) 500 suitable for implementing an embodiment of the present disclosure is shown below. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG5 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.
[0118] As shown in FIG5 , the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An edit / output (I / O) interface 505 is also connected to the bus 504.
[0119] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although FIG5 shows the electronic device 500 with various devices, it should be understood that not all of the devices shown are required to be implemented or present. More or fewer devices may alternatively be implemented or present.
[0120] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.
[0121] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0122] The electronic device provided by the embodiment of the present disclosure and the special effects processing method provided by the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.
[0123] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon. When the program is executed by a processor, the special effect processing method provided in the above embodiment is implemented.
[0124] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.
[0125] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.
[0126] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0127] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: responds to a special effect editing trigger operation, displays a special effect editing page, wherein the special effect editing page includes at least a special effect material editing item; responds to a material adding trigger operation acting on the special effect material editing item, obtains the added initial video material, and displays the target special effect material corresponding to the initial video material, wherein the target video material includes the target foreground information of the initial video material; responds to the special effect display trigger operation, obtains a special effect action image, and displays the target special effect image after the target special effect material is applied to the special effect action image.
[0128] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0129] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0130] The units described in the embodiments of the present disclosure may be implemented in software or hardware. In some cases, the name of a unit does not necessarily limit the unit itself. For example, a special effects editing trigger module may also be described as a "module for displaying a special effects editing page."
[0131] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
[0132] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0133] According to one or more embodiments of the present disclosure, [Example 1] provides a special effects processing method, comprising: in response to a special effects editing trigger operation, displaying a special effects editing page, wherein the special effects editing page includes at least a special effects material editing item; in response to a material adding trigger operation acting on the special effects material editing item, obtaining the added initial video material, and displaying a target special effects material corresponding to the initial video material, wherein the target video material includes target foreground information of the initial video material; in response to the special effects display trigger operation, obtaining a special effects action image, and displaying a target special effects image after the target special effects material is applied to the special effects action image.
[0134] According to one or more embodiments of the present disclosure, [Example 2] provides the method of Example 1, further comprising:
[0135] Optionally, in response to the material adding trigger operation acting on the special effect material editing item, obtaining the added initial video material includes: in response to the material uploading trigger operation acting on the special effect material editing item, obtaining the uploaded video material as the initial video material; and / or, in response to the material shooting trigger operation acting on the special effect material editing item, obtaining the shot video material as the initial video material.
[0136] According to one or more embodiments of the present disclosure, [Example 3] provides the method of Example 1, further comprising:
[0137] Optionally, the display of the target special effects material corresponding to the initial video material includes: in response to a segment selection trigger operation for the initial video material, using the selected video segment in the initial video material as the target video material; extracting target foreground information of the target video material, generating target special effects material based on the target foreground information, and displaying the target special effects material.
[0138] According to one or more embodiments of the present disclosure, [Example 4] provides the method of Example 3, further comprising:
[0139] Optionally, the display of the target special effects material corresponding to the initial video material includes: displaying the initial video material; in response to a segment selection trigger operation for the initial video material, using the selected video segment in the initial video material as the target video material; extracting target foreground information of the target video material, generating target special effects material based on the target foreground information, and displaying the target special effects material.
[0140] According to one or more embodiments of the present disclosure, [Example 5] provides the method of Example 4, further comprising:
[0141] Optionally, before determining the target foreground information corresponding to the video frame to be processed based on the foreground mask image and the video frame to be processed, it also includes: processing the foreground mask image based on a preset processing method, and updating the foreground mask image based on the processing result, wherein the preset processing method includes edge blurring processing and / or adjusting the pixel values of pixel points at the edge.
[0142] According to one or more embodiments of the present disclosure, [Example 6] provides the method of Example 3, further comprising:
[0143] Optionally, after responding to the material adding triggering operation acting on the special effect material editing item and before displaying the target special effect material corresponding to the initial video material, the method further includes:
[0144] A preset transition page is displayed, wherein the preset transition page displays processing status prompt information corresponding to the initial video material.
[0145] According to one or more embodiments of the present disclosure, [Example 7] provides the method of Example 1, further comprising:
[0146] Optionally, after generating the target special effect image based on the target special effect material and the special effect action image, it also includes: in response to an audio adding trigger operation for the target special effect image, determining the special effect audio corresponding to the target special effect image based on the added first audio.
[0147] According to one or more embodiments of the present disclosure, [Example 8] provides the method of Example 7, further comprising:
[0148] Optionally, determining the special effects audio corresponding to the target special effects image based on the added first audio includes: when the target special effects material carries the second audio, playing the first audio and the second audio, and controlling the volume of the second audio based on the adding position of the first audio to obtain the special effects audio corresponding to the target special effects image.
[0149] According to one or more embodiments of the present disclosure, [Example 9] provides the method of Example 1, further comprising:
[0150] Optionally, after the target special effects material corresponding to the initial video material is displayed, it also includes: when the target special effects material carries a second audio, controlling the audio playback progress of the second audio based on the audio component, controlling the video playback progress of the target special effects material based on the video component, and periodically adjusting the video playback progress based on the audio playback progress; and / or, when the target special effects material carries a second audio, controlling the playback progress of the video of the target special effects material and the second audio based on the preset control component.
[0151] According to one or more embodiments of the present disclosure, [Example 10] provides the method of Example 1, further comprising:
[0152] Optionally, after displaying the target special effect image, the method further includes: displaying a special effect editing page in response to a control triggering operation acting on a preset special effect control, and displaying the target special effect material in the special effect editing page.
[0153] According to one or more embodiments of the present disclosure, [Example 11] provides the method of Example 1, further including: optionally, after the display of the target special effects material corresponding to the initial video material, it also includes: in response to a display adjustment trigger operation for the target special effects material, adjusting the material display information of the target special effects material; wherein the material display information includes at least one of a material display position, a material display size, and a material display mode; the material display mode includes at least one of a static display mode, a dynamic display mode, and an associated display with a material-associated object.
[0154] According to one or more embodiments of the present disclosure, [Example 12] provides a special effects processing device, including: a special effects editing trigger module, for displaying a special effects editing page in response to a special effects editing trigger operation, wherein the special effects editing page includes at least a special effects material editing item; a special effects material processing module, for obtaining the added initial video material in response to a material adding trigger operation acting on the special effects material editing item, and displaying a target special effects material corresponding to the initial video material, wherein the target video material includes target foreground information of the initial video material; a special effects image display module, for obtaining a special effects action image in response to the special effects display trigger operation, and displaying a target special effects image after the target special effects material is applied to the special effects action image.
[0155] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.
[0156] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0157] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.
Claims
1. A special effects processing method, comprising: In response to a special effect editing trigger operation, displaying a special effect editing page, wherein the special effect editing page at least includes a special effect material editing item; In response to a material adding triggering operation acting on the special effect material editing item, acquiring the added initial video material, and displaying a target special effect material corresponding to the initial video material, wherein the target video material includes target foreground information of the initial video material; In response to the special effect display triggering operation, a special effect application image is acquired, and a target special effect image after the target special effect material is applied to the special effect application image is displayed.
2. The special effect processing method according to claim 1, wherein: The step of obtaining the added initial video material in response to the material adding triggering operation acting on the special effect material editing item includes: In response to a material upload triggering operation acting on the special effect material editing item, obtaining the uploaded video material as the initial video material; and / or, In response to a material shooting triggering operation acting on the special effect material editing item, the shot video material is acquired as the initial video material.
3. The special effect processing method according to claim 1, wherein: The displaying of the target special effect material corresponding to the initial video material comprises: Displaying the initial video material; In response to a segment selection triggering operation on the initial video material, taking a selected video segment in the initial video material as a target video material; Target foreground information of the target video material is extracted, target special effect material is generated based on the target foreground information, and the target special effect material is displayed.
4. The special effect processing method according to claim 3, wherein: The extracting target foreground information of the target video material includes: For each to-be-processed video frame in the target video material, a foreground mask image corresponding to the target foreground information of the to-be-processed video frame is determined, and the target foreground information corresponding to the to-be-processed video frame is determined based on the foreground mask image and the to-be-processed video frame.
5. The special effect processing method according to claim 4, wherein: Before determining the target foreground information corresponding to the video frame to be processed based on the foreground mask image and the video frame to be processed, the method further includes: The foreground mask image is processed based on a preset processing method, and the foreground mask image is updated based on the processing result, wherein the preset processing method includes edge blurring processing and / or adjusting pixel values of pixel points at the edge.
6. The special effect processing method according to claim 3, wherein: After the material adding triggering operation acting on the special effect material editing item in response to the material adding triggering operation, and before the target special effect material corresponding to the initial video material is displayed, the method further includes: A preset transition page is displayed, wherein the preset transition page displays processing status prompt information corresponding to the initial video material.
7. The special effect processing method according to claim 1, wherein: After generating a target special effect image based on the target special effect material and the special effect image, the method further includes: In response to an audio adding triggering operation for the target special effect image, a special effect audio corresponding to the target special effect image is determined based on the added first audio.
8. The special effect processing method according to claim 7, wherein: The determining, based on the added first audio, the special effect audio corresponding to the target special effect image comprises: In the case where the target special effect material carries a second audio, the first audio and the second audio are played, and the volume of the second audio is controlled based on the adding position of the first audio to obtain a special effect audio corresponding to the target special effect image.
9. The special effect processing method according to claim 1, wherein: After displaying the target special effect material corresponding to the initial video material, the method further includes: In the case where the target special effect material carries a second audio, the audio playback progress of the second audio is controlled based on the audio component, the video playback progress of the target special effect material is controlled based on the video component, and the video playback progress is periodically adjusted based on the audio playback progress; and / or, In the case where the target special effect material carries a second audio, the playback progress of the video of the target special effect material and the second audio is controlled based on a preset component.
10. The special effect processing method according to claim 1, wherein: After displaying the target special effect image, the method further includes: In response to a control triggering operation acting on a preset special effect control, a special effect editing page is displayed, and the target special effect material is displayed in the special effect editing page.
11. The special effect processing method according to claim 1, wherein: After displaying the target special effect material corresponding to the initial video material, the method further includes: In response to a display adjustment trigger operation for the target special effects material, the material display information of the target special effects material is adjusted; wherein the material display information includes at least one of a material display position, a material display size, and a material display mode; the material display mode includes at least one of a static display mode, a dynamic display mode, and an associated display with a material-associated object.
12. A special effects processing device, comprising: A special effect editing trigger module, used to display a special effect editing page in response to a special effect editing trigger operation, wherein the special effect editing page at least includes a special effect material editing item; A special effect material processing module, configured to, in response to a material adding triggering operation acting on the special effect material editing item, obtain an added initial video material, and display a target special effect material corresponding to the initial video material, wherein the target video material includes target foreground information of the initial video material; The special effect image display module is used to respond to the special effect display trigger operation, obtain a special effect action image, and display a target special effect image after the target special effect material is applied to the special effect action image.
13. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the special effect processing method as described in any one of claims 1-11.
14. A storage medium comprising computer executable instructions, wherein: The computer executable instructions are used to execute the special effect processing method as described in any one of claims 1 to 11 when executed by a computer processor.
Citation Information
Patent Citations
Video editing processing method and device and electronic equipment
CN111835986A
Video synthesis method and device, computer equipment and storage medium
CN112822542A
Audio playing method and device in live broadcast, equipment and storage medium
CN113031906A
Special effect video determination method and device, electronic equipment and storage medium
CN116847147A
Special effect processing method and device, electronic equipment and storage medium
CN117676047A