Method and apparatus for generating video, and device and medium

Abstract

Provided are a method and apparatus for generating a video, and a device and a medium. The method comprises: presenting at a client device a processing page for processing an input image; in response to a loading request for the processing page being received, loading a special effect interface, wherein the special effect interface is used for calling a special effect algorithm at a server device corresponding to the client device to generate an output video having a predetermined special effect on the basis of the input image; and in response to determining that the loading state of the special effect interface is successful, presenting an editing page for editing the output video. By using the exemplary implementation of the present disclosure, the special effect interface having a powerful video editing capability can be pre-loaded from the server device, and then richer visual effects can be obtained at the client device.

Description

Method, apparatus, device and medium for generating video

[0001] This application claims priority to the Chinese invention patent application entitled “Methods, devices, equipment and media for generating videos” and application number 202311785540.0, filed on December 22, 2023. The entire contents of that application are incorporated by reference into this application. Technical Field

[0002] Exemplary implementations of the present disclosure relate generally to video processing, and more particularly to methods, apparatuses, devices, and computer-readable storage media for generating videos. Background Art

[0003] Computer vision technology has advanced rapidly, and a wide range of media editing tools have been developed. For example, users can capture photos and / or videos and use various special effects interfaces to perform editing processes on client devices to generate new images and / or videos. However, the processing power of client devices is relatively limited, and it is desirable to leverage the powerful processing capabilities of server devices to generate images and / or videos with better visual effects. Summary of the Invention

[0004] In a first aspect of the present disclosure, a method for generating a video is provided. In this method, a processing page for processing an input image is presented on a client device. In response to receiving a request to load the processing page, a special effects interface is loaded. The special effects interface is used to invoke a special effects algorithm on a server device corresponding to the client device to generate an output video with predetermined special effects based on the input image. In response to determining that the loading status of the special effects interface is successful, an editing page for editing the output video is presented.

[0005] In a second aspect of the present disclosure, a device for generating a video is provided. The device includes: a first rendering module configured to render a processing page for processing an input image on a client device; a loading module configured to, in response to receiving a load request for the processing page, load a special effects interface for invoking a special effects algorithm on a server device corresponding to the client device to generate an output video with a predetermined special effect based on the input image; and a second rendering module configured to, in response to determining that the loading status of the special effects interface is successful, render an editing page for editing the output video.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The electronic device includes: at least one processing unit; and at least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method according to the first aspect of the present disclosure.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor implements the method according to the first aspect of the present disclosure.

[0008] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the implementation of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easy to understand through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of various implementations of the present disclosure will become more apparent hereinafter with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0010] FIG1 shows a block diagram of an application environment according to an exemplary implementation of the present disclosure;

[0011] FIG2 illustrates a block diagram for generating a video according to some implementations of the present disclosure;

[0012] FIG3 shows a block diagram of a process for loading a special effects interface according to some implementations of the present disclosure;

[0013] FIG4 illustrates a block diagram of an edit page according to some implementations of the present disclosure;

[0014] FIG5 illustrates a block diagram of an edit page according to some implementations of the present disclosure;

[0015] FIG6 illustrates a track diagram of an interactive process for generating a video according to some implementations of the present disclosure;

[0016] FIG7 shows a flowchart of a method for generating a video according to some implementations of the present disclosure;

[0017] FIG8 shows a block diagram of an apparatus for generating a video according to some implementations of the present disclosure; and

[0018] FIG9 illustrates a block diagram of a device capable of implementing various implementations of the present disclosure. DETAILED DESCRIPTION

[0019] The following describes implementations of the present disclosure in more detail with reference to the accompanying drawings. Although certain implementations of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the implementations described herein. Rather, these implementations are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and implementations of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0020] In the description of the implementation of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "an implementation" or "the implementation" should be understood as "at least one implementation". The term "some implementations" should be understood as "at least some implementations". The following may also include other explicit and implicit definitions. As used herein, the term "model" can represent the association relationship between various data. For example, the above-mentioned association relationship can be obtained based on a variety of technical solutions currently known and / or to be developed in the future.

[0021] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0022] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0023] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0024] As an optional but non-limiting implementation, in response to receiving a user's active request, a prompt message may be sent to the user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0025] It is understandable that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0026] As used herein, the term "in response to" refers to a state in which a corresponding event occurs or a condition is satisfied. It will be understood that the timing of executing a subsequent action executed in response to the event or condition is not necessarily strongly correlated with the time when the event occurs or the condition is satisfied. For example, in some cases, a subsequent action may be executed immediately upon the occurrence of the event or the satisfaction of the condition; in other cases, the subsequent action may be executed some time after the occurrence of the event or the satisfaction of the condition.

[0027] Sample Environment

[0028] Computer vision technology has developed rapidly, and a large number of media editing tools have been developed. Referring to FIG. 1 , an application environment according to an exemplary implementation of the present disclosure is described. FIG. 1 shows a block diagram 100 of an application environment according to an exemplary implementation of the present disclosure. A media editing tool can be executed on a client device, and the tool can, for example, provide a page 110 as shown in FIG. 1 . A user can use the tool to process an input image 120. Here, the input image 120 can be, for example, a captured image or an image acquired locally or remotely in other ways.

[0029] The media editing tool may provide various special effect controls (also known as special effect props). For example, a user may use the local special effect controls 130 to locally process an input image to generate a new image and / or video. However, the processing power of the client device is relatively limited, and therefore it is desirable to utilize the powerful processing power of the server device to generate images and / or videos with better visual effects.

[0030] Generate a summary of the video

[0031] In order to at least partially address the deficiencies in the prior art, according to an exemplary implementation of the present disclosure, a method for generating a video is proposed. Referring to FIG2 , an overview of an exemplary implementation of the present disclosure is described, which shows a block diagram 200 for generating a video according to some implementations of the present disclosure. As shown in FIG2 , a processing page 210 for processing an input image 220 can be presented at a client device. The processing page 210 may include one or more special effects controls. For example, a local special effects control 130 may be provided to process the input image 220 locally. Alternatively and / or additionally, a remote special effects control 230 may be provided to load a special effects interface, thereby calling a special effects algorithm located at a server device to process the input image 220.

[0032] In the context of the present disclosure, the special effects interface can be implemented by a variety of programming languages ​​and represents a process and / or function implemented at a client device, so as to be used as an intermediary between a client device and a server device to call a special effects algorithm provided by a server device at the client device. Specifically, the special effects interface may include special effects tools, special effects props, or other forms for calling special effects algorithms at a server device. According to an example implementation of the present disclosure, when a load request for a processing page is received, the special effects interface can be loaded at the client device. Specifically, the user can click on the remote special effects control 230 to submit a load request, at which point the loaded special effects interface can call a special effects algorithm 242 from the server device 240. The special effects algorithm 242 is specified by the load request and is used to generate an output video with a predetermined special effect based on the input image 220.

[0033] It should be understood that although FIG2 schematically illustrates only one remote special effect control 230, the processing page 210 may include one or more remote special effect controls. Alternatively and / or additionally, after the user clicks the remote special effect control 230, a panel including multiple special effect controls may pop up for the user to select. Furthermore, if the loading status of the special effect interface is determined to be successful, an editing page 250 for editing the output video may be presented.

[0034] At this point, the user can browse and perform various functional editing operations in the editing page 250. For example, the user can drag the video progress bar control 254 to change the currently displayed image frame. The editing page 250 can support the user's switching logic to present any image frame. In other words, no matter which image frame the user switches to, the rendered effect is correct. In this way, the user can ensure that the visual effects generated by the remote special effects algorithm on the server are accessible to the client, thereby providing users with a richer interactive experience and better visual effects.

[0035] Detailed process of generating videos

[0036] An overview of an example implementation of the present disclosure has been described with reference to FIG2 . Further details regarding generating a video will be provided below. According to an example implementation of the present disclosure, the edit page 250 may include a preview area 252 for presenting the output video, and management controls for managing the playback of the output video. Specifically, as shown in FIG2 , the preview area 252 may provide visual effects for the output video, and the management controls may include, for example, a progress bar control 254 and a toggle control 256 for controlling the start and pause of playback. The user can control which image frame is presented in the preview area 252. In this way, it is convenient for the user to check frame by frame whether the visual effects meet expectations and to edit the output video frame by frame.

[0037] According to an example implementation of the present disclosure, during the process of loading the special effects interface, a loading page indicating the loading progress of the special effects interface can be presented. See Figure 3 for more details, which shows a block diagram 300 of the process for loading the special effects interface according to some implementations of the present disclosure. As shown in Figure 3, during the process of loading the special effects interface, an edit page 310 can be presented, at which time the preview area 252 can present the input image, and a loading page 320 can be presented, which can, for example, indicate the progress of the loading process. The proportion of the loading can be presented to the user in the form of a progress bar and / or percentage, etc., so that the user can predict the waiting time and then reasonably arrange subsequent operations.

[0038] According to an exemplary implementation of the present disclosure, if the loading status of the special effects interface is determined to be successful, a prompt message indicating successful loading can be presented. Similarly, if the loading status of the special effects interface is determined to be failed, a prompt message indicating loading failure can be presented. In this way, the user can be clearly reminded of the current loading status, thereby facilitating the user's determination of subsequent operation steps.

[0039] According to an example implementation of the present disclosure, during the process of loading the special effects interface, a cache area can be created at the client device. The cache area can be used to cache multiple algorithm parameters from the special effects algorithm. For example, at the client device, a cache directory can be created by the client of the media editing tool, and the directory can be located at a specified location of the client: "***\cache" or other location. Further, the client can notify the local software development tool (SDK) to load the special effects interface, and then the SDK will execute the specific process of loading the special effects interface. Further, the client can set the cache path of the algorithm, that is, the path of the cache directory created above. Further, the client can perform the processing of the preprocessing stage, that is, it can obtain multiple algorithm parameters for generating each image frame in the output video from the server device one by one.

[0040] Specifically, multiple algorithm parameters can be written into the cache area, and multiple algorithm parameters can be used to generate multiple image frames in the output video. Specifically, the algorithm parameters can be obtained from the server device using the loaded special effects interface. The various algorithm parameters can be downloaded from the server device. It should be understood that the algorithm parameters here refer to a generalized concept, and the algorithm parameters may include a set of parameters (for example, one or more). It should be understood that for each special effects interface, the length of the output video is fixed. Assuming that the output video includes N image frames, the required algorithm parameters can be downloaded from the server device, and then the corresponding image frames can be generated based on the position of each image frame in the video.

[0041] According to an example implementation of the present disclosure, when writing multiple algorithm parameters to a cache area, a target algorithm parameter from the multiple algorithm parameters can be obtained from a server device via a special effects interface, and then written to the cache area. When the target algorithm parameter is needed, it can be searched from the local cache directory on the client device without having to download it from the server. This method can reduce subsequent waiting time and thus improve the processing speed of the video editing process.

[0042] It should be understood that before accessing the server to obtain a certain target algorithm parameter, you can first check whether there is an already downloaded algorithm parameter in the cache directory, and only if the algorithm parameter does not exist in the cache directory, you can access the server device to obtain the desired algorithm parameter; otherwise, you can directly use the cached algorithm parameter.

[0043] According to an example implementation of the present disclosure, during the acquisition of target algorithm parameters, the target algorithm parameters are only acquired from the server device if it is determined that the target algorithm parameters do not exist in the cache area. Utilizing this example implementation of the present disclosure, the cache directory can reduce the frequency of accessing the server device, thereby acquiring various algorithm parameters in a more efficient manner.

[0044] According to an example implementation of the present disclosure, if the special effects interface has been successfully loaded locally, individual image frames in the output video can be edited on the editing page. Upon receiving a management request for the management control, the target position in the output video for the target image frame to be presented in the preview area can be determined. Then, using multiple algorithm parameters corresponding to the special effects interface already loaded locally on the client device, a target image frame corresponding to the target position is generated, and the target image frame is presented in the preview area 252.

[0045] For more details, see FIG4 , which shows a block diagram 400 of an editing page according to some implementations of the present disclosure. In the initial stage after the special effects interface has successfully loaded, an editing page 410 as shown in FIG4 may be presented. At this point, the preview area 252 presents the initial input image, and the user can interact with the management controls. Specifically, the user can click the switch control 256 to start playback, or adjust the progress bar control 254 to switch to a specific image frame. Using the example implementations of the present disclosure, the user can use the management controls to conveniently switch to any image frame and perform viewing and / or editing operations.

[0046] It should be understood that one or more editing tools may be presented at box 420 of the editing page 410. The user can use these editing tools to adjust the output video, for example, adding background music, text, etc. to the output video. Alternatively and / or additionally, one or more other special effects interfaces may be presented at box 420. The user can select another special effects interface. In this case, if the selected special effects interface is a server-side special effects interface, the special effects interface can be loaded from the server device and applied to the current input image to generate a new output video.

[0047] According to an example implementation of the present disclosure, assuming a user selects to play a target image frame, a target image frame can be generated based on the target position of the target image frame. See FIG5 for more details, which shows a block diagram 500 of an editing page according to some implementations of the present disclosure. On editing page 510, the user can drag the progress bar control 254 to the position shown in FIG5 (e.g., the i-th image frame), and the target image frame can be generated based on the input image, the position i, and multiple algorithm parameters in the buffer area.

[0048] As shown in Figure 5, multiple algorithm parameters obtained from the local cache area can be used to generate the image at the i-th frame. The preview area 252 will present the effect shown in Figure 5, where a lightning effect appears around the character. Alternatively and / or additionally, the user can further adjust the progress bar control 254 to the position of the j-th frame. At this time, the effect of the image frame 520 (for example, a black and white flip effect) can be presented in the preview area. Using the example implementation of the present disclosure, it is not necessary to download the desired algorithm parameters from the server device. Instead, the algorithm parameters can be directly obtained locally to generate the target image frame. In this way, image generation efficiency can be improved and user waiting time can be reduced.

[0049] According to an example implementation of the present disclosure, a user can save the output video generated by the special effects interface; alternatively and / or additionally, the user can discard the output video. Upon receiving an exit request to exit the editing page, the lifecycle of the special effects interface ends, and the special effects interface can be removed from the client device. In this way, the unused special effects interface can be prevented from occupying various resources of the client device.

[0050] According to an exemplary implementation of the present disclosure, a user can switch the currently processed input image. Upon receiving a switch request for switching the input image, the cache area can be cleared. It should be understood that the algorithm parameters in the cache area are specific to a particular input image. Therefore, if the input image is changed, the algorithm parameters in the cache area are no longer valid and should be cleared to avoid occupying the local storage space of the client device.

[0051] According to an exemplary implementation of the present disclosure, the special effects interface is loaded from the server device only when it is determined that the special effects algorithm selected by the user is of a remote type. In this way, multiple types of special effects interfaces can be maintained in the media editing tool, thereby facilitating the provision of richer visual processing effects to users.

[0052] The front-end operation page for generating a video using a special effects interface has been described. Below, refer to FIG6 for describing the background interaction process between the various modules in the process of generating a video. FIG6 shows a track diagram 600 of the interactive process for generating a video according to some implementations of the present disclosure. As shown in FIG6, the client 630 can represent a client of a media editing tool installed at a client device, the software development kit 632 represents various functions that can be called by the client 630, the special effects interface 634 represents a conversion tool for converting an input image to an output video with the help of a special effects algorithm at a server, and the cache target 636 represents a directory at a predetermined location at the client device.

[0053] As shown in Figure 6, the entire interactive process can be divided into a pre-processing phase 640 and a tool usage phase 642. The primary function of the pre-processing phase 640 is to load the tool, access the server through the tool to obtain algorithm parameters or read locally cached algorithm parameters, and send a message to the client to inform the client whether the algorithm parameters required for the tool's normal operation have been obtained. During the tool usage phase 642, the user can use the loaded special effects interface normally, moving the playback progress bar to any frame and viewing the effect.

[0054] In the initial stage, a user 638 may load 601 a special effects interface. Based on this loading operation, the client 630 may create 602 a local cache directory. Subsequently, the client 630 may notify 603 a software development kit 632 to execute the loading process, and the software development kit 632 may load 604 the special effects interface. The client 630 may set 605 a cache directory for caching algorithm parameters and perform 606 preprocessing.

[0055] During the preprocessing process, a server device may be accessed 610 and a plurality of corresponding algorithm parameters may be obtained. The obtained algorithm parameters may be written 611 to a cache directory. If the write is successful, the cache directory 636 may return 612 a success message to the client 630. Alternatively and / or additionally, if the access fails, the special effects interface 634 may return 613 a failure message and may display 614 the failure message to the user.

[0056] It should be understood that the special effects interface 634 only accesses the server device if the desired algorithm parameters are not present in the cache directory. If the desired algorithm parameters are present in the cache directory, the special effects interface 634 can directly read 615 the cache directory. The cache directory 636 can return the stored algorithm parameters to the special effects interface 634, and the special effects interface 634 will return 617 a success message to the client 630. At this point, the pre-processing stage 640 is complete, and all the algorithm parameters required for special effects processing are now included in the cache directory.

[0057] In the user use phase 642, the user can move 620 the progress bar to any position in the target video. At this time, the client 630 can search 621 for the corresponding video frame (e.g., the i-th frame). Then, the required algorithm parameters can be directly obtained from the cache directory, and the i-th image frame can be generated based on the input image and position i. If the user no longer uses the special effects interface loaded 622, the client 630 can notify 623 the software development kit 632 to perform the uninstallation, and then the software development kit 632 can uninstall 624 the special effects interface 634. Alternatively and / or additionally, if the user changes 624 the input image, the client 630 can delete 626 the cache directory.

[0058] Using the example implementations of this disclosure, in the edit page scenario, the preprocessing phase can pre-acquire server-side algorithm parameters, ensuring high-speed operation of the special effects interface. Furthermore, the cache directory can reduce the number of server device accesses. The cache directory includes the same input algorithm parameters, thus reducing user waiting time by reusing algorithm parameters.

[0059] Example Process

[0060] FIG7 illustrates a flow chart of a method 700 for generating a video according to some implementations of the present disclosure. At block 710, a processing page for processing an input image is presented on a client device. At block 720, in response to receiving a load request for the processing page, an effects interface is loaded. The effects interface is used to invoke an effects algorithm at a server device corresponding to the client device to generate an output video with predetermined effects based on the input image. At block 730, in response to determining that the loading status of the effects interface is successful, an editing page for editing the output video is presented.

[0061] According to an exemplary implementation of the present disclosure, the editing page includes: a preview area for presenting the output video, and a management control for managing the playback of the output video.

[0062] According to an example implementation of the present disclosure, the method further includes: in response to receiving a management request for a management control, determining a target position in the output video of a target image frame to be presented in the preview area; generating a target image frame corresponding to the target position using a special effects interface; and presenting the target image frame in the preview area.

[0063] According to an example implementation of the present disclosure, the method further includes: presenting a loading page indicating the loading progress of the special effect interface.

[0064] According to an example implementation of the present disclosure, loading a special effect interface includes: creating a cache area at a client device; and writing a plurality of algorithm parameters generated by the special effect algorithm into the cache area.

[0065] According to an example implementation of the present disclosure, writing multiple algorithm parameters into the cache area includes: acquiring target algorithm parameters among the multiple algorithm parameters from the server device via the special effect interface; and writing the target algorithm parameters into the cache area.

[0066] According to an example implementation of the present disclosure, acquiring the target algorithm parameter includes: in response to determining that the target algorithm parameter does not exist in the cache area, acquiring the target algorithm parameter from the server device.

[0067] According to an example implementation of the present disclosure, generating the target image frame includes: generating the target image frame based on the target position using the multiple algorithm parameters.

[0068] According to an example implementation of the present disclosure, the method further includes: in response to receiving an exit request for exiting the editing page, removing the special effect interface from the client device.

[0069] According to an exemplary implementation of the present disclosure, the method further includes: clearing the cache area in response to receiving a switching request for switching the input image.

[0070] According to an example implementation of the present disclosure, loading the special effect interface from the server further includes: in response to determining that the special effect algorithm is a remote type, loading the special effect interface from the server device.

[0071] According to an example implementation of the present disclosure, the method further includes: in response to determining that the loading status of the special effect interface is failed, presenting prompt information indicating the loading failure.

[0072] Example devices and equipment

[0073] FIG8 shows a block diagram of an apparatus 800 for generating a video according to some implementations of the present disclosure. The apparatus includes: a first rendering module 810 configured to render a processing page for processing an input image on a client device; a loading module 820 configured to, in response to receiving a load request for the processing page, load a special effects interface for invoking a special effects algorithm on a server device corresponding to the client device to generate an output video with a predetermined special effect based on the input image; and a second rendering module 830 configured to, in response to determining that the loading status of the special effects interface is successful, render an editing page for editing the output video.

[0074] According to an exemplary implementation of the present disclosure, the editing page includes: a preview area for presenting the output video, and a management control for managing the playback of the output video.

[0075] According to an example implementation of the present disclosure, the device further includes: a determination module configured to determine a target position in the output video of a target image frame to be presented in the preview area in response to receiving a management request for a management control; a generation module configured to generate a target image frame corresponding to the target position using a special effects interface; and an image presentation module configured to present the target image frame in the preview area.

[0076] According to an exemplary implementation of the present disclosure, the apparatus further includes: a third presentation module configured to present a loading page indicating the loading progress of the special effect interface.

[0077] According to an example implementation of the present disclosure, the loading module includes: a creation module configured to create a cache area at a client device; and a writing module configured to write multiple algorithm parameters generated by the special effect algorithm into the cache area.

[0078] According to an example implementation of the present disclosure, the writing module includes: a parameter acquisition module, configured to obtain target algorithm parameters from the multiple algorithm parameters from the server device via the special effects interface; and a parameter writing module, configured to write the target algorithm parameters into the cache area.

[0079] According to an example implementation of the present disclosure, the parameter acquisition module includes: a remote acquisition module configured to acquire the target algorithm parameters from a server device in response to determining that the target algorithm parameters do not exist in the cache area.

[0080] According to an exemplary implementation of the present disclosure, the generating module includes: a reading module configured to generate the target image frame based on the target position by utilizing the multiple algorithm parameters.

[0081] According to an exemplary implementation of the present disclosure, the apparatus further includes: a removal module configured to remove the special effect interface from the client device in response to receiving an exit request for exiting the editing page.

[0082] According to an exemplary implementation of the present disclosure, the apparatus further includes: a switching module configured to clear the cache area in response to receiving a switching request for switching the input image.

[0083] According to an exemplary implementation of the present disclosure, the loading module includes: a remote loading module configured to load a special effect interface from a server device in response to determining that the special effect algorithm is a remote type.

[0084] According to an example implementation of the present disclosure, the apparatus further includes: a fourth presentation module configured to present prompt information indicating a loading failure in response to determining that the loading status of the special effect interface is a failure.

[0085] FIG9 shows a block diagram of a device 900 capable of implementing various implementations of the present disclosure. It should be understood that the computing device 900 shown in FIG9 is merely exemplary and should not be construed as limiting the functionality and scope of the implementations described herein. The computing device 900 shown in FIG9 can be used to implement the methods described above.

[0086] As shown in FIG9 , computing device 900 is in the form of a general-purpose computing device. Components of computing device 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage devices 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. Processing unit 910 may be a real or virtual processor and is capable of performing various processes according to a program stored in memory 920. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to increase the parallel processing capabilities of computing device 900.

[0087] The computing device 900 typically includes a plurality of computer storage media. Such media can be any available media accessible to the computing device 900, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 can be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 930 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data (e.g., training data for training) and can be accessed within the computing device 900.

[0088] The computing device 900 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 9 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 920 may include a computer program product 925 having one or more program modules configured to perform various methods or actions of various implementations of the present disclosure.

[0089] The communication unit 940 enables communication with other computing devices via a communication medium. Additionally, the functionality of the components of the computing device 900 can be implemented as a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the computing device 900 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or other network nodes.

[0090] Input device 950 may be one or more input devices, such as a mouse, keyboard, or trackball. Output device 960 may be one or more output devices, such as a display, a speaker, or a printer. Computing device 900 may also communicate with one or more external devices (not shown) via communication unit 940, as needed, such as storage devices, display devices, or the like, with one or more devices that allow a user to interact with computing device 900, or with any device that allows computing device 900 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0091] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is provided, on which a computer program is stored, and when the program is executed by a processor, the method described above is implemented.

[0092] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0093] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0094] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0095] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0096] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for generating a video, comprising: presenting, at the client device, a processing page for processing the input image; In response to receiving a load request for the processing page, loading a special effect interface, the special effect interface being used to call a special effect algorithm at a server device corresponding to the client device to generate an output video with a predetermined special effect based on the input image; as well as In response to determining that the loading status of the special effect interface is successful, presenting an editing page for editing the output video.

2. The method according to claim 1, wherein the editing page comprises: A preview area for presenting the output video, and management controls for managing the playback of the output video.

3. The method according to claim 2, further comprising: In response to receiving a management request for the management control, determining a target position in the output video of a target image frame to be presented in the preview area; Using the special effect interface, generating the target image frame corresponding to the target position; as well as The target image frame is presented in the preview area.

4. The method according to claim 1, further comprising: A loading page indicating the loading progress of the special effect interface is presented.

5. The method according to claim 3, wherein loading the special effect interface comprises: creating a cache area at the client device; as well as A plurality of algorithm parameters generated by the special effect algorithm are written into the cache area.

6. The method according to claim 5, wherein writing the plurality of algorithm parameters into the cache area comprises: Acquiring a target algorithm parameter among the plurality of algorithm parameters from the server device via the special effect interface; as well as The target algorithm parameters are written into the cache area.

7. The method according to claim 6, wherein obtaining the target algorithm parameters comprises: In response to determining that the target algorithm parameter does not exist in the cache area, the target algorithm parameter is acquired from the server device.

8. The method according to claim 3, wherein generating the target image frame comprises: The target image frame is generated based on the target position using the multiple algorithm parameters.

9. The method according to claim 1, further comprising: In response to receiving an exit request for exiting the editing page, the special effect interface is removed from the client device.

10. The method according to claim 5, further comprising: In response to receiving a switching request for switching the input image, the buffer area is cleared.

11. The method according to claim 1, wherein loading the special effect interface from the server further comprises: In response to determining that the special effect algorithm is of a remote type, the special effect interface is loaded from the server device.

12. The method according to claim 1, further comprising: In response to determining that the loading status of the special effect interface is failed, a prompt message indicating the loading failure is presented.

13. An apparatus for generating a video, comprising: A first presentation module, configured to present a processing page for processing an input image at a client device; a loading module configured to load a special effect interface in response to receiving a loading request for the processing page, wherein the special effect interface is used to call a special effect algorithm at a server device corresponding to the client device to generate an output video with a predetermined special effect based on the input image; as well as The second presentation module is configured to present an editing page for editing the output video in response to determining that the loading status of the special effect interface is successful.

14. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 12 when executed by the at least one processing unit.

15. A computer-readable storage medium having a computer program stored thereon, the computer program causing a processor to implement the method according to any one of claims 1 to 12 when the computer program is executed by the processor.

Images