Methods for generating source packets, video editing methods, apparatus, devices, and media

Abstract

The embodiments of the present disclosure relate to a material packet generating method, a video editing method, an apparatus, a device, and a medium. The material packet generating method includes: acquiring an editing record file of a target video, where the target video is a video obtained by synthesizing a specified material with an initial video through an editing operation, and the editing record file includes editing record information for recording the editing operation, the initial video, and the specified material; acquiring a target material and application information of the target material based on the editing record file, where the application information includes editing record information of the target material in the target video and the target material belongs to the specified material; and generating a material packet for video editing based on the target material and its application information.

Description

Technical Field

[0001] [Cross-reference to Related Applications] This application claims the priority of a Chinese patent application with an application number of 202210320553.X and a filing date of March 29, 2022, and all the contents of the said application are incorporated herein by reference.

[0002] This disclosure relates to the technical field of data processing, and particularly to a method for generating material packets, a video editing method, an apparatus, a device, and a medium.

Background Art

[0003] Video producers usually use materials such as text, stickers, music, special effects, etc. during video production to enhance the expressiveness of the video. And to ensure the effect, as materials used in the same video, the same theme or the same style is preferably adopted. However, since it is difficult to find materials of the same theme or style, material packets have emerged due to this situation. Producers can pack materials belonging to the same theme or style and share them with other users.

Summary of the Invention

[0004] Embodiments of this disclosure provide a method for generating a material packet applied to a first client. This method includes obtaining an editing record file of a target video, where the target video is a video obtained by synthesizing specified materials into an initial video through an editing operation, and the editing record file includes editing record information for recording the editing operation and the initial video and the specified materials; obtaining target materials and application information of the target materials based on the editing record file, where the application information includes editing record information of the target materials in the target video, and the target materials belong to the specified materials; and generating a material packet for video editing based on the target materials and their application information.

[0005] Embodiments of the present disclosure further provide a video editing method applicable to a second client, the method comprising: acquiring a video to be edited; acquiring a designated material packet corresponding to a material packet application instruction in response to receiving such instruction, wherein the designated material packet is generated by the material packet generation method of any one of the above paragraphs; and performing editing on the video to be edited based on the designated material packet.

[0006] Embodiments of the present disclosure further provide a material packet generation device applicable to a first client, the device comprising: a file acquisition module for acquiring an edit record file of a target video, wherein the target video is a video obtained by compositing specified material with an initial video by an editing operation, and the edit record file includes an edit record information for recording the editing operation, the initial video, and the specified material; an information acquisition module for acquiring the target material and application information of the target material based on the edit record file, wherein the application information includes the edit record information of the target material in the target video, and the target material belongs to the specified material; and a material packet generation module for generating material packets for video editing based on the target material and its application information.

[0007] Embodiments of the present disclosure further provide a video editing apparatus applicable to a second client, the apparatus comprising: a video acquisition module for acquiring a video to be edited; a material packet acquisition module for acquiring a specified material packet corresponding to a material packet application command in response to receiving a material packet application command, wherein the specified material packet is generated by the material packet generation method described in any one of the above paragraphs; and a video editing module for performing editing on the video to be edited based on the specified material packet.

[0008] Embodiments of the present disclosure further provide an electronic device comprising a processor and a memory for storing instructions executable by the processor, wherein the processor reads the executable instructions from the memory and executes the instructions to realize a method for generating material packets or a video editing method according to embodiments of the present disclosure.

[0009] Embodiments of the present disclosure further provide a computer-readable storage medium in which a computer program is stored, and the computer program is used to perform a method for generating material packets or a video editing method according to embodiments of the present disclosure.

[0010] Embodiments of the present disclosure further provide a computer program including instructions, which, when the instructions are executed by a processor, cause the processor to execute a method for generating material packets or a video editing method according to embodiments of the present disclosure.

[0011] It should be understood that the content described in this section is not intended to identify the gist or key features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure are readily apparent from the following specification. [Brief explanation of the drawing]

[0012] The drawings here are incorporated into the specification and constitute part of this specification, illustrating embodiments suitable for this disclosure, and are used together with the specification to interpret the principles of this disclosure.

[0013] To more clearly illustrate the embodiments of this disclosure or the technical proposals in the prior art, the following briefly introduces the drawings necessary for describing the embodiments or the prior art. Obviously, a person skilled in the art can obtain other drawings based on these drawings without expending any creative effort. [Figure 1] This is a schematic flowchart of the method for generating material packets according to the embodiments of this disclosure. [Figure 2]This is a schematic diagram of a material packet protocol according to an embodiment of the present disclosure. [Figure 3] This is a schematic flowchart of the generation of material packets according to the embodiments of this disclosure. [Figure 4] This is a schematic flowchart of the processing of local material according to the embodiments of this disclosure. [Figure 5] This is a schematic flowchart of a video editing method according to an embodiment of the present disclosure. [Figure 6] This is a schematic flowchart illustrating the application of material packets according to the embodiments of this disclosure. [Figure 7] This is a schematic diagram of the structure of a material packet generation device according to an embodiment of the present disclosure. [Figure 8] This is a schematic diagram of the structure of a video editing device according to an embodiment of the present disclosure. [Figure 9] This is a schematic diagram of the configuration of an electronic device according to an embodiment of the present disclosure. [Modes for carrying out the invention]

[0014] To provide a clearer understanding of the above-mentioned objectives, features, and advantages of this disclosure, the proposed technical concepts of this disclosure are further described below. It should be noted that, to the extent that they do not contradict each other, the embodiments and features of this disclosure can be combined with each other.

[0015] Many details are specifically described below in order to fully understand this disclosure, but this disclosure may be implemented in a different form than that described herein, and naturally, the examples in this specification are only a selection of examples, not all examples, of this disclosure.

[0016] The inventors of this disclosure have found that in the prior art, the method of creating material packets by creators is cumbersome, and for example, in order to obtain material packets, it is necessary to first create an effect video and then cut out material from the effect video.

[0017] In view of this, the present disclosure provides a method for generating a material packet to simplify the creation process of the material packet.

[0018] FIG. 1 is a schematic flowchart of a method for generating a material packet according to an embodiment of the present disclosure. This method may be applied to a first client implemented by, for example, a mobile phone, a computer, or the like. Embodiments of the present disclosure do not limit the implementation form of the first client. A user on the production side (for example, the producer of the material packet) may use the first client to generate the material packet. As shown in FIG. 1, this method mainly includes the following steps S102 to S106.

[0019] Step S102, obtain an editing record file of the target video. The target video is a video obtained by synthesizing specified materials into an initial video through an editing operation.

[0020] In some embodiments, in response to receiving a material packet generation instruction started by the user, an editing record file of the target video may be obtained. Here, the target video is a video obtained by synthesizing specified materials into an initial video through an editing operation. That is, the target video may be a video obtained by editing an initial video by adopting the specified materials of the material packet to be created by the user (the producer of the material packet). The target video may also be called an exemplary video of the material packet.

[0021] In some embodiments of the present disclosure, the editing record file includes editing record information for recording editing operations, the initial video, and designated materials. For example, in the video editing software according to the embodiments of the present disclosure, the editing process in which the user creates a video can be completely recorded to obtain a clip operation sequence for the initial video, materials used in each clip operation in the clip operation sequence, and the specific usage method of materials in the initial video, etc., so as to form an editing record file. For example, the editing record file is a protocol used by video editing software to record the video editing state, and it may store all information in the process of the user editing the video, such as elements added by the user during video editing, adjusted parameters, and the user's operations, etc. When the user opens the video again, the previous editing state can be restored by automatically reading the editing record file corresponding to this video.

[0022] In the embodiments of the present disclosure, the producer of the material packet does not need to cut out the material from the video, but can directly obtain the editing record file of the video and generate the material packet according to the editing record file.

[0023] Step S104: Based on the editing record file, obtain the target material and the application information of the target material. The application information includes the editing record information of the target material in the target video.

[0024] Here, the target material belongs to the specified material. In some implementations, all the material in the specified material may be designated as the target material. Since the creator of the material packet may not wish to pack and share all the material, only a selection of material from the specified material chosen by the creator of the material packet may be designated as the target material. The target material may be determined according to user needs, and is not limited here; given that the editing record file is known, application information for the target material can be directly extracted from it. The application information includes editing record information in the target video of the target material. The editing record information may include one or more of the following: position information, rotation information, zoom information, and track information. Furthermore, the application information may include the acquisition path of the target material. This acquisition path is used to indicate the method of acquiring the material. For example, when the material is uploaded from a local source, the acquisition path of this material may be a file acquisition path, and when the material is downloaded from a network, the acquisition path of this material may be a network acquisition path.

[0025] Furthermore, the materials in the embodiments of this disclosure include, but are not limited to, one or more of the following: video, images, stickers, text, music, special effects, and filters. The editing record information includes, for example, one or more of the following: position information, zoom information, and track information in the video material, and may be specifically determined based on the type of material. For example, when the material is video, images, stickers, or text, the corresponding application information may include position information, zoom information, and track information, and when the material is images, stickers, and text, it may also include rotation information, and when the material is music or special effects, the corresponding application information may include track information. The above are merely examples and should not be considered limitations.

[0026] Step S106: Generate a material packet for video editing based on the target material and its application information. After the target material and its application information are known, the first client may automatically pack and generate a material packet for video editing based on the target material and its application information. The generated material packet may then be sent to the server, which may distribute this material packet on a designated platform. The designated platform enables the sharing of the material packet, and other users may download and use this material packet from the designated platform.

[0027] In summary, embodiments of the present disclosure provide a method for generating material packets applicable to a first client, the method comprising: obtaining an editing record file of a target video, wherein the target video is a video obtained by compositing specified material onto an initial video through an editing operation, the editing record file containing editing record information for recording the editing operation, the initial video, and the specified material; obtaining target material and application information of the target material based on the editing record file, wherein the application information contains the editing record information of the target material in the target video, and the target material belongs to the specified material; and generating material packets for video editing based on the target material and its application information. For the creator of the material packets, it is no longer necessary to cut out material from the video piece by piece to create material packets, and material packets can be generated directly based on the target material and application information in the video editing record file, thereby simplifying the material packet creation process.

[0028] In some embodiments, the step of acquiring target material and application information of the target material based on the editing record file may include the following two main steps (1) and (2).

[0029] Step (1) All materials in the specified material are designated as target materials, or materials in the target material that have a distribution permission identifier are designated as target materials. That is, in actual application, this may be implemented by referring to the following two examples of implementation.

[0030] Example 1 of implementation: All materials in the specified materials are treated as target materials. If no specific materials are specified, all specified materials may be treated as target materials by default.

[0031] Example 2 of implementation: Target materials are those that have a distribution permission identifier. In actual application, creators may be provided with material checkboxes. Creators may check the specified materials to be used in creating their target video and assign a distribution permission identifier to the checked materials. This method takes into full consideration the needs of creators and distributes only the materials that creators permit, while not distributing some private materials that creators do not wish to have widely used.

[0032] Depending on the actual situation, the implementation may be flexibly selected from Example 1 and / or Example 2 above. Users may be given the option to "distribute all materials" or "distribute only some materials." If the user chooses to "distribute all materials," the implementation may be carried out using Example 1 above, and if the user chooses to "distribute only some materials," the implementation may be carried out using Example 2 above. In particular, if the target materials include local materials from the creator, the user (creator of the material packet) can assign distribution permission identifiers to the specified materials they wish to distribute using material checkboxes, and the packing can be done while fully respecting the user's wishes, by packing only the materials the user wishes to upload. Here, local materials are materials that the user uploads via the primary client, such as images uploaded by the creator from a local album, or materials such as stickers and videos uploaded by the creator from a local folder. In other words, local materials are materials that are stored locally on the terminal, not materials that are publicly downloadable over the network. The creator can specify which materials can be packed into the material packet according to the demand, providing greater flexibility.

[0033] Step (2) The editing record information in the target video of the target material recorded in the editing record file is used as the application information of the target material. Here, the editing record information includes one or more of the following: position information, rotation information, zoom information, and track information. In actual applications, the editing record information corresponding to different types of material may be different, and each type of material can correspond to one or more types of editing record information, and this is not limited here.

[0034] To conserve memory in the source packet sufficiently and effectively, the application information of the target source further includes the acquisition path of the target source. Furthermore, the target source identifier and application information (including the acquisition path and editing record information of this target source) may be stored in the source packet without directly packing the target source into the source packet. This allows users of the source packet to clearly understand how to acquire and use the target source.

[0035] Creators of material packets often use their own original local materials, such as original images, stickers, music, and short videos, in the process of creating the material packets, thereby providing fresh material to other users. Therefore, target material generally includes at least one type of local material. In many cases, creators of material packets not only use local material but also remote material; that is, the created material packet includes not only the creator's local material but also remote material (original remote material) downloaded by the creator via the network, where the remote material is material stored on a server and publicly available for download. Embodiments of this disclosure can directly identify the type of material (local / remote) in the target material and perform the appropriate processing. For example, to save memory in the material packet, instead of storing local material in the material packet, the local material may first be distributed to the server and converted into new remote material. After that, the material packet only needs to store identifiers for the original remote material and the new remote material (local material), as well as application information including the material acquisition route and editing record information. Such a processing method requires a small amount of material packet capacity and is very easy to download and propagate.

[0036] As described above, the embodiments of this disclosure provide specific embodiments for generating material packets for video editing based on target material and its application information, which may be specifically implemented by referring to the following steps A to C.

[0037] Step A: Upload the local material in the target material to the server, and the server converts the local material into new remote material, where the remote material is stored on the server and is publicly available for download.

[0038] In practical applications, local material for target material may be automatically uploaded to a designated server, and then the server may distribute the local material to a designated platform. After distribution, the local material becomes new remote material. Material storage and distribution may be performed by the same server or by different servers. For example, local material may be uploaded to a storage server, the storage server may store the local material, and then the local material may be sent to a material server, which may distribute the local material to a designated platform.

[0039] Step B: The server returns a remote material identifier corresponding to the new remote material, replaces the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and the replaced application information becomes the application information corresponding to the new remote material.

[0040] When the server distributes local material as remote material, it assigns a new material identifier to the remote material. This material identifier may be a remote material identifier or a resource ID. The remote material identifier is the ID identifier of the remote material, and different remote material identifiers are also different. To make it easier to understand, for the creator of a material packet, the file acquisition path for the local material is recorded in the editing log file because the material packet is created using locally stored material. However, when local material is publicly distributed as new remote material, other users who download the material packet only need to know the remote material identifier of the remote material in the material packet, and can download the corresponding remote material from the server using the remote material identifier. This method allows other users to easily use the local material of the material packet creator.

[0041] It should also be noted that the editing record information in the application information remains unchanged; that is, for local material in target material, the corresponding application information includes the editing record information in the target video of the local material (abbreviated as material editing record information) and the file acquisition path of the local material. When the server converts the local material to remote material, the application information corresponding to this remote material includes the above material editing record information and a remote material identifier corresponding to the remote material. In the embodiments of this disclosure, both the remote material identifier and the file acquisition path can be used to indicate the specific acquisition method of the material, and both belong to the representation format of the acquisition path of the target material included in the application information.

[0042] Step C generates a video editing material packet based on the new remote material and its application information, as well as the original remote material and its application information in the target material. Here, the original remote material is the material that the first client downloads from the server in the process of generating the target video.

[0043] Since the creator's local material has been converted into remote material usable by others, video editing material packets may then be generated directly based on the new remote material and its application information, as well as the original remote material and its application information. To understand this, all the material in the material packets obtained by the above method is remote material; some is new remote material created by the creator distributing local material via a server, and some is the original remote material downloaded by the creator over the network.

[0044] In the above method, local material and application information can be acquired directly based on the editing record file, and the local material can be distributed as new remote material. The acquisition path in the application information of the local material can be replaced with a remote material identifier, and other content of the application information can be retained as is. Finally, a material packet can be generated based on the new remote material and its application information. For the creator of the material packet, it is no longer necessary to cut out material from the video piece by piece to create the material packet, simplifying the material packet creation process. Furthermore, since there is no need to store the material in the material packet, and only the acquisition path and editing record information of the material need to be stored, the required memory is small, and it is easy to download and propagate.

[0045] As stated above, the embodiments of this disclosure may be considered to redefine the material packet protocol, which clearly indicates the method of applying the material. In other words, the material packet protocol may be understood as the aggregated content of the material application information, and the material packets according to the embodiments of this disclosure include a material set and the material packet protocol (i.e., material application information). Referring to the schematic diagram of the material packet protocol shown in Figure 2, the application information corresponding to several types of material that may be included in the material packet is schematically shown. Figure 2 briefly shows material types such as video, images, stickers, text, music, and special effects, and the application information corresponding to each material type. Here, the file path is the acquisition route of the local material as described above, and the resource ID is the remote material identifier as described above, and both the file path and resource ID indicate the method of acquiring the material. It should be noted that Figure 2 is only a simple example and should not be considered a limitation, and in actual applications, the material may not be limited to these but may also include, for example, filters, sound effects, etc. Furthermore, the elements listed in Figure 2 are all selective and can be combined, and do not necessarily have to be present at the same time, and may be customized according to actual needs and specific video editing software. In short, the material packet needs to record all the information about the material so that the effect of each material can be fully restored in subsequent applications. Also, the material packet shown in Figure 2 is the creator's initial material packet and has not yet been distributed, and the file paths of the local material have not yet been replaced, so some material may correspond to file paths (i.e., they may be local material). Once the local material is distributed, its corresponding file path is replaced with the remote material identifier of the corresponding remote material, and all material included in the finally formed material packet will correspond to resource IDs rather than file paths. In actual applications, compared to conventional material packets which are merely material sets, the material packets according to the embodiments of this disclosure include the material set and further include the material packet protocol described above, i.e., the material and the relevant application information.By providing application information that shows how to use the materials and how to obtain them, users who download material packets can clearly understand how each material is used in a video and fully recreate the effect the creator of the material packet used in the video.

[0046] In some embodiments, in order to further improve the efficiency of generating material packets and the convenience of use, the original editing record file may be kept unchanged and a copy may be made to the editing record file. By directly processing the copy to obtain material packets, that is, by modifying the editing record file into material packets, users who download the material packets can directly apply these material packets (modified editing record files). Specifically, users who download the material packets do not need to add each material in the material packets to the video one by one. After downloading the material packets, they can directly use the material packets as an editing record file in the video that needs editing, and completely restore the specific way in which the creator uses the materials in the video (e.g., position, rotation, zoom, track, etc.). Based on this, the step of replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and making the replaced application information the application information corresponding to the new remote material, may be performed by referring to steps a to b below.

[0047] Step a: Duplicate the editing record file to obtain a copy of the editing record file.

[0048] Step b: The copy is processed such that local material is deleted from the copy, the acquisition path recorded in the application information of the local material is replaced with the remote material identifier of the new remote material, and the replaced application information becomes the application information corresponding to the new remote material recorded in the copy. In some specific embodiments, the local material and associated information may be deleted and the acquisition path corresponding to the local material based on the mapping relationship may be replaced with the remote material identifier, while in others, it may be retained as is. This simple and clever method allows existing editing record files to be directly converted into usable material packets without rewriting the application logic.

[0049] As described above, the step of generating a video editing material packet based on new remote material and its application information includes generating a video editing material packet based on a processed copy, where the processed copy includes the remote material identifier and applicable application information of the new remote material. This may be implemented by referring to the following steps (1) to (3).

[0050] Step (1) Obtain the cover image of the specified source packet and upload the source packet cover image to the server. The source packet cover image may be specified by the creator, or if not specified, the default source packet cover image may be selected and used.

[0051] Step (2) retrieves pre-configured option information for the material packet, where the option information for the material packet includes one or more of the following: target video, material version information, and material compatibility information. The target video is an exemplary video obtained by editing multiple types of material, and it may be decided whether to include the target video in the material packet depending on the actual need. In some embodiments, the target video may be included in the material packet. In some other embodiments, the target video may not be included in the material packet, and the target video may be made as material that is independent of the material packet and associated with the material packet. This reduces the size of the material packet as much as possible. Other users may download only the material packet, and when they need to view an example of how to use the material packet, they may download or view the associated target video online. The material version information and material compatibility information mentioned above may both be considered to belong to the extra.json extension file and are used to record some special logic for processing the material packet, such as specific application methods of the material packet on different terminals. For example, the size of materials that can be used normally on iOS (registered trademark) is 200*200, while the size that can be used normally on Android (registered trademark) is 300*300.

[0052] Step (3) The cover image of the source packet, the processed copy, and the option information of the acquired source packet are packed and compressed to obtain a compressed packet, which is used as the source packet for video editing. For example, the cover image of the source packet, the processed copy, and the option information of the acquired source packet may be packed to generate a Zip packet and then delivered to the background server, thereby achieving the distribution and delivery of the source packets.

[0053] Furthermore, embodiments of this disclosure provide a technical implementation for replacing the acquisition path recorded in the application information of local material with the remote material identifier of new remote material, which includes deleting the acquisition path recorded in the application information of local material and changing the local material identifier field in the application information of local material to the remote material identifier of new remote material. In some embodiments of this disclosure, in order to identify the download origin of each remote material, the remote material in the target material is accompanied by a material source identifier to indicate the material storage location of the remote material. The material source identifier may be used to distinguish the platform from which the remote material is downloaded. After the local material in the target material is converted into new remote material by the server, the remote material identifier of the new remote material may be acquired by the server. In a practical application, the target platform from which this remote material is downloaded may be determined based on the material source identifier, and the corresponding remote material is downloaded from the target platform based on the remote material identifier. That is, an additional field may be added to each remote material in the material packet to identify the download origin. For example, the material source identifier field is set to source_plaform, and the value of source_plaform can be, for example, 0, 1, 2, 3, 4, etc., with different values ​​representing different download platforms. In actual applications, there may be multiple platforms (or servers) used to download the material, and this value can be used as the identifier for the material download platform. For ease of understanding, the following example illustrates how to change the identifier field of the target local material to the remote material identifier (remote_id) and the newly added material source identifier (source_platform).

[0054] 1) For video material: Use remote_id to replace the material_id in the original materials.videos, and add source_platform=1.

[0055] 2) For audio (music) material: Use remote_id to replace music_id in the original materials.audios and add source_platform=2.

[0056] 3) Image material: Use remote_id to replace the image_id in the original materials.image and add source_platform=1.

[0057] 4) Sticker material: Use remote_id to replace the sticker_id in the original materials.image and add source_platform=1.

[0058] 5) Text material: First, delete the text segment, then add a new character template segment with source_platform=1.

[0059] The above is merely an illustrative explanation and should not be considered a limitation. In the material packet application process, the material acquisition platform can be determined based on source_platform, and the corresponding remote material can be downloaded from the material acquisition platform based on remote_id, thereby obtaining all the material in the material packet and directly applying the material packet based on the material packet protocol.

[0060] As mentioned above, the embodiments of this disclosure provide an example of converting an editing record file already possessed by a producer into a new material packet for distribution. Referring to the schematic flowchart of material packet generation shown in Figure 3, the specific method for converting an editing record file into a material packet is schematically shown, and the execution body for each part is clearly indicated. As shown in this figure, based on the analysis of the editing record file, the terminal can obtain local material used by the producer for video editing, the original remote material and material packet video, cover image, etc. The local material is distributed as remote material by the server, and after obtaining the remote material identifier fed back from the server, the draft protocol is modified (to create an editing record file). Specifically, as described above, the method of modification involves modifying the acquisition path of the local material to the remote material identifier corresponding to the remote material obtained through distribution, uploading the material packet video and cover image to the server, and then packing them with the original remote material and the modified draft protocol to obtain a new material packet. Finally, this new material packet is distributed by the server. It is important to note that Figure 3 illustrates that different processing methods are used in the process of generating material packets for different types of materials (local material, remote material, material packet video, or cover image). For example, local material must be delivered as remote material by the server, and the protocol must be modified for this local material (the acquisition path for this local material in the editing record file must be modified to the remote material identifier). The original remote material can participate in packing directly without any further processing. Material packet video and cover image must be uploaded to the server and stored before participating in packing. In actual applications, it is not always the case that all three types of material are present. For example, some producers use only local material (e.g., local video, local music, local stickers, text, etc.) for video editing, so the material packets do not contain the original remote material (e.g., stickers, special effects, filters, text templates, music, sound effects, etc.).Some producers may decide not to pack source video packets into source packets, meaning that source video packets may not exist. However, in any case, source packets are related to local source material for the purpose of creating source packets by producers.

[0061] Furthermore, as mentioned above, the embodiments of this disclosure provide a schematic flowchart of local material processing shown in Figure 4, illustrating the flow for distributing local material as new remote material. As shown in Figure 4, the editing record file contains local material (local images, local audio) and original remote material (remote stickers, special effects, etc.). Local material may be uploaded to a storage server and distributed to a material server for public use. For example, after uploading local material to a storage server, the corresponding URL and KEY may be determined, and the material may be distributed to the material server based on the URL and KEY to form remote material. Once distributed by the server, the server's remote material identifier (remote_id) can be obtained, and since the local material is replaced with the remote material, everything included in the generated material packet is remote material. Specifically, the original local image is replaced with a remote image, and the local audio is replaced with remote music. Figure 4 also shows that a new material origin identifier (source_platform) can be added to the new remote material to identify its origin.

[0062] In some embodiments, the method further includes associating the title information and summary information of the source packet with the source packet in response to receiving the title information and summary information of the source packet.

[0063] In practical applications, the user terminal interface may provide a title box and a summary box for the material packet. This allows the creator of the material packet to enter the title of the material packet in the title box and a theme description in the summary box. This allows other users downloading the material packet to have a clearer understanding of its theme and style, enabling them to quickly determine whether they need to download it based on their needs.

[0064] In summary, the method for generating source packets according to the embodiments of this disclosure simplifies the source packet creation process and improves the efficiency of source packet generation, as it eliminates the need for the source packet creator to individually cut out source material from video to create source packets. For users of source packets, the source packets are easier to use because they include application information for the source material.

[0065] When a creator uses materials to create an effect video (the target video mentioned above), they can determine the necessary target local materials according to demand and deliver material packets with a single key, which is extremely convenient and fast. The material packet may not only record the material set, but also include a material packet protocol. Specifically, it records usage record information such as the location information, zoom information, and track information of each material, as well as the specific acquisition method of the material (e.g., remote material identifier). When other users apply it with a single key, they can automatically acquire the material based on the identifier and directly restore the display effect of each material in the video based on the usage record information. Furthermore, since the material packet is obtained directly from the editing record file, other users can directly apply the material packet as a whole. Compared to the prior art in which the material packet only contained the material set, and users of the material packet had to repeatedly adjust it because they did not know how to specifically apply each material even after obtaining the material packet, the above method according to the embodiment of this disclosure improves the usability of the material packet.

[0066] The inventors of this disclosure have further found that in the prior art, the material packets created are merely collections of individual materials, and even if other users obtain the material packets, they do not know how to specifically apply the materials within them, making the material packets very difficult to use.

[0067] In view of this, embodiments of the present disclosure further provide a video editing method for improving the usability of source packets.

[0068] Building upon the aforementioned method for generating source packets, embodiments of this disclosure provide a video editing method. This method is applied to a second client. The second client may be implemented by, for example, a mobile phone or a computer, and embodiments of this disclosure do not limit the implementation form of the second client. Consumer users (e.g., users of source packets) can use the second client to obtain source packets and use the source packets to perform video editing. As shown in Figure 5, this method mainly includes the following steps S502 to S506.

[0069] Step S502: Obtain the video to be edited. The video to be edited may be the original video uploaded by the user.

[0070] In step S504, in response to receiving a material packet application instruction, the specified material packet corresponding to the material packet application instruction is obtained. The specified material packet is generated by the material packet generation method described in any one of the embodiments of this disclosure described above, which is not described here.

[0071] In some specific implementation examples, in response to detecting a trigger operation of the material packet function, the interface of the second client may present multiple target videos, each corresponding to a single material packet. Furthermore, in response to detecting a target video selection operation, it may be determined that a material packet application command has been received, and the material packet corresponding to the selected target video may be made into a designated material packet corresponding to the material packet application command.

[0072] In practical applications, video editing software can provide users with video editing functions and present identifiers for multiple video editing functions in a second-party client interface. These video editing functions include source packet functions. When the software detects that a user (a user of source packets) has clicked a source packet function identifier or button, it may be considered that a trigger operation for the source packet function has been detected, and the software then presents multiple target videos in the second-party client interface. Target videos are videos generated and distributed by the source packet creator. Target videos are obtained by compositing target material into the initial video through editing operations. Each target video corresponds to one source packet. To understand this, a single source packet creator can generate and distribute multiple source packets, and the various target videos presented by the video editing software in the second-party client interface may, and are not limited to, those generated and distributed by different source packet creators. By presenting multiple target videos in the interface, users of source packets can intuitively grasp the effect of applying the source packets to their videos and select the necessary source packets. In the embodiments of this disclosure, when it is detected that a user has clicked on a target video, it is assumed that the user requires a source packet corresponding to this target video. Therefore, the source packet corresponding to this target video can be directly made into a specified source packet corresponding to a source packet application instruction, which is very convenient, fast, and easy to implement.

[0073] In some embodiments, obtaining a specified material packet corresponding to a material packet application instruction involves sending the identifier of the specified material packet to the server, which then downloads the specified material packet corresponding to the material packet application instruction. In actual applications, the server may store the entire content of the material packets, and when a second client determines which specified material packet is needed by the user, it can directly download the content of this specified material packet from the server, and the material packets may directly contain the material and application information.

[0074] Step S506: Edit the video to be edited based on the specified material packet.

[0075] In some embodiments, editing a video to be edited based on a specified source packet includes compositing the material in the specified source packet into the video to be edited based on the application information of the material in the specified source packet. In practical applications, a second client can automatically composite the material in the specified source packet into the video to be edited according to the application information, based on the content contained in the specified source packet, eliminating the need for the user of the source packet to individually select the material in the source packet and edit the video, thereby improving the usability of the source packet.

[0076] In summary, embodiments of the present disclosure provide a video editing method applicable to a second client, which includes acquiring a video to be edited, acquiring a designated material packet corresponding to a material packet application instruction in response to receiving such instruction, wherein the designated material packet is generated by the material packet generation method described above, and performing editing on the video to be edited based on the designated material packet. According to the above video editing method, since the material packet contains material application information, users of the material packets can directly perform video editing based on the material packets. This makes the use of material packets easier.

[0077] For ease of understanding, after obtaining the specified material packet, the embodiments of this disclosure further provide a schematic flowchart of the material packet application shown in Figure 6, schematically illustrating the specific application process after another user has downloaded the specified material packet. In addition to Figure 4, Figure 6 schematically illustrates that the restoration of the editing record file can be achieved by requesting the material server to download and obtain remote images and remote music based on the image remote_id and music remote_id. It should be noted that Figure 6 is merely an illustrative explanation, and the point is to show the restoration flow of local images / local audio delivered as new remote material in the material packet usage process, and does not show the application process of the original remote material (e.g., remote stickers, special effects). In actual situations, the original remote material of the material packet also needs to be requested from the material server based on the corresponding remote_id to download the specific remote material. Furthermore, the editing record file in Figure 6 contains "local images" and "local audio," which primarily indicates that these are local images / audio provided by the creator. However, for users downloading material packets, all the materials in the resulting material packets (which are essentially the editing record file) are remote materials.

[0078] As shown in Figure 6, the material packets obtained by a user who downloads material packets are essentially editing log files. As shown in Figures 3 and 4, only the local material is replaced with remote material and the identifier field of the editing log file is replaced with the remote material identifier. Since the format of the editing log file is not essentially changed, the format of the editing log file created by restoring the material packets is the same as the format of the original editing log file. This allows the user who downloads the material packets to directly restore the effect of each material on the target video in the video they intend to edit. This method improves the ease with which users can edit videos using material packets.

[0079] Corresponding to the method for generating source packets described above, the embodiment of this disclosure provides a source packet generation device applicable to a first client. Referring to the schematic diagram of the source packet generation device shown in Figure 7, it mainly comprises a file acquisition module 702, an information acquisition module 704, and a source packet generation module 706.

[0080] The file acquisition module 702 acquires an editing record file of the target video, where the target video is a video obtained by compositing specified material with an initial video through an editing operation, and the editing record file includes editing record information for recording the editing operation, the initial video, and the specified material.

[0081] The information acquisition module 704 acquires target material and application information of the target material based on the editing record file, wherein the application information includes editing record information in the target video of the target material, and the target material belongs to the designated material.

[0082] The material packet generation module 706 generates material packets for video editing based on the target material and its application information.

[0083] For creators of source packets, the above device eliminates the need to cut out individual elements from video to create source packets, simplifying the source packet creation process. For users of source packets, the source packets include application information, making their use easier.

[0084] In some embodiments, the information acquisition module 704 specifically targets all of the materials in the designated materials, or targets materials that have a distribution permission identifier, and uses the editing record information in the target video of the target materials recorded in the editing record file as application information for the target materials. Here, the editing record information includes one or more of the following: position information, rotation information, zoom information, and track information.

[0085] In some embodiments, the application information of the target material further includes the acquisition path of the target material.

[0086] Specifically, the material packet generation module 706 is used to upload local material in the target material to a server and have the server convert the local material into new remote material, wherein the remote material is material stored on the server and publicly downloadable; to receive a remote material identifier corresponding to the new remote material returned from the server; to replace the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material; to make the replaced application information the application information corresponding to the new remote material; and to generate a material packet for video editing based on the new remote material and its application information, as well as the original remote material and its application information in the target material.

[0087] In some embodiments, the material packet generation module 706 is used to process the copy, specifically by duplicating the editing record file to obtain a copy of the editing record file, deleting the local material contained in the copy, replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and making the replaced application information the application information corresponding to the new remote material recorded in the copy.

[0088] In some embodiments, the material packet generation module 706 is used to generate material packets for video editing based on the processed copy, where the processed copy includes the remote material identifier and applicable application information of the new remote material.

[0089] In some embodiments, the material packet generation module 706 is used to acquire a cover image of a specified material packet, upload the cover image of the material packet to the server, and acquire pre-configured option information for the material packet, wherein the option information for the material packet includes one or more of the target video, material version information, and material compatibility information, and to pack and compress the cover image of the material packet, the processed copy, and the acquired option information for the material packet to obtain a compressed packet, which is then used as a material packet for video editing.

[0090] In some embodiments, the material packet generation module 706 is specifically used to delete the acquisition path recorded in the application information of the local material and to change the identifier field of the local material in the application information of the local material to the remote material identifier of the new remote material.

[0091] In some embodiments, the remote material in the target material is provided with a material source identifier that indicates the material storage location of the remote material.

[0092] In some embodiments, the device further includes an association module that, in response to receiving title information and summary information of a source packet, associates the title information and summary information of the source packet with the source packet.

[0093] In some embodiments, the apparatus further includes a transmission module that transmits the generated material packets to a server, causing the server to distribute the material packets on a specified platform.

[0094] The material packet generation apparatus according to the embodiments of this disclosure can perform a material packet generation method according to any embodiment of this disclosure and has functional modules and beneficial effects corresponding to the performance of the method.

[0095] For the convenience and brevity of the description, and so that those skilled in the art can clearly understand it, the specific operating processes of the apparatus embodiments described above may refer to the corresponding processes in the method embodiments, and are therefore omitted from this description.

[0096] Corresponding to the video editing method described above, an embodiment of the present disclosure provides a video editing device applicable to a second client. Referring to the schematic diagram of the video editing device shown in Figure 8, the video editing device comprises a video acquisition module 802, a source packet acquisition module 804, and a video editing module 806.

[0097] The video acquisition module 802 acquires the video to be edited.

[0098] The material packet acquisition module 804, in response to receiving a material packet application command, acquires a specified material packet corresponding to the material packet application command, where the specified material packet is generated by the material packet generation method of any one of the above-described embodiments of this disclosure.

[0099] The video editing module 806 performs editing on the video to be edited based on the specified material packet.

[0100] According to the video editing device described above, since the source packets contain application information for the source material, users can directly perform video editing based on the source packets. Therefore, using source packets becomes easier.

[0101] In some embodiments, the device further comprises a decision module used to, in response to detecting a trigger operation of the material packet function, present multiple target videos, each corresponding to a single material packet, at the interface of the second client, and in response to detecting a target video selection operation, determine that a material packet application command has been received and designate the material packet corresponding to the selected target video as the specified material packet corresponding to the material packet application command.

[0102] In some embodiments, the material packet acquisition module 804 specifically transmits the identifier of the designated material packet to the server, and the server downloads the designated material packet corresponding to the material packet application command.

[0103] In some embodiments, the video editing module 806 specifically synthesizes the material in the designated material packet into the video to be edited based on the application information of the material in the designated material packet.

[0104] A video editing apparatus according to an embodiment of the present disclosure can perform a video editing method according to any embodiment of the present disclosure and has functional modules and beneficial effects corresponding to the performance of the method.

[0105] For the convenience and brevity of the description, and so that those skilled in the art can clearly understand it, the specific operating processes of the apparatus embodiments described above may refer to the corresponding processes in the method embodiments, and are therefore omitted from this description.

[0106] Embodiments of this disclosure provide an electronic device comprising a processor and a memory for storing instructions executable by the processor, wherein the processor reads executable instructions from the memory and executes the instructions to realize the method for generating material packets or video editing the method described in any one of the above items. That is, both the first client and the second client may be realized by this electronic device.

[0107] Figure 9 is a schematic diagram of the configuration of an electronic device according to an embodiment of the present disclosure. As shown in Figure 9, the electronic device 900 includes one or more processors 901 and memory 902.

[0108] The processor 901 may be a central processing unit (CPU), or another type of processing unit having data processing capability and / or instruction execution capability, and can control other assemblies in the electronic device 900 to perform desired functions.

[0109] The memory 902 may include one or more computer program products, the computer program products may include various types of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache). The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage media, and the processor 901 can execute the program instructions to realize a method for generating material packets or a video editing method or other desired function according to the embodiments of the present disclosure described in the preceding paragraph. The computer-readable storage media may further store various things, such as input signals, signal components, noise components, etc.

[0110] As one example, the electronic device 900 may further include an input device 903 and an output device 904 connected to each other (not shown) via a bus system and / or other type of connection mechanism.

[0111] Furthermore, this input device 903 may also include, for example, a keyboard or a mouse.

[0112] This output device 904 can output various information to the outside, including determined distance information and direction information. This output device 904 may include, for example, a display, a speaker, a printer, and a communication network and remote output devices connected thereto.

[0113] Of course, for the sake of simplification, Figure 9 shows only a portion of the assembly relating to this disclosure in the electronic device 900, omitting assemblies such as buses and input / output interfaces. Furthermore, depending on the specific application, the electronic device 900 may further comprise any other suitable assemblies.

[0114] In addition to the above-described methods and equipment, embodiments of this disclosure may also be computer program products including computer program instructions, wherein when the computer program instructions are executed by a processor, the processor is instructed to execute the material packet generation method or video editing method according to embodiments of this disclosure.

[0115] The computer program product may organize program code for performing the operations of the embodiments of this disclosure using any combination of one or more programming languages, the programming languages ​​including object-oriented programming languages ​​such as Java and C++, and also including conventional process-oriented programming languages ​​such as the "C" language or similar programming languages. The program code may run entirely on a user computing device, partially on a user computing device, run as a single standalone software pack, run partly on a user computing device and partly on a remote computing device, or run entirely on a remote computing device or server.

[0116] Furthermore, the embodiments of this disclosure may be computer-readable storage media (e.g., non-temporary computer-readable storage media) in which computer program instructions are stored, and when the computer program instructions are executed by the processor, the processor is made to execute the method for generating material packets according to the embodiments of this disclosure.

[0117] The computer-readable storage medium may employ any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. The readable storage medium may include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical memory devices, magnetic memory devices, or any suitable combination thereof.

[0118] Embodiments of the present disclosure further provide a computer program product including a computer program / instruction that, when executed by a processor, realizes a method for generating source packets or a video editing method according to embodiments of the present disclosure.

[0119] Embodiments of the present disclosure further provide a computer program including instructions, which, when the instructions are executed by a processor, cause the processor to execute the aforementioned method for generating material packets or the aforementioned video editing method.

[0120] It should be noted that, in this specification, relational terms such as “first” and “second” are merely used to distinguish one entity or operation from another, and do not require or imply that such an actual relationship or order exists between these entities or operations. Furthermore, the terms “includes,” “equipped with,” or any other variations thereof are intended to cover non-exclusive “includes,” thereby meaning that a process, method, article, or apparatus that includes a set of elements includes not only those elements but also other elements not explicitly listed, or elements specific to such a process, method, article, or apparatus. Unless otherwise specified, the phrase “includes one of…” does not preclude the existence of other identical elements in a process, method, article, or apparatus that includes such element.

[0121] The above description is merely a set of specific embodiments of the Disclosure intended to enable those skilled in the art to understand or implement the Disclosure. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can also be implemented in other embodiments without departing from the spirit or scope of the Disclosure. Therefore, the Disclosure is not limited to these embodiments described herein, but should be given the broadest scope that is consistent with the principles and novel features disclosed herein.

Claims

1. A method for generating material packets, applicable to the first client, The method involves obtaining an editing record file of a target video, wherein the target video is a video obtained by compositing specified material onto an initial video through an editing operation, and the editing record file includes editing record information for recording the editing operation, the initial video, and the specified material. Based on the aforementioned editing record file, the acquisition of target material and application information of the target material, wherein the application information includes editing record information in the target video of the target material, and the target material belongs to the designated material. This includes generating material packets for video editing based on the aforementioned target material and its application information, The application information of the target material further includes the acquisition route of the target material. Based on the aforementioned target material and its application information, generating material packets for video editing is: The process involves uploading the local material in the target material to a server and having the server convert the local material into new remote material, wherein the remote material is stored on the server and is publicly downloadable. The process involves receiving the remote material identifier corresponding to the new remote material, which has been returned from the server, replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and making the replaced application information the application information corresponding to the new remote material. A method for generating material packets, comprising generating material packets for video editing based on the aforementioned new remote material and its application information, and the original remote material and its application information in the target material.

2. Based on the aforementioned editing record file, obtaining the target material and application information of the target material is: Either all of the materials in the aforementioned designated materials are designated as target materials, or any material in the aforementioned target materials that has a distribution permission identifier is designated as a target material. A method for generating a material packet according to claim 1, comprising using the editing record information in the target video of the target material recorded in the editing record file as application information of the target material, wherein the editing record information includes one or more of the following: position information, rotation information, zoom information, and track information.

3. Replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and making the replaced application information the application information corresponding to the new remote material, The editing record file is duplicated to obtain a copy of the editing record file, A method for generating a material packet according to claim 1, comprising: deleting local material contained in the copy; replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material; and processing the copy so that the replaced application information becomes application information corresponding to the new remote material recorded in the copy.

4. Based on the aforementioned new remote material and its application information, generating material packets for video editing is: A method for generating a material packet according to claim 3, comprising generating a material packet for video editing based on the processed copy which includes a remote material identifier of the new remote material and corresponding application information.

5. Based on the processed copy, generating material packets for video editing is: The process involves obtaining the cover image of the specified material packet and uploading the cover image of the material packet to the server. The method involves obtaining pre-configured option information for a material packet, wherein the option information for the material packet includes one or more of the following: the target video, the material version information, and the material compatibility information. A method for generating a material packet according to claim 4, comprising packing and compressing the cover image of the material packet, the processed copy, and the acquired option information of the material packet to obtain a compressed packet, and using the compressed packet as a material packet for video editing.

6. Replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material is: To delete the acquisition path recorded in the application information of the aforementioned local material, The method for generating a material packet according to claim 1, further comprising changing the identifier field of the local material in the application information of the local material to the remote material identifier of the new remote material.

7. The method for generating a material packet according to claim 1, wherein the remote material in the target material is provided with a material source identifier for indicating the material storage location of the remote material.

8. A method for generating a material packet according to claim 1, further comprising associating the title information and summary information of the material packet with the material packet in response to receiving the title information and summary information of the material packet of the material packet.

9. The method for generating material packets according to claim 1, further comprising sending the generated material packets to a server and causing the server to distribute the material packets on a specified platform.

10. A video editing method applicable to a second client, Obtaining the video to be edited, In response to receiving a material packet application command, the process involves obtaining a designated material packet corresponding to the material packet application command, wherein the designated material packet is generated by the material packet generation method described in claim 1. A video editing method comprising performing editing on the video to be edited based on the specified material packet.

11. In response to detecting a trigger operation of the material packet function, the interface of the second client presents multiple target videos, each corresponding to a single material packet. The video editing method according to claim 10, further comprising: determining that a material packet application command has been received in response to the detection of a target video selection operation, and making the material packet corresponding to the selected target video a designated material packet corresponding to the material packet application command.

12. To obtain the specified material packet corresponding to the aforementioned material packet application instruction, The video editing method according to claim 10, comprising sending the identifier of the specified material packet to a server, and the server downloading the specified material packet corresponding to the material packet application command.

13. Performing edits on the video to be edited based on the specified material packets is: The video editing method according to claim 10, comprising compositing the material in the designated material packet into the video to be edited based on the application information of the material in the designated material packet.

14. A material packet generation device applicable to the first client, A file acquisition module for acquiring an editing record file of a target video, wherein the target video is a video obtained by compositing specified material onto an initial video through an editing operation, and the editing record file includes editing record information for recording the editing operation, the initial video, and the specified material. An information acquisition module that acquires target material and application information of the target material based on the aforementioned editing record file, wherein the application information includes editing record information in the target video of the target material, and the target material belongs to the specified material; The system includes a material packet generation module that generates material packets for video editing based on the aforementioned target material and its application information, The application information of the target material further includes the acquisition route of the target material. The material packet generation module is a material packet generation device used for uploading local material in the target material to a server and causing the server to convert the local material into new remote material, wherein the remote material is material stored on the server and publicly downloadable; receiving a remote material identifier corresponding to the new remote material returned from the server; replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material; making the replaced application information the application information corresponding to the new remote material; and generating a material packet for video editing based on the new remote material and its application information, as well as the original remote material and its application information in the target material.

15. A video editing device applicable to a second client, A video acquisition module to obtain the video to be edited, A material packet acquisition module that acquires a designated material packet corresponding to a material packet application command in response to receiving such command, wherein the designated material packet is generated by a material packet generation method described in any one of claims 1 to 9, A video editing device comprising a video editing module that performs editing on the video to be edited based on the specified material packets.

16. It is an electronic device, Processor and The processor comprises a memory for storing instructions that can be executed by the processor, The processor is an electronic device that reads the executable instructions from the memory and executes the instructions to realize the method for generating material packets according to any one of claims 1 to 9.

17. A computer-readable storage medium in which a computer program is stored, wherein the computer program is used to execute the method for generating material packets described in any one of claims 1 to 9.

18. A computer program that includes instructions, A computer program that, when the aforementioned instruction is executed by the processor, causes the processor to execute the method for generating material packets according to any one of claims 1 to 9.

Images