Material packet generation method, video editing method, device, equipment, and medium
The method for generating material packets simplifies the creation process by using edit record files to extract application information and create material packets, addressing the complexity of existing methods and enhancing the usability of material packets for video editing.
Patent Information
- Application Number
- JP2024557722
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-03-29
- Filing Date
- 2023-03-16
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2043-03-16
AI Technical Summary
The existing methods for creating material packets are complex and require creators to first produce an effective video and then manually extract materials from it, making the process inefficient.
A method for generating material packets that simplifies the process by directly obtaining an edit record file of a target video, extracting application information for the target material, and using this information to create a material packet without the need for manual extraction of materials.
This approach streamlines the creation of material packets, eliminating the need for manual material extraction and simplifying the process for creators, while also providing users with easily usable material packets that include application information for direct video editing.
Smart Images

Figure 2025512863000001_ABST
Abstract
Description
[Technical field]
[0001] [CROSS REFERENCE TO RELATED APPLICATIONS] This application claims priority to a Chinese patent application having application number 202210320553.X and filing date March 29, 2022, the entire contents of which are incorporated herein by reference.
[0002] The present disclosure relates to the technical field of data processing, and in particular to a material packet generation method, a video editing method, an apparatus, a device, and a medium. [Background technology]
[0003] In order to enhance the expressiveness of a video, video creators usually use materials such as text, stickers, music, special effects, etc. during video creation. In order to ensure the effect, materials used in the same video are of the same theme or style as much as possible. However, since it is difficult to find materials of the same theme or style, material packets have emerged due to this circumstance. Creators can pack materials that belong to the same theme or style and share them with other users. Summary of the Invention
[0004] An embodiment of the present disclosure provides a method for generating a material packet applied to a first client, the method including: obtaining an editing record file of a target video, the target video being a video obtained by combining a specified material with an initial video through an editing operation, the editing record file including editing record information for recording the editing operation and the initial video and the specified material; obtaining a target material and application information of the target material based on the editing record file, the application information including editing record information of the target material in the target video and the target material belonging to the specified material; and generating a material packet for video editing based on the target material and its application information.
[0005] An embodiment of the present disclosure further provides a video editing method applied to a second client, the method including: obtaining a video to be edited; and in response to receiving a material packet application command, obtaining a specified material packet corresponding to the material packet application command, wherein the specified material packet is generated by any one of the material packet generation methods described above; and performing editing on the video to be edited based on the specified material packet.
[0006] An embodiment of the present disclosure further provides a material packet generation device applicable to a first client, the device including: a file acquisition module for acquiring an editing record file of a target video, the target video being a video obtained by combining a specified material with an initial video through an editing operation, the editing record file including editing record information for recording the editing operation, as well as the initial video and the specified material; an information acquisition module for acquiring a target material and application information of the target material based on the editing record file, the application information including editing record information of the target material in the target video and the target material belonging to the specified material; and a material packet generation module for generating a material packet for video editing based on the target material and its application information.
[0007] An embodiment of the present disclosure further provides a video editing device applicable to a second client, the device comprising: a video acquisition module that acquires a video to be edited; a material packet acquisition module that acquires a specified material packet corresponding to a material packet application command in response to receiving the material packet application command, the specified material packet being generated by a material packet generation method described in any one of the above items; and a video editing module that performs editing on the video to be edited based on the specified material packet.
[0008] An embodiment of the present disclosure further provides an electronic device, the electronic device comprising a processor and a memory for storing instructions executable by the processor, the processor reading the executable instructions from the memory and executing the instructions to realize a material packet generation method or a video editing method according to an embodiment of the present disclosure.
[0009] An embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored therein, the computer program being used to execute a material packet generation method or a video editing method according to an embodiment of the present disclosure.
[0010] An embodiment of the present disclosure further provides a computer program comprising instructions, which, when executed by a processor, cause the processor to perform a method for generating material packets or a method for video editing according to an embodiment of the present disclosure.
[0011] It should be understood that the contents described in this section are not intended to identify gist or key features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily apparent from the following specification. [Brief description of the drawings]
[0012] The drawings herein, which are incorporated in and constitute a part of this specification, illustrate preferred embodiments of the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.
[0013] In order to more clearly describe the technical solutions in the embodiments or prior art of the present disclosure, the following briefly introduces drawings necessary for describing the embodiments or prior art. It is obvious that those skilled in the art can obtain other drawings based on these drawings without making creative efforts. [Figure 1] 1 is a schematic flow chart of a method for generating a material packet according to an embodiment of the present disclosure. [Diagram 2]FIG. 2 is a schematic diagram of a material packet protocol according to an embodiment of the present disclosure. [Diagram 3] FIG. 13 is a schematic flow chart of generating a material packet according to an embodiment of the present disclosure. [Figure 4] FIG. 1 is a schematic flow chart of processing local material according to an embodiment of the present disclosure. [Diagram 5] 1 is a schematic flow chart of a video editing method according to an embodiment of the present disclosure; [Figure 6] FIG. 13 is a schematic flow chart of application of material packets according to an embodiment of the present disclosure. [Figure 7] FIG. 2 is a structural schematic diagram of a material packet generating device according to an embodiment of the present disclosure; [Figure 8] FIG. 1 is a structural schematic diagram of a video editing device according to an embodiment of the present disclosure. [Figure 9] FIG. 1 is a schematic diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] In order to make the above objectives, features and advantages of the present disclosure more clearly understood, the technical solutions of the present disclosure are further described below. It should be explained that, unless contradictory, the embodiments and features in the embodiments of the present disclosure can be combined with each other.
[0015] In order to fully understand the present disclosure, numerous details are specifically set forth in the following description; however, the present disclosure may be embodied in forms different from those described herein, and it is to be understood that the embodiments in the specification are merely some embodiments of the present disclosure, and not all embodiments.
[0016] The inventors of the present disclosure have found that in the prior art, the method by which a producer creates a material packet is cumbersome; for example, to obtain a material packet, a producer must first create an effects video and then cut out materials from the effects video.
[0017] In light of this, the present disclosure provides a material packet generation method to simplify the material packet creation process.
[0018] FIG. 1 is a schematic flow chart of a method for generating a content packet according to an embodiment of the present disclosure. This method may be applied to a first client realized by, for example, a mobile phone or a computer. The embodiment of the present disclosure does not limit the implementation form of the first client. A creating user (e.g., a creator of a content packet) may generate a content packet using the first client. As shown in FIG. 1, this method mainly includes the following steps S102 to S106.
[0019] Step S102: obtain an edit record file of a target video. The target video is a video obtained by synthesizing a specified material with an initial video through an editing operation.
[0020] In some embodiments, in response to receiving a content packet generation command initiated by a user, an edit record file of the target video may be obtained. Here, the target video is a video obtained by synthesizing a specified material with an initial video through an editing operation. In other words, the target video may be a video obtained by editing an initial video by adopting a specified material of a content packet to be created by a user (a creator of the content packet). The target video may be called an example video of the content packet.
[0021] In some embodiments of the present disclosure, the editing record file includes editing record information for recording editing operations, and the initial video and designated materials. For example, in the video editing software of the embodiments of the present disclosure, the editing process in which a user creates a video may be completely recorded to form an editing record file by obtaining a clip operation sequence for the initial video, materials used in each clip operation in the clip operation sequence, and a specific usage method of the materials in the initial video. For example, the editing record file is a protocol used by the video editing software to record the video editing state, which may store all information in the process in which a user edits a video, such as elements added by the user during video editing, parameters adjusted, and user operations. When a user opens a video again, the previous editing state can be restored by automatically reading the editing record file corresponding to this video.
[0022] In the embodiment of the present disclosure, the creator of the material packet does not need to cut out the material from the video, but can directly obtain the editing record file of the video and generate the material packet according to the editing record file.
[0023] Step S104: obtain a target material and application information of the target material according to the edit record file, where the application information includes edit record information of the target material in the target video.
[0024] Here, the target material belongs to the specified material. In some implementation examples, all materials in the specified material may be the target material. Since the creator of the material packet may not want to pack and share all the materials, only some materials selected by the creator of the material packet from the specified material may be the target material. The target material may be determined according to the needs of the user, and is not limited here. The application information of the target material can be directly extracted from the edit record file, which is known. The application information includes edit record information in the target video of the target material. The edit record information may include, for example, one or more of position information, rotation information, zoom information, and track information. In addition, the application information may further include an acquisition path of the target material. This acquisition path is used to indicate the manner of acquiring the material. For example, when the material is uploaded from a local area, the acquisition path of the material may be a file acquisition path, and when the material is downloaded from a network, the acquisition path of the material may be a network acquisition path.
[0025] In addition, the material in the embodiment of the present disclosure includes, but is not limited to, one or more of video, image, sticker, text, music, special effects, and filters. The editing record information may include, for example, one or more of position information, zoom information, and track information in the video of the material, and may be determined specifically based on the type of material. For example, when the material is a video, image, sticker, or text, the corresponding application information may include position information, zoom information, and track information; and when the material is an image, sticker, and text, it may further include rotation information; and when the material is music or special effects, the corresponding application information may include track information. The above is merely an example and should not be considered as a limitation.
[0026] Step S106: Generate a content packet for video editing based on the target material and its application information. After the target material and its application information are known, the first client may automatically pack the target material and its application information to generate a content packet for video editing. The generated content packet may then be sent to a server, which may distribute the content packet on a designated platform. The content packet may be shared through the designated platform, and other users may download and use the content packet from the designated platform.
[0027] In summary, an embodiment of the present disclosure provides a method for generating a material packet applied to a first client, the method including: acquiring an editing record file of a target video, the target video being a video obtained by synthesizing a designated material with an initial video through an editing operation, the editing record file including editing record information for recording the editing operation, the initial video, and the designated material; acquiring a target material and application information of the target material based on the editing record file, the application information including editing record information of the target material in the target video, and the target material belonging to the designated material; and generating a material packet for video editing based on the target material and its application information. It is no longer necessary for a creator of a material packet to cut out materials one by one from a video to create a material packet, and the material packet can be generated directly based on the target material and application information in the video editing record file, simplifying the process of creating the material packet.
[0028] In some embodiments, the step of obtaining the target material and application information of the target material based on the edit record file may include the following two main steps (1) and (2).
[0029] Step (1): all of the designated materials are selected as target materials, or the materials with a distribution permission identifier in the target materials are selected as target materials. That is, in practical applications, the following two examples may be referred to for implementation.
[0030] In the first embodiment, all materials in the specified materials are set as target materials. If no specification is made, all specified materials may be set as target materials by default.
[0031] In the second embodiment, the target material is a material with a distribution permission identifier. In practical application, a material checkbox may be provided to the creator. The creator may check the designated material used to create the target video, and the distribution permission identifier may be assigned to the checked designated material. In this manner, the creator's needs are fully considered, and only the material permitted by the creator is distributed, and some private materials that the creator does not want to use widely may not be distributed.
[0032] According to the actual situation, the above embodiment 1 and / or embodiment 2 may be flexibly selected and realized. The user may be provided with an option to "distribute all materials" or "distribute only some materials". When the user selects "distribute all materials", the above embodiment 1 may be adopted and when the user selects the option to "distribute only some materials", the above embodiment 2 may be adopted and realized. In particular, when the target materials include the creator's local materials, the user (the creator of the material packet) can assign a distribution permission identifier to the specified materials that he / she wants to distribute by checking the material checkbox, and only the materials that the user wants to upload can be packed while fully respecting the user's intention. Here, the local materials are materials that the user uploads through the first client, such as images that the creator uploads from a local album, or materials such as stickers and videos that the creator uploads from a local folder. In other words, the local materials are materials that are not publicly downloadable on the network, but are stored locally in the terminal. The creator can specify the materials that can be packed in the material packet according to demand, which is more flexible.
[0033] Step (2): the editing record information of the target video of the target material recorded in the editing record file is the application information of the target material, where the editing record information includes one or more of position information, rotation information, zoom information, and track information. In practical application, the editing record information corresponding to different types of materials may be different, and each type of material may correspond to one or more types of editing record information, which is not limited here.
[0034] In order to fully and effectively save the memory of the material packet, the application information of the target material further includes the acquisition path of the target material. In addition, the target material may not be directly packed into the material packet, but the identifier and application information of the target material (including the acquisition path and editing record information of the target material) may be stored in the material packet, so that the user of the material packet can clearly know how to acquire the target material and how to use the target material.
[0035] In the process of creating a material packet, the creator of the material packet often uses personal original local materials, such as original images, stickers, music, short videos, etc., to provide other users with fresh materials. Therefore, the target material generally includes at least one type of local material. And in many cases, the creator of the material packet not only uses local materials, but also uses remote materials, that is, the created material packet not only includes the creator's local materials, but also includes remote materials (original remote materials) downloaded by the creator via a network, where the remote materials are stored in a server and publicly downloadable. The embodiment of the present disclosure can directly identify the type of material (local / remote) in the target material and perform corresponding processing. For example, in order to save the memory of the material packet, the local material may not be stored in the material packet, but may first be distributed in the server to make the local material into a new remote material, and then the material packet only needs to store the identifiers of the original remote material and the new remote material (local material) and application information including the material acquisition path and editing record information. Such a processing method requires a small capacity of the material packet, and is very easy to download and disseminate.
[0036] Based on the above, an embodiment of the present disclosure provides a specific embodiment for generating a material packet for video editing based on a target material and its application information, and specifically, may be realized by referring to the following steps A to C.
[0037] Step A, upload local material in the target material to a server, and convert the local material into new remote material at the server, where the remote material is material stored on the server and publicly available for download.
[0038] In practical application, the local material in the target material can be automatically uploaded to a designated server, and then the server can distribute the local material on a designated platform, and the distributed local material becomes a new remote material. The storage and distribution of the material can be performed by the same server or different servers. For example, the local material is uploaded to a storage server, and the storage server stores the local material, and then the local material is sent to a material server, and the material server distributes the local material on a designated platform.
[0039] Step B: Receive a remote material identifier corresponding to the new remote material returned from the server, replace the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and make the replaced application information the application information corresponding to the new remote material.
[0040] When the server distributes the local material as a remote material, it newly assigns a corresponding material identifier to the remote material, and this material identifier may be a remote material identifier or a resource ID. The remote material identifier is an ID identifier of the remote material, and the remote material identifier corresponding to different remote materials is also different. As can be understood, for the producer of the material packet, the file acquisition path for the local material is recorded in the editing record file in order to produce the material packet using the material stored locally, but when distributing the local material to the public as a new remote material, when other users download the material packet, they only need to know the remote material identifier of the remote material in the material packet, and can download the corresponding remote material from the server by the remote material identifier. The above method allows other users to easily use the local material of the producer of the material packet.
[0041] It should also be noted that the editing record information in the application information is still kept intact, that is, for a local material in a target material, its corresponding application information includes the editing record information in the target video of the local material (abbreviated as material editing record information) and the file acquisition path of the local material, and when the local material is converted into a remote material by the server, the application information corresponding to the remote material includes the above-mentioned material editing record information and a remote material identifier corresponding to the remote material. In the embodiment of the present disclosure, the remote material identifier and the file acquisition path can both be used to indicate the specific acquisition method of the material, and both belong to the expression form of the acquisition path of the target material contained in the application information.
[0042] Step C: generating a content packet for video editing based on the new remote content and its application information and the original remote content and its application information in the target content, where the original remote content is content downloaded from the server by the first client in the process of generating the target video.
[0043] Since the local material of the creator is converted into remote material usable by others, a material packet for video editing can be directly generated based on the new remote material and its application information and the original remote material and its application information. As can be understood, the materials in the material packet obtained by the above method are all remote materials, some of which are new remote materials created by the creator distributing the local material through a server, and some of which are the original remote materials downloaded by the creator via a network.
[0044] In the above method, the local material and application information are directly obtained based on the editing record file, and the local material is distributed as a new remote material, the acquisition path in the application information of the local material is replaced with the remote material identifier, other contents of the application information may be kept as they are, and finally a material packet is generated based on the new remote material and its application information. For the creator of the material packet, it is no longer necessary to cut out the material from the video one by one to create the material packet, the process of creating the material packet is simplified, and there is no need to store the material in the material packet, only the acquisition path of the material and the editing record information need to be stored, so the required memory is small and it is easy to download and distribute.
[0045] In view of the above, the embodiment of the present disclosure may be considered as redefining a protocol of a material packet that clearly indicates the application method of the material. In other words, the material packet protocol may be understood as an aggregate content of the above-mentioned material application information, and the material packet according to the embodiment of the present disclosure includes a material set and a material packet protocol (i.e., material application information). Referring to the schematic diagram of the material packet protocol shown in FIG. 2, the application information corresponding to a plurality of types of materials that may be included in the material packet is shown in a schematic manner. FIG. 2 shows briefly the material types such as video, image, sticker, text, music, special effects, etc., and the application information corresponding to various material types. Here, the file path is the above-mentioned local material acquisition path, the resource ID is the above-mentioned remote material identifier, and both the file path / resource ID indicate the material acquisition method. It should be noted that FIG. 2 is merely a simple example and should not be considered as a limitation, and in actual applications, the material may further include, for example, filters, sound effects, etc., without being limited thereto. And the elements listed in FIG. 2 are all selective and combinable, and are not necessarily provided at the same time, and may be specifically customized according to actual needs and specific video editing software. In short, the material packet needs to record all the information of the material so that the effect of each material can be fully restored in subsequent applications. In addition, the material packet listed in FIG. 2 is the producer's first material packet, which has not yet been distributed, and the file path of the local material has not yet been replaced, so some materials may correspond to file paths (i.e., local materials). Once the local material is distributed, its corresponding file path is replaced with the remote material identifier of the corresponding remote material, and all the materials included in the finally formed material packet correspond to resource IDs, not file paths. In practical application, compared with the conventional material packet being only a material set, the material packet according to the embodiment of the present disclosure includes the material set and further includes the above material packet protocol, i.e., includes materials and corresponding application information.The application information indicates how the material is used and the method of obtaining the material, so that a user who downloads a material packet can clearly know how each material is applied in the video and can fully restore the effect of the producer of the material packet using the material in the video.
[0046] In some embodiments, in order to further improve the efficiency of generating the material packet and the convenience of using it, the original editing record file may be kept unchanged and a copy may be made of the editing record file. Then, the copy may be directly processed to obtain the material packet, that is, the editing record file may be modified into the material packet, so that the user who downloads the material packet can directly apply this material packet (modified editing record file). Specifically, the user who downloads the material packet does not need to add each material in the material packet to the video one by one, and after downloading this material packet, the user can directly use the material packet as an editing record file in the video that needs to be edited, and the specific manner in which the producer uses the material in the video (e.g., position, rotation, zoom, track, etc.) can be completely restored. Based on this, the above steps of replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material and making the replaced application information the application information corresponding to the new remote material may be performed with reference to the following steps a to b.
[0047] Step a, duplicating the editing record file to obtain a copy of the editing record file.
[0048] Step b: process the copy so as to delete the local material contained in the copy, and replace the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and make the replaced application information the application information corresponding to the new remote material recorded in the copy. In some specific embodiments, the local material and related information may be deleted, and the acquisition path corresponding to the local material may be replaced with the remote material identifier according to the mapping relationship, or the other may be retained. With this simple and clever method, the existing editing record file can be directly converted into an applicable material packet without rewriting the application logic.
[0049] In the above, the step of generating a content packet for video editing based on the new remote material and its application information includes generating a content packet for video editing based on the processed copy, where the processed copy includes a remote material identifier of the new remote material and corresponding application information. Exemplarily, this may be realized by referring to the following steps (1) to (3).
[0050] Step (1): obtain a cover image of a specified material packet, and upload the cover image of the material packet to a server. The cover image of the material packet may be specified by the creator, and if not specified, a default cover image of the material packet may be selected and used.
[0051] Step (2): obtaining preset optional information of a material packet, where the optional information of the material packet includes one or more of the following: a target video, material version information, and material compatibility information. The target video is an exemplary video obtained by editing a plurality of materials, and whether to include the target video in the material packet may be determined according to actual needs. In some embodiments, the target video may be included in the material packet. In other embodiments, the target video may not be included in the material packet, and the target video may be a material independent of the material packet and associated with the material packet, thereby making the capacity of the material packet as small as possible. Other users may download only the material packet, and when they need to view the use example of the material packet, they download the target video associated therewith or view it online. The above material version information and material compatibility information may both be regarded as belonging to the extra.json extension file, and are used to record some special logic for processing the material packet, such as the specific application manner of the material packet in different terminals. For example, the size of a material that can be used normally on iOS® is 200*200, while the size that can be used normally on Android® is 300*300.
[0052] Step (3): The cover image of the content packet, the processed copy, and the option information of the obtained content packet are packed and compressed to obtain a compressed packet, which is used as a content packet for video editing. For example, the cover image of the content packet, the processed copy, and the option information of the obtained content packet may be packed to generate a Zip packet, which is then distributed to a background server, thereby realizing distribution and delivery of the content packet.
[0053] Further, the embodiments of the present disclosure provide a technical implementation of replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, including deleting the acquisition path recorded in the application information of the local material, and changing the local material identifier field in the application information of the local material to the remote material identifier of the new remote material. In some embodiments of the present disclosure, in order to identify the download origin of each remote material, the remote material in the target material is provided with a material source identifier for indicating the material storage location of the remote material. The material source identifier may be used to distinguish the platform that downloads the remote material. After the local material in the target material is converted into the new remote material by the server, the remote material identifier of the new remote material may be obtained by the server. In practical application, the target platform that downloads this remote material may be determined based on the material source identifier, and the corresponding remote material is downloaded from the target platform based on the remote material identifier. That is, an additional field for identifying the download origin may be added to each remote material in the material packet. For example, the material source identifier field is set as source_plaform, and the value of source_plaform may be, for example, 0, 1, 2, 3, 4, etc., and different values represent different download platforms. In practical applications, there may be multiple platforms (or servers) used for downloading materials, and this value may be the identifier of the material download platform. For ease of understanding, the following provides an example description of changing the identifier field of the target local material to the remote material identifier (remote_id) and the newly added material source identifier (source_platform).
[0054] 1) video material: use remote_id to replace the material_id in the original materials.videos and add source_platform=1.
[0055] 2) audio materials: use remote_id to replace the music_id in the original materials.audios and add source_platform=2.
[0056] 3) image materials: use remote_id to replace the image_id in the original materials.image and add source_platform=1.
[0057] 4) sticker material: use remote_id to replace sticker_id in the original materials.image and add source_platform=1.
[0058] 5) text material: First, delete the text segment, then add a new character template segment with source_platform=1.
[0059] The above is merely an illustrative description and should not be considered as a limitation. In the application process of the material packet, the material acquisition platform can be determined according to the source_platform, and the corresponding remote material can be downloaded from the platform for acquiring the material according to the remote_id, so as to obtain all the materials in the material packet, and the material packet can be directly applied according to the material packet protocol.
[0060] As mentioned above, the embodiment of the present disclosure provides an example of converting an edit record file that a producer already has into a new material packet for distribution. Referring to the flow chart of material packet generation shown in FIG. 3, a specific manner of converting an edit record file into a material packet is outlined, and the execution body of each part is clearly indicated. As shown in this figure, the terminal can obtain the local material, the original remote material, and the material packet video, cover image, etc. adopted by the producer in the video editing based on the analysis of the edit record file, the local material is distributed by the server as a remote material, and the draft protocol is modified (made into an edit record file) after obtaining the remote material identifier fed back from the server, and the specific modification manner is as described above, modifying the acquisition path of the local material to the remote material identifier corresponding to the remote material obtained by distribution, uploading the material packet video, cover image, etc. to the server, and then packing it with the original remote material and the modified draft protocol to obtain a new material packet, and finally distributing the new material packet by the server. It should be noted that the main point of FIG. 3 is that different types of materials (local materials, remote materials, material packet videos or cover images) are processed differently in the process of generating material packets. For example, the local materials need to be distributed as remote materials by the server, and the protocol for the local materials needs to be modified (the acquisition path of the local materials in the editing record file is modified to the remote material identifier), the original remote materials can directly participate in packing without any other processing, and the material packet videos and cover images are uploaded and stored in the server before participating in packing. In actual applications, the above three types of materials are not necessarily all included. For example, some producers only use local materials (such as local videos, local music, local stickers, text, etc.) to edit videos, so the material packets do not have the original remote materials (such as stickers, special effects, filters, text templates, music, sound effects, etc.).Some producers may decide not to pack content packets into content packets, so there may be no content packets video, etc. In any case, however, to the creation of the content packets by the producer, the content packets are associated with local content.
[0061] Further, in accordance with the above, an embodiment of the present disclosure provides a schematic flow chart of local material processing shown in FIG. 4, which shows a schematic flow of distributing local material as new remote material. As shown in FIG. 4, the editing record file includes local material (local images, local audio) and original remote material (remote stickers, special effects, etc.). The local material may be uploaded to a storage server and distributed to the material server so that it can be used by the general public. For example, after uploading the local material to the storage server, the corresponding URL and KEY may be determined, and the local material may be distributed to the material server based on the URL and KEY to form the remote material. Once distributed by the server, the server's remote material identifier (remote_id) can be obtained, and the remote material is used to replace the local material, so that the generated material packet contains whatever is remote material. Specifically, the original local image is replaced with the remote image, and the local audio is replaced with the remote music. FIG. 4 also shows that a material origin identifier (source_platform) for identifying the source of the material can be newly added to the new remote material.
[0062] In some embodiments, the method further includes, in response to receiving the content packet title information and the content packet summary information, associating the content packet title information and the content packet summary information with the content packet.
[0063] In practical application, a content packet title box and a content packet summary box may be provided in the interface of a user terminal, so that the creator of the content packet can input the title of the content packet he / she created in the content packet title box, and input the theme description of the content packet in the content packet summary box, etc., so that other users who download the content packet can know the theme style of the content packet more clearly, and can quickly determine whether or not they need to download this content packet according to their needs.
[0064] In summary, the method for generating content packets according to the embodiment of the present disclosure eliminates the need for a content packet creator to cut out content from a video one by one to generate content packets, simplifying the content packet generation process and improving the efficiency of generating content packets. For a user of the content packets, the content packets are easier to use because they include application information for the material.
[0065] When a producer adopts materials to create an effect video (the aforementioned target video), the required target local materials can be determined according to demand, and the distribution of material packets can be realized by one key, which is very convenient and fast. The material packet not only records a material set, but also may include a material packet protocol. Specifically, the location information, zoom information, track information, and other usage record information of each material and the specific acquisition method of the material (for example, a remote material identifier) are recorded. When other users apply with one key, they can automatically acquire the material based on the identifier, and directly restore the display effect in the video of each material based on the usage record information. And the material packet is directly obtained based on the editing record file, and other users can directly apply the material packet as a whole. Compared with the prior art, where the material packet only includes a material set, and the user of the material packet does not know how to specifically apply each material even after obtaining the material packet, and needs to repeatedly adjust it, the above method according to the embodiment of the present disclosure improves the usability of the material packet.
[0066] The inventors of the present disclosure further discovered that in conventional technology, the material packet created was merely a collection of individual materials, and even if other users obtained the material packet, they did not know how specifically to apply the materials contained therein, making the material packet extremely difficult to use.
[0067] In view of this, the embodiment of the present disclosure further provides a video editing method for improving the usability of material packets.
[0068] Based on the above-mentioned method for generating material packets, an embodiment of the present disclosure provides a video editing method. This method is applied to a second client. The second client may be realized by, for example, a mobile phone or a computer, and the embodiment of the present disclosure does not limit the realization form of the second client. A consumer user (e.g., a user of the material packets) can obtain the material packets using the second client and perform video editing using the material packets. As shown in FIG. 5, this method mainly includes the following steps S502 to S506.
[0069] Step S502, obtain a video to be edited. The video to be edited may be an original video to be edited uploaded by a user.
[0070] In step S504, in response to receiving the content packet application command, a specified content packet corresponding to the content packet application command is acquired. The specified content packet is generated by any one of the content packet generation methods described above in the embodiments of the present disclosure, and the description thereof will be omitted here.
[0071] In some specific implementation examples, in response to detecting a trigger operation of the material packet function, a plurality of target videos each corresponding to a material packet may be presented in the interface of the second client, and in response to detecting a selection operation of the target videos, it may be determined that a material packet application command has been received, and the material packet corresponding to the selected target video may be made a specified material packet corresponding to the material packet application command.
[0072] In practical application, the video editing software can provide a video editing function to a user, and present identifiers of multiple video editing functions in the interface of the second client. The video editing function includes a material packet function. When detecting that a user (a user of the material packet) clicks on an identifier or button of the material packet function, it may be deemed to detect a trigger operation of the material packet function, and further present multiple target videos in the interface of the second client. The target videos are videos generated and distributed by the producer of the material packet. The target videos are videos obtained by synthesizing the target materials with the initial video through an editing operation. Each target video corresponds to one material packet. As can be understood, the producer of one material packet can generate and distribute multiple material packets, and the various target videos that the video editing software presents in the interface of the second client may be generated and distributed by different producers of the material packet, and are not limited here. By presenting multiple target videos in the interface, the user of the material packet can intuitively feel the effect of applying the material packet to the video, and thereby select the required material packet. In the embodiment of the present disclosure, when it is detected that a user has clicked on a target video, it is deemed that the user requires a material packet corresponding to the target video, and therefore the material packet corresponding to the target video can be directly made into a specified material packet corresponding to a material packet application command, which is very convenient, quick and easy to implement.
[0073] In some embodiments, obtaining the specific content packet corresponding to the content packet application command includes sending an identifier of the specific content packet to a server, and downloading the specific content packet corresponding to the content packet application command by the server. In practical application, the actual content of the content packet may be stored on the server side, and when the specific content packet required by the user is determined, the second client may directly download the content of the specific content packet from the server, and the content packet may directly include the content and application information.
[0074] In step S506, editing is performed on the video to be edited based on the designated material packet.
[0075] In some embodiments, performing editing on the video to be edited based on the specified content packet includes compositing the material in the specified content packet into the video to be edited based on the application information of the material in the specified content packet. In practical application, the second client can automatically combine the material in the content packet into the video to be edited according to the application information based on the content contained in the specified content packet, so that the user of the content packet does not need to edit the video by adopting the material in the content packet point by point, and improves the usability of the content packet.
[0076] In summary, the embodiment of the present disclosure provides a video editing method applied to a second client, which includes: acquiring a video to be edited; acquiring a designated content packet corresponding to a content packet application command in response to receiving a content packet application command, the designated content packet being generated by the above-mentioned content packet generation method; and editing the video to be edited based on the designated content packet. According to the above video editing method, since the content packet has material application information attached thereto, users of the content packet can directly perform video editing based on the content packet. This makes it easier to use the content packet.
[0077] For ease of understanding, after obtaining the specified material packet, the embodiment of the present disclosure further provides a flow chart diagram of the material packet application shown in FIG. 6, which shows a specific application process after other users download the specified material packet. In addition to FIG. 4, FIG. 6 shows that the restoration of the edit record file can be realized by making a request to the material server based on the image remote_id and music remote_id to download and obtain the remote image and remote music. It should be noted that FIG. 6 is only an exemplary explanation, and the main point is to show the restoration flow of the local image / local audio delivered as a new remote material in the material packet use process, so the application process of the original remote material (e.g. remote sticker, special effect) and other materials is not shown. In actual situations, the original remote material of the material packet also needs to be requested to the material server by the corresponding remote_id to download the specific remote material. In addition, the editing record file in Figure 6 records "local images" and "local audio," which mainly indicates that these are essentially local images / audio provided by the producer, but for a user downloading a material packet, all of the materials in the resulting material packet (which is essentially an editing record file) are remote materials.
[0078] As shown in Figure 6, the material packet obtained by the user who downloads the material packet is essentially an edit record file, and as shown in Figures 3 and 4, the local material is replaced with the remote material and the identifier field of the edit record file is replaced with the remote material identifier, and the format of the edit record file is not changed essentially, so the format of the edit record file restored from the material packet is the same as that of the original edit record file, and can be applied with one key to directly restore the effect of each material in the target video in the video that the user who downloads the material packet wants to edit. In this way, it is easier for users to use the material packet to edit videos.
[0079] Corresponding to the above-mentioned content packet generating method, the embodiment of the present disclosure provides a content packet generating device applicable to a first client. Referring to the structural schematic diagram of the content packet generating device shown in Figure 7, the device mainly includes a file acquisition module 702, an information acquisition module 704, and a content packet generating module 706.
[0080] The file acquisition module 702 acquires an editing record file of a target video, where the target video is a video obtained by synthesizing a specified material with an initial video through an editing operation, and the editing record file includes editing record information for recording the editing operation, the initial video, and the specified material.
[0081] The information acquisition module 704 acquires a target material and application information of the target material based on the editing record file, where the application information includes editing record information of the target material in the target video, and the target material belongs to the specified material.
[0082] The content packet generation module 706 generates content packets for video editing based on the target material and its application information.
[0083] For the creator of the material packet, the device eliminates the need to cut out materials one by one from a video to create a material packet, simplifying the process of creating the material packet, and for the user of the material packet, the use of the material packet becomes easier since the material packet includes application information of the material.
[0084] In some embodiments, the information acquisition module 704 specifically determines all of the designated materials as target materials, or determines the materials in the target materials that have a distribution permission identifier as target materials, and determines the editing record information of the target video of the target materials recorded in an editing record file as application information of the target materials, where the editing record information includes one or more of position information, rotation information, zoom information, and track information.
[0085] In some embodiments, the application information of the target material further comprises a route of acquisition of the target material.
[0086] The material packet generation module 706 is specifically used for uploading local material in the target material to a server, and having the server convert the local material into new remote material, where the remote material is stored in the server and is publicly downloadable; receiving a remote material identifier corresponding to the new remote material returned from the server; replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and making the replaced application information the application information corresponding to the new remote material; and generating a material packet for video editing based on the new remote material and its application information, and the original remote material in the target material and its application information.
[0087] In some embodiments, the material packet generation module 706 is specifically used to duplicate the edit record file to obtain a copy of the edit record file, and process the copy to delete the local material contained in the copy, and replace the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and make the replaced application information the application information corresponding to the new remote material recorded in the copy.
[0088] In some embodiments, the material packet generation module 706 is used to generate a material packet for video editing based on the processed copy, where the processed copy includes a remote material identifier and corresponding application information for the new remote material.
[0089] In some embodiments, the material packet generation module 706 is specifically used for obtaining a cover image of a specified material packet, uploading the cover image of the material packet to the server, obtaining optional information of a pre-set material packet, the optional information of the material packet including one or more of the target video, material version information, and material compatibility information, packing and compressing the cover image of the material packet, the processed copy, and the obtained optional information of the material packet to obtain a compressed packet, and using the compressed packet as a material packet for video editing.
[0090] In some embodiments, the material packet generation module 706 is specifically used to delete the acquisition path recorded in the application information of the local material, and to change the local material identifier field in the application information of the local material to the remote material identifier of the new remote material.
[0091] In some embodiments, remote material in the target material is marked with a material source identifier to indicate a material storage location of the remote material.
[0092] In some embodiments, the apparatus further comprises an association module that, in response to receiving the content packet title information and the content packet summary information, associates the content packet title information and the content packet summary information with the content packet.
[0093] In some embodiments, the apparatus further comprises a transmission module for transmitting the generated content packet to a server and causing the server to distribute the content packet on a specified platform.
[0094] The content packet generating device according to the embodiment of the present disclosure can execute the content packet generating method according to any embodiment of the present disclosure, and has corresponding functional modules and beneficial effects for executing the method.
[0095] As can be clearly understood by those skilled in the art, for the convenience and conciseness of description, the specific operation processes of the above-described apparatus embodiments may refer to the corresponding processes in the method embodiments, and the description will be omitted here.
[0096] Corresponding to the above-mentioned video editing method, an embodiment of the present disclosure provides a video editing device applied to a second client. Referring to the structural schematic diagram of the video editing device shown in Figure 8, the video editing device includes a video acquisition module 802, a material packet acquisition module 804, and a video editing module 806.
[0097] The video capture module 802 captures the video to be edited.
[0098] In response to receiving a material packet application command, the material packet acquisition module 804 acquires a specified material packet corresponding to the material packet application command, where the specified material packet is generated by any one of the material packet generation methods described above according to an embodiment of the present disclosure.
[0099] The video editing module 806 performs editing on the video to be edited based on the specified material packets.
[0100] According to the video editing apparatus, since the content packets contain application information for the materials, users of the content packets can directly perform video editing based on the content packets, which makes it easier to use the content packets.
[0101] In some embodiments, the device further comprises a determination module, which is used to, in response to detecting a trigger operation of a material packet function, present a plurality of target videos, each corresponding to a material packet, in the interface of the second client, and in response to detecting a selection operation of a target video, determine that a material packet application command has been received, and set the material packet corresponding to the selected target video as the designated material packet corresponding to the material packet application command.
[0102] In some embodiments, the content packet acquisition module 804 specifically transmits an identifier of the specific content packet to a server, and downloads the specific content packet corresponding to the content packet application command by the server.
[0103] In some embodiments, the video editing module 806 specifically composites material in the specific material packet into the video to be edited based on application information of the material in the specific material packet.
[0104] The video editing apparatus according to the embodiments of the present disclosure can execute the video editing method according to any embodiment of the present disclosure, and has corresponding functional modules and beneficial effects for executing the method.
[0105] As can be clearly understood by those skilled in the art, for the convenience and conciseness of description, the specific operation processes of the above-described apparatus embodiments may refer to the corresponding processes in the method embodiments, and the description will be omitted here.
[0106] An embodiment of the present disclosure provides an electronic device, the electronic device comprising a processor and a memory for storing instructions executable by the processor, the processor reads the executable instructions from the memory and executes the instructions to realize any one of the content packet generating methods or video editing methods described above. That is, both the first client and the second client may be realized by the electronic device.
[0107] 9 is a schematic diagram of an electronic device according to an embodiment of the present disclosure. As shown in FIG. 9, an electronic device 900 includes one or more processors 901 and a memory 902.
[0108] The processor 901 may be a central processing unit (CPU) or other type of processing unit having data processing and / or instruction execution capabilities, and may control other assemblies in the electronic device 900 to perform desired functions.
[0109] The memory 902 may include one or more computer program products, which may include various types of computer readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache). The non-volatile memory may include, for example, read only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer readable storage media, and the processor 901 may execute the program instructions to realize the method for generating material packets or the method for video editing according to the embodiments of the present disclosure described above, or other desired functions. The computer readable storage media may further store various items, such as an input signal, a signal component, a noise component, etc.
[0110] As one example, the electronic device 900 may further include an input device 903 and an output device 904 connected to each other via a bus system and / or other type of connection mechanism (not shown).
[0111] The input device 903 may further include, for example, a keyboard and a mouse.
[0112] The output device 904 can output various information including the determined distance information, direction information, etc. The output device 904 may include, for example, a display, a speaker, a printer, and a communication network and a remote output device connected thereto.
[0113] Of course, for the sake of simplicity, Fig. 9 shows only some of the assemblies according to the present disclosure in the electronic device 900, and omits assemblies such as buses and input / output interfaces, etc. Also, according to a specific application situation, the electronic device 900 may further include any other suitable assemblies.
[0114] In addition to the methods and apparatus described above, an embodiment of the present disclosure may be a computer program product including computer program instructions that, when executed by a processor, cause the processor to perform a method of generating material packets or a method of video editing according to an embodiment of the present disclosure.
[0115] The computer program product may organize program code for carrying out operations of the embodiments of the present disclosure using any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, and the like, as well as conventional process-based programming languages such as "C" or similar. The program code may be executed entirely on the user computing device, partially on the user computing device, as a separate software pack, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.
[0116] In addition, an embodiment of the present disclosure may be a computer-readable storage medium (e.g., a non-transitory computer-readable storage medium) having computer program instructions stored thereon, which, when executed by a processor, cause the processor to perform a method of generating a material packet according to an embodiment of the present disclosure.
[0117] The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include an electrical connection having one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the above.
[0118] An embodiment of the present disclosure further provides a computer program product including a computer program / instruction, which, when executed by a processor, realizes the material packet generating method or the video editing method in the embodiment of the present disclosure.
[0119] An embodiment of the present disclosure further provides a computer program comprising instructions, which, when executed by a processor, cause the processor to perform the aforementioned material packet generation method or the aforementioned video editing method.
[0120] It should be explained that, in this specification, relational terms such as "first" and "second" are merely used to distinguish one entity or operation from another entity or operation, and do not require or imply that any actual relationship or sequence exists between those entities or operations. And, the terms "comprises", "has", or any other variant thereof are intended to cover a non-exclusive "comprises", whereby a process, method, article, or device that includes a set of elements not only includes those elements, but also includes other elements not expressly listed or that are inherent in such process, method, article, or device. In the absence of further limitations, an element limited by the phrase "comprises a" does not exclude the presence of other identical elements in the process, method, article, or device that includes the element.
[0121] The above description is merely specific embodiments of the present disclosure to enable those skilled in the art to understand or realize the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to these embodiments described herein, but should be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A method for generating a content packet, which is applied to a first client, comprising the steps of: Acquire an editing record file of a target video, the target video being a video obtained by synthesizing a designated material with an initial video through an editing operation, the editing record file including editing record information for recording the editing operation, the initial video, and the designated material; Obtaining a target material and application information of the target material according to the editing record file, the application information including editing record information of the target material in the target video, and the target material belongs to the specified material; generating a content packet for video editing based on the target material and its application information.
2. Acquiring a target material and application information of the target material based on the editing record file determining all of the designated materials as target materials, or determining, among the target materials, materials having a distribution permission identifier attached thereto as target materials; A method for generating a material packet as described in claim 1, comprising the steps of: setting editing record information in the target video of the target material recorded in the editing record file as application information of the target material, and the editing record information including one or more of position information, rotation information, zoom information, and track information.
3. The method for generating a material packet according to claim 1 , wherein the application information of the target material further includes an acquisition path of the target material.
4. generating a video editing material packet based on the target material and its application information, uploading local material in the target material to a server and having the server convert the local material into new remote material, the remote material being stored on the server and publicly available for download; receiving a remote material identifier corresponding to the new remote material returned from the server, replacing an acquisition path recorded in application information of the local material with a remote material identifier of the new remote material, and setting the replaced application information as application information corresponding to the new remote material; 4. The method of claim 3, further comprising: generating a content packet for video editing based on the new remote content and its application information and the original remote content and its application information in the target content.
5. Replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, and setting the replaced application information as application information corresponding to the new remote material, Duplicating the edit record file to obtain a copy of the edit record file; 5. The method of claim 4, further comprising: processing the copy so as to delete local material contained in the copy, and to replace an acquisition path recorded in application information of the local material with a remote material identifier of the new remote material, and to make the replaced application information application information corresponding to the new remote material recorded in the copy.
6. generating a video editing content packet based on the new remote content and its application information; 6. A method for generating content packets according to claim 5, further comprising generating content packets for video editing based on the processed copy including remote material identifiers and corresponding application information for the new remote material.
7. generating a material packet for video editing based on the processed copy; obtaining a cover image for a specified content packet and uploading the cover image for the content packet to the server; Acquiring option information of a preset content packet, the option information of the content packet including one or more of the target video, content version information, and content compatibility information; The method for generating a material packet according to claim 6, further comprising: packing and compressing a cover image of the material packet, the processed copy, and optional information of the obtained material packet to obtain a compressed packet, and converting the compressed packet into a material packet for video editing.
8. Replacing the acquisition path recorded in the application information of the local material with the remote material identifier of the new remote material, Deleting the acquisition path recorded in the application information of the local material; 8. A method according to claim 4, further comprising: in application information for the local material, changing an identifier field of the local material to a remote material identifier of the new remote material.
9. A method according to any preceding claim, wherein remote material in the target material is marked with a material source identifier to indicate a material storage location of the remote material.
10. A method for generating a material packet as described in any one of claims 1 to 9, further comprising, in response to receiving title information of a material packet and summary information of the material packet, associating the title information of the material packet and the summary information of the material packet with the material packet.
11. 11. The method for generating a content packet according to claim 1, further comprising transmitting the generated content packet to a server, and causing the server to distribute the content packet on a designated platform.
12. A video editing method applied to a second client, comprising: Obtaining a video to be edited; In response to receiving a content packet application command, acquiring a designated content packet corresponding to the content packet application command, the designated content packet being generated by a content packet generation method according to any one of claims 1 to 11; and performing editing on the video to be edited based on the specified material packets.
13. presenting, in response to detecting a triggering of a content packet function, a plurality of target videos, each corresponding to a content packet, at an interface of the second client; 13. The video editing method according to claim 12, further comprising: in response to detecting a selection operation of a target video, determining that a content packet application command has been received, and setting the content packet corresponding to the selected target video as a designated content packet corresponding to the content packet application command.
14. Obtaining a specified content packet corresponding to the content packet application command includes:
14. A method as claimed in claim 12 or 13, further comprising transmitting an identifier of the specified content packet to a server, and downloading, by the server, the specified content packet corresponding to the content packet application command.
15. performing editing on the video to be edited based on the specified material packet; 15. A video editing method according to any one of claims 12 to 14, further comprising compositing material in said designated content packet into said video to be edited based on application information of the material in said designated content packet.
16. A content packet generating device applied to a first client, comprising: A file acquisition module for acquiring an editing record file of a target video, the target video being a video obtained by synthesizing a designated material with an initial video through an editing operation, the editing record file including editing record information for recording the editing operation, the initial video, and the designated material; An information acquisition module for acquiring a target material and application information of the target material according to the editing record file, the application information including editing record information of the target material in the target video, and the target material belongs to the specified material; a content packet generation module for generating a content packet for video editing based on the target material and its application information.
17. A video editing device applied to a second client, comprising: a video acquisition module for acquiring a video to be edited; a content packet acquisition module which, in response to receiving a content packet application command, acquires a designated content packet corresponding to the content packet application command, the designated content packet being generated by a content packet generation method according to any one of claims 1 to 11; a video editing module for editing the video to be edited based on the specified material packets.
18. An electronic device, A processor; a memory for storing instructions executable by said processor; The processor reads the executable instructions from the memory and executes the instructions to realize the material packet generation method described in any one of claims 1 to 11, or the video editing method described in any one of claims 12 to 15.
19. A computer-readable storage medium on which a computer program is stored, the computer program being used to execute the material packet generation method of any one of claims 1 to 11, or the video editing method of any one of claims 12 to 15.
20. A computer program comprising instructions, A computer program product, which, when the instructions are executed by a processor, causes the processor to execute the material packet generation method of any one of claims 1 to 11, or the video editing method of any one of claims 12 to 15.
Citation Information
Patent Citations
Video generation program, mobile terminal, and video management system
JP2019003531A
Method and device for generating multimedia resource
US20220005508A1