Multimedia editing method and apparatus, readable medium, and electronic device

Abstract

The present disclosure relates to a multimedia editing method and apparatus, a readable medium, and an electronic device. The multimedia editing method may comprise: acquiring first time information of a target material resource, wherein the target material resource comprises a material resource that is added to multimedia data and necessarily satisfies a preset time rule; detecting the target material resource on the basis of the first time information, so as to obtain a target detection result, wherein the target detection result represents whether the target material resource added to the multimedia data satisfies the preset time rule or not; and on the basis of the target detection result, correcting and editing the target material resource added to the multimedia data, so as to obtain edited target multimedia data.

Description

Multimedia editing method, device, readable medium and electronic device

[0001] This application claims priority to Chinese Patent Application No. 202410154781.3 filed on February 2, 2024, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] The present disclosure relates to a multimedia editing method, device, readable medium and electronic device. Background Art

[0003] In order to make the video file have a more colorful audio-visual effect, users can edit the recorded original video, for example, add text, background music, subtitles, video animation and other materials.

[0004] Video editing can be categorized as either single-track or multi-track. Multi-track video editing involves editing multiple video and audio tracks. Multi-track video editing allows you to simultaneously process multiple video frames and audio, overlaying, mixing, and editing them to create more complex and rich audiovisual effects. This video editing method is commonly used in projects requiring complex editing and post-production, such as film production, television programs, music videos, and documentaries. Summary of the Invention

[0005] This summary is provided to briefly introduce concepts that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0006] In a first aspect, the present disclosure provides a multimedia editing method, the method comprising:

[0007] Acquiring first time information of a target material resource, wherein the target material resource includes a material resource added to the multimedia data and needs to meet a preset time rule;

[0008] detecting the target material resource according to the first time information to obtain a target detection result, wherein the target detection result indicates whether the target material resource added to the multimedia data satisfies the preset time rule;

[0009] The target material resource added to the multimedia data is modified and edited according to the target detection result to obtain edited target multimedia data.

[0010] In a second aspect, a multimedia editing device is provided, the device comprising:

[0011] An acquisition module, configured to acquire first time information of a target material resource, wherein the target material resource includes a material resource added to the multimedia data and needs to meet a preset time rule;

[0012] a detection module, configured to detect the target material resource according to the first time information to obtain a target detection result, wherein the target detection result indicates whether the target material resource added to the multimedia data satisfies the preset time rule;

[0013] The correction module is used to correct and edit the target material resource added to the multimedia data according to the target detection result to obtain edited target multimedia data.

[0014] In a third aspect, a computer-readable medium is provided, on which a computer program is stored, which, when executed by a processing device, implements the steps of the method described in the first aspect of the present disclosure.

[0015] In a fourth aspect, an electronic device is provided, including:

[0016] a storage device having a computer program stored thereon;

[0017] A processing device is used to execute the computer program in the storage device to implement the steps of the method described in the first aspect of the present disclosure.

[0018] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above and other features, advantages and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale. In the drawings:

[0020] FIG1 is a flow chart of a multimedia editing method according to an exemplary embodiment;

[0021] FIG2 is a flow chart of a multimedia editing method according to the embodiment shown in FIG1 ;

[0022] FIG3 is a flow chart of a multimedia editing method according to the embodiment shown in FIG1 ;

[0023] FIG4 is a flow chart of a multimedia editing method according to the embodiment shown in FIG1 ;

[0024] FIG5 is a block diagram of a multimedia editing device according to an exemplary embodiment;

[0025] FIG6 is a block diagram of a multimedia editing device according to the embodiment shown in FIG5 ; and

[0026] Fig. 7 is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0027] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0028] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0029] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0030] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0031] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0032] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0033] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0034] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0035] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0036] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0037] At the same time, it is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0038] First, the application scenarios of the present disclosure are described. The present disclosure is primarily applicable to scenarios involving the editing of multimedia data, such as video data or image data. Taking video data as an example, when editing a video, users can add various materials, such as text, background music, subtitles, and video animations, to the original recorded video, thereby enhancing the audiovisual experience of the video file.

[0039] During the video editing process, different material editing tracks can be used to add different types of material resources. In certain single-track scenes in video editing, some types of material resources (also called "secondary resources"), such as video animations, automatic subtitles, etc., need to comply with non-overlapping rules on the corresponding editing tracks (for example, there can be no time overlap between adjacent secondary resources, and the time range of the secondary resource needs to be within the time range of the primary resource, etc. The primary resource here can be understood as the main video file that needs to be edited). In addition, this non-overlapping rule also applies to certain specific single-track scenes in multi-track systems, that is, the secondary resources on certain tracks of multi-track editing also need to follow similar arrangement rules.

[0040] In real-world scenarios, both developers and video editors may introduce errors in the arrangement of assets. These errors primarily include overlapping adjacent assets on the timeline and arrangements that violate non-overlapping rules, impacting both the coherence and efficiency of video editing. Current multi-track video editing systems often lack automated algorithms for detecting and resolving these errors in specific track scenarios. Editors are often required to manually identify and correct these errors, significantly increasing the complexity of editing and potentially impacting the quality of the final video output.

[0041] To solve the above problems, the present disclosure provides a multimedia editing method, device, readable medium and electronic device. Specific embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0042] FIG1 is a flow chart of a multimedia editing method according to an exemplary embodiment. As shown in FIG1 , the method includes the following steps:

[0043] In step S101 , first time information of a target material resource is obtained, where the target material resource includes a material resource added to multimedia data and needs to meet a preset time rule.

[0044] The multimedia data may include video data or image data to be edited. For example, a video file shot by a user may be edited (including adding subtitles, audio, and other materials) to obtain a target video file with better audio and video effects. Alternatively, an image shot by a user may be edited, such as by adding animation effects to the image.

[0045] The target material resource refers to the material resource that needs to meet the preset time rules, and the target material resource can include one or more different types of material resources. The target material resource on an editing track can include multiple target materials, and different target materials usually have different time ranges. The first time information can include the start time and / or end time of the target material resource, and can also include a time set corresponding to the time range of the target material resource. For example, the first time information of the target material resource R can be represented as a time set S R ={t|R start ≤t≤R end}, where R start Indicates the start time of the target resource R. end Indicates the end time of the target resource R.

[0046] In addition, in the present disclosure, the preset time rule refers to the time rule that the target material resource must meet. For example, the target material resource may include material resources of types such as video animation and subtitles. Taking the target material resource as subtitles as an example, it can be understood that after adding subtitles to the video file, the two adjacent groups of subtitles on the time axis corresponding to the editing track of the subtitles cannot overlap in time; for example, the time range corresponding to a certain group of subtitles should be within the time range corresponding to the video file (i.e., the main resource). Therefore, in the present disclosure, the preset time rule may include at least one of the following rules:

[0047] There is no time overlap between any two adjacent target materials among the multiple target materials; the time range of the target material resource is within the time range corresponding to the multimedia data; and a preset custom rule, the preset custom rule includes that the start time of the target material resource is the same as the start time of the multimedia data, and / or, the end time of the target material resource is the same as the end time of the multimedia data.

[0048] There is no temporal overlap between any two adjacent target materials in the plurality of target materials. The two adjacent target materials herein refer to two target materials located adjacently on the target timeline. In actual multimedia editing scenarios, multiple material editing tracks can be used to add material resources to multimedia data. Each material editing track has a corresponding timeline, and the target timeline is the timeline of the material editing track where the target material resource is located.

[0049] In step S102, the target material resource is detected according to the first time information to obtain a target detection result, where the target detection result indicates whether the target material resource added to the multimedia data meets the preset time rule.

[0050] By executing this step, arrangement errors of target material resources added to multimedia data can be automatically detected based on the first time information corresponding to each target material. The arrangement errors here may include situations where the above-mentioned preset time rules are not met.

[0051] In step S103, the target material resource added to the multimedia data is modified and edited according to the target detection result to obtain edited target multimedia data.

[0052] For example, when it is determined based on the target detection result that there is a time overlap between two adjacent target materials among the multiple target materials added to the multimedia data, the time overlap between the two adjacent target materials can be corrected by adjusting the start time or end time of one of the target materials. When it is determined based on the target detection result that the time range of the target material resource is not within the time range corresponding to the multimedia data, the start time of the target material resource can be adjusted to be the same as the start time of the multimedia data, or the end time of the target material resource can be adjusted to be the same as the end time of the multimedia data, so that the time range of the adjusted target material resource is within the time range corresponding to the multimedia data. By executing this step, the material resources added to the multimedia data can be correctly arranged, the editing efficiency can be improved, and the accuracy and professionalism of the video content can be ensured.

[0053] The above method can automatically detect whether the target material resources added to the multimedia data meet the preset time rules based on the first time information of the target material resources. This can automatically identify improper arrangement of the target material resources and automatically correct and edit the target material resources added to the multimedia data based on the detection results. This avoids manual identification and correction of these arrangement errors, thereby improving the efficiency of multimedia data editing. At the same time, it improves the accuracy of the editing process, ensures the consistency and quality of the final target multimedia data content, and optimizes the user experience.

[0054] In an embodiment of the present disclosure, the target detection result may include a first detection result, and the first detection result is used to indicate whether there is a time overlap between two adjacent target materials.

[0055] In one embodiment, during the execution of step S102, the present disclosure can determine the first detection result for each two adjacent target materials among the multiple target materials on the target timeline based on the first time information corresponding to each of the two adjacent target materials, where the target timeline is the timeline of the material editing track where the target material resource is located.

[0056] In actual multimedia editing scenarios, different material editing tracks can be used to add various types of materials to multimedia data. Each material editing track can edit one or more types of materials, and each material editing track has a corresponding timeline. The target timeline refers to the timeline of the material editing track where the target material resource is located.

[0057] In one possible implementation, multiple target materials on the target timeline may be sorted in chronological order, and then based on the first time information corresponding to each target material, a set operation may be performed to determine whether there is time overlap between any two adjacent target materials.

[0058] For example, assuming that there are two adjacent target materials A and B on the target timeline, the start time of target material A is 00:50 and the end time is 02:50, the first time information of target material A can be expressed as a time set S A ={t|00:50≤t≤02:50}, the start time of the target material B is 02:45, and the end time is 03:10. The first time information of the target material B can be expressed as a time set S B ={t|02:45≤t≤03:10}, thus, through set operation, the time set S is determined A and S B The existence of an intersection indicates that the target materials A and B have a temporal overlap. The above example is merely illustrative and the present disclosure does not limit this.

[0059] FIG2 is a flow chart of a multimedia editing method according to the embodiment shown in FIG1 . As shown in FIG2 , step S103 includes the following sub-steps:

[0060] In step S1031 , when it is determined according to the first detection result that the two adjacent target materials have a time overlap, a target material with a low priority is determined from the two adjacent target materials.

[0061] As described above, when it is determined based on the target detection result that there is time overlap between two adjacent target materials among the multiple target materials added to the multimedia data, the time overlap between the two adjacent target materials can be corrected by adjusting the start time or end time of one of the target materials.

[0062] In a possible implementation of the present disclosure, different priorities can be pre-set for different types of target materials. In this way, if two adjacent target materials are of different types, the problem of time overlap between the two adjacent target materials can be corrected by adjusting the start time or end time of the low-priority target material.

[0063] In step S1032 , the start time and / or end time of the low-priority target material is adjusted so that there is no time overlap between the adjusted low-priority target material and the other target material of the two adjacent target materials.

[0064] For example, there are two adjacent target materials A and B, where target material A is a subtitle and target material B is a video animation. Assuming that the priority of the pre-set video animation is lower than the priority of the subtitle, the time overlap problem of target materials A and B can be corrected by adjusting the start time and / or end time of target material B. A ={t|00:50≤t≤02:50}, the time set of target material B is S B ={t|02:45≤t≤03:10}, the start time of the target material B can be adjusted from 02:45 to 02:50, that is, the time set of the target material B is S B ={t|02:50≤t≤03:10}, thus resolving the temporal overlap issue between adjacent target materials A and B. It should be noted that after adjusting the start time of target material B, whether the end time of target material B is adjusted accordingly to meet the inherent duration of target material B can be adjusted based on user settings or needs, and this disclosure does not impose any restrictions on this.

[0065] It should also be noted that, when it is determined that the material types of two adjacent target materials are the same, the time overlap problem of the two adjacent target materials can be solved by adjusting the start time and / or end time of any one of the two adjacent target materials.

[0066] It can be understood that, assuming that the second time information of the original video to be edited (i.e., the main resource) is from 00:00 to 30:05, that is, the start time of the original video is 00:00 and the end time is 30:05, if the time range of the material added to the original video is 28:00-31:05, obviously, the time range of the material is not within the time range of the original video, which will cause video editing errors. Therefore, in another embodiment of the present disclosure, the target detection result includes a second detection result, and the second detection result characterizes whether the time range of the target material resource is within the time range corresponding to the multimedia data.

[0067] FIG3 is a flow chart of a multimedia editing method according to the embodiment shown in FIG1 . As shown in FIG3 , the method further includes the following steps:

[0068] In step S104, second time information corresponding to the multimedia data is obtained.

[0069] The multimedia data is the primary resource data to be edited, such as the original video or image shot by the user. The second time information may include the start time and / or end time of the multimedia data, or may include a time set corresponding to the time range of the multimedia data. For example, the second time information of the multimedia data M may be represented as a time set S M ={t|M start ≤t≤M end}, where M start Indicates the start time of multimedia data M, M end Indicates the end time of multimedia data M.

[0070] In this way, during the execution of step S102, the target material resource can be detected according to the first time information and the second time information to obtain the second detection result.

[0071] In one implementation, for each target material, it may be determined whether the time range of the target material is within the time range of the multimedia data according to the first time information corresponding to the target material and the second time information of the multimedia data.

[0072] For example, suppose the time set of multimedia data M is S M ={t|01:00≤t≤03:00}, the time set of target material A is S A ={t|00:50≤t≤02:50}, the time set of target material B is S B ={t|02:45≤t≤03:10}, the time set S of the target material A can be determined by set operation. A , and the time set S of the target material B B are not completely contained in the time set S of the multimedia data M M The above examples are merely illustrative and are not intended to be limiting in this disclosure.

[0073] In this embodiment, when it is determined based on the second detection result that the time range of the target material resource is not within the time range corresponding to the multimedia data, the start time or end time of the target material resource is adjusted so that the adjusted time range of the target material resource is within the time range corresponding to the multimedia data.

[0074] In one embodiment, to address the time range conflict between a secondary resource and a primary resource, the start time or end time of the secondary resource can be adjusted so that the time range of the secondary resource falls within the time range of the primary resource to which it depends. For example, if the end time of the secondary resource is greater than the end time of the primary resource, the end time of the secondary resource can be adjusted to be the same as the end time of the primary resource; if the start time of the secondary resource is less than the start time of the primary resource, the start time of the secondary resource can be adjusted to be the same as the start time of the primary resource.

[0075] For example, let the time set of multimedia data M be S M ={t|01:00≤t≤03:00}, the time set of target material A is S A ={t|00:50≤t≤02:50}, the time set of target material B is S B ={t|02:45≤t≤03:10}, the time set S of the target material A can be determined through the above detection. A , and the time set S of the target material B B are not completely contained in the time set S of the multimedia data M M In this case, the start time of target material A can be adjusted from 00:50 to 01:00, and the end time of target material B can be adjusted from 03:10 to 03:00, thereby correcting the time set S of target material A. A , and the time set S of the target material B B are not completely contained in the time set S of the multimedia data M M Internal problems.

[0076] In another embodiment of the present disclosure, the target detection result includes a third detection result, and the third detection result represents whether the target material resource meets the preset custom rule; thus, in the process of executing step S102, the third detection result can be determined based on the first time information and the second time information.

[0077] As described above, the preset custom rule may include that the start time of the target material resource is the same as the start time of the multimedia data, and / or that the end time of the target material resource is the same as the end time of the multimedia data.

[0078] That is to say, users can customize the time rules that the added material resources need to comply with according to their own needs. For example, users can set the start time of one or more target materials included in the target material resources to be aligned with the start time of the multimedia data, or set the end time of one or more target materials among the multiple target materials to be aligned with the end time of the multimedia data.

[0079] In the case where it is determined that the preset custom rule is that the start time of the target material resource is the same as the start time of the multimedia data, the target material resource can be generated based on the R start =M start is a detection condition, and determines whether the target material resource meets the preset custom rule according to the first time information of the target material resource and the second time information of the multimedia data, wherein R start Indicates the start time of the target asset, M start Indicates the start time of multimedia data.

[0080] In the case where it is determined that the preset custom rule is that the start time of the target material resource is the same as the start time of the multimedia data, the target material resource can be generated based on the R end =M end is a detection condition, and determines whether the target material resource meets the preset custom rule according to the first time information of the target material resource and the second time information of the multimedia data, wherein R end Indicates the end time of the target asset, M end Indicates the end time of multimedia data.

[0081] In this embodiment, when it is determined according to the third detection result that the target material resource does not satisfy the preset custom rule, the start time or the end time of the target material resource is adjusted so that the adjusted target material resource satisfies the preset custom rule.

[0082] For example, in determining R start ≠M start In the case of R, the start time of the target material resource can be adjusted so that the start time of the adjusted target material resource is the same as the start time of the multimedia data. end ≠M end In this case, the end time of the target material resource can be adjusted so that the end time of the adjusted target material resource is the same as the end time of the multimedia data.

[0083] In another embodiment of the present disclosure, the target detection result includes a fourth detection result, and the fourth detection result represents whether the time of the target material resource spans multiple multimedia data; in this way, in the process of executing step S102, the fourth detection result can be determined based on the first time information and the second time information corresponding to each multimedia data; in the process of executing step S103, when it is determined according to the fourth detection result that the time of the target material resource spans multiple multimedia data, the target material resource can be divided according to the second time information corresponding to each multimedia data to obtain multiple sub-materials, and the sub-materials correspond one-to-one to the multimedia data.

[0084] For example, assume the following asset time information:

[0085] Multimedia data M1: (start time: 01:00, end time: 02:00);

[0086] Multimedia data M2: (start time: 02:00, end time: 03:00);

[0087] Target asset C: (start time: 01:50, end time: 02:00);

[0088] Target asset D: (start time: 01:55, end time: 02:05).

[0089] Based on the above time information, it can be determined that the target material resource D spans two multimedia data M1 and M2. Based on the second time information of the multimedia data M1 and M2, it can be determined that the end time of M1 is the same as the start time of M2 (i.e., 02:00). Therefore, the target material resource D can be split at 02:00 to obtain two sub-materials. The time ranges of these two sub-materials are 01:55--02:00 and 02:00--02:05, respectively. In this way, the sub-material corresponding to 01:55--02:00 can be added to the multimedia data M1, and the sub-material corresponding to 02:00--02:05 can be added to the multimedia data M2. The above examples are only for illustration and the present disclosure does not limit this.

[0090] FIG4 is a flow chart of a multimedia editing method according to the embodiment shown in FIG1 . As shown in FIG4 , the method further includes the following steps:

[0091] In step S105 , multimedia data to be edited and at least one material resource to be added to the multimedia data are obtained.

[0092] In actual editing scenarios, users can edit videos or images (i.e., multimedia data) through multimedia editing software. Taking video editing as an example, users can load or upload the video file to be edited to the video editing software, and the video file serves as the primary resource. Users can also further select one or more material resources they need to add to the video file. Therefore, in this step, the terminal (generally the terminal where the video editing software is located) can obtain resource data in the current multimedia editing project based on the user's selection. The resource data may include one or more primary resources to be edited, and one or more secondary resources corresponding to each primary resource. Among them, the primary resource refers to the multimedia data to be edited. For example, the primary resource may include the original video file or image shot by the user. The secondary resource refers to the material resource that needs to be added to the corresponding primary resource.

[0093] In step S106 , in response to a triggering operation by the user, the at least one material resource is added to the multimedia data, wherein the at least one material resource includes the target material resource.

[0094] In this step, for each of the material resources, the material resource may be added to the multimedia data in the material editing track corresponding to the material resource.

[0095] During video editing, different material editing tracks can be used to add different types of material resources, and each material editing track can edit one or more types of materials.

[0096] During the execution of step S102 , the target material resource added to the target editing track may be detected according to the first time information. The target editing track is the material editing track where the target material resource is located.

[0097] FIG5 is a block diagram of a multimedia editing device according to an exemplary embodiment. As shown in FIG5 , the device includes:

[0098] An acquisition module 501 is configured to acquire first time information of a target material resource, wherein the target material resource includes a material resource added to multimedia data and needs to meet a preset time rule;

[0099] A detection module 502 is configured to detect the target material resource according to the first time information to obtain a target detection result, wherein the target detection result indicates whether the target material resource added to the multimedia data satisfies the preset time rule;

[0100] The correction module 503 is configured to correct and edit the target material resource added to the multimedia data according to the target detection result to obtain edited target multimedia data.

[0101] Optionally, the target material resource includes multiple target materials; and the preset time rule includes at least one of the following:

[0102] There is no temporal overlap between any two adjacent target materials among the plurality of target materials;

[0103] The time range of the target material resource is within the time range corresponding to the multimedia data;

[0104] A preset custom rule includes that a start time of the target material resource is the same as a start time of the multimedia data, and / or an end time of the target material resource is the same as an end time of the multimedia data.

[0105] Optionally, the target detection result includes a first detection result, where the first detection result indicates whether there is a time overlap between the two adjacent target materials;

[0106] The detection module 502 is used to determine the first detection result for each two adjacent target materials among the multiple target materials on the target timeline according to the first time information corresponding to each of the two adjacent target materials, and the target timeline is the timeline of the material editing track where the target material resource is located.

[0107] Optionally, the correction module 503 is used to determine a low-priority target material from the two adjacent target materials when it is determined according to the first detection result that there is a time overlap between the two adjacent target materials; and adjust the start time and / or end time of the low-priority target material so that there is no time overlap between the adjusted low-priority target material and the other target material in the two adjacent target materials.

[0108] Optionally, the target detection result includes a second detection result, and the second detection result indicates whether the time range of the target material resource is within the time range corresponding to the multimedia data;

[0109] The acquisition module 501 is further configured to acquire second time information corresponding to the multimedia data;

[0110] The detection module 502 is configured to detect the target material resource according to the first time information and the second time information to obtain the second detection result.

[0111] Optionally, the detection module 502 is configured to determine, for each target material, whether a time range of the target material is within a time range of the multimedia data according to the first time information corresponding to the target material and the second time information of the multimedia data.

[0112] Optionally, the correction module 503 is used to adjust the start time or end time of the target material resource when it is determined according to the second detection result that the time range of the target material resource is not within the time range corresponding to the multimedia data, so that the adjusted time range of the target material resource is within the time range corresponding to the multimedia data.

[0113] Optionally, the target detection result includes a third detection result, and the third detection result indicates whether the target material resource meets the preset custom rule;

[0114] The detection module 502 is configured to determine the third detection result according to the first time information and the second time information.

[0115] Optionally, the correction module 503 is configured to adjust the start time or end time of the target material resource when it is determined according to the third detection result that the target material resource does not satisfy the preset custom rule, so that the adjusted target material resource satisfies the preset custom rule.

[0116] Optionally, the multimedia data includes a plurality of multimedia data, and the target detection result includes a fourth detection result, and the fourth detection result indicates whether the time of the target material resource spans the plurality of multimedia data;

[0117] The detection module 502 is configured to determine the fourth detection result based on the first time information and the second time information corresponding to each multimedia data;

[0118] The correction module 503 is used to divide the target material resource according to the second time information corresponding to each multimedia data to obtain multiple sub-materials when it is determined according to the fourth detection result that the time of the target material resource spans multiple multimedia data, and the sub-materials correspond one-to-one to the multimedia data.

[0119] Optionally, FIG6 is a block diagram of a multimedia editing device according to the embodiment shown in FIG5 . As shown in FIG6 , the device further includes:

[0120] The material adding module 504 is used to obtain multimedia data to be edited and at least one material resource to be added to the multimedia data; in response to a user trigger operation, the at least one material resource is added to the multimedia data, and the at least one material resource includes the target material resource.

[0121] Optionally, the material adding module 504 is configured to add each material resource to the multimedia data in a material editing track corresponding to the material resource;

[0122] The detection module 502 is configured to detect the target material resource added to a target editing track according to the first time information, where the target editing track is a material editing track corresponding to the target material resource.

[0123] Optionally, the multimedia data includes video data.

[0124] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0125] Reference is now made to FIG7 , which illustrates a schematic diagram of the structure of an electronic device suitable for implementing an embodiment of the present disclosure. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device 700 shown in FIG7 is merely an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0126] As shown in Figure 7, electronic device 700 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. Various programs and data required for the operation of electronic device 700 are also stored in RAM 703. Processing device 701, ROM 702, and RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to bus 704.

[0127] Typically, the following devices may be connected to the I / O interface 705: an input device 706 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 708 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 709. The communication device 709 may allow the electronic device 700 to communicate with other devices wirelessly or by wire to exchange data. Although FIG. 7 shows the electronic device 700 with various devices, it should be understood that not all of the devices shown are required to be implemented or present. More or fewer devices may be implemented or present instead.

[0128] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0129] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0130] In some embodiments, the client can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can interconnect with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0131] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0132] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: obtains the first time information of the target material resources, and the target material resources include the material resources added to the multimedia data that need to meet the preset time rules; detects the target material resources according to the first time information to obtain a target detection result, and the target detection result indicates whether the target material resources added to the multimedia data meet the preset time rules; and modifies and edits the target material resources added to the multimedia data according to the target detection result to obtain the edited target multimedia data.

[0133] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0134] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0135] The modules described in the embodiments of the present disclosure may be implemented in software or hardware. In some cases, the name of a module does not necessarily limit the module itself. For example, an acquisition module may also be described as a "module for acquiring time information."

[0136] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0137] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0138] According to one or more embodiments of the present disclosure, Example 1 provides a multimedia editing method, including:

[0139] Acquiring first time information of a target material resource, wherein the target material resource includes a material resource added to the multimedia data and needs to meet a preset time rule;

[0140] detecting the target material resource according to the first time information to obtain a target detection result, wherein the target detection result indicates whether the target material resource added to the multimedia data satisfies the preset time rule;

[0141] The target material resource added to the multimedia data is modified and edited according to the target detection result to obtain edited target multimedia data.

[0142] According to one or more embodiments of the present disclosure, Example 2 provides the method of Example 1, wherein the target material resource includes multiple target materials; and the preset time rule includes at least one of the following:

[0143] There is no temporal overlap between any two adjacent target materials among the plurality of target materials;

[0144] The time range of the target material resource is within the time range corresponding to the multimedia data;

[0145] A preset custom rule includes that a start time of the target material resource is the same as a start time of the multimedia data, and / or an end time of the target material resource is the same as an end time of the multimedia data.

[0146] According to one or more embodiments of the present disclosure, Example 3 provides the method of Example 2, wherein the target detection result includes a first detection result, and the first detection result indicates whether the two adjacent target materials have a temporal overlap;

[0147] The detecting the target material resource according to the first time information to obtain a target detection result includes:

[0148] For each two adjacent target materials among the multiple target materials on the target timeline, the first detection result is determined according to the first time information corresponding to each of the two adjacent target materials, and the target timeline is the timeline of the material editing track where the target material resource is located.

[0149] According to one or more embodiments of the present disclosure, Example 4 provides the method of Example 3, wherein modifying and editing the target material resource added to the multimedia data according to the target detection result includes:

[0150] In a case where it is determined according to the first detection result that the two adjacent target materials have a time overlap, determining a target material with a lower priority from the two adjacent target materials;

[0151] The start time and / or end time of the low-priority target material is adjusted so that there is no time overlap between the adjusted low-priority target material and the other target material of the two adjacent target materials.

[0152] According to one or more embodiments of the present disclosure, Example 5 provides the method of Example 2, wherein the target detection result includes a second detection result, and the second detection result indicates whether the time range of the target material resource is within the time range corresponding to the multimedia data;

[0153] The method further comprises:

[0154] Acquiring second time information corresponding to the multimedia data;

[0155] The detecting the target material resource according to the first time information to obtain a target detection result includes:

[0156] The target material resource is detected according to the first time information and the second time information to obtain the second detection result.

[0157] According to one or more embodiments of the present disclosure, Example 6 provides the method of Example 5, wherein detecting the target material resource according to the first time information and the second time information to obtain the second detection result includes:

[0158] For each target material, it is determined whether a time range of the target material is within a time range of the multimedia data according to the first time information corresponding to the target material and the second time information of the multimedia data.

[0159] According to one or more embodiments of the present disclosure, Example 7 provides the method of Example 5, wherein the modifying and editing the target material resource added to the multimedia data according to the target detection result includes:

[0160] When it is determined according to the second detection result that the time range of the target material resource is not within the time range corresponding to the multimedia data, the start time or end time of the target material resource is adjusted so that the time range of the adjusted target material resource is within the time range corresponding to the multimedia data.

[0161] According to one or more embodiments of the present disclosure, Example 8 provides the method of Example 5, wherein the target detection result includes a third detection result, and the third detection result indicates whether the target material resource satisfies the preset custom rule;

[0162] The detecting the target material resource according to the first time information to obtain a target detection result includes:

[0163] The third detection result is determined according to the first time information and the second time information.

[0164] According to one or more embodiments of the present disclosure, Example 9 provides the method of Example 8, wherein the modifying and editing the target material resource added to the multimedia data according to the target detection result includes:

[0165] When it is determined according to the third detection result that the target material resource does not satisfy the preset custom rule, the start time or the end time of the target material resource is adjusted so that the adjusted target material resource satisfies the preset custom rule.

[0166] According to one or more embodiments of the present disclosure, Example 10 provides the method of Example 1, wherein the multimedia data includes multiple data, the target detection result includes a fourth detection result, and the fourth detection result indicates whether the time of the target material resource spans the multiple multimedia data;

[0167] The detecting the target material resource according to the first time information to obtain a target detection result includes:

[0168] determining the fourth detection result according to the first time information and the second time information corresponding to each multimedia data;

[0169] The modifying and editing the target material resource added to the multimedia data according to the target detection result includes:

[0170] When it is determined according to the fourth detection result that the time of the target material resource spans multiple multimedia data, the target material resource is divided according to the second time information corresponding to each multimedia data to obtain multiple sub-materials, and the sub-materials correspond to the multimedia data one by one.

[0171] According to one or more embodiments of the present disclosure, Example 11 provides the method of Example 1, wherein before obtaining the first time information of the target material resource, the method further includes:

[0172] Acquire multimedia data to be edited and at least one material resource for adding to the multimedia data;

[0173] In response to a triggering operation of a user, the at least one material resource is added to the multimedia data, wherein the at least one material resource includes the target material resource.

[0174] According to one or more embodiments of the present disclosure, Example 12 provides the method of Example 11, wherein adding the at least one material resource to the multimedia data includes:

[0175] For each of the material resources, adding the material resource to the multimedia data in the material editing track corresponding to the material resource;

[0176] The detecting the target material resource according to the first time information includes:

[0177] The target material resource added to the target editing track is detected according to the first time information, and the target editing track is the material editing track corresponding to the target material resource.

[0178] According to one or more embodiments of the present disclosure, Example 13 provides the method of any one of Examples 1-12, wherein the multimedia data includes video data.

[0179] According to one or more embodiments of the present disclosure, Example 14 provides a multimedia editing device, including:

[0180] An acquisition module, configured to acquire first time information of a target material resource, wherein the target material resource includes a material resource added to the multimedia data and needs to meet a preset time rule;

[0181] a detection module, configured to detect the target material resource according to the first time information to obtain a target detection result, wherein the target detection result indicates whether the target material resource added to the multimedia data satisfies the preset time rule;

[0182] The correction module is used to correct and edit the target material resource added to the multimedia data according to the target detection result to obtain edited target multimedia data.

[0183] According to one or more embodiments of the present disclosure, Example 15 provides a computer-readable medium having a computer program stored thereon, which implements the steps of the method described in any one of Examples 1-13 when executed by a processing device.

[0184] According to one or more embodiments of the present disclosure, Example 16 provides an electronic device, including:

[0185] a storage device having a computer program stored thereon;

[0186] A processing device is used to execute the computer program in the storage device to implement the steps of the method described in any one of Examples 1-13.

[0187] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0188] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0189] Although the subject matter has been described using language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims. Regarding the apparatus in the above-described embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method and will not be elaborated upon here.

Claims

1. A multimedia editing method, comprising: Acquiring first time information of a target material resource, wherein the target material resource includes a material resource added to the multimedia data and needs to meet a preset time rule; detecting the target material resource according to the first time information to obtain a target detection result, wherein the target detection result indicates whether the target material resource added to the multimedia data satisfies the preset time rule; The target material resource added to the multimedia data is modified and edited according to the target detection result to obtain edited target multimedia data.

2. The method according to claim 1, wherein The target material resource includes multiple target materials; the preset time rule includes at least one of the following: There is no temporal overlap between any two adjacent target materials among the plurality of target materials; The time range of the target material resource is within the time range corresponding to the multimedia data; A preset custom rule includes that a start time of the target material resource is the same as a start time of the multimedia data, and / or an end time of the target material resource is the same as an end time of the multimedia data.

3. The method according to claim 2, wherein: The target detection result includes a first detection result, wherein the first detection result indicates whether the two adjacent target materials have a temporal overlap; The detecting the target material resource according to the first time information to obtain a target detection result includes: For each two adjacent target materials among the multiple target materials on the target timeline, the first detection result is determined according to the first time information corresponding to each of the two adjacent target materials, and the target timeline is the timeline of the material editing track where the target material resource is located.

4. The method according to claim 3, wherein: The modifying and editing the target material resource added to the multimedia data according to the target detection result includes: In a case where it is determined according to the first detection result that the two adjacent target materials have a time overlap, determining a target material with a lower priority from the two adjacent target materials; The start time and / or end time of the low-priority target material is adjusted so that there is no time overlap between the adjusted low-priority target material and the other target material of the two adjacent target materials.

5. The method according to claim 2, wherein: The target detection result includes a second detection result, and the second detection result indicates whether the time range of the target material resource is within the time range corresponding to the multimedia data; The method further comprises: Acquiring second time information corresponding to the multimedia data; The detecting the target material resource according to the first time information to obtain a target detection result includes: The target material resource is detected according to the first time information and the second time information to obtain the second detection result.

6. The method according to claim 5, wherein: The detecting the target material resource according to the first time information and the second time information to obtain the second detection result includes: For each target material, it is determined whether a time range of the target material is within a time range of the multimedia data according to the first time information corresponding to the target material and the second time information of the multimedia data.

7. The method according to claim 5 or 6, wherein: The modifying and editing the target material resource added to the multimedia data according to the target detection result includes: When it is determined according to the second detection result that the time range of the target material resource is not within the time range corresponding to the multimedia data, the start time or end time of the target material resource is adjusted so that the time range of the adjusted target material resource is within the time range corresponding to the multimedia data.

8. The method according to any one of claims 5 to 7, wherein: The target detection result includes a third detection result, and the third detection result indicates whether the target material resource meets the preset custom rule; The detecting the target material resource according to the first time information to obtain a target detection result includes: The third detection result is determined according to the first time information and the second time information.

9. The method according to claim 8, wherein The modifying and editing the target material resource added to the multimedia data according to the target detection result includes: When it is determined according to the third detection result that the target material resource does not satisfy the preset custom rule, the start time or the end time of the target material resource is adjusted so that the adjusted target material resource satisfies the preset custom rule.

10. The method according to any one of claims 1 to 9, wherein: The multimedia data includes a plurality of items, and the target detection result includes a fourth detection result, wherein the fourth detection result indicates whether the time of the target material resource spans the plurality of multimedia data items; The detecting the target material resource according to the first time information to obtain a target detection result includes: determining the fourth detection result according to the first time information and the second time information corresponding to each multimedia data; The modifying and editing the target material resource added to the multimedia data according to the target detection result includes: When it is determined according to the fourth detection result that the time of the target material resource spans multiple multimedia data, the target material resource is divided according to the second time information corresponding to each multimedia data to obtain multiple sub-materials, and the sub-materials correspond to the multimedia data one by one.

11. The method according to any one of claims 1 to 10, wherein: Before obtaining the first time information of the target material resource, the method further includes: Acquire multimedia data to be edited and at least one material resource for adding to the multimedia data; In response to a triggering operation of a user, the at least one material resource is added to the multimedia data, wherein the at least one material resource includes the target material resource.

12. The method according to claim 11, wherein The adding the at least one material resource to the multimedia data includes: For each of the material resources, adding the material resource to the multimedia data in the material editing track corresponding to the material resource; The detecting the target material resource according to the first time information includes: The target material resource added to the target editing track is detected according to the first time information, and the target editing track is the material editing track corresponding to the target material resource.

13. The method according to any one of claims 1 to 12, wherein: The multimedia data includes video data.

14. A multimedia editing device comprising: an acquisition module configured to acquire first time information of a target material resource, wherein the target material resource includes a material resource added to the multimedia data and needs to meet a preset time rule; a detection module configured to detect the target material resource according to the first time information to obtain a target detection result, wherein the target detection result indicates whether the target material resource added to the multimedia data satisfies the preset time rule; The correction module is configured to correct and edit the target material resource added to the multimedia data according to the target detection result to obtain edited target multimedia data.

15. A computer-readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processing device, the multimedia editing method according to any one of claims 1 to 13 is implemented.

16. An electronic device comprising: a storage device having a computer program stored thereon; as well as A processing device is configured to execute the computer program in the storage device to implement the multimedia editing method according to any one of claims 1 to 13.

Images