Multimedia material editing method and apparatus, electronic device, and storage medium
By detecting and adjusting the timing of different types of media streams in multimedia materials, the problem of truncation during multimedia material editing was solved, achieving the integrity and coherence of multimedia materials, and improving editing efficiency and viewing experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- BEIJING ZITIAO NETWORK TECH CO LTD
- Filing Date
- 2024-11-29
- Publication Date
- 2026-05-29
AI Technical Summary
During the editing process of multimedia materials, after importing videos for editing and processing, multimedia files may be truncated, resulting in the loss of key scenes, plots or important information, which damages the integrity and coherence of the video.
By detecting the start and end times of different types of media streams in the multimedia material, the duration is adjusted to align the minimum start and maximum end times of different types of media streams, forming a second multimedia material, which is then displayed on the editing track to avoid truncation.
Ensure time alignment of different media streams in multimedia materials to avoid the loss of key images, plot points, or important information, thereby improving the integrity and coherence of multimedia materials and enhancing editing efficiency and viewing experience.
Smart Images

Figure CN122120531A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of video processing technology, and in particular to a method, apparatus, electronic device, and storage medium for editing multimedia materials. Background Technology
[0002] In today's era of rapid technological development, short video apps are springing up like mushrooms after rain, offering a wide variety of video editing functions that make it easy to process video files and create new video works. However, a common and pressing problem has gradually emerged in the process of importing and editing various videos using short video apps: the resulting multimedia files may be truncated after editing, causing the loss of key scenes, plot points, or important information, greatly damaging the integrity and coherence of the video. Summary of the Invention
[0003] This disclosure provides a multimedia material editing method, apparatus, electronic device, and storage medium to solve the problem that multimedia files may be truncated after importing and editing videos.
[0004] In a first aspect, embodiments of this disclosure provide a multimedia material editing method, the method comprising:
[0005] In response to the import operation of the first multimedia material corresponding to the target editing task, a first detection result and a second detection result of the first multimedia material are determined. The first detection result is used to indicate whether the minimum start time of the first type of media stream and the minimum start time of the second type of media stream in the first multimedia material are the same. The second detection result is used to indicate whether the maximum end time of the first type of media stream and the maximum end time of the second type of media stream in the first multimedia material are the same.
[0006] The second multimedia material is determined based on the first detection result and the second detection result. The second multimedia material is obtained by adjusting the duration of the media stream in the first multimedia material. The minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream, and the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream.
[0007] Based on the second multimedia material, a target editing page corresponding to the target editing task is presented. The target editing page presents multimedia clips formed based on the second multimedia material and placed on the editing track.
[0008] Secondly, this disclosure also provides a multimedia material editing device, the device comprising:
[0009] The first determining module is used to determine a first detection result and a second detection result of the first multimedia material in response to the import operation of the first multimedia material corresponding to the target editing task. The first detection result is used to indicate whether the minimum start time of the first type of media stream and the minimum start time of the second type of media stream in the first multimedia material are the same. The second detection result is used to indicate whether the maximum end time of the first type of media stream and the maximum end time of the second type of media stream in the first multimedia material are the same.
[0010] The second determining module is used to determine the second multimedia material based on the first detection result and the second detection result. The second multimedia material is obtained by adjusting the duration of the media stream in the first multimedia material. The minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream, and the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream.
[0011] The presentation module is used to present the target editing page corresponding to the target editing task based on the second multimedia material. The target editing page presents multimedia clips formed based on the second multimedia material and placed on the editing track.
[0012] Thirdly, this disclosure also provides an electronic device, the electronic device comprising:
[0013] At least one processor; and
[0014] A memory communicatively connected to the at least one processor; wherein,
[0015] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the multimedia material editing method described in any of the above embodiments.
[0016] Fourthly, this disclosure also provides a computer-readable medium storing computer instructions that, when executed by a processor, implement the multimedia material editing method described in any of the above embodiments.
[0017] The technical solution of this disclosure embodiment detects the start and end times of different types of media streams in the imported first multimedia material, accurately determining whether the media streams are aligned in time. Then, based on the detection results, the duration of the media streams in the first multimedia material is adjusted to obtain a second multimedia material, aligning the minimum start and maximum end times of different types of media streams in the second multimedia material. Subsequently, the target editing page is displayed based on the multimedia segments formed by the second multimedia material and placed on the editing track. This avoids the problem of inconsistent durations of different types of media streams in the imported multimedia material and the potential for some media streams to be truncated when displaying with specific types of media stream durations. This prevents the loss of key scenes, plots, or important information in the multimedia material, greatly damaging the integrity and coherence of the multimedia material, and causing the loss of key scenes, plot twists, or information.
[0018] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description
[0019] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.
[0020] Figure 1 This is a flowchart illustrating a multimedia material editing method provided in an embodiment of this disclosure;
[0021] Figure 2 This is a schematic diagram of the multimedia material import and editing page provided in the embodiments of this disclosure;
[0022] Figure 3 This is a schematic diagram comparing the start and end times of different types of media streams in the multimedia materials provided in the embodiments of this disclosure;
[0023] Figure 4 This is a flowchart illustrating another multimedia material editing method provided in this embodiment of the disclosure;
[0024] Figure 5 This is a schematic diagram of the structure of a multimedia material editing device provided in an embodiment of this disclosure;
[0025] Figure 6 This is a schematic diagram of the structure of an electronic device that implements a multimedia material editing method according to an embodiment of this disclosure. Detailed Implementation
[0026] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.
[0027] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.
[0028] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.
[0029] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.
[0030] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".
[0031] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
[0032] Figure 1 This is a flowchart illustrating a multimedia material editing method provided in an embodiment of the present disclosure. This embodiment is applicable to situations where the start and end times of different types of media streams in imported multimedia materials are detected and the duration of the media streams is adjusted. This multimedia material editing method can be executed by a multimedia material editing device, which can be implemented in the form of software and / or hardware, and is generally integrated on any electronic device with network communication function, such as a mobile terminal, a PC, or a server.
[0033] like Figure 1As shown, the multimedia material editing method of this disclosure embodiment may include the following process:
[0034] S110. In response to the import operation of the first multimedia material corresponding to the target editing task, determine the first detection result and the second detection result of the first multimedia material. The first detection result is used to indicate whether the minimum start time of the first type of media stream and the minimum start time of the second type of media stream in the first multimedia material are the same. The second detection result is used to indicate whether the maximum end time of the first type of media stream and the maximum end time of the second type of media stream in the first multimedia material are the same.
[0035] A target editing task refers to the processing and modification of multimedia materials to achieve a desired editing effect. Multimedia materials refer to the various original materials used to constitute a multimedia work, and can include at least one of the following: video materials, audio materials, and image materials. These include video materials such as film clips, movie clips, and animated short films; audio materials such as music tracks, sound effects, and recorded sounds; and image materials such as photographs, illustrations, icons, and graphics.
[0036] Optionally, multimedia material editing tasks can refer to the processing, modification, integration, and optimization of multimedia materials to achieve specific creative goals or meet specific needs. Multimedia material editing tasks can include at least one of the following: video material editing tasks, audio material editing tasks, and image material editing tasks. Specifically, video material editing tasks include video editing, video splicing, adding video effects, and video color correction; audio material editing tasks include audio editing, audio mixing, adding sound effects, and audio restoration; and image material editing tasks include image cropping, image color correction, image retouching, image compositing, and adding text to images.
[0037] For example, editing multiple video clips to create a complete video work involves adjusting the color, brightness, and contrast of image materials, and mixing, noise reduction, or adding special effects to audio materials. Another example is creating a multimedia content task such as a commercial, a film, a teaching document, a musical piece, or multimedia content for a webpage. Yet another example is creating a product promotional video; the process of collecting relevant product images, filming videos of product usage scenarios, and recording narration audio to obtain multimedia materials, along with subsequent editing operations such as editing, adding subtitles, and adding background music, all constitute this multimedia content editing task.
[0038] See Figure 2The first multimedia material is multimedia material selected from a preset material library (such as a photo album) and / or multimedia material acquired through real-time shooting (such as real-time shooting by activating the built-in camera) for the target editing task. The first multimedia material contains at least one first type of media stream and at least one second type of media stream. For example, the first type of media stream may be a video stream and the second type of media stream may be an audio stream. The first type of media stream and the second type of media stream complement each other to form multimedia material with a rich audiovisual experience.
[0039] For the first multimedia material including several first-type media streams and several second-type media streams, these different types of media streams in the first multimedia material have multiple possibilities in terms of time characteristics. The start time and end time of the first-type media stream and the second-type media stream can be the same or different. Specifically, in terms of start time, the start time of the first-type media stream can be the same as the start time of the second-type media stream, that is, they start playing or presenting at the same time. However, the start time of the first-type media stream can also be different from the start time of the second-type media stream. For example, the first-type media stream starts at one start time, while the second-type media stream starts at another different start time.
[0040] Similarly, in terms of ending time, the first type of media stream and the second type of media stream can end at the same time, bringing the playback of the entire multimedia material to a close. However, there are also situations where the first type of media stream and the second type of media stream end at different times. The first type of media stream may have already ended playing while the second type of media stream continues playing; or vice versa, the second type of media stream may have ended playing first while the first type of media stream continues playing.
[0041] For example, see Figure 3 Taking video streams as the first type of media stream and audio streams as the second type of media stream as an example, the start time of video stream 1 is later than the start time of audio stream 1 and audio stream 2, and the start time of video stream 2 is earlier than the start time of audio stream 1; the end time of video stream 2 is earlier than the end time of audio stream 1, the end time of video stream 1 is later than the end time of audio stream 2, the end time of video stream 1 is earlier than the end time of audio stream 2, the end time of video stream 2 is later than the end time of audio stream 2, and the end time of video stream 2 is earlier than the end time of audio stream 2. These different types of media streams have a variety of possibilities in terms of timing characteristics.
[0042] As an optional but not limited implementation, determining the first detection result and the second detection result of the first multimedia material includes the following steps A1-A2:
[0043] Step A1: Determine the first type of media stream and the second type of media stream separated from the first multimedia material.
[0044] Step A2: Perform time detection on the first type of media stream and the second type of media stream separated from the first multimedia material to obtain the first detection result and the second detection result of the first multimedia material.
[0045] See Figure 2 and Figure 3 The first multimedia material can be a video file; for example, a video file containing both video and audio is a typical example. Since the multimedia material needs to be split into media streams and placed on the editing track for display, the different types of media streams within the first multimedia material can be separated. This allows for individual analysis and processing of the first and second type media streams. For instance, based on the media stream format and encoding method of each media stream in the first multimedia material, the first and second type media streams can be parsed and extracted.
[0046] See Figure 2 and Figure 3 The system can detect the start and end times of the separated first-type media stream and second-type media stream respectively, determine the start and end times of each first-type media stream, and determine the start and end times of the second-type media stream. Then, it can determine the minimum start time of the first-type media stream and the minimum start time of the second-type media stream in the first multimedia material to obtain the first detection result, and determine the maximum end time of the first-type media stream and the maximum end time of the second-type media stream in the first multimedia material to obtain the second detection result.
[0047] By using the above method, and by separating different types of media streams and performing time detection on each separated type of media stream, we can gain a deeper understanding of the specific time characteristics of each media stream in the multimedia material. This helps to discover problems such as time deviations between media streams. If it is found that the start time or end time of each type of media stream is different, the duration of each type of media stream in the multimedia material can be adjusted accordingly. This avoids the situation where some types of media streams are truncated and cannot be displayed completely when they enter the editing track due to inconsistencies in the start and end times of each type of media stream.
[0048] As an optional but not limited implementation, determining the first type of media stream and the second type of media stream separated from the first multimedia material includes the following steps:
[0049] When transcoding and compressing the imported first multimedia material, the first type of media stream and the second type of media stream are separated from the first multimedia material.
[0050] After importing the first multimedia material, it undergoes transcoding before entering an editing page with various editing tools and functions for finer-grained editing operations such as trimming, adding effects, and adjusting audio. During transcoding and compression, different types of media streams need to be separated from the first multimedia material; for example, the first type of media stream and the second type of media stream can represent video and audio streams, respectively. This separation process involves parsing the multimedia material. Based on the media stream format and encoding method of each media stream, the video and audio streams can be extracted separately, allowing for independent processing of each stream.
[0051] S120. Determine the second multimedia material based on the first detection result and the second detection result. The second multimedia material is obtained by adjusting the duration of the media stream in the first multimedia material. The minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream, and the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream.
[0052] See Figure 3 In multimedia content editing, if the start times and / or end times of different types of media streams are not aligned, it may cause one type of media stream to be truncated during presentation, resulting in the loss of some information in the media stream and affecting the editing of multiple multimedia materials. Therefore, when importing the first multimedia material corresponding to the target editing task, a detection process is initiated to check the first and second types of media streams included in the first multimedia material. This process determines whether the maximum end time of the first type of media stream is the same as the maximum end time of the second type of media stream, and whether the minimum start time of the first type of media stream (e.g., video stream) is consistent with the minimum start time of the second type of media stream (e.g., audio stream).
[0053] See Figure 3The first detection result is used to determine whether the minimum start time of the first type of media stream (e.g., video stream) in the first multimedia material is the same as the minimum start time of the second type of media stream (e.g., audio stream). This minimum start time refers to the earliest time when the first type of media stream and the second type of media stream begin to appear in the entire multimedia material. Similarly, the second detection result is used to indicate whether the maximum end time of the first type of media stream in the first multimedia material is the same as the maximum end time of the second type of media stream. This maximum end time refers to the latest time when the first type of media stream and the second type of media stream end in the entire multimedia material.
[0054] See Figure 3 If the first detection result shows that the minimum start time of the first type of media stream and the minimum start time of the second type of media stream contained in the first multimedia material are different, then the duration of one type of media stream can be extended at the beginning of the media stream to make its minimum start time consistent with the other type of media stream. Similarly, if the second detection result shows that the maximum end time of the first type of media stream and the maximum end time of the second type of media stream contained in the first multimedia material are different, then the duration of one type of media stream can be extended at the end of the media stream to make its minimum start time consistent with the other type of media stream.
[0055] See Figure 3 After time extension adjustments, the minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream. This ensures that both types of media streams start simultaneously when the second multimedia material is played. Simultaneously, the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream, ensuring that both types of media streams end simultaneously when playback ends.
[0056] Using the above method, the temporal structure of multimedia materials can be quickly understood based on the detection results. This allows us to identify which types of media streams in the multimedia materials are truncated due to their shorter duration. This enables us to adjust the duration of the media streams in a timely manner based on the detection results of the first multimedia material, thus preventing some media streams from being truncated and unable to be displayed completely due to misalignment of duration.
[0057] S130. Based on the second multimedia material, present the target editing page corresponding to the target editing task. The target editing page presents multimedia clips formed based on the second multimedia material and placed on the editing track.
[0058] See Figure 2 and Figure 3The second multimedia material is obtained by extending the time of a portion of the media stream in the first multimedia material, so that the start and end times of the second multimedia material, including the first type of media stream, are aligned with the start and end times of the second type of media stream. Extending the time of the media stream can be achieved by adding blank frames, slowing down the playback speed, etc., with the aim of matching the start and end times of the first type of media stream with those of the second type of media stream.
[0059] See Figure 2 and Figure 3 When presenting the target editing page corresponding to the target editing task based on the second multimedia material, since the start and end times of the first type of media stream are already aligned with the start and end times of the second type of media stream, when the first and second type of media streams are placed on the editing track, the second type of media stream will not be truncated and incompletely displayed due to the shorter duration of the first type of media stream. In other words, when importing the first multimedia material and placing its contained media streams on the editing track, if the start and end times of the first and second type of media streams are inconsistent, it may result in part of the second type of media stream being truncated and incompletely displayed.
[0060] Based on the detection results of the first multimedia material, the time extension of the first type of media stream can be adjusted in a timely manner. This avoids the situation where the start and end times of the first type of media stream cannot be aligned with the start and end times of the second type of media stream, which would cause some of the second type of media stream to be truncated and not displayed completely when the first multimedia material is imported and the included media stream is placed on the editing track. This ensures the integrity of the multimedia content during the editing and playback process.
[0061] As an optional but not limited implementation, after presenting the target editing page corresponding to the target editing task based on the second multimedia material, the following steps B1-B2 are also included:
[0062] Step B1: Obtain the editing record information of the target editing page. The editing record information of the target editing page is used to record the editing operation information triggered on the editing track of the target editing page during the process of performing editing operations on multimedia segments on the editing track of the target editing page.
[0063] Step B2: Generate the target editing result corresponding to the target editing task based on the editing record information of the target editing page and the multimedia clips on the editing track of the target editing page.
[0064] See Figure 2During the editing process of candidate multimedia segments on the target editing page, the system actively acquires the editing record information of the target editing page. In other words, every operation triggered on the editing track during editing of candidate multimedia segments on the target editing page is recorded in detail, such as the range of the clip being edited, the type of effects added, the audio parameters adjusted, etc. This editing operation information constitutes the editing record information of the target editing page, comprehensively reflecting the details of various editing operations performed by the user on the candidate multimedia segments on the editing track during the editing process.
[0065] See Figure 2 After generating multimedia segments corresponding to various media streams based on the second multimedia material and placing them on the editing track to present the target editing page corresponding to the target editing task, the system can comprehensively process and integrate the editing record information of the multimedia segments on the target editing page and the multimedia segments on the editing track. Through this editing record information, the system ultimately generates the target editing result corresponding to the target editing task. The target editing result may be a complete multimedia work, such as an edited video, a processed image, etc., fully meeting the user's expectations and operations during the editing process.
[0066] The technical solution of this disclosure embodiment detects the start and end times of different types of media streams in the imported first multimedia material, accurately determining whether the media streams are aligned in time. Then, based on the detection results, the duration of the media streams in the first multimedia material is adjusted to obtain a second multimedia material, aligning the minimum start and maximum end times of different types of media streams in the second multimedia material. Subsequently, the target editing page is displayed based on the multimedia segments formed by the second multimedia material and placed on the editing track. This avoids the problem of inconsistent durations of different types of media streams in the imported multimedia material and the potential for some media streams to be truncated when displaying with specific types of media stream durations. This prevents the loss of key scenes, plots, or important information in the multimedia material, greatly damaging the integrity and coherence of the multimedia material, and causing the loss of key scenes, plot twists, or information.
[0067] Based on the above embodiments, optionally, before determining the first detection result and the second detection result of the first multimedia material, the following steps are also included:
[0068] Based on the first multimedia material, a candidate editing page corresponding to the target editing task is presented. The candidate editing page presents multimedia clips formed based on the first multimedia material and placed on the editing track.
[0069] Accordingly, the target editing page corresponding to the target editing task is presented based on the second multimedia material, including the following steps:
[0070] The multimedia clips formed based on the second multimedia material replace the original multimedia clips on the editing track of the candidate editing page, so as to replace the target editing page corresponding to the target editing task from the candidate editing page.
[0071] Determining the first and second detection results of the first multimedia material may take a long time, causing the editing page to remain in the loading process instead of being displayed. Therefore, before determining the first and second detection results of the first multimedia material, the first multimedia material can be imported to form multimedia segments corresponding to the first type of media stream and the second type of media stream, and placed on the editing track to present the candidate editing page corresponding to the target editing task.
[0072] Furthermore, the process of obtaining the first and second detection results of the first multimedia material does not block browsing or editing operations on the candidate editing page, making full use of resources. This allows browsing and editing operations on the target editing page to occur simultaneously with the acquisition of the first and second detection results of the first multimedia material. This enables a quick preview of the initial effects of most of the originally imported multimedia material on the editing track. It also allows for an intuitive understanding of the overall layout and general content at this stage, enabling the early identification of potential problems or determination of the editing direction, and the early development of ideas such as conceiving editing points and adding preliminary special effects markers on the candidate editing page.
[0073] By first presenting the candidate editing page, preliminary editing operations or subsequent editing strategies can be considered while waiting for the detection results of the first multimedia material. Once the detection results are finalized and the second multimedia material is generated, the new multimedia clip can quickly replace the original one, achieving a seamless transition from the candidate editing page to the target editing page. This method avoids wasting time waiting for detection results and greatly improves editing efficiency.
[0074] By replacing the original segments on the candidate editing page with multimedia segments formed based on the second multimedia material, higher quality and accuracy of the multimedia content on the final target editing page are ensured, playback problems caused by inconsistent media stream timing are avoided, and the viewing and listening experience is improved.
[0075] Figure 4This is a flowchart illustrating another multimedia material editing method provided by an embodiment of the present disclosure. The technical solution of this embodiment further optimizes the process of determining the second multimedia material based on the first detection result and the second detection result in the foregoing embodiments, based on the technical solution of the above embodiments. This embodiment can be combined with various optional solutions in one or more of the above embodiments.
[0076] like Figure 4 As shown, the multimedia material editing method of this disclosure embodiment may include the following process:
[0077] S410. In response to the import operation of the first multimedia material corresponding to the target editing task, determine the first detection result and the second detection result of the first multimedia material. The first detection result is used to indicate whether the minimum start time of the first type of media stream and the minimum start time of the second type of media stream in the first multimedia material are the same. The second detection result is used to indicate whether the maximum end time of the first type of media stream and the maximum end time of the second type of media stream in the first multimedia material are the same.
[0078] S420. Determine a target media stream from the first type of media stream in the first multimedia material. The duration of the target media stream is not less than the duration of the remaining media streams in the first type of media stream included in the first multimedia material, excluding the target media stream.
[0079] S430. Based on the first detection result and the second detection result, perform a time extension operation on the target media stream in the first multimedia material, so that the start time and end time of the target media stream after the time extension operation are aligned with the minimum start time and the maximum end time of the second type of media stream, respectively.
[0080] The first multimedia material may contain multiple first-type media streams. When extending the duration of a first-type media stream, whether the extension is applied to all first-type media streams or to a shorter one, especially when the extension is achieved by filling in preset image frames, it may result in a large number of extension operations, wasting computational resources and increasing time consumption. Therefore, when adjusting the duration of media streams in the first multimedia material, it is necessary to first determine the target media stream from among the various first-type media streams contained in the first multimedia material. The standard is that the duration of the target media stream is not less than the duration of the remaining first-type media streams excluding the target media stream. In this way, the target media stream is a relatively longer media stream segment among the various first-type media streams.
[0081] Among them, see Figure 3The first detection result indicates whether the minimum start time of the first type of media stream in the first multimedia material is the same as the minimum start time of the second type of media stream. The second detection result indicates whether the maximum end time of the first type of media stream in the first multimedia material is the same as the maximum end time of the second type of media stream. Based on the first and second detection results, the extension time for the target media stream can be determined, and thus, a time extension operation can be performed on the target media stream so that the extended start and end times of the target media stream are aligned with the minimum start time and maximum end time of the second type of media stream, respectively.
[0082] By identifying target media streams with relatively long durations, time extension processing can be performed on these target media streams in a centralized manner. This reduces the complexity of processing multiple short-duration media streams separately, improves overall processing efficiency, and allows for more effective use of computing resources and time in subsequent processing, avoiding unnecessary repetitive operations on too many short-duration media streams.
[0083] As an optional but not limited implementation, the target media stream in the first multimedia material is subjected to a time extension operation based on the first detection result and the second detection result, including the following steps C11-C12:
[0084] Step C11: If the first detection result indicates that the minimum start time of the first type of media stream in the first multimedia material is greater than the minimum start time of the second type of media stream, then a first time extension operation is performed on the target media stream so that the start time of the target media stream after the first time extension operation is the same as the minimum start time of the second type of media stream.
[0085] Step C12: If the first detection result indicates that the maximum end time of the first type of media stream in the first multimedia material is less than the maximum end time of the second type of media stream, then a second time extension operation is performed on the target media stream so that the end time of the target media stream after the second time extension operation is the same as the maximum end time of the second type of media stream.
[0086] As another optional but not limited implementation, the target media stream in the first multimedia material is subjected to a time extension operation based on the first detection result and the second detection result, including the following steps C21-C22:
[0087] Step C21: If the first detection result indicates that the minimum start time of the first type of media stream in the first multimedia material is greater than the minimum start time of the second type of media stream, then starting from the start time of the target media stream, extend the time of the target media stream in the first multimedia material along the media stream timeline from the end time of the target media stream toward the start time, until the extended time point is aligned with the minimum start time of the second type of media stream.
[0088] Step C22: If the first detection result indicates that the minimum end time of the first type of media stream in the first multimedia material is less than the maximum end time of the second type of media stream, then starting from the end time of the target media stream, extend the time of the target media stream in the first multimedia material along the media stream timeline from the start time of the target media stream toward the end time, until the extended time point is aligned with the maximum end time of the second type of media stream.
[0089] S440. The first type of media stream and the second type of media stream in the first multimedia material that has undergone the time extension operation on the target media stream are repackaged to obtain the second multimedia material.
[0090] The second multimedia material is obtained by adjusting the duration of the media stream in the first multimedia material. The minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream, and the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream.
[0091] As an optional but not limited implementation, the first-time extension operation on the target media stream includes the following steps:
[0092] On the side away from the start time of the target media stream along the first timeline direction, starting from the start time of the target media stream, a first time extension operation is performed on the target media stream by filling it with preset image frames along the first timeline direction. The first timeline direction is the direction along the media stream timeline from the end time of the target media stream toward the start time.
[0093] Accordingly, a second time extension operation is performed on the target media stream, including the following steps:
[0094] On the side away from the end time of the target media stream along the second timeline direction, starting from the end time of the target media stream, a second time extension operation is performed on the target media stream by filling it with preset image frames along the second timeline direction. The second timeline direction is the direction along the media stream timeline from the start time of the target media stream toward the end time.
[0095] The first timeline direction is defined as the direction along the media stream timeline from the end time of the target media stream towards the start time; this means tracing back along the media stream timeline. Operations are performed on the side of this direction away from the start time of the target media stream, that is, in the time period before the start time of the target media stream. Starting from the start time of the target media stream, the first time extension operation of the target media stream is achieved by filling it with preset image frames along the first timeline direction. The preset image frames can be specific still images, blank frames, black frames, or repeating image sequences, etc., used to increase the duration of the target media stream before the start time. The preset image frames can also be image frames extracted from the target media stream to enhance the coherence of the target media stream in the initial portion.
[0096] The second timeline direction is along the media stream timeline from the start time of the target media stream towards its end time, i.e., the direction of forward temporal progression. Operations are performed along this direction away from the end time of the target media stream, specifically in the time period after the end time of the target media stream. Starting from the end time of the target media stream, a second time extension operation is achieved by filling the target media stream with preset image frames along the second timeline direction.
[0097] By padding the target media stream with preset image frames before its start time, the start time of the target media stream can be flexibly adjusted, allowing for better time alignment with other types of media streams. Furthermore, the pre-set image frames can enhance the continuity of the target media stream's beginning to some extent. If the target media stream starts too abruptly, the added image frames can serve as a transition.
[0098] As an alternative but not limited implementation, the target media stream is extended in the first instance, including the following steps D11-D12:
[0099] Step D11: Use the minimum start time of the second type of media stream as the start time of the first time extension operation and the start time of the target media stream as the end time of the first time extension operation.
[0100] Step D12: Fill the time between the start point and the end time of the first time extension operation with a preset graphic frame and connect it to the target media stream through the start time of the target media stream.
[0101] As an alternative but not limited implementation, a second time extension operation is performed on the target media stream, including the following steps D21-D22:
[0102] Step D21: Use the end time of the target media stream as the starting point of the second time extension operation and the maximum end time of the second type of media stream as the end time of the second time extension operation.
[0103] Step D22: Fill the time between the start point and the end time of the second time extension operation with a preset graphic frame and connect it to the target media stream by the end time of the target media stream.
[0104] S450: Based on the second multimedia material, present the target editing page corresponding to the target editing task. The target editing page presents a multimedia segment formed based on the second multimedia material and placed on the editing track.
[0105] The technical solution of this disclosure embodiment detects the start and end times of different types of media streams in the imported first multimedia material, accurately determining whether the media streams are aligned in time. Then, based on the detection results, the duration of the media streams in the first multimedia material is adjusted to obtain a second multimedia material, aligning the minimum start and maximum end times of different types of media streams in the second multimedia material. Subsequently, the target editing page is displayed based on the multimedia segments formed by the second multimedia material and placed on the editing track. This avoids the problem of inconsistent durations of different types of media streams in the imported multimedia material and the potential for some media streams to be truncated when displaying with specific types of media stream durations. This prevents the loss of key scenes, plots, or important information in the multimedia material, greatly damaging the integrity and coherence of the multimedia material, and causing the loss of key scenes, plot twists, or information.
[0106] Figure 5 This is a schematic diagram of a multimedia material editing device provided in an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to the detection of start and end times of different types of media streams in imported multimedia materials and the adjustment of media stream duration. The multimedia material editing device can be implemented in the form of software and / or hardware, and is generally integrated on any electronic device with network communication function, such as a mobile terminal, PC, or server.
[0107] like Figure 5 As shown, the multimedia material editing apparatus of this disclosure embodiment may include the following:
[0108] The first determining module 510 is used to determine a first detection result and a second detection result of the first multimedia material in response to the import operation of the first multimedia material corresponding to the target editing task. The first detection result is used to indicate whether the minimum start time of the first type of media stream and the minimum start time of the second type of media stream in the first multimedia material are the same. The second detection result is used to indicate whether the maximum end time of the first type of media stream and the maximum end time of the second type of media stream in the first multimedia material are the same.
[0109] The second determining module 520 is used to determine the second multimedia material based on the first detection result and the second detection result. The second multimedia material is obtained by adjusting the duration of the media stream in the first multimedia material. The minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream, and the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream.
[0110] The presentation module 530 is used to present the target editing page corresponding to the target editing task based on the second multimedia material. The target editing page presents a multimedia segment formed based on the second multimedia material and placed on the editing track.
[0111] Based on the technical solutions of the above embodiments, optionally, before determining the first detection result and the second detection result of the first multimedia material, the method further includes:
[0112] Based on the first multimedia material, a candidate editing page corresponding to the target editing task is presented, and the candidate editing page presents multimedia segments formed based on the first multimedia material and placed on the editing track;
[0113] Accordingly, presenting the target editing page corresponding to the target editing task based on the second multimedia material includes:
[0114] The multimedia fragment formed based on the second multimedia material replaces the original multimedia fragment on the editing track of the candidate editing page, so as to replace the target editing page corresponding to the target editing task from the candidate editing page.
[0115] Based on the technical solutions of the above embodiments, optionally, determining the first detection result and the second detection result of the first multimedia material includes:
[0116] Identify the first type of media stream and the second type of media stream separated from the first multimedia material;
[0117] Time detection is performed on the first type of media stream and the second type of media stream separated from the first multimedia material to obtain the first detection result and the second detection result of the first multimedia material.
[0118] Based on the technical solutions of the above embodiments, optionally, determining the first type of media stream and the second type of media stream separated from the first multimedia material includes:
[0119] When transcoding and compressing the imported first multimedia material, a first type of media stream and a second type of media stream are separated from the first multimedia material.
[0120] Based on the technical solutions of the above embodiments, optionally, determining the second multimedia material according to the first detection result and the second detection result includes:
[0121] A target media stream is determined from the first type of media stream in the first multimedia material, and the duration of the target media stream is not less than the duration of the remaining media streams in the first type of media stream included in the first multimedia material, excluding the target media stream;
[0122] Based on the first detection result and the second detection result, a time extension operation is performed on the target media stream in the first multimedia material so that the start time and end time of the target media stream after the time extension operation are aligned with the minimum start time and the maximum end time of the second type of media stream, respectively.
[0123] The first type of media stream and the second type of media stream in the first multimedia material, after the time extension operation on the target media stream is performed, are repackaged to obtain the second multimedia material.
[0124] Based on the technical solutions of the above embodiments, optionally, a time extension operation is performed on the target media stream in the first multimedia material according to the first detection result and the second detection result, including:
[0125] If the first detection result indicates that the minimum start time of the first type of media stream in the first multimedia material is greater than the minimum start time of the second type of media stream, then a first time extension operation is performed on the target media stream so that the start time of the target media stream after the first time extension operation is the same as the minimum start time of the second type of media stream;
[0126] If the first detection result indicates that the maximum end time of the first type of media stream in the first multimedia material is less than the maximum end time of the second type of media stream, then a second time extension operation is performed on the target media stream so that the end time of the target media stream after the second time extension operation is the same as the maximum end time of the second type of media stream.
[0127] Based on the technical solutions of the above embodiments, optionally, a first time extension operation is performed on the target media stream, including:
[0128] On the side away from the start time of the target media stream along the first timeline direction, starting from the start time of the target media stream, a first time extension operation is performed on the target media stream by filling it with preset image frames along the first timeline direction. The first timeline direction is the direction along the media stream timeline from the end time of the target media stream toward the start time.
[0129] Accordingly, a second time extension operation is performed on the target media stream, including:
[0130] On the side away from the end time of the target media stream along the second timeline direction, starting from the end time of the target media stream, a second time extension operation is performed on the target media stream by filling it with preset image frames along the second timeline direction. The second timeline direction is the direction along the media stream timeline from the start time of the target media stream toward the end time.
[0131] Based on the technical solutions of the above embodiments, optionally, a first time extension operation is performed on the target media stream, including:
[0132] The minimum start time of the second type of media stream is used as the start time of the first time extension operation, and the start time of the target media stream is used as the end time of the first time extension operation.
[0133] A preset graphic frame is filled between the start time and the end time of the first time extension operation, and the target media stream is connected to the target media stream through the start time of the target media stream;
[0134] Accordingly, a second time extension operation is performed on the target media stream, including:
[0135] The end time of the target media stream is used as the starting point of the second time extension operation, and the maximum end time of the second type of media stream is used as the end time of the second time extension operation.
[0136] A preset graphic frame is filled between the start point and the end time of the second time extension operation, and the connection is made with the target media stream at the end time of the target media stream.
[0137] Based on the technical solutions of the above embodiments, optionally, after presenting the target editing page corresponding to the target editing task based on the second multimedia material, the method further includes:
[0138] The editing record information of the target editing page is obtained. The editing record information of the target editing page is used to record the editing operation information triggered on the editing track of the target editing page during the process of performing editing operations on multimedia segments on the editing track of the target editing page.
[0139] The target editing result corresponding to the target editing task is generated based on the editing record information of the target editing page and the multimedia segments on the editing track of the target editing page.
[0140] The technical solution of this disclosure embodiment detects the start and end times of different types of media streams in the imported first multimedia material, accurately determining whether the media streams are aligned in time. Then, based on the detection results, the duration of the media streams in the first multimedia material is adjusted to obtain a second multimedia material, aligning the minimum start and maximum end times of different types of media streams in the second multimedia material. Subsequently, the target editing page is displayed based on the multimedia segments formed by the second multimedia material and placed on the editing track. This avoids the problem of inconsistent durations of different types of media streams in the imported multimedia material and the potential for some media streams to be truncated when displaying with specific types of media stream durations. This prevents the loss of key scenes, plots, or important information in the multimedia material, greatly damaging the integrity and coherence of the multimedia material, and causing the loss of key scenes, plot twists, or information.
[0141] The multimedia material editing device provided in this disclosure can execute the multimedia material editing method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the multimedia material editing method.
[0142] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.
[0143] Figure 6 This is a schematic diagram of the structure of an electronic device that implements a multimedia material editing method according to an embodiment of this disclosure. Refer to the following... Figure 6 It illustrates an electronic device suitable for implementing embodiments of the present disclosure (e.g., Figure 6 The diagram below shows the structure of the terminal device or server 600. The terminal device in this embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and vehicle terminals (e.g., vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 6 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.
[0144] like Figure 6 As shown, electronic device 600 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 602 or a program loaded from storage device 608 into random access memory (RAM) 603. The RAM 603 also stores various programs and data required for the operation of electronic device 600. The processing unit 601, ROM 602, and RAM 603 are interconnected via bus 604. An edit / output (I / O) interface 605 is also connected to bus 604.
[0145] Typically, the following devices can be connected to I / O interface 605: input devices 606 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 607 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 608 including, for example, magnetic tapes, hard disks, etc.; and communication devices 609. Communication device 609 allows electronic device 600 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 6 An electronic device 600 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.
[0146] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the multimedia material editing method shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by the processing device 601, it performs the functions defined above in the multimedia material editing method of embodiments of this disclosure.
[0147] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
[0148] The electronic device provided in this embodiment and the multimedia material editing method provided in the above embodiments belong to the same inventive concept. Technical details not described in detail in this embodiment can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.
[0149] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the multimedia material editing method provided in the above embodiments.
[0150] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.
[0151] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.
[0152] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.
[0153] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to: in response to an import operation of a first multimedia material corresponding to a target editing task, determine a first detection result and a second detection result of the first multimedia material, wherein the first detection result is used to indicate whether the minimum start time of a first type of media stream in the first multimedia material is the same as the minimum start time of a second type of media stream, and the second detection result is used to indicate whether the maximum end time of the first type of media stream in the first multimedia material is the same as the maximum end time of the second type of media stream; determine a second multimedia material based on the first detection result and the second detection result, wherein the second multimedia material is obtained by adjusting the duration of the media streams in the first multimedia material, wherein the minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream, and the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream; and present a target editing page corresponding to the target editing task based on the second multimedia material, wherein the target editing page presents multimedia segments formed based on the second multimedia material and placed on the editing track.
[0154] Computer program code for performing the operations of this disclosure can be written in one or more programming languages or a combination thereof, including but not limited to object-oriented programming languages such as Java, Smalltalk, and C++, as well as conventional procedural programming languages such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0155] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.
[0156] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".
[0157] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.
[0158] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0159] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.
[0160] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.
[0161] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.
Claims
1. A method for editing multimedia materials, characterized in that, The method includes: In response to the import operation of the first multimedia material corresponding to the target editing task, a first detection result and a second detection result of the first multimedia material are determined. The first detection result is used to indicate whether the minimum start time of the first type of media stream and the minimum start time of the second type of media stream in the first multimedia material are the same. The second detection result is used to indicate whether the maximum end time of the first type of media stream and the maximum end time of the second type of media stream in the first multimedia material are the same. The second multimedia material is determined based on the first detection result and the second detection result. The second multimedia material is obtained by adjusting the duration of the media stream in the first multimedia material. The minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream, and the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream. Based on the second multimedia material, a target editing page corresponding to the target editing task is presented. The target editing page presents multimedia clips formed based on the second multimedia material and placed on the editing track.
2. The method according to claim 1, characterized in that, Before determining the first detection result and the second detection result of the first multimedia material, the method further includes: Based on the first multimedia material, a candidate editing page corresponding to the target editing task is presented, and the candidate editing page presents multimedia segments formed based on the first multimedia material and placed on the editing track; Accordingly, presenting the target editing page corresponding to the target editing task based on the second multimedia material includes: The multimedia fragment formed based on the second multimedia material replaces the original multimedia fragment on the editing track of the candidate editing page, so as to replace the target editing page corresponding to the target editing task from the candidate editing page.
3. The method according to claim 1, characterized in that, Determine the first and second detection results of the first multimedia material, including: Identify the first type of media stream and the second type of media stream separated from the first multimedia material; Time detection is performed on the first type of media stream and the second type of media stream separated from the first multimedia material to obtain the first detection result and the second detection result of the first multimedia material.
4. The method according to claim 3, characterized in that, Determining the first type of media stream and the second type of media stream separated from the first multimedia material includes: When transcoding and compressing the imported first multimedia material, a first type of media stream and a second type of media stream are separated from the first multimedia material.
5. The method according to claim 1, characterized in that, The second multimedia material is determined based on the first detection result and the second detection result, including: A target media stream is determined from the first type of media stream in the first multimedia material, and the duration of the target media stream is not less than the duration of the remaining media streams in the first type of media stream included in the first multimedia material, excluding the target media stream; Based on the first detection result and the second detection result, a time extension operation is performed on the target media stream in the first multimedia material so that the start time and end time of the target media stream after the time extension operation are aligned with the minimum start time and the maximum end time of the second type of media stream, respectively. The first type of media stream and the second type of media stream in the first multimedia material, after the time extension operation on the target media stream is performed, are repackaged to obtain the second multimedia material.
6. The method according to claim 5, characterized in that, Based on the first detection result and the second detection result, a time extension operation is performed on the target media stream in the first multimedia material, including: If the first detection result indicates that the minimum start time of the first type of media stream in the first multimedia material is greater than the minimum start time of the second type of media stream, then a first time extension operation is performed on the target media stream so that the start time of the target media stream after the first time extension operation is the same as the minimum start time of the second type of media stream; If the first detection result indicates that the maximum end time of the first type of media stream in the first multimedia material is less than the maximum end time of the second type of media stream, then a second time extension operation is performed on the target media stream so that the end time of the target media stream after the second time extension operation is the same as the maximum end time of the second type of media stream.
7. The method according to claim 6, characterized in that, Performing a first-time extension operation on the target media stream includes: On the side away from the start time of the target media stream along the first timeline direction, starting from the start time of the target media stream, a first time extension operation is performed on the target media stream by filling it with preset image frames along the first timeline direction. The first timeline direction is the direction along the media stream timeline from the end time of the target media stream toward the start time. Accordingly, a second time extension operation is performed on the target media stream, including: On the side away from the end time of the target media stream along the second timeline direction, starting from the end time of the target media stream, a second time extension operation is performed on the target media stream by filling it with preset image frames along the second timeline direction. The second timeline direction is the direction along the media stream timeline from the start time of the target media stream toward the end time.
8. The method according to claim 6, characterized in that, Performing a first-time extension operation on the target media stream includes: The minimum start time of the second type of media stream is used as the start time of the first time extension operation, and the start time of the target media stream is used as the end time of the first time extension operation. A preset graphic frame is filled between the start time and the end time of the first time extension operation, and the target media stream is connected to the target media stream through the start time of the target media stream; Accordingly, a second time extension operation is performed on the target media stream, including: The end time of the target media stream is used as the starting point of the second time extension operation, and the maximum end time of the second type of media stream is used as the end time of the second time extension operation. A preset graphic frame is filled between the start point and the end time of the second time extension operation, and the connection is made with the target media stream at the end time of the target media stream.
9. The method according to claim 1, characterized in that, After presenting the target editing page corresponding to the target editing task based on the second multimedia material, the method further includes: The editing record information of the target editing page is obtained. The editing record information of the target editing page is used to record the editing operation information triggered on the editing track of the target editing page during the process of performing editing operations on multimedia segments on the editing track of the target editing page. The target editing result corresponding to the target editing task is generated based on the editing record information of the target editing page and the multimedia segments on the editing track of the target editing page.
10. A multimedia material editing device, characterized in that, The device includes: The first determining module is used to determine a first detection result and a second detection result of the first multimedia material in response to the import operation of the first multimedia material corresponding to the target editing task. The first detection result is used to indicate whether the minimum start time of the first type of media stream and the minimum start time of the second type of media stream in the first multimedia material are the same. The second detection result is used to indicate whether the maximum end time of the first type of media stream and the maximum end time of the second type of media stream in the first multimedia material are the same. The second determining module is used to determine the second multimedia material based on the first detection result and the second detection result. The second multimedia material is obtained by adjusting the duration of the media stream in the first multimedia material. The minimum start time of the first type of media stream in the second multimedia material is the same as the minimum start time of the second type of media stream, and the maximum end time of the first type of media stream in the second multimedia material is the same as the maximum end time of the second type of media stream. The presentation module is used to present the target editing page corresponding to the target editing task based on the second multimedia material. The target editing page presents multimedia clips formed based on the second multimedia material and placed on the editing track.
11. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the multimedia material editing method according to any one of claims 1-9.
12. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the multimedia material editing method according to any one of claims 1-9.