Multimedia material editing processing method and device, electronic equipment and storage medium

By using a preset editing state sequence to record the differences in editing states during the multimedia material editing process, the problem of sudden increases in memory usage is solved, enabling fast switching and backtracking, and improving editing efficiency and memory usage efficiency.

CN121705084APending Publication Date: 2026-03-20BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-19
Publication Date
2026-03-20

AI Technical Summary

Technical Problem

During the editing of multimedia materials, the sudden increase in memory usage caused by the generation of data backups after each editing operation, especially when there are many editing operations, may lead to excessive memory usage and crashes.

Method used

Editing states are recorded using a preset editing state sequence. By storing the difference in descriptive information between editing states instead of complete data, and combining the descriptive information of the first and second types of editing states, the system enables rapid switching and backtracking of editing states.

Benefits of technology

It effectively reduces the amount of data backup storage, lowers memory usage, avoids crashes caused by sudden increases in memory usage, and improves editing efficiency and flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121705084A_ABST
    Figure CN121705084A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a multimedia material editing processing method and device, electronic equipment and a storage medium. The method comprises the steps that when a target editing task is switched from a first editing state to a second editing state, editing state description information stored corresponding to a third editing state is determined, and the third editing state is a first type editing state which is not triggered after the second editing state in all editing states of a preset editing state sequence; the preset editing state sequence contains editing state description information of which the stored editing state description information corresponding to at least one reference editing state belongs to a second type; and presenting the editing effect corresponding to the second editing state according to the editing state description information correspondingly stored in the third editing state. According to the scheme, when the data backups in the editing states are stored, the data backups in each editing state do not need to be fully stored, only the description information difference quantity between the editing states needs to be stored, and redundant memory occupation is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of computer software technology, and in particular to a multimedia material editing and processing method, apparatus, electronic device, and storage medium. Background Technology

[0002] In multimedia editing, undoing and redoing the most recent edit are common functions. Currently, each editing operation on multimedia materials results in an edited result. To facilitate switching between edited results at different stages, a backup of the edited result is generated for each operation, allowing for accurate restoration of the edited result from any backup. However, this approach incurs significant redundant memory usage, causing a surge in memory consumption during multimedia editing. This surge is particularly pronounced when numerous editing operations are performed, leading to a linear increase in memory usage and potentially causing crashes due to excessive memory usage. Summary of the Invention

[0003] This disclosure provides a multimedia material editing and processing method, apparatus, electronic device, and storage medium to solve the problem of a sudden increase in memory usage during multimedia material editing caused by the large amount of redundant memory occupied during editing operations.

[0004] In a first aspect, embodiments of this disclosure provide a multimedia material editing and processing method, the method comprising:

[0005] When the target editing task switches from the first editing state to the second editing state, the editing state description information corresponding to the third editing state is determined. The third editing state is a first type of editing state that is not triggered after the second editing state in each of the preset editing state sequences. The target editing task is a multimedia material editing task. The preset editing state sequence is used to record the different editing states triggered sequentially in the target editing task in an orderly manner. The editing state description information corresponding to the third editing state belongs to the first type of editing state description information. The first type of editing state description information has the ability to independently present the editing effect produced by the triggered editing operation in the current editing state. There is at least one reference editing state in the preset editing state sequence. The editing state description information corresponding to the reference editing state belongs to the second type of editing state description information. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence.

[0006] Based on the edit state description information stored corresponding to the third edit state, the edit effect corresponding to the second edit state is presented.

[0007] Secondly, this disclosure also provides a multimedia material editing and processing apparatus, the apparatus comprising:

[0008] A determination module is used to determine the stored editing state description information corresponding to a third editing state when the target editing task switches from a first editing state to a second editing state. The third editing state is a first type of editing state that is not triggered after the second editing state in each of the preset editing state sequences. The target editing task is a multimedia material editing task. The preset editing state sequence is used to record the different editing states triggered sequentially in the target editing task in an orderly manner. The stored editing state description information corresponding to the third editing state belongs to the first type of editing state description information. The first type of editing state description information has the ability to independently present the editing effect produced by the triggered editing operation in the current editing state. There is at least one reference editing state in the preset editing state sequence. The stored editing state description information corresponding to the reference editing state belongs to the second type of editing state description information. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence.

[0009] The processing module is used to present the editing effect corresponding to the second editing state according to the editing state description information stored in the third editing state.

[0010] Thirdly, this disclosure also provides an electronic device, the electronic device comprising:

[0011] At least one processor; and

[0012] A memory communicatively connected to the at least one processor; wherein,

[0013] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the multimedia material editing method described in any of the above embodiments.

[0014] Fourthly, this disclosure also provides a computer-readable medium storing computer instructions that, when executed by a processor, implement the multimedia material editing and processing method described in any of the above embodiments.

[0015] The technical solution of this disclosure embodiment can record the different editing states triggered sequentially in the target editing task in an orderly manner through a preset editing state sequence. This makes it convenient to switch editing states when performing editing operations on the target editing task. Since a data backup is generated for the editing result corresponding to each editing state after each editing operation when switching editing results between different editing states, the editing result of any editing state can be accurately restored based on the data backup of that editing state. However, this results in a large amount of memory being consumed by the data backups for each editing state. Therefore, this solution sets at least one second type of editing state in the preset editing state sequence. The editing state description information stored for the second type of editing state is used to indicate the difference between the editing state and the previous adjacent editing state. This method can effectively reduce the data backup storage amount for each editing state, because only the difference in description information between editing states needs to be stored, rather than the complete description information for each editing state. Thus, when switching from the first editing state to the second editing state, the editing state description information corresponding to the third editing state is first determined. The third editing state is a first type of editing state that is not triggered after the second editing state in the preset editing state sequence, and the first type of editing state description information has the ability to independently present the corresponding editing effect. Furthermore, by combining the stored editing state description information corresponding to at least one second-type editing state in the preset editing state sequence, the editing result corresponding to the second editing state can be quickly calculated and updated. This not only enables rapid switching between different editing states but also allows for quick reverting to previous editing states for modifications. Simultaneously, when storing data backups corresponding to editing states, it is not necessary to store the full data backup for each editing state; only the differences in description information between editing states need to be stored. This significantly reduces redundant memory usage and minimizes the risk of crashes caused by sudden or excessive memory consumption during multimedia material editing.

[0016] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0017] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0018] Figure 1 This is a schematic flowchart of a multimedia material editing and processing method provided in an embodiment of this disclosure;

[0019] Figure 2 This is a schematic diagram of a page for editing multimedia materials provided in an embodiment of this disclosure;

[0020] Figure 3 This is a schematic diagram illustrating the storage and recording of the editing state after editing multimedia materials, as provided in this embodiment of the disclosure;

[0021] Figure 4 This is a schematic diagram illustrating the switching of editing states for a target editing task, provided in an embodiment of this disclosure.

[0022] Figure 5 This is a schematic flowchart of another multimedia material editing and processing method provided in this embodiment of the disclosure;

[0023] Figure 6 This is a schematic diagram of various editing states when switching editing states for a target editing task, provided by an embodiment of this disclosure;

[0024] Figure 7 This is a schematic diagram of various editing states when switching editing states for a target editing task, provided in another embodiment of this disclosure;

[0025] Figure 8 This is a schematic diagram illustrating the generation of editing status differences through comparison of editing task information provided in an embodiment of this disclosure;

[0026] Figure 9 This is a schematic diagram of the structure of a multimedia material editing and processing device provided in an embodiment of this disclosure;

[0027] Figure 10 This is a schematic diagram of the structure of an electronic device that implements a multimedia material editing and processing method according to an embodiment of this disclosure. Detailed Implementation

[0028] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0029] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0030] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0031] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0032] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0033] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0034] Figure 1 This is a flowchart illustrating a multimedia material editing method provided in an embodiment of the present disclosure. This embodiment is applicable to situations where editing results are switched between different editing states during the editing of multimedia materials. The multimedia material editing method can be executed by a multimedia material editing device, which can be implemented in the form of software and / or hardware, and is generally integrated into any electronic device with network communication capabilities, such as a mobile terminal, a PC, or a server.

[0035] like Figure 1 As shown, the multimedia material editing and processing method of this disclosure embodiment may include the following process:

[0036] S110. When the target editing task switches from the first editing state to the second editing state, determine the editing state description information stored corresponding to the third editing state. The third editing state is the first type of editing state that is not triggered after the second editing state in each of the preset editing state sequences. The target editing task is a multimedia material editing task. The preset editing state sequence is used to record the different editing states that are triggered sequentially in the target editing task in an orderly manner. The editing state description information stored corresponding to the third editing state belongs to the first type of editing state description information. The first type of editing state description information has the ability to independently present the editing effect produced by the triggered editing operation in the current editing state.

[0037] In the preset editing state sequence, there is at least one reference editing state. The editing state description information stored corresponding to the reference editing state belongs to the second type of editing state description information. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence.

[0038] In the preset editing state sequence, the first type of editing state corresponds to the storage of the first type of editing state description information, and the second type of editing state corresponds to the storage of the second type of editing state description information. The first type of editing state description information has the ability to independently present the editing effect produced by the triggered editing operation in the current editing state. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence.

[0039] See Figure 2 During the editing process of multimedia materials, functions such as undoing and redoing the most recent editing operation may be required. For example, an audio editing operation can be performed on the editing page of the target editing task corresponding to the multimedia material. After performing the audio editing operation, it is supported to undo the most recent audio addition operation (such as undoing the added music), and to redo the changes of the most recent undone audio addition operation (such as redoing the added music).

[0040] See Figure 2 The stored editing state corresponding to one or more editing operations performed on the target editing page corresponding to the target editing task can be regarded as an editing version of the target editing page during the execution of the editing operation. Therefore, each time an editing operation is performed on the target editing page, it is considered that the editing version of the target editing page corresponding to the target editing task has changed. For example, undoing the most recent editing operation can be regarded as a downgrade of the editing version of the target editing page, and reverting the most recent undo can be regarded as an upgrade of the editing version of the target editing page.

[0041] See Figure 2 The target editing page for a given editing task may involve multiple editing operations. Therefore, in a real-world scenario, the target editing page will experience multiple editing states, not just a single one. (See also...) Figure 3To facilitate switching between different editing states, a data backup is performed for the editing results of each editing operation and corresponding editing state. This allows for accurate restoration of the editing results of any given editing state based on the backup. However, as the number of editing states increases, this leads to a large amount of data backup, resulting in significant redundant memory usage. This causes a surge in memory consumption during multimedia editing, especially when there are many editing operations on the multimedia material, where memory usage increases linearly, potentially leading to excessive memory usage and crashes.

[0042] Based on the above, this case configures a preset editing state sequence for the target editing task. This preset sequence allows for the orderly recording of different editing states of the target editing task resulting from sequentially triggered editing operations. For example, the target editing task is in one editing state when no editing operations are performed, and in another when a video clip is added. At least some editing states have corresponding editing state description information stored, so that the editing result to be presented in each editing state can be determined based on this description information. The editing state description information can describe various parameters and characteristics related to the editing state, such as effects applied, material positions, and durations, used to present the corresponding editing result for each editing state.

[0043] Meanwhile, considering the large amount of data backups and resulting redundant memory usage due to the increasing number of editing states, this solution's preset editing state sequence records a first type of editing state and a second type of editing state. The first type of editing state corresponds to the storage of its own editing state description information. This first type of editing state description information has the ability to independently display the editing effects produced by triggered editing operations within its current editing state. In other words, the first type of editing state description information can independently support the presentation of the editing effects produced by triggered editing operations within its current editing state, without requiring the storage of editing state description information corresponding to other editing states. This means that when it is necessary to display the editing result of the target editing task in the third editing state, the first type of editing state description information stored in the third editing state can be used directly to fully present the corresponding editing result.

[0044] Correspondingly, unlike the first type of editing state description information, the second type of editing state corresponds to the storage of second type of editing state description information. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence. In other words, the second type of editing state description information needs to change through the editing state difference between adjacent editing states. In this way, the second type of editing state description information must rely on the editing state description information stored for other editing states to present the editing result of the target editing task. However, since it is the difference between editing states that is stored, the amount of memory occupied when storing the second type of editing state description information is less than that of full storage, and it usually does not cause a sudden increase in the memory usage required during the multimedia material editing process.

[0045] Without supporting editing state descriptions from other editing states, relying solely on the second type of editing state descriptions cannot fully represent the editing results that the target editing task would aim to achieve in the first type of editing state. Understandably, this dependency necessitates considering the availability and accuracy of the editing state descriptions from other editing states upon which the second type of editing state descriptions depend when processing them.

[0046] See Figure 2 and Figure 4 When switching from the first editing state to the second editing state for a target editing task, the goal is to present the editing results of the target editing task in the second editing state. Since not all editing states have the ability to independently present the editing effects caused by triggered editing operations in their current state, it is necessary to iterate through the preset editing state sequence to find a first-type editing state that can independently present the editing effects caused by triggered editing operations in its current state. This allows for iterative restoration of the editing effects of the second editing state by continuously utilizing the editing state differences indicated by the description information of the second-type editing state based on the first-type editing state. For example, the third editing state is found to be a first-type editing state in the preset editing state sequence that is not triggered after the second editing state.

[0047] By employing the above method, the ability to independently present editing effects using the first type of editing state description information allows for accurate presentation of editing results under specific editing states during state transitions. This facilitates the continuous calculation of subsequent editing effects starting from the first type of editing state. Simultaneously, introducing a second type of editing state, by storing the difference information between adjacent editing states rather than the complete description information of each individual state, effectively reduces data storage and saves memory. This prevents sudden spikes in memory usage or even crashes due to excessive memory consumption during multimedia material editing, which could occur during the creation of numerous editing states.

[0048] Optionally, the preset editing state sequence can resemble a timeline or a status record list, clearly reflecting the editing state of the target editing task after each editing operation from its start to the present. Optionally, the target editing task is a multimedia material editing task, which processes and modifies multimedia materials to achieve the desired editing effect. Multimedia materials can refer to various original materials used to constitute a multimedia work, and can include at least one of the following: video materials, audio materials, and image materials. For example, an editing task involving editing, adding special effects, and creating subtitles for multimedia content such as video, audio, and images.

[0049] As an optional but not limited viewing method, the switch from the first editing state to the second editing state is triggered by either undoing a reference change operation or by redoing a reference change operation after undoing it. The reference change operation is the operation that changes the editing result of multimedia materials during the multimedia material editing process.

[0050] Multimedia editing tasks typically involve processing and modifying various types of materials, including images, videos, and audio. The editing process can include various operations such as cropping, color adjustment, adding effects, splicing, and mixing. Each editing operation corresponds to an editing state, and each editing state has a version description. For example, in video editing, one might trim the video footage, add transition effects, adjust brightness and contrast, etc., and each editing operation will have a corresponding version description.

[0051] See Figure 4The editing state refers to the state reached after a series of editing operations during the execution of a multimedia material editing task. This editing state is characterized by specific multimedia material combinations, special effects, duration, and other editing operations performed on the multimedia material. For example, in video material editing, the editing state might be the state after adding specific filters, subtitles, and music, and after certain editing and splicing of the video material.

[0052] See Figure 4 A reference change operation is used to perform editing operations on multimedia materials corresponding to a target editing task, so that the editing state of the multimedia materials in the target editing task gradually changes the editing result. When an undo operation is detected on a reference change operation, a switch from the first editing state to the second editing state is triggered; or, when a reference change operation is undone and then redone, a switch from the first editing state to the second editing state is triggered.

[0053] Optionally, see Figure 4 When undoing a reference change operation during multimedia editing, it triggers a switch from the current editing state to another. Undoing means canceling the editing operation corresponding to the previously executed reference change. Conversely, when undoing a reference change and then redoing it, undoing the reference change returns the multimedia material to the editing state before the undoing, and then redoing the undone reference change.

[0054] For example, see Figure 4 Suppose the target editing task is in version 2 editing state, corresponding to an original video clip without any added effects or editing. During multimedia editing, a specific filter and a piece of music are added to the video clip. This is equivalent to performing a reference change operation, thus modifying the video clip to version 3 editing state with the added filter and music. Previously, a reference change operation was performed. Undoing this reference change operation will restore the video clip to its previous editing state, at which point the target editing task will change from version 3 to version 2. Then, undoing the reference change operation and then redoing it will change the target editing task back from version 2 to version 3.

[0055] Optionally, reference change operations may include editing operations such as cutting multimedia material clips, adding transition effects, and adjusting colors for the target editing task. Reference change operations may include editing operations such as adjusting volume, adding sound effects, and mixing audio for the target editing task. Reference change operations may include editing operations such as adding subtitles, adjusting playback speed, and cropping video frames. The scenario in which reference change operations occur is during the editing of multimedia materials, including but not limited to processing various types of multimedia materials such as images, videos, and audio. Reference change operations are editing operations that perform various editing actions on multimedia materials in the target editing task to change the editing result.

[0056] The switching between the first and second editing states for a target editing task provides great editing flexibility. Editing operations can be undone at any time as needed, returning to the previous editing state, or redone if the operation is later deemed necessary, thus achieving fine-grained control over the editing process. Furthermore, this switching allows for rapid transitions between different states, improving editing efficiency. If an error is accidentally made, the undo and redo mechanism allows for easy correction, minimizing the impact of the mistake on the overall editing task. This enables greater freedom to explore different editing possibilities without worrying about serious consequences from errors.

[0057] S120. Based on the edit state description information stored in the third edit state, perform the presentation processing on the edit effect corresponding to the second edit state.

[0058] For finding a third editing state that meets the conditions in the preset editing state sequence, the third editing state is the first type of editing state that is not triggered after the second editing state in the various editing states of the preset editing state sequence. In other words, it is necessary to filter out those editing states that are not later than the second editing state in terms of editing order and belong to the first type from the preset editing state sequence including all editing states.

[0059] Once the third editing state is determined, the stored editing state description information corresponding to the third editing state can be obtained. The stored editing state description information corresponding to the third editing state belongs to the first type of editing state, therefore, the stored editing state description information corresponding to the third editing state has the ability to independently present the editing effects produced by the triggered editing operation in the third editing state.

[0060] Based on the editing state description information of the third editing state, the editing state difference indicated by the second type of editing state description information is continuously used to iteratively recover the editing effect corresponding to the second editing state of the target editing task, thereby presenting the editing effect. This may involve appropriately transforming or mapping the editing state description information of the third editing state, or combining the editing state description information of the third editing state with the stored editing state description information corresponding to each editing state involved in the transition from the third editing state to the second editing state to control the presentation of the editing result of the target editing task in the second editing state.

[0061] By utilizing the descriptive information of the third editing state to present the editing effect of the second editing state, the multimedia content in a specific editing state can be more accurately reproduced. Since the first type of editing state descriptive information has the ability to independently present the editing effect, it can provide a reliable basis for the presentation of the second editing state. Furthermore, efficient editing state switching and rollback make switching and rollback between different editing states more efficient. When switching from one editing state to another, it is not necessary to reload all multimedia materials and perform all editing operations; only the existing editing state descriptive information needs to be used for presentation processing. For some editing states, only the second type of editing state descriptive information needs to be stored, rather than the complete editing state descriptive information, which can greatly reduce data storage.

[0062] As an optional but not limited viewing method, when the third editing state is the second editing state and belongs to the first type of editing state, the editing effect corresponding to the second editing state is presented according to the editing state description information stored in the third editing state, including the following steps:

[0063] The system directly loads the stored editing state description information corresponding to the third editing state, generates and presents an editing page that includes the editing effects corresponding to the second editing state.

[0064] When the third editing state is the second editing state and belongs to the first type of editing state, it means that the switched second editing state and the selected third editing state are actually the same editing state, just described from different perspectives. Since the third editing state and the second editing state are the same state, the editing state description information stored for the third editing state directly corresponds to the editing state description information stored for the second editing state. Moreover, since the third editing state is a first type of editing state, the editing state description information stored for the third editing state can be loaded directly, without relying on the editing state description information stored for other editing states, to independently present the editing effects produced by the triggered editing operation in the current editing state.

[0065] Based on the stored editing state description information corresponding to the loaded third editing state, an editing page is generated that presents the editing effect corresponding to the target editing page when it is in the second editing state. This process involves converting the editing description information into an actual multimedia segment presentation format. Optionally, the stored editing state description information corresponding to the selected third editing state for the target editing task is read, and the stored editing state description information corresponding to the third editing state is loaded to present the editing page corresponding to the third editing state; wherein, the editing page is configured with an editing track for carrying the multimedia segments generated by triggering editing operations on multimedia materials in the target editing task.

[0066] For example, if the edit state description information stored for the third edit state contains a specific video effect, then when generating the edit page, the effect corresponding to the edit state description information stored for the third edit state will be applied to the corresponding video clip and displayed on the edit page. Simultaneously, other multimedia elements of the multimedia material corresponding to the target editing task, such as audio tracks and subtitles, will be laid out according to the edit state description information stored for the third edit state to present the complete editing effect of the target editing task in the third edit state.

[0067] The technical solution of this disclosure embodiment sets at least one second-type editing state in a preset editing state sequence. The editing state description information corresponding to the second-type editing state is used to indicate the difference between the editing state and the previous adjacent editing state. This method can effectively reduce the data backup storage of each editing state, because only the difference in description information between editing states needs to be stored, rather than the complete description information of each editing state. In this way, when switching from the first editing state to the second editing state, the editing state description information corresponding to the third editing state is first determined. The third editing state is the first-type editing state in the preset editing state sequence that is not triggered after the second editing state, and the first-type editing state description information has the ability to independently present the corresponding editing effect. Furthermore, by combining the editing state description information corresponding to at least one second-type editing state in the preset editing state sequence, the editing result corresponding to the second editing state can be quickly calculated and updated. This not only enables fast switching between different editing states, but also allows for quick backtracking to previous editing states for modification. Meanwhile, when storing data backups corresponding to editing states, a second type of editing state is introduced. Instead of storing the complete description information of each editing state, the difference information between adjacent editing states is stored. This eliminates the need to store the full data backup of each editing state. Only the difference in description information between editing states needs to be stored, which reduces a large amount of redundant memory usage and avoids crashes caused by sudden or excessive memory usage during multimedia material editing.

[0068] Figure 5 This is a flowchart illustrating another multimedia material editing method provided in this embodiment. The technical solution of this embodiment further optimizes the process of presenting the editing effect corresponding to the second editing state according to the editing state description information stored in the third editing state in the aforementioned embodiments, based on the technical solution of the above embodiments. This embodiment can be combined with various optional solutions in one or more of the above embodiments.

[0069] like Figure 5 As shown, the multimedia material editing and processing method of this disclosure embodiment may include the following process:

[0070] S510. When the target editing task switches from the first editing state to the second editing state, determine the editing state description information stored corresponding to the third editing state. The third editing state is the first type of editing state that is not triggered after the second editing state in each of the preset editing state sequences. The target editing task is a multimedia material editing task. The preset editing state sequence is used to record the different editing states that are triggered sequentially in the target editing task in an orderly manner. The editing state description information stored corresponding to the third editing state belongs to the first type of editing state description information. The first type of editing state description information has the ability to independently present the editing effect produced by the triggered editing operation in the current editing state.

[0071] In the preset editing state sequence, there is at least one reference editing state. The editing state description information stored corresponding to the reference editing state belongs to the second type of editing state description information. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence.

[0072] As an optional but not limited implementation, determining the stored editing state description information corresponding to the third editing state includes the following steps A1-A2:

[0073] Step A1: Based on the order of each editing state in the preset editing state sequence, find the third editing state from the several editing states included in the preset editing state sequence.

[0074] Step A2: Obtain the edit state description information corresponding to the third edit state from the edit state description information stored for each edit state in the preset edit state sequence.

[0075] See Figure 6A preset editing state sequence is an ordered collection of different editing states triggered sequentially in a target editing task. Each editing state has a specific position and order within the preset editing state sequence. To find a third editing state that meets the requirements, one can backtrack backwards through each editing state in the preset editing state sequence, starting from the second editing state; for example, one can backtrack forwards through each editing state in the preset editing state sequence, starting from the second editing state. Since the third editing state is a first-type editing state that is not triggered after the second editing state, it is necessary to check whether each editing state meets this condition during the search process. If one or more editing states in the preset editing state sequence are not triggered after the second editing state and belong to the first-type editing state, then this editing state is determined to be the third editing state.

[0076] See Figure 6 Once the third editing state is determined, the editing state description information corresponding to the third editing state can be retrieved from the stored editing state description information corresponding to each editing state in the preset editing state sequence. The editing state description information is typically a data structure associated with the editing effect corresponding to each editing state of the target editing task. For example, for video editing tasks, the editing state description information may include the position, length, effects, and transitions of the video clip; for image editing tasks, the description information may include color adjustments, filter effects, and cropping sizes. Optionally, the stored editing state description information corresponding to the third editing state can be quickly located and extracted using indexes or identifiers such as the version number corresponding to the third editing state for subsequent processing and presentation.

[0077] By employing the above method and searching in the order of editing states, the third editing state that meets the conditions can be accurately found. This method avoids random or uncertain searches, improving the accuracy and reliability of the search. Furthermore, ordered searching can find the nearest suitable first-type editing state, avoiding long iterative recovery paths when using differential methods. Simultaneously, ordered searching can utilize the structural characteristics of the pre-defined editing state sequence to improve search efficiency. Moreover, it can adapt to different types of editing tasks and changes in editing states. Whether it's simple text editing or complex multimedia editing, this method can effectively manage and search for editing states.

[0078] As an optional but not limited implementation, a preset number of second-type editing states are configured between the two closest first-type editing states in the preset editing state sequence. The value of the preset number is determined based on the size of the memory resources allocated for the multimedia editing task, and the size of the memory resources allocated for the multimedia editing task is negatively correlated with the value of the preset number.

[0079] See Figure 6 In the preset editing state sequence, a first type of editing state and a second type of editing state are distinguished. The first type of editing state typically has the ability to independently present the editing effect, while the second type of editing state stores the editing state difference information between it and adjacent editing states. A preset number of second type editing states are configured between the two closest first type editing states. This preset number is determined based on the amount of memory resources allocated for the multimedia editing task.

[0080] If the allocated memory resources are limited, a relatively large preset quantity can be set to store more intermediate state difference information between two first-type editing states, improving the granularity and traceability of the editing states and minimizing memory usage during data storage. Conversely, if memory resources are abundant, a smaller preset quantity should be set to utilize as much first-type editing state description information as possible, without worrying about excessive memory consumption. The size of the memory resources allocated for multimedia editing tasks is negatively correlated with the preset quantity. This means that when memory resources are sufficient, the preset quantity of second-type editing state description information can be appropriately reduced to better record the first-type editing states during the editing process, facilitating quick recovery of subsequent editing states.

[0081] By adopting the above technical solution, the number of second-type editing states can be flexibly adjusted according to the memory resources allocated to the multimedia editing task. This maximizes the utilization of available memory resources and improves system adaptability under different hardware environments and task requirements. By rationally configuring the number of second-type editing states, memory usage can be minimized while ensuring editing functionality. Only necessary intermediate state difference information is stored, avoiding the storage of large amounts of complete editing state data, thereby improving memory utilization efficiency.

[0082] S520. When the third editing state is a first type of editing state triggered before the second editing state in each of the editing states included in the preset editing state sequence, and the second editing state does not belong to the first type of editing state, determine the editing state description information stored corresponding to at least one candidate editing state. The candidate editing state is an editing state triggered after the third editing state and not triggered after the second editing state in each of the editing states included in the preset editing state sequence. The second editing state is the editing state located at the end of the sorting in at least one candidate editing state. At least one of the at least one candidate editing state has editing state description information stored corresponding to the target editing state that belongs to the second type of editing state description information.

[0083] Among them, at least one of the candidate editing states is a target editing state belonging to the second type of editing state. The editing state description information stored corresponding to the target editing state is used to indicate the editing state difference between the target editing state and the editing state triggered before and adjacent to the target editing state in the preset editing state sequence.

[0084] See Figure 6 The third editing state is the first type of editing state triggered before the second editing state in the preset editing state sequence. This means that the third editing state is found by searching through the preset editing state sequence for each editing state preceding the second editing state in the corresponding editing order. The first type of editing state typically independently displays the editing effect caused by the triggered editing operation in its current editing state. The third editing state that meets this condition can be determined by traversing and filtering the preset editing state sequence.

[0085] See Figure 6 Since the third editing state in the preset editing state sequence is not the same as the second editing state, and the third editing state precedes the second editing state, it is necessary to identify each editing state from the third editing state to the second editing state as a candidate editing state. In other words, the candidate editing state is the editing state that is triggered after the third editing state but not after the second editing state among all the editing states included in the preset editing state sequence.

[0086] See Figure 6 Starting from the third edit state, the system searches for each edit state sequentially in a preset edit state sequence. It determines whether an edit state is triggered both after the third edit state and not after the second edit state, and identifies such states as candidate edit states. Given that the second edit state does not belong to the first type of edit state, and that it is the last edit state in the sequence of at least one candidate edit state, this indicates that the second edit state is the last in a series of specific edit states.

[0087] See Figure 6 In a candidate editing state, at least one target editing state belongs to the second type of editing state. The editing state description information stored for the target editing state is used to indicate the editing state difference between the target editing state and the editing state triggered before and adjacent to the target editing state in the preset editing state sequence. This means that for a target editing state of the second type, the stored information is the difference relative to the previous adjacent state. Based on the determination of the third editing state and candidate editing states, the editing effect of the second editing state can be inferred or restored by using the information of the third editing state and the editing state difference of the target editing state in the candidate editing states.

[0088] By employing the above method and clearly defining the relationships between different types of editing states, precise management of editing states can be achieved. The position and nature of a specific editing state within the entire sequence can be accurately determined, providing a reliable basis for subsequent editing operations and state switching. For the second type of editing state, storing the difference between it and the previous adjacent state can significantly reduce data storage. Furthermore, switching and backtracking between different editing states can be performed as needed, and the difference can be used for rapid state recovery and adjustment.

[0089] See Figure 6 and Figure 7 The second type of edit state description information exhibits a significant advantage in terms of memory usage, consuming far less memory than the first type. This difference stems from the fact that, unlike the first type, the second type doesn't store complete edit state data. Instead, it only stores the differences between adjacent edit states within a predefined sequence. This storage method ensures that even as the number of edit states increases during continuous editing operations, the total memory usage of the edit state description information doesn't grow rapidly. This is a crucial advantage, especially for applications that require processing large amounts of edit state description information. It effectively controls memory consumption while ensuring normal editing functionality, preventing performance degradation or instability caused by excessive memory usage.

[0090] See also Figure 6 and Figure 7If the edit state corresponds to the storage of first-type edit state description information, then the first-type edit state description information can be directly loaded for restoration. This is because the first-type edit state description information has the ability to independently present the editing effects produced by the triggered editing operation in the current edit state. However, if the edit state corresponds to the storage of second-type edit state description information, the situation is different. Considering that only the first-type edit state description information has the ability to independently present the editing effects produced by the triggered editing operation in the current edit state, and relying solely on the second-type edit state description information is insufficient to restore the current edit state. In this case, it is necessary to first trace back from the second edit state in the preset edit state sequence, searching for the first-type edit state closest to the second edit state, and taking it as the third edit state. Since the third edit state belongs to the first-type edit state, the edit state description information stored in the third edit state can be used as the basis for restoring the target editing task to the second edit state. In this way, when faced with different types of edit state description information, the restoration operation of the edit state can be effectively realized, ensuring the smooth progress of the editing task.

[0091] S530. Based on the editing state description information stored corresponding to the third editing state, the editing state description information stored corresponding to each candidate editing state is loaded step by step in the order of at least one candidate editing state in the preset editing state sequence until the editing state description information stored corresponding to the second editing state is loaded, and an editing page including the editing effect corresponding to the second editing state is generated and presented.

[0092] See Figure 6 and Figure 7After determining the stored editing state description information corresponding to the third editing state, the operation proceeds according to the order of candidate editing states in the preset editing state sequence. Starting with the first candidate editing state, the stored editing state description information corresponding to each candidate editing state is loaded progressively. During this loading process, the editing state is continuously updated and accumulated based on the description information of each candidate editing state, building upon the previous editing state. For example, if a specific video effect exists in the third editing state, and a subtitle is added in the first candidate editing state, then when loading the description information of the first candidate editing state, the subtitle information will be added to the existing effect. This process of continuously adding the stored editing state description information corresponding to candidate editing states continues, loading the subsequent candidate editing state description information sequentially based on the previous editing state, until the stored editing state description information corresponding to the second editing state is loaded. Once the editing state description information for the second editing state is successfully loaded, this information is used to generate an editing page containing the editing effects corresponding to the second editing state. This editing page will be displayed on the interface of a specific editing software, allowing users to clearly see the complete editing effects of multimedia content in the second editing state, including image adjustments, video effects and subtitles, and audio processing, etc.

[0093] See Figure 6 and Figure 7 Starting from the edit state description information stored in the third edit state, the system progressively applies the edit state description information stored in the candidate edit state to the next state in the preset edit state sequence. Specifically, following the order of the candidate edit states in the preset sequence, the edit state difference indicated in the edit state description information stored in each candidate edit state is loaded onto the previous edit state of the target editing task, continuing until the second edit state description information is loaded to restore the second edit state. In this way, the switching operation from the first to the second edit state can be achieved using the second type of edit state description information. Simultaneously, this method effectively controls memory usage, greatly improving system performance and stability. It ensures smooth edit state switching while avoiding potential performance degradation or instability due to excessive memory usage, providing users with a smoother and more efficient editing experience.

[0094] By using the above method, and progressively loading the description information of candidate editing states based on the description information of the third editing state, the editing effect of the second editing state can be accurately restored. This method ensures that no important editing information is lost during the switching or restoration of editing states, and the editing page is completely consistent with the one when leaving. Furthermore, this implementation makes switching and reverting between different editing states more efficient, eliminating the need to reload all multimedia materials and perform all editing operations. Instead, it quickly restores the target editing state by progressively loading the description information. It is worth noting that because the editing state description information is loaded progressively, rather than all state data at once, the amount of data loaded is reduced. Especially when processing large multimedia materials, this significantly improves system response speed, avoids long waiting times, and allows for quick and accurate viewing of the editing effects in different editing states. It also makes editing operations and trying different editing schemes more convenient, without worrying about the complexity and time consumption of state switching.

[0095] As an optional but not limited implementation, when the third editing state is a first type of editing state that was triggered before the second editing state and is closest to the second editing state among the various editing states included in the preset editing state sequence, and when the second editing state does not belong to the first type of editing state, at least one candidate editing state belongs to the second type of editing state.

[0096] The third edit state is the first type of edit state that was triggered before the second edit state and is closest to the second edit state. This means that it is necessary to traverse the entire sequence of edit states and judge each edit state. If an edit state belongs to the first type, is in chronological order before the second edit state, and is closer to the second edit state than other first type edit states that are before the second edit state, then this state is determined to be the third edit state.

[0097] Once the relationship between the third and second editing states is established, the nature of at least one candidate editing state is further clarified. In this case, it is stipulated that at least one candidate editing state belongs to the second type of editing state, meaning that in subsequent processing, these candidate editing states can utilize the specific attributes and advantages of the first type of editing state. For example, the first type of editing state may have the ability to independently present the editing effect, which is very important for restoring and processing editing states.

[0098] When switching from the first editing state to the second editing state or performing other related operations, the nature of the third editing state and candidate editing states is first determined. Based on the third editing state, the recovery operation is performed step by step by combining the information of the candidate editing states. Since all candidate editing states belong to the second type of editing state, it is only necessary to start from the editing state description information stored corresponding to the third editing state and continuously add up the second type of editing state description information stored corresponding to each candidate editing state to recover the editing result of the second editing state.

[0099] By adopting the above method, and determining the third editing state as the first type of editing state that is closest to the second editing state, the state switching and restoration operations can be performed more accurately. Especially in complex editing tasks, it can ensure restoration to the editing state closest to the first type, reduce the loading and processing of unnecessary other first type of editing state description information, improve efficiency and accuracy, reduce data processing volume and calculation time, and improve system performance and response speed.

[0100] The technical solution of this disclosure embodiment sets at least one second-type editing state in a preset editing state sequence. The editing state description information corresponding to the second-type editing state is used to indicate the difference between the editing state and the previous adjacent editing state. This method can effectively reduce the data backup storage of each editing state, because only the difference in description information between editing states needs to be stored, rather than the complete description information of each editing state. In this way, when switching from the first editing state to the second editing state, the editing state description information corresponding to the third editing state is first determined. The third editing state is the first-type editing state in the preset editing state sequence that is not triggered after the second editing state, and the first-type editing state description information has the ability to independently present the corresponding editing effect. Furthermore, by combining the editing state description information corresponding to at least one second-type editing state in the preset editing state sequence, the editing result corresponding to the second editing state can be quickly calculated and updated. This not only enables fast switching between different editing states, but also allows for quick backtracking to previous editing states for modification. Meanwhile, when storing data backups corresponding to editing states, it is not necessary to store the full data backup for each editing state. Only the difference in descriptive information between editing states needs to be stored, which reduces a large amount of redundant memory usage and avoids crashes caused by sudden or excessive memory usage during multimedia material editing.

[0101] Based on the above embodiments, optionally, before determining the stored editing state description information corresponding to the third editing state, the following steps C1-C3 are further included:

[0102] Step C1: Determine the first editing task information when the target editing task is in the fourth editing state. The first editing task information can independently describe the editing results generated by the target editing task in the fourth editing state due to the triggered editing operation. The fourth editing state belongs to the first type of editing state in the preset editing state sequence.

[0103] Step C2: Determine the second editing task information when the target editing task is in the fifth editing state. The second editing task information can independently describe the editing results generated by the target editing task in the fifth editing state due to the triggered editing operation. The fifth editing state is the second type of editing state that is triggered after the target editing task, which is already in the fourth editing state, continues to trigger the editing operation and is adjacent to the fourth editing state.

[0104] Step C3: Compare the second editing task information with the first editing task information to determine the stored editing state description information corresponding to the fifth editing state.

[0105] See Figure 8 When the target editing task is in the fourth editing state, it is necessary to determine the first editing task information that can independently describe the editing result generated by the triggered editing operation in this state. Since the fourth editing state belongs to the first type of editing state in the preset editing state sequence, the first type of editing state usually has the characteristic of being able to independently present the editing effect. The first editing task information may include various parameters and features related to presenting the corresponding editing result of the target editing task in the fourth editing state. For example, it may include color adjustment parameters, filter effects, cropping size, etc.; in video editing, it may include the position, length, effects parameters, transition effects, etc. of the video clip.

[0106] See Figure 8 When the target editing task is in the fifth editing state, second editing task information is determined that can independently describe the editing results generated due to the triggered editing operation in this state. The fifth editing state is a second type of editing state that is triggered after the target editing task, which is already in the fourth editing state, continues to trigger an editing operation and is adjacent to the fourth editing state. Similarly, the second editing task information also includes various parameters and features related to presenting the corresponding editing results of the target editing task in the fifth editing state, and the second type of editing state corresponds to the storage of the second type of editing state description.

[0107] See Figure 8The second editing task information is compared with the first editing task information. By comparing the differences between the two editing task information, the editing state description information corresponding to the fifth editing state can be determined. This process may involve comparing parameters one by one to find out which parameters have changed and the specific details of the changes. For example, if a new effect is added in the fifth editing state, the relevant parameters of this effect will be recorded in the editing state description information. The final determined editing state description information can be used for subsequent editing state switching, rollback, and restoration to a specific editing state.

[0108] By using the above method, by separately determining the first editing task information and the second editing task information, the editing results under different editing states can be accurately described independently. This allows for a clear understanding of the specific situation of the target editing task under a particular editing state at any time. The process of determining the editing state description information is based on the comparison of task information between two adjacent editing states. This method can quickly and accurately determine the specific content of the state change. By accurately understanding the changes in the editing state, it is possible to switch to different editing states at any time for viewing and modification.

[0109] Based on the above embodiments, optionally, see [link to relevant documentation]. Figure 8 The second editing task information is compared with the first editing task information to determine the stored editing state description information corresponding to the fifth editing state, including steps D1-D2:

[0110] Step D1: Iterate through and obtain the reference function module data in the second editing task information and the reference function module data in the first editing task information, and compare them item by item. The second editing task information and the first editing task information are configured to use the same type of reference function attribute field to describe the same reference function module data.

[0111] Step D2: Compare the data of each reference function module in the second editing task information with the data of each reference function module in the first editing task information item by item to determine the editing state description information stored corresponding to the fifth editing state.

[0112] See Figure 8 The system iterates through the second and first editing task information, which describe the editing results of the target editing task under different editing states. Reference function module data can be understood as the data of each functional component that makes up the editing task. For example, in image editing, this might include color adjustment module data, filter module data, cropping module data, etc.; in video editing, it might include video clip module data, special effects module data, transition module data, etc. Each reference function module data item is configured with a reference function attribute field for description, where the reference function attribute field can be... Figure 8 The fields a1, b1, etc. shown are reference function attribute fields used to describe the editing functions used in video and audio materials.

[0113] Furthermore, these two editing task information entries are configured to use the same type of reference function attribute field to describe the same reference function module data. This means that the description method for the same function module is consistent across different editing states, only the value results differ. During the traversal, each reference function module data entry in the second editing task information is compared item by item with the corresponding entry in the first editing task information. The comparison includes, but is not limited to, the module's parameter values ​​and status flags.

[0114] If there is a discrepancy in the data of a certain reference function module between the two editing task information, this discrepancy will be recorded as part of the editing state description information for the fifth editing state. For example, if the intensity value of a filter changes in the second editing task information, this change will be recorded to describe the change from the fourth editing state to the fifth editing state. Finally, by integrating the comparison results of all reference function module data, the complete editing state description information corresponding to the fifth editing state is obtained.

[0115] By employing the above method and comparing data from reference functional modules item by item, changes between editing states can be detected with remarkable precision. This allows the system to accurately record and describe the state changes resulting from every subtle editing operation, providing users with more precise editing state retrospection and switching capabilities. Using the same type of reference functional attribute fields for description ensures data consistency and understandability. This makes it easier for developers to understand and process editing state data when maintaining the system, improving system maintainability. It also reduces errors and confusion that may result from inconsistent data descriptions. Recording only the differences between editing states significantly reduces data storage, which is crucial for handling large numbers of editing tasks and long-term editing processes, avoiding the storage of excessive redundant data and improving storage efficiency.

[0116] Figure 9 This is a schematic diagram of a multimedia material editing and processing device provided in an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to situations where the editing results are switched between different editing states during the editing of multimedia materials. The multimedia material editing and processing device can be implemented in the form of software and / or hardware, and is generally integrated on any electronic device with network communication function, such as a mobile terminal, PC, or server.

[0117] like Figure 9As shown, the multimedia material editing and processing apparatus of this disclosure embodiment may include the following:

[0118] The determining module 910 is used to determine the stored editing state description information corresponding to the third editing state when the target editing task switches from the first editing state to the second editing state. The third editing state is a first type of editing state that is not triggered after the second editing state in each editing state of the preset editing state sequence. The target editing task is a multimedia material editing task. The preset editing state sequence is used to record the different editing states triggered sequentially in the target editing task in an orderly manner. The stored editing state description information corresponding to the third editing state belongs to the first type of editing state description information. The first type of editing state description information has the ability to independently present the editing effect produced by the triggered editing operation in the current editing state. There is at least one reference editing state in the preset editing state sequence. The stored editing state description information corresponding to the reference editing state belongs to the second type of editing state description information. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence.

[0119] The processing module 920 is used to perform presentation processing on the editing effect corresponding to the second editing state according to the editing state description information stored corresponding to the third editing state.

[0120] Based on the above embodiments, optionally, the switch from the first editing state to the second editing state is triggered by an undo operation on a reference change operation or by a redo operation on a reference change operation after an undo operation on the reference change operation. The reference change operation is an operation that changes the editing result of multimedia materials during the multimedia material editing process.

[0121] Based on the above embodiments, optionally, determining the stored editing state description information corresponding to the third editing state includes:

[0122] Based on the order of each editing state in the preset editing state sequence, the third editing state is searched from the several editing states included in the preset editing state sequence;

[0123] The editing state description information corresponding to the third editing state is obtained from the editing state description information stored for each editing state in the preset editing state sequence.

[0124] Based on the above embodiments, optionally, when the third editing state is the second editing state and belongs to the first type of editing state, the editing effect corresponding to the second editing state is presented according to the editing state description information stored corresponding to the third editing state, including:

[0125] The editing state description information corresponding to the third editing state is directly loaded to generate and present an editing page that includes the editing effects corresponding to the second editing state.

[0126] Based on the above embodiments, optionally, when the third editing state is a first type of editing state triggered before the second editing state in a preset editing state sequence, and when the second editing state does not belong to the first type of editing state, the editing effect corresponding to the second editing state is presented according to the editing state description information stored corresponding to the third editing state, including:

[0127] Determine at least one candidate edit state corresponding to the stored edit state description information. The candidate edit state is the edit state that is triggered after the third edit state and not triggered after the second edit state among the various edit states included in the preset edit state sequence. The second edit state is the edit state located at the end of the sorting among the at least one candidate edit state. At least one of the at least one candidate edit state corresponds to the edit state description information stored in the target edit state that belongs to the second type of edit state description information.

[0128] Based on the edit state description information stored corresponding to the third edit state, the edit state description information stored corresponding to each candidate edit state is loaded step by step in the order of at least one candidate edit state in the preset edit state sequence until the edit state description information stored corresponding to the second edit state is loaded, and an edit page including the edit effect corresponding to the second edit state is generated and presented.

[0129] Based on the above embodiments, optionally, when the third editing state is a first type of editing state that is triggered before the second editing state and is closest to the second editing state among the various editing states included in the preset editing state sequence, and when the second editing state does not belong to the first type of editing state, the at least one candidate editing state belongs to the second type of editing state.

[0130] Based on the above embodiments, optionally, a preset number of second-type editing states are configured between the two closest first-type editing states in the preset editing state sequence. The value of the preset number is determined based on the size of the memory resources allocated for the multimedia editing task, and the size of the memory resources allocated for the multimedia editing task is negatively correlated with the value of the preset number.

[0131] Based on the above embodiments, optionally, before determining the stored editing state description information corresponding to the third editing state, the method further includes:

[0132] The first editing task information is determined when the target editing task is in the fourth editing state. The first editing task information can independently describe the editing results generated by the target editing task in the fourth editing state due to the triggered editing operation. The fourth editing state belongs to the first type of editing state in the preset editing state sequence.

[0133] The second editing task information is determined when the target editing task is in the fifth editing state. The second editing task information can independently describe the editing results generated by the target editing task in the fifth editing state due to the triggered editing operation. The fifth editing state is a second type of editing state that is triggered after the target editing task, which is already in the fourth editing state, is triggered and is adjacent to the fourth editing state.

[0134] The second editing task information is compared with the first editing task information to determine the editing state description information stored corresponding to the fifth editing state.

[0135] Based on the above embodiments, optionally, comparing the second editing task information with the first editing task information to determine the stored editing state description information corresponding to the fifth editing state includes:

[0136] The reference function module data in the second editing task information is retrieved and compared with the reference function module data in the first editing task information. The second editing task information and the first editing task information are configured to use the same type of reference function attribute field for the same reference function module data.

[0137] By comparing the data of each reference function module in the second editing task information with the data of each reference function module in the first editing task information item by item, the editing state description information corresponding to the fifth editing state is determined.

[0138] The technical solution of this disclosure embodiment can record the different editing states triggered sequentially in the target editing task in an orderly manner through a preset editing state sequence. This makes it convenient to switch editing states when performing editing operations on the target editing task. Since a data backup is generated for the editing result corresponding to each editing state after each editing operation when switching editing results between different editing states, the editing result of any editing state can be accurately restored based on the data backup of that editing state. However, this results in a large amount of memory being consumed by the data backups for each editing state. Therefore, this solution sets at least one second type of editing state in the preset editing state sequence. The editing state description information stored for the second type of editing state is used to indicate the difference between the editing state and the previous adjacent editing state. This method can effectively reduce the data backup storage amount for each editing state, because only the difference in description information between editing states needs to be stored, rather than the complete description information for each editing state. Thus, when switching from the first editing state to the second editing state, the editing state description information corresponding to the third editing state is first determined. The third editing state is a first type of editing state that is not triggered after the second editing state in the preset editing state sequence, and the first type of editing state description information has the ability to independently present the corresponding editing effect. Furthermore, by combining the stored editing state description information corresponding to at least one second-type editing state in the preset editing state sequence, the editing result corresponding to the second editing state can be quickly calculated and updated. This not only enables rapid switching between different editing states but also allows for quick reverting to previous editing states for modifications. Simultaneously, when storing data backups corresponding to editing states, it is not necessary to store the full data backup for each editing state; only the differences in description information between editing states need to be stored. This significantly reduces redundant memory usage and minimizes the risk of crashes caused by sudden or excessive memory consumption during multimedia material editing.

[0139] The multimedia material editing and processing apparatus provided in this disclosure can execute the multimedia material editing and processing method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the multimedia material editing and processing method.

[0140] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0141] Figure 10 This is a schematic diagram of the structure of an electronic device that implements a multimedia material editing and processing method according to an embodiment of this disclosure. Refer to the following... Figure 10It illustrates an electronic device suitable for implementing embodiments of the present disclosure (e.g., Figure 10 The diagram below shows the structure of the terminal device or server 1000. The terminal device in this embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and vehicle terminals (e.g., vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 10 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0142] like Figure 10 As shown, the electronic device 1000 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. The RAM 1003 also stores various programs and data required for the operation of the electronic device 1000. The processing unit 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An edit / output (I / O) interface 1005 is also connected to the bus 1004.

[0143] Typically, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1008 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows electronic device 1000 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 10 An electronic device 1000 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0144] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the multimedia material editing processing method shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 1009, or installed from a storage device 1008, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, it performs the functions defined in the multimedia material editing processing method of the embodiments of this disclosure.

[0145] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0146] The electronic device provided in this embodiment and the multimedia material editing and processing method provided in the above embodiments belong to the same inventive concept. Technical details not described in detail in this embodiment can be found in the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.

[0147] This disclosure provides a computer storage medium storing a computer program that, when executed by a processor, implements the multimedia material editing and processing method provided in the above embodiments.

[0148] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0149] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0150] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0151] The aforementioned computer-readable medium carries one or more programs. When the aforementioned one or more programs are executed by the electronic device, the electronic device causes the following: when a target editing task switches from a first editing state to a second editing state, the electronic device determines the edit state description information stored corresponding to a third editing state. The third editing state is a first type of editing state that is not triggered after the second editing state in each of the preset editing state sequences. The target editing task is a multimedia material editing task. The preset editing state sequence is used to record the different editing states triggered sequentially in the target editing task in an orderly manner. The edit state description information stored corresponding to the third editing state belongs to the first type of edit state description information. The first type of edit state description information has the ability to independently present the editing effect produced by the triggered editing operation in the current editing state. There is at least one reference editing state in the preset editing state sequence. The edit state description information stored corresponding to the reference editing state belongs to the second type of edit state description information. The second type of edit state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence. The electronic device then performs presentation processing on the editing effect corresponding to the second editing state based on the edit state description information stored corresponding to the third editing state.

[0152] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0153] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0154] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0155] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0156] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0157] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0158] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0159] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A method for editing and processing multimedia materials, characterized in that, The method includes: When the target editing task switches from the first editing state to the second editing state, the editing state description information corresponding to the third editing state is determined. The third editing state is a first type of editing state that is not triggered after the second editing state in each of the preset editing state sequences. The target editing task is a multimedia material editing task. The preset editing state sequence is used to record the different editing states that are triggered sequentially in the target editing task in an orderly manner. There is at least one reference editing state in the preset editing state sequence. The editing state description information corresponding to the reference editing state belongs to the second type of editing state description information. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence. Based on the edit state description information stored corresponding to the third edit state, the edit effect corresponding to the second edit state is presented.

2. The method according to claim 1, characterized in that, The edit state description information stored corresponding to the third edit state belongs to the first type of edit state description information. The first type of edit state description information has the ability to independently present the edit effect produced by the triggered edit operation in the current edit state.

3. The method according to claim 1, characterized in that, The switch from the first editing state to the second editing state is triggered by either undoing a reference change operation or by redoing a reference change operation after it has been undone. The reference change operation is the operation performed on the multimedia material during the multimedia material editing process to change the editing result.

4. The method according to claim 1, characterized in that, Determine the stored editing state description information corresponding to the third editing state, including: Based on the order of each editing state in the preset editing state sequence, the third editing state is searched from the several editing states included in the preset editing state sequence; The editing state description information corresponding to the third editing state is obtained from the editing state description information stored for each editing state in the preset editing state sequence.

5. The method according to claim 1, characterized in that, When the third editing state is the second editing state and belongs to the first type of editing state, the editing effect corresponding to the second editing state is presented according to the editing state description information stored corresponding to the third editing state, including: The editing state description information corresponding to the third editing state is directly loaded to generate and present an editing page that includes the editing effects corresponding to the second editing state.

6. The method according to claim 1 or 4, characterized in that, When the third editing state is a first type of editing state triggered before the second editing state in a preset editing state sequence, and when the second editing state does not belong to the first type of editing state, the editing effect corresponding to the second editing state is presented according to the editing state description information stored corresponding to the third editing state, including: Determine at least one candidate edit state corresponding to the stored edit state description information. The candidate edit state is the edit state that is triggered after the third edit state and not triggered after the second edit state among the various edit states included in the preset edit state sequence. The second edit state is the edit state located at the end of the sorting among the at least one candidate edit state. At least one of the at least one candidate edit state corresponds to the edit state description information stored in the target edit state that belongs to the second type of edit state description information. Based on the edit state description information stored corresponding to the third edit state, the edit state description information stored corresponding to each candidate edit state is loaded step by step in the order of at least one candidate edit state in the preset edit state sequence until the edit state description information stored corresponding to the second edit state is loaded, and an edit page including the edit effect corresponding to the second edit state is generated and presented.

7. The method according to claim 6, characterized in that, In the third editing state, which is a preset editing state sequence, if the first type of editing state is triggered before the second editing state and is closest to the second editing state, and if the second editing state does not belong to the first type of editing state, then at least one candidate editing state belongs to the second type of editing state.

8. The method according to claim 1, characterized in that, In the preset editing state sequence, a preset number of second-type editing states are configured between the two closest first-type editing states. The value of the preset number is determined based on the size of the memory resources allocated for the multimedia editing task, and the size of the memory resources allocated for the multimedia editing task is negatively correlated with the value of the preset number.

9. The method according to claim 1, characterized in that, Before determining the stored edit state description information corresponding to the third edit state, the process also includes: The first editing task information is determined when the target editing task is in the fourth editing state. The first editing task information can independently describe the editing results generated by the target editing task in the fourth editing state due to the triggered editing operation. The fourth editing state belongs to the first type of editing state in the preset editing state sequence. The second editing task information is determined when the target editing task is in the fifth editing state. The second editing task information can independently describe the editing results generated by the target editing task in the fifth editing state due to the triggered editing operation. The fifth editing state is a second type of editing state that is triggered after the target editing task, which is already in the fourth editing state, is triggered and is adjacent to the fourth editing state. The second editing task information is compared with the first editing task information to determine the editing state description information stored corresponding to the fifth editing state.

10. The method according to claim 9, characterized in that, The editing task information is compared with the first editing task information to determine the stored editing state description information corresponding to the fifth editing state, including: The reference function module data in the second editing task information is retrieved and compared with the reference function module data in the first editing task information. The second editing task information and the first editing task information are configured to use the same type of reference function attribute field for the same reference function module data. By comparing the data of each reference function module in the second editing task information with the data of each reference function module in the first editing task information item by item, the editing state description information corresponding to the fifth editing state is determined.

11. A multimedia material editing and processing device, characterized in that, The device includes: The determination module is used to determine the stored editing state description information corresponding to the third editing state when the target editing task switches from the first editing state to the second editing state. The third editing state is a first type of editing state that is not triggered after the second editing state in each of the preset editing state sequences. The target editing task is a multimedia material editing task. The preset editing state sequence is used to record the different editing states that are triggered sequentially in the target editing task in an orderly manner. There is at least one reference editing state in the preset editing state sequence. The edit state description information corresponding to the reference editing state belongs to the second type of editing state description information. The second type of editing state description information is used to indicate the editing state difference between the second type of editing state and the adjacent editing state triggered before the second type of editing state in the preset editing state sequence. The processing module is used to present the editing effect corresponding to the second editing state according to the editing state description information stored in the third editing state.

12. An electronic device, characterized in that, The electronic device includes: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the multimedia material editing and processing method according to any one of claims 1-10.

13. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to perform the multimedia material editing and processing method according to any one of claims 1-10.