Media Management System

Abstract

The present invention relates to a software product including a computer-readable medium storing instructions that, when executed by a processor, display a graphical user interface for a video editing system including: a media bin displaying one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the media elements; a timeline; and a concatenation element, and, in response to a user activating the concatenation element, concatenates the media elements in the media bin together into a single media element and loads the single media element into the viewing window.

Description

[Technical field]

[0001] The present invention relates generally to video editing software applications and, more particularly, to a media management system for video editing software applications that, at least in a preferred embodiment, provides a more efficient workflow environment for users. [Background technology]

[0002] Film and / or video productions are typically created on a video editing system by assembling a project from a collection of constituent elements. The video editing system allows these constituent elements, including video clips, audiovisual clips, audio clips, and associated metadata, to be individually imported, edited, and integrated into a final production. Modern video editing systems, particularly those used by professionals in the film and television industries, include sophisticated video editing software applications. Applicant's video editing system known as Da Vinci Resolve® is an example of a modern video editing system that is in widespread professional use. The overall functionality of Da Vinci Resolve® is divided into a number of separate pages (each with its own graphical user interface) organized in the order of a typical workflow. The Da Vinci Resolve® pages include Media (for media management and clip organization); Edit (non-linear video editing); Color (for color correction and color grading); Sound (digital audio workstation); and Delivery (for final rendering or output).

[0003] Like other non-linear video editors, the DaVinci Resolve® Edit page user interface includes a timeline, which is a graphical representation of the project being edited. The timeline typically includes a number of spaced time code markings in a line that runs horizontally along the length of the user interface window. By aligning the timeline's temporal markings, the timeline allows the constituent elements of the project to be arranged in a desired chronological order. Once arranged on the timeline, the elements can be edited by manipulating the editing tools to perform operations such as trimming, splitting, inserting, merging, and moving clips to desired positions. Summary of the Invention [Problem to be solved by the invention]

[0004] The present invention, at least in preferred embodiments, aims to provide a media management system for a video editing system that provides a more optimized video editing workflow environment for users. [Means for solving the problem]

[0005] According to a first aspect of the present invention, there is provided a software product including a computer readable medium storing instructions which, when executed by a processor, result in: a media bin that displays one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the media elements; Timeline and; A connector element; displaying a graphical user interface for a video editing system, In response to a user activating the connect element, the media elements in the media bin are connected together into a single media element and the single media element is loaded into the viewing window.

[0006] According to one embodiment, the playback speed of a single media element is varied with reference to a characteristic of the media elements that compose the single media element, which may be, for example, the duration of the single media element. According to this embodiment, the playback speed of media elements whose duration exceeds a threshold may be increased.

[0007] Preferably, the command in response to the user input inserts one of the media elements into the timeline, typically a media element that corresponds to a portion of the single media element currently being viewed in the viewing window.

[0008] The graphical user interface responds to user input by: Define the start and end points of the media element being viewed in the viewing window; Create a media element with a defined start and end point; It may further include a definition object that inserts the created media element into the timeline.

[0009] According to a second aspect of the present invention there is provided a method of providing a graphical user interface for a video editing system, the method comprising: a media bin that displays one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the media elements; Timeline and; A connector element; displaying a graphical user interface, In response to a user activating the connect element, linking the media elements in the media bin together into a single media element and loading the single media element into the viewing window.

[0010] According to one embodiment, the playback speed of a single media element is varied with reference to a characteristic of the individual media elements that make up the single media element, which may be the duration of the single media element. Additionally, the playback speed of media elements whose duration exceeds a threshold may be increased.

[0011] Preferably, the method includes inserting one of the media elements into the timeline in response to user input, the inserted media element being a media element that corresponds to a portion of the single media element currently being viewed in the viewing window.

[0012] The graphical user interface responds to user input by: Define the start and end points of the media element being viewed in the viewing window; Create a media element with a defined start and end point; It may further include a definition object that inserts the created media element into the timeline.

[0013] According to another aspect of the present invention, there is provided a method for playing a media file comprising a plurality of component files each having defined characteristics, the method comprising the step of varying the playback speed with reference to one or more characteristics of the component files.

[0014] A characteristic may be the duration of a component file, optionally speeding up the playback of media elements whose duration exceeds a threshold.

[0015] Unless the context otherwise requires, as used herein, the term "comprise", and variations of that term such as "comprising", "comprises", "comprised", etc., are not intended to exclude additional additives, components, integers or steps.

[0016] Further aspects of the invention, and further embodiments of the aspects described in the preceding paragraphs, will become apparent from the following description, given by way of example and with reference to the accompanying drawings, in which: [Brief description of the drawings]

[0017] [Figure 1] FIG. 2 illustrates a first view of a user interface according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a schematic diagram illustrating a hardware environment suitable for executing graphical user interface functionality according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] 1 illustrates a user interface 100 for a video editing software application that allows a project to be created from constituent media elements that are imported into the video editing software application and displayed in a media bin area 101. In the illustrated embodiment, there is a single bin of media elements labeled "Master," however, one skilled in the art will recognize that any number of media bins can be created to provide a framework for organizing a project with the media elements placed therein.

[0019] In the illustrated embodiment, the user imports twelve constituent media elements into the project, six of which are shown in FIG. 1. The remaining media elements can be viewed by manipulating the scroll bar located on the right hand side of the media bin area. The six visible constituent elements include an audio track 102A and five audiovisual clips 102B-102F (i.e., video clips each with a recorded audio track). As will be appreciated by those skilled in the art, video editing software applications store and manage metadata for each individual constituent element as well as for the project as a whole.

[0020] Additionally, user interface 100 includes a viewer window 110 for viewing a selected video or audiovisual clip, a first timeline 120, and a second timeline 140 above and parallel to the first timeline 120. The operation of the two timelines is described in applicant's co-pending PCT patent application filed on even date, the contents of which are incorporated herein.

[0021] A user uses the timelines 120 and 140 to create a project by inserting constituent media elements onto the timelines and performing editing and arranging operations. In this regard, individual source media elements 102B-102F can be dragged or inserted into one of the timelines 120 from the media bin area 101 or the viewer window 110. Once on the timeline, the constituent media elements can be edited and arranged accordingly.

[0022] The user interface 100 is simplified by displaying only a subset of the typical user interface elements that are displayed on the DaVinci Resolve® edit page. For example, the user interface 100 does not include a separate viewer window in the media bin area 101 for viewing video and audiovisual clips. The simplified user interface displays the core tools needed for a particular project, for example, to import media, edit, trim, add transitions and titles, auto color matching and audio mixing.

[0023] Although only six constituent media elements are shown, it is not uncommon for dozens or even hundreds of constituent media elements to be imported in anticipation of use in a project, which can make it difficult to find a desired clip among all the files present in the media bin area 101.

[0024] To address this issue, the user interface 100 further includes a concatenation object in the form of a button 150. The button 150 is conveniently activated by the user with a single action, typically by clicking or entering a keyboard shortcut linked to the button. In response to activating the concatenation object, the user interface 100 concatenates each media element present in the media bin area 101 into a single media element and loads the created media element into the viewer window 110. The user interface 100 displays the total number of media elements contained in the single media element (12 in this case) and the name of the media bin ("Master" in this case) that contains the media element currently being viewed in the viewer window 110. The total length of the single media element is also displayed on the user interface 100. In the illustrated embodiment, the element number, media bin identifier and length are displayed in an area above the viewer window, although this data could easily be displayed in other locations on the user interface 100.

[0025] When multiple bins are created and displayed in the media bin area 101, concatenation actions can be performed to generate a single media element from the media elements present in one of the selected bins or from the contents of multiple bins.

[0026] Graphical display object 160 is disposed below viewer window 110. In the illustrated embodiment, the entire single media element is depicted as an audio waveform in graphical display object 160. With this depiction, a user can easily identify a particular clip, for example, by examining the trough regions of the audio waveform, which indicate clips with low or zero volume.

[0027] In a graphical display object, the constituent media elements are represented by vertical lines of a contrasting color (such as white).

[0028] Other depictions of single media elements may also be used, such as using simple geometric shapes such as rectangles to diagrammatically represent the constituent media elements. The constituent media elements may be distinguished in the graphical display object 160, for example, by using different colors in the diagrams.

[0029] Having a single media element that consists of all media elements present in the media bin area allows the user to easily scrub (fast if necessary) through the single media element to find the constituent media element that is needed. Fast scrubbing can be performed by manipulating the playhead 123 that is located in the graphical display object 160. Other operations (including fast scrubbing) can be performed using the viewer window controls 170 that are located below the graphical display object 160.

[0030] Once a desired media element is found, it can be easily inserted into one of the timelines 120 and 140, such as by dragging and dropping from the viewer window 110 or the graphical display object 160. The user interface 110 is configured to insert only the individual media element currently displayed in the viewer window 110 into the timeline, rather than inserting an entire single media element.

[0031] The order of the constituent media elements in the created solo media element corresponds to the order of the constituent media elements in the original media bin, except that the order of the individual source media elements in the created solo media element is user-defined and does not have to follow the order of the elements in the media bin.

[0032] The display object 160 is configured to receive user input (such as keyboard input, mouse clicks, or touch screen display contacts) and in response define start and / or end points within the solo media element during the process of the solo media element being played in the viewer window 110. A new clip defined in this manner (i.e., by defining a start point and a corresponding end point) is automatically loaded onto one or both of the timelines 120 and 140. Multiple start and / or end points can be defined in the graphical display object 160 to add multiple clips defined by start and end point pairs to the timelines 120 and 140. Presenting the concatenation of all constituent media objects as a solo media element and defining multiple clips in this manner can improve user workflow by eliminating the need to load individual clips onto the timelines.

[0033] Once multiple clips are present in the timelines 120 and 140, their boundaries can be edited accordingly by trimming and / or zooming, etc. This feature allows display objects 160 to be used to create clips with approximate boundaries that can then be refined using the editing tools of the timelines.

[0034] Concatenating multiple media elements into a single media element effectively removes the start and end points that the individual elements originally defined before the concatenation operation. This opens up the possibility to create a new media element that contains content from multiple original source media elements (i.e., by defining the start and end points of the created single media element). Transition effects can then be easily inserted between the newly created media elements.

[0035] Further, embodiments of the present invention relate to an advantageous playback method performed on the created solo media element, whereby the playback speed of the solo media element is varied with reference to characteristics of the individual source media elements that make up the solo media element. The method is implemented by retaining information about the characteristics (e.g., duration) of the source media elements after they have been concatenated into the solo media element. The retained characteristic information is then used to control the playback of the solo media element.

[0036] An example of a playback method involves playing source media elements whose duration is below a threshold at a normal speed, and playing source media elements whose duration is above the threshold at an accelerated speed. The accelerated playback speed may be the same regardless of the duration of the source media elements involved, or may vary according to the individual durations of those source media elements.

[0037] Other playback control methods can be defined by implementing the present invention, for example, ignoring source media elements whose duration is less than a threshold and varying the playback speed of the remaining elements. In other embodiments, the playback speed of a created media object at a given point in time may be determined as a function of the length of the source media element that corresponds to the given point in time.

[0038] 2 provides a block diagram illustrating an example of a computer system 1000 in which embodiments of the present invention may be implemented. Computer system 1000 includes a bus 1002 or other communication mechanism for communicating information, and a hardware processor 1004 coupled to bus 1002 for processing information. Hardware processor 1004 may be, for example, a general-purpose microprocessor, a graphics processing unit, other type of processing unit, or a combination thereof.

[0039] Additionally, computer system 1000 includes a main memory 1006, such as a random access memory (RAM) or other dynamic storage device coupled to bus 1002 for storing information and instructions executed by processor 1004. Main memory 1006 is also used for storing temporary variables and other intermediate information during execution of instructions to be executed by processor 1004. When such instructions are stored in a non-transitory storage medium accessible to processor 1004, computer system 1000 becomes a special purpose machine customized to perform operations specified by the instructions.

[0040] Computer system 1000 further includes a read only memory (ROM) 1008 or other static storage device coupled to bus 1002 for storing static information and instructions for processor 1004. A storage device 1010, such as a magnetic disk or optical disk, is provided and coupled to bus 1002 for storing information and instructions, including the video editing software application described above.

[0041] Computer system 1000 is connected via bus 1002 to a display 1012 (such as an LCD, LED, touch screen display or other display) for displaying information to a computer user, such as the graphical user interface described and illustrated above. An input device 1014, including alphanumeric and other keys, is connected to bus 1002 for communicating information and command selections to processor 1004. Another type of user input device is a cursor control 1016, such as a mouse, trackball, or cursor direction keys, for communicating directional information and command selections to processor 1004 and for controlling cursor movement on display 1012.

[0042] According to one embodiment, the techniques described herein are performed by computer system 1000 in response to processor 1004 executing one or more sequences of one or more instructions contained in main memory 1006. Such instructions may be read into main memory 1006 from another storage medium, such as a remote database. Processor 1004 executes the sequences of instructions contained in main memory 1006 to perform the process steps described herein. In alternative embodiments, hardwired circuitry may be used in place of or in combination with software instructions.

[0043] The term "storage medium" as used herein refers to any non-transitory storage medium that stores data and / or instructions that cause a machine to operate in a specific manner. Such storage media may include non-volatile storage media and / or volatile storage media. Non-volatile storage media include, for example, optical or magnetic disks, such as storage device 1010. Volatile storage media include dynamic memory, such as main memory 1006. Common forms of storage media include, for example, floppy disks, flexible disks, hard disks, solid state drives, magnetic tape or any other magnetic data storage medium, CD-ROMs, any other optical data storage medium, any physical medium with a pattern of holes, RAM, PROM, EPROM, FLASH-EPROM, NVRAM, any other memory chip or cartridge.

[0044] Computer system 1000 further includes a communication interface 1018 coupled to bus 1002. The communication interface 1018 provides a two-way data communication coupling to a network link 1020 that is connected to one of the communications networks 1050. For example, the communication interface 1018 may be an Integrated Services Digital Network (ISDN) card, cable modem, satellite modem, or the like. As another example, the communication interface 1018 may be a Local Area Network (LAN) card to provide a data communication connection to a compatible LAN. A wireless link may also be implemented. In such an implementation, the communication interface 1018 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.

[0045] It will be understood that the invention disclosed and set forth herein extends to all alternative combinations of two or more of the individual features set forth in or apparent from the text and drawings, all of which different combinations constitute various alternative aspects of the invention.

Claims

1. A computer-readable medium storing instructions that, when executed by a processor, include: a media bin for displaying one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the one or more media elements; a timeline configured to display a graphical representation of a project, the project including a graphical representation of its constituent media elements; A connective object; displaying a graphical user interface for a video editing system, the video editing system is configured to create the project from constituent media elements; A computer-readable medium that, while simultaneously displaying the connector object, the media bin, the viewing window and the timeline in the graphical user interface, in response to a user actuating the connector object, connects media elements in the media bin together into a single media element and loads the single media element into the viewing window.

2. The computer-readable medium of claim 1 , wherein the playback speed of the single media element is varied with reference to characteristics of the individual media elements that make up the single media element.

3. The computer-readable medium of claim 2 , wherein the characteristic is a duration of an individual media element.

4. The computer-readable medium of claim 3 , wherein the playback speed of individual media elements whose duration exceeds a threshold is increased.

5. The computer-readable medium of claim 1 , wherein an instruction responsive to user input inserts one of the media elements into the timeline.

6. The computer-readable medium of claim 5 , wherein the media element inserted into the timeline is a media element that corresponds to a portion of the single media element currently being viewed in the viewing window.

7. The graphical user interface, in response to user input: defining a beginning and an end of a media element being viewed in said viewing window; Create a media element with a defined start and end point; The computer-readable medium of claim 1 , further comprising a definition object that inserts created media elements into the timeline.

8. 1. A method of providing a graphical user interface for a video editing system, the method comprising: a media bin displaying one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the one or more media elements; Timeline and; A connective object; displaying a graphical user interface, The method includes, while simultaneously displaying the connector object, the media bin, the viewing window and the timeline in the graphical user interface, in response to a user activating the connector object, linking the media elements in the media bin together into a single media element and loading the single media element into the viewing window.

9. The method of claim 8 , wherein the playback speed of the single media element is varied with reference to characteristics of the individual media elements that make up the single media element.

10. The method of claim 9 , wherein the characteristic is the duration of an individual media element.

11. The method of claim 10 , wherein the playing speed of individual media elements whose duration exceeds a threshold is increased.

12. The method of claim 8 , further comprising inserting one of the media elements into the timeline in response to user input.

13. The method of claim 12 , wherein the media element inserted into the timeline is a media element that corresponds to a portion of the single media element currently being viewed in the viewing window.

14. The graphical user interface, in response to user input: defining a beginning and an end of a media element within the single media element being viewed in the viewing window; Create a new media element with a defined start and end point; The method of claim 8 , further comprising a definition object that inserts the created media element into the timeline.

15. The method of claim 14 , wherein concatenating a different original media element to the single media element removes the start and end points for the new media element.

16. The method of any of claims 8 to 15, wherein a user actuating the link object causes all media elements present in the media bin to be linked together into a single media element.

17. 17. The method of claim 8, wherein the start and end points of each media element in the media bin are inherently defined by the media element such that all of the media elements are interconnected to the single media element.

18. the video editing system is configured to create a project from the constituent media elements; The method of claim 8 , wherein the timeline is configured to be capable of displaying a graphical representation of the project, the project including a graphical representation of its constituent media elements.

19. 1. A computer system including a processor for executing one or more sequences of instructions contained in a memory, 19. A computer system, the instructions causing the computer system to perform a method according to any of claims 8 to 18.

Images