Video editing or media management system

Abstract

To provide a software product, a computer system, and a method that provide a user with a more optimized video editing workflow environment.SOLUTION: In a method, a graphical user interface for a video editing system is displayed, and as the user activates a concatenation element, media elements in a media bin are concatenated together to form a single media element, and the single media element is loaded into a viewing window, and only the media elements in the media bin with relevant metadata are concatenated in response to the user activating the focus element to modify the single media element so as to form a focused single media element, and load the focused single media element into the viewing window.SELECTED DRAWING: Figure 8

Description

Technical Field

[0001] The present invention generally relates to video editing software applications. More specifically, in at least a preferred embodiment, the present invention relates to a media management system for video editing software applications that provides a more efficient workflow environment for users.

Background Art

[0002] Motion pictures and / or video productions are typically created on a video editing system by assembling a project from a collection of constituent elements. The video editing system can individually import, edit, and integrate these constituent elements, including video clips, audiovisual clips, audio clips, and related metadata. Modern video editing systems, especially those used by professionals in the film and television industries, include high-function video editing software applications. The applicant's video editing system, known as DaVinci Resolve (registered trademark), is an example of a modern video editing system that is widely used in professional settings. The comprehensive functions of DaVinci Resolve (registered trademark) are divided into a number of individual pages organized in the order of a typical workflow (each having its own graphical user interface). The pages of DaVinci Resolve (registered trademark) include Media (for media management and clip composition); Edit (for non-linear video editing); Cut (for alternative non-linear video editing); Color (for color collection and color grading); Sound (for digital audio workstations); Delivery (for final rendering or output); and Fusion (for applying video effects).

[0003] Like other nonlinear video editing software, the user interface of DaVinci Resolve®'s Edit and Cut pages includes a timeline, which is a graphical representation of the project being edited. This timeline typically includes multiple linearly spaced timecode markings that extend horizontally along the length of the user interface window. By aligning with the time markings on the timeline, the project's constituent elements can be arranged in the desired chronological order. Once elements are placed on the timeline, editing tools can be used to edit them, allowing operations such as trimming, splitting, inserting, merging, and moving clips to desired positions. [Overview of the Initiative] [Problems that the invention aims to solve]

[0004] The present invention aims to provide a video editing system that, in at least a preferred embodiment, provides users with a more optimized video editing workflow environment. [Means for solving the problem]

[0005] According to one aspect of the present invention, a software product is provided which includes a non-temporary computer-readable medium for storing instructions, and when the instructions are executed by a processor: A media bin that displays multiple media elements imported into the video editing system; A viewing window to see one of the selected media elements; Timeline and; Connecting element and; Focus element and; Display a graphical user interface for video editing systems, including; In response to the user activating a linked element, media elements in the media bin are linked together to form a single media element, and this single media element is loaded into the viewing window; and In response to the user activating the focus element, the single media element is modified to form a focused single media element that links only the media elements in the media bin, which have the associated metadata, and the focused single media element is loaded into the viewing window.

[0006] According to at least one embodiment, the user interface further includes a sorting element, and in response to the user activating the sorting element, the media elements of the media bin are displayed according to a predetermined sorting scheme. In at least one embodiment, the predetermined sorting scheme is defined or selected by the user. The predetermined sorting scheme includes sorting the media elements according to one or a combination of predetermined metadata fields.

[0007] According to at least one embodiment, a focused single media element links only media elements in a media bin that share attributes defined by associated metadata. This associated metadata may include common metadata, similar metadata, or metadata within a defined numerical range. In some embodiments, the focused single media element links only media elements in a media bin that share attributes defined by one or a combination of predefined metadata fields, corresponding to the currently applied sorting scheme.

[0008] One or more predefined metadata fields may include: timecode; camera and camera type on which the media was captured; date; time; clip name; scene; shot; clip color; modified date; imported date; and / or bin.

[0009] In some embodiments, a focused single media element links only the media elements in the media bin that share associated metadata with one of the selected media elements displayed in the viewing window.

[0010] In some embodiments, the concatenation element and the focus element include different operating modes of the context-dependent user interface element. In at least one embodiment, the context-dependent user interface element operates as a concatenation element in a first context and as a focus element in a second context. The second context can be brought about when a single media element is formed by concatenating media elements in a media bin.

[0011] In some embodiments, context-dependent user interface elements can also function as restoration elements in a third context. The restoration element reverses the operation of the focus element, recombining all media elements in the media bin by reforming the single media element, and loading the single media element into the viewing window.

[0012] In any of the above embodiments, the display of media elements in a media bin that do not form part of the focused standalone media element can be hidden or made less noticeable (for example, by graying out, dimming, fading, changing the color scheme, blurring, etc.).

[0013] In any of the above embodiments, media elements that form part of a focused standalone media element can be highlighted in the display of the media bin.

[0014] According to at least one embodiment, the playback speed of a single media element changes by referring to the characteristics of the media elements that constitute the single media element. For example, the characteristics may be the duration of the single media element. According to this embodiment, the playback speed of media elements whose duration exceeds a threshold can be increased.

[0015] Preferably, a command in response to user input inserts one or more media elements, or selected portions of one or more media elements, into the timeline. This inserted media element is typically a portion of a single media element currently being viewed in the viewing window.

[0016] The graphical user interface responds to user input: Define the start and end points of the media element being viewed in the viewing window; Create a media element from the defined start and end points; It can further include a definition object configured to insert the created media elements into the timeline.

[0017] According to another aspect of the present invention, a method is provided for providing a graphical user interface for a video editing system, the method being: A media bin that displays multiple media elements imported into the video editing system; A viewing window to see one of the selected media elements; Timeline and; Connecting element and; Focus element and; Displaying a graphical user interface, including In response to the user activating the linked element, the media elements in the media bin are linked together to form a single media element, and this single media element is loaded into the viewing window, and The process includes modifying a single media element to form a focused single media element that links only media elements in a media bin, which have associated metadata, in response to a user activating the focus element, and loading the focused single media element into a viewing window.

[0018] When activated, the concatenation element concatenates all media elements in the media bin into a single media element. That is, if the media elements in the media bin are video clips (which may or may not include audio tracks), the concatenation will result in the single media element containing the uncut video clip. If the media elements are still images, they may be concatenated into the single media element as a single frame, or as a multi-frame sequence of a predetermined or user-selectable duration.

[0019] According to at least one embodiment, the user interface further includes a sorting element, the method including displaying media elements in a media bin in an ordered manner according to a predetermined sorting scheme in response to the user activating the sorting element. According to at least one embodiment, the predetermined sorting scheme is defined or selected by the user. The predetermined sorting scheme may include sorting media elements according to one or a combination of predetermined metadata fields.

[0020] According to at least one embodiment, the method includes, when activating a focus element, concatenating only media elements in a media bin that share attributes defined by associated metadata. The associated metadata may include common metadata, similar metadata, or metadata within a defined numerical range. In some embodiments, the focused single media element concatenates only media elements in a media bin that share attributes defined by one or a combination of predefined metadata fields corresponding to the currently applied sorting scheme.

[0021] The predefined one or more metadata fields can include one or more of: time code; camera or camera type where the media was captured; date; time; clip name; scene; shot; clip color; modified date; imported date; and / or bin.

[0022] In some embodiments, the focused single media element concatenates only media elements in a media bin that share metadata associated with a selected one of the media elements displayed in a viewing window.

[0023] In some embodiments, the concatenation element and the focus element include different operating modes of a context-dependent user interface element. In one example, the context-dependent user interface element operates as a concatenation element in a first context and as a focus element in a second context. The second context can arise when a single media element is formed by concatenating media elements in a media bin.

[0024] In some embodiments, the context-dependent user interface element can also function as a return element in a third context. The return element reverses the operation of the focus element, recombining all media elements in the media bin by reforming the single media element, and loading the single media element into the viewing window.

[0025] In any of the above embodiments, the method may include making media elements in a media bin that do not form part of the focused single media element less prominent or hiding them.

[0026] In any of the above embodiments, the method may include highlighting media elements that form part of a focused standalone media element in a media bin.

[0027] According to at least one embodiment, the playback speed of a single media element changes by referring to the characteristics of the individual media elements that constitute the single media element. These characteristics may be the duration of the single media element. Furthermore, the playback speed of media elements whose duration exceeds a threshold can be increased.

[0028] In some embodiments, the method includes inserting one of the media elements into the timeline in response to user input. This inserted media element may be a media element that corresponds to a portion of a single media element currently being viewed in the viewing window.

[0029] The graphical user interface responds to user input: Define the start and end points of a media element that is viewed in a viewing window, where the media element is a standalone media element or a focused standalone media element, and the start and end points can be different media elements in the media bin. Create a media element that includes all media between the defined start and end points; It can further include a definition object configured to insert the created media elements into the timeline.

[0030] According to another aspect of the present invention, a method for displaying a graphical user interface for a video editing system is provided, the method being: Displaying a media bin containing multiple media elements; Displaying the concatenation of the first plurality of media elements in a viewer window; and Depending on the user action that activates the focus function, This includes displaying in a viewer window a link of a second set of media elements, containing only the media elements in a media bin that have associated metadata.

[0031] In some embodiments, the method further includes displaying only the second set of media elements in the media bin in response to a user action that activates the focus function.

[0032] According to another aspect of the present invention, a method for displaying a graphical user interface for a video editing system is provided, the method being: Display the sort element; In response to the user activating the sort element, media elements are displayed in an order according to a predetermined sorting scheme; and This includes displaying a focused single media element that links the media elements associated by the sorting scheme in response to a user action.

[0033] In some embodiments, the predetermined sorting scheme sorts media elements based on specific metadata, for example, according to any metadata described herein. Focused individual media elements can be linked together based on media elements that share the attributes of the specific metadata.

[0034] Unless the context requires a different meaning, the term “comprise” as used herein, and its variations such as “comprising,” “comprises,” and “comprised,” are not intended to exclude further additives, components, integers, or steps.

[0035] Further aspects of the present invention, and further embodiments of the aspects described in the preceding paragraphs, will become apparent from the following description provided through the examples and with reference to the accompanying drawings. [Brief explanation of the drawing]

[0036] [Figure 1] This figure shows a first view of a user interface according to one embodiment. [Figure 2] This figure shows a first view of a second user interface according to one embodiment. [Figure 3] This figure shows a second view of a second user interface according to one embodiment. [Figure 4] This figure shows a sorting element of a second user interface according to one embodiment. [Figure 5] This figure shows a third view of a second user interface according to one embodiment. [Figure 5b]This figure shows the corresponding view of the user interface related to the variation of the embodiment in Figure 5. [Figure 6] This figure shows a fourth view of a second user interface according to one embodiment. [Figure 7] This is a schematic diagram showing a hardware environment suitable for executing a graphical user interface function according to an embodiment of the present invention. [Figure 8] This flowchart illustrates an example of how to provide a graphical user interface for a video editing system. [Figure 9] This flowchart illustrates an example of how to provide a graphical user interface for a video editing system. [Figure 10] This flowchart illustrates an example of how to provide a graphical user interface for a video editing system. [Modes for carrying out the invention]

[0037] Figure 1 shows a user interface 100 for a video editing software application. The video editing software allows the creation of a project from constituent media elements imported into the video editing software application and displayed in a media bin area 101. This is described, for example, in the applicant's concurrently continuing international patent application PCT / AU2020 / 050322, the contents of which are incorporated herein by reference. In the illustrated embodiment, there is a single bin of media elements named “Master,” but those skilled in the art will notice that any number of media bins can be created, providing a framework for organizing a project with the media elements placed therein.

[0038] In the illustrated embodiment, the user imports 12 configuration media elements into the project, six of which are shown in Figure 1. The remaining media elements can be viewed by manipulating the scroll bar located on the right side of the media bin area 101. The six visible configuration elements include an audio track 102A and five audiovisual clips 102B-102F (i.e., video clips, each with a recorded audio track). As experienced users will understand, the video editing software application stores and manages metadata for each individual configuration media element as well as for the entire project.

[0039] Furthermore, the user interface 100 includes a viewer window 110 for viewing selected video or audiovisual clips, a first timeline 120, and a second timeline 140 parallel to the first timeline 120. The operation of the two timelines is described in the applicant's concurrently pending international patent application PCT / AU2020 / 050320, filed on the same date, and its contents are incorporated herein by reference.

[0040] Users create projects by using timelines 120 and 140 to insert, edit, and arrange constituent media elements into the timelines. To this end, individual source media elements 102B-102F can be dragged or inserted from the media bin area 101 or the viewer window 110 into one of the timelines 120 or 140. Once in the timeline, the constituent media elements can be edited and arranged as needed.

[0041] User interface 100 is simplified by simply displaying a subset of the usual user interface elements that appear on the DaVinci Resolve® Cut page. For example, user interface 100 does not include a separate viewer window for viewing video clips or audiovisual clips within the media bin area 101. The simplified user interface displays the core tools required for a particular project, such as importing, editing, trimming, adding transitions and titles, and performing automatic color matching and audio mixing.

[0042] Although only six configuration media elements are shown, it's not uncommon for dozens or even hundreds of configuration media elements to be imported with the expectation of using them in the project. This makes it difficult to find the desired clip from among all the files present in media bin area 101.

[0043] To address this issue, the user interface 100 further includes a linking object, in the form of a button 150 in the embodiment shown in Figure 1. The button 150 is activated by the user as appropriate, typically through a single action such as a click using a mouse or other pointer device, the execution of an appropriate gesture on a touchscreen, or the input of a keyboard shortcut linked to the button. In response to the activation of the linking object, the user interface 100 links each media element present in the media bin area 101 into a single media element and loads the created single media element into the viewer window 110. The user interface 100 displays the total number of media elements contained in the single media element (12 in this case) and the name of the media bin containing the media element currently viewed in the viewer window 110 ("Master" in this case). In the specific embodiment shown, the display of the total number of media elements and the name of the media bin are combined into a single item display, which in this case appears as "12Clips-Master" in the header of the viewer window 110. The full length of the single media element is also displayed in the user interface 100. In the illustrated embodiment, the element number, media bin identifier, and length are displayed in the area above the viewer window, but this data can be easily displayed in other locations in the user interface 100.

[0044] If multiple bins are created and displayed in the media bin area 101, a concatenation action can be performed to generate a single media element from the media elements present in one of the selected bins, or from the contents of multiple bins. In the preferred form, the operation of the concatenation element 150 concatenates the entirety of each media element in the media bin 101 (selected or all of them) into a single media element.

[0045] The graphical display object 160 is located below the viewer window 110. In the illustrated embodiment, an entire standalone media element is depicted in the graphical display object 160, which includes an audio waveform. In this depiction, the user can easily identify a particular clip, for example, by examining the trough region of the audio waveform that indicates a clip with low or zero volume.

[0046] The graphical display object 160 appears as strips representing the connections between its constituent elements. In the graphical display object 160, the boundaries between constituent media elements are indicated by vertical lines of contrasting colors (such as white). Other methods of depicting individual media elements in the graphical display object 160 can also be used, such as schematically representing the constituent media elements using simple geometric shapes like rectangles. Constituent media elements can be identified in the graphical display object 160, for example, by using different colors in their schematic diagrams.

[0047] By having a single media element consisting of all media elements present in the media bin area, the user can easily find the required constituent media elements by scrubbing the single media element (as quickly as necessary). Fast scrubbing can be performed by manipulating the playhead 123 located on the graphical display object 160. Other operations (including fast scrubbing) can be performed using the viewer window control 170 located below the graphical display object 160 in the embodiment shown in Figure 1.

[0048] Once the required media elements are found, they can be easily inserted into one of the timelines 120 and 140 by dragging and dropping from the viewer window 110 or the graphical display object 160. The user interface 100 is configured to insert only the individual media elements currently displayed in the viewer window 110 into the timeline, rather than inserting entire media elements.

[0049] The order of constituent media elements within a created standalone media element corresponds to the order of constituent media elements in the original media bin. However, the order of individual source media elements within a created standalone media element can be defined by the user and does not need to follow the order of media elements in the media bin.

[0050] The graphical display object 160 is configured to receive user input (such as keyboard input, mouse clicks, or touchscreen display contacts) and, accordingly, define start and / or end points within a single media element during the process of the single media element being played back in the viewer window 110. New clips defined in this way (i.e., by defining start and corresponding end points) are automatically loaded into one or both of the timelines 120 and 140. Multiple start and / or end points can be defined in the graphical display object 160 to add multiple clips defined by start and end point pairs to the timelines 120 and 140. Presenting the combination of all constituent media objects as a single media element and defining multiple clips in this way eliminates the need to load individual clips into the timelines, thus improving the user workflow.

[0051] When multiple clips exist on timelines 120 and 140, their boundaries can be edited as needed by trimming and / or scaling. This feature allows you to create clips with approximate boundaries using the graphical display object 160, and then refine those boundaries using the editing tools on the timeline.

[0052] By concatenating multiple media elements into a single media element, the start and end points originally defined by each element before the concatenation operation are effectively removed. This opens up the possibility of creating a new media element containing content from multiple original source media elements (i.e., by defining the start and end points of the created single media element). Transition effects can then be easily inserted between the newly created media elements.

[0053] Figures 2 to 6 show further embodiments of the user interface 200 for video editing software applications such as non-linear editors. Embodiments in Figures 2 and 6 are similar to the embodiment in Figure 1, with elements common to Figure 1 having reference numerals 100 to 170 being numbered in the range of 200 to 270, and elements in Figure 1 having reference numeral 1XX being indicated by reference numeral 2XX in Figures 2 to 6, and so on, corresponding elements having similar functions in each embodiment unless otherwise noted.

[0054] Referring to Figure 2, the video editing software enables the creation of a project from the constituent media elements that are imported into the video editing software application and displayed in the media bin area 201. In the illustrated embodiment, there is a single bin of media elements named "Master," but those skilled in the art will notice that any number of media bins can be created, providing a framework for organizing a project with the media elements placed therein.

[0055] In the illustrated embodiment, the user imports 90 constituent media elements into the project, 19 of which are shown in Figure 1. The remaining media elements are made visible by operating the scroll bar 231 located on the right side of the media bin area 201. The 19 visible constituent media elements consist of seven audiovisual clips 202A.1 to 202A.7 represented by icons in the first column, five audiovisual clips 202B.1 to 202B.5 represented by icons in the second column, an audiovisual clip 202C represented by icons in the third column, and six audiovisual clips 202D.1 to 202D.6 represented by icons in the fourth column. As will be understood by those skilled in the art, the video editing software application stores and manages metadata for each constituent element as well as for the entire project. Figure 3 shows a second view of the interface, where the media elements are made visible as clips or filmstrips. Other views of the clips (e.g., as lists, folders) are also possible.

[0056] The user interface 200 further includes a viewer window 210 for viewing selected video and audiovisual clips, a first timeline 220, and a second timeline 240 positioned parallel to the first timeline 220. The operation of the two timelines is described in the applicant's concurrently continuing PCT patent application PCT / AU2020 / 050320, the contents of which are incorporated herein by reference.

[0057] Using timelines 220 and 240, users can create projects by inserting constituent media elements into either timeline and performing editing and arrangement operations. Inserting a media element into either timeline 220 or 240 will display that same media element at its corresponding position on the other timeline. In this regard, individual source media elements 202A.1 through 202A.4 (or any other media elements in the media bin that are not visible in the current view) can be inserted into either timeline 220 or 240 by dragging or other means from the media bin area 201 or the viewer window 210. Once placed in the timeline, the constituent media elements can be edited and arranged as appropriate.

[0058] User Interface 200 is simplified by simply displaying a subset of the normal user interface elements that appear on the DaVinci Resolve® Cut page. For example, User Interface 200 does not include a separate viewer window for viewing video clips or audiovisual clips within the Media Bin Area 201. The simplified user interface displays the core tools needed for a particular project, such as importing, editing, trimming, adding transitions and titles, automatic color matching, and audio mixing.

[0059] Although only 19 constituent media elements are shown in Figure 2, 90 clips are loaded into the bin in this embodiment. However, it is not uncommon for hundreds of constituent media elements to be imported in anticipation of use in a project. This can make it difficult to identify and manage desired clips from all files present in the media bin area 201, even when using the concatenation elements described in relation to Figure 1. Therefore, this embodiment presents an improved mechanism for identifying and managing media.

[0060] The user interface 200 further includes a concatenation object, which in the embodiment shown in Figure 2 takes the form of a button 250. The button 250 is typically activated by the user in a single action, such as by clicking with a mouse or other pointer device, performing an appropriate gesture on a touchscreen, or entering a keyboard shortcut linked to the button. In response to the activation of the concatenation object, the user interface 200 concatenates each media element present in the media bin area 201 into a single media element and loads the created media element into the viewer window 210. The user interface 200 displays the total number of media elements (232) contained in the single media element (234) and the media bin name (233) (in this case, "Master") of the media bin containing the media element currently viewed in the viewer window 210. The total length of the single media element (234) is also displayed in the user interface 200. In the illustrated embodiment, the media element count (232), media bin name or identifier (233), and the length of a single media element (234) formed by concatenation are displayed in the area above the viewer window, but this data can be easily displayed in other locations on the user interface 200.

[0061] When multiple bins are created and displayed in media bin area 201, a linking action can be performed to generate a single media element from a media element in one of the selected bins, or from the contents of multiple bins.

[0062] Similar to Figure 1, the graphical display object 260 is located below the viewer window 210. In the illustrated embodiment, the entirety of a single media element is depicted in the graphical display object 260, which includes the audio waveform. In this depiction, the user can easily identify a particular clip, for example, by examining the trough region of the audio waveform that indicates a clip with zero or low volume. The temporal boundaries (i.e., edges) of the constituent media elements are indicated by vertical lines of contrasting colors (such as white), for example, 262 and 264, to assist the user in determining the length of the constituent media elements relative to the length of the entire single media object.

[0063] Other methods of depicting individual media elements can also be used, such as schematically representing them using simple geometric shapes like rectangles. Constituent media elements can be identified in the graphical display object 260, for example, by using different colors in their schematic diagrams.

[0064] By constructing a single media element from all media elements present in the media bin area, users can easily find the required constituent media elements by scrubbing (as quickly as necessary) through the single media elements. Fast scrubbing can be performed by manipulating the playhead 223 located on the graphical display object 260. Other operations (including fast scrubbing) can be performed using the viewer window control 270 located below the graphical display object 260.

[0065] The order of constituent media elements within a created standalone media element corresponds to the order of constituent media elements in the original media bin. However, the order of individual source media elements within a created standalone media element can also be defined by the user and does not need to follow the order of media elements in the media bin. In this embodiment, media elements 202A.1 to 202D.6 are displayed in media bin 201 sorted by import date. The media elements are arranged in groups by import date. To set up this sorting, the user interface according to this embodiment includes a sort element 252. When the sort element 252 is activated, the media elements in media bin 201 are displayed in an order according to a predetermined sorting scheme. The sorting scheme is defined and selected by the user. Figure 4 shows an example of a sort element. This sort element 252 is activated by selecting an interface button, after which the user selects the sorting scheme to use. The sorting scheme may include sorting media elements according to one or a combination of predefined metadata fields. A list of possible metadata fields is shown in the sort scheme list 254 of Figure 4. Once a sort scheme is selected, the media elements in the bin are displayed in the new sort order. Media elements can also be grouped according to the appropriate metadata for the sorting scheme by displaying the bins. In this regard, Figure 5 displays the media elements shown in the embodiments of Figures 2 and 3, sorted into groups 256, 258, and 259 by scene name.

[0066] As can be seen from the above, media elements can be stored in data or file formats containing various different metadata fields, and media elements can be sorted using any one or more metadata fields. Grouping in display is performed based on matching metadata in one or more fields set by the sorting scheme, or metadata that falls within a numerical range of one or more metadata fields set by the sorting scheme. Useful metadata fields may include one or more of the following: Timecode; camera and camera type in which the media was captured; date; time; clip name; scene; shot; clip color; modified date; imported date; and / or bin.

[0067] Returning to Figure 5, we can see that the media elements in media bin 201 are grouped in a different way than in Figures 2 and 3. This allows the user to see the grouping of media elements that are most useful for their editing workflow and tasks. However, this can still be difficult when dealing with a large number of media elements.

[0068] In this embodiment, the user interface 200 further includes focus elements that can be used to reduce the set of media elements the user has to deal with at any given time, thereby simplifying and speeding up operations. Focus elements are used to reduce the number of elements in a group of media elements that form a single media element. In this embodiment, this simply involves linking media elements in a media bin that share certain metadata attributes as a modified single media element, which may be displayed as described above.

[0069] Clip grouping can be defined based on the clips currently displayed in the viewer window 210 and their associated metadata. For example, all media elements with metadata associated with the currently displayed media element can be included in the focused single media element. Associated metadata can include common metadata, similar metadata, or metadata within a defined numerical range. In some embodiments, the focused single media element concatenates only the media elements in the media bin that have been grouped together by the currently active sorting scheme.

[0070] Therefore, in Figure 5, media element 202D.2 is actively displayed in viewer window 210 (this can be seen by the prominent interface outline 237 surrounding the icon of media element 202D.2 in media bin 201). When the user activates focus element (button) 250, the individual media element is modified and the user interface transitions to the view in Figure 6.

[0071] In other embodiments, linking elements and focus elements are distinguished. For example, button 250 is a dedicated linking element, and another button can act as a focus element. Figure 5b provides an illustration of such a user interface 200. The user interface of Figure 5b differs from the embodiment of Figure 5 only in that the user interface 200 of Figure 5b includes a dedicated focus element in the form of button 251. All other elements are the same as in Figure 5 and share their reference numerals with Figure 5. Button 251, which is the focus element, can be activated by the user as appropriate, typically by a single action such as clicking with a mouse or other pointing device, performing an appropriate gesture on a touchscreen, or entering a keyboard shortcut linked to the button. When the focus element 251 is activated, the standalone media element is modified as described in relation to the operation of the focus element in Figure 5, and the user interface transitions to the view of Figure 6. The user interfaces of Figure 6 (and also in Figures 2 through 4) may further be configured to include a dedicated focus element, for example, as in Figure 5b.

[0072] As can be seen in Figure 6, the modified standalone media element (graphical display object) illustrated in 260 contains only four clips. Furthermore, in the embodiment shown in Figure 6, media bin 201 is modified. Specifically, only the clips that remain visible in media bin 201 are the four clips included in the modified standalone media element illustrated in 260. In this embodiment, these four remaining clips share the metadata of "Scene 2" with clip 202D.2. The new, modified standalone media element, called the focused standalone media element, can be used as described above.

[0073] In the embodiment shown in Figure 5, the linking element and the focus element are operated using a button 250, which is the same visual element on the user interface. This button 250 operates in a context-dependent manner, acting as a linking element in a first context (in which case the "source tape" bin mode is inactive, i.e., the single media element is not active) and as a focus element in a second context (in which case the "source tape" mode is active, i.e., the single media element is active).

[0074] Any of the user interfaces 200 in the above embodiments may include a restore element, so that if a focused single media element is active, the user can activate the restore element to include all media elements in the media bin back into the single media element and load the single media element into the viewing window. That is, activating the restore element resets the behavior of the focused element and returns the interface to a first context (e.g., the state in Figures 2 and 3) that includes all media elements in the bin in which the single media element is active. The restore element may be a physical button or a GUI (Graphical User Interface) defined button. For convenience, it may also be the "Esc key" on the keyboard. The restore element may further be a context-dependent user interface element, such as a further operating mode of button 250.

[0075] In embodiments that include a dedicated focus element, for example, the embodiment described with reference to Figure 5b, either or both of the focus element 251 or the connecting element 250 can function as a return element in the context of a focused single media element being active.

[0076] As explained in relation to Figure 1, the required media elements can be easily inserted into one of the timelines 220 and 240 by dragging and dropping from the viewer window 210 or the graphical display object 260, once they are positioned as either standalone media elements or focused standalone media elements. The user interface 200 is configured to insert only the individual media elements currently viewed in the viewer window 210 into the timeline, rather than inserting the entire standalone media element or the entire focused standalone media element.

[0077] The graphical display object 260 receives user input (such as keyboard input, mouse clicks, or touchscreen display contacts) and is configured accordingly to define the start and / or end points of a standalone media element or a focused standalone media element while it is playing in the viewer window. Any new clip defined in this way (i.e., by defining start and corresponding end points) is automatically loaded into one or both of the timelines 220 and 240. The graphical display object 260 allows multiple clips defined by start and end point pairs to be added to the timelines 220 and 240 by defining multiple start and / or end points. Once these multiple clips are present in the timelines 220 and 240, their boundaries can be edited as appropriate by trimming and / or extending, etc. This feature allows the graphical display object 260 to be used to create clips with approximate boundaries, which are then refined using the editing tools on the timelines.

[0078] The user workflow can be improved by presenting the combination of all constituent media objects as a single media element, and further allowing the user to focus on a subset of media elements through common attributes, such as defined by metadata. This eliminates the need to load individual clips into the timeline, and allows the user to selectively reduce the number of clips visible at any given time, making it easier to navigate through the numerous clips that may exist in complex projects.

[0079] By linking multiple media elements into a single media element, the start and end points originally defined by each element before the linking operation can be effectively removed. This opens up the possibility of creating a new media element containing content from multiple original source media elements (i.e., by defining the start and end points of the created single media element). Transition effects can then be easily inserted between the newly created media elements.

[0080] Furthermore, embodiments of the present invention relate to an advantageous playback method performed on a created standalone media element. According to this method, the playback speed of the standalone media element is varied by reference to the characteristics of the individual source media elements that constitute the standalone media element. This method is performed by retaining information about the characteristics of the source media elements (e.g., duration) after the source media elements have been linked to the standalone media element. The retained characteristic information is then used to control the playback of the standalone media element.

[0081] One example of a playback method involves playing source media elements whose duration is below a threshold at a normal speed, and playing source media elements whose duration is above the threshold at an increased speed. The increased playback speed may be the same regardless of the duration of the required source media elements, or it may vary according to the duration of each of those source media elements.

[0082] Other playback control methods can be defined by implementing the present invention. For example, source media elements with a duration less than a threshold can be ignored, and the playback speed of the remaining elements can be varied. In another embodiment, the playback speed of a created media object at a given point in time may be determined as a function of the length of the source media element corresponding to that point in time.

[0083] Figure 7 provides a block diagram showing an example of a computer system 1000 capable of carrying out embodiments of the present invention. The computer system 1000 includes a bus 1002 or other communication mechanism for transmitting information and a hardware processor 1004 connected to the bus 1002 for processing information. The hardware processor 1004 may be, for example, a general-purpose microprocessor, a graphics processing unit, another type of processing unit, or a combination thereof.

[0084] Furthermore, the computer system 1000 includes main memory 1006, such as random access memory (RAM) or other dynamic storage devices connected to bus 1002, for storing information and instructions executed by processor 1004. Main memory 1006 is also used to store temporary variables and other intermediate information during the execution of instructions by processor 1004. When such instructions are stored in non-temporary storage media accessible to processor 1004, the computer system 1000 becomes a dedicated machine customized to perform the operations specified by those instructions.

[0085] The computer system 1000 may further include a read-only memory (ROM) 1008 or other static storage device connected to the bus 1002 for storing static information and instructions for the processor 1004. A storage device 1010, such as a magnetic disk or optical disk, may also be provided and connected to the bus 1002 for storing information and instructions, including the video editing software application described above.

[0086] The computer system 1000 is connected to a display 1012 (such as an LCD, LED, touchscreen display, or other display) via a bus 1002 to display information to the computer user, such as the graphical user interface described and illustrated above. An input device 1014, including alphanumeric keys and other keys, is connected to the bus 1002 to transmit information and command selections to the processor 1004. Another type of user input device is a cursor control 1016, such as a mouse, trackball, or cursor directional keys, to transmit directional information and command selections to the processor 1004 and to control the movement of a cursor on the display 1012.

[0087] According to at least one embodiment, the technology described herein is executed by a computer system 1000 in which a processor 1004 executes one or more sequences of one or more instructions contained in main memory 1006. Such instructions may be read into main memory 1006 from another storage medium, such as a remote database. The processor 1004 executes the steps of the process described herein by executing the sequence of instructions contained in main memory 1006. In alternative embodiments, hardwired circuits may be used instead of or in combination with software instructions.

[0088] As used herein, the term “storage medium” refers to any non-temporary storage medium that stores data and / or instructions that cause a machine to operate in a particular way. Such storage media may include non-volatile storage media and / or volatile storage media. Non-volatile storage media include, for example, optical disks or magnetic disks such as storage device 1010. Volatile storage media include dynamic memory such as main memory 1006. Common forms of storage media include, for example, floppy disks, flexible disks, hard disks, solid-state drives, magnetic tapes, or any other magnetic data storage media, CD-ROMs, any other optical data storage media, any physical media with perforation patterns, RAM, PROMs, EPROMs, FLASH-EPROMs, NVRAMs, and any other memory chips or cartridges.

[0089] Furthermore, the computer system 1000 may include a communication interface 1018 connected to the bus 1002. The communication interface 1018 is coupled to a network link 1020 connected to a communication network 1050 to provide bidirectional data communication. For example, the communication interface 1018 may be an Integrated Services Digital Network (ISDN) card, a cable modem, a satellite modem, etc. As another example, the communication interface 1018 may be a local area network (LAN) card to provide data communication connectivity to a compatible LAN. A wireless link may also be implemented. In such an implementation, the communication interface 1018 sends and receives electrical, electromagnetic, or optical signals that transmit digital data streams representing various types of information.

[0090] Figure 8 shows a flowchart of Method 800 for providing a graphical user interface for a video editing system, for example, the graphical user interface described with reference to Figures 2 to 6. In some embodiments, Method 800 is carried out based on instructions in a non-temporary computer-readable medium, for example, ROM 1008.

[0091] In step 801, method 800 includes displaying a graphical user interface containing media elements. In some embodiments, step 801 includes displaying a media bin that displays multiple media elements imported into a video editing system. In some embodiments, step 801 includes displaying a viewing window for viewing one of the selected media elements. In some embodiments, step 801 includes displaying a timeline. In some embodiments, step 801 includes displaying a connect element. In some embodiments, step 801 includes displaying a focus element.

[0092] In step 802, method 800 includes, in response to the user activating a linked element, linking together media elements in a media bin into a single media element and loading the single media element into a viewing window.

[0093] In step 803, method 800 includes modifying a standalone media element to form a focused standalone media element that links only the media elements in a media bin, which have associated metadata, in response to the user activating a focus element, and loading the focused standalone media element into a viewing window.

[0094] In some embodiments, step 803 includes concatenating only media elements present in the media bin that share attributes defined by the relevant metadata when the focus element is activated. In some embodiments, the relevant metadata includes common metadata, similar metadata, or metadata within a defined numerical range.

[0095] In some embodiments, a focused single media element concatenates only media elements in a media bin that share attributes defined by one or a combination of predefined metadata fields corresponding to the currently applied sorting scheme (see, for example, the method described with reference to Figure 9).

[0096] In some embodiments, metadata is selected from: timecode; camera and camera type in which the media was captured; date; time; clip name; scene; shot; clip color; modified date; imported date; and / or bin.

[0097] In some embodiments, the concatenation element and the focus element include different operating modes of the context-dependent user interface element, for example, the context-dependent user interface element operates as a concatenation element in a first context and as a focus element in a second context. Method 800 may also input the second context after a single media element has been formed by concatenating media elements in a media bin. The context-dependent user interface element may also operate as a return element in a third context, in which case the return element reverses the operation of the focus element, and the single media element is formed again by concatenating all media elements in the media bin into a single media element, which is then loaded into the viewing window.

[0098] Figure 9 shows a flowchart of Method 900 for providing a graphical user interface for a video editing system, for example, the graphical user interface described with reference to Figures 2 to 6. In some embodiments, Method 900 is performed in conjunction with Method 800. In some embodiments, Method 900 is performed based on instructions in a non-temporary computer-readable medium, for example, ROM 1008.

[0099] In step 901, method 900 includes displaying a graphical user interface including media elements. Step 901 may also include displaying sort elements, for example, as described in relation to step 801. Step 901 may also include displaying one or more other elements, for example, other elements described in step 801. In step 902, the method includes displaying media elements in a media bin in an order according to a predetermined sorting scheme, in response to a user activating a sort element.

[0100] In some embodiments, a predetermined sorting scheme is defined or selected by the user. In some embodiments, the predetermined sorting scheme includes sorting media elements according to one or a combination of predefined metadata fields.

[0101] In step 903, the method includes, in response to a user action, displaying a focused single media element that links media elements associated by a sorting scheme, for example, by sharing metadata attributes used for sorting. In some embodiments, step 903 is part of step 803 in method 800.

[0102] Figure 10 shows a flowchart of Method 1100 for providing a graphical user interface for a video editing system, for example, the graphical user interface described with reference to Figures 2 to 6. In some embodiments, Method 1100 is performed in conjunction with Method 800 or Method 900. In some embodiments, Method 1100 is performed based on instructions in a non-temporary computer-readable medium, for example, ROM 1008.

[0103] In step 1101, method 1100 includes displaying a graphical user interface that includes media elements. Step 1101 includes displaying a viewing window for viewing one of the selected media elements, and displaying a timeline. Step 1101 may also include displaying one or more other elements, for example, other elements described in step 801 and / or step 901.

[0104] In step 1102, method 1100 includes inserting one of the media elements into the timeline in response to user input. The media element to be inserted into the timeline is a media element that corresponds to a single media element or a portion of a focused single media element (see above) that is currently viewed in the viewing window.

[0105] It will be understood that the invention disclosed and revealed herein extends to all possible alternative combinations of two or more individual features described or evident therefrom in the text and drawings. All of these different combinations constitute various alternative embodiments of the invention.

[0106] In light of the detailed description above, these and other modifications can be made to the embodiments. In general, the terms used in the following claims should not be interpreted as limiting the claims to any particular embodiment disclosed in the specification, but rather as encompassing all possible embodiments, along with the entire scope of equivalents to which such claims are granted. Thus, the claims are not limited by the aforementioned disclosure.

Claims

1. A non-temporary computer-readable medium for storing instructions, when said instructions are executed by a processor: A media bin that displays multiple media elements imported into the video editing system; A viewing window for viewing one of the selected media elements; Timeline and; Connecting element and; Focus element and; It displays a graphical user interface for video editing systems, including; In response to the user activating the linked element, the media elements in the media bin are linked together to form a single media element, and this single media element is loaded into the viewing window; A non-temporary computer-readable medium that, after linking the media elements to form a single media element, modifies the single media element to form a focused single media element that links only the media elements in the media bin, which have associated metadata, in response to the user activating the focus element, and loads the focused single media element into a viewing window.

2. The non-temporary computer-readable media according to claim 1, wherein the user interface further includes a sorting element, and in response to the user activating the sorting element, the media elements of the media bin are displayed according to a predetermined sorting scheme.

3. The non-temporary computer-readable media according to claim 2, wherein the predetermined sorting scheme includes sorting media elements according to one or a combination of predetermined metadata fields.

4. The non-temporary computer-readable media according to any one of claims 1 to 3, wherein the focused single media element links only media elements in a media bin that share attributes defined in the associated metadata.

5. The non-transient computer-readable media according to any one of claims 1 to 4, wherein the focused single media element links only media elements in a media bin that share attributes defined by one or a combination of predefined metadata fields, corresponding to the currently applied sorting scheme.

6. The connecting element and the focus element are non-temporary computer-readable media according to any one of claims 1 to 5, including different operating modes of context-dependent user interface elements.

7. The non-temporary computer-readable medium according to claim 6, wherein the context-dependent user interface element operates as a connective element in a first context and as a focus element in a second context.

8. The non-transient computer-readable media according to any one of claims 1 to 7, wherein the focused single media element links only media elements in a media bin that share metadata associated with one of the selected media elements displayed in the viewing window.

9. A method for providing a graphical user interface for a video editing system, the method being: A media bin that displays multiple media elements imported into the video editing system; A viewing window for viewing one of the selected media elements; a timeline; Connecting element and; Focus element and; Displaying a graphical user interface, including In response to the user activating the linked element, the media elements in the media bin are linked together to form a single media element, and this single media element is loaded into the viewing window, and A method comprising: linking the media elements to form a single media element; modifying the single media element to form a focused single media element that links only the media elements in the media bin, which have associated metadata, in response to the user activating the focus element; and loading the focused single media element into a viewing window.

10. The method according to claim 9, wherein the user interface further includes a sorting element, and the method includes displaying media elements of a media bin in an order according to a predetermined sorting scheme in response to a user activating the sorting element.

11. The method according to claim 10, wherein the predetermined sorting scheme includes sorting media elements according to one or a combination of predetermined metadata fields.

12. The method according to any one of claims 9 to 11, further comprising linking only media elements in a media bin that share attributes defined by the associated metadata when the focus element is activated.

13. The method according to any one of claims 9 to 12, wherein the focused single media element links only media elements in a media bin that share attributes defined by one or a combination of predefined metadata fields, corresponding to the currently applied sorting scheme.

14. The method according to any one of claims 9 to 13, wherein the connecting element and the focus element include different operating modes of context-dependent user interface elements.

15. The method according to claim 14, wherein the context-dependent user interface element operates as a connective element in a first context and as a focus element in a second context.

16. The method according to any one of claims 9 to 12, wherein the focused single media element links only media elements in a media bin that share metadata associated with one of the selected media elements displayed in the viewing window.

17. A computer system comprising a processor and a non-temporary storage medium accessible to the processor, wherein the processor executes a sequence of one or more instructions by the computer system: A media bin that displays multiple media elements imported into the video editing system; A viewing window to see one of the selected media elements; Timeline and; Connecting element and; Focus element and; A graphical user interface including the following is displayed on the screen; In response to receiving user input, including the user activating the linked element, the media elements in the media bin are linked together to form a single media element, and this single media element is loaded into the viewing window. A computer system that, after concatenating the media elements to form a single media element, modifies the single media element to form a focused single media element that concatenates only the media elements in the media bin and has associated metadata, in response to receiving user input including the user activating the focus element, and loads the focused single media element into the viewing window.

18. The computer system according to claim 17, wherein the focused single media element is a link of only media elements in a media bin that share metadata related to one of the selected media elements displayed in the viewing window.

19. The computer system according to claim 17 or 18, wherein the connecting element and the focus element include different operating modes of context-dependent user interface elements.

Images