Video editing system or media management system

Abstract

The present disclosure relates to a software product comprising a computer readable medium storing instructions that, when executed by a processor: displays a graphical user interface for a video editing system, the user interface comprising: a media bin displaying a plurality of media elements imported into the video editing system; a view window for viewing a selected one of the media elements; a timeline; a joiner element; and a focus element. In response to a user initiating the joiner element, joining together media elements present in the media bin into a single media element and loading the single media element into the view window; and in response to a user initiating the focus element, modifying the single media element to form a focused single media element that only joins those media elements present in the media bin that have related metadata, and loading the focused single media element into the view window.

Description

Technical Field

[0001] This disclosure generally relates to video editing software applications. More specifically, this disclosure relates to media management systems for video editing software applications, which, at least in preferred embodiments, provide users with a more efficient workflow environment. Background Technology

[0002] Film and / or video works are typically created on video editing systems by assembling projects from a collection of constituent elements. Video editing systems allow these constituent elements (which include video clips, audiovisual clips, audio clips, and associated metadata) to be imported and edited individually before being merged into the final work. Modern video editing systems (and especially those used professionally in the film and television industry) include sophisticated video editing software applications. For example, DaVinci Resolve... Known video editing systems are examples of modern video editing systems widely used in professional environments. (DaVinci) All of its functionality is divided into multiple separate pages (each with its own graphical user interface), organized according to the sequence of a typical workflow. DaVinci The pages include: "Media" (for media management and clip organization), "Edit" (a non-linear video editor), "Cut" (an alternative non-linear video editor), "Color" (for color correction and grading), "Sound" (a digital audio workstation), "Deliver" (for final rendering or output), and "Fusion" (for applying video effects).

[0003] Like other non-linear video editors, DaVinci Resolve... The user interface for the "Edit" and "Cut" pages includes a timeline, a graphical representation of the item being edited. The timeline consists of multiple linearly spaced timecode markers that typically extend horizontally along the length of the user interface window. The timeline allows the components of an item to be arranged in the desired chronological order by aligning them with the timecode markers. Once placed within the timeline, elements can be edited by launching editing tools to perform operations such as trimming, splitting, inserting, merging, and moving segments to desired positions.

[0004] The purpose of this disclosure is to provide a video editing system that, at least in a preferred embodiment, provides users with a more optimized video editing workflow environment. Summary of the Invention

[0005] According to one aspect of this disclosure, a software product is provided, the software product comprising a non-transitory computer-readable medium storing instructions that, when executed by a processor:

[0006] To display a graphical user interface for the video editing system, the user interface includes:

[0007] The media pod displays multiple media elements that have been imported into the video editing system;

[0008] The view window is used to view the selected media element;

[0009] Timeline;

[0010] Connector element; and

[0011] Focus element;

[0012] In response to the user-initiated linker element, it links all media elements in the media repository together into a single media element and loads that single media element into the view window; and

[0013] In response to the user activating the focused element, the individual media element is modified to form a focused individual media element, which links only those media elements with relevant metadata that exist in the media repository, and the focused individual media element is loaded into the viewing window.

[0014] According to at least one embodiment, the user interface further includes a sorting element, and in response to the user activating the sorting element, media elements in the media repository are displayed according to a predetermined sorting scheme. In at least one embodiment, the predetermined sorting scheme is user-defined or user-selected. The predetermined sorting scheme includes sorting the media elements according to one or a combination of predefined metadata fields.

[0015] According to at least one embodiment, a focused individual media element is linked only to those media elements existing in the media repository that share attributes defined by relevant metadata. Relevant metadata may include public metadata, similar metadata, or metadata within a defined range of values. In some embodiments, a focused individual media element is linked only to those media elements existing in the media repository that share attributes defined by one or a combination of predefined metadata fields corresponding to the sorting scheme of the current application.

[0016] Predefined metadata fields may include one or more of the following: timecode, camera or camera type of the captured media, date, time, clip name, scene, shot, clip color, modification date, import date; and / or repository.

[0017] In some embodiments, a single focused media element is linked only to those media elements that exist in the media repository, and those media elements share relevant metadata with the selected media elements displayed in the viewing window.

[0018] In some embodiments, the linker element and focus element include different modes of operation for a context-sensitive user interface element. In at least one example, the context-sensitive user interface element operates as a linker element in a first background and as a focus element in a second background. The second background can be generated once a single media element has been formed by linking media elements existing in the media repository.

[0019] In some embodiments, background-sensitive user interface elements can also operate as reversion elements in a third background. The reversion element operates by reversing the operation of the focus element to recreate a single media element, which is a link to all media elements existing in the media repository, and loads that single media element into the viewing window.

[0020] In any of the above embodiments, the display of media elements in the media bin that do not form part of a single focused media element may be hidden or weakened (e.g., by graying out, darkening, fading, recoloring, blurring, etc.).

[0021] In any of the above embodiments, the display of those media elements that form a portion of a focused individual media element can be emphasized in the media bin display.

[0022] According to at least one embodiment, the playback speed of a single media element is changed by referencing an attribute of the media element, which includes the individual media element. For example, the attribute could be the duration of the single media element. According to this embodiment, the playback speed of media elements with a duration exceeding a threshold can be increased.

[0023] Preferably, in response to user input, the instruction inserts a selected portion of one, or more, media elements into the timeline. The inserted media element typically corresponds to the portion of a single media element currently being viewed within its view window.

[0024] The graphical user interface may also include defined objects configured to respond to user input:

[0025] Define the start and end points for the media element being viewed in the current viewing window;

[0026] Create media elements from defined start and end points; and

[0027] Insert the created media element into the timeline.

[0028] According to another aspect of this disclosure, a method for providing a graphical user interface for a video editing system is provided, the method comprising:

[0029] Displaying a graphical user interface, which includes:

[0030] The media pod displays multiple media elements that have been imported into the video editing system;

[0031] The view window is used to view the selected media element;

[0032] Timeline;

[0033] Connector element; and

[0034] Focus element;

[0035] In response to the user launching the linker element, link all media elements in the media repository together into a single media element, and load the single media element into the view window; and

[0036] In response to the user activating the focused element, the individual media element is modified to form a focused individual media element that links only those media elements that exist in the media repository and have relevant metadata, and the focused individual media element is loaded into the viewing window.

[0037] When initiated, the linker element links all media elements present in the media bin into a single media element. That is, if the media element in the media bin is a video clip (which may or may not include an audio track), the link will include the entire length of the video clip in a single media clip. If the media element is a still image, it can be linked into a single media element as a single frame or as a sequence of multiple frames lasting a predetermined duration or a user-selectable duration.

[0038] According to at least one embodiment, the user interface further includes a sorting element, and the method includes: in response to a user activating the sorting element, displaying media elements in a media repository according to a predetermined sorting scheme. In at least one embodiment, the predetermined sorting scheme is user-defined or user-selected. The predetermined sorting scheme may include sorting the media elements according to one or a combination of predefined metadata fields.

[0039] According to at least one embodiment, the method includes: when a focused element is initiated, linking only those media elements existing in the media repository that share attributes defined by relevant metadata. Relevant metadata may include public metadata, similar metadata, or metadata within a defined range of values. In some embodiments, the focused single media element links only those media elements existing in the media repository that share attributes defined by one or a combination of predefined metadata fields corresponding to the sorting scheme of the current application.

[0040] Predefined metadata fields may include one or more of the following: timecode, camera or camera type of the media being shot, date, time, clip name, scene, shot, clip color, modification date, import date, and / or repository.

[0041] In some embodiments, a single focused media element is linked only to those media elements that exist in the media repository: those media elements share relevant metadata with the selected one of the media elements displayed in the viewing window.

[0042] In some embodiments, the linker element and focus element include different modes of operation for the background-sensitive user interface element. In one example, the background-sensitive user interface element operates as a linker element in a first background and as a focus element in a second background. The second background can be generated once a single media element has been formed by linking media elements existing in the media repository.

[0043] In some embodiments, background-sensitive user interface elements can also operate as reversed elements in a third background. Reversing element operations reverses the operation of the focused element to re-form a single media element, which is a link between all media elements existing in the media bin, and loads this single media element into the viewing window.

[0044] In any of the above embodiments, the method may include: weakening or hiding the display of media elements that do not form a focused single media element in the media bin.

[0045] In any of the above embodiments, the method may include: highlighting those media elements that form portions of a focused single media element in a media bin.

[0046] According to at least one embodiment, the playback speed of a single media element is changed by referencing attributes of the media element, which includes that single media element. This could be the duration of the single media element. Furthermore, the playback speed of media elements with durations exceeding a threshold can be increased.

[0047] In some embodiments, the method includes: in response to user input, inserting one of the media elements into the timeline. The inserted media element may be a media element corresponding to the portion of a single media element currently being viewed in the currently viewed window.

[0048] The graphical user interface may also include defined objects configured to respond to user input:

[0049] Define the start and end points for the media element being viewed in the viewing window, where the media element is a single media element or a focused single media element, and where the start and end points can be different media elements existing in the media repository;

[0050] Create media elements from the defined start and end points, the media elements including all media between the defined start and end points; and

[0051] Insert the created media element into the timeline.

[0052] According to another aspect of this disclosure, a method includes displaying a graphical user interface for a video editing system, the method comprising:

[0053] Displays a media repository including multiple media elements; and

[0054] The view window displays the links to the first multiple media elements; and then...

[0055] In response to a user action that initiates the focus function, a link to a second set of media elements is displayed in the viewing window. The second set of media elements includes only those media elements that exist in the media repository and have relevant metadata.

[0056] In some embodiments, the method further includes: in response to a user action that initiates a focus function, displaying only multiple elements of a second media in the media bin.

[0057] According to another aspect of this disclosure, a method includes displaying a graphical user interface for a video editing system, the method comprising:

[0058] Display sorted elements;

[0059] In response to the user initiating the sorting of elements, display media elements sorted according to a predefined sorting scheme; and

[0060] In response to a user action, a single focused media element is displayed, which is linked to related media elements through a sorting scheme.

[0061] In some embodiments, the predetermined sorting scheme is based on certain metadata of the media elements (e.g., any metadata described herein). Focused individual media elements may be linked based on media elements sharing certain metadata attributes.

[0062] As used herein, unless the context otherwise requires, the term “comprise” and its variations such as “comprising”, “comprises”, and “included” are not intended to exclude further additions, components, integers, or steps. Attached Figure Description

[0063] Further embodiments of other aspects of this disclosure and those described in the preceding paragraphs will become apparent from the following description by way of example and with reference to the accompanying drawings, wherein:

[0064] Figure 1 This is an illustration of a first view of a user interface according to one embodiment;

[0065] Figure 2 This is an illustration of a first view of a second user interface according to one embodiment;

[0066] Figure 3 This is an illustration of a second view of a second user interface according to one embodiment;

[0067] Figure 4 This is an illustration of sorting elements in a second user interface according to one embodiment;

[0068] Figure 5 This is an illustration of a third view of a second user interface according to one embodiment;

[0069] Figure 5b It is based on Figure 5 Illustrations of corresponding views of user interfaces of variant embodiments of the example;

[0070] Figure 6 This is an illustration of a fourth view of a second user interface according to one embodiment; and

[0071] Figure 7 This is a schematic diagram of a hardware environment suitable for implementing a graphical user interface according to one embodiment of the present disclosure.

[0072] Figures 8 to 10 The diagram illustrates a flowchart of an example method for providing a graphical user interface for a video editing system. Detailed Implementation

[0073] Figure 1The image illustrates a user interface 100 for a video editing software application. The video editing software allows the creation of projects from constituent media elements, which are imported into the application and displayed in a media repository area 101, as described, for example, in the applicant's co-pending international patent application PCT / AU2020 / 050322, the contents of which are incorporated herein by reference. In the illustrated embodiment, a single repository of media elements is present, designated "master"; however, those skilled in the art will recognize that any number of media repositories can be created and media elements placed within them to provide a framework for organizing projects.

[0074] In the illustrated embodiment, the user has imported twelve constituent media elements into the project. Figure 1 Six of them are shown in the image. The remaining media elements can be viewed by scrolling the scroll bar located to the right of the media bin area 101. The six visual components include audio track 102A and five audiovisual clips 102B to 102F (i.e., video clips, each with its own recorded audio track). As experienced users will understand, video editing software applications also store and manage metadata for each component media element and for the entire project.

[0075] The user interface 100 also includes a viewer window 110 for viewing selected video or audiovisual segments, a first timeline 120, and a second timeline 140 parallel to and above the first timeline 120. The operation of the two timelines is described in the applicant's co-pending international patent application PCT / AU2020 / 050320, the contents of which are incorporated herein by reference.

[0076] Timelines 120 and 140 allow users to create projects by inserting constituent media elements into the timeline and performing editing and arrangement operations. At this point, individual source media elements 102B through 102F can be dragged from the media bin area 101 or the viewer window 110, or otherwise inserted into one of the timelines 120 or 140. Once in the timeline, the constituent media elements can be edited and arranged appropriately.

[0077] The user interface 100 is simplified by displaying only a subset of commonly used user interface elements, which are shown in DaVinci. On the “Cut” page. For example, the user interface 100 does not include a separate viewer window for viewing video clips and audiovisual clips in the media repository area 101. The simplified user interface displays the core tools required for certain projects, such as those for importing media, editing, trimming, adding transitions and titles, automatically matching colors, and mixing audio.

[0078] Although only six constituent media elements are illustrated, it is not uncommon for dozens or even hundreds of constituent media elements to be imported for potential use in a project. This can make it difficult to locate the desired segment from within all the files existing in the media repository area 101.

[0079] To address this issue, the user interface 100 also includes a connector object, which... Figure 1 In the example, this is represented by button 150. Button 150 can be appropriately activated by the user, typically with a single action (e.g., by clicking with a mouse or other pointing device, performing a suitable gesture on a touchscreen, or by entering a keyboard shortcut linked to the button). In response to activating the connector object, user interface 100 links each of the media elements present in media bin area 101 into a single media element and loads the created single media element into viewer window 110. User interface 100 displays the total number of media elements included in the single media element (12 in this example) and the name of the media bin containing the media element currently being viewed in viewer window 110 ("Master" in this example). In the specific example shown, the display of the total number of media elements and the name of the media bin is combined into a single display item, in this example, "12 clips – Master" displayed in the title of viewer window 110. The total length of the single media element is also displayed in user interface 100. In the illustrated embodiment, the number of elements, media bin identifier, and length are displayed in the area above the viewer window; however, this data can be easily displayed in other locations on the user interface 100.

[0080] When multiple repositories are created and displayed in media repository area 101, a linking action can be performed to generate a single media element from media elements existing in a selected repositories or from the contents of multiple repositories. In a preferred form, activation of linker element 150 causes each of the media elements (selected or all) in one or more media repositories 101 to be linked as a single media element.

[0081] The graphical display object 160 is located below the viewer window 110. In the illustrated embodiment, the entire single media element is depicted in the graphical display object 160, which includes an audio waveform. In this depiction, the user can easily identify specific segments, for example, by examining the trough regions of the audio waveform, which indicate segments with low or zero volume.

[0082] The graphic display object 160 is shown as bars representing the connections between its constituent elements. The boundaries between the constituent media elements are indicated in the graphic display object 160 by vertical lines of a contrasting color (e.g., white).

[0083] Other depictions of individual media elements within the graphic display object 160 can also be used, such as schematically illustrating the composition of media elements using simple geometric shapes (e.g., rectangles). The composition of media elements can be distinguished within the graphic display object 160, for example, by using different colors for the schematic representation.

[0084] Having a single media element included among all media elements present in the media compartment area allows the user (if needed, at high speed) to erase via a single media element and easily locate the desired constituent media element. High-speed erasure can be performed by manipulating the playhead 123 located in the graphics display object 160. This can be used in... Figure 1 In the illustrated embodiment, the viewer window control 170, located below the graphics display object 160, performs other operations (including high-speed erasing).

[0085] Once located, the required media element can be easily inserted into one of timelines 120 and 140, for example, by dragging and dropping from viewer window 110 or from graphics display object 160. User interface 100 is configured to insert only the media element currently being viewed in viewer window 110 into the timeline, rather than inserting the entire single media element.

[0086] The order of the constituent media elements within a single created media element corresponds to the order of the constituent media elements in the initial media repository. However, the order of the individual source media elements within a single created media element can also be user-defined and does not need to follow the order of media elements in the media repository.

[0087] Graphical display object 160 is configured to receive user input (such as keyboard input, mouse clicks, or touchscreen display contact) and, in response, define a start and / or end point within a single media element while it is being played in viewer window 110. Any new segment defined in this way (i.e., by defining a start point and a corresponding end point) is automatically loaded into one or both of timelines 120 and 140. Multiple start and / or end points can be defined in graphical display object 160 to add multiple segments defined by start-end point pairs to timelines 120 and 140. By linking all constituent media objects into a single media element and allowing multiple segments to be defined thus, the user workflow is improved because it eliminates the need to load individual segments into the timeline.

[0088] Once multiple segments exist in timelines 120 and 140, their boundaries can be edited appropriately—for example, by trimming and / or extending. This feature allows the creation of segments with approximate boundaries using graphical display object 160, which can then be refined using the timeline's editing tools.

[0089] Linking multiple media elements into a single media element effectively removes the start and end points that are inherently defined for each element before the linking operation. This creates the possibility of creating new media elements that contain content from more than one of the initial source media elements (that is, by defining the start and end points within the single media element being created). Transition effects can then be easily inserted between the newly created media elements.

[0090] Figures 2 to 6 Another embodiment of a user interface 200 for a video editing software application (such as a non-linear editor) is illustrated. Figure 2 and Figure 6 The embodiments are similar to Figure 1 The embodiments, and Figure 1 The common elements in the attached figures with reference numerals between 100 and 170 have been numbered using numbers ranging from 200 to 270, making... Figure 1 Elements with reference numeral 1XX in the attached figures will be Figures 2 to 6 The reference numerals 2XX are used to denote these elements—unless otherwise stated, these corresponding elements have the same function in each embodiment.

[0091] Turning Figure 2 The video editing software allows projects to be created from constituent media elements, which are imported into the video editing software application and displayed in the media repository area 201. In the illustrated embodiment, there is a single repository for the media elements, which is named "master"; however, those skilled in the art will recognize that any number of media repositories can be created and media elements placed within them to provide a framework for organizing projects.

[0092] In the illustrated embodiment, the user has imported 90 media elements into the project, 19 of which are... Figure 1 As shown in the diagram. The remaining media elements can be viewed by manipulating the scroll bar 231 located to the right of the media bay area 201. These 19 visible media elements include seven audiovisual segments 202A.1 to 202A.7 represented by icons in the first row, five audiovisual segments 202B.1 to 202B.5 represented by icons in the second row, audiovisual segment 202C represented by icons in the third row, and six audiovisual segments 202D.1 to 202D.6 represented by icons in the fourth row. As experienced users will understand, the video editing software application also stores and manages metadata for each component element and for the entire project. Figure 3 A second view of the interface is shown, in which media elements are visible as clips or film strips. Other views of the clips (e.g., as lists, folders) are also possible.

[0093] The user interface 200 also includes a viewer window 210 for viewing selected video or audiovisual segments, a first timeline 220, and a second timeline 240 parallel to and above the first timeline 220. The operation of the two timelines is described in the applicant's co-pending PCT patent application PCT / AU2020 / 050320, the contents of which are incorporated herein by reference.

[0094] Timelines 220 and 240 allow users to create projects by inserting constituent media elements into either timeline and performing editing and arrangement operations. Inserting a media element into either timeline 220 or 240 causes the same media element to appear in the corresponding position in the other timeline. At this point, individual source media elements 202A.1…202A.4 (or any additional media elements existing in the media bin but not visible in the current view) can be dragged from the media bin area 201 or the viewer window 210, or otherwise inserted into one of timelines 220 or 240. Once in the timeline, the constituent media elements can be edited and arranged appropriately.

[0095] Simplify the user interface by displaying only a subset of commonly used user interface elements 200: These commonly used user interface elements are displayed in DaVinci On the “Cut” page. For example, user interface 200 does not include a separate viewer window for viewing video clips and audiovisual clips in media repository area 201. The simplified user interface displays the core tools needed for certain projects, such as for importing media, editing, trimming, adding transitions and titles, automatically matching colors, and mixing audio.

[0096] Although Figure 2 The example only illustrates 19 constituent media elements, but this example loads 90 segments in the repository. However, it is not uncommon to import hundreds of constituent media elements that may be used in a project. This can lead to difficulties in locating and managing one or more desired segments from within all the files existing in the media repository area 201, even when using methods such as combining... Figure 1 The same applies to the described connector elements. Therefore, this embodiment provides an enhanced mechanism for locating and managing media.

[0097] This user interface 200 also includes a connector object, which in Figure 2In the example, it takes the form of button 250. Button 250 can be appropriately activated by the user, typically with a single action (e.g., by clicking with a mouse or other pointing device, performing a suitable gesture on a touchscreen, or by entering a keyboard shortcut linked to the button). In response to activating the connector object, user interface 200 links each of the media elements present in media bin area 201 into a single media element and loads the created media element into viewer window 210. User interface 200 displays the total number (232) of media elements included in the single media element (234) and the name (233) of the media bin containing the media element currently being viewed in viewer window 210 (in this example, "main"). The total length (234) of the single media element is also displayed in user interface 200. In the illustrated embodiment, the media element count (232), media bin name or media bin identifier (233), and length of a single media element (234) formed by links are displayed in an area above the viewer window; however, this data can be easily displayed in other locations on the user interface 200.

[0098] When multiple repositories are created and displayed in the media repository area 201, a linking action can be performed to generate a single media element from a selected media element existing in a repository or from the contents of multiple repositories.

[0099] like Figure 1 As shown, the graphical display object 260 is located below the viewer window 210. In the illustrated embodiment, the entire single media element is depicted in the graphical display object 260, which includes an audio waveform. In this depiction, the user can easily identify specific segments, for example, by examining the trough regions of the audio waveform, which indicate segments with low or zero volume. The time boundaries (i.e., edges) that make up the media element are indicated in the graphical display object 260 by vertical lines (e.g., 262 and 264) of a contrasting color (e.g., white) to help the user determine the length of the media element relative to the length of the entire single media object.

[0100] Alternatively, other descriptions of individual media elements can be used, such as schematically illustrating the constituent media elements using simple geometric shapes (e.g., rectangles). For example, the constituent media elements in the graphic display object 260 can be distinguished by using different colors for the schematic diagram.

[0101] Having a single media element included among all media elements present in the media bay area allows users to erase individual media elements (at high speed if needed) and easily locate the desired constituent media elements. High-speed erasure can be performed by manipulating the playhead 223 located in the graphics display object 260. Other operations (including high-speed erasure) can be performed using the viewer window control 270 located below the graphics display object 260.

[0102] The order of the constituent media elements within a single created media element corresponds to the order of the constituent media elements in the initial media repository. However, the order of the individual source media elements within a single created media element can also be user-defined and does not need to follow the order of elements within the media repository. In this embodiment, media elements 202A.1 to 202D.6 are displayed in media repository 201 in order of import date. Media elements are arranged in groups according to import date. To set this order, the user interface according to this embodiment includes a sorting element 252. When activated, sorting element 252 causes the media elements in media repository 201 to be displayed sequentially according to a predetermined sorting scheme. The sorting scheme can be user-defined or user-selected. Figure 4 The illustration shows an example sorting element. The sorting element 252 is activated by selecting an interface button and then choosing the sorting scheme to use. The sorting scheme can include sorting the media elements based on one or a combination of predefined metadata fields. Figure 4 List 254 of the sorting schemes illustrates a list of possible metadata fields. Once a sorting scheme is selected, the order of the media elements in the repository is displayed in the new sorting order. The repository display can also group media elements according to the appropriate metadata of the sorting scheme. In this respect, Figure 5 The illustration shows that Figure 2 and Figure 3 The illustrated embodiment shows media elements ordered by scene name. The first group of media elements 202D.4, 202D.5, and 202D.6 are grouped into "Scene 3" 256 because they share metadata reflecting their association with that scene. The second group of media elements 202C, 202D.1, 202D.2, and 202D.3 are grouped into "Scene 2" 258 because they share metadata reflecting their association with that scene. The third group of media elements 202A.1 is grouped into "Scene 1" 259 because they share metadata reflecting their association with that scene.

[0103] It will be understood that media elements can be stored as data or file formats containing a series of different metadata fields, and any one or more metadata fields can be used to sort the media elements. Grouping in the display can be performed based on matching metadata in one or more fields set by the sorting scheme, or metadata falling within the value range of one or more metadata fields set by the sorting scheme. Convenient metadata fields may include one or more of the following: timecode, camera or camera type used to capture the media, date, time, clip name, scene, shot, clip color, modification date, import date, and / or repository.

[0104] Return to Figure 5 It can be seen that the media elements in Media Warehouse 201 are related to... Figure 2 and Figure 3 The media elements can be grouped in different ways. This allows users to view groups of media elements that they deem most useful for their editing workflow and tasks. However, this can still be challenging when working with large numbers of media elements.

[0105] In this embodiment, the user interface 200 also includes a focus element that can be used to reduce the current set of media elements used by the user at any given time, which can simplify and speed up the operation. The focus element is used to reduce the number of elements in a group of media elements that form a single media element. In this embodiment, this only involves linking those media elements in the media repository that share certain metadata attributes into a modified single media element, which can be displayed as described above.

[0106] Grouping of segments can be defined based on the segments currently displayed in viewer window 210 and their associated metadata. For example, all media elements with metadata associated with the currently displayed media element can be included in a focused single media element. Associated metadata can include common metadata, similar metadata, or metadata within a defined range of values. In some embodiments, a focused single media element links only those elements present in the media repository that are grouped together by the currently valid sorting scheme.

[0107] Therefore, in Figure 5 In the viewer window 210, media element 202D.2 is actively displayed (this can be seen through the clear outline 237 of the interface around the icon of media element 202D.2 in media bin 201). When the user activates the focused element (button) 250, the individual media element is modified, and the user interface transitions to... Figure 6 The view.

[0108] In other examples, the linker element and the focus element are different. For example, button 250 can be a dedicated linker element, and another button can be used as the focus element. Figure 5b An illustration of this user interface 200 is provided. Figure 5b User interface and Figure 5 The only difference between the embodiments is that Figure 5b The user interface 200 includes a dedicated focus element in the form of a button 251. All other elements, such as... Figure 5 The elements like and with Figure 5 The elements share reference numerals. The focus element, button 251, can be appropriately activated by the user typically with a single action (e.g., by clicking with a mouse or other pointing device, performing a suitable gesture on a touchscreen, or by entering a keyboard shortcut linked to the button). When the focus element 251 is activated, a single media element is modified, such as regarding... Figure 5 The operation of the focused element in the text indicates that the user interface is transitioning to... Figure 6 The view. Figure 6 User interface (and) Figures 2 to 4 It can also be adapted to include dedicated focus elements, such as those based on... Figure 5b A dedicated focus element.

[0109] As from Figure 6 As can be seen, the modified single media element (graphic display object) illustrated in Figure 260 consists of only four segments. Furthermore, in Figure 6 In the illustrated embodiment, media repository 201 is modified. Specifically, the only segments that remain visible in media repository 201 are the four segments included in the modified single media element illustrated at 260. In this example, the four remaining segments share the "Scene 2" metadata with segment 202D.2. A new, modified single media element, referred to as the focused single media element, can be used as described above.

[0110] exist Figure 5 In the example, the linker element and focus element are activated using the same visual element button 250 on the user interface. The button 250 operates in a background-sensitive manner, wherein the button operates as a linker element in a first background (in this example, when the "Source Tape" pod mode is not activated—i.e., no single media element is active) and as a focus element in a second background (in this example, when the "Source Tape" mode is activated—i.e., a single media element is active).

[0111] The user interface 200 in any of the above embodiments may include a reversal element, whereby if the focused single media element is active, in response to the user activating the reversal element, the single media element again includes all media elements present in the media bin and loads that single media element into the viewing window. That is, activating the reversal element cancels the action of the focused element and returns the interface to a first background, wherein the single media element includes all media elements in the active bin (e.g., Figure 2 and Figure 3 (State). The reversed element can be a physical button or a GUI-defined button. Conveniently, this could be the "Escape" key on the keyboard. It can also include further operation modes for background-sensitive user interface elements (such as button 250).

[0112] In embodiments that include dedicated focus elements (e.g., refer to...) Figure 5b In the described embodiment, either or both of the focus element 251 or the connector element 250 can be used as a reverse element in a background in which the single focused media element is active.

[0113] Such as combination Figure 1 As described, once located within a single media element or a focused single media element, the desired media element can be easily inserted into one of the timelines 220 and 240, for example, by dragging and dropping from the viewer window 210 or from the graphics display object 260. The user interface 200 is configured to insert only the individual media elements currently being viewed in the viewer window 210 into the timeline, rather than inserting the entire single media element or the entire focused single media element.

[0114] The graphics display object 260 is configured to receive user input (such as keyboard input, mouse clicks, or touchscreen display contact) and, in response, define the start and / or end points within a single media element or a focused single media element while it is being played in the viewer window 210. Any new segments defined in this way (i.e., by defining start and corresponding end points) are automatically loaded into one or both of timelines 220 and 240. Multiple start and / or end points can be defined in the graphics display object 260 to add multiple segments defined by start and end point pairs to timelines 220 and 240. Once multiple segments exist in timelines 220 and 240, their boundaries can be edited appropriately (e.g., by trimming and / or extending). This feature allows the graphics display object 260 to be used to create segments with approximate boundaries, which can then be refined using the timeline's editing tools.

[0115] User workflows can be improved by linking all constituent media objects into a single media element and by focusing that single media element on a subset of media elements that share common attributes (such as those defined by metadata). In addition to avoiding the need to load individual segments into the timeline, users can selectively reduce the number of segments visible simultaneously, helping them navigate the large number of segments that can exist within a complex project.

[0116] Linking multiple media elements into a single media element effectively removes the inherent start and end points defined for each element before the linking operation. This creates the possibility of creating (i.e., defining start and end points within the created single media element) new media elements (containing content from more than one initial source media element). Transition effects can then be easily inserted between the newly created media elements.

[0117] Embodiments of this disclosure also relate to a favorable playback method performed on a single media element created. According to this method, the playback speed of the single media element is varied by referencing attributes of the individual source media elements that include the single media element. This method is implemented by retaining information relating to the attributes (e.g., duration) of those elements after the source media elements have been linked into a single media element. The retained attribute information is then used to control the playback of the single media element.

[0118] An example of a playback method involves playing source media elements with a duration below a threshold at their normal speed, and source media elements with a duration above the threshold at an increased speed. Regardless of the required duration of the source media elements, the increased playback speed can be the same, or the increased playback speed can vary depending on the individual durations of those source media elements.

[0119] This disclosure can be used to define other playback control methods. For example, source media elements with a duration less than a threshold can be ignored and the playback speed of the remaining elements can be changed. In other examples, the playback speed of the created media object at a given point can be determined by a function of the length of the source media element corresponding to that given point.

[0120] Figure 7 A block diagram is provided illustrating an example of a computer system 1000 on which embodiments of the present disclosure may be implemented. The computer system 1000 includes a bus 1002 or other communication mechanism for transmitting information, and a hardware processor 1004 coupled to the bus 1002 for processing information. The hardware processor 1004 may be, for example, a general-purpose microprocessor, a graphics processing unit, other types of processing units, or a combination thereof.

[0121] Computer system 1000 also includes main memory 1006, such as random access memory (RAM) or other dynamic storage devices, connected to bus 1002 for storing information and instructions to be executed by processor 1004. Main memory 1006 can also be used to store temporary variables or other intermediate information during the execution of instructions to be executed by processor 1004. When stored in a non-transitory storage medium accessible to processor 1004, these instructions cause computer system 1000 to become a special-purpose machine customized and configured to perform the operations specified in the instructions.

[0122] The computer system 1000 may also include a read-only memory (ROM) 1008 or other static storage device connected to the bus 1002 for storing instructions and static information for the processor 1004. A storage device 1010 (such as a disk or optical disk) may be provided and connected to the bus 1002 for storing information and instructions including the aforementioned video editing software application.

[0123] Computer system 1000 can be connected to display 1012 (such as LCD, LED, touch screen display, or other display) via bus 1002 for displaying information to computer users, such as the graphical user interface described and illustrated above. Input device 1014, including alphanumeric and other keys, can be connected to bus 1002 to transmit information and command selections to processor 1004. Another type of user input device is cursor control 1016, such as a mouse, trackball, or arrow keys, used to transmit directional information and command selections to processor 1004 and to control cursor movement on display 1012.

[0124] According to at least one embodiment, the techniques described herein are executed by computer system 1000 in response to processor 1004 executing one or more sequences of one or more instructions contained in main memory 1006. These instructions may be read into main memory 1006 from another storage medium, such as a remote database. Execution of the sequence of instructions contained in main memory 1006 causes processor 1004 to perform the processing steps described herein. In alternative embodiments, hardwired circuitry may be used in place of or in combination with software instructions.

[0125] As used herein, the term "storage medium" or "storage medium" refers to any non-transitory medium that stores data and / or instructions that enable a machine to operate in a particular manner. These storage media can include non-volatile media and / or volatile media. Non-volatile media include, for example, optical discs or magnetic disks, such as storage device 1010. Volatile media include dynamic memory, such as main memory 1006. Common forms of storage media include, for example, floppy disks, flexible disks, hard disks, solid-state drives, magnetic tape or any other magnetic data storage media, CD-ROMs, any other optical data storage media, any physical medium with a perforated pattern, RAM, PROMs and EPROMs, FLASH-EPROMs, NVRAMs, any other memory chips, or magnetic tape cassettes.

[0126] Computer system 1000 may also include a communication interface 1018 connected to bus 1002. Communication interface 1018 provides bidirectional data communication to network link 1020, which is connected to communication network 1050. For example, communication interface 1018 may be an Integrated Services Digital Network (ISDN) card, a cable modem, a satellite modem, etc. As another example, communication interface 1018 may be a Local Area Network (LAN) card to provide data communication connectivity to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface 1018 transmits and receives electrical, electromagnetic, or optical signals carrying digital data streams representing various types of information.

[0127] Figure 8 The diagram illustrates a graphical user interface (GUI) for providing a video editing system (e.g., reference). Figures 2 to 6 A flowchart of method 800 (described by a graphical user interface). In some embodiments, method 800 is implemented based on instructions in a non-transitory computer-readable medium (e.g., ROM 1008).

[0128] In step 801, method 800 includes: displaying a graphical user interface including media elements. In some embodiments, step 801 includes displaying a media bay that displays a plurality of media elements imported into the video editing system. In some embodiments, step 801 includes displaying a viewing window for viewing a selected media element among the media elements. In some embodiments, step 801 includes displaying a timeline. In some embodiments, step 801 includes displaying a connector element. In some embodiments, step 801 includes displaying a focus element.

[0129] In step 802, method 800 includes: in response to a user initiating a linker element, linking media elements present in the media repository together into a single media element and loading the single media element into a viewing window.

[0130] In step 803, method 800 includes: in response to a user activating a focused element, modifying a single media element to form a focused single media element that links only those media elements with relevant metadata existing in the media repository, and loading the focused single media element into a viewing window.

[0131] In some embodiments, step 803 includes: when a focused element is activated, linking only those media elements that exist in the media repository and share attributes defined by relevant metadata. In some embodiments, relevant metadata includes public metadata, similar metadata, or metadata within a defined range of values.

[0132] In some embodiments, a focused single media element is linked only to those media elements present in the media repository that share attributes defined by one or a combination of predefined metadata fields corresponding to the current application's sorting scheme (e.g., see About Figure 9 (The method described).

[0133] In some embodiments, the metadata is selected from: timecode, camera or camera type of the captured media, date, time, clip name, scene, shot, clip color, modification date, import date, and / or repository.

[0134] In some embodiments, the linker element and focus element include different modes of operation for a background-sensitive user interface element, such as the background-sensitive user interface element operating as a linker element in a first background and as a focus element in a second background. Method 800 may include entering the second background once a single media element has been formed by linking media elements existing in the media bin. The background-sensitive user interface element may operate as a reverse element in a third background, wherein the reverse element reverses the operation of the focus element to form a single media element again, which links all media elements existing in the media bin together into a single media element and loads the single media element into the viewing window.

[0135] Figure 9 The diagram illustrates a graphical user interface (GUI) for providing a video editing system (e.g., reference). Figures 2 to 6 A flowchart of method 900 (described by a graphical user interface). In some embodiments, method 900 is performed in conjunction with method 800. In some embodiments, method 900 is implemented based on instructions in a non-computer-readable medium (e.g., ROM 1008).

[0136] In step 901, method 900 includes displaying a graphical user interface including media elements. Step 901 may include displaying sorting elements, such as those described with respect to step 801. Step 901 may include displaying one or more other elements, such as those described in step 801. In step 902, the method includes: in response to a user initiating sorting elements, displaying media elements that can be sorted in a media repository according to a predetermined sorting scheme.

[0137] In some embodiments, the predetermined sorting scheme is user-defined or user-selected. In some embodiments, the predetermined sorting scheme includes sorting media elements according to one or a combination of predefined metadata fields.

[0138] In step 903, the method includes: in response to a user action, such as displaying a focused single media element that is linked to related media elements by a sorting scheme by sharing metadata attributes used for sorting. In some embodiments, step 903 is part of step 803 in method 800.

[0139] Figure 10 The diagram illustrates a graphical user interface (GUI) for providing a video editing system (e.g., reference). Figures 2 to 6 A flowchart of method 1100 (described by a graphical user interface). In some embodiments, method 1100 is performed in conjunction with method 800 or method 900. In some embodiments, method 1100 is implemented based on instructions in a non-transitory computer-readable medium (e.g., ROM 1008).

[0140] In step 1101, method 1100 includes displaying a graphical user interface including media elements. Step 1101 includes displaying a viewing window for viewing a selected media element and displaying a timeline. Step 1101 may include displaying one or more other elements, such as those described in steps 801 and / or 901.

[0141] In step 1102, method 1100 includes: in response to user input, inserting one of the media elements into the timeline. The media element inserted into the timeline is the media element corresponding to the portion of a single media element or a focused single media element (see above) currently being viewed in the viewing window.

[0142] It will be understood that the invention disclosed and defined in this specification extends to all alternative combinations of two or more features mentioned or apparent from the text or drawings. All these different combinations constitute various alternative aspects of this disclosure.

[0143] Based on the detailed description above, these and other changes can be made to the embodiments. Generally, the terminology used in the following claims should not be construed as limiting the claims to the specific embodiments disclosed in the specification and claims, but should be interpreted to include all possible embodiments and the full scope of equivalents claimed by those claims. Therefore, the claims are not limited to the contents of this disclosure.

Claims

1. A non-transitory computer-readable medium comprising stored instructions, which, when executed by a processor, cause the processor to: A graphical user interface is displayed for the video editing system, the graphical user interface including: The media repository displays multiple media elements imported into the video editing system. A view window is used to view one of the plurality of media elements that has been selected. Timeline Connector element, and Focus element; Receive user input to initiate the connector element, and In response to user input that initiates the linker element; link the media elements existing in the media repository together into a single media element and load the single media element into the viewing window; Receive user input to activate the focused element; as well as In response to user input activating the focused element, the individual media element is modified to form a focused individual media element, which links only those media elements existing in the media repository that have relevant metadata, and the focused individual media element is loaded into the viewing window. The linker element and the focus element include different modes of operation for background-sensitive user interface elements, and The background-sensitive user interface element operates as the linker element in the first background and as the focus element in the second background.

2. The non-transitory computer-readable medium according to claim 1, wherein, The graphical user interface also includes sorting elements, and when the instructions are executed by the processor, the processor: Receive user input to initiate the sorting of elements, and In response to user input that initiates the sorting of elements, media elements in the media repository are displayed according to a predetermined sorting scheme.

3. The non-transitory computer-readable medium according to claim 2, wherein, The predetermined sorting scheme includes sorting the media elements based on one or a combination of predefined metadata fields.

4. The non-transitory computer-readable medium according to claim 1, wherein, The focused individual media element includes only links to those media elements that exist in the media repository and share attributes defined by the relevant metadata.

5. The non-transitory computer-readable medium according to claim 1, wherein, The focused individual media element includes only links to those media elements that share attributes in the media repository, which are defined by one or a combination of predefined metadata fields corresponding to the current application's sorting scheme.

6. The non-transitory computer-readable medium according to claim 1, wherein, The focused individual media element includes only links to those media elements that exist in the media repository and share relevant metadata with the selected media element displayed in the viewing window.

7. A method for providing a graphical user interface for a video editing system, the method comprising: The graphical user interface (GUI) is displayed, including: a media bay that displays multiple media elements imported into the video editing system, a viewing window for viewing one of the multiple media elements, a timeline, a connector element, and a focus element. Receive user input to initiate the connector element; In response to user input that initiates the linker element, media elements existing in the media repository are linked together into a single media element, and the single media element is loaded into the viewing window; Receive user input to activate the focused element; and In response to user input activating the focused element, the individual media element is modified to form a focused individual media element, which links only those media elements with relevant metadata existing in the media repository, and the focused individual media element is loaded into the viewing window. The linker element and the focus element include different modes of operation for background-sensitive user interface elements, and The background-sensitive user interface element operates as the connector element in a first background and as the focus element in a second background.

8. The method according to claim 7, wherein, The graphical user interface also includes a sorting element, and the method further includes: Receive user input to initiate the sorting of elements; and In response to user input that initiates the sorting of the elements, media elements sorted according to a predetermined sorting scheme are displayed in the media bin.

9. The method according to claim 8, wherein, The predetermined sorting scheme includes sorting the media elements based on one or a combination of predefined metadata fields.

10. The method according to claim 7, further comprising: When the focus element is activated, only those media elements that exist in the media repository and share attributes defined by the relevant metadata are linked.

11. The method according to claim 7, wherein, The focused individual media element includes only links to those media elements that exist in the media repository and share attributes defined by one of the predefined metadata fields corresponding to the current application's sorting scheme or by a combination of predefined metadata fields corresponding to the current application's sorting scheme.

12. The method according to claim 7, wherein, The focused individual media element includes only links to those media elements that exist in the media repository and share relevant metadata with the selected media element displayed in the viewing window.

13. A computer system including a processor and a nontransitory storage medium, said nontransitory storage medium storing one or more sequences of instructions accessible by said processor, wherein, When one or more instructions are executed by the processor, the computer system: Displaying a graphical user interface on a monitor, the graphical user interface comprising: The media bin displays multiple media elements imported into the video editing system; a viewing window is used to view one of the multiple media elements; a timeline; a connector element; and a focus element; Receive user input to initiate the connector element; In response to receiving user input that initiates the linker element, the media elements existing in the media repository are linked together into a single media element and the single media element is loaded into the viewing window; Receive user input to activate the focused element; and In response to receiving user input to initiate the focused element, the individual media element is modified to form a focused individual media element, which links only those media elements existing in the media repository that have relevant metadata, and the focused individual media element is loaded into the viewing window. The linker element and the focus element include different modes of operation for background-sensitive user interface elements, and The background-sensitive user interface element operates as the linker element in the first background and as the focus element in the second background.

14. The computer system according to claim 13, wherein, The focused individual media element includes only links to those media elements that exist in the media repository and share relevant metadata with the selected media element displayed in the viewing window.

Images