A method for editing multiple different aspect ratio formats on the same screen in a nonlinear editing

Abstract

The application discloses a method for editing different aspect ratio systems on the same screen in a nonlinear editing system, which comprises the following steps: step 1, setting the width and height of the editing system; step 2, creating a playback window; step 3, creating a storyboard and a storyboard track; step 4, editing the storyboard; step 5, generating an image by rendering; step 6, outputting the image to each aspect ratio playback window; and step 7, outputting a video file. The method can enable a user to simultaneously edit and output different aspect ratio systems, meet the needs of different aspect ratio display devices of various end users, shorten the editing time, improve the work efficiency, enable the user to realize the uniformity of the operation on the editing object while editing, and enable the user to simultaneously watch whether the images of different aspect ratio systems meet the content consistency.

Description

A method for simultaneous editing of multiple aspect ratio formats in non-linear editing Technical Field

[0001] This invention belongs to the field of video editing technology, and in particular relates to a method for simultaneous editing of multiple aspect ratio formats on the same screen in non-linear editing. Background Technology

[0002] Nonlinear editing (NLE) refers to an editing method that uses a computer platform and digital storage media such as hard drives for random access to video footage, allowing for free cutting, arrangement, and modification without adhering to chronological order. Its core characteristics include: 1) Digital processing: All footage is converted into digital signals and stored on the hard drive for direct editing via software; 2) Random access: Breaking the limitations of traditional linear editing's tape sequence, any segment can be instantly accessed; 3) Non-destructive editing: The original footage remains unaffected by modifications; the editing process only adjusts the logical order or adds effects. Nonlinear editing has gradually become the mainstream method for video editing.

[0003] In the modern multimedia era, video producers need to simultaneously release videos for computers, televisions, mobile phones, and other multimedia platforms. Because different end-users use different viewing tools and have different screen ratios, video producers need to create videos with different aspect ratios to accommodate users with varying screen sizes, such as computer displays, television equipment in the broadcasting industry, the film industry, and mobile phone displays. Traditional editing software can only create storyboards for different aspect ratios, which significantly increases the user's workload and makes editing different aspect ratios cumbersome. Editing each video separately with different aspect ratios is time-consuming and severely impacts the consistency of the content across all videos. Therefore, how to simultaneously edit videos with different aspect ratios to output videos with varying aspect ratios is a technical problem that needs to be solved in this field. Summary of the Invention

[0004] The purpose of this invention is to provide a method for simultaneous editing of multiple aspect ratio formats on the same screen in non-linear editing, so as to solve the above-mentioned technical problems.

[0005] To achieve the above objectives, the present invention provides the following technical solution:

[0006] This invention discloses a method for simultaneous editing of multiple aspect ratio formats on the same screen in non-linear editing, the method comprising the following steps:

[0007] Step 1: Set the width and height of the editing system: Based on the types and width and height data of various aspect ratio videos to be edited on the same screen, set the width and height of the editing system. Specifically, the width of the editing system is the maximum image width for each aspect ratio, and the height is the maximum image height for each aspect ratio.

[0008] Step 2: Create playback windows: Create the corresponding number of playback windows in the editing system according to the number of different aspect ratio formats needed to edit, so as to display the different aspect ratio formats of the screen respectively;

[0009] Step 3: Create Storyboards and Storyboard Tracks: Create storyboards and, based on user needs, create multiple storyboard tracks on them. These tracks hold the user's required material data. Each storyboard track includes a common track (main track) and multiple standardized tracks (sub-tracks), where the number of standardized tracks equals the number of different aspect ratios that need to be edited simultaneously. The common track holds common material data used by all formats, while the standardized tracks hold material data customized for each format.

[0010] Step 4, Storyboard Editing: Add the material data to the required storyboard track. If the material data meets the common attributes of each format, place it on the common track of the storyboard track; otherwise, place it on each format track separately.

[0011] Step 5: Render and generate images: Render the storyboard, generating one image for each aspect ratio. At the same time, multiple images of the system size (i.e., the width and height of the editing system) will be generated at the same location, thus generating images of various aspect ratios.

[0012] Step 6: Output images to each playback window: Send the generated images of each aspect ratio to the respective playback window, and then crop the images according to their respective viewfinders to generate the final images required for each aspect ratio.

[0013] Step 7: Output video files: Based on the final images required for each aspect ratio, encode them to generate videos of different aspect ratios, and finally output the video files.

[0014] Furthermore, the storyboard mentioned in step 3 is an independent panel or window; the storyboard track is arranged vertically on the storyboard; the material data includes video material and subtitle material, the video material is video taken by the user, including pictures, photos and animation files; the subtitle material is material used to generate text images.

[0015] Furthermore, the specific process for generating an image for each aspect ratio in step 5 is as follows: For each aspect ratio, each storyboard track generates an image of system size. The method for generating an image for each storyboard track is as follows: First, find the sub-track of the aspect ratio within the storyboard track. If the sub-track has material data, generate the image according to the sub-track data; if there is no sub-track data, generate the image according to the main track data. Then, superimpose the images of each track to generate the composite image, which is the image of the aspect ratio. When operating on the storyboard track, if copying or cropping the material on the track, the operation is performed on both the main track and the sub-track simultaneously. If the main track attributes are changed, the sub-track attributes will also change, but changing the attributes of sub-track objects alone will not affect the attributes of the main track and other sub-track objects.

[0016] Furthermore, the specific process of image cropping based on the respective viewfinders in step 6 is as follows: In each playback window, the framing range of the respective viewfinder is adjusted. The framing range can be a part, the whole, or a range exceeding the size of the input image to obtain the optimal viewfinder parameters, including position, scaling, and rotation parameters. When the user adjusts the viewfinder parameters, the rendering of the material in each standardized track of the storyboard track also changes according to the changes in the viewfinder parameters. Then, image cropping is performed. Specifically, based on the viewfinder parameters, a part or the whole of an image is extracted and placed into a new image. The new image is based on the edited standard size in width and height. If the viewfinder size is larger than the original image size, then the part larger than the original image size is filled with black.

[0017] The beneficial effects of the present invention are: the method of the present invention enables users to edit and output images of different aspect ratios simultaneously, meets the needs of various terminal users with different aspect ratio display devices, shortens editing time, improves work efficiency, allows users to achieve uniformity in operation of the editing object while editing, and allows users to simultaneously view whether images of different aspect ratios meet the content consistency.

[0018] The present invention will now be described in further detail with reference to the accompanying drawings and specific embodiments. Attached Figure Description

[0019] Figure 1 is a schematic diagram of the method flow of the present invention;

[0020] Figure 2 is a schematic diagram of the storyboard editing process;

[0021] Figure 3 is a schematic diagram of the image cropping process based on the viewfinder. Detailed Implementation

[0022] This invention discloses a method for simultaneous editing of multiple aspect ratios in non-linear editing. The aspect ratio of a video refers to the width-to-height ratio of an image generated internally by the non-linear editing system software, typically expressed numerically as width and height. The aspect ratio determines the display effect of a video on different screens and devices, ensuring a consistent visual effect across various playback devices. Common video aspect ratios and their application scenarios include the following:

[0023] 1) 4:3 aspect ratio: This aspect ratio was used by traditional television screens, early computer monitors, and some older video formats (such as VHS);

[0024] 2) Aspect ratio 16:9: Modern high-definition television (HDTV), most modern monitors;

[0025] 3) Aspect ratio 9:16: suitable for mobile phone screens;

[0026] 4) 16:10 aspect ratio: Suitable for some high-end monitors, ideal for office work and gaming;

[0027] 5) 21:9 aspect ratio: Ultrawide monitor, suitable for multitasking and gaming;

[0028] 6) 1:1 aspect ratio: This square aspect ratio is used in social media images and some art designs;

[0029] 7) Aspect ratio 2.35:1 or 2.39:1: Applicable to film standard, suitable for cinema screens.

[0030] Video standards are composed of video frame rate, aspect ratio, and image size. Aspect ratio standards represent different aspect ratios.

[0031] As shown in Figure 1, the method for simultaneous editing of multiple aspect ratios in non-linear editing includes the following steps:

[0032] Step 1: Set the width and height of the editing system: Based on the types and dimensions of the various aspect ratio videos to be edited simultaneously, set the width and height of the editing system. Specifically, the width of the editing system should be the maximum image width for each aspect ratio, and the height should be the maximum image height for each aspect ratio. For example, when editing standard high-definition video, the width and height should be 1920 pixels wide and 1080 pixels high; when editing portrait custom video, the width and height should be 1024 pixels wide and 2048 pixels high. If editing both aspect ratios simultaneously, the width and height of the editing system should be set to 1920 pixels wide and 2048 pixels high.

[0033] Step 2: Create playback windows: Create the corresponding number of playback windows in the editing system according to the number of different aspect ratios you need to edit. One playback window is needed for editing one aspect ratio; two playback windows are needed for editing two aspect ratios; and so on, to display the different aspect ratio images respectively.

[0034] Step 3: Create Storyboards and Storyboard Tracks: Create storyboards and multiple storyboard tracks on them according to user needs. A storyboard is typically a separate panel or window. Storyboard tracks are arranged vertically on the storyboard, with each track containing the user's required source material data. Storyboard tracks are primarily used to plan and organize the various parts of a video edit, helping editors preview and arrange the order and arrangement of video clips before editing. Through storyboard tracks, editors can plan the position and duration of each shot in advance, ensuring the smoothness and logic of the final edit. Source material data includes video footage and subtitle materials. Video footage consists of user-shot videos, including photos and animation files; subtitle materials are materials specifically used to generate text images.

[0035] Each storyboard track includes a common track (the main track) and multiple standardized tracks (sub-tracks). The number of standardized tracks equals the number of different aspect ratios that need to be edited simultaneously. Both the common track and the standardized tracks can hold the footage clips needed by the user. Users can drag different video or subtitle footage onto the common track and the standardized tracks. The common track holds common footage data used by all formats, while each standardized track holds footage data customized for its respective format.

[0036] Step 4, Storyboard Editing: Drag and drop materials onto the desired storyboard track. You can drag them to a common track or a specific track. When adding materials to a storyboard track, if the material meets the common attributes of various formats, it should be placed on the common track of the same storyboard track; otherwise, it should be placed on the respective specific tracks, as shown in Figure 2. For example, if the material is user-shot video footage, it has common attributes and should be placed on the common track. However, for subtitle materials, for different aspect ratios, they should be placed on different specific tracks within the same storyboard track for easy handling of differences. Of course, if some subtitle materials can be shared, they can be placed on the common track; the non-shared parts should be placed on different aspect ratio tracks.

[0037] Step 5: Rendering and Generating Images: When rendering the storyboard, one image is generated for each aspect ratio, and multiple images of the system size (i.e., the width and height of the editing system) will be generated at the same location at the same time. That is, regardless of the format, the generated images are all of the same system size.

[0038] For example, for Format 1, each storyboard track generates one system-sized image. The image generation method for each storyboard track is as follows: First, find the Format 1 sub-track within the storyboard track. If the sub-track has source data, generate the image based on the sub-track's data; otherwise, generate the image based on the main track's data. Then, overlay the images from each track to generate the composite image, which is the Format 1 image. This process is repeated to generate images for various aspect ratios.

[0039] When manipulating storyboard tracks, copying or cropping materials on those tracks affects both the main track and its sub-tracks simultaneously. Changing the properties of the main track will change the properties of the sub-tracks accordingly, but changing the properties of a sub-track object alone will not affect the properties of the main track or other sub-track objects.

[0040] Step 6: Output Images to Each Format Playback Window: Send the generated images for each aspect ratio to their respective playback windows. Then, perform image cropping and other adjustments based on the viewfinder to generate the final image required for each aspect ratio. The viewfinder is a rectangular frame displayed at a specific aspect ratio. This frame is located within the playback window and encloses the image, capturing a portion or the entire image. The viewfinder can be within or outside the image area. Data within the viewfinder is valid, while data outside is invalid.

[0041] In each playback window, adjust the framing range of the respective viewfinder, as shown in Figure 3. The framing range can be a portion, the entirety, or an area exceeding the size of the input image to obtain the optimal framing parameters, including position, scaling, and rotation. These framing parameters are crucial for later file generation; the generated image must be produced based on these parameters. When the user adjusts the framing parameters, the rendering of materials such as subtitles on the various standard tracks of the storyboard track needs to change accordingly. For example, when the viewfinder scales, the subtitles must scale proportionally; when the viewfinder shifts horizontally or vertically, the subtitles must shift equidistantly, and the same applies to rotation. Then, image cropping is performed. Specifically, based on the framing parameters, a portion or the entirety of an image is extracted and placed into a new image. This new image is based on the edited standard size in terms of width and height. If the viewfinder size is larger than the original image size, the portion larger than the original image size is filled with black.

[0042] Step 7: Output video files: Based on the final images required for each aspect ratio, encode them to generate videos of different aspect ratios, and finally output the video files.

[0043] Finally, it should be noted that the above description is only used to illustrate the technical solution of the present invention and not to limit it. Although the present invention has been described in detail with reference to the preferred arrangement, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. A method for simultaneous editing of multiple aspect ratio formats on the same screen in non-linear editing, characterized in that, The method includes the following steps: Step 1, Setting the width and height of the editing system: Based on the required types and width and height data of various aspect ratio videos to be edited simultaneously, set the width and height of the editing system. Specifically, the width of the editing system is taken as the maximum image width for each aspect ratio, and the height is taken as the maximum image height for each aspect ratio. Step 2, Creating playback windows: Based on the required number of different aspect ratios to be edited, create a corresponding number of playback windows in the editing system. One playback window is needed for editing one aspect ratio; two playback windows are needed for editing two aspect ratios; and so on, to display different aspect ratio images respectively. Step 3, Creating storyboards and storyboard tracks: Create storyboards and create multiple storyboard tracks on the storyboards according to user needs. The storyboard tracks receive the material data required by the user. Each storyboard track includes a common track (main track) and multiple standardized tracks (sub-tracks), where the number of standardized tracks is equal to the number of different aspect ratios to be edited simultaneously. The common track receives common material data used by all formats, while the standardized track receives material data customized for each format. Step 4: Storyboard Editing: Add material data to the required storyboard track. If the material data meets the common attributes of each format, it is placed on the common track of the storyboard track; otherwise, it needs to be placed on each standardized track separately. Step 5: Rendering and Generating Images: Render the storyboard. One image is generated for each aspect ratio format. At the same time, multiple images of the system size (i.e., the width and height of the editing system) will be generated at the same location, thus generating images for each aspect ratio format. Step 6: Outputting Images to Each Format Playback Window: Send the generated images for each aspect ratio format to the respective format playback window, and then crop the images according to their respective viewfinders to generate the final images required for each aspect ratio format. Step 7: Outputting Video Files: Based on the generated final images required for each aspect ratio format, encode them to generate videos of different aspect ratio formats, and finally output the video files.

2. The method for simultaneous editing of multiple aspect ratio formats on the same screen in non-linear editing according to claim 1, characterized in that, The storyboard mentioned in step 3 is an independent panel or window; the storyboard track is arranged vertically on the storyboard; the material data includes video material and subtitle material. The video material is video taken by the user, including pictures, photos and animation files; the subtitle material is material used to generate text images.

3. The method for simultaneous editing of multiple aspect ratio formats on the same screen in non-linear editing according to claim 1, characterized in that, The specific process for generating an image for each aspect ratio in step 5 is as follows: For each aspect ratio, each storyboard track generates an image of system size. The method for generating an image for each storyboard track is as follows: First, find the sub-track of the aspect ratio within the storyboard track. If the sub-track has material data, generate the image according to the sub-track data; if there is no sub-track data, generate the image according to the main track data. Then, superimpose the images of each track to generate the composite image, which is the image of the aspect ratio. When operating on the storyboard track, if copying or cropping the material on the track, the operation is performed on both the main track and the sub-track simultaneously. If the main track attributes are changed, the sub-track attributes will also change, but changing the attributes of sub-track objects alone will not affect the attributes of the main track and other sub-track objects.

4. The method for simultaneous editing of multiple aspect ratio formats on the same screen in nonlinear editing according to claim 1, characterized in that, The specific process of image cropping in step 6 based on the respective viewfinders is as follows: In each playback window, adjust the framing range of the respective viewfinder. The framing range can be a part, the whole, or a range exceeding the size of the input image to obtain the optimal viewfinder parameters, including position, scaling, and rotation parameters. When the user adjusts the viewfinder parameters, the rendering of the material in each standard track of the storyboard track also changes according to the changes in the viewfinder parameters. Then, image cropping is performed. Specifically, based on the viewfinder parameters, a part or the whole of an image is extracted and placed into a new image. The new image is based on the edited standard size in width and height. If the viewfinder size is larger than the original image size, the part larger than the original image size is filled with black.

Images