Method for editing multiple systems with different aspect ratios on same screen in nonlinear editing

Abstract

The invention discloses a method for editing various systems with different aspect ratios on the same screen in nonlinear editing. The method comprises the following steps: step 1, setting the width and height of an editing system; step 2, creating a playback window; step 3, creating a story board and a story board track; step 4, editing a story board; 5, rendering to generate an image; step 6, outputting the image to each system playback window; and step 7, outputting the video file. According to the method, the user can edit and output in different aspect ratio systems at the same time, the requirements of various terminal users on display equipment with different aspect ratios are met, the editing time is shortened, the working efficiency is improved, the user can operate editing objects uniformly while editing, and the user experience is improved. And the user can watch whether the images with different aspect ratio systems meet the content consistency or not at the same time.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of video editing, and particularly relates to a method for editing multiple different aspect ratio systems on the same screen in non-linear editing. BACKGROUND

[0002] Non-linear editing (NLE) refers to an editing method that uses a computer as a platform to randomly access video materials on a hard disk or other digital storage medium, and freely cuts, arranges and modifies the materials without being limited by the time sequence. The core features include: 1) digital processing: all materials are converted into digital signals and stored on a hard disk for direct editing by software; 2) random access: breaking through the sequential limitation of traditional linear editing, any segment can be called instantly; 3) non-destructive editing: the original materials are not affected by modification, and the editing process only adjusts the logical sequence or adds special effects. Non-linear editing has gradually become the mainstream of video editing.

[0003] In the modern multimedia era, video producers need to release multimedia videos for computers, televisions, mobile phones and other terminals. Due to different viewing tools and different device display ratios of terminal users, in order to adapt to users with different ratios, video producers need to produce videos with different aspect ratios, such as computer display devices, television devices in the broadcasting industry, movie industry and mobile phone display devices. Traditional editing software for editing different video aspect ratios can only create storyboards of different aspect ratio systems, which doubles the workload of users, and the editing experience of different aspect ratio systems is complicated. Editing each video with different aspect ratios takes a long time, and the consistency of the content of each video is also seriously affected. Therefore, how to simultaneously edit different aspect ratio systems to output videos with different aspect ratios is a technical problem to be solved in the field. SUMMARY

[0004] The present application aims to provide a method for editing multiple different aspect ratio systems on the same screen in non-linear editing to solve the above technical problems.

[0005] To achieve the above-mentioned purpose, the present application provides the following technical solutions:

[0006] The present application discloses a method for editing multiple different aspect ratio systems on the same screen in non-linear editing, which comprises the following steps:

[0007] Step 1: setting the width and height of the editing system: according to the types and width and height data of the multiple different aspect ratio systems to be edited on the same screen, the width and height of the editing system are set, specifically, the width of the editing system is set to the maximum image width of each aspect ratio system, and the height of the editing system is set to the maximum image height of each aspect ratio system;

[0008] Step 2, creating playback windows: according to the number of different aspect ratio formats that need to be edited, create a corresponding number of playback windows in the editing system for displaying different aspect ratio format pictures respectively;

[0009] Step 3, creating storyboards and storyboard tracks: create a storyboard, and create multiple storyboard tracks on the storyboard according to user needs, which carry the material data required by the user; each storyboard track includes a public track, i.e., a main track, and multiple format tracks, i.e., sub-tracks, wherein the number of format tracks is equal to the number of different aspect ratio formats that need to be edited on the same screen; the public track carries common material data used by all formats, and the format tracks carry material data customized for each format;

[0010] Step 4, storyboard editing: add material data to the required storyboard tracks, and if the material data meets the common attribute properties of each format, place it on the public track of the storyboard track, otherwise, place it on each format track respectively;

[0011] Step 5, rendering to generate images: render the storyboard to generate an image for each aspect ratio format, so that multiple system sizes, i.e., the width and height of the editing system, will be generated at the same time and position, i.e., generate images for each aspect ratio format;

[0012] Step 6, outputting images to each format playback window: send the generated images for each aspect ratio format to each format playback window respectively, and then perform image cropping according to the respective viewframes to generate the final images required by each aspect ratio format;

[0013] Step 7, outputting video files: according to the final images required by each aspect ratio format, encode the images to generate videos of different aspect ratio formats, and finally output the video files.

[0014] Further, the storyboard in step 3 is an independent panel or window; the storyboard tracks are arranged vertically on the storyboard; the material data includes video material and subtitle material, the video material is a video shot by the user, including a picture and an animation file; and the subtitle material is material for generating a text image.

[0015] Further, the specific process of generating an image for each aspect ratio mode in step 5 is as follows: for each aspect ratio mode, an image of system size is generated for each storyboard track, and the image for each storyboard track is generated in the following way: first, find the sub-track of the aspect ratio mode in the storyboard track, if there is material data in the sub-track, generate the picture according to the data of the sub-track; if there is no sub-track data, generate the picture according to the main track data; then superimpose the images of the tracks to generate the synthesized picture, which is the image of the aspect ratio mode; when operating the storyboard track, if the material on the track is copied or cut, the main track and the sub-track are operated simultaneously; if the main track attribute is changed, the sub-track attribute is changed accordingly, but the sub-track object attribute is changed alone, and the main track and other sub-track object attributes are not affected.

[0016] Further, the specific process of image cutting according to the respective framing frame in step 6 is as follows: in each aspect ratio playback window, the framing range of the respective framing frame is adjusted, the framing range is taken from part, all or a range exceeding the size of the input image to obtain the best framing frame parameters, including position, scaling and rotation parameters; when the user adjusts the framing frame parameters, the material rendering in the aspect ratio track of the storyboard track also changes according to the framing frame parameter changes; then the image is cut, specifically, part or all of an image is framed out according to the framing frame parameters and placed in a new image, the new image has the edited aspect ratio size as the width and height, and if the framing frame size is greater than the original image size, the part exceeding the original image size is filled with black.

[0017] The method of the present application has the following advantages: the method of the present application can enable the user to simultaneously edit and output different aspect ratio modes, meet the needs of various terminal users of different aspect ratio display devices, shorten the editing time, improve the work efficiency, enable the user to realize the uniformity of the editing object operation while editing, and enable the user to simultaneously watch whether the images of different aspect ratio modes meet the content consistency.

[0018] The present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0019] Figure 1 The method flowchart of the present application is shown in the figure;

[0020] Figure 2 The storyboard editing process diagram is shown in the figure;

[0021] Figure 3 The image cutting process according to the framing frame is shown in the figure. DETAILED DESCRIPTION

[0022] The application discloses a method for editing multiple different aspect ratio systems on the same screen in a nonlinear editing system, wherein the aspect ratio of video editing refers to the width-height ratio of images generated in the nonlinear editing system software, and is usually represented in the form of numbers as width and height. The aspect ratio determines the display effect of video on different screens and devices, and ensures consistent visual effects of video on different playback devices. Common video aspect ratios and their application scenarios include the following:

[0023] 1) Aspect ratio 4:3: traditional television screens, early computer monitors and some old video formats (such as VHS) use this aspect ratio;

[0024] 2) Aspect ratio 16:9: modern high-definition television (HDTV), most modern monitors;

[0025] 3) Aspect ratio 9:16: suitable for mobile phone screens;

[0026] 4) Aspect ratio 16:10: suitable for some high-end monitors, suitable for office and gaming;

[0027] 5) Aspect ratio 21:9: ultra-wide monitor, suitable for multitasking and gaming;

[0028] 6) Aspect ratio 1:1: social media pictures, some art designs use this square aspect ratio;

[0029] 7) Aspect ratio 2.35:1 or 2.39:1: suitable for film standard, suitable for cinema screens.

[0030] The video format is composed of video frame rate, aspect ratio and image size, and the aspect ratio format represents the format represented by different aspect ratios.

[0031] As shown in Figure 1 The method for editing multiple different aspect ratio systems on the same screen in a nonlinear editing system comprises the following steps:

[0032] Step 1, setting the width and height of the editing system: according to the types and width-height data of multiple different aspect ratio systems to be edited on the same screen, the width and height of the editing system are set, specifically, the width of the editing system is the maximum image width of each aspect ratio system, and the height of the editing system is the maximum image height of each aspect ratio system; for example, the width-height data of editing standard high-definition system is 1920 wide and 1080 high, and the width-height data of editing vertical screen custom system is 1024 wide and 2048 high; if the above two aspect ratio systems are edited on the same screen, the width-height of the editing system is set to 1920 wide and 2048 high.

[0033] Step 2, creating playback windows: create a corresponding number of playback windows in the editing system according to the number of different aspect ratio formats that need to be edited. One playback window is created for one aspect ratio format editing, two playback windows are created for two aspect ratio format editing, and so on. Different aspect ratio formats are displayed in different playback windows.

[0034] Step 3, creating storyboard and storyboard track: create a storyboard and create multiple storyboard tracks on the storyboard according to user needs. The storyboard is usually a separate panel or window, and the storyboard tracks are arranged vertically on the storyboard. Each storyboard track accepts user required material data. Storyboard tracks are mainly used to plan and organize various parts of video clips, helping editors preview and arrange the order and arrangement of video segments before editing. Through storyboard tracks, editors can plan the position and duration of each shot in advance to ensure the smoothness and logic of the final edit. Material data includes video material and subtitle material, etc. Video material is user-shot video, including picture photos and animation files; subtitle material is material used to generate text images.

[0035] Each storyboard track includes a common track (i.e. main track) and multiple format tracks (i.e. sub-tracks), where the number of format tracks is equal to the number of different aspect ratio formats that need to be edited on the same screen. Both the common track and the format track can accept user required material segments. Users can drag different video materials or subtitle materials to the common track and the format track. The common track accepts common material data used by all formats, and each format track accepts customized material data for each format.

[0036] Step 4, storyboard editing: drag the material to the required storyboard track, which can be dragged to the common track or the format track. When adding material to the storyboard track, if the material meets the common attribute properties of each format, it is placed on the common track of a storyboard track, otherwise it needs to be placed on each format track, as shown in Figure 2 For example, if the video material shot by the user is placed on the common track, it has common attributes. However, for subtitle material, different aspect ratio formats should be placed on different format tracks to facilitate differential processing. Of course, if some subtitle materials can be shared, they can be placed on the common track, and the non-shareable parts can be placed on different aspect ratio format tracks.

[0037] Step 5, rendering to generate images: when rendering the storyboard, one image is generated for each aspect ratio format, and multiple system sizes (i.e. editing system width and height) images are generated at the same time and position. That is, regardless of the format, the generated image is a unified system size.

[0038] For example, for format 1, one image of system size is generated for each storyboard track. The image is generated by first finding the sub-track for format 1 in the storyboard track, and if there is material data in the sub-track, the picture is generated according to the data in the sub-track; if there is no sub-track data, the picture is generated according to the main track data. The images of the respective tracks are then superimposed to generate a composite picture, which is the image for format 1. In this way, the images for each aspect ratio format are generated.

[0039] When operating on a storyboard track, if the material on the track is copied or cropped, the main track and the sub-track are simultaneously operated on. If the main track attributes are changed, the sub-track attributes are changed accordingly, but if the sub-track object attributes are changed individually, the main track and other sub-track object attributes are not affected.

[0040] Step 6, outputting the images to the respective format playback windows: the respective aspect ratio format images generated are sent to the respective format playback windows, and then the final images required for each aspect ratio format are generated by image cropping and the like according to the respective view frames. The view frame is a rectangular frame displayed in a certain aspect ratio, and the rectangular frame is located in the playback window. The rectangular frame frames the image of the playback window, and part of the image or the entire image is cut off. The view frame can be within the image range or outside the image range. The range inside the view frame is valid data, and the range outside the view frame is invalid data.

[0041] In the respective format playback windows, the view frame range of each view frame is adjusted, as shown in FIG. 6. The view frame range can be part of the input image, the entire input image, or a range larger than the input image size, so as to obtain the best view frame parameters, including position, scaling, rotation parameters, and the like. These view frame parameters are very important parameters in the later generation of files, and the reproduction images are generated according to the view frame parameters. When the user adjusts the view frame parameters, the rendering of the subtitles and the like in the respective format tracks in the storyboard track needs to change according to the changes in the view frame parameters. Taking the subtitles as an example, when the view frame is scaled, the subtitles also need to be scaled by the same ratio; when the view frame is horizontally or vertically displaced, the subtitles also need to be displaced by the same distance, and the same applies to rotation. Then, image cropping is performed, that is, part or all of an image is framed and placed in a new image, and the new image has the edited format size as the width and height. If the view frame size is larger than the original image size, the part larger than the original image size is filled with black. Figure 3

[0042] Step 7, outputting the video files: the final images required for each aspect ratio format are encoded to generate videos of different aspect ratio formats, and finally the video files are outputted.

[0043] ​It should be pointed out finally that the above description is only used to explain the technical solutions of the present application but not to limit the present application. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application can be modified or equivalently replaced without departing from the spirit and scope of the present application.

Claims

1. A method for simultaneous editing of multiple aspect ratio formats on the same screen in non-linear editing, characterized in that, The method comprises the following steps: Step 1, setting the width and height of the editing system: setting the width and height of the editing system according to the types and width and height data of the multiple different aspect ratio video formats required for simultaneous screen editing, specifically, taking the maximum image width of each aspect ratio format as the width of the editing system, and taking the maximum image height of each aspect ratio format as the height of the editing system; Step 2, creating a playback window: creating a corresponding number of playback windows in the editing system according to the number of different aspect ratio formats required for editing, for displaying different aspect ratio format pictures respectively; Step 3, creating a storyboard and storyboard tracks: creating a storyboard, and creating multiple storyboard tracks on the storyboard according to user requirements, the storyboard tracks receiving user required material data; each storyboard track comprises a common track, i.e., a main track, and multiple format tracks, i.e., sub-tracks, wherein the number of format tracks is equal to the number of different aspect ratio formats required for simultaneous screen editing; the common track receives common material data used by all formats, and the format tracks receive material data customized for respective formats; Step 4, storyboard editing: adding material data to the required storyboard tracks, and if the material data meets the common attribute properties of each format, placing the material data on the common track of the storyboard track, otherwise, placing the material data on the respective format tracks; Step 5, rendering to generate images: rendering the storyboard to generate one image for each aspect ratio format, so that multiple system size, i.e., editing system width and height, images will be generated at the same time position, i.e., generating images of each aspect ratio format; Step 6, outputting images to each format playback window: sending the generated images of each aspect ratio format to each format playback window respectively, and then performing image cropping according to respective viewframes to generate final images required by each aspect ratio format; Step 7, outputting video files: encoding the final images required by each aspect ratio format respectively to generate videos of different aspect ratio formats, and finally outputting video files.

2. The method for editing different aspect ratio formats on the same screen in a non-linear editing system according to claim 1, wherein, The storyboard in step 3 is an independent panel or window; the storyboard tracks are arranged vertically on the storyboard; the material data comprises video material and subtitle material, the video material is a video shot by a user, including a picture and an animation file; and the subtitle material is material for generating a text image.

3. The method of claim 1, wherein the method further comprises: The specific process of generating an image for each aspect ratio mode in step 5 is as follows: for each aspect ratio mode, an image of system size is generated for each storyboard track, and the image is generated for each storyboard track in the following way: first, find the sub-track of the aspect ratio mode in the storyboard track, if there is material data in the sub-track, generate the picture according to the data of the sub-track; if there is no sub-track data, generate the picture according to the main track data; then superimpose the images of the tracks to generate the synthesized picture, which is the image of the aspect ratio mode; when operating the storyboard track, if the material on the track is copied or cut, the main track and the sub-track are operated simultaneously; if the main track attribute is changed, the sub-track attribute is changed accordingly, but the sub-track object attribute is changed alone, and the main track and other sub-track object attributes are not affected.

4. The method for simultaneous editing of multiple aspect ratio formats on the same screen in nonlinear editing according to claim 1, characterized in that, The specific process of image cutting according to the respective framing boxes in step 6 is as follows: in each mode playback window, adjust the framing range of each respective framing box, the framing range is the local, the whole, or the range exceeding the size of the input image, to obtain the best framing box parameters, including position, scaling, and rotation parameters; when the user adjusts the framing box parameters, the material rendering in the aspect ratio track of the storyboard track also changes according to the framing box parameter changes; then perform image cutting, specifically, according to the framing box parameters, frame part or all of an image into a new image, the new image has the width and height of the edited aspect ratio size, if the framing box size is greater than the original image size, the part greater than the original image size is filled with black.

Images