A coking processing method, device, equipment, medium and product

Abstract

The application discloses a kind of cardon processing method, device, equipment, medium and product.The method comprises: when the preview frame rate of video editing draft is less than frame rate threshold, the material segment for rendering preview frame corresponding to the preview frame rate in the video editing draft is obtained;According to the editing characteristic data of the material segment, at least one cardon processing strategy is determined;According to the at least one cardon processing strategy, cardon prompt page is displayed;Wherein, the cardon operation control corresponding to each cardon processing strategy is contained in the cardon prompt page, and the cardon operation control is used to execute the processing operation corresponding to the cardon processing strategy, solve the problem that current video editing application lacks preview cardon feedback, guarantee the fluency of preview display function.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of computer technology, and in particular to a method, apparatus, device, medium and product for handling stuttering. Background Technology

[0002] In video editing scenarios, users preview and play draft videos, during which stuttering may occur. Current video editing applications only have basic playback control functions and do not capture or analyze these stuttering issues, thus increasing the negative feedback for the video editing application. Summary of the Invention

[0003] This invention provides a method, apparatus, device, medium, and product for handling stuttering, in order to solve the problem of lack of preview stuttering feedback in current video editing applications, ensure the smoothness of the preview display function, and thus reduce the negative feedback of video editing applications.

[0004] In a first aspect, embodiments of the present invention provide a method for handling stuttering, the method comprising:

[0005] When the preview frame rate of the video editing draft is less than the frame rate threshold, the material segment in the video editing draft corresponding to the preview frame rate is obtained for rendering the preview frame.

[0006] Based on the editing feature data of the material fragment, at least one stuttering handling strategy is determined;

[0007] Display a stuttering warning page according to the at least one stuttering handling strategy;

[0008] The stuttering prompt page includes stuttering operation controls corresponding to each stuttering handling strategy. These stuttering operation controls are used to execute the processing operations corresponding to the stuttering handling strategy.

[0009] Secondly, embodiments of the present invention also provide a lag processing device, the device comprising:

[0010] The material fragment acquisition module is used to acquire material fragments in the video editing draft that correspond to the preview frame rate and are used to render the preview frame when the preview frame rate of the video editing draft is less than the frame rate threshold.

[0011] The stuttering handling strategy determination module is used to determine at least one stuttering handling strategy based on the editing feature data of the material segment;

[0012] A stuttering prompt page display module is used to display a stuttering prompt page according to the at least one stuttering handling strategy;

[0013] The stuttering prompt page includes stuttering operation controls corresponding to each stuttering handling strategy. These stuttering operation controls are used to execute the processing operations corresponding to the stuttering handling strategy.

[0014] Thirdly, embodiments of the present invention also provide an electronic device, the electronic device comprising:

[0015] At least one processor; and

[0016] A memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores a computer program that can be executed by the at least one processor, which enables the at least one processor to perform the stuttering handling method according to any embodiment of the present invention.

[0018] Fourthly, embodiments of the present invention also provide a computer-readable storage medium storing computer instructions, which are used to cause a processor to execute the stuttering processing method described in any embodiment of the present invention.

[0019] Fifthly, embodiments of the present invention also provide a computer program product, including a computer program that, when executed by a processor, implements the stuttering processing method described in any embodiment of the present invention.

[0020] The technical solution of this invention, when the preview frame rate of the video editing draft is less than a frame rate threshold, obtains the material segment in the video editing draft corresponding to the preview frame rate for rendering the preview frame, determines at least one stuttering handling strategy based on the editing feature data of the material segment, and displays a stuttering prompt page according to the at least one stuttering handling strategy. This enables users to resolve preview stuttering phenomena themselves through stuttering operation controls, solves the problem of lack of preview stuttering feedback in current video editing applications, ensures the smoothness of the preview display function, and thus reduces the negative feedback of video editing applications. Attached Figure Description

[0021] The above and other features, advantages, and aspects of the various embodiments of the present invention will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0022] Figure 1 A flowchart illustrating a stuttering handling method provided in one embodiment of the present invention;

[0023] Figure 2This is a schematic diagram of a lag notification page provided in one embodiment of the present invention;

[0024] Figure 3 This is a schematic diagram of another lag prompt page provided in one embodiment of the present invention;

[0025] Figure 4 A flowchart illustrating another stuttering handling method provided in one embodiment of the present invention;

[0026] Figure 5 This is a schematic diagram of another lag prompt page provided in one embodiment of the present invention;

[0027] Figure 6 This is a schematic diagram of another lag prompt page provided in one embodiment of the present invention;

[0028] Figure 7 This is a schematic diagram of a stuttering processing device provided in one embodiment of the present invention;

[0029] Figure 8 This is a schematic diagram of the structure of an electronic device provided in one embodiment of the present invention. Detailed Implementation

[0030] Embodiments of the present invention will now be described in more detail with reference to the accompanying drawings. While some embodiments of the invention are shown in the drawings, it should be understood that the invention can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the invention. It should be understood that the accompanying drawings and embodiments are for illustrative purposes only and are not intended to limit the scope of protection of the invention.

[0031] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.

[0032] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0033] It should be noted that the concepts of "first" and "second" mentioned in this invention are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0034] It should be noted that the terms "a" and "a plurality of" used in this invention are illustrative rather than restrictive. Those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0035] The names of the messages or information exchanged between the multiple devices in the embodiments of the present invention are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0036] It is understood that before using the technical solutions disclosed in the various embodiments of the present invention, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in the present invention and their authorization should be obtained in accordance with relevant laws and regulations through appropriate means.

[0037] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application program, server, or storage medium executing the operation of this invention, based on the prompt message.

[0038] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0039] It is understood that the above notification and user authorization process is merely illustrative and does not constitute a limitation on the implementation of the present invention. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present invention.

[0040] Figure 1 This is a flowchart illustrating a stuttering handling method according to an embodiment of the present invention. This embodiment is applicable to handling stuttering that occurs during the preview and display of a video editing draft. The method can be executed by a stuttering handling device, which can be implemented in hardware and / or software. This stuttering handling device can be configured in an electronic device, typically a mobile terminal or tablet computer. Figure 1 As shown, the method includes:

[0041] S110. When the preview frame rate of the video editing draft is less than the frame rate threshold, obtain the material segment in the video editing draft that corresponds to the preview frame rate and is used to render the preview frame.

[0042] Specifically, a video editing draft represents the video content that a user edits and creates in a video editing application. The video editing application provides a preview tool for the video editing draft, which is used to display the preview frame sequence rendered from the video editing draft, so that users can see the effect of multimedia materials such as transitions, filters, subtitles, videos, pictures or stickers in the video editing draft, as well as check the smoothness of splicing between material clips, etc.

[0043] Specifically, the preview frame rate is the number of preview frames displayed continuously per unit of time. For example, the frame rate threshold is 24 frames per second or 30 frames per second, but is not limited to the example scenario.

[0044] In an optional embodiment, the method further includes: obtaining a display time interval between the current preview frame and the next preview frame; and if the display time interval is greater than a time interval threshold, using the ratio between a unit time and the display time interval as the preview frame rate. For example, the time interval threshold can be 66ms, 110ms, or 160ms, but is not limited to the example scenario.

[0045] Specifically, a video editing draft contains one or more material clips. These material clips consist of multimedia materials such as frames, effects, stickers, and audio. The material clips can be grouped together as a whole and their positions adjusted within the video editing draft. In this embodiment, the material clip used to render the preview frame corresponding to the preview frame rate represents a material clip containing frames corresponding to the preview frame rate. For example, the preview frame related to the preview frame rate can be the last preview frame in a series of preview frames used to calculate the preview frame rate.

[0046] Based on the above embodiments, optionally, after obtaining the material segment used to render the preview frame corresponding to the preview frame rate in the video editing draft, the method further includes: displaying a stutter mark on the material segment in the draft preview page.

[0047] Specifically, the draft preview page represents an interactive page used for previewing and displaying video editing drafts. In one optional embodiment, the draft preview page includes a preview display area and a functional interaction area. Specifically, the preview display area is used to display preview frames rendered based on the video editing draft, and the functional interaction area is used to define preview interaction controls. For example, preview interaction controls include, but are not limited to, at least one of the following: pause control, play control, fast forward control, and rewind control. The draft preview page is not limited here and can be customized according to actual needs.

[0048] For example, the display of stuttering markers can include, but is not limited to, selected markers, highlighted markers, and added stuttering indicators. There is no limitation on the display of stuttering markers here, and the specific settings can be customized according to actual needs.

[0049] The benefit of setting up a stutter indicator is that it helps users understand the stuttering that occurs during the preview and provides a reference for users to select the stuttering trigger control.

[0050] S120. Based on the editing feature data of the material fragment, determine at least one stuttering handling strategy.

[0051] Specifically, the editing feature data is used to characterize feature information related to the editing attributes of the footage clip. In one optional embodiment, the editing feature data includes at least one of the following editing feature parameters: clip resolution, clip duration, image group length, number of effects, and number of picture-in-picture layers.

[0052] Specifically, clip resolution refers to the number of pixels contained in a clip in the horizontal and vertical directions, such as 1920×1080, used to indicate the sharpness of the clip. Clip duration is the time interval between the start and end points of a clip. A Group of Pictures (GOP) is a collection of consecutive frames. The GOP length indicates the number of frames contained within a GOP. These frames can be divided into I-frames (keyframes), P-frames (predictive frames), and B-frames (bidirectional predictive frames), etc. A larger GOP length indicates higher encoding quality, and vice versa. The number of effects indicates the number of effects added to the clip. Effects include, but are not limited to, transition effects, filter effects, animation effects, and text effects, etc., and can be used to reflect the visual richness of the clip. Picture-in-picture refers to embedding one or more smaller sub-pictures within a main picture to create a multi-layered visual effect. The picture-in-picture level is a quantitative indicator used to distinguish the hierarchical relationship between different pictures.

[0053] Specifically, the stuttering handling strategy represents the solution set for the stuttering phenomenon in the preview.

[0054] In an optional embodiment, determining at least one stuttering handling strategy based on the editing feature data of the material segment includes: comparing at least one editing feature parameter in the editing feature data with editing feature conditions, and determining at least one stuttering handling strategy based on the comparison result. Here, each editing feature parameter corresponds one-to-one with the editing feature conditions, and the comparison result indicates whether each editing feature parameter satisfies its corresponding editing feature condition. Specifically, based on the mapping list between editing feature parameters and stuttering handling strategies, the stuttering handling strategy corresponding to the editing feature parameter that does not satisfy the editing feature condition is queried.

[0055] In an optional embodiment, determining at least one stuttering handling strategy based on the editing feature data of the material segment includes: if the number of special effects in the editing feature data is greater than a number threshold, then using a pre-rendering strategy as the stuttering handling strategy; wherein, the pre-rendering strategy represents performing a pre-rendering operation on other material segments located after the material segment in the video editing draft to obtain a pre-rendered frame sequence, and the pre-rendered frame sequence is used when previewing the preview frames corresponding to the other material segments.

[0056] Specifically, an effect quantity greater than a threshold indicates an editing feature condition corresponding to the number of effects. For example, the threshold could be 10 or 20, but is not limited to the example scenario.

[0057] In an optional embodiment, determining at least one stuttering handling strategy based on the editing feature data of the material fragment includes: if at least one editing feature parameter in the editing feature data satisfies the editing feature conditions, then the draft reporting strategy and / or the problem reporting strategy are used as the stuttering handling strategy; wherein, the editing feature parameters correspond one-to-one with the editing feature conditions.

[0058] Specifically, if at least one editing feature parameter in the editing feature data satisfies the editing feature conditions, it indicates that the preview stuttering is caused by an unknown reason. In this embodiment, the draft reporting strategy means uploading the video editing draft to the stuttering processing platform, and the problem reporting strategy means executing the display operation of the problem collection interface and uploading the problem description text entered by the user based on the problem collection interface to the stuttering processing platform.

[0059] S130. Display a stuttering prompt page according to the at least one stuttering handling strategy.

[0060] In this embodiment, the stuttering prompt page includes stuttering operation controls corresponding to each stuttering handling strategy. The stuttering operation controls are used to execute the processing operations corresponding to the stuttering handling strategy.

[0061] Based on the above embodiments, optionally, the lag notification page also includes lag notification information, which prompts the user to resolve the preview lag by clicking the lag operation control. For example, the lag notification information could be: "Severe lag has been detected. You can avoid lag by following these steps."

[0062] Figure 2 This is a schematic diagram of a lag notification page provided in one embodiment of the present invention. Figure 2 Taking a stuttering handling strategy as an example of a pre-rendering strategy. Specifically, Figure 2The message "Severe lag detected. You can avoid lag by following these steps" indicates a lag warning, while the "Pre-render" control represents the lag control corresponding to the pre-render strategy.

[0063] In an optional embodiment, after displaying a stuttering prompt page according to the at least one stuttering handling strategy, the method further includes: in response to a trigger operation of a stuttering operation control corresponding to a pre-rendering strategy, obtaining a preview frame sequence corresponding to the other material segments, and previewing the preview frame sequence; wherein the preview frame sequence is obtained based on the pre-rendered frame sequence corresponding to the other material segments.

[0064] Figure 3 This is a schematic diagram of another lag prompt page provided in one embodiment of the present invention. Figure 3 Taking the lag handling strategy, which includes draft reporting and problem reporting strategies, as an example. Specifically, Figure 3 The "Severe lag detected, report feedback" option indicates a lag warning message; the "Upload Draft" control indicates a lag handling control corresponding to the draft reporting strategy; and the "Describe Problem" control indicates a lag handling control corresponding to the problem reporting strategy.

[0065] In an optional embodiment, after displaying a stuttering prompt page according to the at least one stuttering handling strategy, the method further includes: uploading the video editing draft to the stuttering handling platform in response to a triggering operation of a stuttering operation control corresponding to the draft reporting strategy.

[0066] In another alternative embodiment, after displaying the lag prompt page according to the at least one lag handling strategy, the method further includes: in response to a trigger operation of a lag operation control corresponding to the problem reporting strategy, displaying a problem collection interface, and uploading the problem description text entered by the user based on the problem collection interface to the lag handling platform.

[0067] The technical solution of this embodiment obtains the material segment in the video editing draft corresponding to the preview frame rate for rendering the preview frame when the preview frame rate of the video editing draft is less than the frame rate threshold. Based on the editing feature data of the material segment, at least one stuttering handling strategy is determined. Based on the at least one stuttering handling strategy, a stuttering prompt page is displayed. This enables users to resolve the preview stuttering phenomenon themselves through stuttering operation controls, solves the problem of lack of preview stuttering feedback in current video editing applications, ensures the smoothness of the preview display function, and thus reduces the negative feedback of video editing applications.

[0068] Figure 4This is a flowchart of another stuttering handling method provided by an embodiment of the present invention. This embodiment further refines the "determining at least one stuttering handling strategy based on the editing feature data of the material segment" in the above embodiment. In this embodiment, determining at least one stuttering handling strategy based on the editing feature data of the material segment includes: if at least one editing feature parameter in the editing feature data does not meet the editing feature conditions, then the transcoding acceleration strategy is used as the stuttering handling strategy. Figure 4 As shown, the method includes:

[0069] S210. When the preview frame rate of the video editing draft is less than the frame rate threshold, obtain the material segment in the video editing draft that corresponds to the preview frame rate and is used to render the preview frame.

[0070] S210 in this embodiment is the same as that in the above embodiment. Figure 1 The S110 shown is the same or similar, and will not be described again in this embodiment.

[0071] S220. If at least one editing feature parameter in the editing feature data does not meet the editing feature conditions, then the transcoding acceleration strategy will be used as the stuttering handling strategy.

[0072] In this embodiment, the editing feature parameters correspond one-to-one with the editing feature conditions, and the at least one editing feature parameter includes at least one of the following: clip resolution, clip duration, image group length, and picture-in-picture level.

[0073] Specifically, if at least one editing feature parameter in the editing feature data does not meet the editing feature conditions, it indicates that the preview lag is caused by a predefined known reason.

[0074] In an optional embodiment, when the editing feature parameter is the resolution of the clip material, the editing feature condition is that the resolution of the clip material is less than a resolution threshold corresponding to the material format of the clip material, and the material format is a video format or an image format.

[0075] For example, video formats include, but are not limited to, AVI, MPEG, ASF, MMV, and MP4 formats, and image formats include, but are not limited to, PNG, JPEG, GIF, and BMP formats.

[0076] For example, the video resolution threshold can be 1080P or 2160P, and the image resolution threshold can be 1920×1080 or 4096×2160. There are no restrictions on the video resolution threshold and the image resolution threshold here. They can be customized according to actual needs.

[0077] In an optional embodiment, when the editing feature parameter is the segment duration, the editing feature condition includes the segment duration being greater than a duration threshold, and / or the segment duration being less than or equal to the duration threshold and the number of consecutive segments of the material segment being less than a number of consecutive segments threshold; wherein, the number of consecutive segments represents the number of other material segments in the video editing draft that are located after the material segment within a unit of time.

[0078] For example, the duration threshold can be 1 second or 500 ms, and the continuous quantity threshold can be 2 / s or 20 / min. There are no restrictions on the duration threshold and the continuous quantity threshold here. They can be customized according to actual needs.

[0079] In an optional embodiment, the method further includes: obtaining other material segments located after the material segment from the video editing draft according to a preset selection duration; and using the ratio between the number of selected other material segments and the preset selection duration as the segment continuity quantity.

[0080] For example, suppose the duration of each subsequent clip in the video editing draft is 1s, 2s, 3s, 40s, and 50s, respectively. If the preset selection duration is 1 minute, the selection quantity is rounded up to 5, resulting in a clip continuity rate of 5 / min. If the preset selection duration is 30 seconds, the selection quantity is rounded up to 4, resulting in a clip continuity rate of 8 / min.

[0081] In another optional embodiment, the method further includes: obtaining other material segments located after the material segment from the video editing draft according to a preset selection quantity; taking the sum of the segment durations corresponding to at least one other material segment as the summation duration, and taking the ratio between the preset selection quantity and the summation duration as the segment continuity quantity.

[0082] Taking the above example, if the preset selection quantity is 3, the summation time is 6 seconds, and the corresponding segment continuity rate is 30 / min. If the preset selection quantity is 5, the summation time is 96 seconds, and the corresponding judgment continuity rate is 3.125 / min.

[0083] In one optional embodiment, when the editing feature parameter is the image group length, the editing feature condition is that the image group length is less than a length threshold; when the editing feature parameter is the number of picture-in-picture layers, the editing feature condition is that the number of picture-in-picture layers is less than a layer number threshold.

[0084] For example, the length threshold can be 30 frames and the number of layers threshold can be 5. There are no restrictions on the length threshold or the number of layers threshold here. The specific settings can be customized according to actual needs.

[0085] In this embodiment, the transcoding acceleration strategy represents the use of a preset transcoding technology to perform transcoding operations on the material segment and other material segments located after the material segment in the video editing draft, to obtain segment transcoding data, which is used when previewing and displaying the preview frames corresponding to the material segment and the other material segments.

[0086] S230. Display a stuttering prompt page according to the at least one stuttering handling strategy.

[0087] Figure 5 This is a schematic diagram of another lag prompt page provided in one embodiment of the present invention. Figure 5 Taking the stuttering handling strategy as an example of a transcoding acceleration strategy. Specifically, Figure 5 The message "Severe lag detected. You can avoid lag by following these steps" indicates a lag warning, while the "De-transcoding" control represents the lag control corresponding to the transcoding acceleration strategy.

[0088] Based on the above embodiments, optionally, after displaying the stuttering prompt page according to the at least one stuttering handling strategy, the method further includes: obtaining a preview frame sequence corresponding to the material segment and the other material segments, and previewing the preview frame sequence; wherein, the preview frame sequence is obtained based on the segment transcoding data corresponding to the material segment and the other material segments.

[0089] Based on the above embodiments, specifically, determining at least one stuttering handling strategy according to the editing feature data of the material fragment further includes: if the number of special effects in the editing feature data is greater than the number threshold, then the pre-rendering strategy is used as the stuttering handling strategy.

[0090] Figure 6 This is a schematic diagram of another lag prompt page provided in one embodiment of the present invention. Figure 6 Taking stuttering handling strategies, including pre-rendering strategies and transcoding acceleration strategies, as an example. Specifically, Figure 6 The message "Severe lag detected. You can avoid lag by following these steps" indicates a lag warning. The "Pre-render" control indicates the lag control corresponding to the pre-render strategy, and the "De-transcoding" control indicates the lag control corresponding to the transcoding acceleration strategy.

[0091] The technical solution of this embodiment uses a transcoding acceleration strategy as a stuttering handling strategy when at least one editing feature parameter in the editing feature data does not meet the editing feature conditions. The editing feature data includes at least one of the following: clip resolution, clip duration, image group length, and picture-in-picture level. This solves the problem of a single solution for predefined known causes, improves the diversity of stuttering handling strategies, and further reduces the negative feedback of video editing applications.

[0092] The following are embodiments of the stuttering processing device provided in this invention. This device and the stuttering processing method in the above embodiments belong to the same inventive concept. For details not described in detail in the embodiments of the stuttering processing device, please refer to the content of the stuttering processing method in the above embodiments.

[0093] Figure 7 This is a schematic diagram of a stuttering processing device provided in one embodiment of the present invention. Figure 7 As shown, the device includes: a material fragment acquisition module 310, a stuttering processing strategy determination module 320, and a stuttering prompt page display module 330.

[0094] The material fragment acquisition module 310 is used to acquire material fragments in the video editing draft that correspond to the preview frame rate and are used to render the preview frame when the preview frame rate of the video editing draft is less than the frame rate threshold.

[0095] The stuttering handling strategy determination module 320 is used to determine at least one stuttering handling strategy based on the editing feature data of the material segment;

[0096] The lag prompt page display module 330 is used to display a lag prompt page according to the at least one lag handling strategy;

[0097] The stuttering prompt page includes stuttering operation controls corresponding to each stuttering handling strategy. These stuttering operation controls are used to execute the processing operations corresponding to the stuttering handling strategy.

[0098] The technical solution of this embodiment obtains the material segment in the video editing draft corresponding to the preview frame rate for rendering the preview frame when the preview frame rate of the video editing draft is less than the frame rate threshold. Based on the editing feature data of the material segment, at least one stuttering handling strategy is determined. Based on the at least one stuttering handling strategy, a stuttering prompt page is displayed. This enables users to resolve the preview stuttering phenomenon themselves through stuttering operation controls, solves the problem of lack of preview stuttering feedback in current video editing applications, ensures the smoothness of the preview display function, and thus reduces the negative feedback of video editing applications.

[0099] In an optional embodiment, the stuttering handling strategy determination module 320 includes:

[0100] The pre-rendering strategy determination unit is used to determine the pre-rendering strategy as a stuttering handling strategy if the number of special effects in the edit feature data is greater than the number threshold.

[0101] The pre-rendering strategy refers to performing pre-rendering operations on other material segments in the video editing draft that are located after the material segment, to obtain a pre-rendered frame sequence, which is used when previewing the preview frames corresponding to the other material segments.

[0102] In an optional embodiment, the stuttering handling strategy determination module 320 includes:

[0103] The draft reporting strategy determination unit is used to determine the draft reporting strategy and / or the problem reporting strategy as the lag handling strategy if at least one editing feature parameter in the editing feature data meets the editing feature conditions.

[0104] The editing feature parameters correspond one-to-one with the editing feature conditions. The draft reporting strategy means uploading the video editing draft to the stuttering processing platform. The problem reporting strategy means executing the display operation of the problem collection interface and uploading the problem description text entered by the user based on the problem collection interface to the stuttering processing platform.

[0105] In one optional embodiment, the stuttering handling strategy determination module 320 includes:

[0106] The draft reporting strategy determination unit is used to use the transcoding acceleration strategy as a stuttering handling strategy if at least one editing feature parameter in the editing feature data does not meet the editing feature conditions.

[0107] The at least one editing feature parameter includes at least one of the following: clip resolution, clip duration, image group length, and picture-in-picture level. The editing feature parameter corresponds one-to-one with the editing feature condition. The transcoding acceleration strategy represents the use of a preset transcoding technology to perform transcoding operations on the clip and other clips in the video editing draft located after the clip, to obtain clip transcoding data. The clip transcoding data is used when previewing the clip and the preview frames corresponding to the other clips.

[0108] In an optional embodiment, when the editing feature parameter is the resolution of the clip material, the editing feature condition is that the resolution of the clip material is less than a resolution threshold corresponding to the material format of the clip material, and the material format is a video format or an image format.

[0109] In an optional embodiment, when the editing feature parameter is the segment duration, the editing feature condition includes the segment duration being greater than the duration threshold, and / or the segment duration being less than or equal to the duration threshold and the number of consecutive segments of the material segment being less than the number of consecutive segments threshold;

[0110] The term "segment continuity" represents the number of other material segments following the material segment in the video editing draft within a unit of time.

[0111] In an optional embodiment, when the editing feature parameter is the image group length, the editing feature condition is that the image group length is less than a length threshold;

[0112] When the editing feature parameter is the number of picture-in-picture layers, the editing feature condition is that the number of picture-in-picture layers is less than the layer number threshold.

[0113] In an optional embodiment, the device further includes:

[0114] The stuttering marker display module is used to display stuttering markers on the draft preview page after obtaining the material segment used to render the preview frame corresponding to the preview frame rate in the video editing draft.

[0115] The stuttering processing device provided in the embodiments of the present invention can execute the stuttering processing method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the method.

[0116] The following is for reference. Figure 8 The diagram illustrates a structural schematic of an electronic device (e.g., a terminal device or a server) 400 suitable for implementing embodiments of the present invention. The terminal device in the embodiments of the present invention may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 8 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.

[0117] like Figure 8As shown, electronic device 400 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 401, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 402 or a program loaded from storage device 406 into random access memory (RAM) 403. RAM 403 also stores various programs and data required for the operation of electronic device 400. Processing device 401, ROM 402, and RAM 403 are interconnected via bus 404. Input / output (I / O) interface 405 is also connected to bus 404.

[0118] Typically, the following devices can be connected to I / O interface 405: input devices 406 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 407 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 406 including, for example, magnetic tapes, hard disks, etc.; and communication devices 409. Communication device 409 allows electronic device 400 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 8 An electronic device 400 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0119] In particular, according to embodiments of the present invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 409, or installed from a storage device 406, or installed from a ROM 402. When the computer program is executed by the processing device 401, it performs the functions defined in the methods of the embodiments of the present invention.

[0120] It should be noted that the computer-readable medium described above in this invention can be a computer-readable signal medium, a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0121] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0122] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0123] The aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: acquire at least two Internet Protocol (IP) addresses; send a node evaluation request including the at least two IP addresses to a node evaluation device, wherein the node evaluation device selects an IP address from the at least two IP addresses and returns it; and receive the IP address returned by the node evaluation device; wherein the acquired IP address indicates an edge node in a content delivery network.

[0124] Alternatively, the aforementioned computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: receive a node evaluation request including at least two Internet Protocol (IP) addresses; select an IP address from the at least two IP addresses; and return the selected IP address; wherein the received IP address indicates an edge node in the content delivery network.

[0125] Computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0126] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0127] The units described in the embodiments of the present invention can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0128] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0129] In the context of this invention, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media can include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0130] According to one or more embodiments of the present invention, Example 1 provides a method for handling stuttering, including:

[0131] When the preview frame rate of the video editing draft is less than the frame rate threshold, the material segment in the video editing draft corresponding to the preview frame rate is obtained for rendering the preview frame.

[0132] Based on the editing feature data of the material fragment, at least one stuttering handling strategy is determined;

[0133] Display a stuttering warning page according to the at least one stuttering handling strategy;

[0134] The stuttering prompt page includes stuttering operation controls corresponding to each stuttering handling strategy. These stuttering operation controls are used to execute the processing operations corresponding to the stuttering handling strategy.

[0135] According to one or more embodiments of the present invention, Example 2, based on the method of Example 1, the step of determining at least one stuttering handling strategy based on the editing feature data of the material fragment includes:

[0136] If the number of special effects in the edited feature data is greater than the number threshold, the pre-rendering strategy will be used as a stuttering handling strategy.

[0137] The pre-rendering strategy refers to performing pre-rendering operations on other material segments in the video editing draft that are located after the material segment, to obtain a pre-rendered frame sequence, which is used when previewing the preview frames corresponding to the other material segments.

[0138] According to one or more embodiments of the present invention, Example 3, based on the method described in Example 1, includes determining at least one stuttering handling strategy based on the editing feature data of the material fragment, comprising:

[0139] If at least one editing feature parameter in the editing feature data satisfies the editing feature condition, then the draft reporting strategy and / or the problem reporting strategy will be used as the lag handling strategy.

[0140] The editing feature parameters correspond one-to-one with the editing feature conditions. The draft reporting strategy means uploading the video editing draft to the stuttering processing platform. The problem reporting strategy means executing the display operation of the problem collection interface and uploading the problem description text entered by the user based on the problem collection interface to the stuttering processing platform.

[0141] According to one or more embodiments of the present invention, Example 4, based on the method of Example 1, the step of determining at least one stuttering handling strategy based on the editing feature data of the material fragment includes:

[0142] If at least one editing feature parameter in the editing feature data does not meet the editing feature conditions, then the transcoding acceleration strategy will be used as a stuttering handling strategy.

[0143] The at least one editing feature parameter includes at least one of the following: clip resolution, clip duration, image group length, and picture-in-picture level. The editing feature parameter corresponds one-to-one with the editing feature condition. The transcoding acceleration strategy represents the use of a preset transcoding technology to perform transcoding operations on the clip and other clips in the video editing draft located after the clip, to obtain clip transcoding data. The clip transcoding data is used when previewing the clip and the preview frames corresponding to the other clips.

[0144] According to one or more embodiments of the present invention, Example 5, based on the method described in Example 4, when the editing feature parameter is the resolution of the clip material, the editing feature condition is that the resolution of the clip material is less than a resolution threshold corresponding to the material format of the clip material, wherein the material format is a video format or an image format.

[0145] According to one or more embodiments of the present invention, Example 6 describes the method according to Example 4, wherein when the editing feature parameter is the segment duration, the editing feature condition includes the segment duration being greater than the duration threshold, and / or the segment duration being less than or equal to the duration threshold and the number of consecutive segments of the material segment being less than the number of consecutive segments threshold;

[0146] The term "segment continuity" represents the number of other material segments following the material segment in the video editing draft within a unit of time.

[0147] According to one or more embodiments of the present invention, Example 7, based on the method described in Example 4, wherein when the editing feature parameter is the image group length, the editing feature condition is that the image group length is less than a length threshold;

[0148] When the editing feature parameter is the number of picture-in-picture layers, the editing feature condition is that the number of picture-in-picture layers is less than the layer number threshold.

[0149] According to one or more embodiments of the present invention, Example 8, based on the method of any one of Examples 1-7, after obtaining the material segment in the video editing draft corresponding to the preview frame rate for rendering the preview frame, the method further includes:

[0150] In the draft preview page, the material clips are marked with stutters.

[0151] According to one or more embodiments of the present invention, Example 9 provides a method for handling stuttering, including:

[0152] The material fragment acquisition module is used to acquire material fragments in the video editing draft that correspond to the preview frame rate and are used to render the preview frame when the preview frame rate of the video editing draft is less than the frame rate threshold.

[0153] The stuttering handling strategy determination module is used to determine at least one stuttering handling strategy based on the editing feature data of the material segment;

[0154] A stuttering prompt page display module is used to display a stuttering prompt page according to the at least one stuttering handling strategy;

[0155] The stuttering prompt page includes stuttering operation controls corresponding to each stuttering handling strategy. These stuttering operation controls are used to execute the processing operations corresponding to the stuttering handling strategy.

[0156] According to one or more embodiments of the present invention, Example 10 provides an electronic device, comprising:

[0157] At least one processor; and

[0158] A memory communicatively connected to the at least one processor; wherein,

[0159] The memory stores a computer program that can be executed by the at least one processor to enable the at least one processor to perform the stuttering handling method described in any one of Examples 1-8.

[0160] According to one or more embodiments of the present invention, Example 11 provides a computer-readable storage medium storing computer instructions for causing a processor to execute the stuttering processing method described in any one of Examples 1-8.

[0161] According to one or more embodiments of the present invention, Example 12 provides a computer program product including a computer program that, when executed by a processor, implements the stuttering handling method according to any one of Examples 1-8.

[0162] The above description is merely a preferred embodiment of the present invention and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of disclosure in this invention is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this invention.

[0163] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the invention. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0164] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A method for handling stuttering, characterized in that, include: When the preview frame rate of the video editing draft is less than the frame rate threshold, the material segment in the video editing draft corresponding to the preview frame rate is obtained for rendering the preview frame. Based on the editing feature data of the material fragment, at least one stuttering handling strategy is determined; Display a stuttering warning page according to the at least one stuttering handling strategy; The stuttering prompt page includes stuttering operation controls corresponding to each stuttering handling strategy. These stuttering operation controls are used to execute the processing operations corresponding to the stuttering handling strategy.

2. The method according to claim 1, characterized in that, The step of determining at least one stuttering handling strategy based on the editing feature data of the material fragment includes: If the number of special effects in the edited feature data is greater than the number threshold, the pre-rendering strategy will be used as a stuttering handling strategy. The pre-rendering strategy refers to performing pre-rendering operations on other material segments in the video editing draft that are located after the material segment, to obtain a pre-rendered frame sequence, which is used when previewing the preview frames corresponding to the other material segments.

3. The method according to claim 1, characterized in that, The step of determining at least one stuttering handling strategy based on the editing feature data of the material fragment includes: If at least one editing feature parameter in the editing feature data satisfies the editing feature condition, then the draft reporting strategy and / or the problem reporting strategy will be used as the lag handling strategy. The editing feature parameters correspond one-to-one with the editing feature conditions. The draft reporting strategy means uploading the video editing draft to the stuttering processing platform. The problem reporting strategy means executing the display operation of the problem collection interface and uploading the problem description text entered by the user based on the problem collection interface to the stuttering processing platform.

4. The method according to claim 1, characterized in that, The step of determining at least one stuttering handling strategy based on the editing feature data of the material fragment includes: If at least one editing feature parameter in the editing feature data does not meet the editing feature conditions, then the transcoding acceleration strategy will be used as a stuttering handling strategy. The at least one editing feature parameter includes at least one of the following: clip resolution, clip duration, image group length, and picture-in-picture level. The editing feature parameter corresponds one-to-one with the editing feature condition. The transcoding acceleration strategy represents the use of a preset transcoding technology to perform transcoding operations on the clip and other clips in the video editing draft located after the clip, to obtain clip transcoding data. The clip transcoding data is used when previewing the clip and the preview frames corresponding to the other clips.

5. The method according to claim 4, characterized in that, When the editing feature parameter is the resolution of the clip material, the editing feature condition is that the resolution of the clip material is less than the resolution threshold corresponding to the material format of the clip material, and the material format is a video format or an image format.

6. The method according to claim 4, characterized in that, When the editing feature parameter is the segment duration, the editing feature conditions include the segment duration being greater than the duration threshold, and / or the segment duration being less than or equal to the duration threshold and the number of consecutive segments in the material segment being less than the number of consecutive segments threshold; The term "segment continuity" represents the number of other material segments following the material segment in the video editing draft within a unit of time.

7. The method according to claim 4, characterized in that, When the editing feature parameter is the image group length, the editing feature condition is that the image group length is less than a length threshold; When the editing feature parameter is the number of picture-in-picture layers, the editing feature condition is that the number of picture-in-picture layers is less than the number of layers threshold.

8. The method according to any one of claims 1-7, characterized in that, After obtaining the media clips in the video editing draft that correspond to the preview frame rate and are used to render the preview frame, the method further includes: In the draft preview page, the material clips are marked with stutters.

9. A stuttering handling device, characterized in that, include: The material segment acquisition module is used to acquire material segments in the video editing draft that correspond to the preview frame rate and are used to render the preview frame when the preview frame rate of the video editing draft is less than the frame rate threshold. The stuttering handling strategy determination module is used to determine at least one stuttering handling strategy based on the editing feature data of the material segment; A stuttering prompt page display module is used to display a stuttering prompt page according to the at least one stuttering handling strategy; The stuttering prompt page includes stuttering operation controls corresponding to each stuttering handling strategy. These stuttering operation controls are used to execute the processing operations corresponding to the stuttering handling strategy.

10. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the stuttering processing method according to any one of claims 1-8.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the stuttering handling method according to any one of claims 1-8.

12. A computer program product comprising a computer program that, when executed by a processor, implements the stuttering processing method according to any one of claims 1-8.

Images