Video processing method and device, electronic equipment and storage medium

Abstract

The present disclosure relates to a video processing method and device, electronic equipment and storage medium. The method comprises: displaying a video processing page; the video processing page displays a to-be-processed video and at least two key frames extracted from the to-be-processed video; the to-be-processed video comprises at least two key video segments satisfying a preset condition, and the at least two key video segments correspond to the at least two key frames one by one; each key frame is a video frame in which an object first appears in a corresponding key video segment; in response to an associated information display operation triggered based on a target key frame, an associated video frame corresponding to the target key frame is displayed in the video processing page; and in response to a processing operation on the target key frame and the associated video frame, a current processing result corresponding to the target key frame and the associated video frame is obtained. The scheme of the present disclosure can improve the processing efficiency of video processing.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of computer, and particularly relates to a video processing method and device, electronic equipment and storage medium. BACKGROUND

[0002] With the development of Internet technology, at present, more and more videos are published on the network, and in order to supervise the published videos, the video publishing platform needs to process and label each video before publishing it.

[0003] In the related art, the video processing result is obtained only after all the videos are completely viewed, the video processing time is long, and the processing efficiency of video processing is reduced. SUMMARY

[0004] The present disclosure provides a video processing method and device, electronic equipment and storage medium to at least solve the problem that in the related art, the video processing result is obtained only after all the videos are completely viewed, the video processing time is long, and the processing efficiency of video processing is reduced. The technical solutions of the present disclosure are as follows:

[0005] According to a first aspect of an embodiment of the present disclosure, a video processing method is provided, comprising:

[0006] displaying a video processing page; the video processing page displays a to-be-processed video and at least two key frames extracted from the to-be-processed video; the to-be-processed video includes at least two key video segments that meet a preset condition, and the at least two key video segments correspond one-to-one to the at least two key frames; each key frame is a video frame in which an object first appears in the corresponding key video segment;

[0007] in response to an associated information display operation triggered based on a target key frame, displaying an associated video frame corresponding to the target key frame in the video processing page; the associated video frame is a video frame in a candidate key video segment, and an object in the associated video frame is the same as an object in the target key frame; the candidate key video segment is a key video segment other than a target key video segment in the at least two key video segments; the target key video segment corresponds to the target key frame; the target key frame is any one of the at least two key frames;

[0008] in response to a processing operation on the target key frame and the associated video frame, obtaining a current processing result corresponding to the target key frame and the associated video frame.

[0009] In an optional embodiment, the obtaining the current processing result corresponding to the target key frame and the associated video frame in response to the processing operation on the target key frame and the associated video frame comprises:

[0010] In a case where it is determined to perform the associated processing on the video frames containing the same object, the processing exception page is displayed in response to the processing operation on the target key frame and the associated video frame; the target key frame, the associated video frame, candidate abnormal processing information, and content association information associated with the content of the abnormal video frame are displayed in the processing exception page; the abnormal video frame comprises the target key frame and the associated video frame, and the candidate abnormal processing information represents information that does not meet a preset processing condition;

[0011] The current processing result is obtained in response to a selection operation based on the candidate abnormal processing information.

[0012] In an optional embodiment, the content association information comprises an object group and description information corresponding to the object group; the object group represents a set of objects to be recommended by the abnormal video frame; the processing exception page comprises a first area, a second area, and a third area; and the displaying the processing exception page comprises:

[0013] The target key frame and the associated video frame are displayed in the first area; the candidate abnormal processing information is displayed in the second area; and the first identification information of the object group and the second identification information of the description information are displayed in the third area.

[0014] In an optional embodiment, the first identification information of the object group is connected to the second identification information of the description information through first connection information, and the second identification information of the description information is connected to the abnormal video frame through second connection information; and after the displaying the processing exception page, the method further comprises:

[0015] In response to a triggering operation based on the first identification information, the first identification information and identification information of content belonging to the object group are displayed in a first preset form; or in response to a triggering operation based on the second identification information, the second identification information and identification information of content belonging to the description information are displayed in a second preset form; or in response to an operation instruction triggered based on target connection information, identification information connected to the target connection information and the second connection information are displayed in a third preset form; the target connection information is any one of the first connection information and the second connection information.

[0016] The obtaining the current processing result in response to the selection operation based on the candidate abnormal processing information comprises:

[0017] In response to the selection operation based on the candidate anomaly processing information, the current processing result of the object group and / or description information corresponding to the identification information is obtained and displayed in a preset form.

[0018] In an optional embodiment, obtaining the current processing result in response to the selection operation based on the candidate anomaly handling information includes:

[0019] In response to the selection operation based on the candidate anomaly handling information, the candidate anomaly handling information corresponding to the selection operation is displayed in the second area in a fourth preset form to obtain the current processing result.

[0020] In an optional embodiment, a processing and editing area is displayed within a preset range of the location of the second region. In response to a selection operation based on the candidate exception handling information, the candidate exception handling information corresponding to the selection operation is displayed in the second region in a fourth preset format to obtain the current processing result, including:

[0021] In response to a selection operation based on the candidate anomaly handling information, the candidate anomaly handling information corresponding to the selection operation is displayed in the second area in a fourth preset format.

[0022] In response to an editing operation based on the processing editing area, the newly added processing result corresponding to the editing operation is displayed in the second area;

[0023] The candidate exception handling information corresponding to the selection operation and the newly added processing result are determined as the current processing result.

[0024] In an optional embodiment, the exception handling page displays a processing information confirmation control, and after obtaining the current processing result, the method further includes:

[0025] In response to the triggering operation of the control determined based on the processing information, the current processing result is displayed on the processing comparison page.

[0026] In an optional embodiment, the associated information display operation includes a hover operation, and the display of associated video frames corresponding to the target keyframe in the video processing page in response to the associated information display operation triggered based on the target keyframe includes:

[0027] In response to a hover operation triggered based on the target keyframe, the target key video segment corresponding to the target keyframe is played on the video processing page, and the associated video frame is displayed on the video processing page.

[0028] In an optional embodiment, the step of playing the target key video segment corresponding to the target key frame in the video processing page and displaying the associated video frame in response to a hover operation triggered based on the target key frame includes:

[0029] In response to a hover operation triggered based on the target keyframe, the target key video segment is displayed in a paused manner on the video processing page;

[0030] In response to a triggered operation based on a target key video clip displayed in a paused state, the target key video clip is played at a preset speed on the video processing page, and the associated video frame is displayed in a floating window on the video processing page.

[0031] In an optional embodiment, the video to be processed includes multiple video segments, each video segment corresponding to video and audio data, and the at least two key video segments that meet preset conditions include:

[0032] Among the multiple video segments, the video segment in which the object that first appears matches the object to which the video audio data belongs; and among the multiple video segments, the video audio data is narration and the object to which the video audio data belongs is the same preset object.

[0033] In an optional embodiment, after obtaining the current processing result corresponding to the target keyframe and the associated video frame in response to the processing operation for the target keyframe and the associated video frame, the method further includes:

[0034] The processing comparison page is displayed; the processing comparison page shows the video to be processed, the processing result of the video to be processed, and the processing node information of the video to be processed;

[0035] The processing result of the video to be processed includes the current processing result and the historical processing result. The current processing result is used to compare the processing accuracy of the historical processing result. The processing node information includes the current processing node information corresponding to the current processing result and the historical processing node information corresponding to the historical processing result. The current processing node information represents the start time of the key video segment to which the video frame corresponding to the current processing result belongs, and the historical processing node information represents the start time of the video segment to which the key video frame corresponding to the historical processing result belongs.

[0036] In an optional embodiment, the processing comparison page includes a fourth region, a fifth region, and a sixth region, and the display of the processing comparison page includes:

[0037] The fourth area displays the video to be processed; the fifth area displays the current processing result and historical processing result of the video to be processed; and the sixth area displays the current playback progress information, current processing node information, and historical processing node information of the video to be processed.

[0038] In an optional embodiment, the fourth area also displays a node navigation control, and the method further includes:

[0039] In response to the trigger operation based on the node jump control, the video frame corresponding to the first target processing node information is displayed;

[0040] The start time represented by the first target processing node information is adjacent to the playback time corresponding to the current playback progress information and is located after the playback time corresponding to the current playback progress information.

[0041] In an optional embodiment, the method further includes:

[0042] During the playback of the video to be processed, if a second target processing node information exists within a preset time after the currently playing video frame, the video frame corresponding to the second target processing node information is displayed on the processing comparison page, and a processing area corresponding to the processing result of the second target processing node information is displayed on the video frame corresponding to the second target processing node information.

[0043] The second target processing node information is the processing node information in the current processing node information and the historical processing node information.

[0044] According to a second aspect of the present disclosure, a video processing apparatus is provided, comprising:

[0045] The video processing page display module is configured to execute and display a video processing page; the video processing page displays a video to be processed and at least two key frames extracted from the video to be processed; the video to be processed includes at least two key video segments that meet preset conditions, and the at least two key video segments correspond one-to-one with the at least two key frames; each key frame is the video frame in which the object first appears in the corresponding key video segment;

[0046] The associated video frame display module is configured to perform an associated information display operation triggered based on a target keyframe, displaying associated video frames corresponding to the target keyframe on the video processing page; the associated video frames are video frames among candidate key video segments, and the objects in the associated video frames are the same as the objects in the target keyframe; the candidate key video segments are key video segments other than the target key video segment among the at least two key video segments; the target key video segment corresponds to the target keyframe; the target keyframe is any one of the at least two keyframes;

[0047] The processing operation response module is configured to perform processing operations in response to the target keyframe and the associated video frame, and obtain the current processing result corresponding to the target keyframe and the associated video frame.

[0048] In an optional embodiment, the processing operation response module includes:

[0049] The exception handling page display unit is configured to, in response to the processing operation on the target keyframe and the associated video frame, display an exception handling page when it is determined that associated processing is to be performed on video frames containing the same object; the exception handling page displays the target keyframe, the associated video frame, candidate exception handling information, and content association information associated with the content of the exception video frame; the exception video frame includes the target keyframe and the associated video frame, and the candidate exception handling information represents information that does not meet preset processing conditions;

[0050] The current processing result determination unit is configured to perform a selection operation based on the candidate exception processing information to obtain the current processing result.

[0051] In an optional embodiment, the content association information includes an object group and corresponding description information for the object group. The object group represents a set of objects to be recommended for the abnormal video frame. The abnormal processing page includes a first area, a second area, and a third area. The abnormal processing page display unit is configured to display the target keyframe and the associated video frame in the first area, display the candidate abnormal processing information in the second area, and display the first identification information of the object group and the second identification information of the description information in the third area.

[0052] In an optional embodiment, the first identification information of the object group is connected to the second identification information of the description information via first connection information, and the second identification information of the description information is connected to the abnormal video frame via second connection information. The device further includes:

[0053] The preset format display module is configured to, in response to a trigger operation based on the first identifier information, display the first identifier information and the identifier information of the content belonging to the object group in a first preset format; or, in response to a trigger operation based on the second identifier information, display the second identifier information and the identifier information of the content belonging to the description information in a second preset format; or, in response to an operation instruction triggered based on target connection information, display the identifier information connected to the target connection information and the second connection information in a third preset format; wherein the target connection information is any one of the first connection information and the second connection information.

[0054] The current processing result determination unit is configured to perform a selection operation based on the candidate anomaly processing information to obtain the current processing result of the object group and / or description information corresponding to the identification information displayed in a preset form.

[0055] In an optional embodiment, the current processing result determination unit is configured to perform a selection operation based on the candidate anomaly processing information in response to the selection operation, display the candidate anomaly processing information corresponding to the selection operation in the second region in a fourth preset form, and obtain the current processing result.

[0056] In an optional embodiment, a processing and editing area is displayed within a preset range of the location of the second region, and the current processing result determination unit includes:

[0057] The selection operation response subunit is configured to perform a selection operation in response to the candidate exception handling information, and to display the candidate exception handling information corresponding to the selection operation in the second area in a fourth preset form.

[0058] A new processing result display subunit is added, which is configured to perform a response to an editing operation based on the processing editing area and display the new processing result corresponding to the editing operation in the second area;

[0059] The current processing result determination subunit is configured to determine the candidate exception handling information corresponding to the selection operation and the newly added processing result as the current processing result.

[0060] In an optional embodiment, the exception handling page displays a processing information confirmation control, and the device further includes:

[0061] The control triggering module is configured to perform a triggering operation in response to determining the control based on the processing information, so as to display the current processing result on the processing comparison page.

[0062] In an optional embodiment, the associated information display operation includes a hover operation, and the associated video frame display module includes:

[0063] The hover operation response module is configured to perform a hover operation triggered based on the target keyframe, play the target key video segment corresponding to the target keyframe on the video processing page, and display the associated video frame on the video processing page.

[0064] In an optional embodiment, the hover operation response module includes:

[0065] The target key video clip display unit is configured to perform a hover operation triggered based on the target key frame, and display the target key video clip in a paused form on the video processing page.

[0066] The associated video frame display unit is configured to perform a trigger operation in response to a target key video segment displayed in a paused form, play the target key video segment at a preset speed on the video processing page, and display the associated video frame in a floating window on the video processing page.

[0067] In an optional embodiment, the video to be processed includes multiple video segments, each video segment corresponding to video and audio data, and the at least two key video segments that meet preset conditions include:

[0068] Among the multiple video segments, the video segment in which the object that first appears matches the object to which the video audio data belongs; and among the multiple video segments, the video audio data is narration and the object to which the video audio data belongs is the same preset object.

[0069] In an optional embodiment, the apparatus further includes:

[0070] The processing comparison page display module is configured to display the processing comparison page; the processing comparison page displays the video to be processed, the processing result of the video to be processed, and the processing node information of the video to be processed;

[0071] The processing result of the video to be processed includes the current processing result and the historical processing result. The current processing result is used to compare the processing accuracy of the historical processing result. The processing node information includes the current processing node information corresponding to the current processing result and the historical processing node information corresponding to the historical processing result. The current processing node information represents the start time of the key video segment to which the video frame corresponding to the current processing result belongs, and the historical processing node information represents the start time of the video segment to which the key video frame corresponding to the historical processing result belongs.

[0072] In an optional embodiment, the processing comparison page includes a fourth region, a fifth region, and a sixth region. The processing comparison page display module is configured to display the video to be processed in the fourth region; display the current processing result and historical processing result of the video to be processed in the fifth region; and display the current playback progress information, current processing node information, and historical processing node information of the video to be processed in the sixth region.

[0073] In an optional embodiment, the fourth area also displays a node navigation control, and the device further includes:

[0074] The node jump module is configured to perform a response to a trigger operation based on the node jump control, and display the video frame corresponding to the first target processing node information;

[0075] The start time represented by the first target processing node information is adjacent to the playback time corresponding to the current playback progress information and is located after the playback time corresponding to the current playback progress information.

[0076] In an optional embodiment, the apparatus further includes:

[0077] The processing area display module is configured to, during the playback of the video to be processed, if a second target processing node information exists within a preset time after the currently playing video frame, display the video frame corresponding to the second target processing node information on the processing comparison page, and display the processing area corresponding to the processing result of the second target processing node information on the video frame corresponding to the second target processing node information.

[0078] The second target processing node information is the processing node information in the current processing node information and the historical processing node information.

[0079] According to a third aspect of the present disclosure, an electronic device is provided, comprising:

[0080] processor;

[0081] Memory used to store the processor's executable instructions;

[0082] The processor is configured to execute the instructions to implement the video processing method as described in any of the above embodiments.

[0083] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device performs a video processing method as described in any of the above embodiments.

[0084] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the video processing method described in any of the above embodiments.

[0085] The video processing method, apparatus, electronic device, and storage medium provided in this disclosure display a video processing page. The video processing page displays a video to be processed and at least two key frames extracted from the video to be processed. The video to be processed includes at least two key video segments that meet preset conditions, and the at least two key video segments correspond one-to-one with at least two key frames. Each key frame is the video frame in which the object first appears in the corresponding key video segment. In response to the operation of displaying associated information triggered by the target keyframe, the associated video frames corresponding to the target keyframe are displayed on the video processing page. The associated video frames are video frames in the candidate key video segments, and the objects in the associated video frames are the same as the objects in the target keyframe. The candidate key video segments are key video segments other than the target key video segment among at least two key video segments. The target key video segment corresponds to the target keyframe. The target keyframe is any one of the at least two keyframes. In response to the processing operation on the target keyframe and the associated video frames, the technical solution obtains the current processing results corresponding to the target keyframe and the associated video frames. This achieves a method based on reasonable video segment division and keyframe extraction, and a processing method that replaces video viewing with image viewing. The processing results can be obtained without viewing the complete video, improving the efficiency of video processing. At the same time, batch processing can be performed based on the associated video frames to quickly determine abnormal information in the video to be processed, which not only further improves the processing efficiency of video processing, but also improves the processing quality of video processing.

[0086] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0087] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0088] Figure 1 This is a schematic diagram illustrating an application environment for video processing according to an exemplary embodiment.

[0089] Figure 2 This is a flowchart illustrating a video processing method according to an exemplary embodiment.

[0090] Figure 3This is a schematic diagram of a video processing page according to an exemplary embodiment.

[0091] Figure 4 This is a schematic diagram illustrating a target key video segment played and associated video frames displayed on a video processing page, according to an exemplary embodiment.

[0092] Figure 5 This is a flowchart illustrating, according to an exemplary embodiment, a method for obtaining the current processing result corresponding to a target keyframe and associated video frames.

[0093] Figure 6 This is a schematic diagram illustrating a method for handling abnormal pages according to an exemplary embodiment.

[0094] Figure 7 This is a schematic diagram illustrating a process for comparing pages according to an exemplary embodiment.

[0095] Figure 8 This is a schematic diagram illustrating another process for comparing pages according to an exemplary embodiment.

[0096] Figure 9 This is a block diagram of a video processing apparatus according to an exemplary embodiment.

[0097] Figure 10 This is a block diagram illustrating an electronic device for video processing according to an exemplary embodiment. Detailed Implementation

[0098] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0099] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0100] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0101] Please seeFigure 1 , Figure 1 This is a schematic diagram illustrating an application environment for video processing according to an exemplary embodiment, such as... Figure 1 As shown, the application environment may include terminal 01 and server 02.

[0102] In an optional embodiment, terminal 01 can be used to display a video processing page; and to display associated video frames corresponding to the target keyframe in the video processing page in response to an associated information display operation triggered based on the target keyframe; and to obtain the current processing result corresponding to the target keyframe and associated video frames in response to processing operations on the target keyframe and associated video frames. Specifically, server 02 can be, but is not limited to, electronic devices such as smartphones, desktop computers, tablets, laptops, smart speakers, digital assistants, augmented reality (AR) / virtual reality (VR) devices, and smart wearable devices. Optionally, the operating system running on the electronic device can be, but is not limited to, Android, iOS, Linux, Windows, etc.

[0103] In an optional embodiment, server 02 can be used to provide background services to terminal 01. Exemplarily, server 02 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms.

[0104] In addition, it should be noted that, Figure 1 The example shown is merely one application environment of the video processing method provided in this disclosure. Other application environments may exist in other scenarios, and this disclosure does not limit them.

[0105] Figure 2 This is a flowchart illustrating a video processing method according to an exemplary embodiment, such as... Figure 2 As shown, this video processing method is used for Figure 1 The terminal in the process includes the following steps.

[0106] In step S11, a video processing page is displayed; the video processing page displays a video to be processed and at least two key frames extracted from the video to be processed; the video to be processed includes at least two key video segments that meet preset conditions, and the at least two key video segments correspond one-to-one with at least two key frames; each key frame is the video frame in which the object first appears in the corresponding key video segment.

[0107] Optionally, the video to be processed can be of various types, including but not limited to: short videos, game videos, news videos, shopping videos, etc.

[0108] Optionally, the video to be processed may include multiple video segments, which can be divided into segments according to a preset time period. The at least two key video segments can be video segments that meet preset conditions among the multiple video segments. The preset conditions can be set according to actual business needs, and this embodiment does not specifically limit them.

[0109] Optionally, each of the at least two key video clips corresponds one-to-one with at least two key frames, meaning each key video clip corresponds to one key frame. For example, each key frame is the video frame containing the first appearance of an object in the corresponding key video clip. This object can be of various types, including but not limited to: people, animals, goods, etc. For instance, if a key video clip consists of 10 frames, and a person first appears in the 3rd frame, then the 3rd frame is taken as the key frame corresponding to that key video clip.

[0110] It should be noted that if the video to be processed contains multiple types of objects, the priority of human objects should be set higher than that of other object types. That is, the video frame containing the first appearance of a human object in a key video segment is designated as the keyframe for that segment.

[0111] In step S13, in response to the associated information display operation triggered based on the target keyframe, the associated video frame corresponding to the target keyframe is displayed on the video processing page; the associated video frame is a video frame in the candidate key video segment, and the object in the associated video frame is the same as the object in the target keyframe; the candidate key video segment is a key video segment other than the target key video segment among at least two key video segments; the target key video segment corresponds to the target keyframe; the target keyframe is any one of the at least two keyframes.

[0112] Optionally, the target keyframe can be any one of the at least two keyframes. The associated information display operation can be any operation triggered on the target keyframe according to actual business needs, such as hover operation, click operation, etc., and this disclosure embodiment does not specifically limit it.

[0113] Optionally, the object in the associated video frame is the same as the object in the target keyframe. For example, if the object in the target keyframe is a person, then the object in the associated video frame is also that person. The terminal can use the key video segment corresponding to the target keyframe as the target key video segment, that is, the target keyframe is the video frame containing the first appearance of the object in the target key video segment. The terminal can also use key video segments other than the target key video segment from at least two key video segments as candidate key video segments, and use the video frame containing the same person object from the corresponding video frame of the candidate key video segment as the associated video frame. That is, the associated video frame can be a video frame from different candidate key video segments containing the same object as the target keyframe.

[0114] For example, at least two key video clips include key video clip 1, key video clip 2, key video clip 3, key video clip 4, and key video clip 5. The key video clip corresponding to the target keyframe is key video clip 1, and the first object appearing in key video clip 1 is person object 1. Then, the candidate key video clips are key video clip 2, key video clip 3, key video clip 4, and key video clip 5. The video frame in key video clip 2, key video clip 3, key video clip 4, and key video clip 5 that contains person object 1 is taken as the associated video frame. It can be seen that the associated video frame can be a video frame containing person object 1 from multiple key video clips.

[0115] In step S15, in response to the processing operations on the target keyframe and associated video frame, the current processing result corresponding to the target keyframe and associated video frame is obtained.

[0116] Optionally, the processing operation can be any operation triggered based on actual business needs, targeting the target keyframe and associated video frames, and this embodiment does not specifically limit it. The current processing result can be the batch processing result of the target keyframe and associated video frames, that is, the current processing result includes the processing result of the target keyframe and the processing result of the associated video frames, so as to realize batch processing based on associated segments.

[0117] This embodiment of the disclosure obtains at least two key video segments by reasonably dividing the video to be processed into segments. Keyframe extraction is then performed on these key video segments, with the video frame containing the first occurrence of an object in each segment serving as the corresponding keyframe. The video to be processed, along with the extracted keyframes, is displayed on the video processing page on the terminal. This achieves a method based on reasonable video segment division and keyframe extraction, and replaces the traditional video viewing method with an image-based processing method. The processing result can be obtained without viewing the complete video, improving video processing efficiency. Furthermore, by displaying associated video frames corresponding to the target keyframes on the video processing page, batch processing can be performed on these associated video frames to achieve rapid preview processing of video segments containing the same object. This allows for quick identification of anomalies in the video to be processed, further improving both processing efficiency and quality.

[0118] In an optional embodiment, in step S11 above, the display video processing page may include:

[0119] A processing system page is displayed, containing processing controls. In response to a trigger operation based on these processing controls, the video processing page is displayed. This video processing page may include a video display area and a keyframe display area. The video display area displays the video to be processed, and the keyframe display area displays at least two keyframes. The keyframe display area and the video display area can be located anywhere on the video processing page; this embodiment does not impose specific limitations on this. It should be noted that the video to be processed displayed on the video processing page can be paused. When the terminal receives a playback operation for the video to be processed, the terminal can play the video through a player. Alternatively, the video to be processed displayed on the video processing page can also be in playback mode.

[0120] Figure 3 This is a schematic diagram of a video processing page according to an exemplary embodiment, such as... Figure 3 As shown, the video display area is located to the right of the keyframe display area. The video to be processed can be paused / played using a player in this video display area. The keyframe display area can display at least two keyframes according to a preset arrangement, for example, as shown... Figure 3 The keyframes shown are 1, 2, 3, 4, 5, 6, ...

[0121] In an optional embodiment, the video to be processed includes multiple video segments, each corresponding to video-audio data. The aforementioned at least two key video segments satisfying the preset conditions include: a video segment in which the object appearing for the first time matches the object to which the video-audio data belongs; and a video segment in which the object to which the video-audio data belongs is a preset object. Here, "the object to which the video-audio data belongs" refers to the object that emitted the video-audio data. The "preset object" refers to the same object, such as the same person object, robot object, etc.

[0122] For example, taking a person as an example, the process of determining at least two key video clips that meet the preset conditions is explained as follows:

[0123] The video to be processed is divided into multiple video segments according to its playback time and a preset time period. Face recognition is performed on each video segment, with the first appearing face serving as the starting marker. The face recognition result for each video segment is obtained, and the video-audio data within each segment is analyzed to determine the object to which the video-audio data belongs. If the face recognition result of a video segment matches the object to which the video-audio data belongs within that segment's playback time, it indicates a temporal relationship between the face recognition result and the object to which the video-audio data belongs, and this video segment is designated as a key video segment. If the object to which the video-audio data belongs in a video segment is the same person speaking in a narration style, this video segment is also designated as a key video segment, and the object in the keyframes corresponding to this key video segment is determined by the object represented by the face recognition result of that video segment. If a video segment is described by different objects, and the face recognition result of the video segment does not match the object to which the video and audio data of the video segment belong, it means that there is no corresponding time relationship between the face recognition result and the object to which the video and audio data belong during the time period of the video segment's playback. In this case, the video segment is discarded and will not be used as the key video segment.

[0124] For example, the video to be processed is divided into video segments 1, 2, 3, 4, and 5 according to its playback time and a preset time period. The first appearance of a face is used as the starting marker for each video segment. Face recognition processing is performed on video segments 1, 2, 3, 4, and 5, yielding the face recognition result 1 for video segment 1, 2 for video segment 2, 3 for video segment 3, 4 for video segment 4, and 5 for video segment 5. The video and audio data in each video segment are analyzed to determine the object 1, object 2, object 3, object 4, and object 5 of the video and audio data pairs in video segment 1, 2, 3, 4, and 5, respectively. If face recognition result 1 matches object 1, face recognition result 2 matches object 2, the video audio data in video segment 3 is the narration-style audio of object 3 speaking, face recognition result 4 does not match object 4, and face recognition result 5 does not match object 5, then video segment 1, video segment 2, and video segment 3 will be used as the at least two key video segments.

[0125] This embodiment of the disclosure determines the similarity between the object recognition result in the video to be processed and the corresponding object in the video audio data. It extracts at least two key video segments that meet preset conditions from multiple video segments included in the video to be processed. This can effectively remove the background part in the video to be processed, avoiding the problems of long video processing time and high processing cost caused by processing the background part. It realizes that based on reasonable video segment division, the video processing result can be obtained without viewing the complete video, thereby improving the processing efficiency of video processing and reducing the processing cost of video processing.

[0126] In an optional embodiment, in step S13 above, the associated information display operation includes a hover operation. The above-mentioned display of associated video frames corresponding to the target keyframe in the video processing page in response to the associated information display operation triggered based on the target keyframe may include:

[0127] In response to a hover operation triggered by a target keyframe, the target key video segment corresponding to the target keyframe is played on the video processing page, and the associated video frames are displayed on the video processing page.

[0128] In this embodiment, the associated information display operation can be a hover operation, which means that when the operation object (e.g., mouse) hovers on the target keyframe, the corresponding content can pop up in the vicinity of the target keyframe.

[0129] A terminal account can hover an object (e.g., a mouse) over a target keyframe for a preset time, triggering a hover operation on that keyframe. In response, the terminal plays the corresponding key video segment on the video processing page and displays associated video frames. For example, the terminal can play the corresponding key video segment at the location of the keyframe and display associated video frames around it, thus enabling rapid previewing of video segments containing the same object and further improving video processing efficiency.

[0130] Optionally, the above-mentioned response to the hover operation triggered based on the target keyframe, playing the target key video segment corresponding to the target keyframe in the video processing page, and displaying the associated video frame in the video processing page can be achieved in various ways, without specific limitations here.

[0131] In one implementation, the above-mentioned response to a hover operation triggered based on a target keyframe, playing the target key video segment corresponding to the target keyframe on the video processing page, and displaying associated video frames on the video processing page, may include:

[0132] In response to a hover operation triggered based on a target keyframe, the target key video clip is displayed in a paused manner on the video processing page;

[0133] In response to a triggered operation based on a target key video clip displayed in a paused state, the target key video clip is played at a preset speed on the video processing page, and associated video frames are displayed in a floating window on the video processing page.

[0134] In this embodiment, a terminal account can hover an object (e.g., a mouse) over a target keyframe for a preset time, thereby triggering a hover operation on the target keyframe. In response to this hover operation, the terminal retrieves the target key video segment corresponding to the target keyframe, i.e., the hover operation retrieves the target key video segment. The player in the terminal can pause the target key video segment, and the currently displayed video frame of the paused target key video segment is the target keyframe. The terminal account clicks on the paused target key video segment, thereby triggering a playback operation on the target key video segment. In response to this playback operation, the terminal's player plays the target key video segment at a preset speed and displays the associated video frame in a floating window within a preset area on the video processing page where the target key video segment is located.

[0135] For example, the floating window can be displayed anywhere on the video processing page, and this disclosure does not specifically limit this. For instance, the floating window may be displayed in the right-hand area where the target key video segment is located.

[0136] It should be noted that, since associated video frames can be video frames from different candidate key video segments containing the same objects as the target key frame, associated video frames belonging to different candidate key video segments can be displayed simultaneously. Furthermore, to improve the terminal account's ability to identify associated video frames belonging to different candidate key video segments and enhance the convenience and interactive experience of video processing, associated video frames belonging to different candidate key video segments can be marked accordingly. For example, associated video frames belonging to different candidate key video segments can be displayed in different formats, while associated video frames belonging to the same candidate key video segment can be displayed in the same format.

[0137] It should be noted that, since the target keyframe is any one of at least two keyframes, any one keyframe can display its corresponding associated video frames in the manner described above. For example, Figure 3 Keyframes 1 through 6 in the video can all be displayed in the manner described above, showing their corresponding associated video frames.

[0138] It should be noted that if there are a large number of related video frames, they can be displayed in batches. For example, batch display can be based on candidate key video segments, that is, related video frames belonging to the same candidate key video segment are displayed in the same batch. Batch display can also be based on time, that is, the related video frames are displayed in batches according to the order of their playback time in the corresponding candidate key video segments.

[0139] In this embodiment, the target key video segment can be conveniently displayed through a hover operation. After hovering over the target key video segment, it is first displayed in a paused state, which conveniently notifies the terminal account that the target key video segment has been hovered over, improving the convenience of video processing for the terminal account. Simultaneously, in response to the trigger operation based on the paused display of the target key video segment, the terminal can play the entire target key video segment at a preset speed on the video processing page, achieving a rapid display of the target key video segment. This allows the terminal account to quickly preview the target key video segment and quickly identify any abnormal information in the video to be processed. Furthermore, in response to this trigger operation, the terminal can also display related video frames in a floating window, enabling batch processing based on related video frames. This allows for a rapid preview of video segments containing the same object, thereby quickly identifying any abnormal information in the video to be processed. This not only further improves the processing efficiency but also enhances the processing quality.

[0140] Figure 4 This is a schematic diagram illustrating a target key video segment played and associated video frames displayed on a video processing page, according to an exemplary embodiment. Figure 4 As shown, the target keyframe is keyframe 2. After the terminal hovers over the target key video segment corresponding to keyframe 2, it can pause the target key video segment, and the target key video segment corresponding to keyframe 2 will be paused on keyframe 2. Furthermore, the terminal can also display the associated video frames in a floating window in the right-hand area of ​​the location of the target key video segment corresponding to keyframe 2. For example, associated video frames 1, 2, 3, 4, and so on can be displayed in a floating window. It should be noted that the associated video frames displayed in a floating window may obscure existing content on the video processing page.

[0141] In one implementation, the aforementioned response to a hover operation triggered by a target keyframe, playing the target key video segment corresponding to the target keyframe on the video processing page, and displaying associated video frames on the video processing page, may include: responding to a hover operation triggered by a target keyframe, playing the target key video segment at a preset speed on the video processing page, and displaying associated video frames in a floating window on the video processing page. That is, after hovering over the target key video segment, the target key video segment can be played directly, and associated video frames can be displayed in a floating window.

[0142] In an optional embodiment, Figure 5 This is a flowchart illustrating, according to an exemplary embodiment, a method for obtaining the current processing result corresponding to a target keyframe and associated video frames, such as... Figure 5As shown, in step S15 above, the process of obtaining the current processing result corresponding to the target keyframe and associated video frame in response to the processing operation on the target keyframe and associated video frame may include:

[0143] In step S151, when it is determined that video frames containing the same object will be associated, a processing exception page is displayed in response to the processing operation on the target keyframe and the associated video frame. The processing exception page displays the target keyframe, the associated video frame, candidate exception processing information, and content association information associated with the content of the exception video frame. The exception video frame includes the target keyframe and the associated video frame, and the candidate exception processing information represents information that does not meet the preset processing conditions.

[0144] In step S153, in response to the selection operation based on candidate anomaly handling information, the current processing result is obtained.

[0145] In this embodiment, the terminal first determines whether to enable association processing for video frames containing the same object. If yes, steps S151-S153 are executed; otherwise, steps S151-S153 are not executed. Optionally, there can be multiple ways to enable association processing for video frames containing the same object, and this embodiment does not specifically limit this. In one implementation, an association processing control can be set in the video processing system. The terminal responds to the terminal account's pre-operation of the association processing control, thereby enabling association processing for video frames containing the same object.

[0146] Optionally, in step S151 above, if it is determined that associated processing is being performed on video frames containing the same object, and the terminal account detects an anomaly in the target keyframe and / or associated video frames, the terminal displays an anomaly processing page in response to the terminal account's processing operation on the target keyframe and associated video frames. For example, this processing operation can take various forms. For instance, the processing operation could be a click operation by the terminal account on the target keyframe. The processing operation could also be an operation triggered by the terminal account clicking the target keyframe and then pressing a preset key on the keyboard (e.g., the W key).

[0147] Optionally, the exception handling page may display not only the target keyframe and associated video frames, but also candidate exception handling information, which represents information that does not meet the preset processing conditions. For example, the candidate exception handling information may include, but is not limited to: unauthorized by celebrities, unauthorized by third parties, institutions, programs, etc., and unauthorized by animation or original works.

[0148] Optionally, the error handling page may also display content association information related to the content of the abnormal video frame, including the target keyframe and associated video frames. For example, the content association information may include an object group associated with the content of the abnormal video frame and corresponding descriptive information for that object group. For example, the object group may be a collection of objects to be recommended by the abnormal video frame (e.g., an ad group), and the descriptive information may be information describing the characteristics of the object group (e.g., creative information). It should be noted that there may be at least one object group, and each object group may include at least one descriptive information.

[0149] Optionally, in step S153 above, the number of candidate anomaly processing information can be at least one. The terminal can respond to the selection operation triggered by the terminal account based on at least one of the candidate anomaly processing information, and use the selected candidate anomaly processing information as the current processing result of the association processing of the target key frame and the associated video frame.

[0150] In this embodiment, when performing association processing on video frames containing the same object, the terminal displays the target keyframe and associated video frames on the anomaly processing page. This enables convenient association processing of video frames containing the same object, allowing for quick identification of anomaly information in associated video frames and thus improving video processing efficiency. Simultaneously, the anomaly processing page displays candidate anomaly processing information, facilitating the generation of the current processing result in response to the selection of candidate anomaly processing information, further improving video processing efficiency. Furthermore, the anomaly processing page synchronously displays content association information, providing a visual and convenient display of more detailed content association information related to the anomaly video frames. This allows the terminal to respond to the processing result accurately selected by the terminal account based on the content association information, thereby improving the accuracy and quality of the processing result determination.

[0151] Figure 6 This is a schematic diagram illustrating a method for handling abnormal pages according to an exemplary embodiment. Figure 4 Taking keyframe 2 as an example of the target keyframe, such as Figure 6 As shown, the target keyframe (keyframe) and associated video frames (associated video frame 1, associated video frame 2, associated video frame 3, and associated video frame 4) can be displayed in the first area at the top left of the exception handling page. The candidate exception handling information is displayed in the second area below, and the first identification information and the second identification information of the description information of the object group are displayed in the third area on the right.

[0152] In a feasible embodiment, in step S151 above, the processing error page includes a first area, a second area, and a third area, and displaying the processing error page may include:

[0153] The first area displays the target keyframes and associated video frames, the second area displays candidate anomaly handling information, and the third area displays the first identification information and the second identification information of the description information of the object group.

[0154] Optionally, the first, second, and third regions can be any location on the error handling page, and this embodiment does not impose specific limitations. Furthermore, since the error handling page has limited space, directly displaying the object group and description information would occupy a significant amount of display space. To save display space on the error handling page, the first identification information of the object group and the second identification information of the description information can be displayed in the third region.

[0155] In this embodiment, by displaying different information in different areas, video processing information can be conveniently presented to the terminal account, improving the interactive experience of the terminal account and thus improving the processing efficiency of the video to be processed. In addition, displaying the first identification information of the object group and the second identification information of the description information in the third area can avoid the problem of occupying too much display space caused by directly displaying the object group and description information, saving the display space of the abnormal page, reducing the burden on the video processing system, and thus further improving the processing efficiency of the video to be processed.

[0156] In an exemplary embodiment, the first identification information of the object group is connected to the second identification information of the description information through the first connection information, and the second identification information of the description information is connected to the abnormal video frame through the second connection information. After displaying the abnormal processing page, the above method may further include:

[0157] In response to a trigger operation based on first identification information, the first identification information and the identification information of the content belonging to the object group are displayed in a first preset form; or, in response to a trigger operation based on second identification information, the second identification information and the identification information of the content belonging to the description information are displayed in a second preset form; or, in response to an operation instruction triggered based on target connection information, the identification information and the second connection information connected to the target connection information are displayed in a third preset form; the target connection information is either the first connection information or the second connection information.

[0158] Accordingly, the above-mentioned response to the selection operation based on candidate anomaly handling information to obtain the current processing result includes: in response to the selection operation based on candidate anomaly handling information, obtaining the current processing result of the object group and / or description information corresponding to the identification information displayed in a preset form.

[0159] In this embodiment, the terminal can visualize more detailed object groups and corresponding description information based on the video aggregation rules. The terminal can determine whether to perform abnormal association processing on the object group or description information, or on the description information, based on whether the terminal account triggers the identification information or connection information of the object group or description information.

[0160] In one implementation, if the terminal account triggers (e.g., clicks, selects, long presses, etc.) the first identification information of a certain object group, the terminal responds to the triggering operation by displaying all units located below the object group in a first preset form, so that all units under the object group are selected together, that is, displaying the first identification information, the second identification information, the first connection information and the second connection information in the first preset form.

[0161] In another implementation, if the terminal account triggers (e.g., clicks, selects, long presses, etc.) the second identification information of a certain description information, the terminal responds to the triggering operation and displays all units located below the description information in a second preset form so that all units under the description information are associated with selection, that is, the second identification information and the second connection information of the description information are displayed in the second preset form.

[0162] In the third implementation, if the terminal account triggers (e.g., clicks, selects, long presses, etc.) a target connection information, the terminal responds to the triggering operation by displaying all units connected to the target connection information, as well as all units located below the unit connected to the target connection information, in a third preset format, so that all units associated with the target connection information are selected. That is, the identification information and the second connection information connected to the target connection information are displayed in the third preset format. The target connection information is any one of the first connection information and the second connection information, and the identification information connected to the target connection information is the first identification information and / or the second identification information.

[0163] It should be noted that "below" refers to the subordinate relationship between units. If a unit belongs to another unit, then that unit is located below that other unit. Correspondingly, the identification information belonging to the object group refers to: the identification information of all descriptive information corresponding to the object group, the first connection information between the object group and each descriptive information, and the second connection information between each descriptive information and the abnormal video frame. The identification information belonging to the descriptive information refers to: the second connection information between the descriptive information and the abnormal video frame. If the target connection information is the first connection information, then all units below the unit connected to the target connection information refer to: the second identification information and the second connection information. If the target connection information is the second connection information, then there are no units below the unit connected to the target connection information.

[0164] It should be noted that the first connection information and the second connection information can be any form of connection information, such as lines, arrows, etc.

[0165] Continue as Figure 6 The object group includes object group 1 and object group 2. Object group 1 includes description information 1 and description information 2, and object group 2 includes description information 3. If the terminal account selects the first identifier information of object group 1, then the identifier information belonging to the content of object group 1 is the second identifier information 1 of description information 1, the second identifier information 2 of description information 2, the first connection information, and the second connection information. The terminal then displays the first identifier information of object group 1, the second identifier information 1 of description information 1, the second identifier information 2 of description information 2, the first connection information, and the second connection information in a first preset format. If the terminal account selects the second identifier information 1 of description information 1, then the identifier information belonging to the content of the second identifier information 1 of description information 1 is the second connection information. The terminal then displays the second identifier information 1 of description information 1 and the second connection information in a second preset format. If the terminal account selects the first identification information of object group 2 and the first connection information between the second identification information 3 of description information 3, then the first connection information connects the first identification information of object group 2 and the second identification information 3 of description information 3. The content below the second identification information 3 of description information 3 is the second connection information. The terminal then displays the first identification information of object group 2, the first connection information, the second identification information 3 of description information 3, the third identification information 3 of description information 3, and the second connection information between the abnormal video frame in a third preset format. If the terminal account selects the second connection information between the second identification information 3 of description information and the abnormal video, then the second connection information connects the second identification information 3 of description information 3. The terminal then displays the second identification information 3 of description information 3 and the second connection information in a third preset format.

[0166] It should be noted that the first, second, and third preset formats can be the same or different. For example, they can be a highlight format, a color change format, etc.

[0167] In this embodiment, when the associated information of the selected content is displayed in a preset format, if the terminal responds to the terminal account's selection operation based on candidate exception handling information, the current processing result for the object group and / or description information corresponding to the identifier information displayed in the preset format can be obtained. For example, continuing as follows... Figure 6 As shown, if the terminal account selects the first identifier information 1 of object group 1, it means that the terminal account wants to process object group 1, description information 1 and description information 2. That is, the selection operation of candidate exception handling information is for object group 1, description information 1 and description information 2. Then the final result is the current processing result of object group 1, description information 1 and description information 2.

[0168] In this embodiment, the terminal visualizes more detailed object groups and their corresponding descriptions based on the video aggregation rules. The terminal can determine which objects to handle based on whether the terminal account triggers the identification information or connection information of the object group or description. This enables the terminal to respond to different triggering operations of the terminal account to process more detailed object groups and / or descriptions, which not only improves processing efficiency but also enhances the processing quality of the video to be processed.

[0169] In a feasible embodiment, in step S153 above, obtaining the current processing result in response to the selection operation based on candidate anomaly handling information may include:

[0170] In response to the selection operation based on candidate exception handling information, the candidate exception handling information corresponding to the selection operation is displayed in the second area in a fourth preset form to obtain the current processing result.

[0171] In this embodiment, the number of candidate anomaly handling information can be at least two, and each candidate anomaly handling information can be surrounded by a selection box. The terminal can respond to a selection operation by the terminal account based on certain candidate anomaly handling information, displaying the selected candidate anomaly handling information in the second area in a fourth preset format to obtain the current processing result. This fourth preset format can be various, such as a highlight format, a color-changing format, a font-changing format, a selection box-changing format, etc. This improves the efficiency of determining the current processing result, thereby improving the processing efficiency of the video to be processed. Furthermore, since the candidate anomaly handling information is an option automatically displayed by the video processing system, determining the processing result from the automatically displayed options improves the processing accuracy of the video to be processed.

[0172] Continue as Figure 6 As shown, assuming the candidate exception handling information includes candidate exception handling information 1, candidate exception handling information 2, candidate exception handling information 3, candidate exception handling information 4, ..., each candidate exception handling information has a selection box in front of it. If the terminal account selects candidate exception handling information 1 and candidate exception handling information 2, then the selection boxes for candidate exception handling information 1 and candidate exception handling information 2 will be checked, thereby displaying candidate exception handling information 1 and candidate exception handling information 2 in the fourth preset format, and using candidate exception handling information 1 and candidate exception handling information 2 as the current processing result.

[0173] In an exemplary embodiment, a processing and editing area is displayed within a preset range of the location of the second region. In response to a selection operation based on candidate exception handling information, the candidate exception handling information corresponding to the selection operation is displayed in the second region in a fourth preset form to obtain the current processing result, including:

[0174] In response to a selection operation based on candidate exception handling information, the candidate exception handling information corresponding to the selection operation is displayed in the second area in a fourth preset format; in response to an editing operation based on the processing editing area, the newly added processing result corresponding to the editing operation is displayed in the second area; the candidate exception handling information and the newly added processing result corresponding to the selection operation are determined as the current processing result.

[0175] Optionally, the preset range of the location of the second region can refer to any area surrounding the second region, without specific limitation, and so on. Figure 6 As shown, the processing editing area can be located below the second area. After obtaining the candidate exception handling information corresponding to the selected operation, if the terminal account wants to add exception handling information, it can edit it in this processing editing area, thereby triggering the editing operation. The terminal responds to the editing operation and displays the newly added processing result corresponding to the editing operation in the second area, thus obtaining the current processing result containing the newly added processing result and the candidate exception handling information corresponding to the selected operation. This allows for secondary editing of the processing result based on the selection of processing results from the candidate exception handling information, enabling the addition of processing results according to the actual needs of the terminal account, further improving the video processing experience for the terminal account and the processing accuracy of the video to be processed.

[0176] In one exemplary implementation, the exception handling page displays a processing information determination control. After obtaining the current processing result, the method further includes: responding to a triggering operation based on the processing information determination control to display the current processing result on the processing comparison page.

[0177] Optionally, continue as follows Figure 6As shown, this processing information confirmation control can be displayed anywhere on the exception handling page, and can be an "OK" control, a "Submit" control, etc. After the terminal account completes the current video processing work, the processing information confirmation control can be triggered. The terminal responds to this trigger operation by displaying the current processing result on the processing comparison page of the video processing system. Therefore, not only can convenient processing of the video to be processed be achieved, but the current processing result can also be displayed on the processing comparison page. This allows for comparison of the accuracy of historical processing results with the current processing result, thereby improving the efficiency and accuracy of historical processing results and reducing the processing cost of historical processing results.

[0178] In an optional embodiment, after obtaining the current processing result corresponding to the target keyframe and the associated video frame in response to the processing operation on the target keyframe and the associated video frame, the above method further includes:

[0179] The processing comparison page is displayed; the processing comparison page shows the video to be processed, the processing result of the video to be processed, and the processing node information of the video to be processed.

[0180] The processing results of the video to be processed include the current processing result and the historical processing result. The current processing result is used to compare the processing accuracy of the historical processing result. The processing node information includes the current processing node information corresponding to the current processing result and the historical processing node information corresponding to the historical processing result. The current processing node information represents the start time of the video segment to which the video frame corresponding to the current processing result belongs, and the historical processing node information represents the start time of the video segment to which the video frame corresponding to the historical processing result belongs.

[0181] Optionally, since the video processing system has multiple processing stages, and the processing results of these stages may be inconsistent, after the terminal account obtains the current processing result for the video to be processed, it can compare the current processing result with the historical processing results obtained by other processing stages for the same video to be processed. This allows for a rapid comparison of the inconsistencies between the current and historical processing results, thereby accurately determining which historical processing stage's historical processing result had a problem.

[0182] For example, in order to compare historical processing results, the terminal can display a processing comparison page. This processing comparison page is a page in the video processing system used to compare the current processing results with historical processing results. The terminal account can open the processing comparison page through various channels, and this disclosure embodiment does not specifically limit this.

[0183] Optionally, the processing comparison page can display the video to be processed and its processing result. This result includes the current processing result from the current processing stage and historical processing results from previous processing stages. It should be noted that there may be multiple historical processing stages, and the historical processing results from each stage will be displayed on this comparison page. The terminal account compares the current and historical processing results displayed on the comparison page. If the matching degree between the historical and current processing results is low, it is determined that the accuracy of the historical processing result is low, and the corresponding processing stage has a problem. Conversely, if the matching degree is high, it is determined that the accuracy of the historical processing result is high, and the corresponding processing stage has no problem. Therefore, not only can the problematic historical processing stage be accurately identified, but the problem can also be discovered through comparison of processing results, reducing the cost of judging the accuracy of historical processing results.

[0184] Furthermore, after obtaining the processing comparison results for historical processing results, feedback can be provided on the problematic historical processing results and their processing steps. This feedback can take many forms, and this embodiment does not specifically limit the methods used. For example, in response to a feedback command triggered by a terminal account, the problematic historical processing results and their processing steps can be displayed on a preset page.

[0185] Optionally, when displaying the processing comparison page, the terminal can also obtain which video frame the current processing result is for, the key video segment to which the video frame for which the current processing result is for, and the start time of the key video segment to which the video frame for which the current processing result is for belongs. This start time can be used as the current processing node information corresponding to the current processing result, and displayed on the processing comparison page. Simultaneously, the terminal can also obtain which video frame the historical processing result is for, the key video segment to which the video frame for which the historical processing result is for, and the start time of the key video segment to which the video frame for which the historical processing result is for belongs. This start time can be used as the historical processing node information corresponding to the historical processing result, and displayed on the processing comparison page. Therefore, by displaying the current processing node information and historical processing node information on the processing comparison page, the convenience of showing the start time of different processing stages to the terminal account is improved, thereby improving the convenience for the terminal account to view the processing results of each stage, and ultimately improving the interactive experience of the terminal account.

[0186] In one exemplary embodiment, the processing comparison page includes a fourth region, a fifth region, and a sixth region, and the display processing comparison page includes:

[0187] The fourth area displays the video to be processed; the fifth area displays the current and historical processing results of the video to be processed; and the sixth area displays the current playback progress, current processing node, and historical processing node information of the video to be processed.

[0188] Optionally, the fourth, fifth, and sixth regions can be located anywhere on the processing comparison page, and this disclosure does not impose any specific limitations on this. The video to be processed displayed in the fourth region can be paused, and the terminal can play the video to be processed using a player after responding to a playback operation from the terminal account. The current processing results and historical processing results displayed in the fifth region can be displayed in any form, and this disclosure does not impose any specific limitations on this.

[0189] Optionally, the current processing node information and historical processing node information displayed in the sixth area can be displayed in any form, and this disclosure does not impose any specific limitations on this. For example, the time represented by each processing node can be directly marked on the playback bar of the player playing the video to be processed; the time represented by each processing node can also be marked in the area below the playback bar of the player; or, instead of directly marking the time represented by each processing node in the area below the playback bar of the player, lines, patterns, etc. can be marked, and the time represented by each processing node can be found by using the lines, patterns, etc.

[0190] Optionally, the sixth area may also display the current playback progress information of the video to be processed. This current playback progress information can be displayed in any form, without any specific limitations. For example, the current playback progress information can be marked directly on the player's playback bar; alternatively, a perpendicular line can be drawn to the playback bar, and the intersection of this perpendicular line and the playback bar can represent the current playback progress information.

[0191] Figure 7 This is a schematic diagram illustrating a process for comparing pages according to an exemplary embodiment, such as... Figure 7As shown, the fourth area is located on the right side of the processing comparison page, displaying the video to be processed, a pause button, and a play bar. The fifth area is located to the right of the fourth area, and the sixth area is located below the fourth area. Historical processing results include the historical processing results corresponding to each of the first, second, third, and fourth historical processing stages. The sixth area includes the processing areas corresponding to the current processing stage, the first historical processing stage, the second historical processing stage, the third historical processing stage, and the fourth historical processing stage. Processing node information is represented by vertical lines set in each processing area. The time corresponding to the intersection of this line and the play bar in the fourth area is the start time of the key video segment represented by each processing node. The current playback progress information is displayed in the sixth area by a vertical line intersecting the play bar.

[0192] In this embodiment, by displaying the video to be processed, the current processing result, the current processing result, and the historical processing node information in different areas, the convenience of displaying the processing results and processing node information of different processing stages to the terminal account is further improved. This further improves the convenience for the terminal account to view the processing results of each stage, and thus makes it easier to determine which processing stage has a problem, thereby improving the interactive experience of the terminal account.

[0193] In one specific embodiment, a node navigation control is also displayed in the fourth area, and the method further includes:

[0194] In response to the trigger operation of the node-based jump control, the video frame corresponding to the information of the first target processing node is displayed;

[0195] Among them, the start time represented by the first target processing node information is adjacent to the playback time corresponding to the current playback progress information and is located after the playback time corresponding to the current playback progress information.

[0196] In this embodiment, a node jump control can be displayed near the playback bar in the fourth area, continuing as follows. Figure 7 As shown, a jump control for this node can be displayed on the playback bar (such as...). Figure 7 (As shown in ">>"). In response to the terminal account triggering the node jump control, the terminal obtains the information of the first target processing node, which represents the start time, is adjacent to the playback time corresponding to the current playback progress information, and is located after the playback time corresponding to the current playback progress information. The terminal jumps to the first target processing node and displays the video frame corresponding to the first target processing node. The video frame corresponding to the first target processing node refers to the video frame corresponding to the processing result of the first target processing node. Continuing as... Figure 7As shown, the first target processing node information, which is adjacent to and follows the playback time corresponding to the current playback progress information, is the processing node information marked by the vertical line in the current processing stage. This allows for the rapid display of the video frame corresponding to the next processing node, enabling the terminal account to assess the accuracy of historical processing results and improving the precision of determining the accuracy of historical processing results.

[0197] It should be noted that after the jump, the start time represented by the first target processing node information is used again as the current playback progress information.

[0198] In one feasible embodiment, the above method may further include:

[0199] During the playback of the video to be processed, if a second target processing node exists within a preset time after the current video frame is determined, the video frame corresponding to the second target processing node is displayed, and the processing area corresponding to the processing result of the second target processing node is displayed on the video frame corresponding to the second target processing node.

[0200] The second target processing node information is the processing node information from the current processing node information and the historical processing node information.

[0201] In this embodiment, during the playback of the video to be processed, the terminal can determine whether, within a preset time period (e.g., within 0.3 seconds) after the currently playing video frame, there exists second target processing node information marked by other processing stages. If such information exists, the terminal automatically jumps to the video frame corresponding to the second target processing node information and pauses the display of that video frame. Simultaneously, the processing area corresponding to the processing result of the second target processing node information is displayed on that video frame. This processing area can refer to which region of which video frame in the video to be processed is targeted by the corresponding processing result. The second target processing node information includes processing node information from both the current processing node information and historical processing node information.

[0202] In one implementation, the second target processing node information can be one; that is, if within a preset time period after the current video frame, there is a problem marking a historical processing step for a video frame, then the processing area processed by that historical processing step is displayed on the video frame. In another implementation, the second target processing node information can be at least two; that is, if within a preset time period after the current video frame, there are at least two historical processing steps marking a video frame, then the processing areas processed by each of the at least two historical processing steps are displayed on the video frame.

[0203] Figure 8 This is a schematic diagram illustrating another process for comparing pages according to an exemplary embodiment, such as... Figure 8 As shown, within a preset time period after the current video frame, there is an issue of marking the first historical processing stage and the second historical processing stage for a certain video frame. The terminal obtains the first processing area of ​​the first historical processing stage on the video frame and the second processing area of ​​the second historical processing stage on the video to be processed, and displays the first processing area and the second processing area on the video frame.

[0204] In this embodiment, if a second target processing node exists within a preset time after the terminal determines the currently playing video frame, it automatically jumps to and displays the video frame corresponding to the second target processing node. This enables rapid display of the video frame corresponding to the next processing node, allowing the terminal account to assess the accuracy of historical processing results and improving the accuracy of historical processing results. Furthermore, the video frame corresponding to the second target processing node displays the processing area corresponding to the processing result of the second target processing node, enabling precise comparison of specific problem points in the screenshots marked at different processing stages. This further assists the terminal account in assessing the accuracy of historical processing results, thereby further improving the accuracy of historical processing results.

[0205] The video processing method provided in the embodiments of this disclosure will be described in its entirety below:

[0206] I. Determine the current processing result

[0207] 1) Extract at least two key video segments: Among the multiple video segments included in the video to be processed, the video segment in which the first appearance of the object matches the object to which the video audio data belongs; and the video segment in which the video audio data is narration and the object to which the video audio data belongs is a preset object, are taken as at least two key video segments.

[0208] 2) Extract at least two keyframes: Take the video frame where the object first appears in each key video segment as the keyframe corresponding to each key video segment, and obtain at least two keyframes.

[0209] 3) Determination of associated video frames: Take any one of the at least two key frames as the target key frame, take the key video segment corresponding to the target key frame as the target key video segment, take the key video segments other than the target key video segment from the at least two key video segments as candidate key video segments, and take the video frames in the candidate key video segments whose objects are the same as the objects in the associated video frames as associated video frames.

[0210] 4) The terminal responds to the video processing page display instruction triggered by the terminal account in the video processing system and displays the video processing page; at least two keyframes are displayed on the video processing page.

[0211] 5) In response to the associated information display operation triggered by the target keyframe, the terminal displays the associated video frame corresponding to the target keyframe on the video processing page.

[0212] 6) The terminal responds to the processing operations on the target keyframe and associated video frame and obtains the current processing results corresponding to the target keyframe and associated video frame.

[0213] II. Compare the current processing results with historical processing results to assess their accuracy.

[0214] 7) The terminal responds to the processing comparison page display instruction triggered by the terminal account in the video processing system and displays the processing comparison page; the processing comparison page displays the video to be processed, the processing result of the video to be processed, and the processing node information of the video to be processed.

[0215] 8) The comparison page also displays a node jump control. Upon triggering an operation based on this control, the terminal jumps to and displays the video frame corresponding to the first target processing node information. The start time represented by the first target processing node information is adjacent to, but follows, the playback time corresponding to the current playback progress information.

[0216] 9) During the playback of the video to be processed, if a second target processing node exists within a preset time after the currently playing video frame, the system automatically jumps to the video frame corresponding to the second target processing node and pauses the display of that video frame. Simultaneously, the processing area showing the processing result corresponding to the second target processing node is displayed on that video frame; where the second target processing node information is the processing node information from both the current processing node information and the historical processing node information.

[0217] Figure 9 This is a block diagram of a video processing apparatus according to an exemplary embodiment. (Refer to...) Figure 9 The device includes

[0218] The video processing page display module 21 is configured to display a video processing page; the video processing page displays a video to be processed and at least two key frames extracted from the video to be processed; the video to be processed includes at least two key video segments that meet preset conditions, and the at least two key video segments correspond one-to-one with at least two key frames; each key frame is the video frame in which the object first appears in the corresponding key video segment.

[0219] The associated video frame display module 23 is configured to perform an associated information display operation triggered based on the target keyframe, and display the associated video frame corresponding to the target keyframe on the video processing page; the associated video frame is a video frame in the candidate key video segment, and the object in the associated video frame is the same as the object in the target keyframe; the candidate key video segment is a key video segment other than the target key video segment among at least two key video segments; the target key video segment corresponds to the target keyframe; the target keyframe is any one of at least two keyframes;

[0220] The processing operation response module 25 is configured to perform processing operations in response to the target keyframe and associated video frames, and obtain the current processing results corresponding to the target keyframe and associated video frames.

[0221] In an optional embodiment, the above-described processing operation response module includes:

[0222] The exception handling page display unit is configured to, in response to the processing operation on the target keyframe and the associated video frame, display the exception handling page when it is determined that associated processing is to be performed on video frames containing the same object. The exception handling page displays the target keyframe, the associated video frame, candidate exception handling information, and content association information associated with the content of the exception video frame. The exception video frame includes the target keyframe and the associated video frame, and the candidate exception handling information represents information that does not meet the preset processing conditions.

[0223] The current processing result determination unit is configured to perform a selection operation in response to candidate exception handling information to obtain the current processing result.

[0224] In an optional embodiment, the content association information includes an object group and corresponding description information. The object group represents a set of objects to be recommended for the abnormal video frame. The abnormal processing page includes a first area, a second area, and a third area. The abnormal processing page display unit is configured to display the target keyframe and associated video frame in the first area, display candidate abnormal processing information in the second area, and display the first identification information of the object group and the second identification information of the description information in the third area.

[0225] In an optional embodiment, the first identification information of the object group is linked to the second identification information of the description information through the first connection information, and the second identification information of the description information is linked to the abnormal video frame through the second connection information. The device further includes:

[0226] The preset format display module is configured to, in response to a trigger operation based on first identifier information, display the first identifier information and the identifier information of the content belonging to the object group in a first preset format; or, in response to a trigger operation based on second identifier information, display the second identifier information and the identifier information of the content belonging to the description information in a second preset format; or, in response to an operation instruction triggered based on target connection information, display the identifier information and the second connection information connected to the target connection information in a third preset format; the target connection information is any one of the first connection information and the second connection information.

[0227] The current processing result determination unit is configured to perform a selection operation based on candidate exception processing information to obtain the current processing result of the object group and / or description information corresponding to the identification information displayed in a preset form.

[0228] In an optional embodiment, the current processing result determination unit is configured to perform a selection operation based on candidate exception handling information in response to the selection operation, display the candidate exception handling information corresponding to the selection operation in a fourth preset form in the second area, and obtain the current processing result.

[0229] In an optional embodiment, a processing and editing area is displayed within a preset range of the location of the second region, and the current processing result determination unit includes:

[0230] The selection operation response subunit is configured to perform a selection operation based on candidate exception handling information, and to display the candidate exception handling information corresponding to the selection operation in the second area in a fourth preset form.

[0231] A new processing result display sub-unit is added, which is configured to respond to editing operations based on the processing editing area and display the new processing result corresponding to the editing operation in the second area;

[0232] The current processing result determination subunit is configured to select the candidate exception handling information and the newly added processing result corresponding to the operation and determine it as the current processing result.

[0233] In an optional embodiment, the exception handling page displays a processing information confirmation control, and the above-mentioned device further includes:

[0234] The control triggering module is configured to perform a triggering operation in response to a control determined based on the processing information, so as to display the current processing result on the processing comparison page.

[0235] In an optional embodiment, the associated information display operation includes a hover operation, and the associated video frame display module includes:

[0236] The hover operation response module is configured to perform a hover operation triggered based on the target keyframe, play the target key video segment corresponding to the target keyframe on the video processing page, and display the associated video frame on the video processing page.

[0237] In an optional embodiment, the hover operation response module includes:

[0238] The target key video clip display unit is configured to perform a hover operation triggered based on the target keyframe, and display the target key video clip in a paused form on the video processing page.

[0239] The associated video frame display unit is configured to perform a response to a trigger operation based on a target key video segment displayed in a paused state, play the target key video segment at a preset speed in the video processing page, and display the associated video frame in a floating window in the video processing page.

[0240] In an optional embodiment, the video to be processed includes multiple video segments, each video segment corresponding to video and audio data, and at least two key video segments that meet preset conditions include:

[0241] Among multiple video clips, the video clip in which the first appearance of the object matches the object to which the video audio data belongs; and among multiple video clips, the video audio data is narration and the object to which the video audio data belongs is the same preset object.

[0242] In an optional embodiment, the above-described apparatus further includes:

[0243] The processing comparison page display module is configured to display the processing comparison page; the processing comparison page displays the video to be processed, the processing result of the video to be processed, and the processing node information of the video to be processed.

[0244] The processing results of the video to be processed include the current processing result and the historical processing result. The current processing result is used to compare the processing accuracy of the historical processing result. The processing node information includes the current processing node information corresponding to the current processing result and the historical processing node information corresponding to the historical processing result. The current processing node information represents the start time of the key video segment to which the video frame corresponding to the current processing result belongs, and the historical processing node information represents the start time of the video segment to which the key video frame corresponding to the historical processing result belongs.

[0245] In an optional embodiment, the comparison page includes a fourth region, a fifth region, and a sixth region. The comparison page display module is configured to display the video to be processed in the fourth region; display the current processing result and historical processing result of the video to be processed in the fifth region; and display the current playback progress information, current processing node information, and historical processing node information of the video to be processed in the sixth region.

[0246] In an optional embodiment, a node navigation control is also displayed in the fourth region, and the aforementioned device further includes:

[0247] The node jump module is configured to respond to the trigger operation based on the node jump control and display the video frame corresponding to the first target processing node information;

[0248] Among them, the start time represented by the first target processing node information is adjacent to the playback time corresponding to the current playback progress information and is located after the playback time corresponding to the current playback progress information.

[0249] In an optional embodiment, the above-described apparatus further includes:

[0250] The processing area display module is configured to, during the playback of the video to be processed, if a second target processing node information exists within a preset time after the current video frame is determined, display the video frame corresponding to the second target processing node information on the processing comparison page, and display the processing area corresponding to the processing result of the second target processing node information on the video frame corresponding to the second target processing node information.

[0251] The second target processing node information is the processing node information from the current processing node information and the historical processing node information.

[0252] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0253] In an exemplary embodiment, an electronic device for video processing is also provided, including a processor; a memory for storing processor-executable instructions; wherein, when the processor is configured to execute the instructions stored in the memory, it implements the steps of any of the video processing methods described above.

[0254] The electronic device can be a terminal, a server, or a similar computing device. Taking a server as an example... Figure 10This is a block diagram illustrating an electronic device 30 for video processing according to an exemplary embodiment. The electronic device 30 can vary significantly due to different configurations or performance characteristics. It may include one or more central processing units (CPUs) 31 (CPUs 31 may include, but are not limited to, microprocessors (MCUs) or programmable logic devices (FPGAs), a memory 33 for storing data, and one or more storage media 32 (e.g., one or more mass storage devices) for storing application programs 323 or data 322. The memory 33 and storage media 32 may be temporary or persistent storage. The program stored in the storage media 32 may include one or more modules, each module including a series of instruction operations on the electronic device. Furthermore, the CPU 31 may be configured to communicate with the storage media 32 and execute the series of instruction operations stored in the storage media 32 on the electronic device 30. Electronic device 30 may also include one or more power supplies 36, one or more wired or wireless network interfaces 35, one or more input / output interfaces 34, and / or one or more operating systems 321, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0255] The input / output interface 34 can be used to receive or send data via a network. Specific examples of the network described above may include a wireless network provided by the communication provider of the electronic device 30. In one example, the input / output interface 34 includes a network interface controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In an exemplary embodiment, the input / output interface 34 may be a radio frequency (RF) module for wireless communication with the Internet.

[0256] Those skilled in the art will understand that Figure 10 The structure shown is for illustrative purposes only and does not limit the structure of the aforementioned electronic device. For example, electronic device 30 may also include... Figure 10 The more or fewer components shown, or having the same Figure 10 The different configurations shown.

[0257] In an exemplary embodiment, a computer-readable storage medium is also provided, which, when executed by a processor of an electronic device, enables the electronic device to perform the steps of any of the video processing methods described above.

[0258] In an exemplary embodiment, a computer program product is also provided, including a computer program that, when executed by a processor, implements the video processing method provided in any of the above embodiments.

[0259] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this disclosure can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0260] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0261] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A video processing method, characterized in that, include: The video processing page is displayed; the video processing page displays the video to be processed and at least two keyframes extracted from the video to be processed; The video to be processed includes at least two key video segments that meet preset conditions, and the at least two key video segments correspond one-to-one with the at least two key frames; each key frame is the video frame in which the object first appears in the corresponding key video segment. In response to an operation to display associated information triggered by a target keyframe, associated video frames corresponding to the target keyframe are displayed on the video processing page; the associated video frames are video frames among candidate key video segments, and the objects in the associated video frames are the same as the objects in the target keyframe; the candidate key video segments are key video segments other than the target key video segment among the at least two key video segments; the target key video segment corresponds to the target keyframe; the target keyframe is any one of the at least two keyframes; If it is determined that video frames containing the same object should be associated for processing, in response to the processing operation on the target keyframe and the associated video frame, a processing exception page is displayed, which displays candidate exception processing information. In response to the selection operation based on the candidate anomaly handling information, the current processing result is obtained.

2. The video processing method according to claim 1, characterized in that, The anomaly handling page also displays the target keyframe, the associated video frame, and content association information related to the content of the anomaly video frame; the anomaly video frame includes the target keyframe and the associated video frame, and the candidate anomaly handling information represents information that does not meet the preset processing conditions.

3. The video processing method according to claim 2, characterized in that, The content association information includes object groups and corresponding description information for the object groups. The object groups represent the set of objects to be recommended for the abnormal video frames. The abnormal processing page includes a first area, a second area, and a third area. The display of the abnormal processing page includes: The first area displays the target keyframe and the associated video frame, the second area displays the candidate anomaly handling information, and the third area displays the first identification information of the object group and the second identification information of the description information.

4. The video processing method according to claim 3, characterized in that, The first identification information of the object group is connected to the second identification information of the description information through first connection information, and the second identification information of the description information is connected to the abnormal video frame through second connection information. After displaying the abnormal page, the method further includes: In response to a trigger operation based on the first identification information, the first identification information and the identification information of the content belonging to the object group are displayed in a first preset form; or, in response to a trigger operation based on the second identification information, the second identification information and the identification information of the content belonging to the description information are displayed in a second preset form; or, in response to an operation instruction triggered based on target connection information, the identification information connected to the target connection information and the second connection information are displayed in a third preset form; the target connection information is any one of the first connection information and the second connection information. The step of obtaining the current processing result in response to the selection operation based on the candidate anomaly handling information includes: In response to the selection operation based on the candidate anomaly processing information, the current processing result of the object group and / or description information corresponding to the identification information is obtained and displayed in a preset form.

5. The video processing method according to claim 3, characterized in that, The step of obtaining the current processing result in response to the selection operation based on the candidate anomaly handling information includes: In response to the selection operation based on the candidate anomaly handling information, the candidate anomaly handling information corresponding to the selection operation is displayed in the second area in a fourth preset form to obtain the current processing result.

6. The video processing method according to claim 5, characterized in that, Within a preset range of the second region, a processing and editing area is displayed. In response to a selection operation based on the candidate exception handling information, the candidate exception handling information corresponding to the selection operation is displayed in the second region in a fourth preset format to obtain the current processing result, including: In response to a selection operation based on the candidate anomaly handling information, the candidate anomaly handling information corresponding to the selection operation is displayed in the second area in a fourth preset format. In response to an editing operation based on the processing editing area, the newly added processing result corresponding to the editing operation is displayed in the second area; The candidate exception handling information corresponding to the selection operation and the newly added processing result are determined as the current processing result.

7. The video processing method according to claim 5, characterized in that, The exception handling page displays a control for confirming processing information. After obtaining the current processing result, the method further includes: In response to the triggering operation of the control determined based on the processing information, the current processing result is displayed on the processing comparison page.

8. The video processing method according to any one of claims 1 to 7, characterized in that, The associated information display operation includes a hover operation. The operation, which responds to the associated information display based on a target keyframe, involves displaying the associated video frame corresponding to the target keyframe on the video processing page, including: In response to a hover operation triggered based on the target keyframe, the target key video segment corresponding to the target keyframe is played on the video processing page, and the associated video frame is displayed on the video processing page.

9. The video processing method according to claim 8, characterized in that, The step of responding to a hover operation triggered based on the target keyframe by playing the target keyframe-corresponding target key video segment on the video processing page and displaying the associated video frame on the video processing page includes: In response to a hover operation triggered based on the target keyframe, the target key video segment is displayed in a paused manner on the video processing page; In response to a triggered operation based on a target key video clip displayed in a paused state, the target key video clip is played at a preset speed on the video processing page, and the associated video frame is displayed in a floating window on the video processing page.

10. The video processing method according to any one of claims 1 to 7, characterized in that, The video to be processed includes multiple video segments, each corresponding to video and audio data. The at least two key video segments that meet the preset conditions include: Among the multiple video segments, the video segment in which the object that first appears matches the object to which the video audio data belongs; and among the multiple video segments, the video audio data is narration and the object to which the video audio data belongs is the same preset object.

11. The video processing method according to any one of claims 1 to 7, characterized in that, The method further includes: The processing comparison page is displayed; the processing comparison page shows the video to be processed, the processing result of the video to be processed, and the processing node information of the video to be processed; The processing result of the video to be processed includes the current processing result and the historical processing result. The current processing result is used to compare the processing accuracy of the historical processing result. The processing node information includes the current processing node information corresponding to the current processing result and the historical processing node information corresponding to the historical processing result. The current processing node information represents the start time of the key video segment to which the video frame corresponding to the current processing result belongs, and the historical processing node information represents the start time of the video segment to which the key video frame corresponding to the historical processing result belongs.

12. The video processing method according to claim 11, characterized in that, The processing comparison page includes a fourth region, a fifth region, and a sixth region, and the display processing comparison page includes: The fourth area displays the video to be processed; the fifth area displays the current processing result and historical processing result of the video to be processed; and the sixth area displays the current playback progress information, current processing node information, and historical processing node information of the video to be processed.

13. The video processing method according to claim 12, characterized in that, The fourth area also displays a node navigation control, and the method further includes: In response to the trigger operation based on the node jump control, the video frame corresponding to the first target processing node information is displayed; The start time represented by the first target processing node information is adjacent to the playback time corresponding to the current playback progress information and is located after the playback time corresponding to the current playback progress information.

14. The video processing method according to claim 11, characterized in that, The method further includes: During the playback of the video to be processed, if a second target processing node information exists within a preset time after the currently playing video frame, the video frame corresponding to the second target processing node information is displayed on the processing comparison page, and a processing area corresponding to the processing result of the second target processing node information is displayed on the video frame corresponding to the second target processing node information. The second target processing node information is the processing node information in the current processing node information and the historical processing node information.

15. A video processing apparatus, characterized in that, include: The video processing page display module is configured to execute and display a video processing page; the video processing page displays a video to be processed and at least two key frames extracted from the video to be processed; the video to be processed includes at least two key video segments that meet preset conditions, and the at least two key video segments correspond one-to-one with the at least two key frames; each key frame is the video frame in which the object first appears in the corresponding key video segment; The associated video frame display module is configured to perform an associated information display operation triggered based on a target keyframe, and display the associated video frame corresponding to the target keyframe on the video processing page; the associated video frame is a video frame in the candidate key video segment, and the object in the associated video frame is the same as the object in the target keyframe; the candidate key video segment is a key video segment other than the target key video segment among the at least two key video segments. The target key video segment corresponds to the target key frame; The target keyframe is any one of the at least two keyframes. The processing operation response module includes: a processing exception page display unit, configured to, in response to a processing operation on the target keyframe and the associated video frame, display a processing exception page when it is determined that associated processing is to be performed on video frames containing the same object; the processing exception page displays candidate exception processing information. The current processing result determination unit is configured to perform a selection operation based on the candidate exception processing information to obtain the current processing result.

16. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the video processing method as described in any one of claims 1 to 14.

17. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, cause the electronic device to perform the video processing method as described in any one of claims 1 to 14.

Images