Video processing method and device, electronic equipment and computer readable storage medium

Abstract

The embodiment of the invention discloses a video processing method and device, electronic equipment and a computer readable storage medium, and relates to the technical field of video processing. The method comprises the following steps: in response to a selection operation on a video recording file, displaying a plurality of nodes of the video recording file; the plurality of nodes are in one-to-one correspondence with a plurality of video contents in the video recording file; the video content comprises an advertisement video; in response to a hiding operation on the advertisement video, filtering the advertisement video in the video recording file according to an advertisement node corresponding to the advertisement video; and playing the video recording file after filtering the advertisement video. According to the scheme, the information of the recorded multiple video contents can be provided for the user by displaying the multiple nodes, and playing of the recorded video after advertisement removal is also supported.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of video processing, and specifically relate to a video processing method and device, electronic equipment and computer readable storage medium. BACKGROUND

[0002] A personal video recorder (PVR) is used for recording, storing and playing video content, and can record video signals such as television programs and movies into a disk for the user to watch at a later time.

[0003] Long-time recording often records multiple programs, but a PVR recording file only displays the program name and time at the start of recording, and cannot accurately display information about the recording content to the user, and cannot distinguish between advertising content, so that the user can only skip the advertisement by fast-forwarding after seeing the advertisement. SUMMARY

[0004] Embodiments of the present application provide a video processing method and device, electronic equipment and computer readable storage medium, which can provide information about multiple video contents recorded by a user by displaying multiple nodes, and also support playing the recorded video after removing the advertisements.

[0005] In a first aspect, embodiments of the present application provide a video processing method, comprising: In response to a selection operation on a video recording file, displaying multiple nodes of the video recording file; the multiple nodes correspond one-to-one to multiple video contents in the video recording file; the video contents include an advertising video; In response to a hiding operation on the advertising video, filtering the advertising video in the video recording file according to an advertising node corresponding to the advertising video; Playing the video recording file after filtering the advertising video.

[0006] In one embodiment, before displaying the multiple nodes of the video recording file, the method further comprises: In response to a video recording instruction, obtaining a program map table (PMT) and an electronic program guide (EPG) corresponding to the video recording instruction; When recording a video, obtaining an audio and video feature of the video content being recorded; According to the PMT, the EPG and / or the audio and video feature, identifying whether the video content being recorded has changed relative to the video content recorded at the last time; generating a corresponding node according to the currently recorded video content when it is identified that the video content has changed, and adding information of the currently recorded video content to information of the node, and adding the current recording time as an end time of a previous node and adding to information of the previous node.

[0007] In one of the embodiments, the identifying whether the currently recorded video content has changed relative to the video content recorded at a previous time according to the PMT, the EPG and / or the audio-video features comprises: detecting whether the PMT includes advertisement insertion prompt information; when the PMT includes the advertisement insertion prompt information, determining a start time of the advertisement video according to the advertisement insertion prompt information; when the current recording time is the start time of the advertisement video, determining that the currently recorded video content has changed relative to the video content recorded at the previous time, and the video content change is the advertisement video.

[0008] In one of the embodiments, the obtaining the audio-video features of the currently recorded video content comprises: detecting whether a video black field appears in the currently recorded video content; detecting whether a loudness mutation appears in an audio of the currently recorded video content; determining a switching frequency of a picture scene of the currently recorded video content; when the PMT does not include the advertisement insertion prompt information, the method further comprises: when the black field appears in the currently recorded video content, the loudness mutation appears in the audio and / or the switching frequency is greater than a switching frequency threshold, determining that the currently recorded video content is the advertisement video; when it is determined that the currently recorded video content is the advertisement video and the video content recorded at the previous time is not the advertisement video, determining that the currently recorded video content has changed relative to the video content recorded at the previous time, and the video content change is the advertisement video.

[0009] In one of the embodiments, the generating a corresponding node according to the currently recorded video content when it is identified that the video content has changed comprises: when it is identified that the video content change is the advertisement video, generating a node corresponding to the advertisement video; marking the node corresponding to the advertisement video as an advertisement node; the adding information of the currently recorded video content to information of the node comprises: obtaining a start time and an end time of the advertisement video, and adding the start time and the end time to information of the advertisement node.

[0010] In one of the embodiments, the identifying whether the currently recorded video content is changed relative to the video content recorded at a previous time according to the PMT, the EPG and / or the audio / video features comprises: when the EPG indicates that the television program information is changed, determining that the currently recorded video content is changed relative to the video content recorded at the previous time, and the video content change is a target television program; The generating a corresponding node according to the currently recorded video content and adding information of the currently recorded video content to information of the node when the video content change is identified comprises: generating a target node corresponding to the target television program when the video content change is identified as the target television program; obtaining information of the target television program from the target television program; extracting a target video frame from the target television program, and generating a node thumbnail according to the target video frame; adding the information of the target television program and the node thumbnail to the information of the target node.

[0011] In one of the embodiments, the method further comprises: generating an initial node at the beginning of the video recording; obtaining information of an initially recorded video content from the EPG; adding the information of the initially recorded video content to the information of the initial node.

[0012] In one of the embodiments, the displaying the plurality of nodes of the video recording file comprises: displaying a play progress bar in a play interface of the video recording file; displaying the plurality of nodes in association with the play progress bar according to respective play times of the plurality of nodes of the video recording file; The method further comprises: in response to a target operation on the displayed node, jumping to the play time corresponding to the node for playing.

[0013] In a second aspect, the embodiments of the present application provide a video processing apparatus, comprising: The display module is used to display multiple nodes of the video recording file in response to a selection operation of the video recording file; the multiple nodes correspond one-to-one with multiple video contents in the video recording file; the video contents include advertising videos; A filtering module is used to filter the advertising videos in the video recording file according to the advertising nodes corresponding to the advertising videos in response to the hiding operation of the advertising videos; The playback module is used to play the video recording file after filtering the advertising video.

[0014] Thirdly, embodiments of this application also provide an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the steps in the video processing method described above.

[0015] Fourthly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps in the video processing method described above.

[0016] Fifthly, embodiments of this application also provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described in embodiments of this application.

[0017] The embodiments of this application have the following beneficial effects: By displaying multiple nodes of a selected video recording file, information about various video content within the file can be shown to the user. These nodes include advertising nodes, thus the displayed video content information also includes information about advertising videos, helping users to identify advertising content. This allows users to understand detailed information about all the video content within the entire recording file, not just the initial video content. In response to the hiding of advertising videos, the video recording file can be filtered based on the advertising nodes corresponding to those videos, allowing the playback of the filtered video recording file and achieving the effect of removing advertising videos, thereby improving the user's viewing experience. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of the steps of a video processing method provided in an embodiment of this application; Figure 2 This is a schematic diagram of a video recording process provided in one embodiment of this application; Figure 3 This is a schematic diagram of the steps of a video processing method provided in an embodiment of this application; Figure 4 This is a schematic diagram of a node provided in an embodiment of this application; Figure 5 This is a schematic diagram of the structure of a video processing apparatus provided in an embodiment of this application; Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0020] The technical solutions of this application will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0021] In one embodiment, such as Figure 1 As shown, a video processing method is provided. Although the logical order of the steps is illustrated in the schematic diagram, in some cases, the steps shown or described may be performed in a different order than that shown in the accompanying drawings. Specifically, this video processing method can be applied to a terminal, which may include, but is not limited to, one or more of satellite television, cable television, interactive television, time-shifted television, smart television, digital television, tablet computers, portable computers, and desktop computers.

[0022] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0023] according to Figure 1 The video processing method shown includes at least steps S110 to S130, which are described in detail below: In step S110, in response to the selection operation of the video recording file, multiple nodes of the video recording file are displayed. Each of the multiple nodes corresponds one-to-one with multiple video contents in the video recording file; the video contents include advertising videos.

[0024] Video recording files are files generated during the recording of video content. The recorded video content can be content played on a television, such as television programs; or content played on terminals such as computers and mobile phones, such as online programs. Video recording files can be obtained using a PVR.

[0025] It can display one or more pre-recorded video files and provide a selection control (e.g., a selection button) for the video files. In response to a user operation (e.g., clicking) the selection control corresponding to any video file, it can display detailed information about the video file. This detailed information may include, but is not limited to, one or more of the following: the total duration of the video file, the start time of recording, the end time of recording, and the recorded TV channel.

[0026] In response to a selection operation on a video recording file, multiple nodes generated during the recording of that video file can be read and displayed. When displaying these nodes, information about each node can be shown simultaneously. This node information may include, but is not limited to: a thumbnail of the video content corresponding to that node, start time, end time, duration, actor information, program name, program description, and whether it is an advertisement or one of the following:

[0027] Each node corresponds to a video content, which can refer to a news broadcast, an interview program, a variety show, an episode of a TV series, or a commercial, etc. In one embodiment, although a news broadcast includes multiple news items, it can still be determined as a single video content based on actual needs; an commercial may include multiple advertisements, but it can be considered as a single video content. In another embodiment, a news broadcast includes multiple news items, and each news item in the news broadcast can be determined as a single video content based on actual needs; each advertisement in a commercial can be considered as a single video content.

[0028] In step S120, in response to the hiding operation of the advertising video, the advertising video in the video recording file is filtered according to the advertising node corresponding to the advertising video.

[0029] In step S130, the video recording file after filtering the advertisement video is played.

[0030] It can provide a hiding control (such as a hide button) for ad videos. In response to user actions (such as clicking), the hiding control triggers the hiding operation of the ad video. It can directly filter all ad videos in the video recording file based on the ad node corresponding to the ad video, and then automatically skip all ad videos when playing the video recording file.

[0031] Optionally, a hiding control can be provided for each ad video. Users can select to filter one or more ad videos based on the hiding control corresponding to each ad video, and then automatically skip one or more hidden ad videos when playing the video recording file.

[0032] In one embodiment, filtering ad videos from a video recording file based on ad nodes corresponding to ad videos can be achieved by automatically trimming the video recording file according to the time information corresponding to the ad nodes, removing the ad videos corresponding to the ad nodes, resulting in a video recording file without ad videos. Users can choose to save this ad-free video recording file, overwriting the original video recording file to save storage space. The ad-free video recording file can also be played later, enabling one-click skipping of ad videos.

[0033] In one embodiment, filtering ad videos in a video recording file based on the ad node corresponding to the ad video eliminates the need to process the video recording file itself; an automatic skipping operation is sufficient during playback. Specifically, during playback, when the video content at the current (or next) moment is identified as an ad video based on the ad node, the playback automatically jumps to the non-ad video content following the ad video at the current (or next) moment, without requiring the user to manually skip the ad video.

[0034] By employing the technical solution of this application embodiment, multiple nodes of a selected video recording file can be displayed to the user, showing information about multiple video contents within the video recording file. These multiple nodes include advertising nodes, thus the displayed video content information also includes information about advertising videos, which can help users identify advertising content. In this way, users can gain a detailed understanding of the entire video recording file, not just the program information at the initial stage of video recording. In response to the operation of hiding advertising videos, advertising videos in the video recording file can be filtered according to the advertising nodes corresponding to the advertising videos, thereby allowing the playback of the video recording file after filtering advertising videos, achieving the effect of removing advertising videos and improving the user's viewing experience.

[0035] Based on the above technical solution, as an example, before displaying multiple nodes of the video recording file, it is necessary to first obtain the video recording file by recording the video. During the video recording process, multiple nodes can be generated simultaneously. Figure 2 This is a schematic diagram of a video recording process provided in an embodiment of this application; see reference. Figure 2 Before displaying multiple nodes of the video recording file, the video processing method may further include: in response to a video recording instruction, obtaining a Program Map Table (PMT) and an Electrical Program Guide (EPG) corresponding to the video recording instruction; during video recording, obtaining audio and video features of the currently recorded video content; based on the PMT, the EPG, and / or the audio and video features, identifying whether the currently recorded video content has changed relative to the video content recorded at the previous moment; when a change in the video content is identified, generating a corresponding node based on the currently recorded video content, adding the information of the currently recorded video content to the information of the node, and using the current recording time as the end time of the previous node and adding it to the information of the previous node.

[0036] The video recording command can be generated when the user clicks the record button, or it can be generated when the user pre-books a video recording at a specific time. In response to the video recording command, the television channel or online content (such as live streaming content) to be recorded can be specified.

[0037] Based on the TV channel to be recorded, the Program Association Table (PAT) and EPG for that channel can be obtained, and the PMT for that channel can be retrieved from the PAT. The PAT is a core index table in the digital television transmission stream (TS) where the Packet Identifier (PID) is fixed at 0x0000. It records the PIDs of all PMTs corresponding to each program, providing an entry point for the device to locate the PMT of a specific program. The PMT corresponds to a detail table for a single program, recording the PIDs of the video, audio, subtitle, and other element streams contained in the program, helping the device extract the specific data required for program playback. The SCTE-35 data in the PMT is a signal identifier used to indicate the start, end, and location of advertising segments. The EPG is a digital service system provided to television users, displaying program names, broadcast times, and descriptions in an intuitive interface.

[0038] The PMT (Program Media Detection) data can be used to determine whether a recorded video contains advertisements. If the PMT contains SCTE-35 data, then the video contains advertisements. If the PMT does not contain SCTE-35 data, the recorded video may or may not contain advertisements. In this case, the audio and video characteristics of the video content can be used to determine whether the current video content is an advertisement video.

[0039] During video recording, audio and video features of the recorded video content can be extracted to determine whether the current video content is an advertisement. These features may include the brightness histogram of video frames, audio loudness, and / or the frequency of scene transitions within the video content.

[0040] EPGs are used to describe program information, so the video content at each moment can be determined based on the EPG. However, EPGs typically only describe program information and do not include advertising information. Therefore, it is necessary to combine the EPG with the audio and video characteristics of the PMT and / or video content to accurately determine the video content at each moment.

[0041] Based on PMT, EPG, and / or audio / video features, the video content at each moment can be determined, thus identifying whether the currently recorded video content has changed compared to the video content recorded at the previous moment. Whether the video content has changed can include changing from one program to another, from a program to an advertisement, and from an advertisement to a program.

[0042] When a change in video content is detected, a new node needs to be generated. Therefore, a node corresponding to the changed video content can be generated, and the information of the video content corresponding to that node can be used as the node's information, which is then recorded. Furthermore, the time of the video content change can be either the start time of the changed video content or the end time of the original video content. Therefore, the current recording time (i.e., the time of the video content change) can be used as the end time of the previous node, and this end time can be added to the information of the previous node.

[0043] By adopting the technical solution of this application embodiment, it is possible to determine whether the video content has changed based on PMT, EPG and audio-visual features, thereby determining whether to generate a new node. Generating a new node when the video content changes can ensure that the video content and the node correspond one-to-one. When displaying node information later, users can understand the detailed information of each video content in the entire video recording file, not just the program information at the beginning of the video recording, so as to help users understand the video recording file.

[0044] In one embodiment, based on the network content to be recorded (e.g., live streaming content), a program list provided by the platform or program producer can be obtained. During video recording, audio and video features and video semantic information can be acquired. Based on the program list, audio and video features, and / or video semantic information, the video content at each recording moment is determined, and new nodes are generated when the video content changes. The program list may include program name, time, and actor information. Video semantic information can be obtained based on deep learning models and / or natural language processing models; video semantic information may include video objects (such as people, objects, scenes, etc.) and event information (such as singer performances, vehicle collisions, etc.). Based on the program list, audio and video features, and / or video semantic information, node information can be determined, and the nodes and their corresponding information are saved.

[0045] Based on the above technical solution, as an example, refer to Figure 2 The step of identifying whether the currently recorded video content has changed compared to the video content recorded at the previous moment based on the PMT, the EPG, and / or the audio and video features may include: detecting whether the PMT includes an advertisement insertion prompt; if the PMT includes the advertisement insertion prompt, determining the start time of the advertisement video based on the advertisement insertion prompt; and if the current recording time is the start time of the advertisement video, determining that the currently recorded video content has changed compared to the video content recorded at the previous moment, and that the video content has changed to the advertisement video.

[0046] The advertising notification information can be SCTE-35 data, which indicates the start, end, and location of the advertising period. When the PMT corresponding to the video recording instruction includes advertising notification information, it proves that the recorded video includes advertising video. The start time of the advertising video can be determined based on the advertising insertion notification information. If the current recording time is the start time of the advertising video, and the video content at the previous moment was not advertising video, it can be determined that the currently recorded video content has changed compared to the video content recorded at the previous moment, and the video content has changed to advertising video.

[0047] By adopting the technical solution of this application embodiment, it is possible to determine whether the recorded video content is an advertising video based on the advertising insertion prompt information in the PMT, so as to generate advertising nodes in the future, and then filter out advertising videos based on the advertising nodes, so as to bring a good viewing experience to users.

[0048] Based on the above technical solution, as an embodiment, obtaining the audio and video features of the currently recorded video content may include: detecting whether the currently recorded video content has a black screen; detecting whether the audio of the currently recorded video content has a sudden change in loudness; and determining the switching frequency of the scene in the currently recorded video content.

[0049] The audio-visual characteristics of video content may include the brightness histogram of video frames, audio loudness, and / or the switching frequency of scene transitions in the video content.

[0050] Video frames can be extracted from recorded video content, converted into grayscale images, and the number of pixels with different brightness values ​​(0-255) in the grayscale images can be counted to generate a brightness histogram with brightness value on the horizontal axis and the corresponding number of pixels on the vertical axis. If, in a continuous target number of video frames, a pixel brightness greater than a preset proportion is lower than a brightness threshold, a candidate boundary is triggered, which can be considered as the occurrence of a video black screen. Specifically, a video black screen is considered to have occurred when >95% of the pixels in a video frame have a brightness <10 (0-255 range) for more than 5 consecutive frames.

[0051] A video black screen refers to an area or frame in a video frame with a brightness value of 0 or close to 0, appearing pure black or extremely dark, lacking effective color and detail information. Video black screens may be part of the video content design (such as scene transitions or black screen subtitles) or may be invalid footage caused by shooting or transmission malfunctions (such as signal interruption or lens obstruction). Video black screens are often used as transition signals for inserting and switching between advertisements. When switching between programs and advertisements, or between different advertisements, the black screen can avoid the visual abruptness caused by sudden changes in image quality, while also providing signal synchronization time for the playback system, ensuring accurate insertion or exit of advertisements. Therefore, video content with a video black screen is more likely to be an advertisement video compared to video content without a video black screen.

[0052] The short-term loudness of audio can be calculated based on the Audio Loudness Normalization Standard (EBU R128) at preset intervals (e.g., 500 milliseconds). Continuous monitoring of loudness changes is crucial. If, within a consecutive time window of several seconds (e.g., 2 seconds), the increase in loudness difference between consecutive time periods exceeds 5 loudness units at full scale (LUFS), it can be determined that the audio of the video content has experienced a loudness abrupt change. Video content exhibiting loudness abrupt changes is more likely to be advertising videos compared to video content without such abrupt changes.

[0053] Scene transitions can be identified using scene detection techniques (such as inter-frame difference analysis and edge feature comparison). This involves comparing pixel differences, color distribution, or texture features between adjacent video frames. When the difference exceeds a set threshold, a scene transition is identified and its timing is recorded. The number of transitions per unit of time (e.g., per minute, per hour) is then counted to determine the scene transition frequency. Scene transition frequency reflects the video's rhythm; for example, action movies have high transition frequencies, while documentaries have low frequencies. It can also help determine the type of video content; for instance, advertisements often have a high transition frequency due to dense editing. Therefore, scene transition frequency is positively correlated with the likelihood that the video content is an advertisement.

[0054] When the PMT does not include the advertisement insertion prompt information, the method may further include: determining that the currently recorded video content is the advertisement video when the currently recorded video content has a black screen, the audio has a sudden change in loudness, and / or the switching frequency is greater than a switching frequency threshold; and determining that the currently recorded video content is the advertisement video, and the video content recorded at the previous moment was not the advertisement video, that the currently recorded video content has changed relative to the video content recorded at the previous moment, and that the video content has changed to the advertisement video.

[0055] Whether the currently recorded video content is an advertisement video can be determined by considering factors such as whether there are black screens in the video, whether there are sudden changes in the loudness of the audio, and / or whether the switching frequency exceeds a switching frequency threshold. The switching frequency threshold can be set according to actual needs.

[0056] Optionally, an ad score can be calculated for each audio / video feature, and a weight can be set for each feature. The ad scores for each audio / video feature are then weighted and summed to obtain the total ad score. A preset total score threshold is set, and the relationship between the total ad score and the threshold is used to determine whether the video content corresponding to a given audio / video feature is an ad video.

[0057] Optionally, an advertising determination model can be pre-trained in a supervised manner using a large amount of labeled audio and video feature sample data. In practical applications, the audio and video features are input into the trained advertising determination model, and the model determines whether the video content corresponding to the audio and video features is an advertising video.

[0058] In one embodiment, the determination of whether a video content is an advertisement video can be made by combining whether the PMT includes an ad insertion prompt message with audio and video characteristics. Alternatively, if the PMT does not include an ad insertion prompt message, the determination of whether the video content is an advertisement video can be made based on audio and video characteristics.

[0059] The method of determining whether video content is an advertisement based on audio and video features can also be applied to the recording process of online content.

[0060] When it is determined that the currently recorded video content is the advertising video, and the video content recorded at the previous moment was not the advertising video, it can be determined that the currently recorded video content has changed compared to the video content recorded at the previous moment, and the video content has changed to the advertising video.

[0061] The technical solution adopted in this application embodiment can determine whether the video content is an advertisement video even if the PMT does not include advertisement insertion prompt information. It has a wide range of applications and strong scene compatibility and universality. Combining whether the PMT includes advertisement insertion prompt information and audio and video features to jointly determine whether the video content is an advertisement video can improve the accuracy of the judgment.

[0062] Based on the above technical solution, as an embodiment, the step of generating a corresponding node according to the currently recorded video content when the video content is detected to have changed may include: generating a node corresponding to the advertising video when the video content is detected to have changed to the advertising video; marking the node corresponding to the advertising video as an advertising node; the step of adding the information of the currently recorded video content to the node information includes: obtaining the start time and end time of the advertising video, and adding the start time and end time to the advertising node information.

[0063] When it is determined that the video content has changed, nodes corresponding to the changed video content can be generated. When the video content is changed to an advertisement video, the nodes corresponding to the generated advertisement video can be marked as advertisement nodes.

[0064] If the recorded video content is determined to be an advertisement video based on SCTE-35 data, the start and end times of the advertisement video can be directly obtained from the SCTE-35 data. These start and end times can then be used as the node's time information, added to the node's information, and saved. Compared to the information of nodes for non-advertisement videos, the information for advertisement video nodes can be more concise, without needing to include thumbnails or actor information.

[0065] By adopting the technical solution of this application embodiment, when it is detected that the video content has changed to an advertising video, an advertising node can be generated and the time information of the advertising node can be determined so that the advertising video can be filtered out according to the advertising node, so as to bring a good viewing experience to the user.

[0066] Based on the above technical solution, as an example, such as Figure 2As shown, the video processing method may further include: generating an initial node at the beginning of video recording; obtaining information about the initially recorded video content from the EPG; and adding the information about the initially recorded video content to the information of the initial node.

[0067] At the beginning of video recording, an initial node can be generated directly, and the information of the initially recorded video content can be obtained. This information can then be added to the initial node's information and saved.

[0068] At the beginning of video recording, it can be determined whether the initially recorded video content is an advertisement video based on PMT and / or audio / video features. If the initially recorded video content is an advertisement video, the initial node can be marked as an advertisement node, and the start and end times of the advertisement video can be obtained and added to the information of the advertisement node.

[0069] If the initially recorded video content is not an advertisement video, information about the initially recorded video content can be obtained from the EPG, added to the information of the initial node, and saved. The target video frame is extracted from the initially recorded video content, and a node thumbnail is generated based on the target video frame; this node thumbnail is then added to the information of the initial node and saved.

[0070] By adopting the technical solution of this application embodiment, an initial node can be directly generated at the beginning of video recording, and the information of the initial node can be obtained according to EPG, avoiding the situation where no video content changes can be generated at the beginning of video recording, thereby providing users with comprehensive information on multiple video contents.

[0071] Based on the above technical solution, as an example, such as Figure 2 As shown, identifying whether the currently recorded video content has changed relative to the video content recorded at the previous moment based on the PMT, the EPG, and / or the audio and video features may include: when the EPG represents a change in the television program information, determining that the currently recorded video content has changed relative to the video content recorded at the previous moment, and that the video content has changed to the target television program.

[0072] At the beginning of non-video recording, program (video content) information can be continuously obtained from the EPG. When the program information in the EPG changes, it proves that the program has changed, and it can be determined that the currently recorded video content has changed compared to the video content recorded at the previous moment, and that the video content has changed to the target television program. The target television program is the program corresponding to the changed program information in the EPG.

[0073] The step of generating a corresponding node based on the currently recorded video content and adding the information of the currently recorded video content to the node when a change in the video content is detected may include: generating a target node corresponding to the target TV program when the video content is detected to have changed to the target TV program; obtaining information of the target TV program from the target TV program; extracting target video frames from the target TV program and generating a node thumbnail based on the target video frames; and adding the information of the target TV program and the node thumbnail to the information of the target node.

[0074] When the video content is detected to have changed to the target TV program, a target node corresponding to the target TV program can be generated. Information about the target TV program can be obtained from the EPG, including but not limited to program name, program details, actor information, start time, and / or duration. This information can be added to the target node's information and saved. The saved information in the node can be modified according to the actual situation of the node. For example, if the EPG records a duration of one hour, but the actual duration is one and a half hours, then the previously saved duration of one hour can be changed to one and a half hours.

[0075] Alternatively, a video frame can be extracted from the target TV program as a thumbnail, and this thumbnail can be added to the target node's information and saved. Specifically, the recorded clear stream TS file of the target TV program can be captured, and a frame can be extracted from the clear stream TS file using ffmpeg as the thumbnail. Optionally, when the program information in the EPG changes, the first frame of clear stream data after the change can be extracted as the thumbnail, because the clear stream data at the moment the program starts has strong event representation capabilities and can realistically present the inherent attributes of the event. Optionally, a frame can be randomly selected from the clear stream TS file of the target TV program as the thumbnail.

[0076] By adopting the technical solution of this application embodiment, it is possible to determine whether the TV program has changed based on whether the EPG has changed, and then determine whether to generate a corresponding node. For the node corresponding to the TV program, the TV program information in the EPG can be directly used as node information, and video frames can be extracted as thumbnails, thereby showing the user detailed information of the node corresponding to the TV program, so that the user can clearly understand the video content corresponding to the node and improve the user experience.

[0077] Figure 3 This is a schematic diagram illustrating the steps of a video processing method provided in an embodiment of this application; as shown... Figure 3As shown, in step S310, the video recording file list is accessed, and a video recording file is selected. In step S320, the detailed information of the selected video recording file is displayed. In step S330, the node information saved during the recording of this video file is read. In step S340, the node information is displayed in sorted order; the node information includes thumbnails, program names, time information, actor information, and whether it is an advertisement. In step S350, the user selects the node they want to watch to play, or chooses to skip the advertisement.

[0078] Recorded video files can be pre-saved into a video recording file list, which can then be displayed. Users can navigate to the video recording file list and select any video recording file. In response to the selection, detailed information about the selected file can be displayed, including but not limited to the total duration, start and end times, and the recorded TV channel. Furthermore, node information generated and saved during the recording process can be read and sorted by recording time. Node information may include, but is not limited to, thumbnails, program names, time information, actor information, and / or whether it is an advertisement. Users can select any node to play the corresponding video content. Users can also choose to skip advertisements and play the video recording file after skipping the advertisements.

[0079] Based on the above technical solution, as an example, Figure 4 This is a schematic diagram of a node provided in an embodiment of this application, as shown below. Figure 4 As shown, displaying multiple nodes of the video recording file may include: displaying a playback progress bar on the playback interface of the video recording file; and associating and displaying multiple nodes with the playback progress bar according to the playback time corresponding to each node of the video recording file. The method may further include: in response to a target operation on the displayed node, jumping to the playback time corresponding to the node for playback.

[0080] When displaying multiple nodes of a video recording file, a playback progress bar can be shown on the video recording file's playback interface, simultaneously displaying multiple nodes from the video recording file. These nodes can be associated with multiple playback progress bars according to their respective playback times. Specifically, the nodes can be displayed within the playback progress bars, such as... Figure 4As shown, multiple dots can be displayed on the playback progress bar, each dot representing a node, and the position of each node on the progress bar indicates the playback time corresponding to that node. Node information can also be displayed along with the node itself. This can be done in several ways: first, displaying all the node's information directly when the node is displayed; second, displaying detailed information only when the user performs a node information display operation (e.g., hovering the mouse over the node); third, displaying basic node information (e.g., time information) initially, and then displaying detailed information (e.g., thumbnail, program name, time information, actor information, and / or whether it's an advertisement) when the user performs a node information display operation.

[0081] When a user performs a target action on a displayed node (e.g., clicks on a node), in response to the target action, the system can directly jump to the playback time corresponding to that node for playback. The playback time corresponding to a node can be the start time of that node.

[0082] By adopting the technical solution of this application embodiment, users can clearly understand the video content corresponding to each node through the displayed node information. It also supports playing directly from the playback time corresponding to the node. Users can quickly find the video content of interest through the displayed node information and quickly play the video content of interest, thereby improving the user experience.

[0083] To facilitate better implementation of the video processing method of this application, this application also provides a video processing apparatus based on the above-described video processing method. The meanings of the terms used are the same as in the video processing method described above, and specific implementation details can be found in the descriptions of the method embodiments.

[0084] Please see Figure 5 , Figure 5 This is a schematic diagram of the structure of a video processing apparatus provided in an embodiment of this application, wherein the video processing apparatus includes: The display module 501 is used to display multiple nodes of the video recording file in response to the selection operation of the video recording file; the multiple nodes correspond one-to-one with multiple video contents in the video recording file; the video contents include advertising videos; The filtering module 502 is used to filter the advertising video in the video recording file according to the advertising node corresponding to the advertising video in response to the hiding operation of the advertising video; The playback module 503 is used to play the video recording file after filtering the advertisement video.

[0085] In one embodiment, the device further includes: The information acquisition module is used to acquire the Program Map Table (PMT) and Television Program Guide (EPG) corresponding to the video recording instruction in response to the video recording instruction. The feature acquisition module is used to acquire the audio and video features of the currently recorded video content during video recording. The change recognition module is used to identify whether the currently recorded video content has changed relative to the video content recorded at the previous moment, based on the PMT, the EPG and / or the audio and video features. The node generation module is used to generate a corresponding node based on the currently recorded video content when a change in the video content is detected, and to add the information of the currently recorded video content to the information of the node, and to use the current recording time as the end time of the previous node and add it to the information of the previous node.

[0086] In one embodiment, the change identification module includes: The detection unit is used to detect whether the PMT includes an advertisement insertion prompt message; A time determination unit is used to determine the start time of the advertisement video based on the advertisement insertion prompt information when the advertisement insertion prompt information is included in the PMT; The first change determination unit is configured to determine, when the current recording time is the start time of the advertising video, that the currently recorded video content has changed relative to the video content recorded at the previous moment, and that the video content has been changed to the advertising video.

[0087] In one embodiment, the feature acquisition module includes: The black screen detection unit is used to detect whether the currently recorded video content has a black screen. An audio detection unit is used to detect whether there is a sudden change in loudness in the audio of the currently recorded video content; A frequency determination unit is used to determine the switching frequency of the scene in the currently recorded video content; The device further includes: The advertisement determination module is used to determine that the currently recorded video content is the advertisement video when the currently recorded video content has a black screen, the audio has a sudden change in loudness, and / or the switching frequency is greater than the switching frequency threshold. The second change determination module is used to determine that, when it is determined that the currently recorded video content is the advertising video and the video content recorded at the previous moment is not the advertising video, the currently recorded video content has changed relative to the video content recorded at the previous moment, and the video content has changed to the advertising video.

[0088] In one embodiment, the change identification module includes: An advertising node generation unit is used to generate a node corresponding to the advertising video when it is detected that the video content has changed to the advertising video; An advertising tagging unit is used to tag the node corresponding to the advertising video as an advertising node; The node generation module includes: An information adding unit is used to obtain the start time and end time of the advertising video and add the start time and end time to the information of the advertising node.

[0089] In one embodiment, the change identification module includes: The third change determination unit is used to determine, when the EPG characterizes the television program information, that the currently recorded video content has changed relative to the video content recorded at the previous moment, and that the video content has changed to the target television program. The node generation module includes: The target node generation unit is used to generate a target node corresponding to the target TV program when it is detected that the video content has changed to the target TV program; A program information acquisition unit is used to acquire information about the target television program from the target television program; The thumbnail generation unit is used to extract target video frames from the target TV program and generate node thumbnails based on the target video frames. The target node information adding unit is used to add the information of the target TV program and the node thumbnail to the information of the target node.

[0090] In one embodiment, the device further includes: The initial node generation module is used to generate initial nodes at the beginning of video recording. An initial information acquisition module is used to acquire information about the initially recorded video content from the EPG; The initial information adding module is used to add information about the initially recorded video content to the information of the initial node.

[0091] In one embodiment, the display module 501: A progress bar display unit is used to display a playback progress bar on the playback interface of the video recording file. The associated display unit is used to associate and display multiple nodes with the playback progress bar according to the playback time corresponding to each node of the video recording file. The device further includes: The jump module is used to respond to a target operation on the displayed node and jump to the playback time corresponding to the node for playback.

[0092] By employing the technical solution of this application embodiment, multiple nodes of a selected video recording file can be displayed to the user, showing information about multiple video contents within the video recording file. These multiple nodes include advertising nodes, thus the displayed video content information also includes information about advertising videos, which can help users identify advertising content. In this way, users can gain a detailed understanding of the entire video recording file, not just the program information at the initial stage of video recording. In response to the operation of hiding advertising videos, advertising videos in the video recording file can be filtered according to the advertising nodes corresponding to the advertising videos, thereby allowing the playback of the video recording file after filtering advertising videos, achieving the effect of removing advertising videos and improving the user's viewing experience.

[0093] For specific limitations regarding the video processing device, please refer to the limitations on the video processing method above, which will not be repeated here. Each module in the aforementioned video processing device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in hardware or independently of the processor in the computer device, or stored in software in the memory of the computer device, so that the processor can call and execute the operations corresponding to each module.

[0094] In addition, this application also provides an electronic device, such as Figure 6 As shown, it illustrates the structural diagram of the electronic device involved in this application, specifically: The electronic device may include components such as a processor 601 with one or more processing cores and a memory 602 with one or more computer-readable storage media. Those skilled in the art will understand that... Figure 6 The electronic device structure shown does not constitute a limitation on the electronic device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 601 is the control center of the electronic device. It connects various parts of the electronic device via various interfaces and lines, and performs various functions and processes data by running or executing software programs and / or modules stored in the memory 602, and by calling data stored in the memory 602, thereby providing overall monitoring of the electronic device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 601.

[0095] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0096] In one embodiment, the electronic device further includes a power supply 603 that supplies power to the various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 603 may also include one or more DC or AC power supplies, recharging systems, power equipment debugging circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0097] In one embodiment, the electronic device may further include an input unit 604, which can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0098] Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the electronic device loads the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 601 runs the applications stored in the memory 602, thereby implementing the steps in any of the video processing methods provided in the embodiments of this application.

[0099] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the electronic device to which the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0100] In one embodiment, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the methods described in any embodiment of this application.

[0101] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the method described in any embodiment of this application.

[0102] In some embodiments, a computer program product is also provided, including a computer program or instructions that, when executed by a processor, implement the methods described in any embodiment of this application.

[0103] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0104] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0105] Therefore, this application provides a computer-readable storage medium storing a computer program that can be loaded by a processor to execute the steps of any of the video processing methods provided in this application.

[0106] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0107] The computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0108] Since the instructions stored in the computer-readable storage medium can execute the steps of any of the video processing methods provided in this application, the beneficial effects that any of the video processing methods provided in this application can achieve can be realized, as detailed in the preceding embodiments, and will not be repeated here.

[0109] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or terminal device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or terminal device. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or terminal device that includes said element.

[0110] The foregoing has provided a detailed description of a video processing method, apparatus, electronic device, and computer-readable storage medium provided in this application. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, those skilled in the art will recognize that, based on the ideas of the present invention, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A method of video processing, the method comprising: The method comprises: in response to a selection operation on a video recording file, displaying a plurality of nodes of the video recording file; the plurality of nodes correspond one-to-one to a plurality of video contents in the video recording file; the video contents include an advertisement video; in response to a hiding operation on the advertisement video, filtering the advertisement video in the video recording file according to an advertisement node corresponding to the advertisement video; playing the video recording file after filtering the advertisement video.

2. The method of claim 1, wherein, Before displaying the plurality of nodes of the video recording file, the method further comprises: in response to a video recording instruction, obtaining a program map table (PMT) and an electronic program guide (EPG) corresponding to the video recording instruction; when video recording is performed, obtaining an audio and video feature of the video content being currently recorded; according to the PMT, the EPG and / or the audio and video feature, identifying whether the video content being currently recorded has changed relative to the video content being recorded at a previous time; when it is identified that the video content has changed, generating a node corresponding to the video content being currently recorded, adding information of the video content being currently recorded to information of the node, and taking a current recording time as an end time of a previous node and adding the end time to information of the previous node.

3. The method of claim 2, wherein, The identification of whether the video content being currently recorded has changed relative to the video content being recorded at a previous time according to the PMT, the EPG and / or the audio and video feature comprises: detecting whether the PMT includes advertisement insertion prompt information; when the PMT includes the advertisement insertion prompt information, determining a start time of the advertisement video according to the advertisement insertion prompt information; when the current recording time is the start time of the advertisement video, determining that the video content being currently recorded has changed relative to the video content being recorded at a previous time, and the video content change is the advertisement video.

4. The method of claim 3, wherein, The obtaining of the audio and video feature of the video content being currently recorded comprises: detecting whether a video black field appears in the video content being currently recorded; detecting whether a loudness mutation appears in an audio of the video content being currently recorded; determining a switching frequency of a picture scene of the video content being currently recorded; when the PMT does not include the advertisement insertion prompt information, the method further comprises: when the video content being currently recorded appears a black field, the audio appears a loudness mutation and / or the switching frequency is greater than a switching frequency threshold, determining that the video content being currently recorded is the advertisement video; when it is determined that the video content being currently recorded is the advertisement video and the video content being recorded at a previous time is not the advertisement video, it is determined that the video content being currently recorded has changed relative to the video content being recorded at a previous time, and the video content change is the advertisement video.

5. The method of claim 2, wherein, The generation of the node corresponding to the video content being currently recorded when it is identified that the video content has changed comprises: when it is identified that the video content change is the advertisement video, generating a node corresponding to the advertisement video; marking the node corresponding to the advertisement video as an advertisement node; and The adding of the information of the currently recorded video content to the information of the node comprises: obtaining a start time and an end time of the advertisement video, and adding the start time and the end time to the information of the advertisement node.

6. The method of claim 2, wherein, The identifying of whether the currently recorded video content is changed relative to the video content recorded at the last time according to the PMT, the EPG and / or the audio / video features comprises: when the EPG represents that the television program information is changed, determining that the currently recorded video content is changed relative to the video content recorded at the last time, and the video content change is a target television program; The generating of the node corresponding to the currently recorded video content and the adding of the information of the currently recorded video content to the information of the node when the video content change is identified comprise: when the video content change is identified as the target television program, generating a target node corresponding to the target television program; obtaining information of the target television program from the target television program; extracting a target video frame from the target television program, and generating a node thumbnail according to the target video frame; adding the information of the target television program and the node thumbnail to the information of the target node.

7. The method of claim 2, wherein, The method further comprises: generating an initial node at the beginning of video recording; obtaining information of the initially recorded video content from the EPG; adding the information of the initially recorded video content to the information of the initial node.

8. The method of claim 1, wherein, The displaying of the multiple nodes of the video recording file comprises: displaying a play progress bar in a play interface of the video recording file; displaying the multiple nodes in association with the play progress bar according to the play time corresponding to each of the multiple nodes of the video recording file; The method further comprises: in response to a target operation on the displayed node, jumping to the play time corresponding to the node for playing.

9. A video processing apparatus, comprising: It comprises: a display module configured to display multiple nodes of a video recording file in response to a selection operation on the video recording file; the multiple nodes correspond one-to-one to multiple video contents in the video recording file; the video contents comprise advertisement videos; a filtering module configured to filter the advertisement videos in the video recording file according to advertisement nodes corresponding to the advertisement videos in response to a hiding operation on the advertisement videos; a play module configured to play the video recording file after filtering the advertisement videos.

10. An electronic device, comprising: It comprises a memory, a processor and a computer program stored on the memory and executable on the processor, and the processor executes the computer program to implement the steps in the video processing method according to any one of claims 1 to 8.

11. A computer readable storage medium, characterized in that, The computer program is stored on the computer readable storage medium, and the computer program is executed by the processor to implement the steps in the video processing method according to any one of claims 1 to 8.

Images