Video processing method, device, electronic device and storage medium

Abstract

The present application provides a video processing method, device, electronic device and storage medium, and relates to the field of data processing technology. The method obtains the basic information of the video to be processed by parsing, and can match at least one target processing task corresponding to the video to be processed according to the basic information, so that each processing task can be executed in sequence on the video to be processed according to the execution order of each target processing task, and a target video that meets the release standard can be obtained. Since the basic information of different videos to be processed is different, and the target processing task is determined based on the basic information of the video to be processed, different videos to be processed can be personalized and matched to the corresponding target processing task, breaking the traditional video processing, in which all videos execute the same target processing task, and cannot meet the personalized processing of different videos, so that the effect of video processing is better.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a video processing method, device, electronic device and storage medium. Background Art

[0002] Usually, when videos published by video suppliers are released to the big screen for playback, they need to be processed by the big screen operator to process the videos into videos that meet the requirements and then released to the big screen for playback.

[0003] In the prior art, the video is processed twice through a fixed video processing flow. Since the processing of the fixed video processing flow is relatively simple and cannot meet the personalized processing requirements, the video processing effect is poor. Summary of the invention

[0004] The purpose of this application is to provide a video processing method, device, electronic device and storage medium to address the deficiencies in the above-mentioned prior art, so as to solve the problem that the fixed video processing flow in the prior art cannot meet the personalized processing needs.

[0005] To achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:

[0006] In a first aspect, an embodiment of the present application provides a video processing method, including:

[0007] Parse the video file to be processed and obtain basic information of the video to be processed;

[0008] Determine at least one target processing task according to basic information of the video to be processed, and execute each processing task on the video to be processed in sequence according to the order of each target processing task to obtain a target video;

[0009] The target video and the attribute information bound to the target video are published to the terminal, so that the terminal displays the target video on the display interface of the terminal according to the attribute information.

[0010] Optionally, before parsing the video file to be processed and obtaining basic information of the video to be processed, the process includes:

[0011] Receiving a video file to be processed transmitted by a video provider through a preset file transmission interface, or pulling the video file to be processed from a file extraction link provided by the video provider through a preset file transmission engine, wherein the preset file transmission interface includes: a transmission client, a software development kit client, and a browser transmission plug-in;

[0012] The obtained video files to be processed are stored in a file sharing storage system.

[0013] Optionally, parsing the video file to be processed to obtain basic information of the video to be processed includes:

[0014] Monitoring the newly added video files in the file sharing storage system to obtain the video files to be processed;

[0015] Parse the text information contained in the video file to be processed to obtain basic information of the video to be processed, where the basic information of the video to be processed includes: video source, video format, video resolution, video bit rate, and video content classification.

[0016] Optionally, determining at least one target processing task according to basic information of the video to be processed, and sequentially executing each processing task on the video to be processed in the order of each target processing task to obtain the target video includes:

[0017] According to the basic information of the video to be processed, at least one target processing task matching the video to be processed is screened from a preset processing task sequence, and each target processing task is executed on the video to be processed according to the order of each target processing task in the processing task sequence to obtain the target video. The processing tasks in the processing task sequence include: video transcoding processing, video masking processing, image frame extraction processing, and intelligent recognition processing.

[0018] Optionally, the step of selecting at least one target processing task matching the video to be processed from a preset processing task sequence according to the basic information of the video to be processed includes:

[0019] Determine a target processing task for the video transcoding processing task in the processing task sequence;

[0020] If the video source of the video to be processed meets the logo processing condition, the video logo processing in the processing task sequence is determined as a target processing task;

[0021] If the video content classification of the video to be processed meets the classification condition, the picture frame extraction processing in the processing task sequence is determined as a target processing task;

[0022] If the video source of the video to be processed meets the preset source, and the video content classification of the video to be processed meets the preset classification, the intelligent recognition processing in the processing task sequence is determined as a target processing task.

[0023] Optionally, the processing task includes: video parsing processing, before publishing the target video and the attribute information bound to the target video to the terminal, including:

[0024] Parsing the video to be processed, and obtaining cataloging information and tag information of the video to be processed;

[0025] The cataloging information and tag information of the video to be processed are bound to the target video as the attribute information.

[0026] Optionally, publishing the target video and the attribute information bound to the target video to a terminal includes:

[0027] According to the performance parameters of each terminal to be played and the network parameters, the target video and the attribute information bound to the target video are published to the corresponding terminal.

[0028] In a second aspect, an embodiment of the present application further provides a video processing device, including: an acquisition module, an execution module, and a publishing module;

[0029] The acquisition module is used to parse the video file to be processed and obtain basic information of the video to be processed;

[0030] The execution module is used to determine at least one target processing task according to the basic information of the video to be processed, and execute each processing task in sequence on the video to be processed in accordance with the order of each target processing task to obtain a target video;

[0031] The publishing module is used to publish the target video and the attribute information bound to the target video to the terminal, so that the terminal displays the target video on the display interface of the terminal according to the attribute information.

[0032] Optionally, the device further includes: a receiving module and a storage module;

[0033] The receiving module is used to receive the video file to be processed transmitted by the video provider through a preset file transmission interface, or to pull the video file to be processed from the file extraction link provided by the video provider through a preset file transmission engine, wherein the preset file transmission interface includes: a transmission client, a software development kit client, and a browser transmission plug-in;

[0034] The storage module is used to store the acquired video file to be processed in the file sharing storage system.

[0035] Optionally, the acquisition module is specifically used to monitor the newly added video files in the file sharing storage system to acquire the video files to be processed;

[0036] Parse the text information contained in the video file to be processed to obtain basic information of the video to be processed, where the basic information of the video to be processed includes: video source, video format, video resolution, video bit rate, and video content classification.

[0037] Optionally, the execution module is specifically used to screen at least one target processing task that matches the video to be processed from a preset processing task sequence according to the basic information of the video to be processed, and execute each target processing task on the video to be processed according to the order of each target processing task in the processing task sequence to obtain the target video. The processing tasks in the processing task sequence include: video transcoding processing, video masking processing, image frame extraction processing, and intelligent recognition processing.

[0038] Optionally, the execution module is specifically used to determine a target processing task from the video transcoding processing task in the processing task sequence;

[0039] If the video source of the video to be processed meets the logo processing condition, the video logo processing in the processing task sequence is determined as a target processing task;

[0040] If the video content classification of the video to be processed meets the classification condition, the picture frame extraction processing in the processing task sequence is determined as a target processing task;

[0041] If the video source of the video to be processed meets the preset source, and the video content classification of the video to be processed meets the preset classification, the intelligent recognition processing in the processing task sequence is determined as a target processing task.

[0042] Optionally, the device further comprises: a binding module;

[0043] The acquisition module is further used to parse the video to be processed and acquire cataloging information and tag information of the video to be processed;

[0044] The binding module is used to bind the cataloging information and tag information of the video to be processed with the target video as the attribute information.

[0045] Optionally, the publishing module is specifically used to publish the target video and the attribute information bound to the target video to the corresponding terminal according to the performance parameters of each terminal to be played and the network parameters.

[0046] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the storage medium communicate through the bus, and the processor executes the machine-readable instructions to perform the steps of the video processing method provided in the first aspect.

[0047] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the video processing method provided in the first aspect are executed.

[0048] The beneficial effects of this application are:

[0049] The present application provides a video processing method, device, electronic device and storage medium. The method can obtain the basic information of the video to be processed by parsing, and can match at least one target processing task corresponding to the video to be processed according to the basic information, so that each processing task can be executed in sequence on the video to be processed according to the execution order of each target processing task, and a target video that meets the release standard can be obtained. Since the basic information of different videos to be processed is different, and the target processing task is determined based on the basic information of the video to be processed, different videos to be processed can be personalized and matched to the corresponding target processing task, breaking the traditional video processing, in which all videos execute the same target processing task, and cannot meet the personalized processing of different videos, so that the effect of video processing is better. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0051] Figure 1 A schematic diagram of the architecture of a video processing system provided in an embodiment of the present application;

[0052] Figure 2 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 1 ;

[0053] Figure 3 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 2 ;

[0054] Figure 4 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 3 ;

[0055] Figure 5 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 4 ;

[0056] Figure 6 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 5 ;

[0057] Figure 7 A schematic diagram of a video processing device provided in an embodiment of the present application;

[0058] Figure 8 A schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of explanation and description and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in this application shows the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowchart can be implemented out of sequence, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art can add one or more other operations to the flowchart under the guidance of the content of the present application, or remove one or more operations from the flowchart.

[0060] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0061] It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the existence of the features declared thereafter, but does not exclude the addition of other features.

[0062] Figure 1 A schematic diagram of the architecture of a video processing system provided in an embodiment of the present application is shown in FIG. Figure 1As shown, the video processing system may include: a data access module, a data storage module, a video processing module, and a content operation module, wherein each module may be deployed on a different server respectively, or, when the processing performance of the server is relatively powerful, each module may also be deployed on the same server, and each step of the method may be processed by cooperation between different modules respectively.

[0063] Among them, the data access module may include: an upload module and a download module. The upload module can provide a file transfer interface to the outside to receive video files uploaded by the video provider through the provided file transfer interface; the download module can automatically pull video files from the file extraction link provided by the video provider through the file transfer engine.

[0064] The data access module can store the video files obtained from the video supplier in the data storage module, and the video files from different video suppliers are all stored in the data storage module.

[0065] The video processing module may include: video transcoding service, video masking service, image frame extraction service, and intelligent recognition service; the video processing module can monitor the file storage action in the data storage module in real time. After the video file is stored in the data storage module, it immediately obtains the video file stored at the current moment, and matches the service corresponding to the video from multiple processing services based on the basic information of the video file obtained through analysis, and executes each service in sequence to complete the secondary processing of the video.

[0066] The content operation module binds the cataloging information and tag information of the processed video, and pushes the video to the large screen for display after the binding is completed.

[0067] This method provides a relatively complete video processing flow, and can match the personalized processing service corresponding to the video to be processed from the video processing flow according to the basic information of the video to be processed, so as to realize personalized processing of videos under different processing requirements and improve the effect of video processing.

[0068] Next, each step of the present solution is described in detail through specific embodiments, and different steps can be executed by different modules in the above video processing system.

[0069] Figure 2 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 1 ;like Figure 2 As shown, the method may include:

[0070] S101: parsing a video file to be processed to obtain basic information of the video to be processed.

[0071] The video file to be processed may be provided by a video provider, which may refer to the publisher of the video. Usually, the video provider provides a video file, and the video file may include the video and basic information of the video. By parsing the video file to be processed, the basic information of the video to be processed may be obtained from the video file.

[0072] S102: Determine at least one target processing task according to basic information of the video to be processed, and execute each processing task on the video to be processed in sequence according to the order of each target processing task to obtain a target video.

[0073] In this embodiment, at least one corresponding target processing task can be matched for the video to be processed based on the basic information of the video to be processed. Since the basic information is parsed from the video file to be processed, the basic information of different videos to be processed is different, and the target processing task is determined based on the basic information of the video to be processed, so that different videos to be processed can be personalized and matched to the corresponding target processing tasks, breaking the traditional video processing in which all videos execute the same target processing task and cannot meet the personalized processing of different videos.

[0074] Optionally, based on the determined target processing tasks, each target processing task may be executed in sequence on the video to be processed in the execution order of each target processing task to obtain a target video.

[0075] It is worth noting that, when the target processing tasks are determined, the execution order between the target processing tasks can be determined, and when new target processing tasks are designed, the execution order of the new target processing tasks may be located between any target processing tasks, thereby causing the execution order of the target processing tasks to change. Specifically, the number and type of target processing tasks included in the video processing system, as well as the execution order between the target processing tasks, can be continuously adjusted as the system is updated and optimized.

[0076] S103: Publishing the target video and the attribute information bound to the target video to the terminal, so that the terminal displays the target video on a display interface of the terminal according to the attribute information.

[0077] After secondary processing of the video to be processed in the above manner, the target video obtained basically meets the standards for being published and displayed, and the target video and its bound attribute information can be published to the terminal, so that the terminal can play the target video on the display interface according to the attribute information of the target video.

[0078] Among them, the attribute information of the target video can indicate the layout information when displaying the target video, that is, when the target video is displayed on the display interface, it can be displayed according to the layout indicated by the bound attribute information.

[0079] Optionally, the terminal here may refer to a large-screen terminal other than a mobile phone, such as a projector, a television, a TV box and other devices.

[0080] In summary, this embodiment provides a video processing method, which can obtain the basic information of the video to be processed by parsing, and can match at least one target processing task corresponding to the video to be processed according to the basic information, so that each processing task can be executed in sequence on the video to be processed according to the execution order of each target processing task, and a target video that meets the release standard can be obtained. Since the basic information of different videos to be processed is different, and the target processing task is determined based on the basic information of the video to be processed, different videos to be processed can be personalized and matched to the corresponding target processing task, breaking the traditional video processing, in which all videos execute the same target processing task, and cannot meet the personalized processing of different videos, so that the effect of video processing is better.

[0081] Figure 3 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 2 Optionally, in step S101, before parsing the video file to be processed and obtaining basic information of the video to be processed, the following steps may be included:

[0082] S201, receiving a video file to be processed transmitted by a video provider through a preset file transmission interface, or pulling the video file to be processed from a file extraction link provided by the video provider through a preset file transmission engine, wherein the preset file transmission interface includes: a transmission client, a software development kit client, and a browser transmission plug-in.

[0083] Generally, there are two ways to transfer files: The first is the technical docking method. For video suppliers with weaker business capabilities, they can access the system according to the technical open standards provided by this video processing system, and directly transfer the video files to the video processing system through ftp, http, etc. Video suppliers with stronger business capabilities will provide docking standards to the outside world, so that the video files can be obtained from the video supplier system through the video processing system. However, since there is no unified standard for docking for each video supplier, each new docking requires manpower and material resources. The second is the manual docking transmission method, in which the operators of both parties communicate offline and transmit directly through instant messaging software. Through cloud disks such as Ali Netdisk and Baidu Netdisk, the links are shared and then downloaded by our operators. The mobile hard disks sent by mail are received and processed by our operators.

[0084] In this embodiment, the data access module of the video processing system can be configured with two submodules to meet the file transmission communication between different video providers, including: a download module (active pull) and an upload module (passive reception).

[0085] Optionally, the download module internally encapsulates download capabilities that are compatible with multiple formats and transmission methods. Commonly used video file formats on the market, such as ts / mp4 / hls / , can be automatically pulled through the self-developed high-speed transmission engine as long as the path is reachable. At the same time, the self-developed extraction plug-in can support the automatic extraction of files from multiple video websites and network disk applications, and automatically pull them into the data storage module. Video providers can send video file extraction links through network disk clients, HTTP links, etc. The download module can automatically pull and obtain video files based on the file extraction links provided by the video provider.

[0086] The upload module may include a set of transmission servers to receive, verify, merge and other operations of file information streams, provide self-developed transmission clients / SDK / browser transmission plug-ins, abandon various transmissions, and make user operations as convenient as possible. And based on the self-developed high-speed transmission engine (using UDP protocol, slice transmission), the user's file transfer efficiency is improved. In this way, users can send video files through file transfer interfaces such as FTP clients and self-developed SDK clients.

[0087] The two file acquisition modes provided by this method can almost meet the file transmission requirements of any video provider.

[0088] S202: Store the acquired video file to be processed in a file sharing storage system.

[0089] Optionally, video files transmitted by different video providers may be immediately stored in a file sharing storage system to wait for secondary processing. The file sharing storage system here may be a specific example of the above-mentioned data storage module.

[0090] Figure 4 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 3 Optionally, in step S101, parsing the video file to be processed and obtaining basic information of the video to be processed may include:

[0091] S401: Monitor newly added video files in the file sharing storage system to obtain video files to be processed.

[0092] In some embodiments, the video processing module in the video processing system can monitor the file storage actions of the data storage module in real time. When the video file to be processed uploaded by the video provider is completely stored in the file sharing storage system, it will be immediately monitored by the video processing module to obtain the video to be processed.

[0093] When a video file is stored in the file sharing storage system, that is, when a new video file is added to the file sharing storage system, the video file will be immediately monitored by the video processing module, so as to obtain the video file as the current video file to be processed.

[0094] S402, parsing text information contained in the video file to be processed to obtain basic information of the video to be processed, where the basic information of the video to be processed includes: video source, video format, video resolution, video bit rate, and video content classification.

[0095] Optionally, the video file to be processed can be parsed to obtain text information contained in the video file to be processed, and the text information is used as the basic information of the video to be processed. The text information contained in the video file to be processed can be edited by the video provider and carried in the video file.

[0096] In this embodiment, the basic information of the video to be processed may include but is not limited to the following information: video source, video format, video resolution, video bit rate, and video content classification.

[0097] The video source may be, for example, an information source, etc., and the video content classification may be, for example, variety shows, sports, education, etc.

[0098] Optionally, in step S102, at least one target processing task is determined based on the basic information of the video to be processed, and each processing task is performed on the video to be processed in sequence according to the order of each target processing task to obtain a target video, which may include: based on the basic information of the video to be processed, at least one target processing task matching the video to be processed is screened from a preset processing task sequence, and each target processing task is performed on the video to be processed according to the order of each target processing task in the processing task sequence to obtain the target video. The processing tasks in the processing task sequence include: video transcoding processing, video masking processing, image frame extraction processing, and intelligent recognition processing.

[0099] In one feasible manner, the video processing module may include a preset processing task sequence, and the processing task sequence may include multiple pre-set processing tasks to be executed in sequence. After parsing and obtaining basic information of the video to be processed, the video processing module may filter out at least one target processing task that matches the video to be processed from the processing task sequence based on the basic information.

[0100] Based on the matched target processing tasks, different target processing tasks may be assigned to perform secondary processing on the video to be processed in sequence according to the task execution order.

[0101] In one method, each target processing task can be matched at one time according to the basic information, and each target processing task can be combined into a complete processing flow according to the execution order of each target processing task, and the video to be processed is used as the input data of the processing flow, and the output of the processing flow is the target video.

[0102] In another method, each target processing task can be matched in sequence according to the basic information. For example, the first target processing task is matched and executed first to obtain a first processing result, and then the second target processing task is matched. The first processing result is input into the second target processing task for processing to obtain a second processing result, and so on, until the last target processing task is matched and executed to obtain the target video.

[0103] Optionally, the processing tasks in the processing task sequence in this embodiment include, but are not limited to: video transcoding processing, video masking processing, image frame extraction processing, and intelligent recognition processing.

[0104] When the type and number of processing tasks change, the execution order of each processing task will also change. More processing tasks can be flexibly added and the execution order of each processing task can be flexibly adjusted according to actual video processing needs.

[0105] Figure 5 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 4 Optionally, in the above steps, based on the basic information of the video to be processed, selecting at least one target processing task that matches the video to be processed from a preset processing task sequence may include:

[0106] S501: Determine a target processing task for a video transcoding processing task in a processing task sequence.

[0107] Optionally, any video to be processed needs to be transcoded first, and the video transcoding task in the processing task sequence can be determined as a target processing task.

[0108] Video transcoding provides support for the currently popular multi-screen interactive on-demand and program production services. The proprietary encoding and decoding technology makes the video transcoding in this embodiment compatible with all mainstream file formats on the market, while supporting the transcoding of DVD / BD disc formats, mainstream camera formats, and mainstream non-edited formats. Its ultra-high transcoding speed and ultra-high throughput transcoding performance are far ahead of the industry. A large number of technical solutions such as high-speed transcoding, full-format support, low bit rate and high image quality, 4K / 8K HDR, and automated batch transcoding can improve the content production efficiency of enterprises and maximize the media value of content. Once produced, it can cover media terminals such as computer screens, TV screens, mobile phone screens, tablets, and advertising-specific screens, as well as various network channels such as wired, wireless, and 4G / 5G mobile Internet.

[0109] S502: If the video source of the video to be processed meets the station logo processing condition, a target processing task is determined for the video logo processing in the processing task sequence.

[0110] Optionally, it is possible to determine whether the video source meets the logo processing condition based on the video source in the basic information of the video to be processed. If so, the video logo masking process in the processing task sequence can be determined as a target processing task.

[0111] Video masking can provide dynamic recognition of station logos, including logo recognition, dynamic recognition, and real-time logo removal, restore the masked part of the screen, and realize intelligent image filling. Real-time watermarking of live (rotating) channels, including NewTV logo or cooperative brand logo. Content subtitles are removed, and the screen of the removed subtitle part is restored, and subtitles are intelligently masked.

[0112] S503: If the video content classification of the video to be processed meets the classification condition, the picture frame extraction processing in the processing task sequence is determined as a target processing task.

[0113] It can be determined whether the classification of the video to be processed meets the classification conditions according to the video content classification in the basic information of the video to be processed. If the classification conditions are met, the picture frame extraction processing in the processing task sequence is determined as a target processing task.

[0114] Image frame extraction processing can be secondary developed based on the open source video processing tool FFmpeg and the open source image processing framework Thumbnailator. Independent video and image processing tools can be encapsulated to extract images and automatically cut and compress them for use as seek images when the player fast-forwards and to obtain video cover posters.

[0115] S504: If the video source of the video to be processed meets the preset source, and the video content classification of the video to be processed meets the preset classification, the intelligent recognition processing in the processing task sequence is determined as a target processing task.

[0116] Based on the video source and video content classification in the basic information of the video to be processed, it can be determined whether the video to be processed meets both the preset source and the preset classification. If so, the intelligent recognition processing in the processing task sequence can be determined as a target processing task.

[0117] Intelligent recognition processing can be composed of some basic algorithms: including basic algorithms (face recognition, extracting faces from videos and pictures, and confirming face identities through comparison), OCR (extracting text from videos and pictures), ASR (converting voice to text), NLP (natural language processing, identifying the semantics of text, extracting keywords, etc.). It also includes a tag library application (the tag library stores the definitions of all tags, and stores different types of tags in the form of classification. The system will preset the tag library (including classification and tag definitions) according to different industry scenario versions). Tags in the tag classification have attribute metadata, which is used to further subdivide the tags. A tag can have multiple attributes at the same time, such as: Schwarzenegger, who is both a politician and a celebrity. Users can query the settings of the tag library classification, as well as information such as the tag definitions and related attributes in the classification.

[0118] Intelligent recognition processing can be used to conduct intelligent analysis of video content from unreliable sources, match sensitive character libraries, identify illegal content in videos, and process it.

[0119] In addition, intelligent recognition processing can also be used to identify and obtain arbitrary information from the video to be processed. For example, for a TV series, the target character's clips can be identified from each episode of the TV series, so that only the relevant clips of the target character can be watched when watching the TV series. Or the actor information in the video can be identified to display it in the cast list, etc.

[0120] In one achievable manner, each target processing task determined in the above steps S501 - S504 may be executed in sequence to perform secondary processing on the video to be processed.

[0121] First: according to the video format, video resolution and video bit rate in the basic information of the video to be processed, video transcoding processing can be performed on the video to be processed, and the video to be processed can be transcoded into a first processed video in at least one standard format, and each standard format corresponds to a different video format, video resolution and video bit rate.

[0122] Generally, when performing video transcoding operations, a plurality of different standard formats can be set, for example, 4M bit rate-TS format, 1.8M bit rate-HLS. According to different standard formats, a video to be processed can be transcoded into a plurality of first processed videos in different standard formats. That is, according to the number of set standard formats, a video to be processed can be processed into a plurality of first processed videos corresponding to the number of standard formats.

[0123] Second: based on the first processed videos in each standard format, according to the video source of the video to be processed, video masking processing can be performed on the first processed videos in each standard format to obtain each second processed video.

[0124] When the video source of the video to be processed meets the logo processing condition, that is, when it is the set video source that needs to be processed by the logo, the logo processing can be performed.

[0125] The video logo masking process may be to delete the station logo in the first processed video in each standard format, or to replace the station logo with a preset logo.

[0126] Firstly, according to the correspondence between the video source and the logo attribute created in advance, the display position of the logo can be determined from the first processed video in each standard format, and then the logo at the display position can be processed accordingly.

[0127] Of course, video logo masking is not just about processing station logos, it can also be used to process some illegal logos in the video.

[0128] Third: Based on each second processed video, the video to be processed may be classified according to the video content, and frame extraction processing may be performed on each second processed video to obtain each third processed video.

[0129] The picture frame extraction process in this embodiment can be used for extracting thumbnails when fast-forwarding a video, and can also be used for extracting video posters.

[0130] When used for video poster extraction, no matter what the video content of the video to be processed is classified into, key frames can be extracted from the second processed video as the poster cover of the video.

[0131] When used for extracting thumbnails when fast-forwarding a video, it can be determined whether the video content classification of the video to be processed meets the classification conditions. When the classification conditions are met, thumbnails are extracted for the second processed video.

[0132] For example, when the video content is classified into the following types: TV series, movies, variety shows, etc., and the classification of the video to be processed meets the conditions, a thumbnail is extracted for the second processed video.

[0133] Optionally, frame images at certain moments in the video may be extracted at preset time intervals, and the extracted frame images at each moment may be automatically cut and compressed for use as seek image display when the player fast-forwards.

[0134] When the video content is classified into information, news, and other types, the classification of the video to be processed does not meet the conditions, and the thumbnail is not extracted for the second processed video.

[0135] Fourth: Based on each third processed video, intelligent recognition processing can be performed on each third processed video according to the video source and video content classification of the video to be processed to generate target videos in various standard formats.

[0136] In this embodiment, the credibility of the video to be processed can be judged in combination with the video source and the video content classification. If the source of the video to be processed is unreliable and is an unsafe type of video, the content corresponding to the label information can be identified from the third processed video based on the correspondence between the pre-created video content classification and the label information, and the identified content can be processed.

[0137] For example: for videos of power sources or third-party untrusted suppliers, the corresponding label information can be determined according to the content classification of the video to be processed. Assuming the label information is: person A, person A can be identified from the third processed video and deleted from the third processed video.

[0138] Take a specific example:

[0139] When the video to be processed enters the video processing module, it is transcoded into two outputs (4M bit rate - TS format, 1.8M bit rate - HLS) through video transcoding processing to obtain the first processed video under each standard format; after the transcoding is completed, since the video source of the video to be processed is 'XX source', it meets the station logo processing conditions and needs to be processed, the video logo masking processing will remove the station logo to be processed in each first processed video to obtain each second processed video; since the content of the video to be processed is classified as a TV series, the picture extraction processing will extract the picture of each second processed video and automatically cut and compress it for use as a seek map display when the player fast-forwards, to obtain each third processed video; and since the video to be processed is an information video, the intelligent recognition processing will automatically identify the sensitive persons in each third processed video, and delete the identified target person from each third processed video, and finally generate the target video under each standard format.

[0140] Optionally, in some embodiments, the video processing system may further include a content technical review module. The target video obtained by processing the video processing module may be reviewed again by the content technical review module. The content technical review module may encode and perform frame analysis on the content of the target video that has been produced and processed, extract suspicious problem points (flowered screen, still frames, frame skipping, popping sounds, and audio and video asynchrony) and scores to assist operators in manually confirming and releasing the video.

[0141] When the technical review score of the content technical review module is low, the operator can cancel the release of the target video and its binding attribute information to the terminal. Of course, since some screen distortion and static frames are invisible to the user, the technical review score can be ignored and the release can continue normally.

[0142] Figure 6 Schematic diagram of the video processing method provided in the embodiment of the present application Figure 5 Optionally, the processing task may also include: video parsing processing, in step S103, before publishing the target video and the attribute information bound to the target video to the terminal, it may include:

[0143] S601: parse the video to be processed, and obtain the cataloging information and label information of the video to be processed.

[0144] The basic information of the above-mentioned video can be edited by the video supplier and added to the video file, and the cataloging information here can be obtained by analyzing the video. The cataloging information may include: video director information, actor information, video introduction, video age, etc. Some of this cataloging information can also be edited by the video supplier, and some can be obtained by analyzing the video.

[0145] The characters, objects, etc. in the video can all be set with label information. The character's name, gender, type of object, etc. can all be used as label information for the video, and the content classification of the video can also be used as label information.

[0146] S602: Bind the cataloging information and tag information of the video to be processed to the target video as attribute information.

[0147] Usually, when displaying videos on the interface, they can be displayed according to a certain layout, for example, the video will display a poster cover, and the name of the leading actor can be displayed in the poster. A series of cataloging information such as the video introduction and shooting year can be displayed in a preset position below the cover. The video can also be classified according to the content in the tag information and displayed under the corresponding category. For example: variety shows, movies, TV series, etc.

[0148] Optionally, the attribute information of the target video refers to the cataloging information and tag information obtained through parsing. By binding the target video with the attribute information of the target video, the display layout of the target video can be determined.

[0149] Optionally, in step S103, publishing the target video and the attribute information bound to the target video to the terminal may include: publishing the target video and the attribute information bound to the target video to the corresponding terminal according to the performance parameters of each terminal to be played and network parameters.

[0150] Based on the aforementioned embodiments, a video to be processed can be processed into target videos in a variety of standard formats to meet the needs of display on different large-screen terminals.

[0151] Optionally, the video format matched by the terminal may be determined according to the performance parameters of the terminal and the network parameters, so that the target video in the standard format matched by the terminal is sent to the corresponding terminal for display.

[0152] The performance parameters of the terminal may include: the video bit rate format and resolution supported by the terminal. For example, some terminals can support 4K video playback mode, while some terminals do not; some terminals can support ultra-high-definition video playback, while some terminals only support high-definition playback, etc.

[0153] Network parameters may include network speed, network stability and other parameters.

[0154] By combining the performance parameters and network parameters of the terminal, the video format matched by each terminal can be determined, so that the target video can have a better display effect on different terminals.

[0155] In summary, the embodiment of the present application provides a video processing method, which can obtain the basic information of the video to be processed by parsing, and can match at least one target processing task corresponding to the video to be processed according to the basic information, so that each processing task can be executed in sequence on the video to be processed according to the execution order of each target processing task, and a target video that meets the release standard can be obtained. Since the basic information of different videos to be processed is different, and the target processing task is determined based on the basic information of the video to be processed, different videos to be processed can be personalized and matched to the corresponding target processing task, breaking the traditional video processing, in which all videos execute the same target processing task, and cannot meet the personalized processing of different videos, so that the effect of video processing is better.

[0156] The following describes the apparatus, device, storage medium, etc. used to execute the video processing method provided in this application. The specific implementation process and technical effects are described above and will not be repeated below.

[0157] Figure 7The schematic diagram of a video processing device provided in an embodiment of the present application, the functions implemented by the video processing device correspond to the steps performed by the above method. The device can be understood as a server cluster, and the video processing system of the present method can be integrated with the server cluster. Figure 7 As shown, the device may include: an acquisition module 710, an execution module 720, and a publishing module 730;

[0158] The acquisition module 710 is used to parse the video file to be processed and obtain basic information of the video to be processed;

[0159] An execution module 720 is used to determine at least one target processing task according to the basic information of the video to be processed, and execute each processing task on the video to be processed in sequence according to the order of each target processing task to obtain a target video;

[0160] The publishing module 730 is used to publish the target video and the attribute information bound to the target video to the terminal, so that the terminal displays the target video on the display interface of the terminal according to the attribute information.

[0161] Optionally, the device further includes: a receiving module and a storage module;

[0162] A receiving module, used to receive a video file to be processed transmitted by a video provider through a preset file transmission interface, or to pull the video file to be processed from a file extraction link provided by the video provider through a preset file transmission engine, wherein the preset file transmission interface includes: a transmission client, a software development kit client, and a browser transmission plug-in;

[0163] The storage module is used to store the acquired video files to be processed in the file sharing storage system.

[0164] Optionally, the acquisition module 710 is specifically used to monitor the newly added video files in the file sharing storage system and acquire the video files to be processed;

[0165] Parse the text information contained in the video file to be processed to obtain basic information of the video to be processed, where the basic information of the video to be processed includes: video source, video format, video resolution, video bit rate, and video content classification.

[0166] Optionally, the execution module 720 is specifically used to screen at least one target processing task that matches the video to be processed from a preset processing task sequence according to the basic information of the video to be processed, and execute each target processing task on the video to be processed according to the order of each target processing task in the processing task sequence to obtain the target video. The processing tasks in the processing task sequence include: video transcoding processing, video masking processing, image frame extraction processing, and intelligent recognition processing.

[0167] Optionally, the execution module 720 is specifically configured to determine a target processing task from the video transcoding processing task in the processing task sequence;

[0168] If the video source of the video to be processed meets the station logo processing condition, the video logo processing in the processing task sequence is determined as a target processing task;

[0169] If the video content classification of the video to be processed meets the classification condition, the picture frame extraction processing in the processing task sequence is determined as a target processing task;

[0170] If the video source of the video to be processed meets the preset source, and the video content classification of the video to be processed meets the preset classification, the intelligent recognition processing in the processing task sequence is determined as a target processing task.

[0171] Optionally, the device further comprises: a binding module;

[0172] The acquisition module 710 is further used to parse the video to be processed and obtain the cataloging information and label information of the video to be processed;

[0173] The binding module is used to bind the cataloging information and tag information of the video to be processed with the target video as attribute information.

[0174] Optionally, the publishing module 730 is specifically configured to publish the target video and the attribute information bound to the target video to the corresponding terminal according to the performance parameters of each terminal to be played and the network parameters.

[0175] The above-mentioned device is used to execute the method provided by the aforementioned embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0176] The above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more digital singnal processors (DSP), or one or more field programmable gate arrays (FPGA). For another example, when a module is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0177] The above modules can be connected or communicated with each other via a wired connection or a wireless connection. The wired connection may include a metal cable, an optical cable, a hybrid cable, etc., or any combination thereof. The wireless connection may include a connection in the form of a LAN, a WAN, Bluetooth, a ZigBee, or NFC, or any combination thereof. Two or more modules may be combined into a single module, and any one module may be divided into two or more units. Those skilled in the art will clearly understand that for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the method embodiment, and will not be repeated in this application.

[0178] Figure 8 A schematic diagram of an electronic device provided in an embodiment of the present application, the electronic device can be integrated by multiple servers to achieve integrated deployment of a video processing system.

[0179] The device may include: a processor 801 and a storage medium 802 .

[0180] The storage medium 802 is used to store programs, and the processor 801 calls the programs stored in the storage medium 802 to execute the above method embodiment. The specific implementation method and technical effect are similar and will not be repeated here.

[0181] The storage medium 802 stores program code, and when the program code is executed by the processor 801, the processor 801 executes various steps of the method according to various exemplary embodiments of the present application described in the above “Exemplary Method” section of this specification.

[0182] Processor 801 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor (DigitalSignal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as a hardware processor to be executed, or a combination of hardware and software modules in the processor can be executed.

[0183] Storage medium 802, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. Storage medium may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type storage medium, random access storage medium (Random Access Memory, RAM), static random access storage medium (Static Random Access Memory, SRAM), programmable read-only storage medium (Programmable Read Only Memory, PROM), read-only storage medium (Read Only Memory, ROM), electrically erasable programmable read-only storage medium (Electrically Erasable Programmable Read-Only Memory, EEPROM), magnetic storage medium, disk, optical disk, etc. Storage medium is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The storage medium 802 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.

[0184] Optionally, the present application also provides a program product, such as a computer-readable storage medium, including a program, which is used to execute the above method embodiment when executed by a processor.

[0185] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0186] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0187] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0188] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (English: processor) to perform some steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only storage medium (English: Read-Only Memory, referred to as: ROM), random access storage medium (English: Random Access Memory, referred to as: RAM), disk or optical disk and other media that can store program code.

Claims

1. A video processing method, characterized in that: include: Parse the video file to be processed and obtain basic information of the video to be processed; Determine at least one target processing task according to basic information of the video to be processed, and execute each processing task on the video to be processed in sequence according to the order of each target processing task to obtain a target video; Publishing the target video and the attribute information bound to the target video to the terminal, so that the terminal displays the target video on a display interface of the terminal according to the attribute information; The step of determining at least one target processing task according to basic information of the video to be processed, and sequentially executing each processing task on the video to be processed in the order of each target processing task to obtain a target video includes: According to the basic information of the video to be processed, at least one target processing task matching the video to be processed is selected from a preset processing task sequence, and each target processing task is executed on the video to be processed according to the order of each target processing task in the processing task sequence to obtain the target video, wherein the processing tasks in the processing task sequence include: video transcoding processing, video masking processing, picture frame extraction processing, and intelligent recognition processing; The step of selecting at least one target processing task matching the video to be processed from a preset processing task sequence according to the basic information of the video to be processed includes: Determine a target processing task for the video transcoding processing task in the processing task sequence; If the video source of the video to be processed meets the logo processing condition, the video logo processing in the processing task sequence is determined as a target processing task; If the video content classification of the video to be processed meets the classification condition, the picture frame extraction processing in the processing task sequence is determined as a target processing task; If the video source of the video to be processed meets the preset source, and the video content classification of the video to be processed meets the preset classification, the intelligent recognition processing in the processing task sequence is determined as a target processing task.

2. The method according to claim 1, characterized in that Before parsing the video file to be processed and obtaining basic information of the video to be processed, the process includes: Receiving a video file to be processed transmitted by a video provider through a preset file transmission interface, or pulling the video file to be processed from a file extraction link provided by the video provider through a preset file transmission engine, wherein the preset file transmission interface includes: a transmission client, a software development kit client, and a browser transmission plug-in; The obtained video files to be processed are stored in a file sharing storage system.

3. The method according to claim 2, characterized in that The step of parsing the video file to be processed and obtaining basic information of the video to be processed includes: Monitoring the newly added video files in the file sharing storage system to obtain the video files to be processed; Parse the text information contained in the video file to be processed to obtain basic information of the video to be processed, where the basic information of the video to be processed includes: video source, video format, video resolution, video bit rate, and video content classification.

4. The method according to claim 1, characterized in that: The processing task includes: video parsing processing, before publishing the target video and the attribute information bound to the target video to the terminal, including: Parsing the video to be processed, and obtaining cataloging information and tag information of the video to be processed; The cataloging information and tag information of the video to be processed are bound to the target video as the attribute information.

5. The method according to claim 1, characterized in that The step of publishing the target video and the attribute information bound to the target video to the terminal includes: According to the performance parameters of each terminal to be played and the network parameters, the target video and the attribute information bound to the target video are published to the corresponding terminal.

6. A video processing device, characterized in that: include: Get module, execute module, publish module; The acquisition module is used to parse the video file to be processed and obtain basic information of the video to be processed; The execution module is used to determine at least one target processing task according to the basic information of the video to be processed, and execute each processing task in sequence on the video to be processed in accordance with the order of each target processing task to obtain a target video; The publishing module is used to publish the target video and the attribute information bound to the target video to the terminal, so that the terminal displays the target video on the display interface of the terminal according to the attribute information; The execution module is specifically used to select at least one target processing task matching the video to be processed from a preset processing task sequence according to the basic information of the video to be processed, and execute each target processing task on the video to be processed according to the order of each target processing task in the processing task sequence to obtain the target video, and the processing tasks in the processing task sequence include: video transcoding processing, video masking processing, picture frame extraction processing, and intelligent recognition processing; The execution module is specifically used to determine a target processing task from the video transcoding processing task in the processing task sequence; If the video source of the video to be processed meets the logo processing condition, the video logo processing in the processing task sequence is determined as a target processing task; If the video content classification of the video to be processed meets the classification condition, the picture frame extraction processing in the processing task sequence is determined as a target processing task; If the video source of the video to be processed meets the preset source, and the video content classification of the video to be processed meets the preset classification, the intelligent recognition processing in the processing task sequence is determined as a target processing task.

7. An electronic device, characterized in that: include: A processor, a storage medium and a bus, wherein the storage medium stores program instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium via the bus, and the processor executes the program instructions to perform the steps of the video processing method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the video processing method according to any one of claims 1 to 5 are executed.

Images