Video processing method and device, equipment and storage medium

Abstract

Embodiments of the present disclosure provide a video processing method, device, equipment and storage medium. The method comprises: obtaining a to-be-processed video, wherein the to-be-processed video comprises set sensitive information; determining a target frame rate of the to-be-processed video, processing the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video, and correcting the first processed video to obtain a target video. According to the embodiments of the present disclosure, the accuracy of processing the set sensitive information in the video can be improved by processing the set sensitive information in the to-be-processed video based on the target frame rate and correcting the first processed video.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the technical field of automatic driving, and particularly relate to a video processing method and device, equipment and a storage medium. BACKGROUND

[0002] Automatic driving is the only way for the development of the automobile industry. In the process of continuous improvement and maturity of automatic driving technology, an important means is to train automatic driving algorithms by collecting road videos by vehicles. Before using the collected video data, the video needs to be desensitized. Because there are personal information such as faces and license plate numbers in the video, there may also be other set sensitive information such as political and military related information, and there may also be some sudden information that is not suitable to be displayed, so the set sensitive information in the video needs to be desensitized. However, in the prior art, the processing of the set sensitive information in the video still has the problem of low accuracy. SUMMARY

[0003] Embodiments of the present disclosure provide a video processing method, device, equipment and storage medium, which can improve the accuracy of processing set sensitive information in a video.

[0004] In a first aspect, the embodiments of the present disclosure provide a video processing method, comprising: acquiring a to-be-processed video; wherein the to-be-processed video comprises set sensitive information; determining a target frame rate of the to-be-processed video; processing the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video; and correcting the first processed video to obtain a target video.

[0005] In a second aspect, the embodiments of the present disclosure further provide a video processing device, comprising: a video acquisition module configured to acquire a to-be-processed video; wherein the to-be-processed video comprises set sensitive information; a target frame rate determination module configured to determine a target frame rate of the to-be-processed video; a video processing module configured to process the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video; and a video correction module configured to correct the first processed video to obtain a target video.

[0006] In a third aspect, the embodiments of the present disclosure further provide an electronic device, comprising:

[0007] one or more processors;

[0008] a storage device configured to store one or more programs,

[0009] when the one or more programs are executed by the one or more processors, the one or more processors implement the video processing method according to the embodiments of the present disclosure.

[0010] In a fourth aspect, the present disclosure also provides a storage medium containing computer executable instructions for performing the video processing method according to the present disclosure when executed by a computer processor.

[0011] The technical solution disclosed in the present embodiment comprises the following steps: obtaining a to-be-processed video, determining a target frame rate of the to-be-processed video, processing set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video, and correcting the first processed video to obtain a target video. According to the present embodiment, the set sensitive information in the to-be-processed video is processed based on the target frame rate, and the first processed video is corrected, so that the accuracy of processing the set sensitive information in the video can be improved. BRIEF DESCRIPTION OF DRAWINGS

[0012] The above and other features, aspects, and advantages of the present disclosure will become more apparent with reference to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or like reference numerals are used to represent the same or similar elements. It is to be understood that the drawings are schematically showing the elements and features, which are not necessarily drawn to scale.

[0013] Figure 1 A flowchart of a video processing method according to an embodiment of the present disclosure is shown in FIG. 1.

[0014] Figure 2 A flowchart of another video processing method according to an embodiment of the present disclosure is shown in FIG. 2.

[0015] Figure 3 A structural diagram of a video processing device according to an embodiment of the present disclosure is shown in FIG. 3.

[0016] Figure 4 A structural diagram of an electronic device according to an embodiment of the present disclosure is shown in FIG. 4. DETAILED DESCRIPTION

[0017] Embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. While several embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and fully convey the scope of the present disclosure to those skilled in the art. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

[0018] It should be understood that the various steps in the method embodiments of the present disclosure can be performed in different orders and / or in parallel. In addition, the method embodiments can include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0019] The term "include" and variations thereof, as used in this document, mean "to include, without limitation." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment." The term "another embodiment" means "at least one additional embodiment." The term "some embodiments" means "at least some embodiments." Related terms shall be construed accordingly. Other definitions can be provided in the description accompanying the claims.

[0020] It should be noted that the terms "first", "second", etc. mentioned in the disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0021] It should be noted that the modification of "one" or "multiple" mentioned in the disclosure is illustrative and not restrictive, and those skilled in the art should understand that unless the context clearly indicates otherwise, it should be understood as "one or more".

[0022] It can be understood that the data involved in the technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws and regulations and relevant provisions.

[0023] Figure 1 A video processing method flowchart is provided for the embodiments of the application. The embodiments can be applied to the case of desensitizing the set sensitive information in the video. The method can be executed by a video processing device, and specifically includes the following steps:

[0024] S110, acquiring a video to be processed.

[0025] The video to be processed includes set sensitive information. The set sensitive information includes personal information, political information, military information, and information that should not be displayed. The video to be processed can be a video of a traffic road collected by a vehicle, which is used to train an automatic driving algorithm.

[0026] S120, determining a target frame rate of the video to be processed.

[0027] In this embodiment, the optimal frame rate can be obtained by processing a plurality of historical videos, and the optimal frame rate is used as the target frame rate. For processing historical videos, the historical videos can be desensitized, and the processing result can be obtained, which includes the number of correctly desensitized videos (i.e. the number of video frames containing set sensitive information). The optimal frame rate corresponding to the historical videos is found through the processing result, and finally the target frame rate is determined according to the optimal frame rates corresponding to the plurality of historical videos.

[0028] Optionally, determining the target frame rate of the video to be processed includes: acquiring a plurality of historical videos;

[0029] For each historical video, the set sensitive information in the historical video is processed based on a set frame rate to obtain a first processing result; wherein the first processing result is the number of video frames containing the set sensitive information; the following iteration process is performed on the frame rate corresponding to the first processing result and the historical video: the frame rate corresponding to the first processing result is processed based on a set decreasing step to obtain a first frame rate; the set sensitive information in the historical video is processed based on the first frame rate to obtain a second processing result; if the second processing result is not equal to the first processing result, the second processing result is taken as a new first processing result for iterative processing; if the second processing result is equal to the first processing result, the iteration process is ended, and the frame rate corresponding to the first processing result is taken as a second frame rate; a plurality of second frame rates are obtained; and the target frame rate is determined according to the plurality of second frame rates.

[0030] It should be noted that, since the collected to-be-processed video can have different frame rates, if the frame rate is too high, the playing speed will be very fast, and accordingly, the processing of the to-be-processed video can produce a relatively poor result, thus it is necessary to adjust the frame rate of the to-be-processed video, that is, to determine the target frame rate of the to-be-processed video.

[0031] The set frame rate can be any frame rate, for example, can be the original frame rate, the target frame rate, etc. of the historical video. Specifically, a plurality of historical videos are obtained, for each historical video, the set sensitive information in the historical video is desensitized based on a set frame rate to obtain a first processing result. The first processing result is the number of video frames containing the set sensitive information. The following iteration process is performed on the frame rate corresponding to the first processing result and the historical video: the frame rate corresponding to the first processing result is reduced by a set decreasing step to obtain a first frame rate. The set sensitive information in the historical video is processed based on the first frame rate to obtain a second processing result. If the second processing result is not equal to the first processing result, the second processing result is taken as a new first processing result for iterative processing. If the second processing result is equal to the first processing result, the iteration process is ended, and the frame rate corresponding to the first processing result is taken as a second frame rate, so that a plurality of second frame rates can be obtained according to a plurality of historical videos. The average frame rate, the minimum frame rate or the maximum frame rate of the plurality of second frame rates can be taken as the target frame rate. Preferably, the minimum frame rate of the plurality of second frame rates is taken as the target frame rate.

[0032] For example, the determination process of the second frame rate of each historical video is as follows: step one: the set sensitive information in the historical video is processed based on a set frame rate to obtain a first processing result.

[0033] The first processing result specifically includes: the number of video frames processed is Ti, the number of error video frames (i.e., video frames that do not include the set sensitive information) in Ti is Fi, and the number of video frames containing the set sensitive information (i.e., the validity number) in the processing result is recorded as Vi = Ti-Fi.

[0034] Step two: given a frame rate decrement step S, play the video using a first frame rate (first frame rate = frame rate corresponding to the first processing result - set decrement step S), process the set sensitive information in the historical video based on the first frame rate, and obtain a second processing result.

[0035] The second processing result specifically includes: the number of video frames processed is Tj, the number of error video frames (i.e., video frames that do not include the set sensitive information) in Tj is Fj, and the number of video frames containing the set sensitive information (i.e., the validity number) in the processing result is recorded as Vj = Tj-Fj.

[0036] Step three: if the second processing result and the first processing result are not equal, then the second processing result is used as the new first processing result for iterative processing, i.e., the second processing result is used as the first processing result, Vj is used as Vi, and step two is repeated; if the second processing result and the first processing result are equal, then the iterative process is ended, i.e., the iterative process is ended when Vj = Vi, where j = i+1; at this time, the frame rate corresponding to the first processing result can be used as the second frame rate.

[0037] In this embodiment, multiple second frame rates are determined based on multiple historical videos, and a target frame rate is determined based on the multiple second frame rates, so that the to-be-processed video can be processed based on the target frame rate, thereby improving the accuracy of video processing.

[0038] S130, process the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video.

[0039] In this embodiment, the to-be-processed video can be played using the target frame rate, and in the process of playing the to-be-processed video, each video frame is obtained and the set sensitive information in each video frame is processed one by one. Specifically, the processing can be performed by an automatic desensitization processing system, which can include a machine learning model. The machine learning model can be obtained by iteratively training multiple historical videos containing the set sensitive information.

[0040] Optionally, the set sensitive information in the to-be-processed video is processed based on a target frame rate to obtain a first processed video, including: playing the to-be-processed video based on the target frame rate; obtaining each video frame in the playing process as a first video frame; wherein the first video frame is a currently played video frame; if the first video frame contains set sensitive information, processing the first video frame based on a set processing strategy to obtain a first associated frame set; wherein the set processing strategy includes a whole frame discarding strategy and a set sensitive information region blurring strategy; when the to-be-processed video playing is completed, processing the to-be-processed video according to the first associated frame set to obtain the first processed video.

[0041] Specifically, the to-be-processed video is played by using the target frame rate, and in the process of playing the to-be-processed video, each video frame is obtained, and the currently played video frame is taken as a first video frame. If the first video frame is identified to contain set sensitive information by using a machine learning model, the first video frame containing the set sensitive information is processed based on the whole frame discarding strategy or the set sensitive information region blurring strategy, and after the first video frame is processed, a first associated frame set is obtained. The associated frame set is used to store the video frame containing the sensitive information and the associated information of the video frame containing the sensitive information. If the set processing strategy is the whole frame discarding strategy, the first associated frame set includes the video frame containing the set sensitive information, the time stamp of the video frame, etc. If the set processing strategy is the set sensitive information region blurring strategy, the first associated frame set includes the first video frame containing the set sensitive information, the time stamp of the video frame, and a video frame after the first video frame is blurred (i.e. a blurred video frame). When the to-be-processed video playing is completed, i.e. the video frame containing the set sensitive information in the to-be-processed video is processed, a final first associated frame set is obtained, and the to-be-processed video is uniformly processed according to the final first associated frame set. If the whole frame discarding strategy is used, the video frame containing the set sensitive information is deleted according to the time stamp of the video frame in the first associated frame set. If the set sensitive information region blurring strategy is used, the video frame containing the set sensitive information is replaced by the blurred video frame according to the time stamp of the video frame in the first associated frame set.

[0042] In the embodiment, for the video frame containing the set sensitive information, the video frame is processed based on the set processing strategy to obtain the first associated frame set, and after the to-be-processed video is played, the to-be-processed video is processed according to the final first associated frame set, which can effectively realize the processing of the video containing the set sensitive information, thereby improving the accuracy of video processing.

[0043] Optionally, the first video frame is processed based on the set processing strategy to obtain a first associated frame set, including: if the set processing strategy is a discard entire frame strategy, the first video frame is taken as a target video frame; a timestamp of the target video frame is determined; the timestamp, the target video frame and the discard entire frame strategy are associated and added to the first associated frame set.

[0044] The timestamp of the video frame can be used to determine the specific position of the video frame in the video, and the video frame corresponding to the timestamp can be found through the timestamp. In this embodiment, if the set processing strategy is the discard entire frame strategy, the first video frame is taken as the target video frame, wherein the target video frame can be understood as a video frame containing sensitive information. The timestamp of the target video frame is determined, the timestamp of the target video frame, the target video frame and the discard entire frame strategy are associated, and are added to the first associated frame set.

[0045] Optionally, the first processing video is obtained by processing the video to be processed according to the first associated frame set, including: if the set processing strategy is the discard entire frame strategy, the target video frame is deleted from the video to be processed according to the timestamp corresponding to the target video frame, and the first processing video is obtained.

[0046] In this embodiment, if the set processing strategy is the discard entire frame strategy, the first video frame is taken as the target video frame, the timestamp of the target video frame, the target video frame and the discard entire frame strategy are associated as an associated group, and the associated group is added to the first associated frame set. When the video to be processed is played to the end, that is, the video frame containing the set sensitive information in the video to be processed is processed, the final first associated frame set is obtained, and the final first associated frame set can include one or more associated groups. After the final first associated frame set is obtained, the video to be processed is uniformly desensitized according to the final first associated frame set. Specifically, the target video frame is deleted from the video to be processed according to the timestamp of the target video frame in the final first associated frame set, and the first processing video is obtained.

[0047] In this embodiment, the set sensitive information in the video to be processed is processed by the discard entire frame strategy to obtain the first processing video, which can effectively realize the processing of the set sensitive information in the video, thereby improving the accuracy of video processing.

[0048] Optionally, the first video frame is processed based on the set processing strategy to obtain a first associated frame set, including: if the set processing strategy is a blurring set sensitive information region strategy, the first video frame is taken as a target video frame; a timestamp of the target video frame is determined; a set sensitive region in the target video frame is blurred to obtain a blurred video frame; the timestamp, the target video frame, the blurred video frame and the blurring set sensitive information region strategy are associated and added to the first associated frame set.

[0049] Optionally, the first processing video is obtained by processing the video to be processed according to the first associated frame set, including: if the set processing strategy is the blurring set sensitive information region strategy, the target video frame in the video to be processed is replaced by the blurred video frame according to the timestamp corresponding to the target video frame to obtain the first processing video.

[0050] In this embodiment, if the set processing strategy is the blurring set sensitive information region strategy, the first video frame is taken as a target video frame, and the set sensitive region in the target video frame is blurred to obtain a blurred video frame. The set sensitive region can be understood as a region containing set sensitive information. The specific blurring method is not limited in this embodiment, and the blurring method can be mosaic processing. The timestamp of the target video frame, the target video frame, the blurred video frame and the blurring set sensitive information region strategy are associated, taken as an associated group, and added to the first associated frame set. When the video to be processed is played, that is, the video frame containing set sensitive information in the video to be processed is processed, the final first associated frame set is obtained, and the final first associated frame set can include one or more associated groups. After obtaining the final first associated frame set, the video to be processed is uniformly desensitized according to the first associated frame set. Specifically, the target video frame in the video to be processed is replaced by the corresponding blurred video frame according to the timestamp of the target video frame in the final first associated frame set to obtain the first processing video.

[0051] In this embodiment, the set sensitive information in the video to be processed is processed by the blurring set sensitive information region strategy to obtain the first processing video, which can effectively process the set sensitive information in the video, thereby improving the accuracy of video processing.

[0052] S140, correcting the first processing video to obtain a target video.

[0053] In this embodiment, the target video frame can be acquired from the first associated frame set, the user's check information of the target video frame is received, and the first processed video is modified according to the check information. The check information can include whether the target video frame contains the set sensitive information. Specifically, if the check information is that the target video frame does not contain the set sensitive information, the target video frame is restored according to the timestamp of the target video frame (that is, the target video frame is merged with the first processed video), and the target video is obtained.

[0054] The technical solution disclosed in this embodiment includes obtaining a to-be-processed video, determining a target frame rate of the to-be-processed video, processing set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video, and modifying the first processed video to obtain a target video. Through the method of processing the set sensitive information in the to-be-processed video based on the target frame rate and modifying the first processed video, the accuracy of processing the set sensitive information in the video can be improved.

[0055] Figure 2 The flowchart of another video processing method provided by the embodiment of the application is shown in FIG. 2. The embodiment of the application is a specific embodiment based on the above-mentioned embodiment of the application. As shown in FIG. 2, the method provided by the embodiment of the application includes the following steps. Figure 2 The method provided by the embodiment of the application specifically includes the following steps.

[0056] S210, a to-be-processed video is acquired.

[0057] The to-be-processed video includes set sensitive information.

[0058] S220, a target frame rate of the to-be-processed video is determined.

[0059] S230, the set sensitive information in the to-be-processed video is processed based on the target frame rate to obtain a first processed video.

[0060] S240, if the set processing strategy is a discard entire frame strategy, a target video frame is acquired from the first associated frame set.

[0061] S250, first check information of the target video frame is received.

[0062] S260, if the first check information is that the target video frame does not contain the set sensitive information, the target video frame and the first processed video are merged according to the timestamp corresponding to the target video frame to obtain a target video.

[0063] In the embodiment, if the processing strategy is set as the frame discarding strategy, a target video frame is obtained from the first associated frame set; the target video frame is sequentially introduced into a comparison window according to a timestamp of the target video frame, and first check information of the target video frame in the comparison window is received from a user. If the first check information is that the target video frame does not have the set sensitive information, the target video frame is marked as a revoked state. After the target video frame in the first associated frame set is checked, for the target video frame marked as the revoked state, the target video frame is merged into the first processed video according to the timestamp of the target video frame, i.e., the target video frame is restored into the first processed video according to the timestamp of the target video frame, to obtain a target video.

[0064] In the embodiment, if the processing strategy is set as the frame discarding strategy, a target video frame is obtained from the first associated frame set; the target video frame is sequentially introduced into a comparison window according to a timestamp of the target video frame, and first check information of the target video frame in the comparison window is received from a user. If the first check information is that the target video frame does not have the set sensitive information, the target video frame is marked as a revoked state. After the target video frame in the first associated frame set is checked, for the target video frame marked as the revoked state, the target video frame is merged into the first processed video according to the timestamp of the target video frame, i.e., the target video frame is restored into the first processed video according to the timestamp of the target video frame, to obtain a target video.

[0065] In the embodiment, if the processing strategy is set as the frame discarding strategy, a target video frame is obtained from the first associated frame set; the target video frame is sequentially introduced into a comparison window according to a timestamp of the target video frame, and first check information of the target video frame in the comparison window is received from a user. If the first check information is that the target video frame does not have the set sensitive information, the target video frame is marked as a revoked state. After the target video frame in the first associated frame set is checked, for the target video frame marked as the revoked state, the target video frame is merged into the first processed video according to the timestamp of the target video frame, i.e., the target video frame is restored into the first processed video according to the timestamp of the target video frame, to obtain a target video.

[0066] In the embodiment, if the processing strategy is set as the frame discarding strategy, a target video frame is obtained from the first associated frame set; the target video frame is sequentially introduced into a comparison window according to a timestamp of the target video frame, and first check information of the target video frame in the comparison window is received from a user. If the first check information is that the target video frame does not have the set sensitive information, the target video frame is marked as a revoked state. After the target video frame in the first associated frame set is checked, for the target video frame marked as the revoked state, the target video frame is merged into the first processed video according to the timestamp of the target video frame, i.e., the target video frame is restored into the first processed video according to the timestamp of the target video frame, to obtain a target video.

[0067] In the embodiment, if the processing strategy is set as the frame discarding strategy, a target video frame is obtained from the first associated frame set; the target video frame is sequentially introduced into a comparison window according to a timestamp of the target video frame, and first check information of the target video frame in the comparison window is received from a user. If the first check information is that the target video frame does not have the set sensitive information, the target video frame is marked as a revoked state. After the target video frame in the first associated frame set is checked, for the target video frame marked as the revoked state, the target video frame is merged into the first processed video according to the timestamp of the target video frame, i.e., the target video frame is restored into the first processed video according to the timestamp of the target video frame, to obtain a target video.

[0068] In the embodiment, the target video frame or the blurred video frame in the first associated frame set is subjected to error checking. If the target video frame does not contain the set sensitive information or the blurred video frame contains an error blur area, the target video frame can be restored to the first processed video according to the timestamp of the target video frame, and the target video can be obtained in the manner of correcting the error of the automatic desensitization processing system, thereby further improving the accuracy of processing the set sensitive information in the video.

[0069] Optionally, after the first processed video is corrected to obtain the target video, the method further comprises:

[0070] playing the target video based on the target frame rate; obtaining each video frame in the process of playing the target video as a second video frame; receiving third verification information of the second video frame by a user; if the third verification information is that the second video frame contains the set sensitive information, pausing the target video; processing the second video frame based on the set processing strategy to obtain a second associated frame set; continuing to process the unplayed target video based on the target frame rate until the target video is played to obtain a new second associated frame set; and processing the target video according to the new second associated frame set to obtain a new target video.

[0071] It should be noted that if the blurred video frame contains an error blur area, the corresponding blurred video frame in the first processed video is replaced by the target video frame according to the timestamp of the target video frame to obtain the target video. At this time, the target video frame corresponding to the blurred video frame may contain the set sensitive information. Alternatively, the automatic desensitization processing system (machine learning model) may miss some information during processing the video to be processed, and the target video can be processed again.

[0072] In this embodiment, the target video can be played again based on the target frame rate, and each video frame in the process of playing the target video is obtained as a second video frame. Third verification information of the second video frame is received from the user. If the third verification information indicates that the second video frame contains the set sensitive information, the target video is paused. The second video frame is processed again based on the set processing strategy to obtain a second associated frame set. The unplayed target video is played based on the target frame rate, and the third verification information of the second video frame is continuously received from the user. If the third verification information indicates that the second video frame contains the set sensitive information, the target video is paused again. The second video frame is processed again based on the set processing strategy until the target video is played to the end, that is, after all the second video frames in the target video are checked and processed based on the set processing strategy, a new second associated frame set is obtained. The target video is processed based on the new second associated frame set to obtain a new target video.

[0073] Specifically, the target video is uniformly processed for missing desensitization according to the latest second associated frame set. If the latest second associated frame set is not empty, if the set processing strategy is the whole frame discarding strategy, the second video frame is taken as a target video frame, and the target video frame is deleted from the target video one by one according to the timestamp of the target video frame in the latest second associated frame set to obtain a new target video. If the set processing strategy is the blurring set sensitive information region strategy, the second video frame is taken as a target video frame, and the target video frame in the target video is replaced by the corresponding blurred video frame according to the timestamp of the target video frame in the latest second associated frame set to obtain a new target video.

[0074] In this embodiment, the target video is played based on the target frame rate, and the target video is processed again in the process of playing the target video, which can make up for the processing omission of the automatic desensitization processing system, thereby further improving the accuracy of processing the set sensitive information in the video.

[0075] Optionally, processing the second video frame based on the set processing strategy to obtain a second associated frame set comprises: adding the second video frame and a plurality of video frames before the second video frame to a sliding window; determining a target video frame from the sliding window; processing the target video frame based on the set processing strategy to obtain the second associated frame set.

[0076] In this embodiment, the target video is played again based on the target frame rate, and each video frame in the process of playing the target video is obtained as a second video frame. Third verification information of the second video frame is received. If the third verification information is that the second video frame contains the set sensitive information, the target video is paused. When the target video is paused, the second video frame and a plurality of video frames before the second video frame are added to a sliding window for interactive serialization presentation. The size of the sliding window is N, which can be determined according to the performance of the machine. The size of the sliding window can be understood as the number of video frames. The sliding window can be understood as a list. Specifically, the second video frame and N video frames before the second video frame (which can be obtained according to the timestamp) can be added to the sliding window. The video frame containing the set sensitive information is determined from the sliding window as a target video frame. The target video frame is processed based on the set processing strategy to obtain a second associated frame set. In this embodiment, the way of processing the target video frame based on the set processing strategy to obtain the second associated frame set is the same as the way of processing the first video frame based on the set processing strategy to obtain the first associated frame set in the above embodiment, which will not be repeated here.

[0077] In this embodiment, the video frame containing the set sensitive information is serialized through the sliding window technology, which can improve the speed of video processing.

[0078] Figure 3 A structural schematic diagram of a video processing device provided by an embodiment of the present disclosure is shown in FIG. 3. Figure 3 As shown in FIG. 3, the device includes a video acquisition module 310, a target frame rate determination module 320, a video processing module 330, and a video correction module 340.

[0079] The video acquisition module 310 is configured to acquire a to-be-processed video. The to-be-processed video contains set sensitive information.

[0080] The target frame rate determination module 320 is configured to determine a target frame rate of the to-be-processed video.

[0081] The video processing module 330 is configured to process the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video.

[0082] The video correction module 340 is configured to correct the first processed video to obtain a target video.

[0083] The technical solution disclosed by the embodiment comprises the following steps: acquiring a to-be-processed video by a video acquisition module; determining a target frame rate of the to-be-processed video by a target frame rate determination module; processing set sensitive information in the to-be-processed video based on the target frame rate by a video processing module to obtain a first processed video; and correcting the first processed video by a video correction module to obtain a target video. According to the embodiment, the set sensitive information in the video is processed based on the target frame rate, and the first processed video is corrected, so that the accuracy of processing the set sensitive information in the video can be improved.

[0084] Optionally, the target frame rate determination module is specifically configured to: acquire a plurality of historical videos; for each historical video, process set sensitive information in the historical video based on a set frame rate to obtain a first processing result; wherein the first processing result is the number of video frames containing the set sensitive information; perform the following iteration process on the frame rate corresponding to the first processing result and the historical video: process the frame rate corresponding to the first processing result based on a set decrement step to obtain a first frame rate; process the set sensitive information in the historical video based on the first frame rate to obtain a second processing result; if the second processing result is not equal to the first processing result, take the second processing result as a new first processing result for iterative processing; if the second processing result is equal to the first processing result, end the iteration process, and take the frame rate corresponding to the first processing result as a second frame rate; obtain a plurality of second frame rates; and determine the target frame rate according to the plurality of second frame rates.

[0085] Optionally, the video processing module is specifically configured to: play the to-be-processed video based on the target frame rate; acquire each video frame in the playing process as a first video frame; wherein the first video frame is a currently played video frame; if the first video frame contains set sensitive information, process the first video frame based on a set processing strategy to obtain a first associated frame set; wherein the set processing strategy comprises a whole-frame discarding strategy and a set sensitive information region blurring strategy; and when the to-be-processed video playing is ended, process the to-be-processed video according to the first associated frame set to obtain a first processed video.

[0086] Optionally, the video processing module is further configured to: if the set processing strategy is the whole-frame discarding strategy, take the first video frame as a target video frame; determine a timestamp of the target video frame; associate the timestamp, the target video frame and the whole-frame discarding strategy, and add them to the first associated frame set.

[0087] Optionally, the video processing module is further configured to: if the processing strategy is set as the discard entire frame strategy, delete the target video frame from the video to be processed according to a timestamp corresponding to the target video frame, and obtain a first processed video.

[0088] Optionally, the video processing module is further configured to: if the processing strategy is set as the blur set sensitive information area strategy, take the first video frame as a target video frame; determine a timestamp of the target video frame; perform blur processing on a set sensitive area in the target video frame to obtain a blurred video frame; and associate the timestamp, the target video frame, the blurred video frame and the blur set sensitive information area strategy, and add them into a first associated frame set.

[0089] Optionally, the video processing module is further configured to: if the processing strategy is set as the blur set sensitive information area strategy, replace the target video frame in the video to be processed with the blurred video frame according to a timestamp corresponding to the target video frame, and obtain a first processed video.

[0090] Optionally, the video correction module is specifically configured to: if the processing strategy is set as the discard entire frame strategy, obtain a target video frame from the first associated frame set; receive first check information of the target video frame from a user; if the first check information is that the target video frame does not have the set sensitive information, merge the target video frame and the first processed video according to a timestamp corresponding to the target video frame to obtain a target video.

[0091] Optionally, the video correction module is further configured to: if the processing strategy is set as the blur set sensitive information area strategy, obtain a target video frame and a blurred video frame from the first associated frame set; receive second check information of the target video frame and the blurred video frame from a user; if the second check information is that the target video frame does not have the set sensitive information or the blurred video frame has an erroneous blurred area, replace a corresponding blurred video frame in the first processed video with the target video frame according to a timestamp corresponding to the target video frame to obtain a target video.

[0092] Optionally, the above apparatus further includes a target video processing module, which is specifically used for: playing the target video based on a target frame rate; acquiring each video frame during the playback of the target video as a second video frame; receiving third verification information from the user for the second video frame; if the third verification information indicates that the second video frame contains set sensitive information, then pausing the target video; processing the second video frame based on the set processing strategy to obtain a second associated frame set; continuing to process the unplayed target video based on the target frame rate until the target video is finished playing, obtaining a new second associated frame set; and processing the target video according to the new second associated frame set to obtain a new target video.

[0093] Optionally, the target video processing module is further configured to: add the second video frame and a plurality of video frames preceding the second video frame to a sliding window; determine the target video frame from the sliding window; and process the target video frame based on the set processing strategy to obtain a second associated frame set.

[0094] The video processing apparatus provided in this disclosure can execute the video processing method provided in any embodiment of this disclosure, and has the corresponding functional modules and beneficial effects for executing the method.

[0095] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit are only for easy differentiation and are not used to limit the protection scope of the embodiments of this disclosure.

[0096] Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Reference is made below. Figure 4 It illustrates an electronic device suitable for implementing embodiments of the present disclosure (e.g., Figure 4 The diagram below shows the structure of the terminal device or server 400. The terminal device in this embodiment may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and vehicle terminals (e.g., vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 4 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0097] like Figure 4As shown, the electronic device 400 can include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 401 that can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 402 or loaded into a random access memory (RAM) 403 from a storage device 408. Various programs and data required for the operation of the electronic device 400 are also stored in the RAM 403. The processing device 401, the ROM 402, and the RAM 403 are connected to each other through a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0098] Generally, the following devices can be connected to the I / O interface 405: input devices 406 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 407 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 408 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 409. The communication devices 409 can allow the electronic device 400 to communicate wirelessly or wired with other devices to exchange data. Although Figure 4 The electronic device 400 is shown with various devices, but it should be understood that not all of the shown devices are required to be implemented or present. More or fewer devices can alternatively be implemented or present.

[0099] In particular, the processes described above with reference to the flowcharts can be implemented as a computer software program according to embodiments of the present disclosure. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the methods illustrated by the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network through the communication devices 409, or installed from the storage devices 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, the above-mentioned functions defined in the methods of embodiments of the present disclosure are performed.

[0100] The names of the messages or information exchanged between the plurality of devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0101] The electronic device provided by the embodiments of the present disclosure and the video processing method provided by the above-mentioned embodiments belong to the same inventive concept, and the technical details not described in detail in the present embodiments can be referred to the above-mentioned embodiments, and the present embodiments have the same beneficial effects as the above-mentioned embodiments.

[0102] The embodiments of the present disclosure provide a computer storage medium having a computer program stored thereon, which, when executed by a processor, implements the video processing method provided by the above-mentioned embodiments.

[0103] Note that the computer readable medium described above in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination thereof. The computer readable storage medium can be, for example and without limitation, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination thereof. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, the computer readable storage medium can be any tangible medium that contains or stores a program used by or in connection with an instruction execution system, apparatus or device. In the present disclosure, the computer readable signal medium can include a data signal propagated in baseband or propagated as a carrier wave in a propagated data signal, in which the computer readable program code is contained. Such a propagated data signal can take any of a variety of forms, including but not limited to electro-magnetic, optical, or any suitable combination thereof. The computer readable signal medium can also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate or transport a program for use by or in connection with an instruction execution system, apparatus or device. The program code contained on the computer readable medium can be transmitted by any suitable medium, including but not limited to wire, cable, RF, etc., or any suitable combination thereof.

[0104] In some embodiments, the client, server, or both can communicate using any current known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any current known or future developed networks.

[0105] The computer readable medium described above can be included in the electronic device described above; or can exist separately from the electronic device, and can be accessed via the electronic device.

[0106] The computer readable medium described above carries one or more programs, when the one or more programs are executed by the electronic device, cause the electronic device to: acquire a to-be-processed video; wherein the to-be-processed video comprises set sensitive information; determine a target frame rate of the to-be-processed video; process the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video; and correct the first processed video to obtain a target video.

[0107] Computer program code for carrying out operations of the present disclosure can be written in any one or more of a variety of programming languages or combinations of languages, including an object-oriented programming language such as Java, Smalltalk, C++, or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0108] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of present disclosure. In this regard, each block in the flow diagrams or block diagrams can represent a module, a procedure, or a part of code, which comprises one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in a different order than that noted in the figures. For example, two blocks noted in succession can in fact be executed substantially concurrently or in the opposite order, depending on the functionality involved. It should also be noted that each block in the block diagrams and / or flow diagrams, and combinations of blocks in the block diagrams and / or flow diagrams, can be implemented by dedicated hardware-based systems that perform the specified functions or operations, or can be implemented by a combination of dedicated hardware-based systems and computer instructions.

[0109] The units described in the embodiments of the present disclosure can be implemented by software, or by hardware. In some cases, the name of the unit does not constitute a limitation on the unit itself, for example, the first acquisition unit can also be described as a unit for acquiring at least two Internet protocol addresses.

[0110] The functionality described above in this document can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, non- transitory machine-readable media can include RAM, ROM, programmable ROM (EPROM, EEPROM or flash memory), or any other storage device(s) through which program instructions can be stored and executed by a processing unit. The above described functions can be implemented as software modules or software functions using object-oriented design methodology, or using any other suitable programming technique.

[0111] In the context of the present disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more of: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0112] The foregoing description merely exemplifies the preferred embodiments of the disclosure and the principles of the technology involved. It is believed that those skilled in the art can accomplish the disclosure with the enclosed claims without any creative work. The scope of the disclosure should not be limited by the technical features of the specific embodiments described above, but should include all the technical solutions falling within the concept of the disclosure, which are obtained by combining the technical features described above or equivalent features thereof in any manner. For example, the technical solutions formed by replacing the above-described features with the technical features disclosed in the disclosure (but not limited to) having similar functions.

[0113] Furthermore, while operations are depicted in a particular, chronological sequence in this disclosure, this should not be understood as requiring that such operations be performed in the order shown or that all illustrated operations be performed, to perform impact. In certain circumstances, multitasking and parallel processing can be advantageous. Likewise, the various embodiments can be implemented in software, hardware, or firmware, or any combination thereof. Moreover, the specific hardware or software modules described in the above discussion are meant to be illustrative of the possible implementations of the present disclosure, and are not meant to be limiting. Certain features described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable sub-combination. Accordingly, the scope of the present disclosure should be determined not with reference to the above description, but with reference to the appended claims, along with their full scope of equivalents.

[0114] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A method of video processing, the method comprising: The method comprises: obtaining a to-be-processed video; wherein the to-be-processed video comprises set sensitive information; determining a target frame rate of the to-be-processed video; processing the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video; correcting the first processed video to obtain a target video; the determination of the target frame rate of the to-be-processed video comprises: obtaining a plurality of historical videos; for each historical video, processing the set sensitive information in the historical video based on a set frame rate to obtain a first processing result; wherein the first processing result is the number of video frames containing the set sensitive information; for the frame rate corresponding to the first processing result and the historical video, performing the following iteration process: processing the frame rate corresponding to the first processing result based on a set decreasing step to obtain a first frame rate; processing the set sensitive information in the historical video based on the first frame rate to obtain a second processing result; if the second processing result is not equal to the first processing result, taking the second processing result as a new first processing result for iterative processing; if the second processing result is equal to the first processing result, ending the iteration process, and taking the frame rate corresponding to the first processing result as a second frame rate; obtaining a plurality of second frame rates; determining the target frame rate according to the plurality of second frame rates; processing the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video comprises: playing the to-be-processed video based on the target frame rate; obtaining each video frame in the playing process as a first video frame; wherein the first video frame is the currently played video frame; if the first video frame contains the set sensitive information, processing the first video frame based on a set processing strategy to obtain a first associated frame set; wherein the set processing strategy comprises a whole frame discarding strategy and a set sensitive information region blurring strategy; when the to-be-processed video playing ends, processing the to-be-processed video according to the first associated frame set to obtain a first processed video; correcting the first processed video to obtain a target video comprises: if the set processing strategy is the whole frame discarding strategy, obtaining a target video frame from the first associated frame set; receiving first check information of the target video frame from a user; if the first check information is that the target video frame does not contain the set sensitive information, merging the target video frame and the first processed video according to the time stamp corresponding to the target video frame to obtain a target video; correcting the first processed video to obtain a target video further comprises: if the set processing strategy is the set sensitive information region blurring strategy, obtaining a target video frame and a blurred video frame from the first associated frame set; receiving second check information of the target video frame and the blurred video frame from a user; if the second check information is that the target video frame does not contain the set sensitive information or the blurred video frame contains an incorrect blurring region, replacing the corresponding blurred video frame in the first processed video with the target video frame according to the time stamp corresponding to the target video frame to obtain a target video.

2. The method of claim 1, wherein, processing the first video frame based on the set processing strategy to obtain a first associated frame set, comprising: if the set processing strategy is a discard entire frame strategy, taking the first video frame as a target video frame; determining a timestamp of the target video frame; associating the timestamp, the target video frame, and the discard entire frame strategy, and adding them to the first associated frame set.

3. The method of claim 2, wherein, processing the to-be-processed video according to the first associated frame set to obtain a first processed video, comprising: if the set processing strategy is the discard entire frame strategy, deleting the target video frame from the to-be-processed video according to the timestamp corresponding to the target video frame to obtain the first processed video.

4. The method of claim 1, wherein, processing the first video frame based on the set processing strategy to obtain a first associated frame set, comprising: if the set processing strategy is a blur set sensitive information region strategy, taking the first video frame as a target video frame; determining a timestamp of the target video frame; performing blur processing on a set sensitive region in the target video frame to obtain a blurred video frame; associating the timestamp, the target video frame, the blurred video frame, and the blur set sensitive information region strategy, and adding them to the first associated frame set.

5. The method of claim 4, wherein, processing the to-be-processed video according to the first associated frame set to obtain a first processed video, comprising: if the set processing strategy is the blur set sensitive information region strategy, replacing the target video frame in the to-be-processed video with the blurred video frame according to the timestamp corresponding to the target video frame to obtain the first processed video.

6. The method of claim 1, wherein, after the first processed video is corrected to obtain a target video, further comprising: playing the target video based on a target frame rate; obtaining each video frame in the process of playing the target video as a second video frame; receiving third verification information of the second video frame from a user; if the third verification information is that the second video frame contains set sensitive information, pausing the target video; processing the second video frame based on the set processing strategy to obtain a second associated frame set; continuing to process the target video that has not been played based on the target frame rate until the target video is played completely to obtain a new second associated frame set; processing the target video according to the new second associated frame set to obtain a new target video.

7. The method of claim 6, wherein, processing the second video frame based on the set processing strategy to obtain a second associated frame set, comprising: adding the second video frame and a plurality of video frames before the second video frame to a sliding window; determining a target video frame from the sliding window; processing the target video frame based on the set processing strategy to obtain the second associated frame set.

8. A video processing apparatus, comprising: comprising: a video acquisition module configured to acquire a to-be-processed video; wherein the to-be-processed video contains set sensitive information; a target frame rate determination module configured to determine a target frame rate of the to-be-processed video; a video processing module configured to process the set sensitive information in the to-be-processed video based on the target frame rate to obtain a first processed video; a video correction module, configured to correct the first processing video to obtain a target video; The target frame rate determination module is specifically configured to: obtain a plurality of historical videos; for each historical video, process set sensitive information in the historical video based on a set frame rate to obtain a first processing result; the first processing result is the number of video frames containing the set sensitive information; perform an iteration process on the frame rate corresponding to the first processing result and the historical video as follows: process the frame rate corresponding to the first processing result based on a set decreasing step to obtain a first frame rate; process the set sensitive information in the historical video based on the first frame rate to obtain a second processing result; if the second processing result is not equal to the first processing result, the second processing result is taken as a new first processing result for iterative processing; if the second processing result is equal to the first processing result, the iteration process is ended, and the frame rate corresponding to the first processing result is taken as a second frame rate; obtain a plurality of second frame rates; and determine a target frame rate according to the plurality of second frame rates; The video processing module is specifically configured to: play the video to be processed based on the target frame rate; obtain each video frame in the playing process as a first video frame; the first video frame is a currently played video frame; if the first video frame contains set sensitive information, process the first video frame based on a set processing strategy to obtain a first associated frame set; the set processing strategy includes a whole-frame discarding strategy and a set sensitive information region blurring strategy; when the video to be processed is played to the end, process the video to be processed according to the first associated frame set to obtain a first processing video. The video correction module is specifically configured to: if the set processing strategy is the whole-frame discarding strategy, obtain a target video frame from the first associated frame set; receive first check information of the target video frame from a user; if the first check information is that the target video frame does not contain the set sensitive information, merge the target video frame and the first processing video according to a time stamp corresponding to the target video frame to obtain a target video. The video correction module is further configured to: if the set processing strategy is the set sensitive information region blurring strategy, obtain a target video frame and a blurred video frame from the first associated frame set; receive second check information of the target video frame and the blurred video frame from a user; if the second check information is that the target video frame does not contain the set sensitive information or the blurred video frame contains an incorrect blurring region, replace a corresponding blurred video frame in the first processing video with the target video frame according to a time stamp corresponding to the target video frame to obtain a target video.

9. An electronic device, comprising: The electronic device includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the video processing method in any one of claims 1-7.

10. A storage medium containing computer-executable instructions for performing the video processing method of any one of claims 1-7 when executed by a computer processor.

Images