A data processing method, device and equipment
By dividing the video into front and back segments and obtaining the start and end points of the lag, the problem of low efficiency in video lag detection processing in the prior art is solved, and more efficient and accurate lag detection is achieved.
Patent Information
- Application Number
- CN202110145485.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-02-02
- Publication Date
- 2025-02-11
- Estimated Expiration
- 2041-02-02
AI Technical Summary
The data processing scheme for video stutter detection in the prior art is inefficient in processing.
By dividing the target video into the front video and the back video, the stuttering start point is obtained based on the last frame of the front video and the reference frame of the source video, and then the stuttering end point is determined, thereby obtaining the stuttering information of the video.
It improves the processing efficiency of video stutter detection, reduces the workload of comparison, improves the comparison efficiency, and can cover all stutters that meet preset standards, and has better accuracy and accuracy of processing results.
Smart Images

Figure CN114845164B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data processing technology, and in particular to a data processing method, device and equipment. Background Art
[0002] The smoothness of video playback is an important factor affecting the user's viewing experience. Stuttering is the main manifestation of poor video playback, so stuttering has become one of the important focuses of video quality detection.
[0003] Among the existing video freeze detection methods, some analyze the entire data (video, cached data, etc.), while others analyze the data after obtaining it through periodic sampling. The former needs to analyze from the first data or the first frame of the picture to the last data or the last frame of the picture, which has a large processing workload and low efficiency. The accuracy of periodic sampling depends on the sampling interval. When the interval is short, there is also a large workload and low efficiency.
[0004] As can be seen from the above, the existing data processing solutions for video freeze detection have the problem of low processing efficiency. Summary of the invention
[0005] The purpose of the present invention is to provide a data processing method, device and equipment to solve the problem of low processing efficiency of data processing solutions for video freeze detection in the prior art.
[0006] In order to solve the above technical problems, an embodiment of the present invention provides a data processing method, including:
[0007] When the target video is stuck, the target video is divided into a front video segment and a back video segment;
[0008] Obtaining a freeze start point in the target video from the previous video or the next video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video;
[0009] According to the freeze starting point, obtaining a freeze ending point in the target video corresponding to the freeze starting point;
[0010] Obtaining the freeze information of the target video according to the freeze start point and the freeze end point;
[0011] The target video is video data obtained by actually playing the source video.
[0012] Optionally, obtaining the freeze start point in the target video from the previous video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video includes:
[0013] When the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video segment is a minimum segmentation unit;
[0014] In the case where the previous video is the smallest segmentation unit, the last frame is used as a freeze start point in the target video;
[0015] In the case that the front video segment is not the minimum segmentation unit, the front video segment is used as a new target video, and the target video segmentation is returned to the process of segmenting the target video into the front video segment and the back video segment until a freeze starting point is obtained.
[0016] Optionally, obtaining the freeze start point in the target video from the subsequent video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video includes:
[0017] When the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit;
[0018] In the case that the front video segment is not the minimum segmentation unit, the rear video segment is used as a new target video, and the target video segmentation into the front video segment and the rear video segment is returned until the freeze starting point is obtained.
[0019] Optionally, obtaining a freeze end point corresponding to the freeze start point in the target video according to the freeze start point includes:
[0020] According to the next frame corresponding to the freeze starting point in the source video, a freeze ending point corresponding to the freeze starting point in the target video is obtained.
[0021] Optionally, the acquiring the freeze starting point in the target video from the latter video according to the last frame of the former video and the reference frame at the corresponding time point in the source video further includes:
[0022] When the latter video is a minimum segmentation unit, taking the starting point of the latter video as the freeze starting point in the target video;
[0023] The acquiring, according to the freeze starting point, a freeze ending point in the target video corresponding to the freeze starting point includes:
[0024] The end point of the latter video corresponding to the start point of the latter video is used as the freeze end point in the target video corresponding to the freeze start point.
[0025] Optionally, before the target video is segmented into a front video segment and a rear video segment, the method further includes:
[0026] Obtaining a first difference between a second duration corresponding to the target video and a first duration corresponding to the source video;
[0027] When the first difference is greater than or equal to a second threshold, it is determined that there is a freeze in the target video.
[0028] Optionally, obtaining the freeze information of the target video according to the freeze start point and the freeze end point includes:
[0029] According to the freeze start point and the freeze end point, the freeze frame number and the freeze image are obtained;
[0030] Obtaining a freeze duration according to the freeze frame number and a frame rate actually used for playing the source video;
[0031] Obtain the freeze information of the target video according to at least one of the freeze frame number, the freeze image and the freeze duration.
[0032] Optionally, after obtaining the freeze information of the target video according to the freeze start point and the freeze end point, the method further includes:
[0033] Obtaining a second difference between a second duration corresponding to the target video and the freeze duration in the freeze information;
[0034] When the second difference is greater than the first duration corresponding to the source video, the video after the freeze end point in the target video is used as the new target video, and the video after the frame corresponding to the freeze end point in the source video is used as the new source video, and the method of dividing the target video into the front video and the back video is returned.
[0035] An embodiment of the present invention further provides a data processing device, including:
[0036] A first segmentation module, used for segmenting the target video into a front video segment and a rear video segment when there is a freeze in the target video;
[0037] A first acquisition module, configured to acquire a freeze start point in the target video from the preceding video or the succeeding video according to the last frame of the preceding video and a reference frame at a corresponding time point in the source video;
[0038] A second acquisition module is used to acquire a freeze end point corresponding to the freeze start point in the target video according to the freeze start point;
[0039] A first processing module, configured to obtain the freeze information of the target video according to the freeze start point and the freeze end point;
[0040] The target video is video data obtained by actually playing the source video.
[0041] Optionally, obtaining the freeze start point in the target video from the previous video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video includes:
[0042] When the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video segment is a minimum segmentation unit;
[0043] In the case where the previous video is the smallest segmentation unit, the last frame is used as a freeze start point in the target video;
[0044] In the case that the front video segment is not the minimum segmentation unit, the front video segment is used as a new target video, and the target video segmentation is returned to the process of segmenting the target video into the front video segment and the back video segment until a freeze starting point is obtained.
[0045] Optionally, obtaining the freeze start point in the target video from the subsequent video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video includes:
[0046] When the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit;
[0047] In the case that the front video segment is not the minimum segmentation unit, the rear video segment is used as a new target video, and the target video segmentation into the front video segment and the rear video segment is returned until the freeze starting point is obtained.
[0048] Optionally, obtaining a freeze end point corresponding to the freeze start point in the target video according to the freeze start point includes:
[0049] According to the next frame corresponding to the freeze starting point in the source video, a freeze ending point corresponding to the freeze starting point in the target video is obtained.
[0050] Optionally, the acquiring the freeze starting point in the target video from the latter video according to the last frame of the former video and the reference frame at the corresponding time point in the source video further includes:
[0051] When the latter video is a minimum segmentation unit, taking the starting point of the latter video as the freeze starting point in the target video;
[0052] The acquiring, according to the freeze starting point, a freeze ending point in the target video corresponding to the freeze starting point includes:
[0053] The end point of the latter video corresponding to the start point of the latter video is used as the freeze end point in the target video corresponding to the freeze start point.
[0054] Optionally, also include:
[0055] A third acquisition module is used to acquire a first difference between a second duration corresponding to the target video and a first duration corresponding to the source video before dividing the target video into a front video segment and a rear video segment;
[0056] The first determination module is used to determine that there is a freeze in the target video when the first difference is greater than or equal to a second threshold.
[0057] Optionally, obtaining the freeze information of the target video according to the freeze start point and the freeze end point includes:
[0058] According to the freeze start point and the freeze end point, the freeze frame number and the freeze image are obtained;
[0059] Obtaining a freeze duration according to the freeze frame number and a frame rate actually used for playing the source video;
[0060] Obtain the freeze information of the target video according to at least one of the freeze frame number, the freeze image and the freeze duration.
[0061] Optionally, also include:
[0062] A fourth acquisition module is used to obtain a second difference between a second duration corresponding to the target video and the freeze duration in the freeze information after obtaining the freeze information of the target video according to the freeze start point and the freeze end point;
[0063] A second processing module is used to use the video after the freeze end point in the target video as a new target video when the second difference is greater than the first duration corresponding to the source video, and use the video after the frame corresponding to the freeze end point in the source video as a new source video, and return the method of dividing the target video into a front video and a back video.
[0064] An embodiment of the present invention further provides a data processing device, including: a processor;
[0065] The processor is used to divide the target video into a front video segment and a rear video segment when there is a freeze in the target video;
[0066] Obtaining a freeze start point in the target video from the previous video or the next video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video;
[0067] According to the freeze starting point, obtaining a freeze ending point in the target video corresponding to the freeze starting point;
[0068] Obtaining the freeze information of the target video according to the freeze start point and the freeze end point;
[0069] The target video is video data obtained by actually playing the source video.
[0070] Optionally, obtaining the freeze start point in the target video from the previous video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video includes:
[0071] When the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video segment is a minimum segmentation unit;
[0072] In the case where the previous video is the smallest segmentation unit, the last frame is used as a freeze start point in the target video;
[0073] In the case that the front video segment is not the minimum segmentation unit, the front video segment is used as a new target video, and the target video segmentation is returned to the process of segmenting the target video into the front video segment and the back video segment until a freeze starting point is obtained.
[0074] Optionally, obtaining the freeze start point in the target video from the subsequent video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video includes:
[0075] When the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit;
[0076] In the case that the front video segment is not the minimum segmentation unit, the rear video segment is used as a new target video, and the target video segmentation into the front video segment and the rear video segment is returned until the freeze starting point is obtained.
[0077] Optionally, obtaining a freeze end point corresponding to the freeze start point in the target video according to the freeze start point includes:
[0078] According to the next frame corresponding to the freeze starting point in the source video, a freeze ending point corresponding to the freeze starting point in the target video is obtained.
[0079] Optionally, the acquiring the freeze starting point in the target video from the latter video according to the last frame of the former video and the reference frame at the corresponding time point in the source video further includes:
[0080] When the latter video is a minimum segmentation unit, taking the starting point of the latter video as the freeze starting point in the target video;
[0081] The acquiring, according to the freeze starting point, a freeze ending point in the target video corresponding to the freeze starting point includes:
[0082] The end point of the latter video corresponding to the start point of the latter video is used as the freeze end point in the target video corresponding to the freeze start point.
[0083] Optionally, the processor is further configured to:
[0084] Before dividing the target video into a front video segment and a rear video segment, obtaining a first difference between a second duration corresponding to the target video and a first duration corresponding to the source video;
[0085] When the first difference is greater than or equal to a second threshold, it is determined that there is a freeze in the target video.
[0086] Optionally, obtaining the freeze information of the target video according to the freeze start point and the freeze end point includes:
[0087] According to the freeze start point and the freeze end point, the freeze frame number and the freeze image are obtained;
[0088] Obtaining a freeze duration according to the freeze frame number and a frame rate actually used for playing the source video;
[0089] Obtain the freeze information of the target video according to at least one of the freeze frame number, the freeze image and the freeze duration.
[0090] Optionally, the processor is further configured to:
[0091] After obtaining the freeze information of the target video according to the freeze start point and the freeze end point, obtaining a second difference between a second duration corresponding to the target video and the freeze duration in the freeze information;
[0092] When the second difference is greater than the first duration corresponding to the source video, the video after the freeze end point in the target video is used as the new target video, and the video after the frame corresponding to the freeze end point in the source video is used as the new source video, and the method of dividing the target video into the front video and the back video is returned.
[0093] An embodiment of the present invention provides a data processing device, including a memory, a processor, and a program stored in the memory and executable on the processor; when the processor executes the program, the above-mentioned data processing method is implemented.
[0094] An embodiment of the present invention provides a readable storage medium on which a program is stored. When the program is executed by a processor, the steps in the above-mentioned data processing method are implemented.
[0095] The beneficial effects of the above technical solution of the present invention are as follows:
[0096] In the above scheme, the data processing method divides the target video into a front video and a back video when there is a freeze in the target video; obtains the freeze start point in the target video from the front video or the back video according to the last frame of the front video and the reference frame of the corresponding time point in the source video; obtains the freeze end point in the target video corresponding to the freeze start point according to the freeze start point; obtains the freeze information of the target video according to the freeze start point and the freeze end point; wherein the target video is the video data obtained according to the actual playback of the source video; it can realize the segmentation of the video based on the determination of freeze, locate the first frame of freeze by locating the last frame of the segmented video to the first frame of freeze, and then determine the last frame of freeze, which reduces the workload required for comparison, improves the comparison efficiency, and also improves the processing efficiency of the scheme; it solves the problem of low processing efficiency of the data processing scheme for video freeze detection in the prior art. In addition, this scheme can cover all freezes that meet the preset standards, and the precision and accuracy of the processing results are better than the existing scheme. BRIEF DESCRIPTION OF THE DRAWINGS
[0097] Figure 1 A schematic diagram of a data processing method according to an embodiment of the present invention;
[0098] Figure 2 A schematic diagram of a specific implementation flow of a data processing method according to an embodiment of the present invention;
[0099] Figure 3 A schematic diagram of the structure of a data processing device according to an embodiment of the present invention;
[0100] Figure 4 Schematic diagram of the structure of a data processing device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0101] In order to make the technical problems, technical solutions and advantages to be solved by the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.
[0102] The present invention aims to solve the problem of low processing efficiency of data processing schemes for video freeze detection in the prior art and provides a data processing method, such as Figure 1 As shown, including:
[0103] Step 11: if the target video is stuck, split the target video into a front video segment and a back video segment;
[0104] Step 12: Obtaining a freeze start point in the target video from the previous video or the next video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video;
[0105] Step 13: According to the freeze start point, obtain a freeze end point in the target video corresponding to the freeze start point;
[0106] Step 14: Obtain the freeze information of the target video according to the freeze start point and the freeze end point; wherein the target video is the video data obtained by actually playing the source video.
[0107] The data processing method provided by the embodiment of the present invention divides the target video into a front video and a back video when there is a freeze in the target video; obtains the freeze start point in the target video from the front video or the back video according to the last frame of the front video and the reference frame of the corresponding time point in the source video; obtains the freeze end point in the target video corresponding to the freeze start point according to the freeze start point; obtains the freeze information of the target video according to the freeze start point and the freeze end point; wherein the target video is the video data obtained according to the actual playback of the source video; it can realize the segmentation of the video based on the determination of freeze, locate the first frame of freeze by locating the last frame of the segmented video to the first frame of freeze, and then determine the last frame of freeze, which reduces the workload required for comparison, improves the comparison efficiency, and also improves the processing efficiency of the scheme; it well solves the problem of low processing efficiency of the data processing scheme for video freeze detection in the prior art. In addition, the scheme can cover all freezes that meet the preset standards, and the precision and accuracy of the processing results are better than the existing scheme.
[0108] Among them, the method of obtaining the freeze starting point in the target video from the previous video based on the last frame of the previous video and the reference frame at the corresponding time point in the source video includes: when the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video is a minimum segmentation unit; when the previous video is a minimum segmentation unit, using the last frame as the freeze starting point in the target video; when the previous video is not a minimum segmentation unit, using the previous video as a new target video, and returning to the method of segmenting the target video into the previous video and the next video until the freeze starting point is obtained.
[0109] In this case, it is considered that there is a freeze in the previous video.
[0110] In an embodiment of the present invention, the method of obtaining the freeze starting point in the target video from the latter video based on the last frame of the former video and the reference frame at the corresponding time point in the source video includes: when the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit; when the former video is not a minimum segmentation unit, taking the latter video as a new target video, and returning to the method of segmenting the target video into the former video and the latter video until the freeze starting point is obtained.
[0111] In this case, it is considered that there is no jamming in the first video segment, but there is jamming in the second video segment.
[0112] Correspondingly, obtaining the freeze end point in the target video corresponding to the freeze start point according to the freeze start point includes: obtaining the freeze end point in the target video corresponding to the freeze start point according to the next frame corresponding to the freeze start point in the source video.
[0113] In an embodiment of the present invention, the method of obtaining a freeze start point in the target video from the latter video based on the last frame of the former video and a reference frame at a corresponding time point in the source video also includes: when the latter video is a minimum segmentation unit, using the starting point of the latter video as the freeze start point in the target video; and the method of obtaining a freeze end point in the target video corresponding to the freeze start point based on the freeze start point includes: using the ending point of the latter video corresponding to the starting point of the latter video as the freeze end point in the target video corresponding to the freeze start point.
[0114] It can also be understood that the latter video is actually a video of one frame, and the freeze exists in the latter video, then the freeze is in the frame.
[0115] Furthermore, before dividing the target video into a front video segment and a back video segment, it also includes: obtaining a first difference between a second duration corresponding to the target video and a first duration corresponding to the source video; when the first difference is greater than or equal to a second threshold, determining that there is a freeze in the target video.
[0116] Among them, the second threshold can be set according to the actual demand for the freeze duration, for example, the default setting is 0.1 second.
[0117] In an embodiment of the present invention, obtaining the freeze information of the target video according to the freeze starting point and the freeze ending point includes: obtaining the freeze frame number and the freeze image according to the freeze starting point and the freeze ending point; obtaining the freeze duration according to the freeze frame number and the frame rate actually used for playing the source video; obtaining the freeze information of the target video according to at least one of the freeze frame number, the freeze image and the freeze duration.
[0118] Furthermore, after obtaining the freeze information of the target video according to the freeze start point and the freeze end point, it also includes: obtaining a second difference between a second duration corresponding to the target video and the freeze duration in the freeze information; when the second difference is greater than the first duration corresponding to the source video, taking the video after the freeze end point in the target video as the new target video, and taking the video after the frame corresponding to the freeze end point in the source video as the new source video, and returning to the step of dividing the target video into a front video and a back video.
[0119] It can also be understood that after the current freeze (the freeze corresponding to the freeze duration) is confirmed, if other freezes still exist, the above freeze detection operation can be performed again (similar to the determination process of this freeze).
[0120] The data processing method provided by the embodiment of the present invention is described below by way of example.
[0121] In response to the above technical problems, an embodiment of the present invention provides a data processing method, which can be specifically implemented as a method for detecting video freezes: based on the comparison of the playback duration (corresponding to the first duration and the second duration mentioned above) to determine freezes, the video is segmented, and the first frame of freezes is located only by comparing the last frame of the segmented video, and then the last frame of freezes is determined frame by frame, which reduces the workload required for comparison and improves the comparison efficiency. On this basis, this solution can cover all freezes that meet the preset standards, and the accuracy and precision of the results are better than the sampling detection method.
[0122] This solution can also be understood as providing a method for detecting and measuring video freezes. This method is based on the comparison of the duration of the source video and the target video to determine whether the target video has freezes. The starting and ending points of the freezes are quickly determined by multiple segmentation and frame comparison of the source video and the target video, and then the number of freezes and duration and other information are calculated.
[0123] Specifically, the solution provided by the embodiment of the present invention can be as follows: Figure 2 As shown (the minimum segmentation unit takes the minimum divisible frame as an example), including:
[0124] Step 21: Obtain the video to be played (source video) and determine its playing time (corresponding to the first time);
[0125] It can also be understood that the video to be detected is obtained as the source video, and the duration required for its playback is determined.
[0126] Step 22: Play the video, record the video (target video) according to the actual playback frame rate, and obtain the actual playback time;
[0127] It can also be understood that the video is played, recorded according to the actual playback frame rate, and the target video playback time (actual playback time, corresponding to the second time) is obtained for detecting whether there is a freeze.
[0128] Step 23: Playing time comparison (source video VS target video), if the playing time of the source video is equal to the actual playing time of the target video, proceed to step 24; if the playing time of the source video is less than the actual playing time of the target video, proceed to step 25;
[0129] Specifically, the playback time of the source video is compared with the actual playback time of the target video. If they are not equal, it is determined that there is a freeze, and the video segmentation process is entered, that is, step 25 is entered, and then step 26 is entered.
[0130] Regarding "playback time comparison (source video VS target video)", specifically it can be: determine whether the first difference between the actual playback time of the target video and the playback time of the source video is greater than or equal to the second threshold. The second threshold can be set by yourself, for example, the default is 0.1s.
[0131] Step 24: Make sure the duration is the same and there is no lag;
[0132] That is, if the playback time of the source video is equal to the actual playback time of the target video, it is considered that there is no freeze in the target video and the judgment ends.
[0133] Step 25: Determine that the duration is different and the target video has a freeze;
[0134] Step 26: Segment the target video according to a certain standard, and obtain the duration, start frame, and end frame of the segmented video blocks;
[0135] Step 27: Compare the end frame of the first half of the target video (i.e., the first video) with the frame of the source video at the corresponding time to see if they are the same; if so, proceed to step 28; if not, proceed to step 211;
[0136] Step 28: The video block (i.e., the first half of the video) has no lag and is no longer compared; proceed to step 29;
[0137] Step 29: Determine whether the second half of the video (i.e., the second half of the video) is a minimum divisible frame (corresponding to the above-mentioned minimum segmentation unit); if so, proceed to step 210; if not, return to step 26;
[0138] Step 210: Record the time point corresponding to the frame, and use the frame as the starting point and the ending point of the freeze; proceed to step 213 (you may also skip step 213, and directly calculate the duration of the freeze according to the actual frame rate and number of frames used for video playback, and record the acquired freeze-related information; but this is not limited to this);
[0139] The above can be specifically understood as: according to certain rules and standards (such as time points divided in half, or other clues of the monitored playback process (such as plot development)), the target video is divided into two parts (the division does not necessarily mean half and half). The similarity between the last frame of the front part (corresponding to the front video segment) (i.e. the above-mentioned last frame) and the frame of the source video at the same time point (i.e. the above-mentioned reference frame) is compared. If the preset standard (i.e. the above-mentioned first threshold) is met, it is considered that there is no jamming in the first half, and the second half (corresponding to the second video segment) is continued to be divided and the last frame at the same time point is compared (i.e. the last frame of the divided video is compared with the frame at the corresponding time point in the source video) until the starting frame of this jam is found.
[0140] Specifically: if there is no lag in the first half, then we can first determine whether the second half is the smallest divisible frame (corresponding to the above-mentioned smallest segmentation unit); if not, take the second half as the new target video, and take the source video part corresponding to the second half as the new source video (that is, take the starting point of the second half as the starting frame of the new target video, and the ending point as the ending frame of the new target video; take the frame at the corresponding time point in the source video of the starting point of the second half as the starting frame of the new source video, and the ending point of the source video as the ending frame of the new source video), and return to execute step 26.
[0141] Step 211: Determine if there is a freeze, and determine whether the first half of the video is the smallest divisible frame; if so, proceed to step 212, if not, return to step 26;
[0142] Step 212: Record the time point corresponding to the frame, take the next frame of the source video as the end point comparison frame, and compare the next frame of the target video frame by frame until the comparison frame of the source video is matched; and use the matched frame as the freeze end point.
[0143] Regarding "recording the time point corresponding to the frame, taking the next frame of the source video as the end point comparison frame, and comparing the next frame of the target video frame by frame until the comparison frame of the source video is matched", it can be understood as: recording this time point in the target video, and obtaining the next frame in the source video according to this time point as the end frame; matching the end frame with the target video until the match is consistent, and obtaining the end point of this period of freeze.
[0144] That is: if the end frame of the first half of the target video does not match the frame of the source video at the corresponding time (does not meet the preset standard, that is, they are not the same), it is considered that there is a freeze in the first half, and the first half is continued to be divided and the last frame comparison at the same time point is continued. According to the comparison result, step 28 or step 211 is executed until the starting frame of this freeze is found.
[0145] In the embodiment of the present invention, the "minimum divisible frame" can be understood as: the minimum unit of segmentation is a frame. Specifically, in implementation, if the similarity between the two frames before and after segmentation is lower than a first threshold, it is not a minimum divisible frame. If the similarity is equal to or higher than the first threshold, it is a minimum divisible frame.
[0146] In an embodiment of the present invention, after determining the start frame of the freeze, the next frame of the freeze start frame of the source video can be taken and compared frame by frame with the next frame of the freeze start frame of the target video until a frame with a satisfactory similarity is found and recorded as the last frame of this freeze (i.e., the end point of the freeze or the end frame of the freeze).
[0147] In the embodiment of the present invention, the last frame may span across multiple segmented video blocks (ie, the last frame freeze may span across multiple segmented video blocks).
[0148] Step 213: Calculate the duration of this freeze according to the frame rate and the number of frames.
[0149] Specifically, the number of frames between the start frame and the end frame may be calculated, and the duration of the freeze may be calculated according to the frame rate of the video when it is actually played.
[0150] Step 214: Subtract the freeze duration from the actual video playback duration to obtain a difference (corresponding to the second difference above);
[0151] Step 215: compare the difference with the duration of the source video (i.e., the duration of the source video playback); if the difference is greater than the duration of the source video, proceed to step 216; if the difference is equal to the duration of the source video, proceed to step 217;
[0152] That is, determine whether the difference is greater than the source video duration, if so, proceed to step 216, if not, proceed to step 217;
[0153] Step 216: Determine that the difference is greater than the source video duration, and the target video still has freezes. Take the next frame of the last frame of this freeze as the starting point (as the starting point of the new target video), and return to step 26 (continue segmentation and matching).
[0154] Specifically, the difference between the target video duration (i.e., the actual playback duration of the target video) and the current freeze duration is compared with the source video duration. If the former is greater than the latter, it is determined that freeze still exists, and the next frame after the last freeze frame is used as the starting point until the last frame of the target video is used as the end point, and the process of cutting, comparison, judgment, and calculation is continued until it is determined that there is no freeze.
[0155] This solution can detect the freezes that exist during actual video playback.
[0156] Step 217: Determine that the difference is equal to the source video duration, and there is no other freeze, end the operation, and save the information;
[0157] Regarding "Save Information", specific information that can be saved can be related to the freeze, such as: freeze duration, freeze time point, freeze frame, etc.;
[0158] That is, if the target video duration is equal to the source video duration (there is no case where it is greater than the source video duration), it is determined that there is no freeze.
[0159] Later, you can save the time points, pictures (frame images), duration and other information of each freeze. This information can be used for subsequent reporting.
[0160] As can be seen from the above, in the scheme provided by the embodiment of the present invention, a source video for comparison and reference and a target video for actual playback are first constructed, and the target video is recorded during the playback of the source video. Compare the duration of the source video and the target video. If the duration of the target video is greater than that of the source video, it is determined that there is a freeze. Cut the video according to the idea of splitting in half, and compare the last frame of the first half of the cut video with the frame of the source video at the corresponding time point; if they are the same, it means that the freeze is in the second half of the video, and continue to split the second half of the video; if they are different, it means that there is a freeze in the first half of the video, and continue to split the first half of the video until the first frame of the freeze is found. Subsequently, the next frame corresponding to the first frame of the freeze in the source video is compared frame by frame with the back frame of the target video until the last frame of the freeze is found. Then, the duration between the first frame and the last frame of the freeze can be calculated as the freeze duration. Compare the difference between the target video and the freeze duration with the duration of the source video. If it is still greater than the source video, it is determined that there is still a freeze, and the segmentation continues. If they are the same, it means that there is no freeze, and the comparison ends.
[0161] It can also be understood that the solution provided by the embodiment of the present invention involves: starting from the target video, when it is determined that there is a freeze through duration comparison, the target video is first segmented, and then the last frame of the previous video after the segmentation is compared with the frame at the corresponding time point in the source video to determine whether it is the freeze start point (i.e., freeze start frame); after the freeze start point is determined, the next frame in the source video is continued, and the corresponding matching frame (i.e., freeze end point, also called freeze end frame) is found in the target video, and then the freeze duration can be calculated by the number of frames between the two detection frames in the target video (i.e., the freeze start frame and the freeze end frame mentioned above). In the embodiment of the present invention, the divided video can also be further split into several segments (at least two segments) according to the duration, which is not limited here.
[0162] In summary, the solution provided by the embodiment of the present invention can achieve:
[0163] 1) First, compare the playback time of the source video and the target video to determine whether there is a freeze. The benefit of adding this judgment link is to avoid comparing when there is no freeze in the target video, thus reducing the consumption of evaluation resources.
[0164] 2) By segmenting the video and then performing frame comparison, and starting the comparison from the first freeze, it avoids comparing resources for the normal playback part and reduces the workload of frame comparison.
[0165] 3) After determining the first frame of the freeze, select the next frame of the source video and compare it with the frame of the target video step by step, which minimizes the use of source video segmentation and frame comparison and reduces the workload of comparison.
[0166] 4) After a jam is identified, the time comparison is used to determine whether there is a jam, and further segmentation and comparison are performed, so that all jams can be detected with better accuracy.
[0167] In addition, the solution provided by the embodiment of the present invention only needs to perform local analysis after obtaining the source video and the target video, without the need for an additional network connection; the solution determines the stuck frame by comparing the frames after video cutting, which requires fewer working resources and is more efficient; the solution can intuitively obtain pictures and videos of the stuck process by locating the specific first and last frames of the stuck frame, which is closer to and in line with the user's perceptual experience.
[0168] The embodiment of the present invention also provides a data processing device, such as Figure 3 As shown, including:
[0169] A first segmentation module 31 is used to segment the target video into a front video segment and a rear video segment when there is a freeze in the target video;
[0170] A first acquisition module 32 is used to acquire a freeze start point in the target video from the previous video or the next video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video;
[0171] A second acquisition module 33 is used to acquire a freeze end point corresponding to the freeze start point in the target video according to the freeze start point;
[0172] A first processing module 34 is used to obtain the freeze information of the target video according to the freeze start point and the freeze end point;
[0173] The target video is video data obtained by actually playing the source video.
[0174] The data processing device provided by the embodiment of the present invention divides the target video into a front video and a back video when there is a freeze in the target video; obtains the freeze start point in the target video from the front video or the back video according to the last frame of the front video and the reference frame of the corresponding time point in the source video; obtains the freeze end point in the target video corresponding to the freeze start point according to the freeze start point; obtains the freeze information of the target video according to the freeze start point and the freeze end point; wherein the target video is the video data obtained according to the actual playback of the source video; it can realize the segmentation of the video based on the determination of freeze, locate the first frame of freeze by locating the last frame of the segmented video to the first frame of freeze, and then determine the last frame of freeze, thereby reducing the workload required for comparison, improving the comparison efficiency, and also improving the processing efficiency of the scheme; it well solves the problem of low processing efficiency of the data processing scheme for video freeze detection in the prior art. In addition, the scheme can cover all freezes that meet the preset standards, and the precision and accuracy of the processing results are better than the existing scheme.
[0175] Among them, the method of obtaining the freeze starting point in the target video from the previous video based on the last frame of the previous video and the reference frame at the corresponding time point in the source video includes: when the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video is a minimum segmentation unit; when the previous video is a minimum segmentation unit, using the last frame as the freeze starting point in the target video; when the previous video is not a minimum segmentation unit, using the previous video as a new target video, and returning to the method of segmenting the target video into the previous video and the next video until the freeze starting point is obtained.
[0176] In an embodiment of the present invention, the method of obtaining the freeze starting point in the target video from the latter video based on the last frame of the former video and the reference frame at the corresponding time point in the source video includes: when the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit; when the former video is not a minimum segmentation unit, taking the latter video as a new target video, and returning to the method of segmenting the target video into the former video and the latter video until the freeze starting point is obtained.
[0177] Among them, obtaining the freeze end point corresponding to the freeze starting point in the target video according to the freeze starting point includes: obtaining the freeze end point corresponding to the freeze starting point in the target video according to the next frame corresponding to the freeze starting point in the source video.
[0178] In an embodiment of the present invention, the method of obtaining a freeze start point in the target video from the latter video based on the last frame of the former video and a reference frame at a corresponding time point in the source video also includes: when the latter video is a minimum segmentation unit, using the starting point of the latter video as the freeze start point in the target video; and the method of obtaining a freeze end point in the target video corresponding to the freeze start point based on the freeze start point includes: using the ending point of the latter video corresponding to the starting point of the latter video as the freeze end point in the target video corresponding to the freeze start point.
[0179] Furthermore, the data processing device also includes: a third acquisition module, used to obtain a first difference between a second duration corresponding to the target video and a first duration corresponding to the source video before dividing the target video into a front video and a back video; a first determination module, used to determine that there is a freeze in the target video when the first difference is greater than or equal to a second threshold.
[0180] Among them, obtaining the freeze information of the target video according to the freeze starting point and the freeze ending point includes: obtaining the freeze frame number and the freeze image according to the freeze starting point and the freeze ending point; obtaining the freeze duration according to the freeze frame number and the frame rate actually used for playing the source video; obtaining the freeze information of the target video according to at least one of the freeze frame number, the freeze image and the freeze duration.
[0181] Furthermore, the data processing device also includes: a fourth acquisition module, which is used to obtain a second difference between a second duration corresponding to the target video and the freeze duration in the freeze information after obtaining the freeze information of the target video according to the freeze start point and the freeze end point; a second processing module, which is used to use the video after the freeze end point in the target video as a new target video and the video after the frame corresponding to the freeze end point in the source video as a new source video when the second difference is greater than the first duration corresponding to the source video, and return the method of dividing the target video into a front video and a back video.
[0182] Among them, the implementation embodiments of the above-mentioned data processing method are all applicable to the embodiments of the data processing device and can achieve the same technical effects.
[0183] The embodiment of the present invention also provides a data processing device, such as Figure 4 As shown, it includes: a processor 41;
[0184] The processor 41 is used for dividing the target video into a front video segment and a rear video segment when there is a freeze in the target video;
[0185] Obtaining a freeze start point in the target video from the previous video or the next video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video;
[0186] According to the freeze starting point, obtaining a freeze ending point in the target video corresponding to the freeze starting point;
[0187] Obtaining the freeze information of the target video according to the freeze start point and the freeze end point;
[0188] The target video is video data obtained by actually playing the source video.
[0189] Of course, in the embodiment of the present invention, the data processing device may further include a transceiver for communicating with the processor, which is not limited here.
[0190] The data processing device provided by the embodiment of the present invention divides the target video into a front video and a back video when there is a freeze in the target video; obtains the freeze start point in the target video from the front video or the back video according to the last frame of the front video and the reference frame of the corresponding time point in the source video; obtains the freeze end point in the target video corresponding to the freeze start point according to the freeze start point; obtains the freeze information of the target video according to the freeze start point and the freeze end point; wherein the target video is the video data obtained according to the actual playback of the source video; it can realize the segmentation of the video based on the determination of freeze, locate the first frame of freeze by locating the last frame of the segmented video to the first frame of freeze, and then determine the last frame of freeze, thereby reducing the workload required for comparison, improving the comparison efficiency, and also improving the processing efficiency of the scheme; it well solves the problem of low processing efficiency of the data processing scheme for video freeze detection in the prior art. In addition, the scheme can cover all freezes that meet the preset standards, and the precision and accuracy of the processing results are better than the existing scheme.
[0191] Among them, the method of obtaining the freeze starting point in the target video from the previous video based on the last frame of the previous video and the reference frame at the corresponding time point in the source video includes: when the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video is a minimum segmentation unit; when the previous video is a minimum segmentation unit, using the last frame as the freeze starting point in the target video; when the previous video is not a minimum segmentation unit, using the previous video as a new target video, and returning to the method of segmenting the target video into the previous video and the next video until the freeze starting point is obtained.
[0192] In an embodiment of the present invention, the method of obtaining the freeze starting point in the target video from the latter video based on the last frame of the former video and the reference frame at the corresponding time point in the source video includes: when the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit; when the former video is not a minimum segmentation unit, taking the latter video as a new target video, and returning to the method of segmenting the target video into the former video and the latter video until the freeze starting point is obtained.
[0193] Among them, obtaining the freeze end point corresponding to the freeze starting point in the target video according to the freeze starting point includes: obtaining the freeze end point corresponding to the freeze starting point in the target video according to the next frame corresponding to the freeze starting point in the source video.
[0194] In an embodiment of the present invention, the method of obtaining a freeze start point in the target video from the latter video based on the last frame of the former video and a reference frame at a corresponding time point in the source video also includes: when the latter video is a minimum segmentation unit, using the starting point of the latter video as the freeze start point in the target video; and the method of obtaining a freeze end point in the target video corresponding to the freeze start point based on the freeze start point includes: using the ending point of the latter video corresponding to the starting point of the latter video as the freeze end point in the target video corresponding to the freeze start point.
[0195] Furthermore, the processor is also used to: before dividing the target video into a front video and a back video, obtain a first difference between a second duration corresponding to the target video and a first duration corresponding to the source video; when the first difference is greater than or equal to a second threshold, determine that there is a freeze in the target video.
[0196] Among them, obtaining the freeze information of the target video according to the freeze starting point and the freeze ending point includes: obtaining the freeze frame number and the freeze image according to the freeze starting point and the freeze ending point; obtaining the freeze duration according to the freeze frame number and the frame rate actually used for playing the source video; obtaining the freeze information of the target video according to at least one of the freeze frame number, the freeze image and the freeze duration.
[0197] Furthermore, the processor is also used to: after obtaining the freeze information of the target video according to the freeze start point and the freeze end point, obtain a second difference between a second duration corresponding to the target video and the freeze duration in the freeze information; when the second difference is greater than the first duration corresponding to the source video, use the video after the freeze end point in the target video as a new target video, and use the video after the frame corresponding to the freeze end point in the source video as a new source video, and return to the method of dividing the target video into a front video and a back video.
[0198] Among them, the implementation embodiments of the above-mentioned data processing method are all applicable to the embodiments of the data processing device and can achieve the same technical effects.
[0199] An embodiment of the present invention further provides a data processing device, comprising a memory, a processor, and a program stored in the memory and executable on the processor; when the processor executes the program, the above-mentioned data processing method is implemented.
[0200] Among them, the implementation embodiments of the above-mentioned data processing method are all applicable to the embodiments of the data processing device and can achieve the same technical effects.
[0201] An embodiment of the present invention further provides a readable storage medium on which a program is stored. When the program is executed by a processor, the steps in the above-mentioned data processing method are implemented.
[0202] Among them, the implementation embodiments of the above-mentioned data processing method are all applicable to the embodiments of the readable storage medium and can achieve the same technical effects.
[0203] It should be noted that many functional components described in this specification are referred to as modules in order to more particularly emphasize the independence of their implementation methods.
[0204] In the embodiment of the present invention, module can be implemented with software so that it can be executed by various types of processors. For example, an executable code module of an identification can include one or more physical or logical blocks of computer instructions, for example, it can be constructed as an object, process or function. Nevertheless, the executable code of the identified module does not need to be physically located together, but can include different instructions stored in different positions, and when these instructions are logically combined together, it constitutes a module and realizes the specified purpose of the module.
[0205] In fact, executable code module can be a single instruction or many instructions, and can even be distributed on a plurality of different code segments, distributed among different programs, and distributed across a plurality of memory devices. Similarly, operating data can be identified in the module, and can be implemented and organized in the data structure of any appropriate type according to any appropriate form. The operating data can be collected as a single data set, or can be distributed in different locations (including on different storage devices), and can only be present on a system or network as an electronic signal at least in part.
[0206] When a module can be implemented by software, considering the level of existing hardware technology, a person skilled in the art can build a corresponding hardware circuit to implement the corresponding function of the module that can be implemented by software without considering the cost. The hardware circuit includes a conventional very large scale integration (VLSI) circuit or gate array and existing semiconductors such as logic chips, transistors, or other discrete components. The module can also be implemented by a programmable hardware device, such as a field programmable gate array, a programmable array logic, a programmable logic device, etc.
[0207] The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary personnel in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims
1. A data processing method, characterized in that: include: When the target video is stuck, the target video is divided into a front video segment and a back video segment; Obtaining a freeze start point in the target video from the previous video or the next video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video; According to the freeze starting point, obtaining a freeze ending point in the target video corresponding to the freeze starting point; Obtaining the freeze information of the target video according to the freeze start point and the freeze end point; Wherein, the target video is the video data obtained by actually playing the source video; The obtaining the freeze starting point in the target video from the previous video according to the last frame of the previous video and the reference frame at the corresponding time point in the source video includes: When the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video segment is a minimum segmentation unit; In the case where the previous video is the smallest segmentation unit, the last frame is used as a freeze start point in the target video; In the case that the front video segment is not the minimum segmentation unit, the front video segment is used as a new target video, and the target video segmentation is returned to the step of segmenting the target video into the front video segment and the back video segment until a freeze start point is obtained; or The obtaining the freeze starting point in the target video from the latter video according to the last frame of the former video and the reference frame at the corresponding time point in the source video includes: When the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit; In the case that the latter video is not the minimum segmentation unit, the latter video is used as a new target video, and the process of segmenting the target video into the former video and the latter video is returned until a freeze starting point is obtained.
2. The data processing method according to claim 1, characterized in that: The acquiring, according to the freeze starting point, a freeze ending point in the target video corresponding to the freeze starting point includes: According to the next frame corresponding to the freeze starting point in the source video, a freeze ending point corresponding to the freeze starting point in the target video is obtained.
3. The data processing method according to claim 1, characterized in that: The method of obtaining the freeze start point in the target video from the latter video according to the last frame of the former video and the reference frame at the corresponding time point in the source video further includes: When the latter video is a minimum segmentation unit, taking the starting point of the latter video as the freeze starting point in the target video; The acquiring, according to the freeze starting point, a freeze ending point in the target video corresponding to the freeze starting point includes: The end point of the latter video corresponding to the start point of the latter video is used as the freeze end point in the target video corresponding to the freeze start point.
4. The data processing method according to claim 1, characterized in that: Before the target video is segmented into a front video segment and a rear video segment, the method further includes: Obtaining a first difference between a second duration corresponding to the target video and a first duration corresponding to the source video; When the first difference is greater than or equal to a second threshold, it is determined that there is a freeze in the target video.
5. The data processing method according to claim 1, characterized in that: The obtaining the freeze information of the target video according to the freeze start point and the freeze end point includes: According to the freeze start point and the freeze end point, the freeze frame number and the freeze image are obtained; Obtaining a freeze duration according to the freeze frame number and a frame rate actually used for playing the source video; Obtain the freeze information of the target video according to at least one of the freeze frame number, the freeze image and the freeze duration.
6. The data processing method according to claim 1, characterized in that: After obtaining the jam information of the target video according to the jam start point and the jam end point, the method further includes: Obtaining a second difference between a second duration corresponding to the target video and the freeze duration in the freeze information; When the second difference is greater than the first duration corresponding to the source video, the video after the freeze end point in the target video is used as the new target video, and the video after the frame corresponding to the freeze end point in the source video is used as the new source video, and the method of dividing the target video into the front video and the back video is returned.
7. A data processing device, characterized in that: include: A first segmentation module, used for segmenting the target video into a front video segment and a rear video segment when there is a freeze in the target video; A first acquisition module, configured to acquire a freeze start point in the target video from the preceding video or the succeeding video according to the last frame of the preceding video and a reference frame at a corresponding time point in the source video; A second acquisition module is used to acquire a freeze end point corresponding to the freeze start point in the target video according to the freeze start point; A first processing module, configured to obtain the freeze information of the target video according to the freeze start point and the freeze end point; Wherein, the target video is the video data obtained by actually playing the source video; The obtaining the freeze starting point in the target video from the previous video according to the last frame of the previous video and the reference frame at the corresponding time point in the source video includes: When the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video segment is a minimum segmentation unit; In the case where the previous video is the smallest segmentation unit, the last frame is used as a freeze start point in the target video; In the case that the front video segment is not the minimum segmentation unit, the front video segment is used as a new target video, and the target video segmentation is returned to the step of segmenting the target video into the front video segment and the back video segment until a freeze start point is obtained; or The obtaining the freeze starting point in the target video from the latter video according to the last frame of the former video and the reference frame at the corresponding time point in the source video includes: When the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit; In the case that the latter video is not the minimum segmentation unit, the latter video is used as a new target video, and the process of segmenting the target video into the former video and the latter video is returned until a freeze starting point is obtained.
8. The data processing device according to claim 7, characterized in that: The acquiring, according to the freeze starting point, a freeze ending point in the target video corresponding to the freeze starting point includes: According to the next frame corresponding to the freeze starting point in the source video, a freeze ending point corresponding to the freeze starting point in the target video is obtained.
9. The data processing device according to claim 7, characterized in that: The method of obtaining the freeze start point in the target video from the latter video according to the last frame of the former video and the reference frame at the corresponding time point in the source video further includes: When the latter video is a minimum segmentation unit, taking the starting point of the latter video as the freeze starting point in the target video; The acquiring, according to the freeze starting point, a freeze ending point in the target video corresponding to the freeze starting point includes: The end point of the latter video corresponding to the start point of the latter video is used as the freeze end point in the target video corresponding to the freeze start point.
10. The data processing device according to claim 7, characterized in that: Also includes: A third acquisition module is used to acquire a first difference between a second duration corresponding to the target video and a first duration corresponding to the source video before dividing the target video into a front video segment and a rear video segment; The first determination module is used to determine that there is a freeze in the target video when the first difference is greater than or equal to a second threshold.
11. The data processing device according to claim 7, characterized in that: The obtaining the freeze information of the target video according to the freeze start point and the freeze end point includes: According to the freeze start point and the freeze end point, the freeze frame number and the freeze image are obtained; Obtaining a freeze duration according to the freeze frame number and a frame rate actually used for playing the source video; Obtain the freeze information of the target video according to at least one of the freeze frame number, the freeze image and the freeze duration.
12. The data processing device according to claim 7, characterized in that: Also includes: A fourth acquisition module is used to obtain a second difference between a second duration corresponding to the target video and the freeze duration in the freeze information after obtaining the freeze information of the target video according to the freeze start point and the freeze end point; A second processing module is used to use the video after the freeze end point in the target video as a new target video when the second difference is greater than the first duration corresponding to the source video, and use the video after the frame corresponding to the freeze end point in the source video as a new source video, and return the method of dividing the target video into a front video and a back video.
13. A data processing device, characterized in that: include: processor; The processor is used to divide the target video into a front video segment and a rear video segment when there is a freeze in the target video; Obtaining a freeze start point in the target video from the previous video or the next video according to the last frame of the previous video and a reference frame at a corresponding time point in the source video; According to the freeze starting point, obtaining a freeze ending point in the target video corresponding to the freeze starting point; Obtaining the freeze information of the target video according to the freeze start point and the freeze end point; Wherein, the target video is the video data obtained by actually playing the source video; The obtaining the freeze starting point in the target video from the previous video according to the last frame of the previous video and the reference frame at the corresponding time point in the source video includes: When the similarity between the last frame and the reference frame is less than a first threshold, confirming whether the previous video segment is a minimum segmentation unit; In the case where the previous video is the smallest segmentation unit, the last frame is used as a freeze start point in the target video; In the case that the front video segment is not the minimum segmentation unit, the front video segment is used as a new target video, and the target video segmentation is returned to the step of segmenting the target video into the front video segment and the back video segment until a freeze start point is obtained; or The obtaining the freeze starting point in the target video from the latter video according to the last frame of the former video and the reference frame at the corresponding time point in the source video includes: When the similarity between the last frame and the reference frame is greater than or equal to a first threshold, confirming whether the latter video is a minimum segmentation unit; In the case that the latter video is not the minimum segmentation unit, the latter video is used as a new target video, and the process of segmenting the target video into the former video and the latter video is returned until a freeze starting point is obtained.
14. A data processing device comprising a memory, a processor, and a program stored in the memory and executable on the processor; characterized in that: When the processor executes the program, the data processing method according to any one of claims 1 to 6 is implemented.
15. A readable storage medium having a program stored thereon, characterized in that: When the program is executed by a processor, the steps in the data processing method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Key frame identification method and device
CN107147947A
Method and equipment for positioning video playing lag
CN111327964A