Video detection method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a video detection method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining a first video; video detection is carried out based on the first video, at least one second video and reference information corresponding to the second video are obtained, the second video comprises at least one target video clip, the target video clip is associated with the first video, and the reference information represents the playing position of the target video clip in the second video; and synchronously playing the first video clip in the first video and the target video clip in the corresponding second video in the target interface based on the reference information. Detection is performed based on the first video to obtain the second video and the reference information, and then the first video clip in the first video and the target video clip in the second video are played at the same time based on the reference information, so that the purpose of contrasting and displaying similar clips in the videos is achieved, the interaction process is simplified, and the video detection efficiency is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of Internet technology, and in particular to a video detection method, device, electronic device, and storage medium. Background Art

[0002] With the rise of user-generated content (UGC), a large number of self-made videos have been uploaded by users on various Internet platforms. On the one hand, the rich self-made videos enable platform users to obtain a variety of interesting content and improve the user experience, but on the other hand, self-made videos may contain abnormal content materials, resulting in security issues.

[0003] In the prior art, for homemade videos uploaded by users, video platforms usually perform manual frame-by-frame comparison to detect the homemade videos, so as to determine whether the homemade videos contain abnormal content. However, the solutions for detecting homemade videos in the prior art require manual video synchronization and comparison, which has the problems of complex interaction process and low detection efficiency. Summary of the invention

[0004] The embodiments of the present disclosure provide a video detection method, device, electronic device and storage medium to overcome the problems of complex verification interaction process and low detection efficiency.

[0005] In a first aspect, an embodiment of the present disclosure provides a video detection method, including:

[0006] Acquire a first video; perform video detection based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video contains at least one target video segment, the target video segment is associated with the first video, and the reference information represents the playback position of the target video segment in the second video; based on the reference information, synchronously play the first video segment in the first video and the corresponding target video segment in the second video in a target interface.

[0007] In a second aspect, an embodiment of the present disclosure provides a video detection device, including:

[0008] An acquisition module, used for acquiring a first video;

[0009] a processing module, configured to perform video detection based on the first video, obtain at least one second video and reference information corresponding to the second video, wherein the second video includes at least one target video segment, the target video segment is associated with the first video, and the reference information represents a playback position of the target video segment in the second video;

[0010] An interactive module is used to synchronously play the first video segment in the first video and the corresponding target video segment in the second video in a target interface based on the reference information.

[0011] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:

[0012] A processor, and a memory communicatively connected to the processor;

[0013] The memory stores computer-executable instructions;

[0014] The processor executes the computer-executable instructions stored in the memory to implement the video detection method as described in the first aspect and various possible designs of the first aspect.

[0015] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer execution instructions are stored. When a processor executes the computer execution instructions, the video detection method described in the first aspect and various possible designs of the first aspect is implemented.

[0016] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the video detection method as described in the first aspect and various possible designs of the first aspect.

[0017] The video detection method, device, electronic device and storage medium provided in this embodiment obtain a first video; perform video detection based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video contains at least one target video segment, the target video segment is associated with the first video, and the reference information represents the playback position of the target video segment in the second video; based on the reference information, the first video segment in the first video and the corresponding target video segment in the second video are synchronously played in the target interface. By performing detection based on the first video, a second video containing a similar segment and reference information representing the playback position of the similar segment are obtained, and then the first video segment in the first video and the target video segment in the second video are simultaneously played based on the reference information, thereby achieving the purpose of comparing and displaying similar segments in the video, realizing rapid detection and display of similar segments, simplifying the interaction process, and improving video detection efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0019] Figure 1 A diagram of an application scenario of the video detection method provided in an embodiment of the present disclosure;

[0020] Figure 2 The process diagram of the video detection method provided by the embodiment of the present disclosure is as follows: Figure 1 ;

[0021] Figure 3 for Figure 2 A flowchart of a specific implementation method of step S102 in the illustrated embodiment;

[0022] Figure 4 for Figure 3 A flowchart of a specific implementation method of step S1021 in the illustrated embodiment;

[0023] Figure 5 A schematic diagram of a process of selecting a target image frame provided by an embodiment of the present disclosure;

[0024] Figure 6 for Figure 3 A flowchart of a specific implementation method of step S1022 in the illustrated embodiment;

[0025] Figure 7 A schematic diagram of a process for detecting a video to be detected provided by an embodiment of the present disclosure;

[0026] Figure 8 The process diagram of the video detection method provided by the embodiment of the present disclosure is as follows: Figure 2 ;

[0027] Fig. 9 A schematic diagram of a first playback control and a second playback control provided in an embodiment of the present disclosure;

[0028] Fig.10 for Figure 8 A flowchart of a specific implementation method of step S204 in the illustrated embodiment;

[0029] Fig.11 A schematic diagram of a process for synchronously moving control elements provided by an embodiment of the present disclosure;

[0030] Fig.12 A structural block diagram of a video detection device provided in an embodiment of the present disclosure;

[0031] Fig.13 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure;

[0032] Fig.14 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0033] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0034] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0035] The application scenarios of the embodiments of the present disclosure are explained below:

[0036] Figure 1 FIG. 1 is an application scenario diagram of the video detection method provided in the embodiment of the present disclosure. The video detection method provided in the embodiment of the present disclosure can be applied to the application scenario of video detection in the video platform. Specifically, Figure 1 As shown, the method provided by the embodiment of the present disclosure can be applied to electronic devices with computing capabilities such as terminal devices, and the above electronic devices can display images through their own display screens or through external devices connected to them for communication. Figure 1 As shown in , the video detection method provided by the embodiment of the present disclosure can be executed by a terminal device, and the terminal device communicates with the platform server. On the one hand, the terminal device obtains a first video as a reference video through a storage medium directly connected to it and by accessing the Internet. On the other hand, the terminal device sends a detection request to the platform server to detect the homemade video stored in the platform server based on the first video, and obtain a second video containing the video content in the first video. The second video is, for example, a problematic video containing abnormal content. After that, the server transmits the second video back to the terminal device side for display. The user on the platform side further determines whether the second video is normal by comparing the second video with the first video, and performs corresponding processing.

[0037] In the prior art, for homemade videos uploaded by users, in order to detect whether the videos contain abnormal content materials, in addition to automatic detection based on image recognition technology, considering the purpose and extent of the use of content materials in homemade videos, it is usually necessary to further detect the homemade videos through manual inspection, and then perform subsequent processing. However, in the scheme for detecting videos in the prior art, after the detected video containing abnormal content materials is displayed on the terminal device side, the platform staff needs to manually check the image frames in the video and compare them with the corresponding image frames in the control video, which leads to the problems of complex inspection interaction process and low detection efficiency. The disclosed embodiments provide a video detection method to solve the above problems.

[0038] refer to Figure 2 , Figure 2 The process diagram of the video detection method provided by the embodiment of the present disclosure is as follows: Figure 1 The method of this embodiment can be applied in a terminal device, such as a personal computer. The video detection method includes:

[0039] Step S101: Acquire a first video.

[0040] Step S102: Perform video detection based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video contains at least one target video segment, the target video segment is associated with the first video, and the reference information represents the playback position of the target video segment in the second video.

[0041] For example, reference Figure 1In the application scenario schematic diagram shown, after the terminal device obtains the first video based on the user operation, it first parses the first video to obtain the image features corresponding to at least one image frame in the first video. After that, by accessing the server for storing the video to be detected and detecting the video to be detected, at least one second video and reference information corresponding to the second video can be obtained, wherein the second video is the video to be detected that may contain abnormal content. The second video contains at least one target video segment, and the target video segment is associated with the first video, that is, the target video segment is a similar segment of the first video segment in the first video, that is, the target video segment has a high degree of similarity with the first video segment in the first video. It should be noted that the similar segments in this embodiment refer to the video contents in the two video segments being similar. More specifically, for example, if the two video segments contain at least one image frame showing the same screen content, the two video segments are similar segments. In the steps of this embodiment, the image features of at least one image frame in the first video can be obtained, and the special effects features of the image frames in the video to be detected can be compared based on the image features, so as to determine the similar image frames, and then the video segments containing the similar image frames can be determined as the similar segments of the first video segments, that is, the target video segments. Furthermore, the video to be detected that includes the target video segment is determined as the second video.

[0042] Furthermore, while obtaining the second video through checking, reference information corresponding to the second video is generated, wherein the reference information represents the playback position of the target video segment similar to the first video segment in the first video in the second video. Specifically, for example, the reference information may include the start time and end time of the target video segment in the second video. Further, optionally, the reference information may also include the total duration of the second video, and / or, the reference information may also include the ratio of the start time of the target video segment to the total duration, and the ratio of the end time to the total duration. Further, in addition to the above implementation, the reference information may also include the playback position corresponding to each image frame of the target video segment in the second video, such as the playback timestamp corresponding to each image frame. The reference information obtained in the steps of this embodiment can be used to locate the target video segment in the second video, thereby achieving synchronous playback of the target video segment and the first video segment in subsequent steps.

[0043] In one possible implementation, Figure 3 As shown, the specific implementation of step S102 includes:

[0044] Step S1021: Acquire a target image frame in the first video.

[0045] Step S1022: Detect at least one video to be detected based on the target image frame to obtain at least one second video, wherein the second video at least includes a matching image frame corresponding to the target image frame, and the image similarity between the matching image frame and the target image frame is greater than a first threshold.

[0046] Step S1023: based on the playback timestamp of the matching image frame, obtain reference information corresponding to the second video.

[0047] Exemplarily, first, by parsing the first video, the target image frame in the first video is obtained, and the target image frame is, for example, one or more key frames in the first video; then, based on the above target image frame, the video to be detected is detected, and the video to be detected is, for example, the self-made video by the user in the platform. Specifically, by comparing the target video frame with the image frame in the video to be detected, the image frame in the video to be detected whose image similarity is greater than the first threshold is determined as a matching image frame, and then the video to be detected containing one or more matching image frames is determined as the second video. Afterwards, based on the playback timestamp of the matching image frame obtained in the above steps, the reference information corresponding to the second video is generated, that is, the reference information contains the playback timestamps of all matching image frames in the second video. Among them, exemplarily, the specific implementation method of comparing the target video frame with the image frame in the video to be detected to obtain the image similarity can be realized by, for example, performing feature comparison between the target video frame and the image frame in the video to be detected through a pre-trained neural network model, and the specific implementation method is the prior art and will not be repeated.

[0048] Furthermore, the target image frame in the first video may be specified based on a manual operation of the user or determined based on historical detection results. Figure 4 As shown, the specific implementation of step S1021 includes:

[0049] Step S1021A: Obtain the number of hits of at least one key frame in the first video, where the number of hits is the number of times a key frame is detected to have a corresponding matching image frame.

[0050] Step S1021B: determine the key frame with a hit count greater than the first number as the target image frame.

[0051] Exemplarily, first, a detection record corresponding to the first video is obtained, and the detection record records the historical results of detecting the first video based on the method provided in this embodiment. Further, exemplarily, the detection record includes the corresponding hit counts of each key frame in the first video, and the hit counts are the number of times the key frame is detected to have a corresponding matching image frame. According to the detection record corresponding to the first video, the key frame whose hit count is greater than the first number is determined as the target image frame, or the N key frames with the largest hit counts are determined as the target image frames. Figure 5 A schematic diagram of a process of selecting a target image frame provided by an embodiment of the present disclosure, such as Figure 5 As shown, based on the detection records, the number of hits corresponding to all key frames in the first video (shown as I_1 to I_n in the figure) can be obtained. For example, as shown in the figure, the number of hits corresponding to I_1 = 8, the number of hits corresponding to I_2 = 168; the number of hits corresponding to I_3 = 3; the number of hits corresponding to I_4 = 721. Taking the I_1 frame as an example, its meaning is: in the historical detection process corresponding to the previously specified time, the I_1 frame is used to detect the video to be detected, and a total of 8 videos are detected containing the image content corresponding to the I_1 frame, that is, 8 videos to be detected containing matching image frames. Other frames are similar and will not be repeated. The key frames with a hit count greater than 100, namely, the I_2 frame and the I_4 frame, are determined as target image frames. In subsequent steps, the video to be detected is detected to obtain at least one second video.

[0052] Further, the target image frame includes at least two consecutive key frames in the first video, for example, Figure 6 As shown, the specific implementation of step S1022 includes:

[0053] Step S1022A: Based on the time interval between at least two consecutive key frames, a corresponding number of second image frames in the video to be detected are obtained.

[0054] Step S1022B: obtaining image similarity between the key frame and the corresponding second image frame, and if the number of second image frames whose image similarity is greater than the first threshold is greater than the second number, determining the video to be detected corresponding to the second image frame as the second video.

[0055] For example, Figure 7 A schematic diagram of a process for detecting a video to be detected provided by an embodiment of the present disclosure is shown below. Figure 7The above process is introduced. As shown in the figure, the first video determined based on the previous steps includes three consecutive key frames (target image frames), namely I_1 frame, I_2 frame and I_3 frame (shown as I_1, I_2 and I_3 in the figure). Since there are non-key frames between the key frames, there are two corresponding time intervals between I_1 frame, I_2 frame and I_3 frame, namely time interval T1 and time interval T2 (shown as T1 and T2 in the figure). Afterwards, based on the time interval T1 and time interval T2, the corresponding number of second image frames in the video to be detected are obtained, and the key frames in the first video are compared with the second image frames in the second video one by one to obtain the image similarity between the key frames and the second image frames, and then the second video is determined.

[0056] For example, in this embodiment, the number of the second image frames is the same as that of the above key frames (3). Specifically, starting from the head of the video to be processed, based on the above time interval T1 and time interval T2, 3 second image frames can be obtained, such as the i_01 frame, i_02 frame and i_03 frame shown in the figure (shown as i_01, i_02 and i_03 in the figure). Afterwards, multiple translations are performed based on the preset interval (for example, the time interval between every two image frames is the preset interval) to obtain multiple groups of second image frames with intervals of time intervals T1 and time intervals T2. For example, as shown in the figure, after one translation, another group of second image frames i_11 frame, i_12 frame and i_13 frame (shown as i_11, i_12 and i_13 in the figure) with intervals of the same time intervals T1 and time intervals T2 are obtained, until the preset end condition is reached, or the end of the video to be detected is reached. That is, the last group of second image frames shown in the figure are i_n1 frame, i_n2 frame and i_n3 frame (shown as i_n1, i_n2 and i_n3 in the figure).

[0057] Further, after each group of second image frames is obtained, the key frames in the first video are respectively compared with the corresponding second image frames for similarity to obtain the corresponding image similarity. For example, the I_1 frame and the i_1 frame, the I_2 frame and the i_2 frame, and the I_3 frame and the i_3 frame are respectively compared to obtain the corresponding image similarities S1, S2 and S3. Exemplarily, the image similarity can be a normalized value, that is, greater than 0 and less than or equal to 1. The greater the image similarity, the more similar the two frames of image are. The second image frame whose image similarity is greater than the first threshold (for example, 0.8) is determined as a similar frame. When the number of similar frames is greater than the second number (for example, 2), it is determined that the segment composed of the i_1 frame, the i_2 frame and the i_3 frame in the video to be detected is a similar segment of the first video segment in the first video, and then the video to be detected corresponding to the above second image frame is determined as the second video. The second number may be a preset value or a number determined based on the number of key frames constituting the target image frame. For example, if the number of at least two consecutive key frames constituting the target image frame is N, the second number is N / 2.

[0058] In this embodiment, multiple consecutive key frames in the first video are used as detection controls, and the characteristic that at least two consecutive key frames in the first video have different time intervals is utilized to perform accurate multi-point detection on the processed video, thereby improving the credibility of the detected similar segments, improving the detection accuracy, and reducing the probability of false detection.

[0059] Step S103: Based on the reference information, the first video segment in the first video and the corresponding target video segment in the second video are synchronously played in the target interface.

[0060] Exemplarily, based on the previous steps, after obtaining the second video containing similar segments and the corresponding reference information, the first video segment in the first video and the target video segment in the second video are synchronously played on the target interface in the application running on the terminal device. Specifically, in the process of obtaining the second video and the corresponding reference information through the above steps, the terminal device will record the first video segment used when the target video segment in the second video is detected, and the playback position in the first video. The playback position includes, for example, the start position and end position of the first video segment, or the playback timestamp of each image frame corresponding to the target video segment in the first video segment. In a possible implementation, the playback position corresponding to the first video segment is also stored in the reference information, or is stored in a local or cloud storage medium by other means. After that, the terminal device automatically locates to the start position of the first video segment and the start position of the target video segment based on the playback position corresponding to the first video segment and the playback position of the target video segment represented by the reference information, and synchronously starts to play the first video segment and the target video segment, thereby realizing the comparative display of the first video segment and the target video segment. Afterwards, the user can manually determine whether the first video clip and the target video clip are completely consistent based on the comparative display of the two in the target interface, or whether the second video contains abnormal information, and process the second video to realize the manual inspection process of the self-made video.

[0061] In a possible implementation, before step S103, the method further includes:

[0062] Step S1001: obtaining a speed change coefficient corresponding to a target video segment, where the speed change coefficient represents a video content playback rate of the target video segment relative to a first video segment.

[0063] Step S1002: Obtain a target playback speed of the first video clip according to the speed change coefficient.

[0064] Correspondingly, a specific implementation of step S103 includes: playing the first video segment in the first video based on the target playback speed in the target interface.

[0065] Exemplarily, the speed coefficient corresponding to the target video segment represents the playback rate of the video content of the target video segment relative to the first video segment. For example, when the speed coefficient is 2, it represents that the playback rate of the target video segment is twice that of the first video segment, that is, the target video segment has been processed by fast-forward speed change. At the same time, since the target video segment and the first video segment have the same video content, the duration of the target video segment is half of that of the first video segment. For another example, when the speed coefficient is 0.5, it represents that the playback rate of the target video segment is half of that of the first video segment, and the duration of the target video segment is twice that of the first video segment.

[0066] If the target video segment has been speed-changed, its playback rate under normal playback conditions will be different from that of the first video segment, making it difficult for the two to be played synchronously. To address this issue, after determining the target video segment based on the video content, the terminal device can compare the duration of the target video segment with that of the first video segment based on the duration of the target video segment, thereby obtaining a speed-changed coefficient. Then, when playing the first video segment, the speed-changed playback is performed based on the speed-changed coefficient, thereby making the playback speed of the target video segment consistent with that of the first video segment, thereby achieving synchronous playback of the two. Of course, in another possible implementation, the target video segment can also be played in the opposite direction based on the speed-changed coefficient, thereby making the playback rates of the first video segment and the target video segment the same, thereby achieving synchronous playback of the two. No specific restrictions are made here.

[0067] In this embodiment, a first video is obtained; video detection is performed based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video contains at least one target video segment, the target video segment is associated with the first video, and the reference information represents the playback position of the target video segment in the second video; based on the reference information, the first video segment in the first video and the corresponding target video segment in the second video are synchronously played in the target interface. By performing detection based on the first video, a second video containing a similar segment and reference information representing the playback position of the similar segment are obtained, and then the first video segment in the first video and the target video segment in the second video are simultaneously played based on the reference information, thereby achieving the purpose of comparing and displaying similar segments in the video, realizing rapid detection and display of similar segments, simplifying the interaction process, and improving video detection efficiency.

[0068] refer to Figure 8 , Figure 8 The process diagram of the video detection method provided by the embodiment of the present disclosure is as follows: Figure 2 In this embodiment Figure 2 On the basis of the illustrated embodiment, step S103 is further refined, and the video detection method includes:

[0069] Step S201: Obtain a first video.

[0070] Step S202: Perform video detection based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video contains at least one target video segment, the target video segment is associated with the first video, and the reference information represents the playback position of the target video segment in the second video.

[0071] Step S203: Based on the reference information, a play interval identifier of the target video segment in the second video is displayed in the second play control of the target interface, where the play interval identifier is used to represent the start position and the end position of the target video segment in the second video.

[0072] Exemplarily, the target interface is provided with a first playback control corresponding to the first video and / or a second playback control corresponding to the second video. In a possible implementation, the first playback control is used to control the playback of the first video, specifically, for example, to control the playback start, playback pause, jump (seek) playback, etc. of the first video, wherein the first playback control may include a video playback area for playing the first video and a control area for setting functional controls. The second playback control has the same functions as the first playback control; the appearance layout of the second playback control may be the same as or different from the first playback control, and may be set based on specific needs. The implementation of the functions and appearance layout of the second playback control will not be repeated here, and reference may be made to the introduction of the first playback control.

[0073] Optionally, on the other hand, the method of this embodiment further includes: based on the playback position of the first video clip, displaying the playback interval mark of the target video clip in the first video in the first playback control of the target interface, the playback interval mark is used to represent the start position and end position of the first video clip in the first video. That is, the first playback control can achieve the same function as the second playback control, and the details are not repeated here.

[0074] Fig. 9 A schematic diagram of a first playback control and a second playback control provided in an embodiment of the present disclosure, such as Fig. 9 As shown, in the target interface, the first play control is used to play the first video, and the second play control is used to play the second video. After obtaining the corresponding reference information and the play position corresponding to the first video, the second play interval mark of the target video segment in the second video is displayed in the second play control based on the reference information. The second play interval mark is used to represent the starting position (00:35 in the figure, indicating the 35th second of the second video) and the ending position (00:42 in the figure, indicating the 42nd second of the second video) of the target video segment in the second video. Based on the play position of the first video segment, the first play interval mark of the first video segment in the first video is displayed in the first play control. The first play interval mark is used to represent the starting position (03:10 in the figure, indicating the 03rd minute and 10th second of the first video) and the ending position (03:17 in the figure, indicating the 03rd minute and 17th second of the second video) of the first video segment in the first video.

[0075] In the steps of this embodiment, by displaying the corresponding playback interval mark in the first playback control and / or the second playback control, the proportion of similar segments in the first video and / or the second video is displayed. Optionally, in the first playback control and / or the second playback control, the proportion of the duration represented by the playback interval mark in the total duration of the entire first video and / or the second video can also be displayed. For example, "12%" is displayed in the first playback control, indicating that the duration of the first video segment accounts for 12% of the total duration of the first video. Thus, the proportion of similar videos can be displayed more accurately.

[0076] Step S204: In response to the first jump operation on the second play interval identifier corresponding to the target video segment, a first play position corresponding to the second video and a second play position corresponding to the first video are obtained.

[0077] Further, exemplarily, the first playback control is used to jump to play the first target content in the first video clip in response to the first trigger operation; the second playback control is used to play the same first target content in the target video clip in response to the first trigger operation, and the first trigger operation is an operation on the first playback control or the second playback control. That is, when the user triggers either the first playback control or the second playback control by operating the terminal device to play the first target content, the other playback control will be automatically triggered synchronously and play the first target content at the same time, so that the first video clip and the target video clip are played synchronously, and the synchronous display of similar clips is realized.

[0078] Optionally, the first playback control includes a movable first control element, and the second playback control includes a movable second control element. Fig.10 As shown, the specific implementation of step S204 includes:

[0079] Step S2041: In response to a first jump operation on a second playback interval marker corresponding to a target video segment, a second control element is moved to a first element position corresponding to the first jump operation.

[0080] Step S2042: Based on the first element position, obtain the corresponding first playback position.

[0081] Step S2043: Obtain a second playback position corresponding to the first playback position.

[0082] Step S2044: Move the first control element to a second element position corresponding to the second playback position.

[0083] For example, Fig.11 A schematic diagram of the process of synchronously moving control elements provided in an embodiment of the present disclosure is shown below. Fig.11 The above process is introduced as follows: Fig.11As shown, when the terminal device receives a first jump operation for the second playback interval identifier corresponding to the second video, such as clicking the target position in the second playback interval identifier, or dragging the second control element to the target position in the second playback interval identifier, the terminal device moves the second control element to the first element position corresponding to the first jump operation, that is, the above-mentioned target position, and then, based on the mapping information between the movement amount of the control element provided by the second playback control and the corresponding value, the playback position of the second video corresponding to the first element position, that is, the first playback position, is obtained; then, based on the mapping relationship between the first video segment and each image frame in the target video segment contained in the reference information, the first image frame in the first video corresponding to the second image frame at the first playback position in the second video is obtained, and then, according to the playback timestamp corresponding to the first image frame, the second playback position of the first image frame in the first video is obtained. Further, based on the mapping information between the movement amount of the control element provided by the first playback control and the corresponding value, the second element position corresponding to the second playback position is obtained, and the first control element corresponding to the first video is moved to the second element position, so that the similar segments played by the first video and the second video (that is, the first video segment and the target video segment) are synchronized. At the same time, synchronous movement of the control elements (first control element and second control element) in the first play control and the second play control is achieved.

[0084] Optionally, the first playback control also includes a third control element, and the second playback control also includes a fourth control element, the third control element is used to independently control the playback position of the first video to achieve jump playback for the first video; the fourth control element is used to independently control the playback position of the second video to achieve jump playback for the second video; by combining the first control element and the third control element, or combining the second control element and the fourth control element, single jump playback or synchronous jump playback of the first video and the second video can be achieved, thereby improving the efficiency of manual detection of self-made videos.

[0085] In this embodiment, when the terminal device responds to the user operation and jumps to a similar segment (the first video segment or the target video segment) for video playback, the playback content of the first video segment and the target video segment is made consistent, thereby achieving alignment of the playback content of similar segments between the first video and the second video. There is no need for the user to manually adjust the playback position to align the video content, thereby improving the efficiency of video detection.

[0086] Step S205: In the target interface, synchronously play the target video segment starting from the first play position and the first video segment starting from the second play position, wherein the content of the image frame corresponding to the second play position is the same as the content of the image frame corresponding to the first play position.

[0087] After obtaining the first playback position and the second playback position, the target video segment is played synchronously starting from the first playback position and the first video segment is played starting from the second playback position. Since the first playback position and the second playback position point to the same content of the image frame to be played after the above steps, after starting to play the first video segment and the target video segment, the content of the image frame corresponding to the second playback position can be made the same as the content of the image frame corresponding to the first playback position, thereby achieving the purpose of comparatively displaying similar segments in the first video and the second video.

[0088] Optionally, after step S203, the method further includes:

[0089] Step S206: In response to the second jump operation, a third playback position corresponding to the second video is obtained, and the third playback position is located after the end position corresponding to the target video segment.

[0090] Step S207: Obtain the fourth playback position corresponding to the first video according to the third playback position corresponding to the second video

[0091] Step S208: In the target interface, synchronously play the second video starting from the third playback position and play the first video starting from the fourth playback position, wherein the distance from the fourth playback position to the end position of the first video segment is the same as the distance from the first playback position to the end position of the target video segment.

[0092] Exemplarily, in another possible implementation, after step S203, the terminal device receives a second jump operation for the second video input by the user, and the target position corresponding to the second jump operation is located before the end position corresponding to the target video segment. Specifically, the specific implementation process of the above steps can be, for example: the terminal device responds to the first jump operation for the area outside the second playback interval identifier corresponding to the target video segment, moves the second control element to the third element position corresponding to the first jump operation, and then obtains the third playback position corresponding to the second video based on the third element position. The specific implementation method of this process is similar to the specific implementation method of obtaining the first playback position in the steps of the previous embodiment, and will not be repeated here.

[0093] When the second jump operation is triggered, the play pointer moves from the current position to the third play position, and then the backward distance between the third play position and the end position of the target video clip is obtained, and the backward distance represents the time for the third play position to move backward from the end position of the target video clip. After that, based on the backward distance, the end distance of the first video clip in the first video is used as the starting point, and the backward distance is moved backward to obtain the fourth play position corresponding to the first video. The corresponding movement of the control elements involved in the above process is integrated with the movement method of the first control element and the second control element in the previous embodiment, and will not be repeated here. After that, the second video is played synchronously with the third play position as the starting point, and the first video is played with the fourth play position as the starting point, so as to realize the synchronous comparison playback of the video content after the end of similar clips in the first video and the second video, thereby improving the overall detection efficiency for the second video.

[0094] In another possible implementation, in response to the second jump operation, the third playback position corresponding to the second video is obtained, and the third playback position is located before the start position corresponding to the target video segment; according to the third playback position corresponding to the second video, the fourth playback position corresponding to the first video is obtained; thereafter, in the target interface, the second video is synchronously played with the third playback position as the starting point, and the first video is played with the fourth playback position as the starting point, wherein the distance from the fourth playback position to the start position of the first video segment is the same as the distance from the first playback position to the start position of the target video segment. In the steps of this embodiment, the target position of the video adjustment triggered by the second jump operation is located before the target video segment, and the specific implementation principle is similar to the implementation principle in the previous embodiment in which the target position is located after the target video segment, and will not be repeated here.

[0095] Optionally, after synchronously playing the target video segment and the first video segment, or synchronously playing the first video and the second video, it also includes: in response to a pause operation, pausing the playback of the target video segment and the first video segment at the same time, or synchronously pausing the playback of the first video and the second video.

[0096] In this embodiment, the specific implementation method of steps S201 and S202 is consistent with that of steps S101 and S102 in the above embodiment. For detailed discussion, please refer to the discussion under steps S101 and S102, which will not be repeated here.

[0097] Corresponding to the video detection method of the above embodiment, Fig.12 This is a structural block diagram of a video detection device provided by an embodiment of the present disclosure. For ease of description, only the parts related to the embodiment of the present disclosure are shown.

[0098] Reference Fig.12 , the video detection device 3 comprises:

[0099] The acquisition module 31 is used to acquire the first video.

[0100] The processing module 32 is used to perform video detection based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video contains at least one target video segment, the target video segment is associated with the first video, and the reference information represents the playback position of the target video segment in the second video.

[0101] The interaction module 33 is used to synchronously play the first video segment in the first video and the corresponding target video segment in the second video in the target interface based on the reference information.

[0102] In one embodiment of the present disclosure, a first playback control corresponding to the first video and / or a second playback control corresponding to the second video are provided in the target interface, wherein the first playback control is used to jump to play the target content in the first video clip in response to a first trigger operation; the second playback control is used to play the target content in the target video clip in response to the first trigger operation, and the first trigger operation is an operation on the first playback control or the second playback control.

[0103] In one embodiment of the present disclosure, the interaction module 33 is specifically used to: based on reference information, display the playback interval identifier of the target video segment in the second video in the second playback control of the target interface, the playback interval identifier is used to represent the starting position and the ending position of the target video segment in the second video; in response to a first jump operation for the playback interval identifier, obtain the corresponding first playback position; in the target interface, synchronously play the target video segment with the first playback position as the starting point and play the first video segment with the second playback position as the starting point, wherein the content of the image frame corresponding to the second playback position is the same as the content of the image frame corresponding to the first playback position.

[0104] In one embodiment of the present disclosure, the first playback control includes a movable first control element, and the second playback control includes a movable second control element; when the interaction module 33 obtains the corresponding first playback position in response to the first jump operation for the playback interval identifier, it is specifically used to: in response to the first jump operation for the playback interval identifier, move the second control element to the first element position corresponding to the first jump operation; based on the first element position, obtain the corresponding first playback position; the interaction module 33 is also used to: obtain the second playback position corresponding to the first playback position; move the first control element to the second element position corresponding to the second playback position.

[0105] In one embodiment of the present disclosure, the interaction module 33 is also used to: in response to a second jump operation, obtain a corresponding third playback position, the third playback position being located after the corresponding end position of the target video segment; in the target interface, synchronously play the second video starting from the third playback position and play the first video starting from the fourth playback position, wherein the distance from the fourth playback position to the end position of the first video segment is the same as the distance from the first playback position to the end position of the target video segment.

[0106] In one embodiment of the present disclosure, the processing module 32 is specifically used to: obtain a target image frame in a first video; detect at least one video to be detected based on the target image frame to obtain at least one second video, wherein the second video at least includes a matching image frame corresponding to the target image frame, and the image similarity between the matching image frame and the target image frame is greater than a first threshold; based on the playback timestamp of the matching image frame, obtain reference information corresponding to the second video.

[0107] In one embodiment of the present disclosure, when the processing module 32 obtains the target image frame in the first video, it is specifically used to: obtain the number of hits of at least one key frame in the first video, the number of hits being the number of times the key frame is detected to have a corresponding matching image frame; and determine the key frame having a hit number greater than a first number as the target image frame.

[0108] In one embodiment of the present disclosure, the target image frame includes at least two consecutive key frames in a first video; when the processing module 32 detects at least one video to be detected based on the target image frame and obtains at least one second video, it is specifically used to: based on the time interval between at least two consecutive key frames, obtain a corresponding number of second image frames in the video to be detected; obtain the image similarity between the key frame and the corresponding second image frame, and if the number of second image frames whose image similarity is greater than a first threshold is greater than a second number, the video to be detected corresponding to the second image frame is determined as the second video.

[0109] In one embodiment of the present disclosure, the processing module 32 is further used to: obtain a speed coefficient corresponding to the target video segment, the speed coefficient representing the video content playback rate of the target video segment relative to the first video segment; obtain a target playback speed of the first video segment based on the speed coefficient; the interaction module is specifically used to: play the first video segment in the first video based on the target playback speed in the target interface.

[0110] The acquisition module 31, the processing module 32 and the interaction module 33 are connected in sequence. The video detection device 3 provided in this embodiment can implement the technical solution of the above method embodiment, and its implementation principle and technical effect are similar, which will not be described in detail in this embodiment.

[0111] Fig.13A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure is shown in FIG. Fig.13 As shown, the electronic device 4 includes:

[0112] A processor 41, and a memory 42 communicatively connected to the processor 41;

[0113] The memory 42 stores computer executable instructions;

[0114] The processor 41 executes the computer execution instructions stored in the memory 42 to implement the following Figure 2-Figure 11 The video detection method in the illustrated embodiment.

[0115] Optionally, the processor 41 and the memory 42 are connected via a bus 43 .

[0116] For related instructions, please refer to Figure 2-Figure 11 The relevant descriptions and effects corresponding to the steps in the corresponding embodiments can be understood, and no further elaboration is made here.

[0117] The present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, which are used to implement the present invention when executed by a processor. Figure 2-Figure 11 The video detection method provided in any one of the corresponding embodiments.

[0118] The present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements Figure 2-Figure 11 The video detection method in the illustrated embodiment.

[0119] refer to Fig.14 , which shows a schematic diagram of the structure of an electronic device 900 suitable for implementing the embodiment of the present disclosure, and the electronic device 900 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.14 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0120] like Fig.14As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0121] Typically, the following devices may be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although Fig.14 The electronic device 900 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0122] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0123] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0124] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device.

[0125] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0126] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0127] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0128] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0129] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0130] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0131] In a first aspect, according to one or more embodiments of the present disclosure, a video detection method is provided, including:

[0132] Acquire a first video; perform video detection based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video contains at least one target video segment, the target video segment is associated with the first video, and the reference information represents the playback position of the target video segment in the second video; based on the reference information, synchronously play the first video segment in the first video and the corresponding target video segment in the second video in a target interface.

[0133] According to one or more embodiments of the present disclosure, a first playback control corresponding to the first video and / or a second playback control corresponding to the second video are provided in the target interface, wherein the first playback control is used to jump to play the target content in the first video clip in response to a first trigger operation; the second playback control is used to play the target content in the target video clip in response to the first trigger operation, and the first trigger operation is an operation on the first playback control or the second playback control.

[0134] According to one or more embodiments of the present disclosure, the first video segment in the first video and the corresponding target video segment in the second video are synchronously played in the target interface based on the reference information, including: based on the reference information, displaying a playback interval identifier of the target video segment in the second video in a second playback control of the target interface, the playback interval identifier being used to characterize the start position and end position of the target video segment in the second video; obtaining a corresponding first playback position in response to a first jump operation for the playback interval identifier; and synchronously playing the target video segment with the first playback position as the starting point and the first video segment with the second playback position as the starting point in the target interface, wherein the content of the image frame corresponding to the second playback position is the same as the content of the image frame corresponding to the first playback position.

[0135] According to one or more embodiments of the present disclosure, the first playback control includes a movable first control element, and the second playback control includes a movable second control element; the obtaining of the corresponding first playback position in response to the first jump operation for the playback interval identifier includes: in response to the first jump operation for the playback interval identifier, moving the second control element to the first element position corresponding to the first jump operation; obtaining the corresponding first playback position based on the first element position; and also including: obtaining the second playback position corresponding to the first playback position; and moving the first control element to the second element position corresponding to the second playback position.

[0136] According to one or more embodiments of the present disclosure, the method also includes: in response to a second jump operation, obtaining a corresponding third playback position, the third playback position being located after the corresponding end position of the target video clip; in the target interface, synchronously playing the second video starting from the third playback position and playing the first video starting from a fourth playback position, wherein the distance from the fourth playback position to the end position of the first video clip is the same as the distance from the first playback position to the end position of the target video clip.

[0137] According to one or more embodiments of the present disclosure, the video detection is performed based on the first video to obtain at least one second video and reference information corresponding to the second video, including: obtaining a target image frame in the first video; detecting at least one video to be detected based on the target image frame to obtain at least one second video, wherein the second video at least includes a matching image frame corresponding to the target image frame, and the image similarity between the matching image frame and the target image frame is greater than a first threshold; and obtaining reference information corresponding to the second video based on a playback timestamp of the matching image frame.

[0138] According to one or more embodiments of the present disclosure, obtaining the target image frame in the first video includes: obtaining the hit count of at least one key frame in the first video, the hit count being the number of times the key frame is detected to have a corresponding matching image frame; and determining the key frame whose hit count is greater than a first number as the target image frame.

[0139] According to one or more embodiments of the present disclosure, the target image frame includes at least two consecutive key frames in the first video; the detecting of at least one video to be detected based on the target image frame to obtain at least one second video includes: obtaining a corresponding number of second image frames in the video to be detected based on the time interval between the at least two consecutive key frames; obtaining the image similarity between the key frame and the corresponding second image frame, if the number of second image frames whose image similarity is greater than a first threshold is greater than a second number, then determining the video to be detected corresponding to the second image frame as the second video.

[0140] According to one or more embodiments of the present disclosure, the method further includes: obtaining a speed coefficient corresponding to the target video segment, the speed coefficient representing a video content playback rate of the target video segment relative to the first video segment; obtaining a target playback speed of the first video segment based on the speed coefficient; synchronously playing the first video segment in the first video and the corresponding target video segment in the second video in the target interface, including: playing the first video segment in the first video based on the target playback speed in the target interface.

[0141] In a second aspect, according to one or more embodiments of the present disclosure, a video detection device is provided, including:

[0142] The acquisition module is used to acquire the first video.

[0143] A processing module is used to perform video detection based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video contains at least one target video segment, the target video segment is associated with the first video, and the reference information represents the playback position of the target video segment in the second video.

[0144] An interactive module is used to synchronously play the first video segment in the first video and the corresponding target video segment in the second video in a target interface based on the reference information.

[0145] According to one or more embodiments of the present disclosure, a first playback control corresponding to the first video and / or a second playback control corresponding to the second video are provided in the target interface, wherein the first playback control is used to jump to play the target content in the first video clip in response to a first trigger operation; the second playback control is used to play the target content in the target video clip in response to the first trigger operation, and the first trigger operation is an operation on the first playback control or the second playback control.

[0146] According to one or more embodiments of the present disclosure, the interaction module is specifically used to: based on the reference information, display the playback interval identifier of the target video segment in the second video in the second playback control of the target interface, and the playback interval identifier is used to represent the start position and the end position of the target video segment in the second video; in response to a first jump operation for the playback interval identifier, obtain the corresponding first playback position; in the target interface, synchronously play the target video segment with the first playback position as the starting point and play the first video segment with the second playback position as the starting point, wherein the content of the image frame corresponding to the second playback position is the same as the content of the image frame corresponding to the first playback position.

[0147] According to one or more embodiments of the present disclosure, the first playback control includes a movable first control element, and the second playback control includes a movable second control element; when the interaction module obtains the corresponding first playback position in response to the first jump operation for the playback interval identifier, it is specifically used to: in response to the first jump operation for the playback interval identifier, move the second control element to the first element position corresponding to the first jump operation; based on the first element position, obtain the corresponding first playback position; the interaction module 33 is also used to: obtain the second playback position corresponding to the first playback position; move the first control element to the second element position corresponding to the second playback position.

[0148] According to one or more embodiments of the present disclosure, the interaction module is also used to: in response to a second jump operation, obtain a corresponding third playback position, wherein the third playback position is located after the corresponding end position of the target video segment; in the target interface, synchronously play the second video starting from the third playback position and play the first video starting from a fourth playback position, wherein the distance from the fourth playback position to the end position of the first video segment is the same as the distance from the first playback position to the end position of the target video segment.

[0149] According to one or more embodiments of the present disclosure, the processing module is specifically used to: obtain a target image frame in the first video; detect at least one video to be detected based on the target image frame to obtain at least one second video, wherein the second video at least includes a matching image frame corresponding to the target image frame, and the image similarity between the matching image frame and the target image frame is greater than a first threshold; based on the playback timestamp of the matching image frame, obtain reference information corresponding to the second video.

[0150] According to one or more embodiments of the present disclosure, when acquiring the target image frame in the first video, the processing module is specifically used to: acquire the number of hits of at least one key frame in the first video, the number of hits being the number of times the key frame is detected to have a corresponding matching image frame; and determine the key frame having a number of hits greater than a first number as the target image frame.

[0151] According to one or more embodiments of the present disclosure, the target image frame includes at least two consecutive key frames in the first video; when the processing module detects at least one video to be detected based on the target image frame and obtains at least one second video, it is specifically used to: obtain a corresponding number of second image frames in the video to be detected based on the time interval between the at least two consecutive key frames; obtain the image similarity between the key frame and the corresponding second image frame, and if the number of second image frames whose image similarity is greater than a first threshold is greater than a second number, the video to be detected corresponding to the second image frame is determined as the second video.

[0152] According to one or more embodiments of the present disclosure, the processing module is further used to: obtain a speed coefficient corresponding to the target video segment, the speed coefficient representing a playback rate of the video content of the target video segment relative to the first video segment; obtain a target playback speed of the first video segment based on the speed coefficient; the interaction module is specifically used to: play the first video segment in the first video based on the target playback speed in the target interface.

[0153] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

[0154] The memory stores computer-executable instructions;

[0155] The processor executes the computer-executable instructions stored in the memory to implement the video detection method as described in the first aspect and various possible designs of the first aspect.

[0156] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the video detection method described in the first aspect and various possible designs of the first aspect is implemented.

[0157] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the video detection method as described in the first aspect and various possible designs of the first aspect.

[0158] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0159] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0160] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A video detection method, characterized in that: include: Get the first video; Performing video detection based on the first video to obtain at least one second video and reference information corresponding to the second video, wherein the second video includes at least one target video segment, the target video segment is associated with the first video, and the reference information represents a playback position of the target video segment in the second video; Based on the reference information, the first video segment in the first video and the corresponding target video segment in the second video are synchronously played in the target interface.

2. The method according to claim 1, characterized in that The target interface is provided with a first playback control corresponding to the first video and / or a second playback control corresponding to the second video, wherein the first playback control is used to jump to play the target content in the first video clip in response to a first trigger operation; the second playback control is used to play the target content in the target video clip in response to the first trigger operation, and the first trigger operation is an operation on the first playback control or the second playback control.

3. The method according to claim 1, characterized in that The target video segment is associated with the first video, including that the target video segment has a high similarity with the first video segment in the first video.

4. The method according to claim 2, characterized in that: The synchronously playing the first video segment in the first video and the corresponding target video segment in the second video in the target interface based on the reference information includes: Based on the reference information, displaying a play interval identifier of the target video segment in the second video in a second play control of the target interface, wherein the play interval identifier is used to represent a start position and an end position of the target video segment in the second video; In response to a first jump operation for the playback interval identifier, obtaining a corresponding first playback position; In the target interface, the target video segment is played synchronously starting from the first playback position and the first video segment is played starting from the second playback position, wherein the content of the image frame corresponding to the second playback position is the same as the content of the image frame corresponding to the first playback position.

5. The method according to claim 4, characterized in that The first playback control includes a movable first control element, and the second playback control includes a movable second control element; The step of obtaining a corresponding first playback position in response to a first jump operation on the playback interval identifier includes: In response to a first jump operation for the playback interval identifier, moving the second control element to a first element position corresponding to the first jump operation; Based on the first element position, obtaining a corresponding first playback position; Also includes: Acquire the second playback position corresponding to the first playback position; The first control element is moved to a second element position corresponding to the second playback position.

6. The method according to claim 4, characterized in that The method further comprises: In response to the second jump operation, a corresponding third playback position is obtained, where the third playback position is located after the end position corresponding to the target video segment; In the target interface, the second video is played synchronously starting from the third playback position and the first video is played starting from the fourth playback position, wherein the distance from the fourth playback position to the end position of the first video segment is the same as the distance from the first playback position to the end position of the target video segment.

7. The method according to claim 1, characterized in that The performing video detection based on the first video to obtain at least one second video and reference information corresponding to the second video includes: Acquire a target image frame in the first video; Detecting at least one to-be-detected video based on the target image frame to obtain at least one second video, wherein the second video at least includes a matching image frame corresponding to the target image frame, and an image similarity between the matching image frame and the target image frame is greater than a first threshold; Based on the playback timestamp of the matching image frame, reference information corresponding to the second video is obtained.

8. The method according to claim 7, characterized in that The acquiring the target image frame in the first video includes: Obtaining a hit count of at least one key frame in the first video, where the hit count is the number of times the key frame is detected to have a corresponding matching image frame; The key frame with a hit count greater than the first number is determined as the target image frame.

9. The method according to claim 7, characterized in that: The target image frame includes at least two consecutive key frames in the first video; and detecting at least one to-be-detected video based on the target image frame to obtain at least one second video includes: Based on the time interval between the at least two consecutive key frames, obtaining a corresponding number of second image frames in the video to be detected; The image similarity between the key frame and the corresponding second image frame is obtained. If the number of second image frames whose image similarity is greater than a first threshold is greater than a second number, the video to be detected corresponding to the second image frame is determined as the second video.

10. The method according to claim 1, characterized in that The method further comprises: Acquire a speed change coefficient corresponding to the target video segment, where the speed change coefficient represents a video content playback rate of the target video segment relative to the first video segment; Obtaining a target playback speed of the first video clip according to the speed change coefficient; The synchronously playing the first video segment in the first video and the corresponding target video segment in the second video in the target interface includes: The first video segment in the first video is played in the target interface based on the target playback speed.

11. A video detection device, characterized in that: include: An acquisition module, used for acquiring a first video; a processing module, configured to perform video detection based on the first video, obtain at least one second video and reference information corresponding to the second video, wherein the second video includes at least one target video segment, the target video segment is associated with the first video, and the reference information represents a playback position of the target video segment in the second video; An interactive module is used to synchronously play the first video segment in the first video and the corresponding target video segment in the second video in a target interface based on the reference information.

12. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the video detection method according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the video detection method according to any one of claims 1 to 10 is implemented.

14. A computer program product, characterized in that The invention comprises a computer program, which implements the video detection method according to any one of claims 1 to 10 when being executed by a processor.

Images