Method and device for determining infringement video

Abstract

The invention discloses an infringement video determination method and device, and belongs to the field of image processing. The method comprises: receiving a first input to a first video; in response to the first input, selecting a first video clip of the first video; extracting first blind watermark information in the first video clip; acquiring a first highlight video clip, the similarity of which to the first video clip is greater than a preset similarity, from a database, determining the first highlight video clip as a second highlight video clip, and performing infringement judgment on the first video according to the first blind watermark information and second blind watermark information in the second highlight video clip, the database comprises at least one first highlight video clip, and the second highlight video clip is one of the at least one first highlight video clip; and under the condition that the first blind watermark information is the same as the second blind watermark information, determining that the first video is an infringement video.

Description

Technical Field

[0001] The present application belongs to the field of image processing technology, and specifically relates to a method and device for determining an infringing video. Background Art

[0002] Currently, when users upload edited videos to various video platforms, they mainly declare copyright ownership by adding visible watermarks to the video screen. A small number of users may use blind watermarking technology to add invisible watermarks to the entire uploaded video. However, the visible watermark in the video will be removed by attackers through methods such as cropping the screen, and after the removed video is republished to the video platform, it is impossible to prove the copyright ownership of the video. The existing blind watermarking algorithm embeds a watermark in each frame of the entire uploaded video. When judging whether a video is infringing, it is necessary to judge whether each frame of the entire video is infringing. The infringement judgment process is long and consumes a lot of resources. Summary of the invention

[0003] In view of the above problems, the embodiments of the present application provide a method and device for determining infringing videos that overcome the above problems or at least partially solve the above problems.

[0004] In a first aspect, an embodiment of the present application provides a method for determining an infringing video, comprising:

[0005] Receiving a first input of a first video;

[0006] In response to the first input, selecting a first video segment of the first video;

[0007] Extracting first blind watermark information from the first video clip;

[0008] Acquire a first highlight video segment whose similarity with the first video segment is greater than a preset similarity from a database, determine the first highlight video segment as a second highlight video segment, and perform infringement judgment on the first video according to the first blind watermark information and the second blind watermark information in the second highlight video segment, wherein the database includes at least one first highlight video segment, and the second highlight video segment is one of at least one of the first highlight video segments;

[0009] When the first blind watermark information is the same as the second blind watermark information, the first video is determined to be an infringing video.

[0010] In a second aspect, an embodiment of the present application provides a device for determining an infringing video, including:

[0011] A first input module, used for receiving a first input of a first video;

[0012] A first response module, configured to select a first video segment of the first video in response to the first input;

[0013] An extraction module, used to extract the first blind watermark information in the first video clip;

[0014] an infringement judgment module, configured to obtain from a database a first highlight video segment whose similarity to the first video segment is greater than a preset similarity, determine the first highlight video segment as a second highlight video segment, and perform infringement judgment on the first video according to the first blind watermark information and the second blind watermark information in the second highlight video segment, wherein the database includes at least one first highlight video segment, and the second highlight video segment is one of at least one of the first highlight video segments;

[0015] A determination module is used to determine that the first video is an infringing video when the first blind watermark information is the same as the second blind watermark information.

[0016] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0017] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0018] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0019] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0020] In an embodiment of the present application, by responding to a first input of a first video, a first video segment of the first video is selected, the first blind watermark information in the first video segment is extracted, a second highlight video segment whose similarity to the first video segment is greater than a preset similarity is obtained from a database, and an infringement judgment is performed based on the first blind watermark information and the second blind watermark information in the second highlight video segment, the database includes at least one first highlight video segment, and the second highlight video segment is one of at least one of the first highlight video segments; when the first blind watermark information is the same as the second blind watermark information, the first video is determined to be an infringing video.

[0021] According to the above scheme, after the user finds the first video suspected of infringement, he only needs to compare whether the second blind watermark information of the second highlight video clip most similar to the first video clip in the database is consistent with the first blind watermark information of the first video clip in the first video, so as to determine whether the first video clip infringes the second highlight video clip and quickly confirm the copyright ownership of the first video. There is no need to determine the blind watermark information of the entire first video, which can improve the efficiency of infringement judgment and reduce resource consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 This is one of the flowcharts of the method for determining an infringing video provided in the embodiment of the present application;

[0023] Figure 2 This is one of the schematic diagrams of the watermark extraction page provided in the embodiment of the present application;

[0024] Figure 3 This is the second schematic diagram of the watermark extraction page provided in the embodiment of the present application;

[0025] Figure 4 This is one of the schematic diagrams of embedding a watermark into a page provided by an embodiment of the present application;

[0026] Figure 5 This is the second schematic diagram of a watermark embedded in a page provided in an embodiment of the present application;

[0027] Figure 6 This is the third schematic diagram of a watermark embedded in a page provided in an embodiment of the present application;

[0028] Figure 7 is a schematic diagram of a highlight time interval provided in an embodiment of the present application;

[0029] Figure 8 is a schematic diagram of adjusting the highlight time interval provided in an embodiment of the present application;

[0030] Fig. 9 It is a schematic diagram of deleting a highlight time interval provided in an embodiment of the present application;

[0031] Fig.10 It is a schematic diagram of adding a highlight time interval provided in an embodiment of the present application;

[0032] Fig.11 It is a schematic diagram of the structure of the device for determining an infringing video provided in an embodiment of the present application;

[0033] Fig.12 is a structural block diagram of an electronic device provided in an embodiment of the present application;

[0034] Fig.13 It is a structural block diagram of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0036] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way are interchangeable where appropriate, so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0037] The following describes the method for determining infringing videos provided in the embodiments of the present application through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0038] like Figure 1 As shown, the embodiment of the present application provides a method for determining an infringing video, which may specifically include the following steps:

[0039] Step 101: Receive a first input of a first video.

[0040] Specifically, the first video can be a video obtained by the user through any means, for example, the first video can be an online video downloaded by the user from the Internet. If the user wants to determine whether the first video is infringing, the first video needs to be downloaded to an electronic device. After the first video is downloaded to the electronic device, the user clicks on the first application to open the first application, and the user selects the watermark extraction module to jump to the watermark extraction page. At this time, the watermark extraction page displays the first video 21 and the thumbnail control 22 corresponding to the first video, as shown in FIG. Figure 2 The user makes a first input to the thumbnail control 22 of the first video to select a different video segment.

[0041] It should be noted that the first application consists of two functions: a watermark embedding module and a watermark extraction module, wherein the watermark embedding module is mainly used to embed watermark information into images or videos; the watermark extraction module is mainly used to extract watermark information from images or videos.

[0042] The first input specifically refers to a selection operation of the user on the first video through the watermark extraction page and a sliding input of the user on the thumbnail control of the first video.

[0043] Step 102: In response to the first input, select a first video segment of the first video.

[0044] Specifically, Figure 2 As shown, the electronic device responds to the user's first input to the thumbnail control 22 of the first video by sliding the thumbnail control 22 of the first video left and right to adjust the progress of the first video to the area where the user wants to make an infringement judgment (that is, the suspected infringement area 23 considered by the user), thereby selecting the first video segment 25 suspected of infringement in the first video, as shown in FIG. Figure 3 shown.

[0045] Step 103: extracting first blind watermark information from the first video clip.

[0046] Specifically, Figure 2 As shown, after selecting the first video clip, click the watermark extraction control 24 on the current watermark extraction page, and then execute the watermark extraction algorithm to first determine whether there is blind watermark information in the first video clip. If it is determined that there is no blind watermark information in the first video clip, the user is prompted that the first video clip has no blind watermark information and no infringement-related information, so that the user can be informed of the infringement determination result in a timely manner.

[0047] If it is determined that the first video segment 25 contains blind watermark information, then jump to the watermark extraction details page, such as Figure 3As shown, the blind watermark information in the first video clip 25 is further extracted on the watermark extraction details page, and all the blind watermark information extracted from the first video clip 25 is the first blind watermark information 26.

[0048] It should be noted that blind watermark information refers to the hidden embedding of digital information (i.e. digital watermark) into carrier files such as audio, video, and pictures without affecting the visual quality and integrity of video images and pictures. It is suitable for scenarios such as copyright protection, leak tracing, and file authentication.

[0049] Step 104: Obtain from a database a first highlight video clip whose similarity with the first video clip is greater than a preset similarity, determine the first highlight video clip as a second highlight video clip, and make an infringement judgment on the first video based on the first blind watermark information and the second blind watermark information in the second highlight video clip, wherein the database includes at least one first highlight video clip, and the second highlight video clip is one of at least one of the first highlight video clips.

[0050] Specifically, the database includes at least one first highlight video segment, and each first highlight video segment has corresponding second blind watermark information. The similarity between each first highlight video segment in the database and the first video segment is calculated, and the first highlight video segment in the database whose similarity with the first video segment is greater than a preset similarity is determined as the second highlight video segment.

[0051] The second blind watermark information corresponding to the second highlight video clip and the first blind watermark information of the first video clip are judged for infringement, that is, whether the second blind watermark information is the same as the first blind watermark information, thereby judging whether the first video clip infringes on the second highlight video clip, and further judging whether the first video infringes on the second highlight video clip.

[0052] Step 105: When the first blind watermark information is the same as the second blind watermark information, determine that the first video is an infringing video.

[0053] Specifically, if the first blind watermark information is the same as the second blind watermark information, it means that the first video is a video uploaded to the Internet by the electronic device, and it is determined that the first video segment in the first video infringes the second highlight video segment, and then the first video where the first video segment is located can be determined to be an infringing video. If the first blind watermark information is different from the second blind watermark information, it is determined that the first video segment does not infringe the second highlight video segment, and then the first video where the first video segment is located can be determined to be a non-infringing video.

[0054] In an embodiment of the present application, after the user discovers a first video that is suspected of infringement, it is only necessary to compare whether the second blind watermark information of the second highlight video clip that is most similar to the first video clip in the database is consistent with the first blind watermark information of the first video clip in the first video, so as to determine whether the first video clip infringes the second highlight video clip, and quickly confirm the copyright ownership of the first video. There is no need to determine the blind watermark information of the entire first video, which can improve the efficiency of infringement determination and reduce resource consumption.

[0055] As an optional specific embodiment, before step 101, the method may further include steps 106 to 111, wherein:

[0056] Step 106: Receive a second input of a plurality of second videos.

[0057] Specifically, if the user wants to embed blind watermark information into a video, the user opens the first application by clicking on the first application, and jumps to the watermark embedding page through the user's selection input of the watermark embedding module, and the watermark embedding page displays multiple second videos in the electronic device. The electronic device receives the user's second input of at least one second video among the multiple second videos.

[0058] It should be noted that the second video may be a locally saved video, and the first video and the second video are different videos.

[0059] The second input is a selection input of at least one second video among the multiple second videos by the user, which may specifically be a click input, a press input, or the like.

[0060] Step 107: In response to the second input, determine a third video to be embedded with a watermark from a plurality of second videos.

[0061] Specifically, in response to a second input of the user to at least one second video among the plurality of second videos, the at least one second video is determined as a third video to be embedded with a watermark.

[0062] It should be noted that the second input is a user's selection input of at least one second video among the multiple second videos, and the selected second video is the third video.

[0063] Step 108: Detect the third video using a highlight detection algorithm to determine at least one third highlight video segment in the third video.

[0064] Specifically, after determining the third video, highlight detection is performed on the third video based on a highlight detection algorithm based on artificial intelligence (AI), and at least one third highlight video segment in the third video is automatically analyzed, and at least one third highlight video segment is used as a video segment to be embedded with a watermark.

[0065] Among them, the highlight detection algorithm refers to extracting highlight moments for a long video and calculating the highlight video clip corresponding to at least one highlight moment in the video. It can be applied to scenes such as game highlight editing and film and television drama highlight editing to quickly display the wonderful content in the long video.

[0066] Step 109: Add second blind watermark information to at least one of the third highlight video segments to obtain at least one first highlight video segment.

[0067] Specifically, after determining at least one third highlight video segment that needs to be embedded with a watermark, the watermark input area is displayed. After obtaining the second blind watermark information input by the user in the watermark input area, the second blind watermark information is embedded into at least one third highlight video segment to obtain at least one first highlight video segment. That is, after a third highlight video segment is embedded with the second blind watermark information, the corresponding first highlight video segment can be obtained.

[0068] Example: Figure 4 As shown, after determining at least one third highlight video segment that needs to be embedded with a watermark, the user operates the first confirmation control 41 of the watermark embedding page (e.g., clicks the first confirmation control 41), and a watermark input area 42 (i.e., a watermark input box) pops up, as shown in FIG. Figure 5 As shown, the user can edit the second blind watermark information to be embedded in the watermark input area 42, such as: XXXXX. Figure 5 As shown, through the user's operation of the second confirmation control 43, the second blind watermark information can be embedded into at least one third highlight video segment to obtain at least one first highlight video segment. By adding the second blind watermark information, not only the user's video copyright can be protected, but the second blind watermark information cannot be perceived by the naked eye, does not affect the video viewing experience, and improves the user experience.

[0069] Step 110: Generate a fourth video based on the third video and at least one of the first highlight video segments.

[0070] Specifically, Figure 5 As shown, each third highlight video segment in the third video is embedded with the second blind watermark information, and through the user's operation on the second confirmation control 43, the prompt information that the fourth video is being generated can be displayed, such as Figure 6As shown, a prompt message such as "Please do not leave this page to ensure that the video generation will not be paused" may also be displayed, and a generation progress bar 44 may also be displayed. The generated fourth video includes at least one first highlight video segment, and the at least one first highlight video segment is obtained by embedding the second blind watermark information into at least one third highlight video segment.

[0071] It should be noted that the fourth video is the video obtained after adding the second blind watermark information to the third video.

[0072] Step 111: Save at least one of the first highlight video clips and the fourth video into the database.

[0073] Specifically, after obtaining at least one first highlight video clip, at least one first highlight video clip can be saved in a database; and after obtaining a fourth video, the fourth video can be saved in a database to save copyrighted videos or video clips for later infringement determination. Furthermore, the user can upload and publish the fourth video or the first highlight video clip to any platform on the Internet as needed.

[0074] As an optional specific embodiment, the step 108 detects the third video by using a highlight detection algorithm to determine at least one third highlight video segment in the third video, including:

[0075] Detecting the third video using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video;

[0076] receiving editing input for at least one of the fourth highlight video clips;

[0077] In response to the editing input, at least one edited third highlight video segment is obtained.

[0078] Specifically, after determining the third video, the highlight detection algorithm based on AI performs highlight detection on the third video, automatically analyzes at least one fourth highlight video segment in the third video, and the user can edit and input the at least one fourth highlight video segment as needed to obtain at least one edited third highlight video segment, and use at least one third highlight video segment as the video segment to be embedded with a watermark, so that the highlight video segment obtained by the highlight detection cannot meet the customer's requirements, making the determination method of the highlight video segment more flexible. Among them, the editing input includes: adjusting input, deleting input, adding input, etc.

[0079] The case where the editing input is an adjustment input is described as follows: after obtaining at least one fourth highlight video segment, the at least one fourth highlight video segment is in an unselected state. The user can select one or more fourth highlight video segments as needed, and the selected fourth highlight video segments are in a selected state. The fourth highlight video segments in the selected state are edited, and the user can adjust the time interval range, that is, the fourth highlight video segment can be shortened, extended forward, extended backward, and one or more adjustments can be made.

[0080] For example, the fourth highlight video segment in the selected state is the video segment corresponding to 00:03 to 00:15 of the first video. 00:03 to 00:15 can be adjusted to 00:05 to 00:10, that is, the fourth highlight video segment is shortened to obtain the third highlight video segment, and the shortened third highlight video segment is the video segment corresponding to 00:05 to 00:10 of the third video. Alternatively, 00:03 to 00:15 can be adjusted to 00:01 to 00:15, that is, the fourth highlight video segment is extended forward to obtain the third highlight video segment, and the extended third highlight video segment is the video segment corresponding to 00:01 to 00:15 of the third video. Alternatively, 00:03 to 00:15 can be adjusted to 00:03 to 00:20, that is, the fourth highlight video segment is extended backward to obtain the third highlight video segment, and the extended third highlight video segment is the video segment corresponding to 00:03 to 00:20 of the third video.

[0081] Among them, 00:03 represents the 3rd second of the third video, and 00:15 represents the 15th second of the third video, that is, the video clip with a start time of 00:03 and an end time of 00:15 is the fourth highlight video clip in the selected state.

[0082] The case where the editing input is a deletion input is explained as follows: after obtaining at least one fourth highlight video clip, the at least one fourth highlight video clip is in an unselected state. The user can select one or more fourth highlight video clips as needed, and the selected fourth highlight video clips are in a selected state. The fourth highlight video clips in the selected state are edited, and the user can specifically delete the fourth highlight video clips in the selected state, for example: the fourth highlight video clip in the selected state is deleted by the user operating the delete control of the watermark embedding page.

[0083] For the case where the editing input is an adding input, the at least one fourth highlight video segment is in an unselected state after obtaining the at least one fourth highlight video segment. The user can add the fourth highlight video segment as needed, for example, by operating the new control of the watermark embedding page by the user, or by selecting a video segment in the third video by the user, to add one or more fourth highlight video segments.

[0084] Furthermore, the step of detecting the third video by using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video may specifically include:

[0085] Detecting the third video using the highlight detection algorithm to obtain at least one highlight time interval in the third video;

[0086] At least one of the highlight time intervals is marked at a corresponding position of the thumbnail control of the third video to obtain at least one of the fourth highlight video segments corresponding to the at least one highlight time interval.

[0087] Specifically, after determining the third video, the highlight detection algorithm based on AI performs highlight detection on the third video, and automatically analyzes at least one highlight time interval in the third video, that is, it can automatically extract the highlight moment of the video, and mark at least one highlight time interval at the corresponding position of the thumbnail control of the third video, such as: Figure 7 As shown, at least one highlight time interval 71 is marked at a corresponding position below the thumbnail control 73 of the third video 72, and is marked in a color block manner, mainly marking the start and end time of the time interval. The video clip corresponding to each time interval is a fourth highlight video clip.

[0088] The case where the editing input is an adjustment input is explained as follows: after obtaining at least one highlight time interval, the at least one highlight time interval is in an unselected state. The user can select one or more highlight time intervals as needed, and the selected highlight time intervals are in a selected state. The range of the selected highlight time intervals can be adjusted, that is, the highlight time interval can be shortened, extended forward, extended backward, and one or more adjustments can be made. For example: Figure 8 As shown, the highlight time interval in the selected state is from 00:03 to 00:15 of the third video, and the user can click and drag the two sides 74 of the highlight time interval to move left or right to adjust the range of the highlight time interval.

[0089] The case where the editing input is a deletion input is described as follows: after obtaining at least one highlight time interval, the at least one highlight time interval is in an unselected state. The user can select one or more highlight time intervals as needed, and the selected highlight time intervals are in a selected state. The fourth highlight video clip in the selected state is edited. Specifically, the user can delete the selected highlight time interval, for example: Fig. 9 As shown, the selected highlight time interval is deleted by the user operating the delete control 75 of the watermark embedded page.

[0090] For the case where the editing input is an adding input, the at least one highlight time interval is unselected after obtaining the at least one highlight time interval. The user can add a highlight time interval as needed, for example: Fig.10 As shown, by the user operating the newly added control 76 of the watermark embedding page and by the user selecting the time interval of the third video, one or more highlight time intervals are added.

[0091] As an optional specific embodiment, in step 105, when the first blind watermark information is the same as the second blind watermark information, after determining that the first video is an infringing video, the method further includes:

[0092] Display infringement warning information;

[0093] The first video and the infringement prompt information are saved.

[0094] Specifically, if the first blind watermark information is the same as the second blind watermark information, it means that the first video is a video uploaded to the Internet by the electronic device, and it is determined that the first video segment in the first video infringes on the second highlight video segment. Further, it can be determined that the first video where the first video segment is located is an infringing video. At this time, infringement prompt information can be displayed, and the infringement prompt information is used to prompt the user that the first video infringes on the second highlight video segment.

[0095] like Figure 3 As shown, on the current watermark extraction page, the user can operate the current page control 27 to save the content of the current page, so as to serve as evidence for subsequent rights protection, thereby achieving the purpose of copyright protection.

[0096] In summary, in the embodiment of the present application, the user can add the second blind watermark information to the produced third video and save it to the database, which can not only protect the user's video copyright, but also the second blind watermark information cannot be perceived by the naked eye, does not affect the video viewing, and improves the user experience. After the user finds the suspected infringing first video, it is only necessary to compare whether the second blind watermark information of the second highlight video clip that is most similar to the first video clip in the database is consistent with the first blind watermark information of the first video clip in the first video, so as to determine whether the first video clip infringes the second highlight video clip, and quickly confirm the copyright ownership of the first video, without having to determine the blind watermark information of the entire first video, which can improve the efficiency of infringement determination and reduce resource consumption.

[0097] The infringing video determination method provided in the embodiment of the present application can be executed by an infringing video determination device. In the embodiment of the present application, the infringing video determination method performed by the infringing video determination device is taken as an example to illustrate the infringing video determination device provided in the embodiment of the present application.

[0098] like Fig.11 As shown, the embodiment of the present application further provides a device 1100 for determining an infringing video, which specifically includes:

[0099] The first input module 1101 is used to receive a first input of a first video;

[0100] A first response module 1102, configured to select a first video segment of the first video in response to the first input;

[0101] An extraction module 1103, configured to extract first blind watermark information from the first video segment;

[0102] The infringement judgment module 1104 is used to obtain a first highlight video segment whose similarity with the first video segment is greater than a preset similarity from a database, determine the first highlight video segment as a second highlight video segment, and perform infringement judgment on the first video according to the first blind watermark information and the second blind watermark information in the second highlight video segment, wherein the database includes at least one first highlight video segment, and the second highlight video segment is one of at least one of the first highlight video segments;

[0103] The determination module 1105 is used to determine that the first video is an infringing video when the first blind watermark information is the same as the second blind watermark information.

[0104] As an optional specific embodiment, the device further includes:

[0105] Prompt module, used to display infringement prompt information;

[0106] The first saving module is used to save the first video and the infringement prompt information.

[0107] As an optional specific embodiment, the device further includes:

[0108] A second input module, used for receiving a second input of a plurality of second videos;

[0109] A second response module, configured to determine a third video to be embedded with a watermark from a plurality of second videos in response to the second input;

[0110] a detection module, configured to detect the third video by using a highlight detection algorithm, and determine at least one third highlight video segment in the third video;

[0111] a watermark adding module, configured to add second blind watermark information to at least one of the third highlight video segments to obtain at least one first highlight video segment;

[0112] A generating module, configured to generate a fourth video based on the third video and at least one of the first highlight video segments;

[0113] The second saving module is used to save at least one of the first highlight video clips and the fourth video into the database.

[0114] As an optional specific embodiment, the detection module is specifically used to:

[0115] Detecting the third video using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video;

[0116] receiving editing input for at least one of the fourth highlight video clips;

[0117] In response to the editing input, at least one edited third highlight video segment is obtained.

[0118] As an optional specific embodiment, when the detection module detects the third video by using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video, it is specifically configured to:

[0119] Detecting the third video using the highlight detection algorithm to obtain at least one highlight time interval in the third video;

[0120] At least one of the highlight time intervals is marked at a corresponding position of the thumbnail control of the third video to obtain at least one of the fourth highlight video segments corresponding to the at least one highlight time interval.

[0121] In summary, in the embodiment of the present application, the user can add the second blind watermark information to the produced third video and save it to the database, which can not only protect the user's video copyright, but also the second blind watermark information cannot be perceived by the naked eye, does not affect the video viewing, and improves the user experience. After the user finds the suspected infringing first video, it is only necessary to compare whether the second blind watermark information of the second highlight video clip that is most similar to the first video clip in the database is consistent with the first blind watermark information of the first video clip in the first video, so as to determine whether the first video clip infringes the second highlight video clip, and quickly confirm the copyright ownership of the first video, without having to determine the blind watermark information of the entire first video, which can improve the efficiency of infringement determination and reduce resource consumption.

[0122] The device for determining the infringing video in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

[0123] The device for determining the infringing video in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0124] The device for determining infringing videos provided in the embodiment of the present application can achieve Figures 1 to 10 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0125] Alternatively, if Fig.12 As shown, an embodiment of the present application further provides an electronic device 1200, including a processor 1201 and a memory 1202, wherein the memory 1202 stores programs or instructions that can be executed on the processor 1201, and when the program or instructions are executed by the processor 1201, the various steps of the above-mentioned infringing video determination method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described again here.

[0126] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0127] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0128] The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.

[0129] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0130] The input unit 1004 is used to receive a first input of a first video;

[0131] The processor 1010 is configured to:

[0132] In response to the first input, selecting a first video segment of the first video;

[0133] Extracting first blind watermark information from the first video clip;

[0134] Acquire a first highlight video segment whose similarity with the first video segment is greater than a preset similarity from a database, determine the first highlight video segment as a second highlight video segment, and perform infringement judgment on the first video according to the first blind watermark information and the second blind watermark information in the second highlight video segment, wherein the database includes at least one first highlight video segment, and the second highlight video segment is one of at least one of the first highlight video segments;

[0135] When the first blind watermark information is the same as the second blind watermark information, the first video is determined to be an infringing video.

[0136] As an optional specific embodiment, when the first blind watermark information is the same as the second blind watermark information, after determining that the first video is an infringing video, the processor 1010 is further configured to:

[0137] Display infringement warning information;

[0138] The first video and the infringement prompt information are saved.

[0139] As an optional specific embodiment, the input unit 1004 is further used to receive a second input of a plurality of second videos;

[0140] The processor 1010 is further configured to:

[0141] In response to the second input, determining a third video to be watermarked from a plurality of second videos;

[0142] Detecting the third video using a highlight detection algorithm to determine at least one third highlight video segment in the third video;

[0143] Adding second blind watermark information to at least one of the third highlight video segments to obtain at least one first highlight video segment;

[0144] generating a fourth video based on the third video and at least one of the first highlight video segments;

[0145] At least one of the first highlight video clip and the fourth video is saved in the database.

[0146] As an optional specific embodiment, when the processor 1010 detects the third video by using a highlight detection algorithm to determine at least one third highlight video segment in the third video, it is specifically configured to:

[0147] Detecting the third video using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video;

[0148] receiving editing input for at least one of the fourth highlight video clips;

[0149] In response to the editing input, at least one edited third highlight video segment is obtained.

[0150] As an optional specific embodiment, when the processor 1010 detects the third video by using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video, it is specifically configured to:

[0151] Detecting the third video using the highlight detection algorithm to obtain at least one highlight time interval in the third video;

[0152] At least one of the highlight time intervals is marked at a corresponding position of the thumbnail control of the third video to obtain at least one of the fourth highlight video segments corresponding to the at least one highlight time interval.

[0153] In summary, in the embodiment of the present application, the user can add the second blind watermark information to the produced third video and save it to the database, which can not only protect the user's video copyright, but also the second blind watermark information cannot be perceived by the naked eye, does not affect the video viewing, and improves the user experience. After the user finds the suspected infringing first video, it is only necessary to compare whether the second blind watermark information of the second highlight video clip that is most similar to the first video clip in the database is consistent with the first blind watermark information of the first video clip in the first video, so as to determine whether the first video clip infringes the second highlight video clip, and quickly confirm the copyright ownership of the first video, without having to determine the blind watermark information of the entire first video, which can improve the efficiency of infringement determination and reduce resource consumption.

[0154] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0155] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0156] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1010.

[0157] The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned infringing video determination method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0158] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0159] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned infringing video determination method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0160] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0161] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned infringing video determination method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0162] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0163] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0164] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for determining an infringing video, characterized in that: include: Receiving a first input of a first video; In response to the first input, selecting a first video segment of the first video; Extracting first blind watermark information from the first video clip; Acquire a first highlight video segment whose similarity with the first video segment is greater than a preset similarity from a database, determine the first highlight video segment as a second highlight video segment, and perform infringement judgment on the first video according to the first blind watermark information and the second blind watermark information in the second highlight video segment, wherein the database includes at least one first highlight video segment, and the second highlight video segment is one of at least one of the first highlight video segments; When the first blind watermark information is the same as the second blind watermark information, the first video is determined to be an infringing video.

2. The method according to claim 1, characterized in that In the case where the first blind watermark information is the same as the second blind watermark information, after determining that the first video is an infringing video, the method further includes: Display infringement warning information; The first video and the infringement prompt information are saved.

3. The method according to claim 1, characterized in that The method further comprises: receiving a second input of a plurality of second videos; In response to the second input, determining a third video to be watermarked from a plurality of second videos; Detecting the third video using a highlight detection algorithm to determine at least one third highlight video segment in the third video; Adding second blind watermark information to at least one of the third highlight video segments to obtain at least one first highlight video segment; generating a fourth video based on the third video and at least one of the first highlight video segments; At least one of the first highlight video clip and the fourth video is saved in the database.

4. The method according to claim 3, characterized in that The detecting the third video by using a highlight detection algorithm to determine at least one third highlight video segment in the third video includes: Detecting the third video using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video; receiving editing input for at least one of the fourth highlight video clips; In response to the editing input, at least one edited third highlight video segment is obtained.

5. The method according to claim 4, characterized in that The detecting the third video by using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video includes: Detecting the third video using the highlight detection algorithm to obtain at least one highlight time interval in the third video; At least one of the highlight time intervals is marked at a corresponding position of the thumbnail control of the third video to obtain at least one of the fourth highlight video segments corresponding to the at least one highlight time interval.

6. A device for determining an infringing video, characterized in that: include: A first input module, used for receiving a first input of a first video; A first response module, configured to select a first video segment of the first video in response to the first input; An extraction module, used to extract the first blind watermark information in the first video clip; an infringement judgment module, configured to obtain from a database a first highlight video segment whose similarity to the first video segment is greater than a preset similarity, determine the first highlight video segment as a second highlight video segment, and perform infringement judgment on the first video according to the first blind watermark information and the second blind watermark information in the second highlight video segment, wherein the database includes at least one first highlight video segment, and the second highlight video segment is one of at least one of the first highlight video segments; A determination module is used to determine that the first video is an infringing video when the first blind watermark information is the same as the second blind watermark information.

7. The device according to claim 6, characterized in that The device also includes: Prompt module, used to display infringement prompt information; The first saving module is used to save the first video and the infringement prompt information.

8. The device according to claim 6, characterized in that The device also includes: A second input module, used for receiving a second input of a plurality of second videos; A second response module, configured to determine a third video to be embedded with a watermark from a plurality of second videos in response to the second input; a detection module, configured to detect the third video by using a highlight detection algorithm, and determine at least one third highlight video segment in the third video; a watermark adding module, configured to add second blind watermark information to at least one of the third highlight video segments to obtain at least one first highlight video segment; A generating module, configured to generate a fourth video based on the third video and at least one of the first highlight video segments; The second saving module is used to save at least one of the first highlight video clips and the fourth video into the database.

9. The device according to claim 8, characterized in that The detection module is specifically used for: Detecting the third video using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video; receiving editing input for at least one of the fourth highlight video clips; In response to the editing input, at least one edited third highlight video segment is obtained.

10. The device according to claim 9, characterized in that When the detection module detects the third video by using the highlight detection algorithm to obtain at least one fourth highlight video segment in the third video, the detection module is specifically used to: Detecting the third video using the highlight detection algorithm to obtain at least one highlight time interval in the third video; At least one of the highlight time intervals is marked at a corresponding position of the thumbnail control of the third video to obtain at least one of the fourth highlight video segments corresponding to the at least one highlight time interval.

Images