Indication and interaction for video matching

By using visual style indicators to distinguish between matching and non-matching video segments in the video playback interface, the problem of difficulty in intuitively displaying the matching relationship of video segments in existing technologies is solved, and a user-friendly function for viewing and synchronously playing matched segments is achieved.

WO2025213475A1PCT designated stage Publication Date: 2025-10-16BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/087620
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-12
Publication Date
2025-10-16

AI Technical Summary

Technical Problem

Existing technologies struggle to visually display the matching relationships between multiple video clips within a video, especially when the matching clip occupies a small portion of the progress bar, making it difficult for users to quickly locate and view the matching clip.

Method used

By presenting visual style indicators in the video playback interface, matching and non-matching video segments can be distinguished in the progress bar and associated areas, and detailed information can be provided in the matching display area, allowing users to select and view matching segments.

Benefits of technology

It enables users to view video clip matching relationships more conveniently and intuitively, supports synchronized playback and frame-by-frame comparison, and improves the efficiency of visualizing matching clips.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024087620_16102025_PF_FP_ABST
    Figure CN2024087620_16102025_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide a video matching method and apparatus, a device, a medium, and a product. The method comprises: displaying a first playback interface for a first video and a second playback interface for a second video; and on the basis of a content matching result between the first video and the second video, displaying first matching indication information in an area associated with the first playback interface and displaying second matching indication information in an area associated with the second playback interface, wherein the first matching indication information comprises visual style indicators respectively corresponding to at least one first clip, and the second matching indication information comprises visual style indicators respectively corresponding to at least one second clip; and the first clip of the first video and the second clip of the second video that are indicated as matching by the content matching result have identical visual style indicators, and the first clip of the first video and the second clip of the second video that are indicated as non-matching by the content matching result have different visual style indicators.
Need to check novelty before this filing date? Find Prior Art

Description

Indication and interaction of video matching TECHNICAL FIELD

[0001] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to methods, apparatuses, electronic devices, computer-readable storage media, and computer program products for video matching. BACKGROUND

[0002] With the rapid development of computer technology, a variety of videos also grow rapidly. In some scenarios, it is necessary to determine whether there is content matching each other between two or more videos. To meet the needs of users for matching a certain segment in a video with at least one segment in another video, a video matching task emerges as the times require. Therefore, as the video content diversifies, it is increasingly important to provide more intuitive matching indication information for users.

[0003] SUMMARY

[0004] In a first aspect of the present disclosure, a method for video matching is provided. The method comprises: presenting a first play interface of a first video and a second play interface of a second video; and presenting first matching indication information in a region associated with the first play interface and second matching indication information in a region associated with the second play interface based on a content matching result between the first video and the second video, wherein the first matching indication information comprises a visual style indication corresponding to each of at least one first segment in the first video, the second matching indication information comprises a visual style indication corresponding to each of at least one second segment in the second video, and wherein the visual style indications of the first segment of the first video and the second segment of the second video indicated as matching each other by the content matching result are the same, and the visual style indications of the first segment of the first video and the second segment in the second video indicated as not matching each other by the content matching result are different.

[0005] In a second aspect of the present disclosure, an apparatus for video matching is provided. The apparatus includes: an interface presentation model configured to present a first play interface of a first video and a second play interface of a second video; and an information presentation model configured to present first matching indication information in a region associated with the first play interface and second matching indication information in a region associated with the second play interface based on a content matching result between the first video and the second video, wherein the first matching indication information includes respective visual style indications of at least one first segment in the first video, the second matching indication information includes respective visual style indications of at least one second segment in the second video, and wherein the visual style indications of a first segment of the first video and a second segment of the second video indicated as matching each other by the content matching result are the same, and the visual style indications of a first segment of the first video and a second segment in the second video indicated as not matching each other by the content matching result are different.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. The instructions, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided. The computer-readable storage medium has stored thereon a computer program, which is executable by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of the present disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0009] It should be understood that nothing in the Summary is intended to limit the scope of the embodiments of the present disclosure or the claims which follow, either explicitly or implicitly, notwithstanding that certain features of the embodiments of the present disclosure, or the applications of the embodiments of the present disclosure are highlighted. BRIEF DESCRIPTION OF DRAWINGS

[0010] The above and other features, aspects and advantages of embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like reference numerals refer to like elements, wherein:

[0011] FIG. 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] FIGS. 2A-2B show schematic diagrams of example user interfaces for video matching, according to some embodiments of the present disclosure;

[0013] FIG. 3 shows a flowchart of a process for video matching, according to some embodiments of the present disclosure;

[0014] FIG. 4 shows a schematic structural block diagram of an apparatus for video matching, according to certain embodiments of the present disclosure; and

[0015] FIG. 5 shows a block diagram of an electronic device capable of implementing one or more embodiments of the present disclosure. DETAILED DESCRIPTION

[0016] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein, but rather, these embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It will be understood that the drawings of the present disclosure and the embodiments are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

[0017] In the description of embodiments of the present disclosure, the term "includes" and its derivatives, such as "including," should be understood in an open, inclusive sense, that is, "including, but not limited to." The term "based on" should be understood as "based at least in part on." The term "one embodiment" or "an embodiment" should be understood as "at least one embodiment." The term "some embodiments" should be understood as "at least some embodiments." Other explicit or implicit definitions can also be included below.

[0018] In this document, unless explicitly stated otherwise, performing a step "in response to" an event means performing the step in response to a determination that the event has occurred, which can include one or more intermediate steps.

[0019] It can be understood that the data involved in the technical solutions of the present disclosure (including but not limited to the data itself, the obtaining or use of the data) should comply with the requirements of the relevant laws and regulations and the relevant provisions.

[0020] It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the type of personal information involved in the present disclosure, the scope of use, the use scenario, etc. should be informed to the user and the authorization of the user should be obtained through appropriate means according to the relevant laws and regulations.

[0021] For example, in response to receiving an active request of a user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed by the user will require obtaining and using personal information of the user, so that the user can autonomously select whether to provide personal information to software or hardware such as an electronic device, an application program, a server or a storage medium performing the operation of the technical solution of the present disclosure according to the prompt information.

[0022] As an optional but non-limiting implementation manner, in response to receiving an active request of a user, the manner of sending prompt information to the user may, for example, be a pop-up window manner, and the prompt information may be presented in a text manner in the pop-up window. In addition, the pop-up window may also carry selection controls for the user to select “agree” or “disagree” to provide personal information to the electronic device.

[0023] It can be understood that the above notification and obtaining of user authorization process is only illustrative and does not limit the implementation manner of the present disclosure, and other manners meeting relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0024] As briefly described above, to meet the needs of users for matching a certain segment in a video with at least one segment in another video, a video matching task arises at the historic moment. For example, if one video is created based on another video, or two videos are generated based on the same content source or the same scene, there may be partially matching video segments in them. In performing video matching, whether there are identical or similar content segments in multiple videos can be determined through analysis of video content. The video matching result needs to be shown to the user in a visual manner.

[0025] There may be multiple mutually matching video segments in multiple videos, and these segments may appear at any position in each video and have different lengths. How to show the user accurate and convenient matching relationship indication is a problem. Simple labeling may not enable the user to intuitively see which video content is matched with each other. If the matched segment in the video has a very small proportion on the progress bar, the user may have difficulty in quickly hitting the segment for viewing.

[0026] In view of this, embodiments of the present disclosure provide an improved method for video matching. In this approach, a first play interface of a first video and a second play interface of a second video are presented. Then, according to a content matching result between the first video and the second video, a first matching indication information is presented in a region associated with the first play interface and a second matching indication information is presented in a region associated with the second play interface. The first matching indication information includes a visual style indication corresponding to each of at least one first segment in the first video, and the second matching indication information includes a visual style indication corresponding to each of at least one second segment in the second video. Correspondingly, the visual style indications of the first segment of the first video and the second segment of the second video indicated as matching each other by the content matching result are the same, and the visual style indications of the first segment of the first video and the second segment of the second video indicated as not matching each other by the content matching result are different.

[0027] In this way, the user can more conveniently and intuitively view which segments in different videos match each other. In addition, in some embodiments, the matching indication information can also be used to determine the position of these segments in the video or material and the proportion of the total duration, and the matching segments in different videos can also be played synchronously based on user selection to facilitate checking whether the matching result is reasonable. Further, if there are video segments processed by speed change in the video, synchronous playing can also be implemented to achieve the purpose of frame-by-frame comparison.

[0028] FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. The environment 100 includes a video matching platform 110, a user 140, and a video group 130 to be matched. The video group 130 can be uploaded or specified by the user 140 for video matching. The video group 130 can include multiple videos. In FIG. 1, two videos, video A and video B, are taken as examples for illustration. In some embodiments, the video group 130 uploaded by the user 140 can also include video A, video B, and other videos, etc., which are not limited by the present disclosure.

[0029] In the environment 100 of FIG. 1, the video matching platform 110 performs a video matching task based on the multiple videos uploaded or specified by the user 140, and presents an interface / page 150 based on the content matching result. This interface / page 150 can include any appropriate page that can be provided to indicate the content matching result of the multiple videos to the user. The interface / page 150 is also sometimes referred to herein as a "matching result presentation page".

[0030] The video matching platform 110 can be run on a suitable electronic device. The electronic device here can be any type of device with computing capability, including terminal devices and / or server devices. The terminal device can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including accessories and peripherals of such devices or any combination thereof. The server device can include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. In some embodiments, the video matching platform 110 can be implemented based on cloud services.

[0031] It should be understood that the structures and functions of the various elements in the environment 100 are described for illustrative purposes only, without implying any limitation on the scope of the present disclosure.

[0032] Various example implementations of the present disclosure will be described in detail below.

[0033] Example embodiments of image processing are described below with reference to the example interfaces / example pages shown in FIGS. 2A-2B.

[0034] For better understanding of various embodiments of the present disclosure, reference is made to the example user interfaces 200A-200B shown in FIGS. 2A-2B in the example embodiments below. FIGS. 2A-2B show schematic diagrams of example user interfaces 200A-200B for video matching, according to some embodiments of the present disclosure. It should be understood that the user interfaces shown in FIGS. 2A-2B and other figures below are merely examples, and various designs can actually exist. For example, various graphical elements and / or controls in the user interfaces can have different arrangements and different visual representations, one or more elements and / or controls among them can be omitted or replaced, and one or more other elements and / or controls can also exist. In addition, any suitable content can be included in the user interfaces. The scope of the present disclosure is not limited in this respect.

[0035] In example embodiments of the present disclosure, example user interfaces 200A-B can be presented at the video matching platform 110. For ease of discussion, some implementations of the present disclosure will be described with reference to the environment 100 of FIG. 1 and the example user interfaces 200A-B. While these embodiments are described as being implemented at the video matching platform 110 of FIG. 1, in particular at the application client of the video matching platform 110, in other embodiments, the video matching platform 110 can perform these operations with the assistance of a server device.

[0036] In the example of FIG. 2A, assume that the video group for which content matching is performed includes a first video and a second video. In the matching result presentation page, the video matching platform 110 presents a first playback interface of the first video and a second playback interface of the second video in the result showcase area. As shown in the example user interface 200A of FIG. 2A, the video matching platform 110 presents a first playback interface 201 of the first video and a second playback interface 202 of the second video in the result showcase area.

[0037] In some examples, the playback interface includes at least a video frame and a progress bar. As shown in the example user interface 200A of FIG. 2A, the first playback interface 201 includes at least a video frame 211 and a progress bar 212. The second playback interface 202 includes at least a video frame 221 and a progress bar 222.

[0038] In some embodiments, the video matching platform 110 presents first matching indication information in a region associated with the first playback interface of the first video based on the content matching result between the first video and the second video. Correspondingly, the video matching platform 110 also presents second matching indication information in a region associated with the second playback interface of the second video.

[0039] In some examples, the video matching platform 110 can match the first video with the second video and determine a content matching result between the first video and the second video. The content matching result can indicate a matching relationship between one or more segments in the first video and one or more segments in the second video. For example, one segment in the first video can match to one or more segments in the second video. A pair of segments in the two videos match each other if the content in the pair of segments is of a high similarity or reaches a certain threshold. The video matching platform 110 can utilize any suitable video matching technique and can determine whether a pair of segments in a video match each other according to any content matching criteria. Embodiments of the present disclosure are not limited as to how the video matching platform determines the content matching result.

[0040] The video matching platform 110 presents the first matching indication information and the second matching indication information in the respective associated areas of the first playback interface and the second playback interface according to the content matching result between the first video and the second video.

[0041] The area in the first playback interface and / or the second playback interface for presenting the matching indication information can include a progress bar within the respective playback interface, and / or a matching display area independent of the playback interface. As shown in the example user interface 200A of FIG. 2A, the associated area of the first playback interface includes a progress bar 212, and / or a matching display area 213 below. The associated area of the second playback interface includes a progress bar 222, and / or a matching display area 223 below the playback interface. The video matching platform 110 presents the first matching indication information and / or the second matching indication information in the respective associated progress bar and / or matching display area of the first playback interface and / or the second playback interface will be described in detail below with reference to FIGS. 2A-2B.

[0042] The first matching indication information and / or the second matching indication information includes a color element on the progress bar, and / or a matching segment display below. As shown in the example user interface 200A of FIG. 2A, the first matching indication information includes a color element on the progress bar 212, and / or a matching segment display below. The second matching indication information includes a color element on the progress bar 222, and / or a matching segment display below.

[0043] In some examples, the first matching indication information and / or the second matching indication information can include a progress bar. The first matching indication information and / or the second matching indication information can include a progress bar and a matching segment display area below. The present disclosure does not limit this.

[0044] In some embodiments, the first matching indication information includes a respective visual style indication of at least one first segment in the first video. The second matching indication information includes a respective visual style indication of at least one second segment in the second video.

[0045] Correspondingly, the visual style indications of the first segment of the first video and the second segment of the second video indicated as matching each other by the content matching result are the same, and the visual style indications of the first segment of the first video and the second segment of the second video indicated as not matching each other by the content matching result are different.

[0046] In some embodiments, the selectable visual style indications include, but are not limited to, color-based visual style indications, fill pattern-based visual style indications, graphical-based visual style indications, and any other visual styles that can be visually distinguished from each other. For example, mutually matching segments can be indicated with the same color, mutually non-matching segments can be indicated with non-identical colors, and so on. In the example of FIGS. 2A and 2B, different fill patterns are used as examples of different visual style indications. Of course, color-based visual style indications and fill pattern-based visual style indications can also be considered non-identical to each other. Embodiments of the present disclosure are not limited to specific visual styles. Selection and configuration can be made as needed in actual applications.

[0047] As shown in FIG. 2A, the video matching platform 110 can match the first video 211 with the second video 221 to obtain that there are four segments of matching content between the first video 211 and the second video 221 (e.g., segment 1 of the first video 211 matches segment 3 of the second video 221, segment 2 of the first video 211 matches segment 2 of the second video 221, segment 3 of the first video 211 matches segment 1 of the second video 221, and segment 4 of the first video 211 matches segment 4 of the second video 221). Based on the matching result of the first video 211 and the second video 221, the video matching platform 110 presents information of four different visual style indications (e.g., four different fill pattern visual style indications 212-1, 212-2, 212-3, 212-4) in the area associated with the first playback interface 201 (e.g., the area corresponding to the progress bar 212).

[0048] Accordingly, the video matching platform 110 also presents information of four different visual style indications (e.g., four different fill pattern visual style indications 222-1, 222-2, 222-3, 222-4) in the area associated with the second playback interface 202 (e.g., the area corresponding to the progress bar 222). In some examples, the video matching platform 110 uses the same visual style indication for the first segment of the first video 211 and the second segment of the second video 221.

[0049] For example, if the first segment of the first video 211 and the second segment of the second video 221 are matching video content, the video matching platform 110 uses the same visual style indication 212-1 for the first segment in the area corresponding to the progress bar 212 and the visual style indication 222-3 for the second segment in the area corresponding to the progress bar 222.

[0050] If the first segment of the first video 211 and the second segment of the second video 221 are mismatched video contents, the video matching platform 110 indicates the visual style of the first segment 212-1 and the visual style of the second segment 222-1 are different in the corresponding regions of the progress bars 212 and 222.

[0051] The following will continue to refer to FIGS. 2A-2B to describe the video matching platform 110 presenting the first matching indication information and / or the second matching indication information in the progress bars associated with the first playback interface and / or the second playback interface, and / or the matching display region below.

[0052] The following will first refer to FIG. 2A to describe the video matching platform 110 presenting the first matching indication information and / or the second matching indication information in the progress bars associated with the first playback interface and / or the second playback interface.

[0053] In some embodiments, the video matching platform 110 presents the first matching indication information on or in the adjacent region of the first progress bar of the first playback interface. The video matching platform 110 presents the first matching indication information (e.g., color elements, filling patterns, etc.) on or in the additional region adjacent to the first progress bar 212 of the first playback interface 201.

[0054] In some embodiments, the video matching platform 110 presents the second matching indication information on or in the adjacent region of the second progress bar of the second playback interface. The video matching platform 110 presents the second matching indication information (e.g., color elements, filling patterns, etc.) on or in the additional region adjacent to the second progress bar 222 of the second playback interface 202.

[0055] In some embodiments, the extension length of the visual style indication of each of the at least one first segment on or in the adjacent region of the first progress bar is the same as the length of the corresponding first segment.

[0056] In some examples, the extension length of the visual style indication of each of the at least one first segment on or in the adjacent region of the first progress bar 212 is the same as the length of the corresponding first segment. For example, the length of the visual style indication 212-1 of the first segment on the first progress bar 212 is the same as the time length of the video segment corresponding to the first segment. The length of the visual style indication 212-2 of the first segment on the first progress bar 212 is the same as the time length of the video segment corresponding to the first segment.

[0057] In some embodiments, the extension length of the visual style indication corresponding to each of the at least one second segment in the second progress bar or in the adjacent area of the second progress bar is the same as the length of the corresponding second segment.

[0058] In some examples, the extension length of the visual style indication corresponding to each of the at least one second segment in the second progress bar 222 or in the adjacent area of the second progress bar 222 is the same as the length of the corresponding second segment. For example, the length of the visual style indication 222-3 of the second segment in the second progress bar 222 is the same as the length of the corresponding video segment. The length of the visual style indication 222-1 of the second segment in the second progress bar 222 is the same as the length of the corresponding video segment.

[0059] The following continues to refer to FIGS. 2A-2B to describe the video matching platform 110 presenting the first matching indication information and / or the second matching indication information in the area associated with the first playback interface and / or the second playback interface, respectively (e.g., the matching display area below the first playback interface and / or the second playback interface).

[0060] In some embodiments, the video matching platform 110 presents the first matching indication information in the first area outside the first playback interface. In some examples, the video matching platform 110 presents the first matching indication information in the matching display area 213 below the first playback interface 201.

[0061] In some embodiments, the video matching platform 110 presents the second matching indication information in the second area outside the second playback interface. In some examples, the video matching platform 110 presents the second matching indication information in the matching display area 223 below the second playback interface 202.

[0062] In some embodiments, the size of the visual style indication corresponding to each of the at least one first segment in the first area is not proportional to the length of the corresponding first segment. Correspondingly, the size of the visual style indication corresponding to each of the at least one second segment in the second area is not proportional to the length of the corresponding second segment.

[0063] As shown in FIG. 2A, in the first area (e.g., the matching display area 213 below the first playback interface 201), the size of the visual style indication 213-2 corresponding to the first segment is not proportional to the length of the corresponding first segment. In the first area, the size of the visual style indication 213-3 corresponding to the first segment is not proportional to the length of the corresponding first segment.

[0064] In the second region (e.g., the match presentation region 223 below the second playback interface 202), the size of the visual style indication 223-1 corresponding to the second segment is not proportional to the length of the second segment it corresponds to. In the second region, the size of the visual style indication 223-4 corresponding to the second segment is also not proportional to the length of the second segment it corresponds to.

[0065] In some embodiments, when presenting the match indication information in the underlying match presentation region, the size of the presented visual style indication is not strongly correlated to the length of the matching segment. In this way, even if a segment is relatively short, the visual style indication corresponding to the segment can still have a certain size, which can facilitate user selection for viewing.

[0066] In some embodiments, the size of the visual style indications corresponding to the plurality of first segments can be the same, and the size of the visual style indications corresponding to the plurality of second segments can also be the same, regardless of the lengths of the segments. In some embodiments, among the plurality of first segments, the size of the visual style indication corresponding to a relatively long first segment can be greater (e.g., longer) than the size of the visual style indication corresponding to a relatively short first segment. For the plurality of second segments, the size of the visual style indications can also be set according to similar rules.

[0067] In some embodiments, in the first region, the size of the visual style indication corresponding to each of the at least one first segment is equal to or exceeds a lower limit size. Accordingly, in the second region, the size of the visual style indication corresponding to each of the at least one second segment is equal to or exceeds the lower limit size.

[0068] In some examples, by setting the lower limit size, the size of the box in the underlying match presentation region is always greater than or equal to the lower limit size, regardless of the length of the segment for which match indication is provided. This can also facilitate user selection and viewing.

[0069] In some embodiments, the video matching platform 110, in response to detecting selection of the first visual style indication corresponding to the target first segment in the first region, expands the first visual style indication in the first region. Accordingly, the video matching platform 110, in response to detecting selection of the second visual style indication corresponding to the target second segment in the second region, expands the second visual style indication in the second region.

[0070] In some examples, if the video matching platform 110 detects that the user 140 selects the first visual style indication 213-1 corresponding to the target first segment in the matching display region 213, the first visual style indication 213-1 is expanded in the matching display region 213. If the video matching platform 110 detects that the user 140 selects the second visual style indication 223-3 corresponding to the target second segment in the matching display region 223, the second visual style indication 223-3 is expanded in the matching display region 223.

[0071] In some embodiments, in response to the first visual style indication being expanded, the video matching platform 110 presents the time range occupied by the target first segment in the first video in association with the expanded first visual style indication. Similarly, in response to the second visual style indication being expanded, the video matching platform 110 presents the time range occupied by the target second segment in the second video in association with the expanded second visual style indication.

[0072] For example, in FIG. 2A, if the visual style indication 213-1 of segment 1 in the first video is expanded, the video matching platform 110 presents the time range occupied by the segment in the first video, e.g., the segment length is 7S and the time range is 00:00-00:07, on the expanded visual style indication 213-1.

[0073] If the visual style indication 223-3 of segment 3 in the second video is expanded, the video matching platform 110 presents the time range occupied by the segment 3 in the second video, e.g., the segment length is 28S and the time range is 31:12-31:40, in association with the expanded visual style indication 223-3.

[0074] For ease of understanding, the following description will refer to the video matching platform 110 expanding the first visual style indication and / or the second visual style indication in the first region and / or the second region in response to detecting the selection of the first visual style indication and / or the second visual style indication corresponding to the target first segment and / or the target second segment in the first region and / or the second region. For ease of understanding, the first region and / or the second region will be collectively referred to as the matching display region, the target first segment and / or the target second segment will be collectively referred to as the target segment, and the first visual style indication and / or the second visual style indication will be collectively referred to as the visual style indication. However, this is merely exemplary and the present disclosure is not limited thereto.

[0075] As shown in the example interface 200B of FIG. 2B, if the video matching platform 110 detects that the user 140 selects the visual style indicator 231-1 corresponding to the target segment in the match showcase area 231, the video matching platform 110 expands the visual style indicator 231-1 corresponding to the target segment in the match showcase area 231. The match showcase area 232 shown in FIG. 2B is the expanded version of the visual style indicator 231-1 corresponding to the target segment.

[0076] If the visual style indicator 231-1 corresponding to the target segment is expanded, the video matching platform 110 presents the time range of the target segment in the video to which the target segment 231-1 belongs in association with the expanded visual style indicator. For example, the target segment 1 occupies 7 seconds in the video to which it belongs, and the time range is: 00:00-00:07.

[0077] The video matching platform 110 presents the first match indication information and / or the second match indication information in the progress bar associated with the first playback interface and / or the second playback interface, and / or the match showcase area below, as described above.

[0078] The following will continue to describe that the user selects the visual style indicator corresponding to a segment, and the video matching platform 110 presents a secondary progress bar corresponding to the segment so that the user can view each frame corresponding to the segment.

[0079] In some embodiments, the video matching platform 110 presents a secondary progress bar corresponding to the target first segment in an area outside the first progress bar of the first playback interface in response to detecting the selection of the first visual style indicator corresponding to the target first segment in the first match indication information. The secondary progress bar is longer than the target first segment. In some examples, the user 140 can view each frame corresponding to the target first segment based on the secondary progress bar.

[0080] If the user 140 selects the visual style indicator 212-1 corresponding to the target first segment in the first progress bar 212 corresponding to the target first segment in the first match indication information, the video matching platform 110 presents a secondary progress bar corresponding to the target first segment in an area outside the first progress bar 212.

[0081] Additionally, if the user 140 selects the visual style indicator 213-1 corresponding to the target first segment in the match showcase area 213 corresponding to the target first segment in the first match indication information, the video matching platform 110 can jump to the position of the visual style indicator 212-1 corresponding to the target first segment in the first progress bar 212, and present a secondary progress bar corresponding to the target first segment in an area outside the first progress bar 212.

[0082] Accordingly, in response to detecting the selection of the second visual style indication corresponding to the target second segment in the second matching indication information, the video matching platform 110 presents a secondary progress bar corresponding to the target second segment in a region outside the second progress bar of the second playback interface. The secondary progress bar is longer than the length of the target second segment. In some examples, the user 140 can view each frame corresponding to the target second segment based on the secondary progress bar.

[0083] If the user 140 selects the visual style indication 222-3 corresponding to the target second segment in the second progress bar 222 corresponding to the target second segment in the second matching indication information, the video matching platform 110 presents a secondary progress bar 224 corresponding to the target second segment in a region outside the second progress bar 222.

[0084] Additionally, if the user 140 selects the visual style indication 223-3 corresponding to the target second segment in the matching display region 223 corresponding to the target second segment in the second matching indication information, the video matching platform 110 can jump to the position of the visual style indication 222-3 corresponding to the target second segment in the second progress bar 222 and present a secondary progress bar 224 corresponding to the target second segment in a region outside the second progress bar 222 so that the user 140 can view the second segment frame by frame.

[0085] In some embodiments, regardless of whether the user selects the visual style indication corresponding to a certain segment in the first video or the second video on the progress bar, a secondary progress bar corresponding to the selected segment can be presented. Since the secondary progress bar is longer, it can be convenient for the user to select a position of the segment in the secondary progress bar for viewing.

[0086] In some embodiments, the first matching indication information presented by the video matching platform 110 in the region associated with the first playback interface includes a length indication of each of the at least one first segment presented in association with the first matching indication information.

[0087] As shown in the example user interface 200A of FIG. 2A, if a first segment (e.g., segment 1) of the first video matches a second segment (e.g., segment 3) of the second video, the video matching platform 110 presents a length indication (e.g., 7S) of the first segment on the first visual style indication 213-1 corresponding to the first segment in the region (e.g., matching display region 213) associated with the first playback interface 201 of the first video.

[0088] In some embodiments, the second matching indication information presented by the video matching platform 110 in the region associated with the second playback interface includes a length indication of each of the at least one second segment presented in association with the second matching indication information.

[0089] As shown in the example user interface 200A of FIG. 2A, if the first segment (e.g., segment 1) of the first video matches the second segment (e.g., segment 3) of the second video, the video matching platform 110 presents a length indication (e.g., 28S) of the second segment on a second visual style indication 223-3 corresponding to the second segment in a region (e.g., matching showcase region 223) associated with the second playback interface 202 of the second video.

[0090] In some embodiments, although only the presentation of the length indication of each segment at the matching indication information in the matching showcase region is shown in the figures, additionally or alternatively, the length indication of each segment can also be presented at the matching indication information in or near the progress bar of each of the first video and the second video. Embodiments of the present disclosure do not limit this.

[0091] In the foregoing, various embodiments of presenting matching indication information of matching segments in videos are described in connection with the matching between two videos. It should be understood that embodiments of the present disclosure can also be similarly applied to scenarios where three or more videos need to be matched. In such scenarios, based on the content matching result of the three or more videos, matching indication information discussed in embodiments of the present disclosure can be used to indicate the matching video segments in the three or more videos to let users quickly understand and determine which segments in the videos are matching each other, obtain more information related to the matching segments. In addition, it is also possible to support users to conveniently and quickly view each segment in each video.

[0092] In summary, by using matching indication information (e.g., color elements or any other visual indication), it is possible to more explicitly correspond the matching segments in the first video and the second video on the progress bar and / or other associated regions. By the matching showcase region, it is more convenient for users to select and view the matching segments. Further, in some scenarios (e.g., when the length of a segment occupies on the progress bar is particularly short), by providing a secondary progress bar, it is more convenient for users to perform fine selection operations.

[0093] FIG. 3 illustrates a flowchart of a process 300 for video matching, according to some embodiments of the present disclosure. The process 300 can be implemented at the video matching platform 110. The process 300 is described below with reference to FIG. 1.

[0094] At block 310, the video matching platform 110 presents a first playback interface of a first video and a second playback interface of a second video.

[0095] At block 320, the video matching platform 110 presents the first matching indication information in the region associated with the first playback interface and the second matching indication information in the region associated with the second playback interface based on the content matching result between the first video and the second video, where the first matching indication information includes the respective visual style indication of each of the at least one first segment in the first video, the second matching indication information includes the respective visual style indication of each of the at least one second segment in the second video, and where the visual style indications of the first segment of the first video and the second segment of the second video that are indicated as matching each other by the content matching result are the same, and the visual style indications of the first segment of the first video and the second segment of the second video that are indicated as not matching each other by the content matching result are different.

[0096] In some embodiments, presenting the first matching indication information in the region associated with the first playback interface and the second matching indication information in the region associated with the second playback interface includes: presenting the first matching indication information on the first progress bar of the first playback interface or in an adjacent region of the first progress bar; and presenting the second matching indication information on the second progress bar of the second playback interface or in an adjacent region of the second progress bar.

[0097] In some embodiments, the extension length of the respective visual style indication of each of the at least one first segment is the same as the length of the corresponding first segment on the first progress bar or in the adjacent region of the first progress bar; and where the extension length of the respective visual style indication of each of the at least one second segment is the same as the length of the corresponding second segment on the second progress bar or in the adjacent region of the second progress bar.

[0098] In some embodiments, presenting the first matching indication information in the region associated with the first playback interface and the second matching indication information in the region associated with the second playback interface includes: presenting the first matching indication information in a first region outside the first playback interface; and presenting the second matching indication information in a second region outside the second playback interface.

[0099] In some embodiments, the size of the respective visual style indication of each of the at least one first segment in the first region is not proportional to the length of the corresponding first segment; and where the size of the respective visual style indication of each of the at least one second segment in the second region is not proportional to the length of the corresponding second segment.

[0100] In some embodiments, the size of the respective visual style indication of each of the at least one first segment in the first region is equal to or exceeds a lower limit size, and the size of the respective visual style indication of each of the at least one second segment in the second region is equal to or exceeds the lower limit size.

[0101] In some embodiments, the process 300 further includes: in response to detecting selection of the first visual style indication corresponding to the target first segment in the first region, expanding the first visual style indication in the first region; and / or in response to detecting selection of the second visual style indication corresponding to the target second segment in the second region, expanding the second visual style indication in the second region.

[0102] In some embodiments, the process 300 further includes: in response to the first visual style indication being expanded, presenting the time range occupied by the target first segment in the first video in association with the expanded first visual style indication; and / or in response to the second visual style indication being expanded, presenting the time range occupied by the target second segment in the second video in association with the expanded second visual style indication.

[0103] In some embodiments, the process 300 further includes: in response to detecting selection of the first visual style indication corresponding to the target first segment in the first match indication information, presenting a secondary progress bar corresponding to the target first segment in a region other than the first progress bar of the first playback interface, the secondary progress bar being greater than the length of the target first segment; and / or in response to detecting selection of the second visual style indication corresponding to the target second segment in the second match indication information, presenting a secondary progress bar corresponding to the target second segment in a region other than the second progress bar of the second playback interface, the secondary progress bar being greater than the length of the target second segment.

[0104] In some embodiments, presenting the first match indication information in the region associated with the first playback interface and presenting the second match indication information in the region associated with the second playback interface includes: presenting respective length indications of the at least one first segment in association with the first match indication information; and presenting respective length indications of the at least one second segment in association with the second match indication information.

[0105] FIG. 4 shows a schematic structural block diagram of an apparatus 400 for video matching, according to certain embodiments of the present disclosure. The apparatus 400 can be implemented as or included in the video matching platform 110. Various modules / components in the apparatus 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0106] As shown, the apparatus 400 includes an interface presenting module 410 configured to present a first play interface of a first video and a second play interface of a second video. The apparatus 400 further includes an information presenting module 420 configured to present, based on a content matching result between the first video and the second video, first matching indication information in a region associated with the first play interface and second matching indication information in a region associated with the second play interface, wherein the first matching indication information comprises respective visual style indications of at least one first segment in the first video, the second matching indication information comprises respective visual style indications of at least one second segment in the second video, and wherein the visual style indications of a first segment of the first video and a second segment of the second video indicated as matching each other by the content matching result are identical, and the visual style indications of a first segment of the first video and a second segment in the second video indicated as not matching each other by the content matching result are different.

[0107] In some embodiments, the information presenting module 420, in presenting the first matching indication information in the region associated with the first play interface, is further configured to present the first matching indication information on a first progress bar of the first play interface or in a neighboring region of the first progress bar; and present the second matching indication information on a second progress bar of the second play interface or in a neighboring region of the second progress bar.

[0108] In some embodiments, the respective visual style indications of the at least one first segment each have a length identical to a length of the corresponding first segment on the first progress bar or in the neighboring region of the first progress bar; and the respective visual style indications of the at least one second segment each have a length identical to a length of the corresponding second segment on the second progress bar or in the neighboring region of the second progress bar.

[0109] In some embodiments, the information presenting module 420, in presenting the first matching indication information in the region associated with the first play interface, is further configured to present the first matching indication information in a first region outside the first play interface; and present the second matching indication information in a second region outside the second play interface.

[0110] In some embodiments, sizes of the respective visual style indications of the at least one first segment each are not proportional to lengths of the corresponding first segment in the first region; and sizes of the respective visual style indications of the at least one second segment each are not proportional to lengths of the corresponding second segment in the second region.

[0111] In some embodiments, sizes of the respective visual style indications of the at least one first segment each are equal to or exceed a lower limit size in the first region, and sizes of the respective visual style indications of the at least one second segment each are equal to or exceed the lower limit size in the second region.

[0112] In some embodiments, the apparatus 400 further includes an indication expanding module configured to, in response to detecting a selection of the first visual style indication corresponding to the target first segment in the first region, expand the first visual style indication in the first region; and / or in response to detecting a selection of the second visual style indication corresponding to the target second segment in the second region, expand the second visual style indication in the second region.

[0113] In some embodiments, the apparatus 400 further includes a range presenting module configured to, in response to the first visual style indication being expanded, present the time range occupied by the target first segment in the first video in association with the expanded first visual style indication; and / or in response to the second visual style indication being expanded, present the time range occupied by the target second segment in the second video in association with the expanded second visual style indication.

[0114] In some embodiments, the apparatus 400 further includes a progress bar presenting module configured to, in response to detecting a selection of the first visual style indication corresponding to the target first segment in the first matching indication information, present a secondary progress bar corresponding to the target first segment in a region outside of the first progress bar of the first play interface, the secondary progress bar being greater than the length of the target first segment; and / or in response to detecting a selection of the second visual style indication corresponding to the target second segment in the second matching indication information, present a secondary progress bar corresponding to the target second segment in a region outside of the second progress bar of the second play interface, the secondary progress bar being greater than the length of the target second segment.

[0115] In some embodiments, the first matching indication information is presented in a region associated with the first play interface, and the information presenting module 420 is further configured to present at least one length indication of each of the first segments in association with the first matching indication information; and present at least one length indication of each of the second segments in association with the second matching indication information.

[0116] FIG. 5 illustrates a block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 500 illustrated in FIG. 5 is merely exemplary and should not be construed as limiting on the functionality and scope of the embodiments described herein. The electronic device 500 illustrated in FIG. 5 can be used to implement the video matching platform 110 of FIG. 1 or the apparatus 400 of FIG. 4.

[0117] As shown in FIG. 5, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 can include, but are not limited to, one or more processors or processing units 510, memory 520, storage 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processing unit(s) 510 can be real or virtual processors and capable of executing various processing in accordance with programs stored in memory 520. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing power of electronic device 500.

[0118] Electronic device 500 typically includes a plurality of computer storage media. Such media can be removable and / or non-removable, volatile and / or non-volatile. Memory 520 can be volatile (such as registers, cache, random access memory (RAM)), non-volatile (such as read-only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory), or some combination thereof. Storage 530 can be removable or non-removable and can include machine- readable media such as flash drives, disks, or any other media capable of storing information and / or data (e.g., training data for training) and accessible by electronic device 500.

[0119] Electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, a disk drive or other computer-readable media drive can be provided for reading from or writing to a removable, non-removable, volatile, or non-volatile media slot (e.g., a “floppy disk”). In such cases, each drive can be connected to the bus (not shown) by one or more data media interfaces. Memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0120] Communication unit(s) 540 enable communication with other electronic devices via communication media. Additionally, functionality of components of electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines capable of communicating over a communication connection. Thus, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in a distributed environment.

[0121] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown), such as storage devices, display devices, etc., one or more devices that enable a user to interact with the electronic device 500, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 500 to communicate with one or more other electronic devices, as desired via the communication unit 540. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0122] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0123] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0124] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0125] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0126] The computer program product of the present disclosure can be a computer program product, which is a machine-readable medium (media) having instances of the software embodied thereon, such as computer software, firmware, wireless application protocol (WAP), middleware or microcode. For example, a computer program product can be a floppy disk, a CD-ROM, a DVD, a Blu-ray Disc™, a flash drive, a memory stick, a magnetic tape, or a hard disk drive. The machine-readable medium can be a single medium, or multiple media, of the same or different type. The computer program product can be one or more computer program components embodied in medium and / or transmission signals. The computer program product can have one or more computer program components embodied in medium and / or transmission signals.

[0127] The implementations of the disclosure have been described above with the intent to be illustrative rather than limiting. Although the implementations of the disclosure have been described with regard to one or more implementations, it will be recognized that a variety of modifications and changes can be made to these implementations without departing from the broader spirit and scope of the implementations as set forth in the preceding disclosure. For example, certain aspects of the implementations can be performed using hardware, software, and / or firmware, or any combination thereof. The above-described implementations should therefore be regarded as merely illustrative, and not as narrowing the scope of the disclosure, which is defined by the appended claims and their equivalents.

Claims

1. A method for video matching, comprising: Presenting a first playback interface for the first video and a second playback interface for the second video; as well as Based on the content matching result between the first video and the second video, first matching indication information is presented in an area associated with the first playback interface and second matching indication information is presented in an area associated with the second playback interface. The first matching indication information includes a visual style indication corresponding to at least one first segment in the first video, the second matching indication information includes a visual style indication corresponding to at least one second segment in the second video, and The visual style indications of the first segment of the first video and the second segment of the second video, which are indicated as matching each other by the content matching result, are the same, and the visual style indications of the first segment of the first video and the second segment of the second video, which are indicated as not matching each other by the content matching result, are different.

2. The method according to claim 1, wherein presenting first matching indication information in an area associated with the first playback interface and presenting second matching indication information in an area associated with the second playback interface comprises: presenting the first matching indication information on a first progress bar of the first playback interface or in an area adjacent to the first progress bar; as well as The second matching indication information is presented on the second progress bar of the second playback interface or in an adjacent area of ​​the second progress bar.

3. The method according to claim 2, wherein on the first progress bar or in an adjacent area of ​​the first progress bar, an extension length of a visual style indication corresponding to each of the at least one first segment is the same as a length of the corresponding first segment; and Wherein, on the second progress bar or in an adjacent area of ​​the second progress bar, an extension length of a visual style indication corresponding to each of the at least one second segments is the same as a length of the corresponding second segment.

4. The method according to claim 1, wherein presenting first matching indication information in an area associated with the first playback interface and presenting second matching indication information in an area associated with the second playback interface comprises: Presenting the first matching indication information in a first area outside the first playback interface; as well as The second matching indication information is presented in a second area outside the second playback interface.

5. The method according to claim 4, wherein a size of the visual style indicator corresponding to each of the at least one first fragment in the first area is not proportional to a length of the corresponding first fragment; and Wherein, in the second area, a size of the visual style indicator corresponding to each of the at least one second segment is not proportional to a length of the corresponding second segment.

6. The method according to claim 4, wherein the size of the visual style indication corresponding to each of the at least one first fragment in the first area is equal to or exceeds the lower limit size, and the size of the visual style indication corresponding to each of the at least one second fragment in the second area is equal to or exceeds the lower limit size.

7. The method according to claim 4, further comprising: In response to detecting selection of a first visual style indication corresponding to a target first fragment in the first area, expanding the first visual style indication in the first area; and / or In response to detecting selection of a second visual style indication corresponding to a target second fragment in the second area, the second visual style indication is expanded in the second area.

8. The method according to claim 7, further comprising: In response to the first visual style indication being expanded, presenting a time range occupied by the target first segment in the first video in association with the expanded first visual style indication; and / or In response to the second visual style indication being extended, a time range occupied by the target second segment in the second video is presented in association with the extended second visual style indication.

9. The method according to claim 1, further comprising: In response to detecting selection of the first visual style indication corresponding to the target first segment in the first matching indication information, presenting a secondary progress bar corresponding to the target first segment in an area outside the first progress bar of the first playback interface, the secondary progress bar being longer than the target first segment; and / or In response to detecting selection of the second visual style indication corresponding to the target second segment in the second matching indication information, a secondary progress bar corresponding to the target second segment is presented in an area outside the second progress bar of the second playback interface, and the secondary progress bar is larger than the length of the target second segment.

10. The method according to claim 1, wherein presenting first matching indication information in an area associated with the first playback interface and presenting second matching indication information in an area associated with the second playback interface comprises: presenting, in association with the first matching indication information, an indication of a length of each of the at least one first segment; as well as A length indication of each of the at least one second segment is presented in association with the second matching indication information.

11. A device for video matching, comprising: An interface presentation model is configured to present a first playback interface of a first video and a second playback interface of a second video; as well as an information presentation model configured to present first matching indication information in an area associated with the first playback interface and second matching indication information in an area associated with the second playback interface based on a content matching result between the first video and the second video; The first matching indication information includes a visual style indication corresponding to at least one first segment in the first video, the second matching indication information includes a visual style indication corresponding to at least one second segment in the second video, and The visual style indications of the first segment of the first video and the second segment of the second video, which are indicated as matching each other by the content matching result, are the same, and the visual style indications of the first segment of the first video and the second segment of the second video, which are indicated as not matching each other by the content matching result, are different.

12. An electronic device comprising: at least one processing unit; as well as At least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 10 when executed by the at least one processing unit.

13. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 10.

14. A computer program product tangibly stored in a computer storage medium and comprising computer executable instructions which, when executed by a device, cause the device to perform the method according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Video clip positioning method and device, computer equipment and storage medium

    CN111866607A

  • Video drainage method and related equipment

    CN114640868A

  • Video matching method and device, electronic equipment and storage medium

    CN116385934A

  • Method, device and equipment for content interaction and storage medium

    CN117851681A

  • Video Switching Method and Apparatus, Storage Medium, and Device

    US20240064346A1