Conference video tagging interaction method, device, computer equipment and storage medium
By marking the personnel icons and target progress bars in the progress bar of the conference video and obtaining the target video segment, the problem of low efficiency in speech in the prior art focusing on specific personnel in video conferences is solved, and efficient video interaction and acquisition are achieved.
Patent Information
- Application Number
- CN202111605583.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-25
- Publication Date
- 2025-02-18
- Estimated Expiration
- 2041-12-25
AI Technical Summary
In the prior art, if you want to pay attention to the speeches of certain participants in a video conference, you need to fully view the conference images and perform editing operations, which is extremely inefficient.
Provide a tag interaction method for conference videos, by receiving selection and marking instructions, marking personnel icons and target progress bars in the progress bar of conference videos, and obtaining target video segments.
Without the need to watch the conference video in full, you can freely obtain the target video segments for any time period, which improves the efficiency of paying attention to specific people's pictures, and intuitively displays the following content through the progress bar and video segment.
Smart Images

Figure CN114296593B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of video processing technology, and in particular to a marking interaction method, device, computer equipment and storage medium for conference videos. Background Art
[0002] Video conferencing allows multiple participants in multiple locations to have face-to-face conversations through communication equipment and the Internet. With the rapid development of Internet technology, video conferencing has become more widely used. After the video conference, the video conference images can be saved. In the existing technology, if you want to pay attention to the speeches of some participants in the video conference, you need to watch the entire conference image and perform editing operations while watching. You can only view the video clips of the participants you are interested in again; this interactive method wastes a lot of time and energy and is extremely inefficient. Summary of the invention
[0003] Based on this, it is necessary to provide a marking interaction method, device, computer equipment and storage medium for conference videos in response to the above technical problems.
[0004] In a first aspect, the present application provides a conference video tagging interaction method. The method comprises:
[0005] receiving a first selection instruction including a first moment through the conference video, and displaying a first set of person icons corresponding to the first moment;
[0006] In response to a first marking instruction received by any first person icon in the first person icon set, marking the any first person icon in the progress bar of the conference video based on the first moment;
[0007] receiving a second selection instruction including a second moment through the conference video, and displaying a second set of personnel icons corresponding to the second moment;
[0008] In response to a second marking instruction received by any second person icon in the second person icon set, if the any second person icon is the same as the any first person icon, marking the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0009] Based on the target progress bar and the conference video, a target video segment corresponding to any second person icon is obtained.
[0010] In one embodiment, displaying the first person icon set corresponding to the first moment includes:
[0011] Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video;
[0012] Determine a number of first persons appearing in the first video segment, and obtain a first person icon of each first person to obtain a first person icon set;
[0013] The first person icon set is displayed in the conference video, wherein a display position of the first person icon set corresponds to a position of the first moment in the progress bar.
[0014] In one embodiment, displaying any first person icon in the progress bar of the conference video based on the first moment includes:
[0015] Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video;
[0016] In the first video, a first marked moment when a first person corresponding to any first person icon appears for the first time is determined, and any first person icon is displayed at the first marked moment of the progress bar.
[0017] In one embodiment, marking any second person icon in the progress bar and a target progress bar corresponding to any second person icon based on the first moment and the second moment includes:
[0018] Based on the second moment and the preset interval, obtaining a second video segment corresponding to the second moment in the conference video;
[0019] In the second video segment, determining a second marked time at which the second person last appeared corresponding to any second person icon, and displaying any second person icon at the second marked time on the progress bar;
[0020] The portion of the progress bar from the first marking moment to the second marking moment in the progress bar is used as a target progress bar, and the target progress bar is highlighted.
[0021] In one embodiment, the method further comprises:
[0022] In response to the play instruction received by the target progress bar, play the target video segment;
[0023] After the target video segment is played, the second marked moment is used as the playback start moment to play the conference video.
[0024] In one embodiment, the method further comprises:
[0025] Displaying a thumbnail corresponding to the target video segment in a preset video directory hot zone;
[0026] In response to a loop playback instruction received by the thumbnail, the target video segment corresponding to the thumbnail is looped in a preset playback hot zone, wherein the loop playback instruction is an instruction triggered by the operation of moving any of the first person icons or any of the second person icons to the thumbnail.
[0027] In a second aspect, the present application also provides a conference video marking interaction device. The device includes:
[0028] A first personnel icon set determination module, configured to receive a first selection instruction including a first moment through a conference video, and display a first personnel icon set corresponding to the first moment;
[0029] A first marking module, configured to respond to a first marking instruction received by any first person icon in the first person icon set, and mark the any first person icon in the progress bar of the conference video based on the first moment;
[0030] A second personnel icon set determination module is used to receive a second selection instruction including a second moment through the conference video, and display a second personnel icon set corresponding to the second moment;
[0031] A second marking module, configured to respond to a second marking instruction received by any second person icon in the second person icon set, and if the any second person icon is the same as the any first person icon, mark the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0032] The target video segment acquisition module is used to acquire the target video segment corresponding to any second person icon based on the target progress bar and the conference video.
[0033] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:
[0034] receiving a first selection instruction including a first moment through the conference video, and displaying a first set of person icons corresponding to the first moment;
[0035] In response to a first marking instruction received by any first person icon in the first person icon set, marking the any first person icon in the progress bar of the conference video based on the first moment;
[0036] receiving a second selection instruction including a second moment through the conference video, and displaying a second set of personnel icons corresponding to the second moment;
[0037] In response to a second marking instruction received by any second person icon in the second person icon set, if the any second person icon is the same as the any first person icon, marking the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0038] Based on the target progress bar and the conference video, a target video segment corresponding to any second person icon is obtained.
[0039] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0040] receiving a first selection instruction including a first moment through the conference video, and displaying a first set of person icons corresponding to the first moment;
[0041] In response to a first marking instruction received by any first person icon in the first person icon set, marking the any first person icon in the progress bar of the conference video based on the first moment;
[0042] receiving a second selection instruction including a second moment through the conference video, and displaying a second set of personnel icons corresponding to the second moment;
[0043] In response to a second marking instruction received by any second person icon in the second person icon set, if the any second person icon is the same as the any first person icon, marking the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0044] Based on the target progress bar and the conference video, a target video segment corresponding to any second person icon is obtained.
[0045] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:
[0046] receiving a first selection instruction including a first moment through the conference video, and displaying a first set of person icons corresponding to the first moment;
[0047] In response to a first marking instruction received by any first person icon in the first person icon set, marking the any first person icon in the progress bar of the conference video based on the first moment;
[0048] receiving a second selection instruction including a second moment through the conference video, and displaying a second set of personnel icons corresponding to the second moment;
[0049] In response to a second marking instruction received by any second person icon in the second person icon set, if the any second person icon is the same as the any first person icon, marking the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0050] Based on the target progress bar and the conference video, a target video segment corresponding to any second person icon is obtained.
[0051] The above-mentioned conference video marking interaction method, device, computer equipment, storage medium and computer program product do not need to watch the entire conference video when it is necessary to pay attention to the picture of a certain person in the conference video. The target video segment of any first person in any time period can be freely obtained in the conference video, and in the progress bar of the conference video, any first person icon, any second person icon and the target progress bar of the first person can be marked. The progress bar can intuitively display what the user is paying attention to: the picture of the first person in the target progress bar; and the specific picture of the person the user is paying attention to in the target progress bar can be understood through the target video segment. BRIEF DESCRIPTION OF THE DRAWINGS
[0052] Figure 1 A schematic diagram of a flow chart of a conference video marking interaction method in one embodiment;
[0053] Figure 2 is a schematic diagram showing a first person icon set in one embodiment;
[0054] Figure 3 A schematic diagram of marking any first person icon in an embodiment;
[0055] Figure 4 A schematic diagram of marking any second person icon in an embodiment;
[0056] Figure 5 A schematic diagram of a target progress bar marked in one embodiment;
[0057] Figure 6 A schematic diagram of a target progress bar marking multiple persons in one embodiment;
[0058] Figure 7A schematic diagram of a hot zone included in a display screen in one embodiment;
[0059] Figure 8 is a structural block diagram of a marking interaction device for conference video in one embodiment;
[0060] Fig. 9 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0061] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0062] In one embodiment, Figure 1 As shown, a conference video marking interaction method is provided. This embodiment takes the method applied to a terminal as an example. In this embodiment, the method includes the following steps:
[0063] S101, receiving a first selection instruction including a first moment through a conference video, and displaying a first person icon set corresponding to the first moment.
[0064] Among them, the conference video can be a video obtained after a video conference, or it can be a video of any conference that is shot or downloaded; the first selection instruction can be triggered by the user's selection operation, and the user's selection operation can be triggered by a virtual button, or a preset gesture, or a preset shortcut key; the first selection instruction acts on the first moment of the duration corresponding to the conference video; the first person icon set corresponding to the first moment is a set of icons of all first persons appearing in a conference video before and after the first moment.
[0065] Specifically, through the first moment of the progress bar of the conference video, a first selection instruction is received, all first persons appearing in a conference video before and after the first moment are determined to determine the first person icon set, and the first person icon set is displayed.
[0066] For example, the duration of conference video F is 30 minutes. The first selection instruction is received at 5 minutes and 6 seconds of conference video F. A conference video before and after 5 minutes and 6 seconds is obtained in conference video F. All first persons are determined to include: a1, b1 and c1. The first person icon set corresponding to a1, b1 and c1 is obtained and displayed.
[0067] S102: In response to a first marking instruction received by any first person icon in the first person icon set, display the any first person icon in a progress bar of the conference video based on the first moment.
[0068] Specifically, the first person icon set includes a plurality of first person icons, and displaying the first person icon set means displaying a plurality of first person icons. The first marking instruction received by any first person icon may be triggered by a selection operation received by any first person icon, and the reception of the first marking instruction by any first person icon indicates that the first person corresponding to any first person icon is a person of interest, and the segment of the first person corresponding to any first person icon in the conference video is a segment of interest.
[0069] After any first person icon receives the first marking instruction, the first marking moment corresponding to any first person icon is determined in the progress bar according to the first moment, and any first person icon is displayed at the first marking moment in the progress bar.
[0070] S103: Receive a second selection instruction including a second moment through the conference video, and display a second person icon set corresponding to the second moment.
[0071] Among them, the second selection instruction can be triggered by the user's selection operation, and the user's selection operation can be triggered by a virtual button, or a preset gesture, or a preset shortcut key; the second selection instruction acts on the second moment of the duration corresponding to the conference video; the second person icon set corresponding to the second moment is the icon set of all second persons appearing in a conference video before and after the first moment.
[0072] Specifically, a second selection instruction is received through the second moment of the progress bar of the conference video, the second moment is greater than the first moment, all second persons appearing in a conference video before and after the second moment are determined to determine the second person icon set, and the second person icon set is displayed. All second persons appearing in a conference video before and after the second moment may be the same as all first persons appearing in a conference video before and after the first moment, or partially the same, or completely different.
[0073] For example, a second selection instruction is received at 10 minutes and 2 seconds of conference video F, and a conference video before and after 10 minutes and 2 seconds is obtained in conference video F. All second persons are determined to include: a2, b2 and c2, and the second person icon set corresponding to a2, b2 and c2 is obtained and displayed.
[0074] S104, in response to a second marking instruction received by any second person icon in the second person icon set, if any second person icon is the same as any first person icon, then based on the first moment and the second moment, display any second person icon in the progress bar, as well as a target progress bar corresponding to any second person icon.
[0075] Specifically, the second person icon set includes a plurality of second person icons, and displaying the second person icon set means displaying a plurality of second person icons. The second marking instruction received by any second person icon may be triggered by a selection operation received by any second person icon, and any second person icon receiving the second marking instruction indicates that the second person corresponding to any second person icon is a person of interest, and the segment of the second person corresponding to any second person icon in the conference video is a segment of interest.
[0076] After any second person icon receives the second marking instruction, it is determined whether any second person icon is the same as any first person icon in S102. If they are the same, it means that the first person corresponding to any first person icon is the same person as the second person corresponding to any second person icon. Then, according to the second moment, the second marking moment corresponding to any second person icon is determined in the progress bar, and any second person icon is marked at the second marking moment of the progress bar; the target progress bar corresponding to any second person icon is the target progress bar corresponding to the person corresponding to any second person icon, and is also the target progress bar corresponding to the person corresponding to any first person icon; in the progress bar, part of the progress bar between the first marking moment and the second marking moment is used as the target progress bar, and the target progress bar is displayed distinguishably to mark the target progress bar.
[0077] S105: Based on the target progress bar and the conference video, obtain a target video segment corresponding to any second person icon.
[0078] Specifically, in the conference video, the video segment corresponding to the target progress bar is obtained, all video frames of the second person corresponding to any second person icon (any first person icon) appearing in the obtained video segment are obtained, and the target video segment is determined based on all the obtained video frames.
[0079] In the above-mentioned conference video marking interaction method, a first selection instruction and a first marking instruction corresponding to a first moment are received to display any first person icon corresponding to the first marking instruction in a progress bar, and a second selection instruction and a second marking instruction corresponding to a second moment are received. If any second person icon corresponding to the second marking instruction is the same as any first person icon corresponding to the first marking instruction, then any second person icon corresponding to the second marking instruction and a target progress bar corresponding to any second person icon are displayed in the progress bar, and a target video segment of any second person icon in the target progress bar is obtained. Through the above-mentioned conference video marking interaction method, when it is necessary to pay attention to the screen of a certain person in the conference video, it is not necessary to watch the conference video in its entirety. The target video segment of any first person in any time period can be freely obtained in the conference video, and any first person icon, any second person icon and the target progress bar of the first person are marked in the progress bar of the conference video. The progress bar can intuitively display what the user is paying attention to: the screen of the first person in the target progress bar; and the specific screen of the person that the user is paying attention to in the target progress bar can be understood through the target video segment.
[0080] In one embodiment, in S101, displaying the first person icon set corresponding to the first moment includes:
[0081] S111: Based on the first moment and a preset interval, obtain a first video segment corresponding to the first moment in the conference video.
[0082] Specifically, the preset interval is a time interval, and the preset interval includes a first time interval and a second time interval, and a video segment between the first time interval before a first moment and the second time interval after the first moment in the conference video is used as the first video segment corresponding to the first moment. The first time interval and the second time interval may be equal or unequal.
[0083] S112, determining a number of first persons appearing in the first video segment, and obtaining a first person icon of each first person to obtain a first person icon set.
[0084] Specifically, a first video segment including all first video frames is obtained, and a number of first persons appearing in all first video frames are determined. For any first person, an image of the any first person is captured in the first video segment, and the image of the any first person is used as the first person icon of the any first person.
[0085] S113, displaying the first person icon set in the conference video.
[0086] Specifically, the display position of the first person icon set corresponds to the position of the first moment in the progress bar, and the first person icon set can be displayed above the first moment in the progress bar, such as Figure 2 shown.
[0087] In one embodiment, in S102, displaying the first person icon in the progress bar of the conference video based on the first moment includes:
[0088] S211: Based on the first moment and a preset interval, obtain a first video segment corresponding to the first moment in the conference video.
[0089] S212, in the first video, determine the first marked moment when the first person corresponding to any first person icon appears for the first time, and display any first person icon at the first marked moment of the progress bar of the conference video.
[0090] Specifically, in the first video segment including all first video frames, determine the first video frame where the first person corresponding to any first person icon appears for the first time, use the moment corresponding to the first video frame in the conference video as the first marked moment, and display any first person icon at the first marked moment of the progress bar, such as Figure 3 shown.
[0091] In one embodiment, in S103, based on the first moment and the second moment, marking any second person icon in the progress bar, and a target progress bar corresponding to any second person icon, includes:
[0092] S311: Based on the second moment and a preset interval, obtain a second video segment corresponding to the second moment in the conference video.
[0093] Specifically, the preset interval includes a first duration and a second duration, and a video segment between the first duration before the second moment and the second duration after the second moment in the conference video is used as the second video segment corresponding to the second moment.
[0094] S312: Determine, in the second video segment, a second marked moment at which the second person last appeared corresponding to any second person icon.
[0095] Specifically, in the second video segment including all second video frames, determine the second video frame in which the second person corresponding to any second person icon (the first person corresponding to any first person icon) appears for the last time, use the moment corresponding to the second video frame in the conference video as the second marked moment, and display any second person icon (any first person icon) at the second marked moment of the progress bar, such as Figure 4 shown.
[0096] S313: Use the portion of the progress bar from the first marking moment to the second marking moment in the progress bar as a target progress bar, and highlight the target progress bar.
[0097] Specifically, the first marked moment is the moment when the first person corresponding to any first person icon (the second person corresponding to any second person icon) appears for the first time within a period of time before and after the first moment, and the second marked moment is the moment when the first person appears for the last time within a period of time before and after the second moment. The partial progress bar from the first marked moment to the second marked moment is used as the target progress bar, so that the target video segment corresponding to the target progress bar includes all video frames of the first person appearing from a period of time before and after the first moment to a period of time before and after the second moment. The target progress bar is highlighted, such as Figure 5 shown.
[0098] In one embodiment, after S104, the method further includes:
[0099] S105, in response to the play instruction received by the target progress bar, play the target video segment, and after the target video segment is played, use the second marked moment as the play start moment to play the conference video.
[0100] Specifically, the play instruction received by the target progress bar can be triggered by a click operation at any time in the target progress bar, and the target video segment is played from the first marked time according to the play instruction; after the target video segment is played, the second marked time is used as the play start time to continue playing the conference video. During the playback of the target video segment and the playback of the conference video, operations such as fast forward, fast rewind, double speed playback, and pause can be performed.
[0101] In one embodiment, the conference video marking interaction method can receive multiple selection instructions and multiple marking instructions through the conference video; in actual operation, considering the user's marking needs, the user can select the person icon of the same person in two consecutively triggered marking instructions to reduce the complexity of the marking interaction and improve the marking efficiency. If the person icons of different persons are selected in two consecutively triggered marking instructions, the person icons corresponding to different persons can also be displayed on the progress bar.
[0102] If any of the second person icons is different from any of the first person icons, then based on the second moment and the preset interval, the second video segment corresponding to the second moment is obtained in the conference video; in the second video segment, the third marked moment when the second person first appears corresponding to any of the second person icons is determined, and any of the second person icons is displayed at the third marked moment of the progress bar.
[0103] Specifically, if any of the second person icons is different from any of the first person icons, the target progress bar corresponding to any of the first person icons cannot be obtained, and it is necessary to receive the selection instruction and marking instruction again, and the person icon corresponding to the marking instruction received again must be the same as the first person icon, in order to obtain the target progress bar corresponding to the first person icon.
[0104] For example, Figure 6 As shown, if the person icon A corresponding to the marking instruction received for the first time is the icon of person A, the person icon A is marked at the moment a on the progress bar; the person icon B corresponding to the marking instruction received for the second time is the icon of person B, and the person icon B is marked at the moment b on the progress bar; the person icon C corresponding to the marking instruction received for the third time is the icon of person A, and the person icon C is marked at the moment c on the progress bar, and the progress bar is determined to be the target progress bar of person A from moment a to moment c, and the target video segment corresponding to person A in the target progress bar is obtained; the person icon D corresponding to the marking instruction received for the third time is the icon of person B, and the person icon D is marked at the moment d on the progress bar, and the progress bar is determined to be the target progress bar of person B from moment b to moment d, and the target video segment corresponding to person B in the target progress bar is obtained. In one embodiment, after S104, it also includes:
[0105] S106: Displaying a thumbnail corresponding to the target video segment in a preset video directory hot zone.
[0106] Specifically, Figure 7 As shown, the display screen includes a video directory hot zone and a video playback hot zone. The video target hot zone is used to display the thumbnail of the target video, and the video playback hot zone is used to play the conference video and the target video. The display screen also includes a conference video list hot zone, which is used to display thumbnails of multiple conference videos. If a conference video in the conference video list hot zone is selected, the selected conference video can be displayed in the video playback hot zone, and thumbnails of several target videos of the selected conference video can be displayed in the video directory hot zone.
[0107] S107: In response to the loop play instruction received by the thumbnail, loop play the target video segment corresponding to the thumbnail in a preset play hot zone.
[0108] Specifically, the loop playback instruction is an instruction triggered by the operation of moving any of the first person icons or any of the second person icons to the thumbnail; the loop playback instruction can also be triggered by a preset loop playback shortcut key, or it can be an instruction triggered by triggering a loop playback button in the menu bar corresponding to the thumbnail.
[0109] In response to the exit loop playback instruction received by the thumbnail, after the target video segment is played, the second marked moment is used as the playback start moment to play the conference video.
[0110] In one embodiment, multiple selection instructions and multiple marking instructions can be received through the conference video, and multiple target progress bars and multiple target video segments can be determined. The multiple target video segments may include: target video segments of the same person in multiple different target progress bars, and target video segments of multiple different people in their respective target progress bars; thumbnails corresponding to multiple target video segments can be displayed in the video directory hot zone. Any thumbnail can receive a loop playback instruction to realize loop playback of the target video segment corresponding to any thumbnail in a preset playback hot zone, and any thumbnail can receive an exit loop playback instruction to realize that after the target video segment corresponding to any thumbnail is played, the second marked moment is used as the playback start moment to play the conference video.
[0111] Multiple selection instructions and multiple marking instructions can be received through the conference video, and multiple target video segments determined can all be downloaded, shared, published, and other operations; specifically, after selecting any target video segment, the download or sharing can be achieved through button, gesture, and other trigger operations.
[0112] Through the above-mentioned conference video marking interaction method, when it is necessary to pay attention to the screen of a certain person in the conference video, it is not necessary to watch the entire conference video. In the conference video, you can freely obtain the target video segment of any first person in any time period, and in the progress bar of the conference video, mark any first person icon, any second person icon and the target progress bar of the first person. The progress bar can intuitively display that the user is paying attention to: the screen of the first person in the target progress bar; when you want to share the screen of any person in any time period, you do not need to share the complete conference video, you can directly share the obtained target video segment, or you can download the target video segment for repeated viewing; display the thumbnail of the target video segment in the video directory hot zone, through the video directory hot zone, you can intuitively see all the target videos obtained in the conference video, the thumbnail in the video target hot zone can receive loop playback instructions and exit loop playback instructions, so that the operation of loop playback is simple.
[0113] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0114] Based on the same inventive concept, the embodiment of the present application also provides a conference video marking interaction device for implementing the conference video marking interaction method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiments of one or more conference video marking interaction devices provided below can refer to the limitations of the conference video marking interaction method above, and will not be repeated here.
[0115] In one embodiment, Figure 8 As shown, a conference video marking interaction device is provided, comprising:
[0116] A first personnel icon set determination module, configured to receive a first selection instruction including a first moment through a conference video, and display a first personnel icon set corresponding to the first moment;
[0117] A first marking module, configured to respond to a first marking instruction received by any first person icon in the first person icon set, and mark the any first person icon in the progress bar of the conference video based on the first moment;
[0118] A second personnel icon set determination module is used to receive a second selection instruction including a second moment through the conference video, and display a second personnel icon set corresponding to the second moment;
[0119] A second marking module, configured to respond to a second marking instruction received by any second person icon in the second person icon set, and if the any second person icon is the same as the any first person icon, mark the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0120] The target video segment acquisition module is used to acquire the target video segment corresponding to any second person icon based on the target progress bar and the conference video.
[0121] In one embodiment, the first person icon set determination module includes:
[0122] A first video segment determining unit, configured to obtain, in the conference video, a first video segment corresponding to the first moment based on the first moment and a preset interval;
[0123] a first person icon set determining unit, configured to determine a plurality of first persons appearing in the first video segment, and obtain a first person icon for each first person to obtain a first person icon set;
[0124] The first display unit is used to display the first person icon set in the conference video, wherein the display position of the first person icon set corresponds to the position of the first moment in the progress bar.
[0125] In one embodiment, the first marking module includes:
[0126] A first video segment determining unit, configured to obtain, in the conference video, a first video segment corresponding to the first moment based on the first moment and a preset interval;
[0127] The first person icon marking unit is used to determine the first marking moment when the first person corresponding to any first person icon appears for the first time in the first video, and display any first person icon at the first marking moment of the progress bar.
[0128] In one embodiment, the second marking module includes:
[0129] A second video segment determining unit, configured to obtain, in the conference video, a second video segment corresponding to the second moment based on the second moment and a preset interval;
[0130] A second person icon marking unit, configured to determine, in the second video segment, a second marking time at which any second person icon corresponds to the second person's last appearance, and display any second person icon at the second marking time on the progress bar;
[0131] The target progress bar marking unit is used to use the portion of the progress bar from the first marking moment to the second marking moment in the progress bar as the target progress bar, and highlight the target progress bar.
[0132] In one embodiment, the conference video marking interaction device further includes:
[0133] The target progress bar playback module is used to play the target video segment in response to the playback instruction received by the target progress bar; after the target video segment is played, the second marked moment is used as the playback start moment to play the conference video.
[0134] In one embodiment, the conference video marking interaction device further includes:
[0135] A loop playback module is used to display the thumbnail corresponding to the target video segment in a preset video directory hot zone; in response to the loop playback instruction received by the thumbnail, the target video segment corresponding to the thumbnail is looped in the preset playback hot zone, wherein the loop playback instruction is an instruction triggered by the operation of moving any of the first person icons or any of the second person icons to the thumbnail.
[0136] Each module in the above-mentioned conference video marking interaction device can be implemented in whole or in part by software, hardware and their combination. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the corresponding operations of each of the above modules.
[0137] In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as follows: Fig. 9 As shown. The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a marking interaction method for conference videos is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a key, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.
[0138] Those skilled in the art will understand that Fig. 9The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0139] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:
[0140] receiving a first selection instruction including a first moment through the conference video, and displaying a first set of person icons corresponding to the first moment;
[0141] In response to a first marking instruction received by any first person icon in the first person icon set, marking the any first person icon in the progress bar of the conference video based on the first moment;
[0142] receiving a second selection instruction including a second moment through the conference video, and displaying a second set of personnel icons corresponding to the second moment;
[0143] In response to a second marking instruction received by any second person icon in the second person icon set, if the any second person icon is the same as the any first person icon, marking the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0144] Based on the target progress bar and the conference video, a target video segment corresponding to any second person icon is obtained.
[0145] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0146] The displaying of the first person icon set corresponding to the first moment includes:
[0147] Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video;
[0148] Determine a number of first persons appearing in the first video segment, and obtain a first person icon of each first person to obtain a first person icon set;
[0149] The first person icon set is displayed in the conference video, wherein a display position of the first person icon set corresponds to a position of the first moment in the progress bar.
[0150] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0151] The displaying the first person icon in the progress bar of the conference video based on the first moment includes:
[0152] Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video;
[0153] In the first video, a first marked moment when a first person corresponding to any first person icon appears for the first time is determined, and any first person icon is displayed at the first marked moment of the progress bar.
[0154] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0155] The marking of any second person icon in the progress bar and a target progress bar corresponding to any second person icon based on the first moment and the second moment includes:
[0156] Based on the second moment and the preset interval, obtaining a second video segment corresponding to the second moment in the conference video;
[0157] In the second video segment, determining a second marked time at which the second person last appeared corresponding to any second person icon, and displaying any second person icon at the second marked time on the progress bar;
[0158] The portion of the progress bar from the first marking moment to the second marking moment in the progress bar is used as a target progress bar, and the target progress bar is highlighted.
[0159] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0160] In response to the play instruction received by the target progress bar, play the target video segment;
[0161] After the target video segment is played, the second marked moment is used as the playback start moment to play the conference video.
[0162] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:
[0163] Displaying a thumbnail corresponding to the target video segment in a preset video directory hot zone;
[0164] In response to a loop playback instruction received by the thumbnail, the target video segment corresponding to the thumbnail is looped in a preset playback hot zone, wherein the loop playback instruction is an instruction triggered by the operation of moving any of the first person icons or any of the second person icons to the thumbnail.
[0165] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0166] receiving a first selection instruction including a first moment through the conference video, and displaying a first set of person icons corresponding to the first moment;
[0167] In response to a first marking instruction received by any first person icon in the first person icon set, marking the any first person icon in the progress bar of the conference video based on the first moment;
[0168] receiving a second selection instruction including a second moment through the conference video, and displaying a second set of personnel icons corresponding to the second moment;
[0169] In response to a second marking instruction received by any second person icon in the second person icon set, if the any second person icon is the same as the any first person icon, marking the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0170] Based on the target progress bar and the conference video, a target video segment corresponding to any second person icon is obtained.
[0171] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0172] The displaying of the first person icon set corresponding to the first moment includes:
[0173] Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video;
[0174] Determine a number of first persons appearing in the first video segment, and obtain a first person icon of each first person to obtain a first person icon set;
[0175] The first person icon set is displayed in the conference video, wherein a display position of the first person icon set corresponds to a position of the first moment in the progress bar.
[0176] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0177] The displaying the first person icon in the progress bar of the conference video based on the first moment includes:
[0178] Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video;
[0179] In the first video, a first marked moment when a first person corresponding to any first person icon appears for the first time is determined, and any first person icon is displayed at the first marked moment of the progress bar.
[0180] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0181] The marking of any second person icon in the progress bar and a target progress bar corresponding to any second person icon based on the first moment and the second moment includes:
[0182] Based on the second moment and the preset interval, obtaining a second video segment corresponding to the second moment in the conference video;
[0183] In the second video segment, determining a second marked time at which the second person last appeared corresponding to any second person icon, and displaying any second person icon at the second marked time on the progress bar;
[0184] The portion of the progress bar from the first marking moment to the second marking moment in the progress bar is used as a target progress bar, and the target progress bar is highlighted.
[0185] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0186] In response to the play instruction received by the target progress bar, play the target video segment;
[0187] After the target video segment is played, the second marked moment is used as the playback start moment to play the conference video.
[0188] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0189] Displaying a thumbnail corresponding to the target video segment in a preset video directory hot zone;
[0190] In response to a loop playback instruction received by the thumbnail, the target video segment corresponding to the thumbnail is looped in a preset playback hot zone, wherein the loop playback instruction is an instruction triggered by the operation of moving any of the first person icons or any of the second person icons to the thumbnail.
[0191] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:
[0192] receiving a first selection instruction including a first moment through the conference video, and displaying a first set of person icons corresponding to the first moment;
[0193] In response to a first marking instruction received by any first person icon in the first person icon set, marking the any first person icon in the progress bar of the conference video based on the first moment;
[0194] receiving a second selection instruction including a second moment through the conference video, and displaying a second set of personnel icons corresponding to the second moment;
[0195] In response to a second marking instruction received by any second person icon in the second person icon set, if the any second person icon is the same as the any first person icon, marking the any second person icon in the progress bar and a target progress bar corresponding to the any second person icon based on the first moment and the second moment;
[0196] Based on the target progress bar and the conference video, a target video segment corresponding to any second person icon is obtained.
[0197] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0198] The displaying of the first person icon set corresponding to the first moment includes:
[0199] Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video;
[0200] Determine a number of first persons appearing in the first video segment, and obtain a first person icon of each first person to obtain a first person icon set;
[0201] The first person icon set is displayed in the conference video, wherein a display position of the first person icon set corresponds to a position of the first moment in the progress bar.
[0202] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0203] The displaying the first person icon in the progress bar of the conference video based on the first moment includes:
[0204] Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video;
[0205] In the first video, a first marked moment when a first person corresponding to any first person icon appears for the first time is determined, and any first person icon is displayed at the first marked moment of the progress bar.
[0206] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0207] The marking of any second person icon in the progress bar and a target progress bar corresponding to any second person icon based on the first moment and the second moment includes:
[0208] Based on the second moment and the preset interval, obtaining a second video segment corresponding to the second moment in the conference video;
[0209] In the second video segment, determining a second marked time at which the second person last appeared corresponding to any second person icon, and displaying any second person icon at the second marked time on the progress bar;
[0210] The portion of the progress bar from the first marking moment to the second marking moment in the progress bar is used as a target progress bar, and the target progress bar is highlighted.
[0211] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0212] In response to the play instruction received by the target progress bar, play the target video segment;
[0213] After the target video segment is played, the second marked moment is used as the playback start moment to play the conference video.
[0214] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:
[0215] Displaying a thumbnail corresponding to the target video segment in a preset video directory hot zone;
[0216] In response to a loop playback instruction received by the thumbnail, the target video segment corresponding to the thumbnail is looped in a preset playback hot zone, wherein the loop playback instruction is an instruction triggered by the operation of moving any of the first person icons or any of the second person icons to the thumbnail.
[0217] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.
[0218] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0219] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0220] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A conference video marking interaction method, characterized in that: The method comprises: receiving a first selection instruction including a first moment through a conference video, and displaying a first person icon set corresponding to the first moment; the first selection instruction is triggered by a selection operation of a user, and the selection operation is triggered by a virtual key, a preset gesture, or a preset shortcut key; the first person icon set includes an icon set of all first persons appearing in a conference video before and after the first moment; In response to a first marking instruction received by any first person icon in the first person icon set, marking the any first person icon in the progress bar of the conference video based on the first moment; receiving a second selection instruction including a second moment through the conference video, and displaying a second set of personnel icons corresponding to the second moment; the second set of personnel icons is completely the same as, partially the same as, or completely different from the first set of personnel icons; In response to a second marking instruction received by any second person icon in the second person icon set, if any second person icon is the same as any first person icon, then based on the first moment and the second moment, marking any second person icon in the progress bar, and a target progress bar corresponding to any second person icon; if any second person icon is different from any first person icon, then based on the second moment and a preset interval, obtaining a second video segment corresponding to the second moment in the conference video; in the second video segment, determining a third marked moment when the second person corresponding to any second person icon appears for the last time, and displaying any second person icon at the third marked moment in the progress bar; Based on the target progress bar and the conference video, obtaining a target video segment corresponding to any second person icon; If any of the second person icons is different from any of the first person icons, receiving a third selection instruction and a third marking instruction triggered by the user, and the third person icon corresponding to the third marking instruction is the same as the first person icon; According to the progress bar time corresponding to the first person icon and the progress bar time corresponding to the third person icon, the target video segment corresponding to the first person icon is acquired.
2. The method according to claim 1, characterized in that The displaying of the first person icon set corresponding to the first moment includes: Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video; Determine a number of first persons appearing in the first video segment, and obtain a first person icon of each first person to obtain a first person icon set; The first person icon set is displayed in the conference video, wherein a display position of the first person icon set corresponds to a position of the first moment in the progress bar.
3. The method according to claim 1, characterized in that The displaying the first person icon in the progress bar of the conference video based on the first moment includes: Based on the first moment and the preset interval, obtaining a first video segment corresponding to the first moment in the conference video; In the first video, a first marked moment when a first person corresponding to any first person icon appears for the first time is determined, and any first person icon is displayed at the first marked moment of the progress bar.
4. The method according to claim 3, characterized in that The marking of any second person icon in the progress bar and a target progress bar corresponding to any second person icon based on the first moment and the second moment includes: Based on the second moment and the preset interval, obtaining a second video segment corresponding to the second moment in the conference video; In the second video segment, determining a second marked time at which the second person last appeared corresponding to any second person icon, and displaying any second person icon at the second marked time on the progress bar; The portion of the progress bar from the first marking moment to the second marking moment in the progress bar is used as a target progress bar, and the target progress bar is highlighted.
5. The method according to claim 4, characterized in that The method further comprises: In response to a play instruction received by the target progress bar, play the target video segment; After the target video segment is played, the second marked moment is used as the playback start moment to play the conference video.
6. The method according to claim 1, characterized in that The method further comprises: Displaying a thumbnail corresponding to the target video segment in a preset video directory hot zone; In response to a loop playback instruction received by the thumbnail, the target video segment corresponding to the thumbnail is looped in a preset playback hot zone, wherein the loop playback instruction is an instruction triggered by the operation of moving any of the first person icons or any of the second person icons to the thumbnail.
7. A conference video marking interaction device, characterized in that: The device comprises: A first person icon set determination module is configured to receive a first selection instruction including a first moment through a conference video, and display a first person icon set corresponding to the first moment; the first selection instruction is triggered by a selection operation of a user, and the selection operation is triggered by a virtual key, a preset gesture, or a preset shortcut key; the first person icon set includes an icon set of all first persons appearing in a conference video before and after the first moment; A first marking module, configured to respond to a first marking instruction received by any first person icon in the first person icon set, and mark the any first person icon in the progress bar of the conference video based on the first moment; A second personnel icon set determination module is used to receive a second selection instruction including a second moment through the conference video, and display a second personnel icon set corresponding to the second moment; the second personnel icon set is completely the same as the first personnel icon set, or is partially the same as the first personnel icon set, or is completely different; A second marking module is used to respond to a second marking instruction received by any second person icon in the second person icon set, and if any second person icon is the same as any first person icon, then based on the first moment and the second moment, mark any second person icon and a target progress bar corresponding to any second person icon in the progress bar; if any second person icon is different from any first person icon, then based on the second moment and a preset interval, obtain a second video segment corresponding to the second moment in the conference video; in the second video segment, determine a third marked moment when the second person corresponding to any second person icon appears for the last time, and display any second person icon at the third marked moment in the progress bar; A target video segment acquisition module is used to acquire the target video segment corresponding to any second person icon based on the target progress bar and the conference video; if any second person icon is different from any first person icon, receive a third selection instruction and a third marking instruction triggered by the user, and the third person icon corresponding to the third marking instruction is the same as the first person icon; and acquire the target video segment corresponding to the first person icon according to the progress bar moment corresponding to the first person icon and the progress bar moment corresponding to the third person icon.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Video playing progress control method and terminal
CN106851407A
Method and device for obtaining character segment of video data and electronic equipment
CN110119711A