Video interaction method, device, equipment, storage medium and computer program product

Abstract

The present application discloses a video interaction method, apparatus, device, storage medium, and computer program product, relating to the field of human-computer interaction. The method includes: playing a target video in a video playback interface, where the target video includes video frames; in response to a marking operation on a target video frame, displaying a first marking control at an interest point position in the target video frame; and displaying marking control information in an information display area of the target video, where the marking control information includes first control information corresponding to the first marking control, and the first control information is used to locate to the interest point position in the target video frame. By performing a marking operation on the interest point position of a target video frame in the target video, a marking control is displayed at the interest point position to indicate the marking result of the current user for the interest point position, thereby improving the human-computer interaction efficiency in video interaction.

Description

Technical Field

[0001] This embodiment relates to the field of human-computer interaction, and particularly to a video interaction method, apparatus, device, storage medium, and computer program product. Background Art

[0002] As a way of spreading Internet content, video has won the favor of many platforms and users for its fast dissemination speed and wide dissemination range. While providing more interactive functions to users, the platform obtains the reactions of different users to different contents, which helps the good development of the platform and the full participation of users.

[0003] In related technologies, in order to improve the participation and interest of users when watching videos, some video interaction forms participated by users have emerged, such as posting comments in the video comment area and sending bullet screens during video playback.

[0004] However, the above-mentioned video interaction forms are relatively single. Only through the interaction forms of comments and bullet screens, the ways for users to interact with videos are limited, and the human-computer interaction efficiency is low. Summary of the Invention

[0005] The embodiments of the present application provide a video interaction method, apparatus, device, storage medium, and computer program product, which can improve the accuracy of positioning video frames and enhance the participation and interest when watching videos. The technical solutions are as follows.

[0006] On the one hand, a video interaction method is provided, and the method includes:

[0007] Playing a target video in a video playback interface, where the target video includes video frames;

[0008] In response to a marking operation on a target video frame, displaying a first marking control at the position of an interest point in the target video frame, where the marking operation refers to marking at the position of the interest point on the target video frame, and the first marking control is used to indicate the marking result of the interest point position;

[0009] Displaying marking control information in the information display area of the target video, where the marking control information includes first control information corresponding to the first marking control, and the first control information is used to locate to the position of the interest point in the target video frame.

[0010] On the other hand, a video interaction apparatus is provided, and the apparatus includes:

[0011] A playing module, configured to play a target video in a video playback interface, where the target video includes video frames;

[0012] The first control display module is configured to, in response to a marking operation on a target video frame, display a first marking control at the position of the point of interest in the target video frame. The marking operation refers to marking at the position of the point of interest on the target video frame, and the first marking control is used to indicate the marking result of the position of the point of interest.

[0013] The information display module is configured to display marking control information in the information display area of the target video. The marking control information includes first control information corresponding to the first marking control, and the first control information is used to locate to the position of the point of interest in the target video frame.

[0014] On the other hand, a computer device is provided, which includes a processor and a memory. At least one instruction, at least one program, a code set or an instruction set is stored in the memory, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the video interaction method according to any one of the above embodiments of the present application.

[0015] On the other hand, a computer-readable storage medium is provided, in which at least one instruction, at least one program, a code set or an instruction set is stored, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the video interaction method according to any one of the above embodiments of the present application.

[0016] On the other hand, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the video interaction method according to any one of the above embodiments.

[0017] The beneficial effects brought by the technical solutions provided in the embodiments of the present application at least include:

[0018] By performing a marking operation on the position of the point of interest in the target video frame of the target video, a marking control is displayed at the position of the point of interest to indicate the marking result of the current user on the position of the point of interest. Other users can display the marking control marked by the current user, so as to learn the position where the wonderful content related to the target video is located, and directly locate to the position where the wonderful content is located according to the marking control, improving the human-computer interaction efficiency in the video interaction process. Description of the Drawings

[0019] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0020] Figure 1 It is a schematic diagram of the interaction situation of the video interaction client provided by an exemplary embodiment of the present application;

[0021] Figure 2 It is a schematic diagram of the environment of video interaction provided by an exemplary embodiment of the present application;

[0022] Figure 3 It is a flowchart of the video interaction method provided by an exemplary embodiment of the present application;

[0023] Figure 4 It is a flowchart of the video interaction method provided by another exemplary embodiment of the present application;

[0024] Figure 5 It is a schematic diagram of the mobile terminal interface provided by an exemplary embodiment of the present application;

[0025] Figure 6 It is a flowchart of the video interaction method provided by another exemplary embodiment of the present application;

[0026] Figure 7 It is a schematic diagram of the timestamp display method provided by an exemplary embodiment of the present application;

[0027] Figure 8 It is a schematic diagram of the display mark control interface provided by an exemplary embodiment of the present application;

[0028] Figure 9 It is a schematic diagram of the mobile terminal interface provided by an exemplary embodiment of the present application;

[0029] Figure 10 It is a schematic diagram of the mobile terminal interface provided by an exemplary embodiment of the present application;

[0030] Figure 11 It is a schematic diagram of the overall solution process provided by an exemplary embodiment of the present application;

[0031] Figure 12 It is a block diagram of the structure of the video interaction device provided by an exemplary embodiment of the present application;

[0032] Figure 13 It is a block diagram of the structure of the video interaction device provided by another exemplary embodiment of the present application;

[0033] Figure 14 It is a structural block diagram of a server provided by an exemplary embodiment of the present application. Detailed implementation manners

[0034] To make the objectives, technical solutions, and advantages of the present application clearer, the following will further describe the implementation manners of the present application in detail with reference to the accompanying drawings.

[0035] In an embodiment of the present application, a video interaction method is provided, which improves the interest, participation, and human-computer interaction efficiency when a user watches a video.

[0036] For the video interaction method of the present application, when applied, it includes at least one of the following scenarios.

[0037] First, it is applied to the annotation of entertainment videos.

[0038] Illustratively, when watching an entertainment video, when the entertainment nature or commemorative significance of the video content is strong, there is usually a need to record the video for subsequent searching or real-time sharing with other viewers. In an embodiment of the present application, by marking the position of the point of interest in the entertainment video frame, the time stamp corresponding to the position of the point of interest and the screen coordinates corresponding to the position of the point of interest are recorded. Illustratively, when watching an entertainment video, it is found that the puppy captured in the lower left corner of the frame corresponding to the target time stamp is very cute. Through the video interaction method provided by this embodiment, a marking control is marked at any point in the lower left corner of the frame where the puppy is located, so that other users can locate to the position of this point of interest according to the marked marking control, achieving the effect of accurate video positioning and improving the participation and interactivity during the viewing process.

[0039] Second, it is applied to the annotation of learning videos.

[0040] Illustratively, when watching a learning video, when the relevant knowledge points in the video are key points or difficult points, there is usually a need to annotate the video for subsequent review or asking others. Illustratively, when watching a teaching video of the mathematics subject, the teacher emphasizes the determinant solving process involved in the frame corresponding to the target time stamp. Through the video interaction method provided by this embodiment, the position of the point of interest corresponding to the determinant solving process is marked to achieve rapid positioning of the point of interest position, which helps subsequent video viewers to better grasp the relevant knowledge points and improve the learning efficiency.

[0041] It should be noted that the above application scenarios are only illustrative examples, and the video interaction method provided by this embodiment can also be applied to other scenarios, and the embodiments of the present application do not limit this.

[0042] Secondly, the interaction situation in the embodiment of the present application is described. Illustratively, please refer toFigure 1 In this interaction scenario, the client 110 and the client 120 are involved.

[0043] In some embodiments, there is a marking control in the video playback interface of the client 110. The marking control belongs to a triggerable control, as shown in the interface 111. When the marking control receives a trigger operation, a marked control is displayed at the position of the point of interest in the video playback interface, as shown in the interface 112.

[0044] Based on the trigger operation of the marking control on the client 110, a marked control at the position of the point of interest is synchronously displayed on the video playback interface of the client 120, as shown in the interface 121.

[0045] The above process demonstrates the way for the client to mark the position of the point of interest, and the method for different clients to know the position of the point of interest by viewing the marked control. Schematically, after marking the position of the target video point of interest on the client 110, other clients (such as the client 120) can know the position of the point of interest by viewing the marked control, so as to achieve accurate positioning of the point of interest position.

[0046] After that, the implementation environment involved in the embodiments of the present application is described. Schematically, please refer to Figure 2 In this implementation environment, the terminal 210 and the server 220 are involved. The terminal 210 and the server 220 are connected through the communication network 230.

[0047] In some embodiments, the terminal 210 is used to send marking information to the server 220. In some embodiments, an application program with video playback function is installed in the terminal 210.

[0048] In this embodiment, during the playback of the target video (paused or continuously played) by the terminal 210 through the application program with video playback function, the marking result of the marking control is sent to the server, so as to indicate the position of the marked point of interest. The marking result includes the target video frame targeted by the marking action and the position of the point of interest on the target video frame. Taking the server 220 to implement video interaction according to the marking result as an example for description.

[0049] Optionally, after receiving the marking result sent by the terminal 210, the server 220 determines the marked target video frame and the position of the point of interest on the target video frame corresponding to the marking result, so that when other terminals obtain the target video from the server 220 for viewing, the display information of the marking control (including the target video frame and the position of the point of interest on the target video frame) is sent to other terminals. Other terminals display the marking control during the playback of the target video through the above display information of the marking control.

[0050] The above-mentioned terminal can be terminal devices in various forms such as mobile phones, intelligent in-vehicle devices, tablet computers, desktop computers, portable laptops, smart TVs, etc., and the embodiments of the present application do not limit this.

[0051] It should be noted that the above-mentioned server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, Content Delivery Network (CDN), and big data and artificial intelligence platforms.

[0052] Among them, cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or local area network to achieve data computing, storage, processing, and sharing. Cloud technology is the general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool, be used on demand, and is flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites, and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark and needs to be transmitted to the background system for logical processing. Data at different levels will be processed separately, and various industry data requires a powerful system backup support, which can only be achieved through cloud computing.

[0053] In some embodiments, the above-mentioned server can also be implemented as a node in a blockchain system. Blockchain is a new application mode of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanism, and encryption algorithms. Blockchain, essentially a decentralized database, is a string of data blocks generated by using cryptographic methods. Each data block contains information about a batch of network transactions, which is used to verify the validity (anti-counterfeiting) of the information and generate the next block. Blockchain can include the blockchain underlying platform, the platform product service layer, and the application service layer.

[0054] Schematically, Figure 3 is a schematic diagram of the overall solution implementation process provided by an exemplary embodiment of the present application. Taking the process of marking a video as an example, as Figure 3 shown, the method includes:

[0055] Step 310, play the target video in the video playback interface.

[0056] Among them, the target video includes video frames.

[0057] Optionally, the target video includes at least one of the following videos:

[0058] First, movies, documentaries, variety shows, animations, etc. played on film and television software or websites; second, short videos with short durations played and pushed through other media channels such as short video platforms; third, videos self-recorded or shot by others are used as the target video. Schematically, any video with a certain duration composed of continuous video images can be the target video, and the embodiments of the present application do not limit this.

[0059] The video playback interface generally refers to an interface capable of playing videos, including at least one of the video playback interfaces in web pages, the video playback interfaces in application programs, and the video playback interfaces configured on mobile terminals. Schematically, by playing the target video through the video playback interface, operations such as playing, pausing, adjusting the volume, and adjusting the display brightness can be performed on the target video.

[0060] A frame is the smallest unit of network transmission. Generally, a relatively complete and independent piece of information is divided into one frame. Schematically, the video frames in the target video contain partial video information of the video in a short period of time, such as the timestamp information, video resolution information, picture background information, picture character information, etc. of the target video at a certain moment.

[0061] Step 320, in response to a marking operation on the target video frame, display a first marking control at the position of the point of interest in the target video frame.

[0062] Among them, the marking operation refers to marking at the position of the point of interest on the target video frame, and the first marking control is used to indicate the marking result of the point of interest position.

[0063] Optionally, the implementation manner of the marking operation includes at least one of the following manners:

[0064] First, the marking operation is a specific touch operation.

[0065] Such as: single click operation, continuous click operation, swipe operation, long press operation, etc. Schematically, a long press operation on the position of the point of interest on the target video frame is implemented as the above-mentioned marking operation.

[0066] Second, the marking operation is a specific voice keyword.

[0067] Schematically, keywords such as "start marking", "open marking function", "annotation", etc. are preset as the ways to trigger the marking operation. When receiving the input of the voice keyword, the marking operation is performed.

[0068] For example, the keyword for triggering the marking function is "turn on the marking function". When a viewer watches a target video on a terminal, the operation of the marking function is triggered by voice input of the keyword "turn on the marking function", and voice input continues, such as "mark the puppy in the lower left corner of the video". Keywords "lower left corner" and "puppy" are extracted from the voice input content, so as to perform image recognition on the target video frame, obtain the area where the puppy is displayed, and use the area where the puppy in the lower left corner is displayed as the target area, and randomly determine a point in the target area to automatically perform the marking operation.

[0069] The above is only a schematic example, and this embodiment does not limit this.

[0070] The target video frame is a video frame in the target video. In the embodiment of the present application, the example of realizing the marking operation through a touch operation is used for illustration.

[0071] The implementation manner of the touch operation includes at least one of the following manners:

[0072] First , a marking annotation control is included in the video playback interface. Receive a drag operation on the marking annotation control; in response to the drag operation, determine the position on the target video frame when the drag operation ends as the point of interest position.

[0073] Schematically, the marking annotation control is located on the right side of the video playback interface. Start the drag operation from the area where the marking annotation control is located, and the termination position of the drag operation is the point of interest position, realizing the marking operation on the marking annotation control.

[0074] In some embodiments, when the marking operation is realized by dragging the marking annotation control, it includes at least one of the following situations:

[0075] 1.1 The target video is in the playback process, that is, the playback progress of the target video is still in progress.

[0076] That is, receive a drag operation on the marking annotation control during the playback of the target video. Then, during the playback of the target video, in response to the drag operation, determine the video frame corresponding to the display when the drag operation ends as the target video frame; or, according to the drag duration of the drag operation, reverse the corresponding duration from the video frame corresponding to the display when the drag operation ends to obtain the target video frame.

[0077] Optionally, determine the position on the video frame corresponding to the end of the drag operation as the point of interest position.

[0078] Schematically, use a finger to press on the marker annotation control and keep pressing. The marker annotation control vibrates based on the finger press. Drag the finger on the video playback interface, and the marker annotation control moves on the video playback interface along with the finger drag. The dragging range of the finger is limited by the size of the video playback interface. If the finger drag exceeds the video playback interface, the following situations may occur, such as stop marking, end marking, prompting whether to continue marking, etc.

[0079] 1.2 The target video is in a paused state.

[0080] That is, before receiving the drag operation on the marker annotation control, receive a pause operation, and the pause operation is used to pause the playback progress of the target video at the time stamp corresponding to the target video frame; or, when receiving the drag operation on the marker annotation control, pause the playback progress of the target video at the time stamp corresponding to the target video frame.

[0081] After the target video pauses playback, receive the drag operation on the marker annotation control.

[0082] Optionally, when the user releases the touch on the marker annotation control, determine that the drag operation ends; or, when the drag operation exceeds the preset drag range of the target video, determine that the drag operation ends; or, when the drag duration of the drag operation reaches the preset time threshold, determine that the drag operation ends.

[0083] Optionally, during the dragging process of the marker annotation control, at least one of the following display modes is included: 1. The marker annotation control is presented in a visible state on the video playback interface; 2. The marker annotation control is presented in a hidden state on the video playback interface; 3. The marker annotation control is presented with a preset transparency on the video playback interface.

[0084] Second , the video playback interface includes a marker annotation control. First, receive the selection operation on the marker annotation control, so as to select the position of the point of interest in the target video frame, thus realizing the above-mentioned marking operation.

[0085] Schematically, the marker annotation control is located on the right side of the video playback interface. By clicking on the marker annotation control for the first time, the marking function of the marker annotation control is triggered. Then, click on the position of the point of interest on the target video frame for the second time to complete the marking of the position of the point of interest and realize the marking operation of the marker annotation control.

[0086] In some embodiments, when realizing the marking operation by dragging the marker annotation control, at least one of the following situations is included:

[0087] 2.1 The target video is in the process of playing, that is, the playback progress of the target video is still in progress.

[0088] That is, during the playback of the target video, a selection operation on the marking control and a selection operation on the position of the point of interest are received.

[0089] 2.2 The target video is in a paused state.

[0090] That is, before receiving the selection operation on the marking control, a pause operation is received, and the pause operation is used to control the playback progress of the target video to pause at the time stamp corresponding to the target video frame; or, when the selection operation on the marking control is received, the playback progress of the target video is paused at the time stamp corresponding to the target video frame.

[0091] After the target video pauses playback, a selection operation on the marking control is received, and then a selection operation on the position of the point of interest is received.

[0092] Third , a long-press operation at the position of the point of interest on the target video frame is received, and the long-press operation is used as a marking operation.

[0093] In some embodiments, when implementing the marking operation by dragging the marking control, at least one of the following situations is included:

[0094] 3.1 The target video is in a playback state. When there is a need to mark the position of the point of interest in the target video, a long-press operation is performed on the position of the point of interest.

[0095] Wherein, the long-press operation refers to an operation whose pressing duration reaches a preset required duration. When the touch display screen receives a long-press operation on the position of the point of interest and the duration reaches or exceeds the preset required duration, the marking of the position of the point of interest is realized.

[0096] Optionally, when performing a long-press operation on the position of the point of interest, the target video can continue to play. After the long-press operation ends, the video frame corresponding to the time stamp obtained by backward deduction of the long-press duration from the time stamp at the end moment of the long-press end operation is determined as the target video frame, that is, the marked position is at the position of the point of interest at the start of the long-press operation; or, the target video stays at the target video frame corresponding to the start moment of the long-press operation.

[0097] 3.2 The target video is in a paused state.

[0098] Schematically, before receiving the long-press operation, a pause operation is received, and the pause operation is used to control the playback progress of the target video to pause at the time stamp corresponding to the target video frame; or, when the long-press operation is received, the playback progress of the target video is automatically paused to the time stamp corresponding to the target video frame.

[0099] It should be noted that the above implementation manners of the marking operation are only schematic examples, and this embodiment does not limit this.

[0100] In an alternative embodiment, in response to a marking operation, a video segment with the target video frame as the middle frame is determined.

[0101] Wherein, the target video frame is the picture corresponding to the point of interest position. Schematically, the target video is composed of multiple pictures, that is, multiple video frames. When marking the point of interest position of the target video frame, the target video frame is used as the middle frame, and there are other video frames before and after the target video frame. The video frames before and after the target video frame are video frames that are played before or after the target video frame in the time concept of the video playback progress.

[0102] Optionally, a video segment with the target video frame as the middle frame and a segment duration of a preset duration is determined.

[0103] In an alternative embodiment, a first marking control is displayed at the position of the point of interest in the video segment.

[0104] There are various shapes and display manners of the first marking control. Schematically, the first marking control can be circular, rectangular, diamond-shaped, needle-shaped, irregular-shaped, etc.; the display manner of the first marking control can be that it exists within the video segment after marking is completed and ends after the video segment, or it can disappear immediately after being displayed at the point of interest position after marking is completed, or it can still exist at the position of other video frames corresponding to the point of interest position of the target video frame until the end of the video.

[0105] After performing a marking operation on the point of interest position, a first marking control is displayed in the video playback interface. The first marking control is used to indicate that the marking of the point of interest position is completed. The display manners include at least one of the following:

[0106] 1. Appear immediately when marking is completed. Schematically, when the marking of the point of interest position is completed, the first marking control immediately appears in the video playback interface.

[0107] 2. Appear in a prompting manner. Schematically, when the marking of the point of interest position is completed, while the first marking control appears on the playback interface, a prompt appears on or near the first marking control. The manifestation form of the prompt can be text, an icon, or a combination of text and an icon, and can be a static presentation form or a dynamic presentation form such as an animation. For example: displaying "+1" in the video playback interface, which indicates that one marking is achieved for the point of interest position.

[0108] 3. Appears when the threshold time progress bar is completed. Schematically, when a long - press operation is used to mark the position of an interest point, the long - press operation needs to reach a preset required duration to complete the marking. When a pressing operation is performed at a certain point, a threshold time progress bar appears near the position of that point. During the process of pressing that point, the threshold time progress bar changes. When the preset required duration is reached, the marking of that point is completed. Among them, either the completion of filling the threshold time progress bar means the completion of marking, or the emptying of the threshold time progress bar means the completion of marking. The above is only a schematic example, and this embodiment does not limit it.

[0109] Step 330, display the marking control information in the information display area of the target video.

[0110] Among them, the marking control information includes the first control information corresponding to the first marking control, and the first control information is used to locate to the position of the interest point in the target video frame.

[0111] In some embodiments, the information display area is used to display relevant information of the target video, such as: display the introduction of the target video, display the release time of the target video, display the playback volume of the target video, display the comment content received by the target video, etc. In the embodiments of the present application, the information display area of the target video includes at least one of: a comment display area, a timeline display area, and a basic information display area.

[0112] That is, 1. The comment display area, that is, generate comment content according to the annotation of the first marking control and display it in the comment display area, and users can locate to the annotation position of the first marking control through the comment content in the comment display area; 2. The timeline display area, that is, display the marking information according to the time stamp corresponding to the annotation of the first marking control on the timeline, so as to directly locate to the annotation position of the first marking control through the marking information on the timeline; 3. The basic information display area, that is, display the marked controls in the current target video in the basic information display area of the target video according to the annotation of the first marking control, including the first marking control, and the annotation position of the first marking control can be directly located through the marking information of the first marking control.

[0113] It should be noted that the above information display area is only a schematic example, and this embodiment of the present application does not limit it.

[0114] Optionally, analyze the situation where there are at least one marked interest point positions in the target video.

[0115] After marking the position of an interest point, a marked control will appear to indicate the position of the interest point. Schematically, the position of the interest point is the coordinate position of the interest point in the target video. To determine the coordinates of the interest point position, a method of selecting a certain point in the target video as a reference point in advance can be adopted. Here, a certain point in the target video can be fixed as a point on the upper left edge of the target video, or it can be the center point of the target video. The reference point for each video frame can be the same, or the reference point for each video frame can be different.

[0116] For at least one marked control marked in the target video, there is at least one corresponding control information for each. Schematically, for the first marked control, it corresponds to the first control information. The marked control information includes at least one control information.

[0117] In an optional embodiment, the marked control is displayed on the timeline of the target video as the marked control information, wherein the timestamp of the target video frame corresponding to the first marked control is displayed on the timeline.

[0118] The timeline strings together events in one or more aspects in chronological order to form a relatively complete recording system, and then presents it to the user in the form of pictures, texts, videos, etc. The timeline can be applied to different fields to more systematically, completely, and precisely display the connections between things. Schematically, the timeline of the target video is obtained by stringing together the video frames of the target video in chronological order, such as the progress bar of the target video. For a determined target video, its duration is fixed and the timeline is also fixed.

[0119] When marking the position of the interest point in the target video, the position of the interest point is located on the target video frame in the target video, and the position of the target video frame can be determined according to the timeline of the target video.

[0120] In another optional embodiment, the comment data corresponding to the first marked control is displayed in the comment area of the target video as the marked control information.

[0121] In summary, by performing a marking operation on the position of the interest point of the target video frame in the target video, a marked control is displayed at the position of the interest point to indicate the marking result of the current user on the position of the interest point. Other users can display the marked control marked by the current user, thereby learning the position where the wonderful content related to the target video is located, and directly positioning to the position where the wonderful content is located according to the marked control, improving the human-computer interaction efficiency in the video interaction process.

[0122] In an optional embodiment, comment data can also be generated after receiving the marking operation on the target video frame. Schematically, as Figure 4 shown, the aboveFigure 3 After step 320 in the illustrated embodiment, the following steps 410 to 420 are further included.

[0123] Step 410, generating comment data corresponding to the first marked control.

[0124] Among them, the comment data includes a positioning element, and the positioning element is used to indicate the position of the interest point for positioning to the target video frame through the comment data.

[0125] It is known that the first marked control is used to indicate the marking result of the interest point position. Therefore, the first control information of the first marked control includes the position information of the interest point. The position information includes the coordinate information of the interest point position. Among them, the coordinate information is determined according to the offset situation of the first marked control in the target video frame, and the first marked control is embodied in the comment data in the form of a positioning element.

[0126] Optionally, first select the upper left corner of the target video as the reference point, compare and calculate the selected interest point position and the reference point position to determine the coordinate offset value of the interest point position. Schematically, the target video is a two-dimensional video played on the video playback interface. To determine the coordinate offset value, the offset values of both the horizontal and vertical coordinates need to be considered, that is, the horizontal coordinate offset value Offset_x and the vertical coordinate offset value Offset_x. The positioning element contains Offset_x and Offset_y. Among them, the coordinate offset value can be calculated in pixels, and the pixels of the video are reflected by the video resolution.

[0127] The target video is a video that can be displayed at different resolutions. The resolution is a parameter that measures the amount of data in the image, and the amount of data is measured in pixels. The target video consists of several video frames, that is, the target video contains several images. When the number of pixels in the image is more, the quality of the image is higher and the clarity is better. The higher the resolution of the target video, that is, the more pixels in the video frames that make up the target video. Schematically, when marking the interest point position in the target video during playback, the resolution of the target video may be 480p, 720p, 1080p or in an automatic adjustment situation. Correspondingly, the resolution corresponding to the target video frame is 480p, 720p, 1080p or any situation. When determining the target offset value, the offset amount of the interest point position can be calculated based on the actual resolution of the target video, or the offset amount of the interest point position can be calculated based on the current resolution of the target video. The above is only a schematic example, and this embodiment does not limit this.

[0128] By determining the offset amount of the interest point position and the timestamp of the target video frame corresponding to the interest point position, the positioning element corresponding to the first marked control in the comment data can be obtained. The positioning element is included in the comment data. Optionally, the positioning element is implemented as a hyperlink element.

[0129] While obtaining the first marked control or after obtaining the first marked control, comment data can be automatically generated, or after prompting whether to generate a comment through the video playback interface, the viewer can choose to generate a comment to obtain the comment data. The generated comment data corresponds to the first marked control, that is, the interest point location information and timestamp information can be obtained through the comment data. Schematically, after the comment data undergoes a triggering operation, the target video can be positioned to the interest point location, that is, the interest point location and the timestamp of the interest point location can be known.

[0130] Step 420, display the comment data corresponding to the marked control in the comment list of the target video as the marked control information.

[0131] It includes the comment data corresponding to the first marked control as the first control information.

[0132] The comment list is used to carry the feelings, views, suggestions, etc. expressed by the viewer for the target video. The viewer can perform operations such as liking, copying, forwarding, and commenting on the comments. Optionally, the existence form of the comment list includes at least one of the following situations:

[0133] 1. The comment list is located around the target video. Schematically, the comment list is located below the target video. It can be scrolled down when the target video is in the paused state to view the comment list; it can also be scrolled down when the target video is playing, and the target video continues to play in the video playback interface or the target video continues to play after being minimized with the video playback interface, or the target video automatically pauses in response to scrolling to the comment list, etc.

[0134] 2. The comment list is hidden in the comment control. Schematically, there is a comment control in the video playback interface, and by performing a triggering operation on the comment control, the comment list is displayed.

[0135] The above are only schematic examples, and this embodiment does not limit this.

[0136] Optionally, the comment data is obtained in an automatically generated manner, which includes the interest point location information and the time axis information of the interest point location. Therefore, the comment data in the comment list can be represented in the form of control information and timestamp, and the comment data is used as the marked control information. As Figure 5 shown, it is the comment list interface of a schematic embodiment.

[0137] Among them, the normal comment 510 refers to the comment obtained in the comment list when the viewer inputs text or converts voice input into text; the automatically generated comments 520 and 530 refer to the comments automatically generated in the comment list when the viewer uses the marking method while watching the target video. In the automatically generated comments, there are the avatar and nickname of the marker, the marking control information 540, the comment generation time, the like control and the number of likes, the comment control and the number of comments, and the share control. The marking control information 540 includes a timestamp 541 and control information 542. To distinguish it from the normal comment 510, the timestamp 541 can be represented in different colors, such as blue, yellow, green, etc. The control information may include the shape of the marking control and some prompt information, etc. Among them, the prompt information can be displayed in ways such as text, symbols, small images, etc. Schematically, such as "click me".

[0138] In summary, when obtaining the first marking control or after obtaining the first marking control, comment data is automatically generated, and the comment data in the comment list is used as the marking control information to realize the linkage between the marking control and the marking control information in the comment list. By triggering the marking control information, the position of the point of interest can be quickly located, the target video frame corresponding to the position of the point of interest and the timestamp corresponding to the target video frame can be known, the granularity of video interaction can be focused on each picture coordinate of each frame of the video, so that the target video content and comments form a more fine-grained linkage, improving the participation and entertainment of the viewer when watching the target video.

[0139] In an optional embodiment, in response to the marking operation, a first marking control is displayed at the position of the point of interest in the target video frame. Schematically, as Figure 6 shown, the above Figure 3 The step 320 in the embodiment shown also includes the following steps 610 to step 622.

[0140] Step 610, in response to the marking operation, determine a video segment with the target video frame as the middle frame.

[0141] Among them, the target video frame is the picture corresponding to the position of the point of interest. A certain time is preset in advance as the time of the video segment, and the target video frame is used as the middle frame to obtain the video segment within the preset time. Schematically, considering that the time of the target video frame is short, when marking the point of interest of the target video frame, the time corresponding to the video segment is marked, that is, the marked position is the position of the point of interest, and the marked time is the time of the video segment centered on the target video frame at the position of the point of interest.

[0142] Step 621, display a first marking control at the position corresponding to the point of interest in the video segment.

[0143] In an alternative embodiment, a first marking control is displayed in a target frame of a video clip, where the number of frames between the target frame and the intermediate frame is positively correlated with the display transparency of the first marking control on the target frame.

[0144] The target frame includes the intermediate frame and video frames having an adjacent relationship with the intermediate frame (target video frame). Having an adjacent relationship means being located in the video clip, centered on the intermediate frame, and distributed on both sides or one side of the intermediate frame. The adjacent situation between the target frame and the intermediate frame can be determined by the number of frames. As described above, a video is composed of several video frames, and the number of frames refers to the number of frames between the target frame and the intermediate frame. Schematically, the number of frames of the third target frame before the intermediate frame from the intermediate frame is 3.

[0145] The transparency shows the difference between the intermediate frame and the target frame in the video clip. A positive correlation of transparency means that when the number of frames between the target frame and the intermediate frame is smaller, the display transparency of the first marking control on the target frame is smaller; when the number of frames between the target frame and the intermediate frame is larger, the display transparency of the first marking control on the target frame is larger, that is, the transparency is in a gradient form. In addition, the gradient form at least also includes the following situations:

[0146] 1. Gradient between blur and clarity. Schematically, the marking control corresponding to the intermediate frame as the target frame is the clearest, and the greater the number of frames from the intermediate frame, the higher the degree of blur. When marking the position of the interest point, not only the time stamp corresponding to the intermediate frame is marked, but also the time stamps corresponding to the video frames in the video clip are marked. For example, if the preset video clip is 3 seconds before and after the intermediate frame, when marking the position of the interest point, the marking control corresponding to the intermediate frame is the clearest, and the marking controls 3 seconds before and after the intermediate frame become blurred as the number of frames from the intermediate frame increases.

[0147] 2. Gradient between different colors. Schematically, the marking control corresponding to the intermediate frame as the target frame is blue, and the greater the number of frames from the intermediate frame, the smaller the proportion of blue and the greater the proportion of green. When marking the position of the interest point, when the target frame is the intermediate frame, the corresponding marking control is blue. For the target frames 3 seconds before and 3 seconds after the intermediate frame, as the number of frames of the target frame from the intermediate frame increases, the proportion of blue decreases and the proportion of green increases. Until the time stamp where the target frame is 3 seconds away from the intermediate frame, the marking control is displayed in green.

[0148] As Figure 7 shown, it is a schematic diagram of the interface of the time stamp marking method provided by an exemplary embodiment.

[0149] When marking the position of the interest point on the target video frame, the target video frame corresponding to the position of the interest point is used as the intermediate frame, and the time stamp 710 corresponding to the target video frame and the video clips of the first 3 seconds and the last 3 seconds are marked by default. During the video playback, the time stamp display follows the playback progress and fades in and out. The time stamp corresponding to the position of the interest point marked by the user is the clearest, and the transparency of the time stamps of the first 3 seconds and the last 3 seconds gradually decreases as the number of frames away from the target video frame increases.

[0150] Schematically, if the selected interest point position is at 2 minutes and 03 seconds of the target video, then the target video frame corresponding to this interest point position is used as the intermediate frame, and the video clips of the first 3 seconds and the last 3 seconds before and after 2 minutes and 03 seconds are marked, that is, the marked time points are from 2 minutes to 2 minutes and 06 seconds, where the time stamp 710 and the marking control at 2 minutes and 03 seconds are the clearest, and the marking controls farther away from 2 minutes and 03 seconds are more blurred.

[0151] Step 622, display a prompt message on the first marking control.

[0152] Among them, the prompt message is used to indicate the number of markings corresponding to the first marking control. The existence mode of the prompt message includes at least the following situations:

[0153] 1. The prompt message is located within the marked marking control, that is, the marked marking control has a certain shape, and the prompt message can be displayed within the shape of the marked marking control. Schematically, the prompt message can adopt the way of digital prompt, and the numbers include but are not limited to Arabic numerals, capital numerals, English numerals, etc.

[0154] 2. The prompt message is located beside the marked marking control, that is, within the video playback interface beside the marked marking control, the prompt message is displayed. The prompt message can be directly displayed in digital form, or can be displayed after being surrounded by a certain geometric shape, etc. The above are only schematic examples, and this embodiment does not limit this.

[0155] Schematically, the prompt information has the following forms: 1. When counting the number of marks in the prompt information, only the marks at the positions of the points of interest in the target video frame are counted; 2. When counting the number of marks in the prompt information, not only the number of marks at the positions of the points of interest in the target video frame is counted, but also the number of marks at the same positions of the points of interest in the adjacent video frames within a preset duration with the target video frame as the middle frame is counted uniformly. Among them, the same position of the point of interest in the adjacent video frames means that the marked positions in the adjacent video frames include the coordinates of the points of interest corresponding to the first marking control being the same. Schematically, the preset duration is 10 seconds. On the basis of determining the target video frame as the middle frame, after counting the number of marks at the positions of the points of interest on the target video frame, the number of marks at the points with the same coordinates as the positions of the points of interest in the adjacent video frames 5 seconds before and 5 seconds after the target video frame is counted at the first marking control on the target video frame.

[0156] In an optional embodiment, after the prompt information is displayed on the video playback interface, the viewer of the target video can perform a triggering operation on the marked marking control or the prompt information to achieve the purpose of repeatedly marking at the position of the point of interest. Schematically, after the marked marking control and the prompt information of the marked marking control are displayed on the video playback interface, when the viewer of the target video performs a marking operation on the position of the point of interest corresponding to one of the marked marking controls, he can choose to perform a marking on the position of the point of interest through triggering methods such as dragging operation, long-press operation, etc., or he can choose to directly perform a triggering operation on the marked marking control or a triggering operation on the digital prompt of the marked marking control to achieve the marking of the position of the point of interest.

[0157] In an optional embodiment, the video playback interface corresponds to the logged-in first account, and a second marking control is displayed in the target video.

[0158] Among them, the second marking control is the control marked by the second account in the target video, and the second account is an account having an associated relationship with the first account.

[0159] Schematically, the video playback interface is the interface of a certain video playback application on a mobile terminal. The video playback application can realize video interaction functions such as liking, commenting, and forwarding by logging in the first account. The video interaction method provided in this embodiment can generate a first marking control by marking the position of the point of interest through the first account.

[0160] The first account can choose to display the marked marking controls in the target video, such as the second marking control. The second marking control can be the marking control marked by the second account at any video frame and any position of the point of interest in the target video.

[0161] The following are at least the cases where the marked controls marked in the target video are selected and displayed for the first account:

[0162] 1. Select and display the marked controls marked by the second account associated with the first account. Among them, the first account and the second account having an associated relationship means that there is a direct or indirect connection between the first account and the second account. For example: friend relationship, like relationship, comment relationship, etc.

[0163] 2. Select and display all the marked controls marked in the target video, that is, the relationship between the second account and the first account is not restricted. Schematically, the previously marked controls, or the marked controls being marked by the second account, can all be displayed on the video playback interface.

[0164] 3. Select and display the marked controls in the target video whose marked times exceed the times threshold. Among them, the marked times refer to the number of times the position of the point of interest has been marked. Different accounts may have differences in marking the position of the point of interest. When a certain position of the point of interest in the target video is marked multiple times, the number of marked controls for the position of the point of interest is relatively large. A times threshold can be set in advance. When the number of marked controls exceeds the times threshold, the marked control is displayed.

[0165] In an alternative embodiment, after the marked controls are displayed, the marked controls can also be selected to be hidden through a display control.

[0166] Among them, the display control is a functional control on the video playback interface. When the display control is in the on state, the marked controls are displayed on the video playback interface; when the display control is in the off state, the marked controls are hidden on the video playback interface. Schematically, the display state and the hidden state of the marked controls can be realized by overlaying a user interface (UI) on the video playback interface.

[0167] To sum up, by displaying the marked controls, it is possible to know the marked positions of the points of interest and the number of times the positions of the points of interest have been marked within the video segment. The viewer of the target video can more clearly know the positions of the points of interest in the target video by displaying the marked control information, improving the entertainment during video viewing and making the video interaction more targeted.

[0168] As Figure 8 shown, it is a schematic diagram of an interface showing the display of the marked controls in an exemplary embodiment.

[0169] The video playback interface 810 is a schematic diagram of an interface where the marked controls are not yet displayed.

[0170] Among them, the upper right corner of the video playback interface 810 includes a display control 811 for displaying the marking control and a setting control. The number above the display control 811 indicates the number of times the target video has been marked, that is, the number of marking controls. On the right side of the video playback interface 810 is a marking annotation control 812, that is, the viewer can drag the marking annotation control 812 to the position of the point of interest for annotation. Below the video playback interface 810 includes a progress bar indicating the duration of the target video, a video pause / play control for pausing the target video or resuming the playback of the target video, a video switching control for switching the current target video to other videos, and a video clarity switching control for adjusting the clarity of the current target video.

[0171] Among them, after the display control 811 is turned on, at least one marking control 821 is displayed on the video playback interface 810. The number on the marking control 821 refers to the total number of points of interest marked on the target video frame and adjacent video frames with the target video frame where the point of interest is located as the middle frame when marking the position of the point of interest. The number of adjacent video frames is counted through a preset statistical duration. Schematically, the preset statistical duration is ten seconds, and the statistical method is centered on the target video frame, and the number of marking controls in the five seconds before and after the target video frame is counted. At the same time, a marked timestamp 822 will appear on the video progress bar, and the display method of the marked timestamp 822 is the same as that of the marking control.

[0172] In summary, by performing a marking operation on the position of the point of interest of the target video frame in the target video, a marking control is displayed at the position of the point of interest to indicate the marking result of the current user on the position of the point of interest. Other users can display the marking controls marked by the current user, so as to learn the location of the wonderful content related to the target video, and directly locate to the location of the wonderful content according to the marking control, improving the human-computer interaction efficiency in the video interaction process.

[0173] As Figure 9 shown, it is the overall interface diagram of the marking process. Taking the dragging implementation of the marking process as an example, it is introduced.

[0174] Among them, the upper left corner of the video playback interface is an exit control and a video name, and the upper right corner includes a display control for displaying the marking control and a setting control. On the right side of the video playback interface is a marking annotation control, and the viewer can drag the marking annotation control to the position of the point of interest for annotation. Below the video playback interface includes a progress bar indicating the duration of the target video, a video pause / play control for pausing the target video or resuming the playback of the target video, a video switching control for switching the current target video to other videos, and a video clarity switching control for adjusting the clarity of the current target video.

[0175] The interface 910 is the starting situation for annotating the target video. When the video playback interface is triggered, it prompts to click on the marking and annotation control 911. In response to the click on the marking and annotation control, the video playback interface is as shown in interface 920, and it prompts "Drag and hold to the place you want to mark". By dragging the marking and annotation control 911, the marking and annotation control 911 moves along with the dragging operation. While a "+1" prompt is shown beside it, it is surrounded by a border. After the change, the updated prompt for the marking and annotation control is "Drag and hold", as shown in interface 930. Until the marking and annotation control 911 reaches the point of interest and is released, a first marking control 941 in the shape of the marking and annotation control is obtained. Near the first marking control 941, there are prompts "+1" and "Release to complete marking", indicating that the marking process is completed, as shown in interface 940. The above-mentioned marking process is the process of one marking. For the target video, the above operation can be repeated to obtain multiple marking controls.

[0176] In an optional embodiment, there are situations where the target video has different screen size displays on the video playback interface. Schematically, it can be displayed in full-screen ratio, in a stretched form, in a 4:3 form, in a 16:9 form, etc. When the target video is displayed on the video playback interface in a non-full-screen size, there will be some unfilled areas on the video playback interface, and there is no picture information of the target video in the unfilled areas. Schematically, when the marking and annotation control is dragged to the unfilled area, it prompts "This point cannot be marked. Please return to the target video area for marking", or "Releasing the marking and annotation control here is regarded as completing the marking at the edge point closest to this point", etc.

[0177] Optionally, when dragging the marking and annotation control, it may happen that it is dragged to the unfilled area of the target video or the edge of the video playback interface. As Figure 10 shown, when the marking and annotation control is dragged, a "+1" prompt will be generated around it, and the prompt and the marking and annotation control are surrounded by a border. A positioning line will also be drawn outside the border. When the marked and annotated control 102 surrounded by the border is dragged to the edge of the screen, the direction of the positioning line will automatically change, as shown in interface 101. Among them, the positioning line of the marked and annotated control 102 surrounded by the border helps to quickly locate the current position coordinates and time stamps. When the marked and annotated control 102 surrounded by the border is released at the edge, the point on the target video closest to the edge point of the video playback interface is used as the point of interest for annotation, and a new marking control is added at the position of the point of interest.

[0178] Schematically, during the playback of the target video, when the marking control 102 surrounded by a border is dragged to the edge point on the left side of the target video, the finger leaves the video playback interface. The moment of the target video when the finger leaves the target video and the position of this edge point are used as the timestamp and the position of the point of interest at the end of the drag operation, and a marking control is generated at the position of the point of interest, and the drag operation ends.

[0179] In summary, by performing a marking operation on the position of the point of interest in the target video frame of the target video, a marking control is displayed at the position of the point of interest to indicate the marking result of the current user at this point of interest position. Other users can display the marking controls marked by the current user, thereby learning the position where the wonderful content related to the target video is located, and directly positioning to the position where the wonderful content is located according to the marking control, improving the human-computer interaction efficiency in the video interaction process.

[0180] As Figure 11 shown, it is a schematic overall flow diagram provided by a schematic embodiment.

[0181] Taking the video resolution of the target video as 8K as an example for illustration, the method process involved in this embodiment involves a total of 5-terminal information exchanges, including user 1110, player user interface (User interface, UI) 1120, player software development data packet (Software Development Kit, SDK) 1130, server application programming interface (Application Programming Interface, API) 1140, and database 1150.

[0182] It mainly includes the following three processes: marking process 1160, displaying marking process 1170, and displaying marking comment process 1180. Among them, the MARK (mark) control is a control with a marking function, the MARK point is the marked position point, that is, the selected position of the point of interest, and the timestamp is the moment when the marked position point is located. Schematically, the implementation process of the method involved in this embodiment is as follows:

[0183] First: In the marking process 1160, the implementation process includes:

[0184] 1. The user 1110 enters the marking state by clicking on the MARK control on the video playback interface of the player UI 1120 or through other processes.

[0185] 2. By dragging the MARK control on the video playback interface, move the MARK control to the position of the point of interest of the target video frame being played in the player UI1120. According to the offset of the point of interest position in the target video frame and in combination with the screen size of the current target video frame, calculate the coordinate offset values Offset_x and Offset_y of the MARK control relative to the upper left corner of the actual resolution of the target video. That is, when there are differences between the screen size and video resolution of the current target video frame and the playback state and the actual screen size and video resolution of the target video, only need to convert the current screen size and video resolution, and the above method still applies.

[0186] 3. When the MARK control is located at the position of the point of interest of the target video, release the MARK control to complete the current marking operation and obtain the first marking control.

[0187] 4. Call the server API1140 interface to generate a unique ID of the current MARK control as an identifier, and store the data of the current MARK control. The data includes: the current timestamp timestamp, the relative coordinate values Offset_x and Offset_y. Complete the data recording of the first marking control through the (timestamp, Offset_x, Offset_y) triple data, and store the triple data in the database 1150.

[0188] 5. The database 1150 is stored in the form of key-value pairs (Key-Value, KV). Among them, the keyword Key includes the user identifier and the video identifier of the target video. The value Value in the key-value pair includes the above MARK triple data.

[0189] 6. After the server API1140 completes the marking, in addition to returning the information that the marking on the client is successful, synchronously call the MARK comment generation interface to generate and record comment data. Among them, the comments automatically generated by the MARK control are stored in the comment database and are interconnected with the above KV database, and the data can be called from each other.

[0190] II: In the display marking process 1170, the implementation process includes:

[0191] 1. When the user needs to view the MARK control, the user independently selects to turn on the MARK display switch for viewing the marking control on the player UI1120.

[0192] 2. After turning on the MARK display switch, asynchronously call the interface of the server API1140 to read the data of the current video marking control, and return the MARK data of 5S before and after the current video frame according to the timestamp corresponding to the current video playback progress.

[0193] 3. According to the current video playback progress, overlay the UI on the video screen played in the player SDK 1130, and render and display the MARK data marker points that have been obtained currently (i.e., the MARK controls within 5 seconds before and after the current video frame). The marker points need to calculate the positions of the marker controls drawn on the screen based on the Offset_x, Offset_y data, as well as the actual video resolution and the current display resolution. Optionally, according to the frame distance between the video frame marked by the MARK control and the current video frame, display the MARK control with a transparency that is in a positive correlation.

[0194] 4. When the user 1110 turns off the MARK display switch, clear the MARK data and hide the display.

[0195] III: In the display comment marking process 1180, the implementation process includes:

[0196] 1. When the MARK data is generated, a user comment is synchronously generated at the same time. The comment text includes the interest point position data and timestamp data in the MARK control.

[0197] 2. Click on the MARK point on the screen to locate the position of the comment in the UI layer of the player SDK 1130.

[0198] In summary, by performing a marking operation on the interest point position of the target video frame in the target video, a marker control is displayed at the interest point position to indicate the marking result of the current user on the interest point position. Other users can display the marker controls marked by the current user, thereby learning the positions of the wonderful contents related to the target video, and directly positioning to the positions of the wonderful contents according to the marker controls, improving the human-computer interaction efficiency in the video interaction process.

[0199] Figure 12 It is the structural block diagram of a video interaction device provided by an exemplary embodiment of the present application. As Figure 12 shown, the device includes the following parts:

[0200] A playback module 1210, configured to play a target video in a video playback interface, where the target video includes video frames;

[0201] A first control display module 1220, configured to, in response to a marking operation on a target video frame, display a first marker control at an interest point position in the target video frame, where the first marker control refers to marking at the interest point position on the target video frame, and the first marker control is used to indicate the marking result of the interest point position;

[0202] An information display module 1230 is configured to display marker control information in an information display area of the target video. The marker control information includes first control information corresponding to the first marker control, and the first control information is used to locate to the position of the point of interest in the target video frame.

[0203] In an optional embodiment, a marker annotation control is included in the video playback interface. The first control display module 1220 includes:

[0204] A receiving unit 1221 is configured to receive a drag operation on the marker annotation control;

[0205] A determining unit 1222 is configured to, in response to the drag operation, determine the position on the target video frame at the end of the drag operation as the position of the point of interest.

[0206] In an optional embodiment, the receiving unit 1221 is configured to receive a pause operation, and the pause operation is used to control the playback progress of the target video to pause at the time stamp corresponding to the target video frame.

[0207] In an optional embodiment, the receiving unit 1221 is further configured to receive a drag operation on the marker annotation control during the playback of the target video; during the playback of the target video, in response to the end of the drag operation, determine the video frame corresponding to the display at the end of the drag operation as the target video frame.

[0208] In an optional embodiment, the first control display module 1220 is further configured to receive a long press operation at the position of the point of interest on the target video frame, use the long press operation as the marking operation; generate comment data corresponding to the first marker control, and the comment data includes a positioning element, and the positioning element is used to indicate that the comment data is used to locate to the position of the point of interest in the target video frame.

[0209] In an optional embodiment, the information display module 1230 is configured to display, in a comment list of the target video, comment data corresponding to the marker control as the marker control information, including comment data corresponding to the first marker control as the first control information; display the marker control on a timeline of the target video as the marker control information, wherein the time stamp of the target video frame corresponding to the first marker control is displayed on the timeline.

[0210] In an optional embodiment, the first control display module 1220 is configured to, in response to a marking operation on the target video frame, determine a video segment with the target video frame as the middle frame; display the first marker control at the position of the point of interest in the video segment.

[0211] In an optional embodiment, the first control display module 1220 is further configured to display the first marking control in a target frame of the video segment, where a frame number distance between the target frame and the intermediate frame is positively correlated with a display transparency of the first marking control on the target frame.

[0212] In an optional embodiment, the apparatus further includes:

[0213] A prompt display module 1240, configured to display prompt information on the first marking control, where the prompt information is used to indicate the number of marking times corresponding to the first marking control.

[0214] In an optional embodiment, the video playback interface corresponds to a logged-in first account, and the apparatus further includes:

[0215] A second control display module 1250, configured to display a second marking control in the target video, where the second marking control is a control marked by a second account in the target video, and the second account is an account having an associated relationship with the first account.

[0216] In summary, the apparatus provided in this embodiment marks the position of the interest point of the target video frame in the target video, and thus displays a marking control at the position of the interest point to indicate the marking result of the current user at the position of the interest point. Other users can display the marking controls marked by the current user, so as to learn the position where the wonderful content related to the target video is located, and directly locate to the position where the wonderful content is located according to the marking control, improving the human-computer interaction efficiency in the video interaction process.

[0217] It should be noted that: for the video interaction apparatus provided in the above embodiment, only the above division of each functional module is used for illustration. In practical applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the video interaction apparatus provided in the above embodiment and the video interaction method embodiment belong to the same concept, and the specific implementation process thereof can be seen in the method embodiment, which will not be elaborated here.

[0218] Figure 14 FIG. shows a schematic structural diagram of a server provided by an exemplary embodiment of the present application. The server can be a server as Figure 2 shown.

[0219] Specifically: The server 1400 includes a Central Processing Unit (CPU) 1401, a system memory 1404 including a Random Access Memory (RAM) 1402 and a Read Only Memory (ROM) 1403, and a system bus 1405 connecting the system memory 1404 and the central processing unit 1401. The server 1400 also includes a mass storage device 1406 for storing an operating system 1413, application programs 1414, and other program modules 1415.

[0220] The mass storage device 1406 is connected to the central processing unit 1401 through a mass storage controller (not shown) connected to the system bus 1405. The mass storage device 1406 and its associated computer-readable medium provide non-volatile storage for the server 1400. That is to say, the mass storage device 1406 may include computer-readable media (not shown) such as a hard disk or a Compact Disc Read Only Memory (CD-ROM) drive.

[0221] Without loss of generality, computer-readable media can include computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes RAM, ROM, Erasable Programmable Read Only Memory (EPROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other solid-state storage technologies, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, magnetic tape cartridges, tapes, magnetic disk storage or other magnetic storage devices. Of course, those skilled in the art will know that computer storage media is not limited to the above several. The above-mentioned system memory 1404 and mass storage device 1406 can be collectively referred to as memory.

[0222] According to various embodiments of the present application, the server 1400 may also run on a remote computer on the network connected through a network such as the Internet. That is, the server 1400 may be connected to the network 1412 through the network interface unit 1411 connected to the system bus 1405. Or rather, the network interface unit 1411 may also be used to connect to other types of networks or remote computer systems (not shown).

[0223] The above-mentioned memory further includes one or more programs, and the one or more programs are stored in the memory and configured to be executed by the CPU.

[0224] Embodiments of the present application further provide a computer device, which may be implemented as a Figure 2 terminal or a server as shown. The computer device includes a processor and a memory. At least one instruction, at least one program, a code set or an instruction set is stored in the memory, and the at least one instruction, at least one program, the code set or the instruction set is loaded and executed by the processor to implement the video interaction method provided by the above method embodiments.

[0225] Embodiments of the present application further provide a computer-readable storage medium, on which at least one instruction, at least one program, a code set or an instruction set is stored, and the at least one instruction, at least one program, the code set or the instruction set is loaded and executed by the processor to implement the video interaction method provided by the above method embodiments.

[0226] Embodiments of the present application further provide a computer program product or a computer program, which includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the video interaction method described in any one of the above embodiments.

[0227] Optionally, the computer-readable storage medium may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), solid state drive (SSD, Solid State Drives), or optical disc, etc. Among them, the random access memory may include resistive random access memory (ReRAM, Resistance RandomAccess Memory) and dynamic random access memory (DRAM, Dynamic Random Access Memory). The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.

[0228] Those of ordinary skill in the art can understand that all or part of the steps to implement the above embodiments can be completed by hardware, or can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. The above-mentioned storage medium can be a read-only memory, a disk, an optical disc, etc.

[0229] The above are only alternative embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included within the protection scope of the present application.

Claims

1. A video interaction method, characterized in that, The method includes: Playing a target video in a video playback interface, where the target video includes video frames; In response to a marking operation on a target video frame, determining a video segment with the target video frame as the intermediate frame, where the marking operation refers to marking at the position of an interest point on the target video frame; Based on the frame number distance between the target frame and the intermediate frame, displaying a first marking control in the target frame of the video segment in a gradient form, where the gradient form includes at least one of a transparency gradient form, a clarity gradient form, and a color gradient form, and the first marking control is used to indicate the marking result of the interest point position; the target frame includes the intermediate frame and video frames having an adjacent relationship with the intermediate frame; Displaying marking control information in an information display area of the target video, where the marking control information includes first control information corresponding to the first marking control, and the first control information is used to locate to the position of the interest point in the target video frame.

2. The method according to claim 1, characterized in that, The video playback interface includes a marking annotation control; The method further includes: Receiving a dragging operation on the marking annotation control; In response to the dragging operation, determining the position on the target video frame at the end of the dragging operation as the interest point position.

3. The method according to claim 2, characterized in that, Before receiving the dragging operation on the marking annotation control, it further includes: Receiving a pause operation, where the pause operation is used to control the playback progress of the target video to pause at the time stamp corresponding to the target video frame.

4. The method according to claim 2, wherein Receiving the dragging operation on the marking annotation control includes: Receiving a dragging operation on the marking annotation control during the playback of the target video; The method further includes: During the playback of the target video, in response to the end of the dragging operation, determining the video frame corresponding to the display at the end of the dragging operation as the target video frame.

5. The method according to claim 1, characterized in that, The method further includes: Receiving a long-press operation at the position of the interest point on the target video frame, and taking the long-press operation as the marking operation.

6. The method according to any one of claims 1 to 5, characterized in that The method further includes: Generating comment data corresponding to the first marking control, where the comment data includes a positioning element, and the positioning element is used to indicate locating to the position of the interest point in the target video frame through the comment data.

7. The method according to claim 6, wherein Displaying the marking control information in the information display area of the target video includes: Displaying the comment data corresponding to the marking control in the comment list of the target video as the marking control information, where the comment data corresponding to the first marking control is included as the first control information.

8. The method according to any one of claims 1 to 5, characterized in that, Displaying the marking control information in the information display area of the target video includes: Displaying the marking control on the timeline of the target video as the marking control information, where the time stamp of the target video frame corresponding to the first marking control is displayed on the timeline.

9. The method according to any one of claims 1 to 5, characterized in that The frame number distance between the target frame and the intermediate frame has a positive correlation with the display transparency of the first marking control on the target frame.

10. The method according to any one of claims 1 to 5, characterized in that The method further includes: Display a prompt message on the first marking control, where the prompt message is used to indicate the marking times corresponding to the first marking control.

11. According to the method according to any one of claims 1 to 5, characterized in that The video playback interface corresponds to the logged-in first account; The method further includes: Display a second marking control in the target video, where the second marking control is a control marked by a second account in the target video, and the second account is an account associated with the first account.

12. A video interaction device, characterized in that, The device includes: A playback module, configured to play a target video in a video playback interface, where the target video includes video frames; A first control display module, configured to, in response to a marking operation on a target video frame, determine a video segment with the target video frame as the middle frame, where the marking operation refers to marking at an interest point position on the target video frame; display a first marking control in the target frame of the video segment in a gradual change form based on the frame number distance between the target frame and the middle frame, where the gradual change form includes at least one of a transparency gradual change form, a clarity gradual change form, and a color gradual change form, and the first marking control is used to indicate the marking result of the interest point position; the target frame includes the middle frame and video frames adjacent to the middle frame; An information display module, configured to display marking control information in an information display area of the target video, where the marking control information includes first control information corresponding to the first marking control, and the first control information is used to locate to the interest point position in the target video frame.

13. A computer device, characterized in that, The computer device includes a processor and a memory, and at least one program is stored in the memory, and the at least one program is loaded and executed by the processor to implement the video interaction method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that, At least one program is stored in the storage medium, and the at least one program is loaded and executed by a processor to implement the video interaction method according to any one of claims 1 to 11.

15. A computer program product, characterized in that, Including a computer program or instruction, where the computer program or instruction, when executed by a processor, implements the video interaction method according to any one of claims 1 to 11.

Images