Video playing method and device, electronic equipment and storage medium

Abstract

The invention discloses a video playing method and device, electronic equipment and a storage medium, and relates to the technical field of computers, and the method comprises the steps: obtaining animation data corresponding to a current playing point position from a server when a client plays a target video, determining first animation identification information through analysis, obtaining animation materials according to the first animation identification information, and playing the animation materials according to the first animation identification information; determining a playing point location corresponding to the first animation identification information as a prompt point location, and displaying animation triggering prompt information when it is detected that the target video is played to the prompt point location; then, responding to the animation triggering operation of the user, determining the animation triggered by the user, creating an animation layer and rendering and playing the animation triggered by the user, so that the requirement of the user for quickly and conveniently performing video interaction is met, and a video interaction task is realized; moreover, the animation triggered by the user is popped up and displayed on the video playing interface, so that a video interaction effect similar to a bullet screen is realized, selectable bullet screen types of the user are enriched, and the interaction experience when the user watches the video is optimized.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a video playback method, device, electronic device and storage medium. Background Art

[0002] Danmu refers to the commentary subtitles that pop up when watching a video. With Danmu, users can view the comments sent by other users and send real-time comments while watching the video, and participate in the video discussion.

[0003] The existing bullet screen format is relatively simple, usually in plain text format, so when users interact with videos, they often need to click on the bullet screen input box, enter the bullet screen content, and send the bullet screen, which is a cumbersome process. If users want to interact with videos in a timely manner, it is easy for them to miss the wonderful content and affect their viewing experience. If they do not want to miss the wonderful content, they can only postpone sending the bullet screen. Based on this, the existing bullet screen video interaction method cannot meet the user's video interaction needs. Summary of the invention

[0004] In view of the above problems, the present application provides a video playback method, device, electronic device and storage medium, which provide a basis for realizing convenient and fast video interaction tasks.

[0005] The specific plan is as follows:

[0006] A first aspect of the present application provides a video playback method, which is applied to a video playback system, wherein the video playback system includes a client and a server, and the method includes:

[0007] When playing the target video on the video playback interface of the client, the client sends an animation data acquisition request to the server, where the animation data acquisition request carries the current playback point of the target video;

[0008] The server, in response to the animation data acquisition request, searches for animation data corresponding to the current playback point from the animation data configured by the server, wherein the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video; and sends the found animation data to the client;

[0009] The client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as a prompt point; obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, displays the animation trigger prompt information corresponding to the prompt point played on the video playback interface; in response to the user's animation trigger operation, determines the animation triggered by the user as a second animation; creates a second animation layer on the video playback interface, and renders and plays the animation material of the second animation on the second animation layer; wherein the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

[0010] A second aspect of the present application provides a video playback method, which is applied to a client. The method comprises: in a process of playing a target video on a video playback interface of the client, performing the following steps:

[0011] Configure an animation data acquisition request, where the animation data acquisition request carries the current playback point of the target video;

[0012] Sending the animation data acquisition request to the server, wherein the animation data acquisition request is used to request the server to search for animation data corresponding to the current playback point from the animation data configured by the server and to feed back the found animation data to the client; the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video;

[0013] Receive and parse the animation data fed back by the server, determine the first animation identification information contained in the received first type of animation data, and determine the playback point corresponding to the first animation identification information as the prompt point;

[0014] Acquire animation material of a first animation corresponding to the first animation identification information;

[0015] When it is detected that the target video is played to the prompt point, the animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface; the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played;

[0016] In response to an animation triggering operation by a user, determining the animation triggered by the user as a second animation;

[0017] A second animation layer is created on the video playback interface, and animation material of the second animation is rendered and played on the second animation layer.

[0018] A third aspect of the present application provides a video playback method, applied to a server, the method comprising:

[0019] Receive an animation data acquisition request; the animation data acquisition request is a request sent by a client that plays a target video through a video playback interface and carries the current playback point of the target video;

[0020] In response to the animation data acquisition request, searching for animation data corresponding to the current playback point from the animation data configured by the server, wherein the animation data configured by the server includes first-category animation data pre-configured by the server based on video content of the target video;

[0021] The found animation data is sent to the client so that the client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as a prompt point, and obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, the animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface, and in response to the user's animation trigger operation, the animation triggered by the user is determined as a second animation, a second animation layer is created on the video playback interface, and the animation material of the second animation is rendered and played on the second animation layer; wherein the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

[0022] A fourth aspect of the present application provides a video playback device, applied to a client, the device comprising:

[0023] An animation data acquisition unit, used to configure an animation data acquisition request during the process of playing the target video on the video playback interface of the client, wherein the animation data acquisition request carries the current playback point of the target video;

[0024] Sending the animation data acquisition request to the server, wherein the animation data acquisition request is used to request the server to search for animation data corresponding to the current playback point from the animation data configured by the server and to feed back the found animation data to the client; the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video;

[0025] An animation information determination unit, used to receive and analyze the animation data fed back by the server, determine the first animation identification information contained in the received first type of animation data, and determine the playback point corresponding to the first animation identification information as a prompt point;

[0026] An animation material acquisition unit, used to acquire the animation material of the first animation corresponding to the first animation identification information;

[0027] An animation trigger prompt unit is used to display animation trigger prompt information corresponding to the prompt point played on the video playback interface when detecting that the target video is played to the prompt point; the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played;

[0028] An animation barrage display unit is used to respond to the user's animation triggering operation, determine the animation triggered by the user as the second animation; create a second animation layer on the video playback interface, and render and play the animation material of the second animation on the second animation layer.

[0029] A fifth aspect of the present application provides a video playback device, applied to a server, the device comprising:

[0030] A request receiving unit, configured to receive an animation data acquisition request; the animation data acquisition request is a request carrying the current playback point of the target video sent by a client playing the target video through a video playback interface;

[0031] a request response unit, configured to search for animation data corresponding to the current playback point from the animation data configured by the server in response to the animation data acquisition request, wherein the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video;

[0032] A data feedback unit is used to send the found animation data to the client, so that the client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as a prompt point, and obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, the animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface, and in response to the user's animation trigger operation, the animation triggered by the user is determined as a second animation, a second animation layer is created on the video playback interface, and the animation material of the second animation is rendered and played on the second animation layer; wherein the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

[0033] A sixth aspect of the present application provides an electronic device, comprising at least one processor and a memory connected to the processor, wherein:

[0034] The memory is used to store computer programs;

[0035] The processor is used to execute the computer program to implement the video playback method described in the second aspect or the third aspect.

[0036] In a seventh aspect, the present application provides a storage medium, which carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement the video playback method described in the second or third aspect above.

[0037] By means of the above technical scheme, during the process of playing the target video on the video playback interface of the client, the client sends an animation data acquisition request to the server, so that the server searches for and feeds back the animation data corresponding to the current playback point from the configured animation data, wherein the animation data configured by the server includes a first type of animation data pre-configured based on the video content; the client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and obtains the animation material accordingly, so as to provide a basis for quickly responding to the user's animation trigger operation, and determines the playback point corresponding to the first animation identification information as a prompt point, and then when it is detected that the target video is played to the prompt point, the display The corresponding animation trigger prompt information is displayed to prompt the user to trigger the corresponding first animation, which provides a basis for the user to quickly trigger the interactive animation and conduct video interaction; thereafter, in response to the user's animation trigger operation, the animation triggered by the user is determined as the second animation, and a second animation layer is created on the video playback interface, and the animation material of the second animation is rendered and played, thereby realizing the video interaction task and meeting the user's needs for quick video interaction; and, the present application realizes a video interaction effect similar to barrage by popping up the animation triggered by the user on the video playback interface, enriches the types of barrage that users can select, improves the diversity of video barrage, and helps to optimize the user's interactive experience when watching videos. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present application. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0039] Figure 1 A flowchart of a video playback method provided by this application;

[0040] Figure 2 An example of a schematic diagram of the display process of an interactive animation is provided;

[0041] Figure 3 A schematic diagram of the structure of a video playback device provided in this application;

[0042] Figure 4 A schematic diagram of the structure of an electronic device provided in this application. DETAILED DESCRIPTION

[0043] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation mode of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application. It is known to those skilled in the art that with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0044] The present application provides a video playback method, device, electronic device and storage medium, which can be used to solve video interaction tasks and provide a basis for users to quickly interact with videos.

[0045] The video playback method provided in the embodiment of the present application can be applied to a video playback system, which includes a client and a server.

[0046] The client described in this application may refer to a client for providing video playback services to users. The client generally runs on a client, such as a mobile terminal or a computer. The client may specifically refer to a video playback software or a video playback webpage (such as HTML5, referred to as H5) running on a mobile terminal such as an Android terminal, an IOS terminal, a PAD, or a personal computer (PC). The server described in this application may refer to a server for providing animated bullet screen support to the client.

[0047] On the basis of the above, the method may include the following steps:

[0048] The first step is that when the target video is played on the video playback interface of the client, the client sends a request to obtain animation data to the server.

[0049] The animation data acquisition request carries the current playback point of the target video.

[0050] In the second step, the server responds to the animation data acquisition request, searches for animation data corresponding to the current playback point from the animation data configured by the server, and sends the found animation data to the client.

[0051] Among them, the animation data configured by the server may include a first type of animation data pre-configured by the server based on the video content of the target video. Exemplarily, the animation involved in the animation data of the target video may include: action animations of video characters involved in the target video and videos related to the target video, and the actions in the action animations may be changes in facial expressions or body position of the video characters, such as body movements made by the video characters in the target video or videos related to the target video. By sending the above-mentioned action animations, users can increase their sense of immersion when watching videos, and the popularity of the video, especially the popularity of the video characters, can be determined by the number of times each user sends the action animations.

[0052] The animation data configured by the server may be composed of animation identification information and the playback point of the animation corresponding to the animation identification information in the target video, wherein the animation identification information may refer to an animation ID that is a unique identifier of the animation material, the animation corresponding to the animation identification information may refer to a pre-generated action animation of a video character, and the playback point in the first category of animation data may correspond to the best trigger display point of the animation. Based on this, optionally, the first category of animation data corresponding to the current playback point may include: the first category of animation data whose playback point is within a specified video segment, wherein the specified video segment is a video segment of a specified duration after the current playback point. Exemplarily, the specified duration may be set according to the periodicity of the client requesting the animation data from the server.

[0053] In addition, depending on the actual situation, the animation data found may include one set of animation data or multiple sets of animation data. In particular, if any set of animation data is not found, the subsequent steps will not be executed.

[0054] Step 3: The client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as the prompt point; obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, displays the animation trigger prompt information corresponding to the prompt point played on the video playback interface; in response to the user's animation trigger operation, determines the animation triggered by the user as the second animation; creates a second animation layer on the video playback interface, and renders and plays the animation material of the second animation on the second animation layer.

[0055] The animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

[0056] Next, the video playback method provided by the present application is described from the perspective of the client. The video playback method described below can be referenced to the video playback method described above.

[0057] Figure 1 The following is a flow chart of a video playback method provided by the present application, which can be applied to a client. Figure 1 As shown, the method may include: in the process of playing the target video on the video playback interface of the client, executing the following steps:

[0058] Step S101: configure an animation data acquisition request, and send the animation data acquisition request to a server.

[0059] The animation data acquisition request carries the current playback point of the target video, and the animation data acquisition request can be used to request the server to search for animation data corresponding to the current playback point from the animation data configured by the server and to feed back the found animation data to the client. The animation data configured by the server may include first-category animation data pre-configured by the server based on the video content of the target video.

[0060] Step S102: receiving and parsing the animation data fed back by the server, determining the first animation identification information contained in the received first type of animation data, and determining the playback point corresponding to the first animation identification information as a prompt point.

[0061] Specifically, when the received first type of animation data includes multiple groups of animation data, the determined first animation identification information may be one or more, that is, the multiple groups of animation data may contain repeated animation identification information, that is, one first animation identification information may correspond to at least one prompt point.

[0062] Step S103: Acquire animation material of a first animation corresponding to the first animation identification information.

[0063] In a possible implementation, various animation materials may be pre-configured on the client for user use. On this basis, the acquisition of animation materials may refer to acquisition from the local computer to speed up the response to the user's animation triggering operation.

[0064] However, as the amount of animation materials increases, this configuration will cause the client to bear greater data storage pressure, which will have an adverse impact on the client's operating performance. To solve the above problem, in another possible implementation, each animation material can be pre-configured on the server for the client to request and obtain. Optionally, when the client starts playing the target video, it can obtain animation materials related to the target video from the server and store the animation material library of the target video locally. Based on this, the above-mentioned acquisition of the target animation material can refer to acquisition from the animation material library of the target video stored locally. Optionally, after determining the first animation identification information, the client can also obtain the animation material of the corresponding first animation from the server. Based on this, the above-mentioned acquisition of the animation material can also refer to acquisition from the server.

[0065] In addition, different animation material configuration methods can be adopted for different animations. For example, animation material configuration can be performed according to the situation where the user triggers the animation. Specifically, animation materials that are frequently used by users can be stored locally. Animation material configuration can also be performed according to the file size of the animation material. Specifically, animation materials that are frequently used by users and have larger files can be stored locally.

[0066] Step S104: when it is detected that the target video is played to the prompt point, animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface.

[0067] Among them, the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played. In particular, when the prompt point played has multiple corresponding first animation identification information, that is, when the prompt point played has multiple first animations, multiple animation trigger prompt information can be displayed on the video playback interface for user selection, and the displayed multiple animation trigger prompt information can be arranged in a preset order. Exemplarily, the above-mentioned animation trigger prompt information can be an animation diagram or icon.

[0068] Step S105: In response to the animation triggering operation of the user, determine the animation triggered by the user as the second animation.

[0069] Step S106: creating a second animation layer on the video playback interface, and rendering and playing the animation material of the second animation on the second animation layer.

[0070] Optionally, after step S106, the method may further include: after the animation material of the second animation is played, destroying the second animation layer.

[0071] By destroying the created animation layer after playback is completed, the resource usage on the client is reduced, which helps to ensure normal video playback and, to a certain extent, avoids client freezes or even freezes.

[0072] It should be noted that when the received first type of animation data includes multiple groups of animation data, that is, when multiple prompting points are determined, steps S104 to S106 are performed for each prompting point.

[0073] By means of the above scheme, during the process of playing the target video on the video playback interface of the client, the client sends an animation data acquisition request to the server, so that the server searches for and feeds back the animation data corresponding to the current playback point from the configured animation data, wherein the animation data configured by the server includes a first type of animation data pre-configured based on the video content; the client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and obtains the animation material accordingly, so as to provide a basis for quickly responding to the user's animation trigger operation, and determines the playback point corresponding to the first animation identification information as a prompt point, and then displays when it is detected that the target video is played to the prompt point. The corresponding animation trigger prompt information is used to prompt the user to trigger the corresponding first animation, thereby providing a basis for the user to quickly trigger the interactive animation and conduct video interaction; thereafter, in response to the user's animation trigger operation, the animation triggered by the user is determined as the second animation, and a second animation layer is created on the video playback interface, and the animation material of the second animation is rendered and played, thereby realizing the video interaction task and meeting the user's needs for quick video interaction; and, the present application realizes a video interaction effect similar to barrage by popping up the animation triggered by the user on the video playback interface, thereby enriching the types of barrage that users can select, improving the diversity of video barrage, and helping to optimize the user's interactive experience when watching videos.

[0074] In one or more embodiments provided in the present application, in the process of playing the target video on the video playback interface, the following steps may also be included:

[0075] Step S201: displaying a material library logo on the video playback interface.

[0076] The material library identifier is used to prompt the user to view the animation material library of the target video and trigger any animation in the animation material library.

[0077] Step S202: In response to a user triggering operation on the material library identifier, displaying a material library view of the animation material library.

[0078] Among them, the material library view may include animation icons corresponding to each animation in the animation material library. It should be noted that the animation icon and material library logo described in the present application may refer to an icon, such as an animation icon composed of a certain animation screen of an animation. In addition, the animation material library of the target video includes all animation materials of the target video and related videos of the target video. Optionally, different animation materials may have their own corresponding effective time, which effectively indicates the time period in which the animation material is available. Based on this, the animation icon in the above-mentioned material library view may carry corresponding status information to indicate whether the animation is in an available state, or the above-mentioned material library view may only include animation icons corresponding to animations that are in an available state at the current playback point.

[0079] Regarding the display mode of the material library view, in one possible implementation, the material library view can be displayed on a material library interface independent of the video playback interface; in another possible implementation, the material library view can be displayed in the video playback interface. Exemplarily, the various animation icons constituting the material library view can be sequentially displayed in a certain area in the video playback interface according to a preset order; in addition, the user can change the animation icon displayed in the area by sliding in the area.

[0080] Regarding the order of animation icons in the library view, in a possible implementation, the animation icons in the library view displayed on the video playback interface can be arranged in descending order of relevance to the current video clip content. The current video clip content is the video clip content when the user triggers the library identifier. In addition, the order of animation icons in the library view can also be configured according to the user's interactive habits when watching the target video and related videos of the target video, or the heat of the animation. Exemplarily, the heat of the animation can be represented by parameters such as the number of times each user sends the animation.

[0081] Step S203, in response to a user triggering operation on any animation icon in the material library view, determining the animation triggered by the user as a fourth animation; creating a fourth animation layer on the video playback interface, and rendering and playing the animation material of the fourth animation on the fourth animation layer.

[0082] Optionally, after step S203, the method may further include: after the animation material of the fourth animation is played, destroying the fourth animation layer.

[0083] The above scheme provides another interactive animation sending method, which can support users to conduct video interactions with greater freedom in time and richer content, and provides a basis for meeting diverse user interaction needs.

[0084] Optionally, the method may further include:

[0085] In response to the user's animation triggering operation, the animation bullet screen reporting information is uploaded to the server.

[0086] The animation barrage reporting information includes the animation identification information and sending time of the animation triggered by the user, and the animation barrage reporting information is used for the server to configure animation data.

[0087] It should be noted that the animation trigger operation responded to in the above steps can be the animation trigger operation described in step S105, in which case, the animation bullet screen reporting information of the second animation is uploaded, including the animation identification information and sending time of the second animation; it can also be the animation trigger operation described in step S203, in which case, the animation bullet screen reporting information of the fourth animation is uploaded, including the animation identification information and sending time of the fourth animation. In addition, the uploaded animation bullet screen reporting information can also include user identification information, such as user ID, target video identification information, such as episode ID and other information.

[0088] Based on the above content, the server can configure the animation data of the target video according to the information of each user triggering the interactive animation, so that the server can provide the user with richer animation data, such as the first type of animation data.

[0089] In one or more embodiments provided in the present application, the animation data configured by the server may also include second type animation data configured by the server based on animation barrage reporting information reported by each client.

[0090] On the basis of the above, after receiving and parsing the animation data fed back by the server, the following may also be included:

[0091] Step S107: determining the third animation identification information contained in the received second type animation data, and determining the playback point corresponding to the third animation identification information as the animation playback point.

[0092] After step S107, the animation information sent by other users when watching the target video can be obtained. For example, the animation information selected by other users to send can be obtained through Ajax (Asynchronous Javascript And XML) or webSocket (a full-duplex communication protocol based on the transmission control protocol TCP). On this basis, the determined third animation identification information and playback point can be n groups of animation data in the received second type of animation data, where n represents a preset number, and its value can be set according to the client performance to ensure that the number of interactive animations played simultaneously by the client does not exceed the preset number, thereby avoiding client freezes.

[0093] Step S108: Acquire animation material of the third animation corresponding to the third animation identification information.

[0094] Step S109, when it is detected that the target video is played to the animation playback point, a third animation layer is created on the video playback interface, and the animation material of the third animation corresponding to the animation playback point played is rendered and played on the third animation layer. Optionally, after step S109, the method may further include: after the animation material of the third animation is played, the third animation layer is destroyed.

[0095] Optionally, the second type of animation data may also include the number of times the animation is used. If the number of times the animation is used is multiple, multiple identical interactive animations may be rendered and played on the video playback interface provided that the total number of animations does not exceed a preset number. Figure 2 An example of a schematic diagram of the display effect of an interactive animation is shown, wherein two interactive animations a including attacking actions are shown, thereby providing a more intense and richer battle scene.

[0096] Next, the video playback method provided by the present application is described from the perspective of the server. The video playback method described below can be referenced to the video playback method described above.

[0097] The embodiment of the present application also provides a video playback method, which can be applied to a server, and the method includes the following steps:

[0098] Step S301: Receive a request for obtaining animation data.

[0099] The animation data acquisition request is a request carrying the current playback point of the target video, sent by a client that plays the target video through a video playback interface.

[0100] Step S302: In response to the animation data acquisition request, searching for animation data corresponding to the current playback point from the animation data configured by the server.

[0101] The animation data configured by the server may include first-category animation data pre-configured by the server based on the video content of the target video.

[0102] Step S303, sending the found animation data to the client, so that the client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as a prompt point, and obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, the animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface, and in response to the user's animation trigger operation, the animation triggered by the user is determined as a second animation, a second animation layer is created on the video playback interface, and the animation material of the second animation is rendered and played on the second animation layer; wherein the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

[0103] In one or more embodiments provided in the present application, the process of configuring the animation data by the server based on the video content of the target video may include:

[0104] Step A: analyzing the video content of the target video, determining at least one highlight segment in the target video, and recording the highlight segment information of the target video.

[0105] In one possible implementation, the video content can be analyzed in combination with a video character recognition algorithm and a highlight recognition algorithm. Specifically, the celebrity characters (such as popular characters) in the video characters involved in the target video can be marked in advance, and on this basis, the video content is analyzed and identified to find out the moments when the celebrity characters appear in the target video and determine the time segments where the highlights are located, thereby achieving the task of identifying the highlight segments.

[0106] The highlight segment information may include the start time and segment tag of each highlight segment, and may also include the end time of each highlight segment, and the segment tag is used to characterize the content of the video segment. For example, in a video character recognition algorithm, the tag may be the identification information of a video character, such as a character ID; in a highlight recognition algorithm, the tag may be a highlight segment tag.

[0107] Optionally, the above-mentioned highlight segment recognition task can be implemented using a pre-trained highlight segment recognition model, and the model can be trained using videos marked with highlight segment tags, and the tag information can be set with reference to the highlight segment information. On this basis, the highlight segment recognition model can be used to process the target video, identify the highlight segments in the target video, and the server can perform visual management on the identified highlight segments. In addition, the output of the highlight segment recognition model can also include confidence, based on which, video segments with confidence greater than a preset threshold (such as 0.85) can be determined as highlight segments, and video segments with confidence not greater than the preset threshold can be manually reviewed to determine whether they are highlight segments, thereby obtaining all the highlight segments of the target video.

[0108] Step B: for any highlight segment, search for animation material matching the segment tag of the highlight segment from a pre-configured animation material library, and use the start time of the highlight segment as the playback point of the animation material found to generate animation data corresponding to the highlight segment.

[0109] The animation data corresponding to the wonderful clip includes the animation identification information and the playback point of the animation material found.

[0110] It should be noted that the server can also be used to receive and store manually uploaded animation materials, build an animation material library, and implement management tasks for animation materials, especially visualization management tasks for available materials. In addition, the animation materials stored in the server can be configured with material information. For example, Table 1 shows a material information table of animation materials, which shows the fields of material information and corresponding descriptions.

[0111] Table 1

[0112]

[0113] Based on this, the animation material matching the segment tag of the highlight segment can be searched by using the description of the animation material and the information of the associated roles. In addition, the material information shown in Table 1 can be configured when the material is stored, and can be configured or updated during use.

[0114] Step C: generating the first type of animation data of the target video.

[0115] The first type of animation data of the target video may include: animation data corresponding to each wonderful segment in the target video.

[0116] Based on this, the first type of animation data received by the client may include: animation data corresponding to the wonderful clips in the specified video segment after the current playback point, thereby realizing the task of obtaining the time points and animation information of the recommended interactive animations in advance, and providing a basis for guiding users to interact with videos and participate in wonderful video clips.

[0117] In one or more embodiments provided in the present application, the animation data configured by the server may also include second type animation data configured by the server based on animation barrage reporting information reported by each client.

[0118] On the basis of the above, the process of configuring the animation data by the server based on the animation bullet screen reporting information reported by each client may include:

[0119] Step D: Receive the animation bullet screen reporting information uploaded by each client.

[0120] The animation barrage reporting information is information reported by the client in response to the user's animation triggering operation, and the animation barrage reporting information includes the animation identification information and sending time of the animation triggered by the user.

[0121] Step E: Divide the target video into multiple video segments according to the time length, and count the animation identification information with the sending time in each video segment respectively.

[0122] Step F: for any video segment, determine the animation corresponding to the largest number of animation identification information in the video segment as the animation corresponding to the video segment, use the start time of the video segment as the playback point of the animation corresponding to the video segment, and generate animation data corresponding to the video segment.

[0123] The animation data corresponding to the video segment may include animation identification information and a playback point of the animation corresponding to the video segment.

[0124] Step G: Generate the second type of animation data of the target video.

[0125] The second type of animation data of the target video includes: animation data corresponding to each video segment constituting the target video. In other words, the server can also be used to recycle data of user interaction feedback and configure the animation data of the target video accordingly.

[0126] It should be noted that in another possible implementation, the animation data configuration scheme shown in step DG can also be used to configure the first type of animation data of the target video as a basis for prompting the user to trigger the animation barrage. Based on the above content, the first animation determined may be an animation related to the subsequent video content, or it may be the most used animation in the subsequent video segment, thereby achieving a video interaction task that takes into account both plot requirements and user requirements.

[0127] On the basis of the above, the second type of animation data fed back by the server to the client can be used for the client to determine the third animation identification information contained in the received second type of animation data, and determine the playback point corresponding to the third animation identification information as the animation playback point, obtain the animation material of the third animation corresponding to the third animation identification information, and when it is detected that the target video is played to the animation playback point, create a third animation layer on the video playback interface, and render and play the animation material of the third animation corresponding to the animation playback point played on the third animation layer.

[0128] The video playback device provided in an embodiment of the present application is described below. The video playback device described below and the video playback method described above can refer to each other.

[0129] Figure 3 FIG. 1 is a schematic diagram of the structure of a video playback device disclosed in an embodiment of the present application, which can be applied to a client. Figure 3 As shown, the device may include:

[0130] The animation data acquisition unit 11 is used to configure an animation data acquisition request during the process of playing the target video on the video playback interface of the client, wherein the animation data acquisition request carries the current playback point of the target video; send the animation data acquisition request to the server, wherein the animation data acquisition request is used to request the server to search for animation data corresponding to the current playback point from the animation data configured by the server and feed back the found animation data to the client; the animation data configured by the server includes the first type of animation data pre-configured by the server based on the video content of the target video;

[0131] The animation information determining unit 12 is used to receive and analyze the animation data fed back by the server, determine the first animation identification information contained in the received first type of animation data, and determine the playback point corresponding to the first animation identification information as the prompt point;

[0132] Animation material acquisition unit 13, used to acquire animation material of a first animation corresponding to the first animation identification information;

[0133] The animation trigger prompt unit 14 is used to display the animation trigger prompt information corresponding to the prompt point played on the video playback interface when it is detected that the target video is played to the prompt point; the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played;

[0134] The animation barrage display unit 15 is used to respond to the user's animation triggering operation, determine the animation triggered by the user as the second animation; create a second animation layer on the video playback interface, and render and play the animation material of the second animation on the second animation layer.

[0135] In one or more embodiments provided in the present application, the device may also include: an animation barrage information reporting unit, used to upload animation barrage reporting information to the server in response to the user's animation trigger operation, the animation barrage reporting information including the animation identification information and sending time of the animation triggered by the user, and the animation barrage reporting information is used for the server to configure animation data.

[0136] In one or more embodiments provided in the present application, the animation data configured by the server also includes a second type of animation data configured by the server based on animation barrage reporting information reported by each client.

[0137] On the basis of the above, the device may further include: a unit for determining an animation to be played.

[0138] The to-be-played animation determination unit is used to determine the third animation identification information contained in the received second-category animation data after receiving and parsing the animation data fed back by the server, and determine the playback point corresponding to the third animation identification information as the animation playback point;

[0139] The animation material acquisition unit 13 may also be used to acquire the animation material of the third animation corresponding to the third animation identification information;

[0140] The animation barrage display unit 15 can also be used to create a third animation layer on the video playback interface when it is detected that the target video is played to the animation playback point, and render and play the animation material of the third animation corresponding to the animation playback point played to the third animation layer.

[0141] In one or more embodiments provided in the present application, the device further includes: a material library display unit, configured to display a material library identifier on the video playback interface during the process of playing the target video on the video playback interface, wherein the material library identifier is used to prompt a user to view an animation material library of the target video and trigger any animation in the animation material library; in response to a user triggering operation on the material library identifier, display a material library view of the animation material library; the material library view includes animation icons corresponding to each animation in the animation material library;

[0142] The animation barrage display unit 15 can also be used to: in response to a user's triggering operation on any animation icon in the material library view, determine the animation triggered by the user as the fourth animation; create a fourth animation layer on the video playback interface, and render and play the animation material of the fourth animation on the fourth animation layer.

[0143] In one or more embodiments provided in the present application, the animated icons in the material library view displayed on the video playback interface are arranged in descending order of relevance to the current video clip content; the current video clip content is the video clip content when the user triggers the material library identifier.

[0144] The embodiment of the present application further provides a video playback device, which can be applied to a server, and the device may include:

[0145] A request receiving unit, configured to receive an animation data acquisition request; the animation data acquisition request is a request carrying the current playback point of the target video sent by a client playing the target video through a video playback interface;

[0146] a request response unit, configured to search for animation data corresponding to the current playback point from the animation data configured by the server in response to the animation data acquisition request, wherein the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video;

[0147] A data feedback unit is used to send the found animation data to the client, so that the client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as a prompt point, and obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, the animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface, and in response to the user's animation trigger operation, the animation triggered by the user is determined as a second animation, a second animation layer is created on the video playback interface, and the animation material of the second animation is rendered and played on the second animation layer; wherein the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

[0148] In one or more embodiments provided in the present application, the apparatus may further include: an animation data configuration unit, configured to configure the animation data of the target video.

[0149] Optionally, the process of configuring the animation data by the animation data configuration unit based on the video content of the target video may include:

[0150] Analyze the video content of the target video, determine at least one highlight segment in the target video, and record the highlight segment information of the target video, wherein the highlight segment information includes the start time and segment tag of each highlight segment, and the segment tag is used to represent the content of the video segment;

[0151] For any highlight segment, search for an animation material matching the segment tag of the highlight segment from a pre-configured animation material library, and use the start time of the highlight segment as the playback point of the animation material found, to generate animation data corresponding to the highlight segment, wherein the animation data corresponding to the highlight segment includes animation identification information and playback point of the animation material found;

[0152] Generate the first type of animation data of the target video, wherein the first type of animation data of the target video includes: animation data corresponding to each wonderful segment in the target video.

[0153] In one or more embodiments provided in the present application, the animation data configured by the server also includes a second type of animation data configured by the server based on animation barrage reporting information reported by each client.

[0154] On the basis of the above, the process of configuring the animation data by the animation data configuration unit based on the animation bullet screen reporting information reported by each client may include:

[0155] Receive animation bullet screen reporting information uploaded by each client; the animation bullet screen reporting information is information reported by the client in response to the user's animation triggering operation, and the animation bullet screen reporting information includes the animation identification information and sending time of the animation triggered by the user;

[0156] Dividing the target video into multiple video segments according to the time length, and counting the animation identification information of the sending time in each video segment respectively;

[0157] For any video segment, determine the animation corresponding to the largest number of animation identification information in the video segment as the animation corresponding to the video segment, use the start time of the video segment as the playback point of the animation corresponding to the video segment, and generate animation data corresponding to the video segment, wherein the animation data corresponding to the video segment includes the animation identification information and the playback point of the animation corresponding to the video segment;

[0158] The second type of animation data of the target video is generated, wherein the second type of animation data of the target video includes: animation data corresponding to each video segment constituting the target video.

[0159] The embodiment of the present application further provides an electronic device, such as a terminal with data processing capability. Optionally, Figure 4 The hardware structure diagram of the electronic device is shown in FIG. Figure 4 , the hardware structure of the electronic device may include: at least one processor 1, at least one communication interface 2, at least one memory 3 and at least one communication bus 4;

[0160] In the embodiment of the present application, the number of the processor 1, the communication interface 2, the memory 3, and the communication bus 4 is at least one, and the processor 1, the communication interface 2, and the memory 3 communicate with each other through the communication bus 4;

[0161] The processor 1 may be a central processing unit CPU, or an application-specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present invention, etc.;

[0162] The memory 3 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), etc., such as at least one disk memory;

[0163] The memory is used to store computer programs, and the processor is used to execute the computer programs, so that the electronic device can implement any of the above-mentioned video playback methods applied to the client, or can implement any of the above-mentioned video playback methods applied to the server.

[0164] A storage medium is also provided in an embodiment of the present application, which carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any video playback method applied to a client provided in an embodiment of the present application, or implement any video playback method applied to a server provided in an embodiment of the present application.

[0165] Also provided in an embodiment of the present application is a computer program product including computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements any video playback method applied to a client provided in an embodiment of the present application, or implements any video playback method applied to a server provided in an embodiment of the present application.

[0166] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0167] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The various embodiments can be combined as needed, and the same or similar parts can refer to each other.

[0168] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A video playback method, characterized in that: Applied to a video playback system, the video playback system includes a client and a server, and the method includes: When playing the target video on the video playback interface of the client, the client sends an animation data acquisition request to the server, where the animation data acquisition request carries the current playback point of the target video; The server, in response to the animation data acquisition request, searches for animation data corresponding to the current playback point from the animation data configured by the server, wherein the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video; and sends the found animation data to the client; The client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as a prompt point; obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, displays the animation trigger prompt information corresponding to the prompt point played on the video playback interface; in response to the user's animation trigger operation, determines the animation triggered by the user as a second animation; creates a second animation layer on the video playback interface, and renders and plays the animation material of the second animation on the second animation layer; wherein the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

2. A video playback method, characterized in that: Applied to a client, the method comprises: in the process of playing a target video on a video playback interface of the client, executing the following steps: Configure an animation data acquisition request, where the animation data acquisition request carries the current playback point of the target video; Sending the animation data acquisition request to the server, wherein the animation data acquisition request is used to request the server to search for animation data corresponding to the current playback point from the animation data configured by the server and to feed back the found animation data to the client; the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video; Receive and parse the animation data fed back by the server, determine the first animation identification information contained in the received first type of animation data, and determine the playback point corresponding to the first animation identification information as the prompt point; Acquire animation material of a first animation corresponding to the first animation identification information; When it is detected that the target video is played to the prompt point, the animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface; the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played; In response to an animation triggering operation by a user, determining the animation triggered by the user as a second animation; A second animation layer is created on the video playback interface, and animation material of the second animation is rendered and played on the second animation layer.

3. The video playback method according to claim 2, characterized in that: The method further includes: In response to the user's animation triggering operation, the animation barrage reporting information is uploaded to the server, the animation barrage reporting information includes the animation identification information and sending time of the animation triggered by the user, and the animation barrage reporting information is used for the server to configure animation data.

4. The video playback method according to claim 3, characterized in that: The animation data configured by the server also includes second type animation data configured by the server based on the animation bullet screen reporting information reported by each client; After receiving and parsing the animation data fed back by the server, the method further includes: Determine the third animation identification information contained in the received second type animation data, and determine the playback point corresponding to the third animation identification information as the animation playback point; Acquire the animation material of the third animation corresponding to the third animation identification information; When it is detected that the target video is played to the animation playback point, a third animation layer is created on the video playback interface, and animation materials of the third animation corresponding to the animation playback point played are rendered and played on the third animation layer.

5. The video playback method according to any one of claims 1 to 4, characterized in that: The process of playing the target video on the video playback interface further includes: Displaying a material library logo on the video playback interface, wherein the material library logo is used to prompt the user to view the animation material library of the target video and trigger any animation in the animation material library; In response to a user triggering operation on the material library identifier, displaying a material library view of the animation material library; the material library view includes animation icons corresponding to each animation in the animation material library; In response to a user triggering operation on any animation icon in the material library view, determining the animation triggered by the user as a fourth animation; creating a fourth animation layer on the video playback interface, and rendering and playing animation material of the fourth animation on the fourth animation layer.

6. The video playback method according to claim 5, characterized in that: The animated icons in the material library view displayed on the video playback interface are arranged in descending order of relevance to the current video clip content; the current video clip content is the video clip content when the user triggers the material library identifier.

7. A video playback method, characterized in that: Applied to a server, the method comprises: Receive an animation data acquisition request; the animation data acquisition request is a request sent by a client that plays a target video through a video playback interface and carries the current playback point of the target video; In response to the animation data acquisition request, searching for animation data corresponding to the current playback point from the animation data configured by the server, wherein the animation data configured by the server includes first-category animation data pre-configured by the server based on video content of the target video; The found animation data is sent to the client so that the client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as a prompt point, and obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, the animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface, and in response to the user's animation trigger operation, the animation triggered by the user is determined as a second animation, a second animation layer is created on the video playback interface, and the animation material of the second animation is rendered and played on the second animation layer; wherein the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

8. The video playback method according to claim 7, characterized in that: The process of configuring the animation data by the server based on the video content of the target video includes: Analyze the video content of the target video, determine at least one highlight segment in the target video, and record the highlight segment information of the target video, wherein the highlight segment information includes the start time and segment tag of each highlight segment, and the segment tag is used to represent the content of the video segment; For any highlight segment, search for an animation material matching the segment tag of the highlight segment from a pre-configured animation material library, and use the start time of the highlight segment as the playback point of the animation material found, to generate animation data corresponding to the highlight segment, wherein the animation data corresponding to the highlight segment includes animation identification information and playback point of the animation material found; Generate the first type of animation data of the target video, wherein the first type of animation data of the target video includes: animation data corresponding to each wonderful segment in the target video.

9. The video playback method according to claim 8, characterized in that: The animation data configured by the server also includes second type animation data configured by the server based on the animation bullet screen reporting information reported by each client; The process of configuring animation data by the server based on the animation bullet screen reporting information reported by each client includes: Receive animation bullet screen reporting information uploaded by each client; the animation bullet screen reporting information is information reported by the client in response to the user's animation triggering operation, and the animation bullet screen reporting information includes the animation identification information and sending time of the animation triggered by the user; Dividing the target video into multiple video segments according to the time length, and counting the animation identification information of the sending time in each video segment respectively; For any video segment, determine the animation corresponding to the largest number of animation identification information in the video segment as the animation corresponding to the video segment, use the start time of the video segment as the playback point of the animation corresponding to the video segment, and generate animation data corresponding to the video segment, wherein the animation data corresponding to the video segment includes the animation identification information and the playback point of the animation corresponding to the video segment; The second type of animation data of the target video is generated, wherein the second type of animation data of the target video includes: animation data corresponding to each video segment constituting the target video.

10. A video playback device, characterized in that: Applied to the client, the device includes: An animation data acquisition unit is used to configure an animation data acquisition request during the process of playing a target video on a video playback interface of the client, wherein the animation data acquisition request carries the current playback point of the target video; send the animation data acquisition request to a server, wherein the animation data acquisition request is used to request the server to search for animation data corresponding to the current playback point from the animation data configured by the server and feed back the found animation data to the client; the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video; An animation information determination unit, used to receive and analyze the animation data fed back by the server, determine the first animation identification information contained in the received first type of animation data, and determine the playback point corresponding to the first animation identification information as a prompt point; An animation material acquisition unit, used to acquire the animation material of the first animation corresponding to the first animation identification information; An animation trigger prompt unit is used to display animation trigger prompt information corresponding to the prompt point played on the video playback interface when detecting that the target video is played to the prompt point; the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played; An animation barrage display unit is used to respond to the user's animation triggering operation, determine the animation triggered by the user as the second animation; create a second animation layer on the video playback interface, and render and play the animation material of the second animation on the second animation layer.

11. A video playback device, characterized in that: Applied to a server, the device comprises: A request receiving unit, configured to receive an animation data acquisition request; the animation data acquisition request is a request carrying the current playback point of the target video sent by a client playing the target video through a video playback interface; a request response unit, configured to search for animation data corresponding to the current playback point from the animation data configured by the server in response to the animation data acquisition request, wherein the animation data configured by the server includes first-category animation data pre-configured by the server based on the video content of the target video; A data feedback unit is used to send the found animation data to the client, so that the client parses the received animation data, determines the first animation identification information contained in the received first type of animation data, and determines the playback point corresponding to the first animation identification information as a prompt point, and obtains the animation material of the first animation corresponding to the first animation identification information; when it is detected that the target video is played to the prompt point, the animation trigger prompt information corresponding to the prompt point played is displayed on the video playback interface, and in response to the user's animation trigger operation, the animation triggered by the user is determined as a second animation, a second animation layer is created on the video playback interface, and the animation material of the second animation is rendered and played on the second animation layer; wherein the animation trigger prompt information is used to prompt the user to perform an animation trigger operation on the first animation corresponding to the prompt point played.

12. An electronic device, characterized in that: The method comprises at least one processor and a memory connected to the processor, wherein: The memory is used to store computer programs; The processor is used to execute the computer program so that the electronic device can implement the video playback method as described in any one of claims 2 to 6, or can implement the video playback method as described in any one of claims 7 to 9.

13. A storage medium, characterized in that: The storage medium carries one or more computer programs, which, when executed by an electronic device, can enable the electronic device to implement the video playback method as described in any one of claims 2 to 6, or can implement the video playback method as described in any one of claims 7 to 9.

Images