Data processing method and related equipment

Abstract

The present application discloses a data processing method and related equipment, the method comprising: obtaining preset interaction configuration information in a video playback scene; the interaction configuration information comprises a description configuration of at least one interaction trajectory and an interaction event matching each interaction trajectory; the description configuration of any interaction trajectory is used to determine an interaction trajectory, and any interaction trajectory is used to constrain the motion path of interaction data; if a target interaction event is detected in the video playback scene, determining a target interaction trajectory matching the target interaction event; obtaining target interaction data to be displayed in the video playback scene; and, based on the description configuration of the target interaction trajectory, displaying the target interaction data according to the constraints of the target interaction trajectory; the display method of the interaction data can be enriched.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, a data processing device, a computer equipment, a computer-readable storage medium, and a computer program product. Background Art

[0002] In the video playback scenario, it is usually supported that video viewers post interactive data while watching the video (for example, the interactive data posted includes barrage content such as their opinions on the video plot and pictures), and it is supported to display the interactive data posted by different video viewers while watching the video in the video playback window, so as to realize interactive discussion based on the video playback window; the existing display method of interactive data is usually based on a fixed track, and the single display method of interactive data makes the interactive experience of video viewers low. Summary of the invention

[0003] The embodiments of the present application provide a data processing method and related devices, which can enrich the display mode of interactive data.

[0004] On the one hand, an embodiment of the present application provides a data processing method, the method comprising:

[0005] In a video playback scenario, preset interaction configuration information is obtained; the interaction configuration information includes a description configuration of at least one interaction track and an interaction event matching each interaction track; the description configuration of any interaction track is used to determine an interaction track, and any interaction track is used to constrain a motion path of interaction data;

[0006] If a target interaction event is detected in the video playback scene, a target interaction trajectory matching the target interaction event is determined;

[0007] Obtaining target interaction data to be displayed in the video playback scene; and,

[0008] Based on the description configuration of the target interaction trajectory, the target interaction data is displayed according to the constraints of the target interaction trajectory.

[0009] On the one hand, an embodiment of the present application provides a data processing device, the device comprising:

[0010] An acquisition unit is used to acquire preset interaction configuration information in a video playback scene; the interaction configuration information includes a description configuration of at least one interaction track and an interaction event matching each interaction track; the description configuration of any interaction track is used to determine an interaction track, and any interaction track is used to constrain the motion path of the interaction data;

[0011] a processing unit, configured to determine a target interaction track matching the target interaction event if a target interaction event is detected in the video playback scene;

[0012] The acquisition unit is further used to acquire target interaction data to be displayed in the video playback scene; and

[0013] The processing unit is further configured to display the target interaction data according to the constraints of the target interaction trajectory based on the description of the target interaction trajectory.

[0014] In one aspect, an embodiment of the present application provides a computer device, the computer device comprising an input interface and an output interface, and the computer device further comprising:

[0015] A processor and a computer readable storage medium;

[0016] A computer-readable storage medium for storing a computer program;

[0017] The processor is used to run the computer program to implement the above data processing method.

[0018] On the one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and the computer program is suitable for being loaded by a processor and executing the above-mentioned data processing method.

[0019] On the one hand, an embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the above-mentioned data processing method is executed.

[0020] In an embodiment of the present application, it supports configuring corresponding interaction tracks for different interaction events that may occur in a video playback scene, so that when different interaction events are detected in the video playback scene, the interaction data can be displayed according to the constraints of the interaction tracks configured for the corresponding interaction events. This can enrich the display method of the interaction data and realize the personalized display of the interaction data under different interaction events, thereby improving the interactive experience of the video viewing object. For example, when the video viewing object watches the video to a specific plot content, the interaction data can be displayed through an interaction track adapted to the specific plot content. For example, when the video viewing object publishes specific interaction data in the process of watching the video, the published specific interaction data can be displayed through an interaction track adapted to the specific interaction data. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0022] Figure 1a is a schematic diagram of an interactive trajectory provided by an embodiment of the present application;

[0023] Figure 1b It is a structural diagram of a data processing system provided in an embodiment of the present application;

[0024] Figure 2 It is a flowchart of a data processing method provided in an embodiment of the present application;

[0025] Figure 3a is a schematic diagram of displaying interactive data based on interactive trajectories provided by an embodiment of the present application;

[0026] Figure 3b is another schematic diagram of displaying interactive data based on interactive trajectories provided in an embodiment of the present application;

[0027] Figure 4 It is a flowchart of another data processing method provided in an embodiment of the present application;

[0028] Figure 5a is a schematic diagram of a target interaction trajectory drawn based on a description configuration of the target interaction trajectory provided by an embodiment of the present application;

[0029] Figure 5b is a schematic diagram of a model architecture used to construct a target interaction trajectory provided in an embodiment of the present application;

[0030] Figure 5c It is a schematic diagram of a target interactive data mobile display provided by an embodiment of the present application;

[0031] Figure 6a This is a schematic diagram of displaying interactive data under a plot content matching event provided by an embodiment of the present application;

[0032] Figure 6b This is a schematic diagram of displaying interactive data under a topic matching event provided by an embodiment of the present application;

[0033] Figure 6c is a schematic diagram of displaying interactive data under an interactive data matching event provided by an embodiment of the present application;

[0034] Figure 6d is a schematic diagram of displaying interactive data under a countdown event provided by an embodiment of the present application;

[0035] Figure 6e This is a schematic diagram of displaying interactive data under a reminder event provided by an embodiment of the present application;

[0036] Figure 6f is a schematic diagram of displaying interactive data under another reminder event provided by an embodiment of the present application;

[0037] Figure 7 It is a flowchart of another data processing method provided in an embodiment of the present application;

[0038] Figure 8a It is a schematic diagram of the mismatch between a target interaction track and a video playback window provided in an embodiment of the present application;

[0039] Figure 8b is a schematic diagram of determining a window area provided in an embodiment of the present application;

[0040] Figure 8c is another schematic diagram of determining a window area provided in an embodiment of the present application;

[0041] Figure 8d is another schematic diagram of determining a window area provided in an embodiment of the present application;

[0042] Figure 8e is a schematic diagram of another method of determining a window area provided in an embodiment of the present application;

[0043] Figure 8f is a schematic diagram of determining interactive trajectories arranged in parallel provided by an embodiment of the present application;

[0044] Figure 8g is a schematic diagram of another method for determining parallel arranged interactive trajectories provided in an embodiment of the present application;

[0045] Figure 8h is a schematic diagram of a trajectory parameter provided in an embodiment of the present application;

[0046] Figure 8i is a schematic diagram of determining a group of parallel arranged straight line trajectories provided in an embodiment of the present application;

[0047] Figure 8j is a schematic diagram of a straight line trajectory in a three-dimensional coordinate system provided in an embodiment of the present application;

[0048] Fig. 9 is a structural schematic diagram of a data processing device provided in an embodiment of the present application;

[0049] Fig.10 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0051] In order to enrich the display method of interactive data, an embodiment of the present application provides a data processing solution, which can obtain preset interactive configuration information in a video playback scene; wherein the interactive configuration information includes a description configuration of at least one interactive trajectory and an interactive event matching each interactive trajectory, and the description configuration of any interactive trajectory is used to determine an interactive trajectory, and any interactive trajectory is used to constrain the motion path of the interactive data; if a target interactive event is detected in the video playback scene, a target interactive trajectory matching the target interactive event can be determined, and based on the description configuration of the target interactive trajectory, the target interactive data to be displayed in the video playback scene is displayed according to the constraints of the target interactive trajectory.

[0052] Among them, interactive data includes barrage data, that is, data that can be interactive by displaying in the video playback window in the video playback scenario. The display of interactive data in the video playback window should be subject to the constraints of the interactive trajectory; interactive data may include data in text format (that is, text data), data in image format (that is, image data), etc. that support display in the video playback window. For example, the interactive data may be text data including interactive content posted by the video viewer in the process of watching the video (for example, the interactive content may be the video viewer's views on the video plot, views on the scenery in the video, etc.). By displaying the interactive data posted by different video viewer objects in the process of watching the video in the video playback window, interactive discussion can be realized based on the video playback window, which can enrich the viewing experience of the video viewer.

[0053] The interactive trajectory refers to the position information that the interactive data needs to satisfy in order to be displayed in the video playback window. The interactive trajectory can be used to constrain the motion path of the interactive data. An interactive trajectory can be composed of at least one interactive trajectory segment, and an interactive trajectory segment can be composed of multiple trajectory points. An interactive trajectory segment can be one of a straight-line interactive trajectory segment (i.e., a straight-line trajectory segment) and a curved-line interactive trajectory segment (i.e., a curved-line trajectory segment). By combining interactive trajectory segments of different shapes, interactive trajectories of different trajectory shapes can be obtained. The direction from the starting point coordinates (i.e., the first trajectory point coordinates) to the ending point coordinates (i.e., the last trajectory point coordinates) in the interactive trajectory can be used as the direction of the interactive trajectory. See Figure 1a , is a schematic diagram of an interactive trajectory exemplarily provided in an embodiment of the present application, Figure 1a The interactive trajectory shown as 101 is composed of a straight line trajectory segment, wherein the “arrow direction” indicates the direction of the interactive trajectory; Figure 1aThe interactive trajectory shown as 102 is composed of a curved trajectory segment; Figure 1a The interactive track indicated by 103 is composed of a curved track segment indicated by 104 and a curved track segment indicated by 105, and the track shape of the interactive track is the shape corresponding to the number 3; Figure 1a The interactive trajectory shown by 106 is composed of a curved trajectory segment shown by 107 and a straight trajectory segment shown by 108. The trajectory shape of the interactive trajectory is the shape corresponding to number 2.

[0054] The above data processing scheme can be executed by a video playback terminal, which can refer to a client with video playback capability (referred to as a video playback client) or a terminal device running a video playback client; the terminal device here can include but is not limited to any one or more of a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart TV, a smart car device, and a smart wearable device. Figure 1b , is a structural diagram of a data processing system provided in an embodiment of the present application, the data processing system may include a video playback terminal 111 and a server 112, the server 112 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms. The server 112 may be a background server of the video playback terminal 111, and may provide service support for the video playback terminal 111. The video playback terminal 111 may communicate directly or indirectly with the server 112 in a wired or wireless manner to achieve data interaction with the server 112 and use the services provided by the server 112. For example, the video playback terminal 111 may request the server 112 to play a certain video, and the server 112 may transmit the video stream of the video to the video playback terminal 111 in response to the corresponding request, and the video playback terminal 111 may play the video according to the received video stream of the video.

[0055] based on Figure 1bWhen the data processing system shown implements the above data processing scheme, the preset interactive configuration information can be sent from the server 112 to the video playback terminal 111, and the interactive data can be sent from the server 112 to the video playback terminal 111, or it can be posted by the video viewing object of the video playback terminal 111 during the video viewing process. It should be known that in order to realize the display of the interactive data posted by a certain video viewing object through its video playback terminal in other video playback terminals, the corresponding interactive data will be uploaded to the server 112, and sent from the server 112 to other video playback terminals for display. In a feasible implementation, based on Figure 1b When the data processing system shown implements the above-mentioned data processing scheme, the video playback terminal 111 can request the server 112 to send the preset interaction configuration information in the video playback scene, and the server 112 can respond to the corresponding request and send the preset interaction configuration information to the video playback terminal 111; the video playback terminal 111 can obtain the preset interaction configuration information (i.e., receive the interaction configuration information sent by the server 112) in the video playback scene. If a target interaction event is detected in the video playback scene, a target interaction trajectory matching the target interaction event is determined, and the target interaction data to be displayed in the video playback scene is obtained. Based on the description configuration of the target interaction trajectory, the target interaction data is displayed according to the constraints of the target interaction trajectory.

[0056] It should be pointed out in particular that the collection and processing of relevant data (such as interactive data) in this application should be strictly in accordance with the requirements of laws and regulations when applied in examples, and the informed consent or separate consent of the personal information subject should be obtained, and subsequent data use and processing should be carried out within the scope of authorization of laws and regulations and the personal information subject.

[0057] Based on the above description, the present application embodiment provides a data processing method; see Figure 2 , which is a flow chart of a data processing method provided in an embodiment of the present application; the data processing method can be executed by a computer device, and the computer device can be a video playback terminal or a server. In the embodiment of the present application, the method is described by taking the video playback terminal as an example. Figure 1b Taking the video playback terminal 111 in the data processing system shown in the figure as an example, the data processing method may include the following steps S201-S204:

[0058] S201, in a video playback scene, obtaining preset interaction configuration information; the interaction configuration information includes a description configuration of at least one interaction track and an interaction event matching each interaction track.

[0059] Among them, the description configuration of any interactive trajectory is used to determine an interactive trajectory, and any interactive trajectory is used to constrain the movement path of interactive data. Interactive data includes bullet screen data, that is, in the video playback scene, interactive data can be displayed in the video playback window to achieve interaction, and the display of interactive data in the video playback window should be constrained by the interactive trajectory. Interactive trajectory refers to the position information required for interactive data to be displayed in the video playback window, and the interactive trajectory can be used to constrain the movement path of interactive data; an interactive trajectory can be composed of at least one interactive trajectory segment, an interactive trajectory segment can be composed of multiple trajectory points, and an interactive trajectory segment can be one of a straight line type interactive trajectory segment (i.e., a straight line trajectory segment) and a curve type interactive trajectory segment (i.e., a curve trajectory segment). Interactive trajectories of different trajectory shapes can be obtained by combining interactive trajectory segments of different shapes. An interactive event matching a certain interactive trajectory is used to indicate: an event that requires interactive data to be displayed according to the constraints of the interactive trajectory, that is, when an interactive event matching the interactive trajectory is detected, the interactive data will be displayed according to the constraints of the interactive trajectory. The description configuration of the interaction trajectory and the matching relationship between the interaction trajectory and the interaction event can be configured by the background configuration object according to specific needs. The background server of the video playback terminal can store the corresponding configuration, so that the video playback terminal can obtain the preset interaction configuration information from the background server in the video playback scene.

[0060] In a feasible implementation, the interactive configuration information obtained by the video playback terminal in the video playback scenario of any video is the interactive configuration information associated with the video. The interactive configuration information associated with a video may include at least one of the following: general interactive configuration information and interactive configuration information specific to the video, wherein the interactive track configured by the general interactive configuration information can be applied to the video playback scenario of any video in the video playback client, and the interactive track configured by the interactive configuration information specific to a video can be applied to the video playback scenario of the video in the video playback client. The video playback terminal can request the background server to obtain the interactive configuration information associated with a certain video in the video playback scenario of the video. For example, when a certain video starts to play, the video playback terminal can request the background server to obtain the interactive configuration information associated with the video. During this process, the video playback terminal can carry the video identifier of the video, and the background server can respond to the corresponding request, search for the interactive configuration information through the corresponding video identifier and send it to the video playback terminal. It can be known that during the playback of the video, if the interactive configuration information associated with the video needs to be updated (for example, adding interactive configuration information, adjusting interactive configuration information, etc.), the background server can actively send an update notification for the interactive configuration information associated with the video to update the interactive configuration information obtained by the video playback terminal.

[0061] S202: If a target interaction event is detected in the video playback scene, a target interaction trajectory matching the target interaction event is determined.

[0062] In a feasible implementation, the target interaction event may be any interaction event indicated by the interaction configuration information obtained by the video playback terminal; since the interaction configuration information obtained by the video playback terminal may include a description configuration of at least one interaction trajectory and an interaction event matching each interaction trajectory, if the video playback terminal detects a target interaction event in the video playback scene, it can determine the target interaction trajectory matching the target interaction event based on the obtained interaction configuration information, and the target interaction trajectory is the interaction trajectory of the interaction data to be displayed.

[0063] S203: Obtain target interactive data to be displayed in the video playback scene.

[0064] In a feasible implementation, the video playback terminal obtains the target interactive data to be displayed in the video playback scene, which can be obtained from the interactive data set to be displayed in the video playback scene; in the video playback scene of any video, the interactive data set to be displayed refers to the interactive data set associated with the video, and an interactive data set associated with a video can include at least one of the following interactive data: general interactive data and interactive data specific to the video, wherein the general interactive data can be applied to the video playback scene of any video in the video playback client, and the interactive data specific to a video can be applied to the video playback scene of the video in the video playback client. The video playback terminal can request the background server to obtain the interactive data set associated with the video in the video playback scene of a certain video. For example, when a certain video starts to play, the video playback terminal can request the background server to obtain the interactive data set associated with the video. In this process, the video playback terminal can carry the video identifier of the video, and the background server can respond to the corresponding request, search for the interactive data set through the corresponding video identifier and send it to the video playback terminal; it can be known that during the playback of the video, if a certain video viewing object publishes interactive data through its video playback terminal while watching the video, then its video playback terminal can update its video playback terminal based on the published interactive data. The published interactive data set associated with the video is obtained by the terminal, and the published interactive data can be uploaded to the background server, so that the background server can send the published interactive data to other video playback terminals that are playing the video, so as to realize the synchronous update of the published interactive data in the other video playback terminals that are playing the video. Of course, the interactive data published by other video viewers in the process of watching the video through the corresponding video playback terminals can also be synchronously updated to the video playback terminal corresponding to the video viewer through the background server; it can be known that there is no strict time sequence between the process of obtaining the target interactive data and the process of determining the target interactive trajectory.

[0065] S204: Based on the description configuration of the target interaction trajectory, display the target interaction data according to the constraints of the target interaction trajectory.

[0066] In a feasible implementation, the description configuration of any interactive trajectory is used to determine an interactive trajectory, and any interactive trajectory is used to constrain the movement path of interactive data. Based on this, when the video playback terminal displays the target interactive data according to the constraints of the target interactive trajectory based on the description configuration of the target interactive trajectory, it can draw the target interactive trajectory in the video playback window based on the description configuration of the target interactive trajectory; and control the target interactive data to be presented on the target interactive trajectory. Among them, when the video playback terminal controls the interactive data to be presented on the interactive trajectory, it can control the interactive data to be displayed at a fixed position on the interactive trajectory, or it can control the interactive data to be displayed at different positions on the interactive trajectory; an interactive data can be displayed on the interactive trajectory within the preset display duration corresponding to the interactive data, and the preset display duration corresponding to an interactive data can be configured according to specific needs, for example, it can be configured to be 2 seconds, 3 seconds, etc., and the preset display durations corresponding to different interactive data can be configured to be the same or different; the display of an interactive data on the interactive trajectory is driven by time, that is, it is driven by a clock signal. When the video playback terminal controls the interactive data to be presented on the interactive trajectory, it can control the interactive data to be displayed under the drive of the clock signal. The interactive data is displayed at a fixed position on the interactive trajectory until the preset display time corresponding to the interactive data is reached. In this case, at adjacent time points corresponding to any two adjacent clock signals, the interactive data is displayed at a fixed position on the interactive trajectory. In other words, the interactive data is displayed statically on the interactive trajectory as the time point changes (i.e., as driven by the clock signal); or the interactive data can be controlled to move and display at different positions on the interactive trajectory under the drive of the clock signal until the preset display time corresponding to the interactive data is reached. In this case, at adjacent time points corresponding to any two adjacent clock signals, the interactive data is displayed at different positions on the interactive trajectory. In other words, the interactive data will move and display on the interactive trajectory as the time point changes (i.e., as driven by the clock signal).

[0067] For example, if the interaction data is text data, the specific interaction content is "The scenery is so beautiful", and the interaction trajectory is a curved trajectory consisting of one curved trajectory segment; see Figure 3a , is a schematic diagram of displaying interactive data based on an interactive trajectory exemplarily provided in an embodiment of the present application, wherein the interactive trajectory can be shown as marked 301, and the interactive data is displayed at a fixed position on the interactive trajectory as shown by the mark 301, wherein the display of the interactive data at a certain time point within the corresponding preset display duration is shown as marked 302, and the display of the interactive data at another time point within the corresponding preset display duration is shown as marked 303, and the time point corresponding to 302 is earlier than the time point corresponding to 303, as shown in FIG. Figure 3aIt can be seen that the position of the interactive data remains unchanged when it is displayed at different time points within the corresponding preset display duration; optionally, when the interactive data is displayed based on the interactive trajectory, the interactive trajectory can be displayed or not. The embodiment of the present application is described by taking the example of not displaying the interactive trajectory and only displaying the interactive data under the constraint of the interactive trajectory as an example. In the accompanying drawings, for the convenience of description, the interactive trajectory is indicated by a dotted line when it is not displayed, such as the interactive trajectory indicated by a dotted line in 302. Please refer to Figure 3b , is another schematic diagram of displaying interactive data based on an interactive trajectory provided by way of example in an embodiment of the present application, wherein the interactive trajectory may be as indicated by a mark 311, and the interactive data is displayed by movement at different positions on the interactive trajectory as indicated by a mark 311, wherein a display of the interactive data at a certain time point within the corresponding preset display duration is indicated by a mark 312, and a display of the interactive data at another time point within the corresponding preset display duration is indicated by a mark 313, wherein the time point corresponding to 312 is earlier than the time point corresponding to 313, as shown in FIG. Figure 3b It can be seen that the position of the interactive data changes when it is displayed at different time points within the corresponding preset display duration.

[0068] In another feasible implementation, after receiving the interaction configuration information, the video playback terminal can draw each interaction track in the video playback window based on the description configuration of each interaction track included in the interaction configuration information; based on this, if the video playback terminal detects a target interaction event in the video playback scene, it can directly control the target interaction data to be presented on the target interaction track that is determined according to the target interaction event and has been drawn, and the drawing of each interaction track and related processes are similar to the related processes of drawing the target interaction track.

[0069] In an embodiment of the present application, it supports configuring corresponding interaction tracks for different interaction events that may occur in a video playback scene, so that when different interaction events are detected in the video playback scene, the interaction data can be displayed according to the constraints of the interaction tracks configured for the corresponding interaction events. This can enrich the display method of the interaction data and realize the personalized display of the interaction data under different interaction events, thereby improving the interactive experience of the video viewing object. For example, when the video viewing object watches the video to a specific plot content, the interaction data can be displayed through an interaction track adapted to the specific plot content. For example, when the video viewing object publishes specific interaction data in the process of watching the video, the published specific interaction data can be displayed through an interaction track adapted to the specific interaction data.

[0070] Based on the above description, the present application embodiment provides another data processing method; see Figure 4, which is a flow chart of another data processing method provided in an embodiment of the present application; the data processing method can be executed by a computer device, and the computer device can be a video playback terminal or a server. In the embodiment of the present application, the method is described by taking the video playback terminal as an example. Figure 1b Taking the video playback terminal 111 in the data processing system shown in the figure as an example, the data processing method may include the following steps S401-S405:

[0071] S401, in a video playback scene, obtaining preset interaction configuration information; the interaction configuration information includes a description configuration of at least one interaction track and an interaction event matching each interaction track.

[0072] Among them, the relevant process of step S401 is similar to the relevant process of step S201, and the description configuration of any interactive trajectory is used to determine an interactive trajectory, and any interactive trajectory is used to constrain the motion path of interactive data. The description configuration of any interactive trajectory may include: the trajectory type of the interactive trajectory, the interactive trajectory model used under the trajectory type, and at least one set of control point coordinates required to draw the interactive trajectory; any set of control point coordinates is used to draw an interactive trajectory segment, and the interactive trajectory model can be used to construct an interactive trajectory segment, that is, an interactive trajectory segment can be constructed using an interactive trajectory model and a set of control point coordinates. In other words, the interactive trajectory can be composed of each interactive trajectory segment determined by at least one set of control point coordinates included in the description configuration of the interactive trajectory. Specifically, the trajectory type of the interactive trajectory may include: the trajectory type of at least one interactive trajectory segment required to constitute the interactive trajectory, the interactive trajectory model used under the trajectory type may include: the interactive trajectory model used under the trajectory type of each interactive trajectory segment, and the at least one set of control point coordinates required to draw the interactive trajectory, that is: a set of control point coordinates required to construct each interactive trajectory segment. Among them, the interactive trajectory model refers to a model that can be used to construct an interactive trajectory segment, a set of control point coordinates can be used to indicate the shape and position of an interactive trajectory segment, and an interactive trajectory segment can be constructed using an interactive trajectory model and a set of control point coordinates; one trajectory type corresponds to at least one interactive trajectory model, and various interactive trajectory models corresponding to one trajectory type can be used to construct an interactive trajectory segment of the corresponding trajectory type. The trajectory type may include a straight line type and a curve type. Various interactive trajectory models corresponding to the straight line type can be used to construct an interactive trajectory segment of the straight line type (i.e., a straight line trajectory segment), and various interactive trajectory models corresponding to the curve type can be used to construct an interactive trajectory segment of the curve type (i.e., a curve trajectory segment); the interactive trajectory model included in the description configuration of any interactive trajectory and used under the trajectory type of any interactive trajectory segment can be configured according to specific needs, for example, it can be selected by the configuration object from various interactive trajectory models corresponding to the trajectory type of the interactive trajectory segment according to specific needs.

[0073] For example, if the description configuration of an interactive trajectory includes two sets of control point coordinates, the trajectory types of the interactive trajectory included in the description configuration of the interactive trajectory are: straight line type, curve type, and the interactive trajectory models used under the trajectory types are: interactive trajectory model a1 used under the straight line type, and interactive trajectory model b1 used under the curve type. Based on this, it can be seen that the interactive trajectory determined by the description configuration of the interactive trajectory should be composed of a straight line trajectory segment and a curve trajectory segment, wherein the straight line trajectory segment can be constructed based on the interactive trajectory model a1 and the first set of control point coordinates, and the curve trajectory segment can be constructed based on the interactive trajectory model b1 and the second set of control point coordinates.

[0074] S402: If a target interaction event is detected in the video playback scene, a target interaction trajectory matching the target interaction event is determined.

[0075] The relevant process of step S402 is similar to the relevant process of the above-mentioned step S202, and will not be repeated here.

[0076] S403: Obtain target interactive data to be displayed in the video playback scene.

[0077] Among them, the relevant process of step S403 is similar to the relevant process of step S203. The video playback terminal obtains the target interactive data to be displayed in the video playback scene, which can be obtained from the interactive data set to be displayed in the video playback scene. In the video playback scene of any video, the interactive data set to be displayed refers to the interactive data set associated with the video. The method of obtaining the target interactive data may include at least one of the following: randomly selecting an interactive data as the target interactive data from the interactive data set to be displayed in the video playback scene; or, selecting the interactive data whose interactive content is adapted to the target interactive event from the interactive data set to be displayed in the video playback scene as the target interactive data; or, selecting the interactive data whose display time is adapted to the target interactive event from the interactive data set to be displayed in the video playback scene as the target interactive data; or, in the case where the interactive configuration information also includes the interactive text bound to the target interactive trajectory, selecting the interactive data matching the interactive text from the interactive data set to be displayed in the video playback scene as the target interactive data.

[0078] In a feasible implementation, the configuration object can pre-configure the interactive data that matches the interactive content and the interactive event according to specific needs. Based on this, when the video playback terminal obtains the interactive data, it can obtain the adaptation relationship between the interactive data and the interactive event based on the interactive content. Then, the video playback terminal can select the interactive data that matches the interactive content and the target interactive event from the interactive data set to be displayed in the video playback scene as the target interactive data; for example, if the target interactive event is a reminder event related to rest reminder, the target interactive data can be interactive data containing the interactive content "It's late at night, please arrange your work and rest time reasonably and pay attention to rest." In a feasible implementation, the configuration object can pre-configure the display time of the interactive data according to specific needs. Based on this, when the video playback terminal obtains the interactive data, it can obtain the display time of the interactive data. Then, the video playback terminal can select the interactive data that matches the display time and the target interactive event from the interactive data set to be displayed in the video playback scene as the target interactive data. When the display time is the same as the time when the target interactive event is detected, it is determined that the display time is compatible with the target interactive event.

[0079] In a feasible implementation, the configuration object may pre-configure the interactive text bound to the interactive track according to specific needs. The interactive text may be a keyword for determining the interactive data displayed constrained by the interactive track. The interactive text bound to the interactive track may be carried in the interactive configuration information. Based on this, during video playback, when the interactive configuration information also includes the interactive text bound to the target interactive track, the interactive data set to be displayed in the video playback scene may select the interactive data that matches the interactive text as the target interactive data; optionally, when the interactive content in the interactive data includes the interactive text bound to the target interactive track, it is determined that the corresponding interactive data matches the interactive text; for example, if the interactive text bound to the target interactive track is "basketball", the interactive data set to be displayed includes interactive data with the interactive content of "the exciting basketball game has begun", and interactive data with the interactive content of "this bouquet of flowers is so beautiful", then the interactive data with the interactive content of "the exciting basketball game has begun" may be selected as the target interactive data. In a feasible implementation, the configuration object may also pre-configure the interactive data matching the interactive trajectory according to specific needs. Based on this, the video playback terminal may select the interactive data matching the target interactive trajectory as the target interactive data from the interactive data set to be displayed in the video playback scene.

[0080] S404: based on the description configuration of the target interaction trajectory, draw the target interaction trajectory in the video playback window.

[0081] Among them, the description configuration of the target interactive trajectory may include: the trajectory type of the target interactive trajectory, the interactive trajectory model used under the trajectory type, and M groups of control point coordinates required to draw the target interactive trajectory; any group of control point coordinates is used to draw an interactive trajectory segment, and M is a positive integer; based on this, when the video playback terminal draws the target interactive trajectory in the video playback window based on the description configuration of the target interactive trajectory, it can: use the interactive trajectory model in the description configuration of the target interactive trajectory and the M groups of control point coordinates in the description configuration of the target interactive trajectory to construct M interactive trajectory segments; in the video playback window, draw M interactive trajectory segments to obtain the target interactive trajectory. Specifically, the trajectory type may include a straight line type and a curve type, and the interactive trajectory model may be used to construct an interactive trajectory segment; the trajectory type of the target interactive trajectory may include: the trajectory type of the M interactive trajectory segments required to constitute the target interactive trajectory, and the interactive trajectory model used under the trajectory type may include: the interactive trajectory model used under the trajectory type of each interactive trajectory segment (in the M interactive trajectory segments), and the M groups of control point coordinates required to draw the target interactive trajectory, that is: constructing a set of control point coordinates required for each interactive trajectory segment (in the M interactive trajectory segments); based on this, the video playback terminal uses the interactive trajectory model in the description configuration of the target interactive trajectory, and the M groups of control point coordinates in the description configuration of the target interactive trajectory, and when constructing the M interactive trajectory segments, the interactive trajectory model used under the trajectory type of each interactive trajectory segment and the control point coordinates required to construct the corresponding interactive trajectory segment are respectively used. See Figure 5a , which is a schematic diagram of a target interaction trajectory drawn based on a description configuration of a target interaction trajectory provided in an embodiment of the present application; if the description configuration of the target interaction trajectory includes 2 groups of control point coordinates, the trajectory types of the target interaction trajectory included in the description configuration of the target interaction trajectory are respectively: curve type, straight line type, and the interactive trajectory models used under the trajectory types are respectively: interactive trajectory model b2 used under the curve type, and interactive trajectory model a2 used under the straight line type. The target interaction trajectory determined by the description configuration of the target interaction trajectory should be composed of a curve trajectory segment and a straight line trajectory segment, wherein the curve trajectory segment as shown in the mark 501 can be constructed by using the interactive trajectory model b2 and the first group of control point coordinates, and the straight line trajectory segment as shown in the mark 502 can be constructed by using the interactive trajectory model a2 and the second group of control point coordinates.

[0082] Taking the construction of the mth interactive trajectory segment among M interactive trajectory segments as an example, m∈[1,M], for the convenience of explanation, in the description configuration of the target interactive trajectory, the trajectory type of the mth interactive trajectory segment is called the mth trajectory type, the interactive trajectory model used under the trajectory type of the mth interactive trajectory segment is called the mth interactive trajectory model, and the set of control point coordinates required to construct the mth interactive trajectory segment is called the mth set of control point coordinates. Among them, the mth interactive trajectory model can be configured according to specific needs, for example, it can be configured as a Bezier curve model.

[0083] Among them, Bezier curve is a mathematical method for drawing smooth curves, which is widely used in computer graphics, animation, font design and other fields; Bezier curves can be divided into different orders such as linear, quadratic, and cubic. Among them, the linear Bezier curve (also called the first-order Bezier curve or the first-order Bezier curve) is a straight line, which can be determined by the coordinates of two control points. The second-order Bezier curve (also called the quadratic Bezier curve) can be determined by the coordinates of three control points. The first and last (i.e., the third) control point coordinates represent the starting point coordinates and the ending point coordinates of the curve. The coordinates of the middle control point (i.e., the second control point coordinates) determine the shape of the curve. The quadratic Bezier curve is often used to draw simple curve shapes in computer graphics. The third-order Bezier curve (also called the cubic Bezier curve) can be determined by the coordinates of four control points. It is similar to the quadratic Bezier curve. The first and last (i.e., the fourth) control point coordinates represent the starting point coordinates and the ending point coordinates of the curve, while the coordinates of the two control points in the middle (i.e., the second and third control point coordinates) determine the shape of the curve. The cubic Bezier curve can create a more complex curve shape than the quadratic Bezier curve, and is often used in font design, vector graphics drawing, etc. The order of the Bezier curve can continue to increase, but in practical applications, the quadratic and cubic Bezier curves are sufficient to meet most needs; by combining multiple Bezier curves, complex curve shapes can be created.

[0084] The Bezier curve model is a model represented by parameters. Taking the cubic Bezier curve model as an example, the cubic Bezier curve model can be represented by the cubic Bezier curve representation equation shown in the following formula 1:

[0085] B(t)=(1-t) 3 *H0+3*(1-t) 2 *t*H1+3*(1-t)*t 2 *H2+t 3 *H3 (1)

[0086] Wherein, H0, H1, H2 and H3 represent the coordinates of the first control point to the fourth control point respectively, where the coordinates of the first control point and the last control point (i.e., the coordinates of the fourth control point) are also called the starting point coordinates and the ending point coordinates, and any control point coordinate is represented by a two-dimensional vector or a three-dimensional vector; t represents a parameter, 0≤t≤1, as the parameter t gradually increases from 0 to 1, the trajectory point coordinates represented by B(t) (i.e., the coordinates of the trajectory point) will move from the first control point coordinate H0 to the fourth control point coordinate H3 along the Bezier curve, that is, from the starting point coordinate H0 to the ending point coordinate H3 along the Bezier curve; since the display of interactive data on the interactive trajectory is driven by time, that is, driven by a clock signal, when the interactive trajectory is composed of a Bezier curve, as the clock signal drives, the parameter t increases accordingly, and the position coordinates of the interactive data on the interactive trajectory can change according to the change of the trajectory point coordinates determined by B(t), thereby allowing the interactive data to move along the Bezier curve. Wherein, (1-t) 3 *H0 represents the influence of the coordinates of the first control point (i.e. the coordinates of the starting point) on the curve, 3*(1-t) 2 *t*H1 represents the influence of the coordinates of the second control point H1 on the curve, 3*(1-t)*t 2 *H2 represents the influence of the coordinates of the third control point H2 on the curve, t 3 *H3 represents the influence of the fourth control point coordinate (i.e., the end point coordinate) H3 on the curve; when different control point coordinates are used, different cubic Bezier curves will be obtained, that is, different interactive trajectory segments will be obtained. In addition, the cubic Bezier curve model can also be used to construct straight trajectory segments. When the second control point coordinate H1 is the same as the first control point coordinate H0, and the third control point coordinate H2 is the same as the fourth control point coordinate H3, the cubic Bezier curve model will be used to obtain a straight line from the first control point coordinate (i.e., the starting point coordinate) to the fourth control point coordinate (i.e., the end point coordinate), that is, a straight line trajectory segment will be obtained. Based on the above, it can be seen that the cubic Bezier curve has directionality, that is, the direction of moving from the starting point coordinate H0 to the end point coordinate H3 along the Bezier curve. The direction depends on the order of adding the control point coordinates. Therefore, the interactive trajectory segment constructed based on the cubic Bezier curve model also has directionality, and the interactive trajectory also has directionality.

[0087] For example, if the mth trajectory type is a straight line type, the mth interactive trajectory model is a cubic Bezier curve model, the mth group of control point coordinates includes 4 control point coordinates, where the second control point coordinates are the same as the first control point coordinates, and the third control point coordinates are the same as the fourth control point coordinates, then the mth interactive trajectory model and the mth group of control point coordinates are used to construct a straight line trajectory segment; if the mth trajectory type is a curve type, the mth interactive trajectory model is a cubic Bezier curve model, the mth group of control point coordinates includes 4 control point coordinates, and the 4 control point coordinates do not satisfy the condition that "the second control point coordinates are the same as the first control point coordinates, and the third control point coordinates are the same as the fourth control point coordinates", then the mth interactive trajectory model and the mth group of control point coordinates are used to construct a curved trajectory segment.

[0088] In a feasible implementation, the video playback terminal can generate a sampling list of the corresponding interactive trajectory segment each time it constructs an interactive trajectory segment. The sampling list of an interactive trajectory segment may include one or more samples. A sample may include trajectory features such as sampling point coordinates, sampling point vectors, and sampling point lengths, wherein the sampling point coordinates refer to the coordinates of the trajectory point sampled in the interactive trajectory segment, the sampling point vector refers to the tangent vector of the interactive trajectory segment at the corresponding sampling point coordinates, and the sampling point length refers to the length of the sampling point coordinates from the starting point coordinates in the interactive trajectory segment. For example, when a certain interactive trajectory segment is a cubic Bezier curve, a sampling can be obtained by giving the t value (0≤t≤1) in the expression of the cubic Bezier curve, wherein the expression of the cubic Bezier curve is an expression obtained by substituting a set of control point coordinates required to construct the cubic Bezier curve into the cubic Bezier curve model. For example, a set of control point coordinates required to construct the cubic Bezier curve are: H0′, H1′, H2′, and H3′, respectively, then the expression of the cubic Bezier curve can be: B(t)′=(1-t) 3 *H0′+3*(1-t) 2 *t*H1′+3*(1-t)*t 2 *H2′+t 3 *H3′, correspondingly, the sampling point coordinates are the control point coordinates of the expression of the cubic Bezier curve at a given t value. If the given t value is t1, the sampling point coordinates are B(t1)′. The sampling point vector can be obtained by the formula derived from the expression of the cubic Bezier curve. The sampling point length can be obtained by integrating the expression of the cubic Bezier curve from t=0 to the given t value.

[0089] Based on the above description, the video playback terminal can also implement the following functions:

[0090] (1) Obtaining the coordinates of a certain trajectory point on the interactive trajectory. The video playback terminal can calculate the length of each interactive trajectory segment in an interactive trajectory by interpolation, and then obtain the total length of the interactive trajectory. Based on this, the video playback terminal can obtain the coordinates of the trajectory point under the specified length according to the externally specified length; specifically, the video playback terminal can determine the interactive trajectory segment where the trajectory point under the specified length is located according to the externally specified length, and can determine the length of the trajectory point under the specified length in the interactive trajectory segment from the starting point coordinates of the interactive trajectory segment. The determined length from the starting point coordinates can be used to obtain the sampling corresponding to the interactive trajectory segment with the corresponding sampling point length, and the sampling point coordinates included in the determined sampling are the coordinates of the trajectory point under the specified length.

[0091] (2) Obtaining the tangent vector of a certain trajectory point on the interactive trajectory: Based on the description of (1) above, the sampling point vector included in the determined sampling is the tangent vector of the trajectory point at the specified length.

[0092] (3) Obtaining the angle of a certain trajectory point on the interactive trajectory relative to the horizontal axis (i.e., the X-axis): the angle of the trajectory point relative to the X-axis, that is, the angle of the tangent vector of the trajectory point relative to the X-axis; based on the description of (2) above, after obtaining the tangent vector of the trajectory point at a specified length, the angle of the trajectory point relative to the X-axis can be determined according to the tangent vector of the trajectory point and the vector of the X-axis. Specifically, the angle θ of the trajectory point relative to the X-axis can be determined according to the formula θ=arccos((A·B) / (|A|*|B|)), where A represents the tangent vector of the trajectory point, and B represents the vector of the X-axis. In a two-dimensional coordinate system, the vector of the X-axis can be expressed as (1, 0), and in a three-dimensional coordinate system, the vector of the X-axis can be expressed as (1, 0, 0).

[0093] (4) Realizing uniform motion of objects on the interactive trajectory: To achieve uniform motion, that is, the distance moved per unit time remains unchanged, the position coordinates of the object can be obtained by obtaining samples of the object at a specified distance from the starting point coordinates of the interactive trajectory to achieve uniform motion.

[0094] (5) Ability to realize uniform movement in the reverse direction of the interactive trajectory: To realize reverse movement, the distance of the object from the starting point coordinates of the interactive trajectory can be obtained by subtracting the distance moved by the object from the total length of the interactive trajectory. The position coordinates of the object can be obtained by obtaining samples of the distance from the starting point coordinates of the interactive trajectory, thereby realizing uniform reverse movement.

[0095] In a feasible implementation, the video playback terminal draws the target interactive trajectory in the video playback window based on the description configuration of the target interactive trajectory. This can be achieved by instantiating the trajectory class (Spline). Spline is the core class or facade class of the interactive trajectory. It is mainly responsible for the construction and modification of the interactive trajectory and the access to the trajectory features of the interactive trajectory. The Spline class also provides an interface for obtaining trajectory features, such as the coordinates of the trajectory points on the above-mentioned interactive trajectory, the tangent direction, the length of the interactive trajectory, and other trajectory features. Take the interactive trajectory model as a cubic Bezier curve model and the interactive trajectory segment as a cubic Bezier curve as an example, see Figure 5b, which is a schematic diagram of a model architecture used to construct a target interactive trajectory provided as an example in an embodiment of the present application. The model architecture may include: a trajectory class (Spline), a representation model of a cubic Bezier curve (i.e., the expression of a cubic Bezier curve CubicBezierCurve), a trajectory node (SplinePoint), and a sample of a Bezier curve (CurveSample). Among them: (1) Spline is a model constructed by connecting at least one third-order Bezier curve in series. One Spline (interactive trajectory) contains at least one CubicBezierCurve (representation model of a Bezier curve), and each CubicBezierCurve corresponds to at least one CurveSample (sample of a Bezier curve). (2) SplinePoint can be used to describe nodes on the interactive trajectory. It has properties such as coordinates and direction. A Spline object contains multiple SplinePoints. Two adjacent SplinePoints are used to construct a CubicBezierCurve. Usually, a third-order Bezier curve is composed of four control point coordinates (H0, H1, H2, H3). It starts from H0 and goes to H1, and then goes from H2 to H3. SplinePoint is essentially a combination of P0, P1 and P3, P2. SplinePoint can be divided into two types: position node (pPosition) and direction node (pDirection). pPosition represents the coordinates of the starting point and the end point (H0, H3), and pDirection represents the coordinates of the second control point that controls the moving direction and the coordinates of the third control point (H1, H2). Among them, two adjacent SplinePoints are used to construct a CubicBezierCurve, which means that a CubicBezierCurve is constructed based on the position node (pPosition) and the direction node (pDirection). (3) CubicBezierCurve can be constructed based on two SplinePoints. Two SplinePoints can represent the coordinates of four control points, and then the expression of the cubic Bezier curve can be determined, as well as the position and shape of the cubic Bezier curve. Each time a CubicBezierCurve is constructed, a sample (CurveSample) list of the Bezier curve can be generated based on the two SplinePoints.

[0096] S405, controlling the target interaction data to be presented on the target interaction track.

[0097] In a feasible implementation, when the video playback terminal controls the target interaction data to be presented on the target interaction trajectory, it can: determine the position coordinates of the target interaction data on the target interaction trajectory; wherein the position coordinates include static coordinates or dynamic coordinates, and the dynamic coordinates include coordinates corresponding to multiple time points respectively; if the position coordinates are static coordinates, then on the target interaction trajectory, at a fixed position indicated by the static coordinates, the target interaction data is displayed; if the position coordinates are dynamic coordinates, then when each time point indicated by the dynamic coordinates is reached, the target interaction data is updated and displayed at the position indicated by the coordinates corresponding to each time point on the target interaction trajectory.

[0098] Among them, the target interaction data can be displayed on the target interaction trajectory within the preset display time corresponding to the target interaction data. The preset display time corresponding to the target interaction data can be configured according to specific needs, for example, it can be configured to 2 seconds, 3 seconds, etc.; the display of the target interaction data on the target interaction trajectory is time-driven, that is, it is driven by a clock signal, and the coordinates corresponding to multiple time points included in the dynamic coordinates refer to the coordinates corresponding to each time point within the preset display time corresponding to the target interaction data. One time point corresponds to the arrival of a clock signal, and the interval between any two adjacent clock signals can be set according to specific needs, for example, it can be set to 0.01 seconds or 0.02 seconds. For example, when the interval is set to 0.01 seconds, a clock signal arrives every 0.01 seconds, that is, the interval between any two adjacent time points is 0.01 seconds.

[0099] When the video playback terminal controls the target interaction data to be presented on the target interaction trajectory, it can be driven by the clock signal to statically display the target interaction data or to move the target interaction data within the preset display time corresponding to the target interaction data; in the case of static display, the video playback terminal can control the target interaction data to be displayed at a fixed position indicated by the static coordinates on the target interaction trajectory under the drive of the clock signal until the preset display time corresponding to the target interaction data is reached; in the case of mobile display, the video playback terminal can be driven by the clock signal to update the display target interaction data at the position indicated by the coordinates corresponding to each time point on the target interaction trajectory when each time point indicated by the dynamic coordinates is reached. Among them, the position coordinates of the target interaction data on the target interaction trajectory at the first time point within the corresponding preset display time can be set according to specific needs, that is, the position on the target interaction trajectory where the target interaction data is placed when it is placed on the target interaction trajectory can be set according to specific needs; for example, the starting point coordinates of the target interaction trajectory can be used as the coordinates of the target interaction data at the first time point, and then the target interaction data can be displayed statically based on the coordinates, or the target interaction data can be displayed along the forward direction of the target interaction trajectory. For another example, the end point coordinates of the target interaction trajectory can be used as the coordinates of the target interaction data at the first time point, and then the target interaction data can be displayed statically based on the coordinates, or the target interaction data can be displayed along the reverse direction of the target interaction trajectory. For another example, the coordinates of any track point in the target interaction trajectory can be used as the coordinates of the target interaction data at the first time point, and then the target interaction data can be displayed statically based on the coordinates, or the target interaction data can be displayed along the forward or reverse direction of the target interaction trajectory.

[0100] In a feasible implementation, when the position coordinates include dynamic coordinates, that is, for the case of mobile display of target interactive data, the dynamic coordinates include coordinates corresponding to multiple time points, and the multiple time points include a first time point and a second time point that are adjacent to each other, and the arrival time of the first time point is earlier than the arrival time of the second time point; based on this, in the process of the video playback terminal determining the position coordinates of the target interactive data on the target interactive trajectory, it can: obtain the time required from the first time point to the second time point; obtain the moving distance that the target interactive data needs to move on the target interactive trajectory after the time period; determine the first coordinate corresponding to the first time point on the target interactive trajectory; on the target interactive trajectory, based on the first coordinate, the position coordinate at the interval of the moving distance is determined as the second coordinate corresponding to the second time point. Among them, the duration required to go from the first time point to the second time point is the interval between any two adjacent time points. The moving distance that the target interaction data needs to move on the target interaction trajectory after this duration can be set according to specific needs. For example, when it is necessary to achieve uniform motion of the target interaction data, the distance moved by the target interaction data per unit time is required to remain unchanged. If the unit time is set to the interval between adjacent time points, the moving distance that the target interaction data needs to move on the target interaction trajectory after this duration is the set distance that the target interaction data moves per unit time.

[0101] In the process of determining the position coordinates at the interval moving distance on the target interactive trajectory as the second coordinate corresponding to the second time point, the video playback terminal can determine the first length of the first coordinate from the starting point coordinates of the target interactive trajectory in the target interactive trajectory according to the first coordinate corresponding to the first time point, and the second length can be determined according to the first length and the moving distance. The second length can indicate: the distance between the second coordinate corresponding to the second time point and the starting point coordinates of the target interactive trajectory in the target interactive trajectory, and then the coordinates of the trajectory point under the length can be determined according to the second length, and the coordinates of the trajectory point under the length are used as the second coordinate corresponding to the second time point; because in the process of determining the second coordinate corresponding to the second time point, the second length of the second coordinate from the starting point coordinates of the target interactive trajectory in the target interactive trajectory will be determined, and similarly, in the process of determining the first coordinate corresponding to the first time point, the first length of the first coordinate from the starting point coordinates of the target interactive trajectory in the target interactive trajectory will be determined, so according to the first coordinate corresponding to the first time point, the first length can be directly obtained. Among them, if the target interaction data needs to move along the forward direction of the target interaction trajectory, the second length determined according to the first length and the movement is the sum of the first length and the moving distance. If the target interaction data needs to move along the reverse direction of the target interaction trajectory, the second length determined according to the first length and the movement is the difference between the first length and the moving distance. The relevant process of the video playback terminal determining the coordinates of the trajectory point under the second length according to the second length can refer to the above description of the relevant process of "obtaining the coordinates of a trajectory point on the interactive trajectory" in the function implemented by the video playback terminal.

[0102] For example, if the target interaction data is text data, the specific interaction content is "The scenery is really beautiful", and the target interaction trajectory is a curved trajectory composed of a curved trajectory segment, the static display of the target interaction data on the target interaction trajectory can be seen in Figure 3a For the case where the target interaction data moves and is displayed on the target interaction track, the case where the target interaction data moves and is displayed along the positive direction of the target interaction track can be referred to Figure 3b ; See Figure 5c , which is a schematic diagram of a target interactive data movement display exemplarily provided in an embodiment of the present application, wherein the target interactive trajectory can be shown as marked 511, the display of the target interactive data at a first time point as shown by marked 512, and the display of the target interactive data at a second time point as shown by marked 513. It can be seen that the target interactive data is displayed along the reverse movement of the target interactive trajectory shown by marked 511.

[0103] In a feasible implementation, the embodiment of the present application also provides a scheduling and display mechanism for interactive data, which can be used to display interactive data when the number of target interactive data is multiple, or the number of target interactive trajectories is multiple, and the general principle is: by building in a waiting queue to store the target interactive data, each time a clock signal arrives, the target interactive data at the head of the queue selects a target interactive trajectory from the target interactive trajectory that can hold the corresponding target interactive data, and puts the corresponding target interactive data into the selected target interactive trajectory, and each time a clock signal arrives, drives the display of the target interactive data already on each target interactive trajectory (for example, static display or moving display driven by the clock signal); this scheduling and display mechanism can, for example, be applied to scenarios where multiple interactive trajectories are used to display interactive data published by different video viewing objects.

[0104] In a feasible implementation, the scheduling and display mechanism of the interactive data can be executed collaboratively by multiple modules, and exemplary modules may include: a distributor module (track dispatcher), a track module (track) and a track controller module (track controller). Among them, the distributor module can implement the distribution logic of interactive data to the interactive track according to the specified strategy management. A track dispatcher usually manages multiple interactive tracks and has a built-in waiting queue to store interactive data; the track dispatcher can continuously check the managed interactive tracks driven by the clock signal. When a certain interactive track meets the idleness requirement and the distribution strategy at the same time, the interactive data at the head of the waiting queue will be added to the corresponding interactive track; wherein, the idleness requirement can define the conditions that the interactive track needs to meet to put down the interactive data, which can be set according to specific needs, and the distribution strategy can also be set according to specific needs. The track module can be used to maintain the mapping of the location coordinates, size, affine transformation and other attributes of the interactive data displayed on the corresponding interactive track and the time progress, which is similar to a function of spatial information and time information. The track controller module can be used to maintain the display of the interactive data that has been placed on the interactive track, maintain the interactive data waiting to be placed in the interactive track, and maintain the interactive track it manages.

[0105] Taking the interactive data as danmu data (referred to as danmu) as an example, when the scheduling and display mechanism of the interactive data is collaboratively executed by multiple modules, it can also include a danmu player module (danmu player), which can generally include the following processes:

[0106] (1) The bullet screen placement stage.

[0107] The video playback terminal can obtain the danmu model through the network. This model may be obtained using HTTP (Hypertext Transfer Protocol) segmented requests. The video playback terminal can convert the danmu model into danmu attributes through data conversion and deliver it to the danmu player; among them, the danmu attributes can describe the spatial and temporal characteristics of a single danmu, and the danmu attributes can change with the passage of time. It is a description of the movement and display of the danmu on the screen. The danmu player can transfer it to the track dispatcher for processing; after receiving the danmu attributes, the track dispatcher places the danmu attributes at the end of the waiting queue.

[0108] (2) Barrage update stage.

[0109] The display of bullet comments (static display or moving display) is driven by the clock signal. Each time the danmu player receives a clock callback, it can calculate the time interval from the last clock callback, and forward the clock signal and time interval to the track controllers and track dispatcher. After receiving the clock signal, the track controller will update the bullet comments on each interactive track (for example, static display or moving display driven by the clock signal); optionally, data transmission will consume time, and the track controller can deduct the "elapsed time" of the clock signal from the displayed time of the bullet comments. After receiving the clock signal, the track dispatcher can traverse the interactive track list of the danmu player and find the interactive track that can place the bullet comments at the head of the waiting queue, and put the bullet comments at the head of the queue on the corresponding interactive track through the track controller. After receiving the bullet comments at the head of the queue, the track controller stores the bullet comments and places the display view of the bullet comments on the video playback window for display. If it is a texture, it will be drawn and displayed, and the display of the bullet comments on the interactive track will be controlled under the drive of the clock signal within the preset display time corresponding to the bullet comments.

[0110] (3) Barrage unloading stage.

[0111] In stage (2), if the track controller detects that the display time of the barrage exceeds the preset display time, the display view of the barrage can be removed to end the display of the barrage, and the barrage can be removed from its storage structure and delegated to the danmu player an uninstall callback. After receiving the uninstall callback from the track controller, the danmu player follows the recycling logic, stores the presentation layer (presentLayer) of the corresponding danmu attributes in the cache pool (Pool), and releases the danmu attributes; this can reduce the performance loss caused by frequently creating the presentation layer of the barrage, and can cache the presentation layer of the barrage in the cache pool after the barrage is uninstalled, so that the presentation layer cached in the cache pool can be reused the next time the barrage is loaded.

[0112] In the embodiment of the present application, it is supported to configure corresponding interactive tracks for different interactive events that may appear in the video playback scene, so that when different interactive events are detected in the video playback scene, the interactive data can be displayed according to the constraints of the interactive tracks configured for the corresponding interactive events, which can enrich the display mode of the interactive data and realize the personalized display of the interactive data under different interactive events, thereby improving the interactive experience of the video viewing object. In addition, the embodiment of the present application proposes that a curved track and a straight track of any angle can be constructed, which can enrich the track shape of the interactive track, support static or moving display of interactive data based on interactive tracks of different shapes, and can also enrich the display mode of the interactive data, and enhance the fun of the interactive data display, which is conducive to the dissemination of the interactive data.

[0113] Based on the above description, the interactive events and related scenarios in the data processing method proposed in this application are introduced below.

[0114] In a feasible implementation manner, the interactive event includes at least one of the following: a plot content matching event, a theme matching event, a playback time matching event, an interactive data matching event, a countdown event, and a reminder event; wherein, a plot content matching event refers to: the video being played in the video playback scene is played to a specific plot content; a theme matching event refers to: the video being played in the video playback scene is played to a specific theme; a playback time matching event refers to: the playback time of the video being played in the video playback scene reaches a specified time; an interactive data matching event refers to: the target interactive data to be displayed in the video playback scene meets the preset data conditions; a countdown event refers to: the video playback scene reaches the countdown node; a reminder event refers to: the video playback scene generates an event that meets the output conditions of the reminder content; wherein, a target interactive event refers to any one of the above interactive events.

[0115] (1) Matching events to the plot content.

[0116] A plot content matching event refers to: the video being played in the video playback scene is played to a specific plot content. That is to say, if the video playback terminal detects in the video playback scene that the video being played in the video playback scene is played to a specific plot content, then the interaction trajectory that matches the plot matching event indicated by the specific plot content can be determined as the target interaction trajectory, and then the target interaction trajectory drawn based on the description of the target interaction trajectory can be configured to display the target interaction data; wherein, the method of displaying the target interaction data based on the target interaction trajectory can be configured according to specific needs, for example, it can be a static display, a moving display, etc., and the embodiments of the present application are not limited thereto.

[0117] For example, if the interactive configuration information includes a description configuration of an interactive trajectory A1, a description configuration of an interactive trajectory A2, and a description configuration of an interactive trajectory A3, wherein the interactive event matched by the interactive trajectory A1 is a plot content matching event, and the specific plot content indicated by the plot content matching event is the plot content related to "rock climbing", the interactive event matched by the interactive trajectory A2 is a plot content matching event, and the specific plot content indicated by the plot content matching event is also the plot content related to "rock climbing", and the interactive event matched by the interactive trajectory A3 is a plot content matching event, and the specific plot content indicated by the plot content matching event is the plot content related to "kicking a ball". If the video playback terminal detects that the video being played in the video playback scene is played to the plot content related to "rock climbing", it can display the target interactive data based on the interactive trajectory A1 and the interactive trajectory A2; if the target interactive data is text data, the specific interactive content is "turn on the negative angle climbing mode", please refer to Figure 6a , which is a schematic diagram of displaying interactive data under a plot content matching event exemplarily provided in an embodiment of the present application, wherein the target interactive data is repeatedly moved and displayed on the target interactive trajectory (interactive trajectory A1 and interactive trajectory A2); as shown by the mark 601, it is the display of the target interactive data at a certain point in time, the interactive trajectory A1 is shown by the mark 602, and the interactive trajectory A2 is shown by the mark 603; as shown by the mark 604, it is the display of the target interactive data at a certain point in time after the corresponding time point 601; as shown by the mark 605, it is the display of the target interactive data at a certain point in time after the corresponding time point 604; as shown by the mark 606, it is the display of the target interactive data at a certain point in time after the corresponding time point 604.

[0118] (ii) Matching events according to themes.

[0119] A topic matching event refers to: the video being played in the video playback scene is played to a specific topic. That is to say, if the video playback terminal detects in the video playback scene that the video being played in the video playback scene is played to a specific topic, then the interaction trajectory that matches the topic matching event indicated by the specific topic can be determined as the target interaction trajectory, and then the target interaction trajectory drawn can be configured based on the description of the target interaction trajectory to display the target interaction data; wherein, the method of displaying the target interaction data based on the target interaction trajectory can be configured according to specific needs, for example, it can be a static display, a moving display, etc., and the embodiments of the present application are not limited thereto.

[0120] For example, if the interaction configuration information includes a description configuration of an interaction track B1, where the interaction event matched by the interaction track B1 is a theme matching event, and the specific theme indicated by the theme matching event is a theme related to the "Dragon Boat Festival". If the video playback terminal detects that the video being played in the video playback scene is being played to a theme related to the "Dragon Boat Festival" (for example, the video being played is played to a plot content related to "making rice dumplings" or "dragon boat racing", which can be determined to be played to a theme related to the "Dragon Boat Festival"), then the target interaction data can be displayed based on the interaction track B1; if the target interaction data is text data, and the specific interaction content is "Happy Dragon Boat Festival", please refer to Figure 6b , which is a schematic diagram of displaying interactive data under a topic matching event provided as an example in an embodiment of the present application, wherein the interactive track B1 is shown as marked 611, and the target interactive data is displayed statically on the target interactive track (interactive track B1), and the display situation can be shown as marked 612.

[0121] (3) Matching events according to playback time.

[0122] A playback time matching event refers to: the playback time of the video being played in the video playback scene reaches the specified time. That is to say, if the video playback terminal detects in the video playback scene that the playback time of the video being played in the video playback scene reaches the specified time, the interaction trajectory matching the specified time can be determined as the target interaction trajectory, and then the target interaction trajectory drawn can be configured based on the description of the target interaction trajectory to display the target interaction data; wherein, the method of displaying the target interaction data based on the target interaction trajectory can be configured according to specific needs, for example, it can be a static display, a moving display, etc., and the embodiments of the present application are not limited thereto.

[0123] In a feasible implementation manner, the effects achieved by the plot content matching event and the theme matching event can be achieved by the playback time matching event. For example, the interaction configuration information includes a description configuration of an interaction trajectory A1 and a description configuration of an interaction trajectory A2, wherein the interaction event matched by the interaction trajectory A1 is a plot content matching event, and the specific plot content indicated by the plot content matching event is a plot content related to "rock climbing", and the interaction event matched by the interaction trajectory A2 is a plot content matching event, and the specific plot content indicated by the plot content matching event is also a plot content related to "rock climbing". If the video playback terminal detects that the video being played in the video playback scene is played to the plot content related to "rock climbing", the target interaction can be displayed based on the interaction trajectory A1 and the interaction trajectory A2. data; when the interactive event corresponding to the interactive trajectory A1 and the interactive event corresponding to the interactive trajectory A2 are configured as playback time matching events, the interactive event matching the interactive trajectory A1 can be configured as a playback time matching event, and the specified time indicated by the playback time matching event is the time when the plot content related to "rock climbing" starts to be played. Similarly, the interactive event matching the interactive trajectory A2 is configured as a playback time matching event, and the specified time indicated by the playback time matching event is the time when the plot content related to "rock climbing" starts to be played; if the video playback terminal detects that the playback time of the video being played in the video playback scene reaches the specified time (i.e., the time when the plot content related to "rock climbing" starts to be played), the target interactive data can be displayed based on the interactive trajectory A1 and the interactive trajectory A2, which can achieve the same Figure 6a The same effect; the logic of the effect achieved by the theme matching event through the playback time matching event is similar to the logic of the effect achieved by the plot content matching event through the playback time matching event, which will not be repeated here.

[0124] Taking the effect of achieving a plot content matching event or a theme matching event through a playback time matching event as an example, the following briefly introduces the interaction process between the video playback terminal and the background server.

[0125] (1) Background configuration: The configuration object can configure an interactive track for a specific plot content or a specific theme according to the plot content or theme, and configure the interactive event corresponding to the interactive track as a play time matching event. The specified time is configured in the play time matching event, and the interactive data can be optionally configured accordingly. The background server stores the corresponding configuration in the interactive configuration information, so that the interactive configuration information can include: the description configuration of the interactive track configured by the configuration object, and the interactive event matching the corresponding interactive track (i.e., the play time matching event); further optionally, the configuration object can also configure the switch state of the curve track, and the switch state of the curve track is used to indicate whether the curve track function is enabled. When the switch state of the curve track is configured to indicate that the curve track function is turned off, the interactive data is displayed along the straight track in the video playback terminal.

[0126] (2) Terminal request: When a video player starts playing a video, it can request the background server to obtain the interactive configuration information and interactive data set. The request must carry the video ID of the video so that the background server can return the interactive configuration information and the interactive data set associated with the video.

[0127] (3) Background response: After receiving the request from the video playback terminal, the background server searches for the interactive configuration information and interactive data set according to the video identifier carried in the request and returns them to the video playback terminal.

[0128] (4) Terminal parsing: After receiving the interactive configuration information and interactive data set returned by the background server, the video playback terminal can perform data parsing so that the video playback terminal can determine when (the playback time matches the specified time indicated by the event) and how to adjust the interactive trajectory (how to adjust the interactive trajectory can be determined based on the description configuration).

[0129] (5) Terminal displays interactive data: If the video playback terminal detects in the video playback scene that the playback time of the video being played in the video playback scene reaches the specified time, the interactive track matching the specified time can be determined as the target interactive track, and then the target interactive track drawn based on the description configuration of the target interactive track can be used to display the target interactive data. This allows specific plot content or specific themes to be highlighted through specific interactive tracks, so that the video viewers can perceive the switching of plot content or themes through specific interactive tracks during the video viewing process, thereby improving the viewing experience.

[0130] (IV) Matching events for interactive data.

[0131] An interactive data matching event refers to: the target interactive data to be displayed in the video playback scene meets the preset data condition, that is, if the video playback terminal detects in the video playback scene that the target interactive data to be displayed in the video playback scene meets the preset data condition, then the interactive trajectory that matches the interactive data matching event indicated by the preset data condition can be determined as the target interactive trajectory, and then the target interactive trajectory drawn based on the description of the target interactive trajectory can be configured to display the target interactive data; wherein, the method of displaying the target interactive data based on the target interactive trajectory can be configured according to specific needs, for example, static display, moving display, etc., which is not limited in the embodiment of the present application; the preset data condition can be configured according to specific needs, for example, the preset data condition can be configured so that the interactive content is specified content (the specified content can be configured according to specific needs, for example, it can be configured as "Happy Birthday", "Happy Holidays", etc.), and the preset data condition can be configured so that the interactive content contains specified text (the specified text can be configured according to specific needs, for example, it can be configured as "Moon Cake", etc.); that is, the data processing method proposed in the embodiment of the present application supports special display based on a specific interactive trajectory when the interactive data meets the preset data condition, which can improve the display interest of the interactive data and enhance the user experience.

[0132] For example, if the interaction configuration information includes a description configuration of an interaction track C1, wherein the interaction event matched by the interaction track C1 is an interaction data matching event, and the preset data condition indicated by the interaction data matching event is: the interaction content is the specified content "Happy birthday, happy every day". If the video playback terminal detects that the interaction content of the target interaction data to be displayed in the video playback scene is the specified content "Happy birthday, happy every day", the target interaction data can be displayed based on the interaction track C1; see Figure 6c , which is a schematic diagram of displaying interactive data under an interactive data matching event provided as an example in an embodiment of the present application, wherein the interactive track C1 is shown as marked 621, and the target interactive data is displayed statically on the target interactive track (interactive track C1), and the display situation can be shown as marked 622.

[0133] (V) Regarding countdown events.

[0134] A countdown event refers to: a video playback scene reaches a countdown node, that is, if the video playback terminal detects in the video playback scene that the video playback scene reaches a countdown node, the interaction trajectory that matches the countdown event indicated by the countdown node can be determined as the target interaction trajectory, and then the target interaction trajectory drawn can be configured based on the description of the target interaction trajectory to display the target interaction data; wherein, the method of displaying the target interaction data based on the target interaction trajectory can be configured according to specific needs, for example, it can be displayed statically, displayed in motion, etc., and the embodiments of the present application do not impose any restrictions; wherein, a countdown node refers to a node obtained by subtracting the countdown interval duration from the countdown duration, and the countdown duration and the countdown interval duration can be configured according to specific needs, for example, the countdown duration can be configured to 3 seconds, and the countdown interval duration can be configured to 1 second, then the countdown node includes a node corresponding to a countdown of 3 seconds, a node corresponding to a countdown of 2 seconds, and a node corresponding to a countdown of 1 second.

[0135] For example, if the interaction configuration information includes a description configuration of an interaction trajectory D1, a description configuration of an interaction trajectory D2, and a description configuration of an interaction trajectory D3, wherein the interaction event matched by the interaction trajectory D1 is a countdown event, and the countdown node indicated by the countdown event is: the node corresponding to the countdown of 3 seconds, the interaction event matched by the interaction trajectory D2 is a countdown event, and the countdown node indicated by the countdown event is: the node corresponding to the countdown of 2 seconds, and the interaction event matched by the interaction trajectory D3 is a countdown event, and the countdown node indicated by the countdown event is: the node corresponding to the countdown of 1 second. If the video playback terminal detects that the video playback scene reaches the node corresponding to the countdown of 3 seconds, the corresponding target interaction data can be displayed based on the interaction trajectory D1. If the video playback scene is detected to reach the node corresponding to the countdown of 2 seconds, the corresponding target interaction data can be displayed based on the interaction trajectory D2. If the video playback scene is detected to reach the node corresponding to the countdown of 1 second, the corresponding target interaction data can be displayed based on the interaction trajectory D3. Please refer to Figure 6d , which is a schematic diagram of displaying interactive data under a countdown event provided as an example in an embodiment of the present application. As shown by the mark 631, when the video playback scene reaches the node corresponding to the countdown of 3 seconds, the corresponding target interactive data is displayed; as shown by the mark 632, when the video playback scene reaches the node corresponding to the countdown of 2 seconds, the corresponding target interactive data is displayed; as shown by the mark 633, when the video playback scene reaches the node corresponding to the countdown of 1 second, the corresponding target interactive data is displayed.

[0136] Taking the video playback scenario as a live video broadcast scenario as an example, the following briefly introduces the interaction process between the video playback terminal and the background server during the countdown event.

[0137] (1) Countdown configuration: During the live video broadcast, the configuration object can configure the countdown start event, in which the countdown start time, countdown duration and countdown interval can be configured. Optionally, it also supports configuring the interactive data to be displayed for each countdown node; wherein the configuration object can be the object (i.e., the anchor) that initiates the live video broadcast in the live video broadcast scene. The backend server can generate interactive configuration information according to the configuration of the configuration object, so that the interactive configuration information can include: the description configuration of the interactive track corresponding to each countdown node within the countdown duration, the interactive event matching the interactive track corresponding to each countdown node (i.e., the countdown event, with the corresponding countdown node configured), the interactive configuration information can include the countdown start time and the countdown interval. If the configuration object does not configure the countdown interval, the default countdown interval can be selected, for example, the default countdown interval can be 1 second, 2 seconds, etc.

[0138] (2) Notifying the video playback client: The background server can send the generated interactive configuration information and interactive data to the video playback client that is playing the live video.

[0139] (3) Terminal analysis: The video playback terminal that receives the interactive configuration information and interactive data sent by the background server can perform data analysis so that the video playback terminal can determine when (when the countdown node arrives) and how to adjust the interactive trajectory (how to adjust the interactive trajectory can be determined based on the description configuration).

[0140] (4) The terminal displays interactive data: When the countdown start time arrives, the video playback terminal performs a countdown operation, and detects in the video playback scene that when the video playback scene reaches the countdown node, the interactive track that matches the countdown event indicated by the countdown node is determined as the target interactive track, and then the target interactive track drawn based on the description of the target interactive track can be configured to display the target interactive data; for example, it can be displayed statically or in motion, and during the countdown, the interactive data on the interactive track corresponding to the countdown node can be configured to gradually decrease until the countdown ends. This allows the countdown to be displayed through interactive data, enriches the countdown display method, improves the fun of the countdown display, and improves the viewing experience.

[0141] (6) Regarding reminder events.

[0142] A reminder event refers to: an event generated by a video playback scene that satisfies the output conditions of the reminder content. That is to say, if the video playback terminal detects in the video playback scene that the video playback scene generates an event that satisfies the output conditions of the reminder content, that is, if it is detected in the video playback scene that the output conditions of the reminder content are met in the video playback scene, then the interaction trajectory matching the reminder event indicated by the reminder content can be determined as the target interaction trajectory, and then the target interaction trajectory drawn can be configured based on the description of the target interaction trajectory to display the target interaction data; wherein, the method of displaying the target interaction data based on the target interaction trajectory can be configured according to specific needs, for example, it can be a static display, a moving display, etc., and the embodiments of the present application are not limited thereto.

[0143] Among them, the reminder content and the output conditions of the reminder content can be configured according to specific business needs. For example, the reminder content can be used for rest reminders. For example, the reminder content can be the first reminder content for rest reminders, and the corresponding output condition can be that the video playback scene reaches a specified time point (the specified time point can be set according to specific needs, for example, it can be set to 12 o'clock in the morning, 2 o'clock in the morning, etc.), that is, if the video viewing object is still watching the video at a specified time point such as 12 o'clock in the morning or 2 o'clock in the morning, then the first reminder content can be displayed based on a specific interactive trajectory for rest reminders, and the target interactive data at this time is the first reminder content; for another example, the reminder content can be the second reminder content for rest reminders, and the corresponding output condition can be that the duration of the video playback terminal playing the video reaches a specified duration threshold (the specified duration threshold can be set according to specific needs, for example, it can be set to 1 hour, 2 hours, etc.), that is, if the duration of the video viewing object watching the video in the video playback terminal reaches a specified duration threshold such as 1 hour or 2 hours, then the second reminder content can be displayed based on a specific interactive trajectory for rest reminders, and the target interactive data at this time is the second reminder content. For example, the reminder content can also be used for screen brightness reminders; in this business scenario, the reminder content can be used for screen brightness reminders, and the corresponding output condition can be that the screen brightness reaches a specified brightness threshold (the specified brightness threshold can be set according to specific needs, for example, it can be set to 70%, 80%, etc. of the maximum screen brightness supported by the video playback terminal). In other words, if the video viewing object adjusts the screen brightness to reach the specified brightness threshold, the corresponding reminder content can be displayed based on a specific interaction trajectory for screen brightness reminders. At this time, the target interaction data is used for the reminder content for screen brightness reminders.

[0144] For example, if the interactive configuration information includes a description configuration of an interactive track E1 and a description configuration of an interactive track E2, the interactive event matched by the interactive track E1 is a reminder event, and the reminder content indicated by the reminder event is the first reminder content. If the first reminder content is specifically "It's late at night, please arrange your work and rest time reasonably and pay attention to rest", the interactive event matched by the interactive track E2 is a reminder event, and the reminder content indicated by the reminder event is the second reminder content. If the second reminder content is specifically "You have watched for 2 hours, pay attention to rest and protect your eyes". Please refer to Figure 6e , which is a schematic diagram of displaying interactive data under a reminder event exemplarily provided in an embodiment of the present application. If the video playback terminal detects that the output condition of the first reminder content is met, the target interactive data (first reminder content) can be displayed based on the interactive track E1, wherein the interactive track E1 can be as shown by the mark 641, and the target interactive data (first reminder content) is displayed statically on the interactive track E1, and the display situation can be as shown by the mark 642; please refer to Figure 6f , which is a schematic diagram of displaying interactive data under another reminder event provided as an example in an embodiment of the present application. If the video playback terminal detects that the output condition of the second reminder content is met, the target interactive data (second reminder content) can be displayed based on the interactive trajectory E2, wherein the interactive trajectory E2 can be as shown by the mark 651, and the target interactive data (second reminder content) is displayed statically on the interactive trajectory E2, and the display situation can be as shown by the mark 652.

[0145] Taking the rest reminder scenario as an example, the following briefly introduces the interaction process between the video playback terminal and the background server during the reminder event.

[0146] (1) Background configuration: The configuration object can configure a reminder event for rest reminder and a description configuration of the interactive track matching the reminder event, configure a first reminder content for rest reminder and an output condition of the first reminder content in one reminder event, and configure a second reminder content for rest reminder and an output condition of the second reminder content in another reminder event. The background server stores the corresponding configuration in the interactive configuration information, so that the interactive configuration information may include: a description configuration of the interactive track configured by the configuration object, and an interactive event (i.e., a reminder event) matching the interactive track.

[0147] (2) Terminal request: When a video player starts playing a video, it can request the background server to obtain interactive configuration information and interactive data sets.

[0148] (3) Background response: After receiving the request from the video playback terminal, the background server returns the interactive configuration information and interactive data set to the video playback terminal.

[0149] (4) Terminal analysis: After receiving the interactive configuration information and interactive data set returned by the background server, the video playback terminal can perform data analysis so that the video playback terminal can determine when (when the output conditions of the reminder content are met) and how to adjust the interactive trajectory (how to adjust the interactive trajectory can be determined based on the description configuration).

[0150] (5) The terminal displays interactive data: If the video playback terminal has enabled the rest reminder function, it is necessary to monitor the viewing time, current time and other information so as to trigger the display of the reminder content for rest reminder when the output conditions of the reminder content are met. If the video playback terminal detects in the video playback scene that the output conditions of the reminder content are met in the video playback scene, the interactive track that matches the reminder event indicated by the reminder content can be determined as the target interactive track, and then the target interactive track drawn based on the description configuration of the target interactive track can be used to display the target interactive data (i.e., display the reminder content); for example, when the video playback terminal detects that the output conditions of the first reminder content are met (i.e., when the specified time point arrives), the first reminder content for rest reminder can be displayed, and when the video playback terminal detects that the output conditions of the second reminder content are met (i.e., when the video playback terminal plays the video for a specified time threshold), the second reminder content for rest reminder can be displayed. This makes it possible to enrich the display mode of the reminder content, improve the fun of watching movies, and improve the user experience.

[0151] Based on the above description, it can be seen that personalized display of interactive data can be achieved in different application scenarios based on interactive trajectories adapted to the corresponding scenarios; specific plot content or specific themes can be highlighted through specific interactive trajectories, so that video viewers can perceive the switching of plot content or themes through specific interactive trajectories while watching the video, thereby improving the viewing experience; the countdown can be displayed through interactive data, the display method of the countdown can be enriched, the fun of the countdown display can be improved, and the viewing experience can be improved; different reminder contents can be displayed through specific interactive trajectories, the display method of the reminder contents can be enriched, the fun of viewing can be improved, and the user experience and user retention rate can be improved.

[0152] The above embodiments introduce the description configuration based on the target interaction trajectory, and the related process of displaying the target interaction data according to the constraints of the target interaction trajectory, that is, the description configuration based on the target interaction trajectory, the related process of drawing the target interaction trajectory in the video playback window, and controlling the presentation of the target interaction data on the target interaction trajectory. However, in some cases, there may be a mismatch between the target interaction trajectory determined by the description configuration based on the target interaction trajectory and the video playback window. For example, when configuring the description configuration of the target interaction trajectory, the configuration object is configured based on the size of the reference window. When the sizes of the video playback window and the reference window are different, there will be a mismatch between the target interaction trajectory determined by the description configuration based on the target interaction trajectory and the video playback window. Based on this, an embodiment of the present application provides another data processing method. In the case of a mismatch between the target interaction trajectory determined by the description configuration based on the target interaction trajectory and the video playback window, the description configuration of the target interaction trajectory is adjusted so that the target interaction trajectory determined by the adjusted description configuration of the target interaction trajectory is adapted to the video playback window. See. Figure 7 , which is a flow chart of another data processing method provided in an embodiment of the present application; the data processing method can be executed by a computer device, and the computer device can be a video playback terminal or a server. In the embodiment of the present application, the method is described by taking the video playback terminal as an example. Figure 1b Taking the video playback terminal 111 in the data processing system shown in the figure as an example, the data processing method may include the following steps S701-S708:

[0153] S701, in a video playback scene, obtaining preset interaction configuration information; the interaction configuration information includes a description configuration of at least one interaction track and an interaction event matching each interaction track.

[0154] The description configuration of any interactive trajectory is used to determine an interactive trajectory, and any interactive trajectory is used to constrain the motion path of the interactive data.

[0155] S702: If a target interaction event is detected in the video playback scene, a target interaction track matching the target interaction event is determined.

[0156] S703: Obtain target interactive data to be displayed in the video playback scene.

[0157] The relevant processes of step S701 to step S703 have been introduced in the above-mentioned steps S201 to step S203 and step S401 to step S403, and will not be repeated here.

[0158] S704, obtaining size information of the video playback window.

[0159] S705 , determining, according to the size information of the video play window, an adaptation result between the target interaction trajectory determined based on the description configuration of the target interaction trajectory and the video play window.

[0160] The description configuration of the target interactive trajectory may include: M groups of control point coordinates required for drawing the target interactive trajectory, M is a positive integer, and any group of control point coordinates is used to draw an interactive trajectory segment adapted to the reference window; the description configuration of the target interactive trajectory also includes the size information of the reference window; in the process of determining the adaptation result between the target interactive trajectory determined based on the description configuration of the target interactive trajectory and the video playback window according to the size information of the video playback window, the video playback terminal may perform the following operations: if the size information of the video playback window is the same as the size information of the reference window in the description configuration of the target interactive trajectory, then an adaptation result indicating the adaptation between the target interactive trajectory determined based on the description configuration of the target interactive trajectory and the video playback window is generated; otherwise, an adaptation result indicating the incompatibility between the target interactive trajectory determined based on the description configuration of the target interactive trajectory and the video playback window is generated. The reference window refers to the window adapted to the target interactive trajectory determined based on the description configuration of the target interactive trajectory, that is, the window referenced by the configuration object when configuring the description configuration of the target interactive trajectory.

[0161] See also Figure 8a , which is a schematic diagram of the incompatibility between a target interaction trajectory and a video playback window provided in an embodiment of the present application; if the reference window and the video playback window are both rectangular windows, a two-dimensional coordinate system is constructed with the lower left vertex of the rectangular window as the coordinate origin, the direction from the lower left vertex of the rectangular window to the lower right vertex is the horizontal axis (X axis) direction, and the direction from the lower left vertex of the rectangular window to the upper left vertex is the vertical axis (Y axis) direction. If the reference window for constructing the two-dimensional coordinate system is shown as 801, and the video playback window for constructing the two-dimensional coordinate system is shown as 802, in the accompanying drawings of the embodiments of the present application, in order to facilitate the distinction between the reference window and the video playback window, the reference window is represented by a "dotted line" and the video playback window is represented by a "solid line"; if the target interaction trajectory determined based on the description configuration of the target interaction trajectory is drawn in the reference window, as shown in 803, then, when the target interaction trajectory determined based on the description configuration of the target interaction trajectory is drawn in the video playback window, it can be as shown in 804. It can be seen that the target interaction trajectory determined based on the description configuration of the target interaction trajectory is incompatible with the video playback window.

[0162] S706: If the adaptation result indicates that the target interaction trajectory determined based on the description configuration of the target interaction trajectory is adapted to the video playback window, the target interaction data is displayed according to the constraints of the target interaction trajectory based on the description configuration of the target interaction trajectory.

[0163] The relevant process of step S706 is similar to the relevant process of the above-mentioned step S204 and steps S404 to S405, and will not be described in detail here.

[0164] S707, if the adaptation result indicates that the target interaction trajectory determined based on the description configuration of the target interaction trajectory is not compatible with the video playback window, the description configuration of the target interaction trajectory is adjusted according to the size information of the video playback window to obtain the adjusted description configuration of the target interaction trajectory; wherein the target interaction trajectory determined based on the adjusted description configuration is adapted to the video playback window.

[0165] In a feasible implementation, the video playback terminal adjusts the description configuration of the target interactive trajectory according to the size information of the video playback window. In the process of obtaining the adjusted description configuration of the target interactive trajectory, the following steps can be performed: according to the M groups of control point coordinates in the description configuration of the target interactive trajectory, determine the window area occupied by the interactive trajectory determined by the M groups of control point coordinates; according to the size information of the video playback window, determine the scaling parameters for filling the window area into the video playback window; scale the M groups of control point coordinates according to the scaling parameters to obtain the M groups of target control point coordinates adapted to the video playback window; update the M groups of control point coordinates in the description configuration of the target interactive trajectory to the M groups of target control point coordinates to obtain the adjusted description configuration of the target interactive trajectory. Among them, the scaling parameter refers to the ratio of enlargement or reduction required to fill the window area into the video playback window; when scaling the M groups of control point coordinates according to the scaling parameters to obtain the M groups of target control point coordinates adapted to the video playback window, the scaling parameters can be used to perform geometric transformation on the M groups of control point coordinates.

[0166] In a feasible implementation manner, when the video playback terminal determines the window area occupied by the interactive trajectory determined by the M groups of control point coordinates in the description configuration of the target interactive trajectory, it can: determine the interactive trajectory adapted to the reference window according to the M groups of control point coordinates in the description configuration of the target interactive trajectory; find the maximum and minimum values ​​of the interactive trajectory adapted to the reference window in the horizontal coordinate direction, and find the maximum and minimum values ​​of the interactive trajectory adapted to the reference window in the vertical coordinate direction; and use the area formed by the determined maximum and minimum values ​​in the horizontal coordinate direction, and the maximum and minimum values ​​in the vertical coordinate direction as the window area.

[0167] Among them, the description configuration of the target interactive trajectory may also include: the trajectory type of the target interactive trajectory, the interactive trajectory model used under the trajectory type, and the video playback terminal determines the relevant process of the interactive trajectory adapted to the reference window according to the M groups of control point coordinates in the description configuration of the target interactive trajectory. The process is similar to the above-mentioned relevant process of determining the target interactive trajectory according to the description configuration of the target interactive trajectory, that is, the interactive trajectory model in the description configuration of the target interactive trajectory and the M groups of control point coordinates in the description configuration of the target interactive trajectory can be used to construct M interactive trajectory segments, and the M interactive trajectory segments constitute the interactive trajectory adapted to the reference window.

[0168] When searching for the maximum and minimum values ​​in the horizontal direction of the interactive trajectory adapted to the reference window, the maximum and minimum values ​​in the horizontal direction of each interactive trajectory segment in the M interactive trajectory segments can be searched, and the maximum value is selected from each maximum value in the horizontal direction to obtain the maximum value of the interactive trajectory adapted to the reference window in the horizontal direction, and the minimum value is selected from each minimum value in the horizontal direction to obtain the minimum value of the interactive trajectory adapted to the reference window in the horizontal direction. Similarly, when searching for the maximum and minimum values ​​in the vertical direction of the interactive trajectory adapted to the reference window, the maximum and minimum values ​​in the vertical direction of each interactive trajectory segment in the M interactive trajectory segments can be searched, and the maximum value is selected from each maximum value in the vertical direction to obtain the maximum value of the interactive trajectory adapted to the reference window in the vertical direction, and the minimum value is selected from each minimum value in the vertical direction to obtain the minimum value of the interactive trajectory adapted to the reference window in the vertical direction.

[0169] In the process of determining the maximum and minimum values ​​of any interactive trajectory segment in the horizontal coordinate direction, the maximum and minimum values ​​can be determined by calculating the maximum and minimum values ​​of the expression of the interactive trajectory segment (the expression of the interactive trajectory segment is an expression obtained by substituting a set of control point coordinates required to construct the interactive trajectory segment into the interactive trajectory model required to construct the interactive trajectory segment). For example, the derivative of the horizontal coordinate (X coordinate) of the expression of the interactive trajectory segment can be calculated to find its zero point relative to t, and the horizontal coordinate value (X coordinate value) at the zero point corresponds to the local maximum or minimum value of the interactive trajectory segment. Similarly, in the process of determining the maximum and minimum values ​​of any interactive trajectory segment in the vertical coordinate direction, the maximum and minimum values ​​can be determined by calculating the maximum and minimum values ​​of the expression of the interactive trajectory segment. For example, the derivative of the vertical coordinate (Y coordinate) of the expression of the interactive trajectory segment can be calculated to find its zero point relative to t, and the vertical coordinate value (Y coordinate value) at the zero point corresponds to the local maximum or minimum value of the interactive trajectory segment.

[0170] See also Figure 8b, which is a schematic diagram of determining a window area exemplarily provided in an embodiment of the present application; if the interaction trajectory adapted to the reference window is determined according to the M groups of control point coordinates in the description configuration of the target interaction trajectory as shown in mark 811, the interaction trajectory is composed of a curved trajectory segment, and the maximum and minimum values ​​of the interaction trajectory in the horizontal coordinate direction are respectively the horizontal coordinate of the trajectory point coordinates as shown in mark 812, and the horizontal coordinate of the trajectory point coordinates as shown in mark 813, and the maximum and minimum values ​​of the interaction trajectory in the vertical coordinate direction are respectively the vertical coordinate of the trajectory point coordinates as shown in mark 814, and the vertical coordinate of the trajectory point coordinates as shown in mark 815, and the window area determined based on the determined maximum and minimum values ​​in the horizontal coordinate direction, and the maximum and minimum values ​​in the vertical coordinate direction can be as shown in mark 816.

[0171] See also Figure 8c , which is another schematic diagram of determining the window area provided as an example in an embodiment of the present application; if the interaction trajectory adapted to the reference window is determined according to the M groups of control point coordinates in the description configuration of the target interaction trajectory as shown in mark 821, the interaction trajectory is composed of a curved trajectory segment, and the maximum and minimum values ​​of the interaction trajectory in the horizontal coordinate direction are respectively the horizontal coordinate of the trajectory point coordinates as shown in mark 822, and the horizontal coordinate of the trajectory point coordinates as shown in mark 823, and the maximum and minimum values ​​of the interaction trajectory in the vertical coordinate direction are respectively the vertical coordinate of the trajectory point coordinates as shown in mark 824, and the vertical coordinate of the trajectory point coordinates as shown in mark 825, and the window area determined based on the determined maximum and minimum values ​​in the horizontal coordinate direction, and the maximum and minimum values ​​in the vertical coordinate direction can be as shown in mark 826.

[0172] See also Figure 8d , which is another schematic diagram of determining a window area exemplarily provided in an embodiment of the present application; if the interaction trajectory adapted to the reference window is determined according to the M groups of control point coordinates in the description configuration of the target interaction trajectory as shown in mark 831, the interaction trajectory is composed of 2 curved trajectory segments, and the maximum and minimum values ​​of the interaction trajectory in the horizontal coordinate direction are respectively the horizontal coordinate of the trajectory point coordinates as shown in mark 832, and the horizontal coordinate of the trajectory point coordinates as shown in mark 833, and the maximum and minimum values ​​of the interaction trajectory in the vertical coordinate direction are respectively the vertical coordinate of the trajectory point coordinates as shown in mark 834, and the vertical coordinate of the trajectory point coordinates as shown in mark 835, and the window area determined based on the determined maximum and minimum values ​​in the horizontal coordinate direction, and the maximum and minimum values ​​in the vertical coordinate direction can be as shown in mark 836.

[0173] In another feasible implementation, if the description configuration of the target interactive trajectory indicates that the interactive trajectory adapted to the reference window is an interactive trajectory composed of a cubic Bezier curve, according to the convex hull property of the Bezier curve, the trajectory area of ​​a cubic Bezier curve will always be surrounded by a quadrilateral surrounded by its control point coordinates, and this quadrilateral is formed by sequentially connecting the control point coordinates connected head to tail. Based on this, the area formed by connecting a set of control point coordinates required to construct the cubic Bezier curve can be used as the window area; wherein, if the description configuration of the target interactive trajectory includes a set of control point coordinates, and the trajectory type of the target interactive trajectory included in the description configuration of the target interactive trajectory is a curve type, and the interactive trajectory model used under the trajectory type is a cubic Bezier curve model, then it can be determined that the interactive trajectory adapted to the reference window is an interactive trajectory composed of a cubic Bezier curve. See. Figure 8e , which is another schematic diagram of determining a window area provided as an example in an embodiment of the present application; if the interaction trajectory configured as indicated by the description configuration of the target interaction trajectory and adapted to the reference window is as shown in mark 841, the window area determined according to the control point coordinates can be as shown in mark 842.

[0174] The adjustment process of the description configuration of any interactive track in the interactive configuration information is similar to the adjustment process of the description configuration of the target interactive track mentioned above. In another feasible implementation, the description configuration of the target interactive track includes: M groups of control point coordinates required to draw the target interactive track, M is a positive integer, and any group of control point coordinates is used to draw an interactive track segment; the adjusted description configuration of the target interactive track includes: M groups of target control point coordinates obtained by adjusting the M groups of control point coordinates; when the interactive configuration information also includes: description configurations of other interactive tracks with the same track shape as the target interactive track, and other interactive tracks and the target interactive track are arranged in parallel in the video playback window; the video playback terminal can also obtain the adjusted description configurations of other interactive tracks adapted to the video playback window in the following manner: obtain the interval distance and interval direction between other interactive tracks and the target interactive track; translate the M groups of target control point coordinates in the adjusted description configuration of the target interactive track in the interval direction by the interval distance; use the translated M groups of target control point coordinates to replace the M groups of control point coordinates in the description configuration of other interactive tracks, and obtain the adjusted description configurations of other interactive tracks adapted to the video playback window.

[0175] In the process of the video playback terminal translating the M groups of target control point coordinates in the adjusted description configuration of the target interaction trajectory in the interval direction by the interval distance, if the interval direction is the X-axis direction (i.e., the positive direction of the X-axis), the M groups of target control point coordinates corresponding to the target interaction trajectory are translated in the positive direction of the X-axis by the interval distance; if the interval direction is the negative direction of the X-axis, the M groups of target control point coordinates corresponding to the target interaction trajectory are translated in the negative direction of the X-axis by the interval distance; if the interval direction is the Y-axis direction (i.e., the positive direction of the Y-axis), the M groups of target control point coordinates corresponding to the target interaction trajectory are translated in the positive direction of the Y-axis by the interval distance; if the interval direction is the negative direction of the Y-axis, the M groups of target control point coordinates corresponding to the target interaction trajectory are translated in the negative direction of the Y-axis by the interval distance; the interval distance and interval direction between other interaction trajectories and the target interaction trajectory can be carried in the interaction configuration information.

[0176] See also Figure 8f , which is a schematic diagram of determining interactive trajectories arranged in parallel provided in an embodiment of the present application; if the target interactive trajectory adapted to the video playback window determined according to the adjusted description configuration of the target interactive trajectory is as shown in mark 851, if there are two other interactive trajectories with the same trajectory shape as the target interactive trajectory, the interval distance between the first other interactive trajectory and the target interactive trajectory is g, and the interval direction is the negative direction of the Y axis, and the interval distance between the second other interactive trajectory and the target interactive trajectory is 2g, and the interval direction is the negative direction of the Y axis, that is, the interval distance between two adjacent interactive trajectories with the same trajectory shape is g, then the first other interactive trajectory adapted to the video playback window can be as shown in mark 852, and the second other interactive trajectory adapted to the video playback window can be as shown in mark 853.

[0177] See also Figure 8g, which is a schematic diagram of another method for determining interactive trajectories arranged in parallel provided in an embodiment of the present application; if the target interactive trajectory adapted to the video playback window determined according to the adjusted description configuration of the target interactive trajectory is as shown in mark 861, if there are two other interactive trajectories with the same trajectory shape as the target interactive trajectory, the interval distance between the first other interactive trajectory and the target interactive trajectory is g, and the interval direction is the negative direction of the X-axis, and the interval distance between the second other interactive trajectory and the target interactive trajectory is 2g, and the interval direction is the negative direction of the X-axis, that is, the interval distance between two adjacent interactive trajectories with the same trajectory shape is g, then the first other interactive trajectory adapted to the video playback window can be as shown in mark 862, and the second other interactive trajectory adapted to the video playback window can be as shown in mark 863. Based on the above, when it is necessary to adjust a group of interactive tracks with the same track shape and arranged in parallel, the description configuration of one of the interactive tracks can be adjusted first to obtain the adjusted description configuration of the interactive track (the interactive track indicated by the adjusted description configuration of the interactive track is adapted to the video playback window), and then the adjusted description configurations of each interactive track can be obtained according to the interval distance and interval direction between the interactive track, which can speed up processing efficiency and save processing resources; among them, the spacing between a group of interactive tracks with the same track shape and arranged in parallel and the video playback window can be configured according to specific needs.

[0178] In another feasible implementation, when M=1, and the trajectory type of the interactive trajectory determined by the M groups of control point coordinates is a straight line type, that is, the description configuration of the target interactive trajectory includes 1 group of control point coordinates, and the target interactive trajectory determined based on the description configuration of the target interactive trajectory is composed of a straight line trajectory segment; based on this, the video playback terminal adjusts the description configuration of the target interactive trajectory according to the size information of the video playback window, and in the process of obtaining the adjusted description configuration of the target interactive trajectory, the following steps can be performed: according to the M groups of control point coordinates in the description configuration of the target interactive trajectory, the trajectory parameters of the interactive trajectory determined by the M groups of control point coordinates are determined; according to the size information of the video playback window and the trajectory parameters, a straight line equation is constructed; based on the size information of the video playback window, the coordinates of the intersection of the straight line equation and the video playback window are determined; the determined intersection coordinates are used to construct M groups of target control point coordinates that are adapted to the video playback window, and the M groups of control point coordinates in the description configuration of the target interactive trajectory are updated to the M groups of target control point coordinates to obtain the adjusted description configuration of the target interactive trajectory.

[0179] The determined trajectory parameters of the interactive trajectory may include: an angle of the determined interactive trajectory and a vertical distance of the determined interactive trajectory, wherein the angle of the determined interactive trajectory refers to: an angle between the direction of the determined interactive trajectory and the positive direction of the X-axis, and the vertical distance of the determined interactive trajectory refers to: a vertical distance between the upper left vertex / upper right vertex of the reference window and the determined interactive trajectory; see Figure 8h , which is a schematic diagram of a trajectory parameter provided in an embodiment of the present application, wherein the determined interaction trajectory may be as indicated by mark 871 , the determined angle of the interaction trajectory may be as indicated by mark 872 , and the determined vertical distance of the interaction trajectory may be as indicated by mark 873 .

[0180] In the case where the M groups of control point coordinates in the description configuration of the target interactive trajectory include the starting point coordinates and the ending point coordinates of the straight line trajectory segment to be constructed, the video playback terminal can obtain the angle of the determined interactive trajectory and the vertical distance of the determined interactive trajectory according to the starting point coordinates and the ending point coordinates. The straight line equation is constructed according to the size information of the video playback window and the trajectory parameters in order to construct a straight line trajectory with the same angle as the determined interactive trajectory and the same vertical distance as the determined interactive trajectory, and adapted to the video playback window, that is, the angle of the determined interactive trajectory is used as the angle required to construct the straight line equation, and the vertical distance of the determined interactive trajectory is used as the vertical distance required to construct the straight line equation to construct the straight line equation. That is to say, the embodiment of the present application points out that the straight line equation can be constructed according to the size information of the video playback window and the trajectory parameters required to construct the straight line equation, that is, the straight line equation can be constructed according to the size information of the video playback window, the angle required to construct the straight line equation, and the vertical distance required to construct the straight line equation; in a feasible implementation, the trajectory parameters required to construct the straight line equation also support configuration according to specific needs, and the configuration object can configure the trajectory parameters required to construct the straight line equation corresponding to any interactive trajectory, and carry it in the interactive configuration information and send it to the video playback terminal by the background server.

[0181] If α is used to represent the angle required to construct the straight line equation, and h is used to represent the vertical distance required to construct the straight line equation, then the slope required to construct the straight line equation can be determined based on the angle α. If k is used to represent the slope, the straight line equation can be expressed by the following formula 2.1, where b is the intercept required to construct the straight line equation, x represents the horizontal coordinate variable, and y represents the vertical coordinate variable:

[0182] y=kx+b (2.1)

[0183] The intercept b required to construct the straight line equation can be determined based on the size information of the video playback window; if in the size information of the video playback window, the width of the video playback window (i.e., the length of the video playback window along the X-axis direction) is represented by width, and the height of the video playback window (i.e., the length of the video playback window along the Y-axis direction) is represented by length, when the angle α is in the first or third quadrant, the straight line equation can be expressed by the following formulas 2.2 and 2.3; when the angle α is in the second or fourth quadrant, the straight line equation can be expressed by the following formulas 2.4 and 2.5, where Math.sqrt represents the square root.

[0184] y1=k*x+(length-h*Math.sqrt(1+k*k)) (2.2)

[0185] y2=k*x+(length+h*Math.sqrt(1+k*k)) (2.3)

[0186] y1=k*x+(length-k*width-h*Math.sqrt(1+k*k)) (2.4)

[0187] y2=k*x+(length-k*width+h*Math.sqrt(1+k*k)) (2.5)

[0188] After constructing the straight line equation, the video playback terminal can determine the coordinates of the intersection of the straight line equation and the video playback window based on the size information of the video playback window, and use the determined intersection coordinates to construct M groups of target control point coordinates that are adapted to the video playback window. Wherein, when the video playback terminal determines the coordinates of the intersection of the straight line equation and the video playback window based on the size information of the video playback window, the coordinates of the intersection of each straight line equation and the four sides of the rectangle corresponding to the video playback window can be determined. When the coordinates of the intersection corresponding to any straight line equation are within the range of the rectangle corresponding to the video playback window, the coordinates of the intersection corresponding to the straight line equation are used as the coordinates of the intersection of the straight line equation and the video playback window, and then the M groups of target control point coordinates that are adapted to the video playback window can be constructed based on the corresponding intersection coordinates. Wherein, if the horizontal coordinates of the intersection coordinates corresponding to a straight line equation are in [0, width], and the vertical coordinates of the intersection coordinates corresponding to the straight line equation are in [0, length], it is determined that the intersection coordinates corresponding to the straight line equation are within the range of the rectangle corresponding to the video playback window.

[0189] The process of adjusting the description configuration of any straight line track in the interaction configuration information is similar to the process of adjusting the description configuration of the target interaction track when the target interaction track is a straight line track. Figure 8i, which is a schematic diagram of determining a group of parallel linear trajectories provided in an embodiment of the present application; if the group of parallel linear trajectories includes 3 linear trajectories, if the first linear trajectory adapted to the video playback window is as shown in the mark 881, the vertical distance of the first linear trajectory is h=h1, if the interval distance between any two adjacent linear trajectories is g, then the vertical distance of the nth linear trajectory is: h=h1+g*(,n-1), then the second linear trajectory adapted to the video playback window can be as shown in the mark 882, and the third other interactive trajectory adapted to the video playback window can be as shown in the mark 883.

[0190] In a feasible implementation, when M=1, the trajectory type of the interactive trajectory determined by the coordinates of the M groups of control points is a straight line type, see Figure 8j , if the interactive trajectory determined by the coordinates of the M groups of control points is in a three-dimensional coordinate system, since the change of the z-axis does not affect the values ​​of x and y, if the angle between the Z-axis direction and the target interactive trajectory direction is β (β = 90°-α), if the Z-axis coordinate z0 in the starting point coordinates is known, then the Z-axis coordinate z1 in the ending point coordinates of the target interactive trajectory adapted to the video playback window can be calculated by the following formulas 3.1 and 3.2:

[0191] (z1-z0)=sqrt((x1-x0) 2 +(y1-y0) 2 +(z1-x0) 2 )*cos(β) (3.1)

[0192]

[0193] Among them, x0, y0 are respectively the X-axis coordinate and Y-axis coordinate of the starting point coordinate of the target interaction trajectory adapted to the video playback window, and x1, y1 are respectively the X-axis coordinate and Y-axis coordinate of the ending point coordinate of the target interaction trajectory adapted to the video playback window.

[0194] S708 , based on the adjusted description configuration of the target interaction trajectory, display the target interaction data according to the constraints of the target interaction trajectory.

[0195] Among them, the video playback terminal displays the relevant process of target interaction data according to the constraints of the target interaction trajectory based on the adjusted description configuration of the target interaction trajectory, which is similar to the above-mentioned description configuration based on the target interaction trajectory and the relevant process of displaying the target interaction data according to the constraints of the target interaction trajectory. That is, the video playback terminal can draw a target interaction trajectory adapted to the video playback window in the video playback window based on the adjusted description configuration of the target interaction trajectory; and control the target interaction data to be presented on the target interaction trajectory.

[0196] In an embodiment of the present application, it is possible to detect whether the target interaction trajectory determined based on the description configuration of the target interaction trajectory is compatible with the video playback window according to the size information of the video playback window, and display the target interaction data to be displayed based on the target interaction trajectory determined based on the description configuration of the target interaction trajectory when they are compatible; and adjust the description configuration of the target interaction trajectory to obtain the adjusted description configuration of the target interaction trajectory when they are not compatible, so that the target interaction trajectory determined based on the adjusted description configuration is compatible with the video playback window, and then the target interaction data can be displayed based on the target interaction trajectory that is compatible with the video playback window; the occurrence of a situation where the video playback window and the interaction trajectory are incompatible can be avoided, and the interaction trajectory that is compatible with the video playback window can be adjusted in time.

[0197] Based on the description of the above data processing method embodiment, the present application embodiment also discloses a data processing device, which can execute Figure 2 , Figure 4 or Figure 7 The steps in the method flow are shown. Fig. 9 , is a structural schematic diagram of a data processing device provided in an embodiment of the present application, the data processing device may include an acquisition unit 901 and a processing unit 902. The data processing device is used to execute the relevant processes of the above-mentioned data processing method, which can refer to the description of the above-mentioned method embodiment. For example, the acquisition unit 901 can be used to obtain preset interaction configuration information in a video playback scene; the interaction configuration information includes a description configuration of at least one interaction trajectory and an interaction event matching each interaction trajectory; the description configuration of any interaction trajectory is used to determine an interaction trajectory, and any interaction trajectory is used to constrain the motion path of the interaction data; the processing unit 902 can be used to determine a target interaction trajectory matching the target interaction event if a target interaction event is detected in the video playback scene; the acquisition unit 901 can also be used to obtain target interaction data to be displayed in the video playback scene; and, the processing unit 902 can also be used to display the target interaction data according to the constraints of the target interaction trajectory based on the description configuration of the target interaction trajectory.

[0198] According to another embodiment of the present application, Fig. 9The various units in the data processing device shown can be respectively or all combined into one or several other units to constitute, or some of the units (some) can also be split into multiple smaller units in function to constitute, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In practical applications, the function of a unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of the present application, the data processing device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.

[0199] According to another embodiment of the present application, the program can be executed by running on a general computing device such as a computer including a central processing unit (CPU), a random access memory medium (RAM), a read-only memory medium (ROM), and other processing elements and storage elements. Figure 2 , Figure 4 or Figure 7 The computer program of each step involved in the corresponding method shown in is constructed as follows Fig. 9 The data processing device shown in the figure can be used to implement the data processing method of the embodiment of the present application. The computer program can be recorded on a computer-readable storage medium, for example, and loaded into the above-mentioned computing device through the computer-readable storage medium and run therein.

[0200] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program with a predetermined function, and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0201] In an embodiment of the present application, it supports configuring corresponding interaction tracks for different interaction events that may occur in a video playback scene, so that when different interaction events are detected in the video playback scene, the interaction data can be displayed according to the constraints of the interaction tracks configured for the corresponding interaction events. This can enrich the display method of the interaction data and realize the personalized display of the interaction data under different interaction events, thereby improving the interactive experience of the video viewing object. For example, when the video viewing object watches the video to a specific plot content, the interaction data can be displayed through an interaction track adapted to the specific plot content. For example, when the video viewing object publishes specific interaction data in the process of watching the video, the published specific interaction data can be displayed through an interaction track adapted to the specific interaction data.

[0202] Based on the description of the above method embodiment and device embodiment, the present application embodiment also provides a computer device, which can be a video playback terminal or server. Fig.10 , the computer device at least includes a processor 1001, an input interface 1002, an output interface 1003 and a computer-readable storage medium 1004. The processor 1001, the input interface 1002, the output interface 1003 and the computer-readable storage medium 1004 in the computer device can be connected via a bus or other means. The computer-readable storage medium 1004 can be stored in the memory of the computer device, the computer-readable storage medium 1004 is used to store computer programs, and the processor 1001 is used to execute the computer programs stored in the computer-readable storage medium 1004. The processor 1001 (or CPU (Central Processing Unit)) is the computing core and control core of the computer device, which is suitable for running computer programs to implement corresponding method processes or corresponding functions.

[0203] In one embodiment, the processor 1001 of the embodiment of the present application can be used to implement the relevant process of displaying the above-mentioned interactive data on the interactive track.

[0204] The embodiment of the present application also provides a computer-readable storage medium (Memory), which is a memory device in a computer device for storing computer programs and data. It is understandable that the computer-readable storage medium here can include both built-in storage media in the computer device and, of course, extended storage media supported by the computer device. The computer-readable storage medium provides a storage space that stores the operating system of the computer device. In addition, a computer program is also stored in the storage space, which is suitable for being loaded and executed by the processor 1001 to implement the corresponding method flow provided in the embodiment of the present application. It should be noted that the computer-readable storage medium here can be a high-speed RAM memory, or a non-volatile memory, such as at least one disk storage; optionally, it can also be at least one computer-readable storage medium located away from the aforementioned processor.

[0205] In one embodiment, a computer program stored in a computer-readable storage medium may be loaded and executed by a processor to implement the above-mentioned Figure 2 , Figure 4 or Figure 7The corresponding steps in the method embodiment shown; in a specific implementation, the computer program in the computer-readable storage medium can be loaded by the processor and execute the following steps: in a video playback scene, obtain preset interaction configuration information; the interaction configuration information includes a description configuration of at least one interaction trajectory and an interaction event matching each interaction trajectory; the description configuration of any interaction trajectory is used to determine an interaction trajectory, and any interaction trajectory is used to constrain the motion path of the interaction data; if a target interaction event is detected in the video playback scene, determine the target interaction trajectory that matches the target interaction event; obtain the target interaction data to be displayed in the video playback scene; and, based on the description configuration of the target interaction trajectory, display the target interaction data according to the constraints of the target interaction trajectory.

[0206] In an embodiment of the present application, it supports configuring corresponding interaction tracks for different interaction events that may occur in a video playback scene, so that when different interaction events are detected in the video playback scene, the interaction data can be displayed according to the constraints of the interaction tracks configured for the corresponding interaction events. This can enrich the display method of the interaction data and realize the personalized display of the interaction data under different interaction events, thereby improving the interactive experience of the video viewing object. For example, when the video viewing object watches the video to a specific plot content, the interaction data can be displayed through an interaction track adapted to the specific plot content. For example, when the video viewing object publishes specific interaction data in the process of watching the video, the published specific interaction data can be displayed through an interaction track adapted to the specific interaction data.

[0207] The present application provides a computer program product, which includes a computer program stored in a computer-readable storage medium; a processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device performs the above Figure 2 , Figure 4 or Figure 7 It should be understood that the above disclosure is only the preferred embodiment of the present application, and certainly cannot be used to limit the scope of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope of the present application.

Claims

1. A data processing method, characterized in that: include: In the video playback scenario, obtain preset interactive configuration information; The interaction configuration information includes a description configuration of at least one interaction track and an interaction event matching each interaction track; The description configuration of any interactive trajectory is used to determine an interactive trajectory, and any interactive trajectory is used to constrain the motion path of the interactive data; The description configuration of the interactive trajectory includes: the trajectory type of the interactive trajectory, the interactive trajectory model used under the trajectory type, and at least one set of control point coordinates required to draw the interactive trajectory; one trajectory type corresponds to at least one interactive trajectory model, and various interactive trajectory models corresponding to one trajectory type are used to construct an interactive trajectory segment of the corresponding trajectory type according to at least one set of control point coordinates; a set of control point coordinates are used to indicate the shape and position of an interactive trajectory segment; If a target interaction event is detected in the video playback scene, determining a target interaction trajectory that matches the target interaction event; Acquiring target interactive data to be displayed in the video playback scene; and, Based on the description configuration of the target interaction trajectory, the target interaction trajectory is drawn in the video playback window; the target interaction data is controlled to be presented on the target interaction trajectory; the drawn target interaction trajectory is constructed based on the interaction trajectory model and control point coordinates included in the description configuration of the target interaction trajectory; Determining, according to the size information of the video playback window, an adaptation result between the target interaction trajectory determined based on the description configuration of the target interaction trajectory and the video playback window; If the adaptation result indicates that the target interaction trajectory determined based on the description configuration of the target interaction trajectory is not compatible with the video playback window, adjusting the description configuration of the target interaction trajectory according to the size information of the video playback window to obtain an adjusted description configuration of the target interaction trajectory; The step of adjusting the description configuration of the target interaction track according to the size information of the video playback window to obtain the adjusted description configuration of the target interaction track includes: According to the M groups of control point coordinates in the description configuration of the target interactive trajectory, determining the window area occupied by the interactive trajectory determined by the M groups of control point coordinates; Determining, according to the size information of the video playback window, a scaling parameter for filling the window area into the video playback window; Scaling the M groups of control point coordinates according to the scaling parameters to obtain the M groups of target control point coordinates adapted to the video playback window; The M groups of control point coordinates in the description configuration of the target interaction trajectory are updated to the M groups of target control point coordinates to obtain an adjusted description configuration of the target interaction trajectory.

2. The method according to claim 1, characterized in that The interactive event includes at least one of the following: plot content matching event, theme matching event, play time matching event, interactive data matching event, countdown event, reminder event; The plot content matching event refers to: the video being played in the video playback scene is played to a specific plot content; The theme matching event refers to: the video being played in the video playing scene is played to a specific theme; The play time matching event refers to: the play time of the video being played in the video play scene reaches the specified time; The interactive data matching event means that the target interactive data to be displayed in the video playback scene meets the preset data condition; The countdown event refers to: the video playback scene reaches the countdown node; The reminder event refers to: an event generated by the video playback scene that meets the output conditions of the reminder content; The target interaction event refers to any one of the above interaction events.

3. The method according to claim 1, characterized in that The step of drawing the target interaction track in the video playback window based on the description configuration of the target interaction track includes: Using the interactive trajectory model in the description configuration of the target interactive trajectory and the M groups of control point coordinates in the description configuration of the target interactive trajectory, construct M interactive trajectory segments, where M is a positive integer; In the video playback window, the M interactive trajectory segments are drawn to obtain the target interactive trajectory.

4. The method according to claim 1, characterized in that The controlling the target interaction data to be presented on the target interaction track includes: Determine the position coordinates of the target interaction data on the target interaction track; wherein the position coordinates include static coordinates or dynamic coordinates, and the dynamic coordinates include coordinates corresponding to multiple time points respectively; If the position coordinates are static coordinates, then displaying the target interaction data at a fixed position indicated by the static coordinates on the target interaction track; If the position coordinates are dynamic coordinates, when each time point indicated by the dynamic coordinates is reached, the target interaction data is updated and displayed at the position indicated by the coordinates corresponding to each time point on the target interaction trajectory.

5. The method according to claim 4, characterized in that The location coordinates include dynamic coordinates, the multiple time points include a first time point and a second time point that are adjacent to each other, and an arrival time of the first time point is earlier than an arrival time of the second time point; The determining the position coordinates of the target interaction data on the target interaction track includes: Obtaining the time required from the first time point to the second time point; Obtaining the moving distance required for the target interaction data to move on the target interaction track during the time period; Determining a first coordinate corresponding to the first time point on the target interaction trajectory; On the target interaction trajectory, taking the first coordinate as a reference, the position coordinates at the interval of the moving distance are determined as the second coordinates corresponding to the second time point.

6. The method according to claim 1, characterized in that The description configuration of the target interactive trajectory includes: M groups of control point coordinates required for drawing the target interactive trajectory, M is a positive integer, and any group of control point coordinates is used to draw an interactive trajectory segment adapted to the reference window; the description configuration of the target interactive trajectory also includes size information of the reference window; The step of determining, according to the size information of the video playback window, an adaptation result between the target interaction trajectory determined based on the description configuration of the target interaction trajectory and the video playback window includes: If the size information of the video playback window is the same as the size information of the reference window in the description configuration of the target interaction trajectory, generating an adaptation result indicating the adaptation between the target interaction trajectory determined based on the description configuration of the target interaction trajectory and the video playback window; Otherwise, an adaptation result is generated to indicate that there is no match between the target interaction trajectory determined based on the description configuration of the target interaction trajectory and the video playback window.

7. The method according to claim 6, characterized in that The determining, according to the M groups of control point coordinates in the description configuration of the target interactive trajectory, a window area occupied by the interactive trajectory determined by the M groups of control point coordinates comprises: Determining an interactive trajectory adapted to the reference window according to the M groups of control point coordinates in the description configuration of the target interactive trajectory; Finding the maximum value and the minimum value of the interaction track adapted to the reference window in the horizontal coordinate direction, and finding the maximum value and the minimum value of the interaction track adapted to the reference window in the vertical coordinate direction; The area formed by the determined maximum value and minimum value in the abscissa direction, and the maximum value and minimum value in the ordinate direction is taken as the window area.

8. The method according to claim 1, characterized in that M=1, the trajectory type of the interactive trajectory determined by the M groups of control point coordinates is a straight line type; the description configuration of the target interactive trajectory is adjusted according to the size information of the video playback window to obtain the adjusted description configuration of the target interactive trajectory, and further includes: Determining, according to the M groups of control point coordinates in the description configuration of the target interactive trajectory, trajectory parameters of the interactive trajectory determined by the M groups of control point coordinates; Constructing a straight line equation according to the size information of the video playback window and the trajectory parameters; Based on the size information of the video playback window, determining the coordinates of the intersection of the straight line equation and the video playback window; The determined intersection coordinates are used to construct M groups of target control point coordinates adapted to the video playback window, and the M groups of control point coordinates in the description configuration of the target interactive trajectory are updated to the M groups of target control point coordinates to obtain the adjusted description configuration of the target interactive trajectory.

9. The method according to claim 1, characterized in that The description configuration of the target interactive trajectory includes: M groups of control point coordinates required to draw the target interactive trajectory, M is a positive integer, and any group of control point coordinates is used to draw an interactive trajectory segment; the adjusted description configuration of the target interactive trajectory includes: M groups of target control point coordinates obtained by adjusting the M groups of control point coordinates; The interaction configuration information further includes: description configurations of other interaction tracks having the same track shape as the target interaction track, the other interaction tracks and the target interaction track being arranged in parallel in the video playback window; The method of obtaining the adjusted description configuration of the other interactive tracks adapted to the video playback window includes: Obtaining the interval distance and interval direction between the other interaction tracks and the target interaction track; The M groups of target control point coordinates in the adjusted description configuration of the target interaction trajectory are translated in the interval direction by the interval distance; The M groups of target control point coordinates after translation are used to replace the M groups of control point coordinates in the description configuration of the other interactive tracks, so as to obtain the adjusted description configuration of the other interactive tracks adapted to the video playback window.

10. The method according to claim 1, characterized in that The target interaction data is obtained by at least one of the following methods: Randomly selecting a piece of interactive data from the interactive data set to be displayed in the video playback scene as the target interactive data; Alternatively, selecting, from the interactive data set to be displayed in the video playback scene, interactive data whose interactive content is compatible with the target interactive event as the target interactive data; Alternatively, selecting, from the interactive data sets to be displayed in the video playback scene, interactive data whose display time matches the target interactive event as the target interactive data; Alternatively, when the interaction configuration information also includes interaction text bound to the target interaction trajectory, interaction data matching the interaction text is selected from the interaction data set to be displayed in the video playback scene as the target interaction data.

11. A data processing device, characterized in that: The device comprises: An acquisition unit is used to acquire preset interaction configuration information in a video playback scene; the interaction configuration information includes a description configuration of at least one interaction trajectory and an interaction event matching each interaction trajectory; the description configuration of any interaction trajectory is used to determine an interaction trajectory, and any interaction trajectory is used to constrain the motion path of interaction data; the description configuration of the interaction trajectory includes: the trajectory type of the interaction trajectory, the interaction trajectory model used under the trajectory type, and at least one set of control point coordinates required to draw the interaction trajectory; one trajectory type corresponds to at least one interaction trajectory model, and various interaction trajectory models corresponding to one trajectory type are used to construct an interaction trajectory segment of the corresponding trajectory type according to at least one set of control point coordinates; a set of control point coordinates is used to indicate the shape and position of an interaction trajectory segment; a processing unit, configured to determine a target interaction track matching the target interaction event if a target interaction event is detected in the video playback scene; The acquisition unit is further used to acquire target interaction data to be displayed in the video playback scene; and The processing unit is further used to draw the target interaction trajectory in the video playback window based on the description configuration of the target interaction trajectory; control the target interaction data to be presented on the target interaction trajectory; the drawn target interaction trajectory is constructed based on the interaction trajectory model and control point coordinates included in the description configuration of the target interaction trajectory; The processing unit is further configured to determine, based on the acquired size information of the video playback window, an adaptation result between the target interaction trajectory determined based on the description configuration of the target interaction trajectory and the video playback window; if the adaptation result indicates that the target interaction trajectory determined based on the description configuration of the target interaction trajectory is not compatible with the video playback window, adjust the description configuration of the target interaction trajectory according to the size information of the video playback window to obtain the adjusted description configuration of the target interaction trajectory; Among them, the processing unit, when being used to adjust the description configuration of the target interactive trajectory according to the size information of the video playback window to obtain the adjusted description configuration of the target interactive trajectory, is used to determine the window area occupied by the interactive trajectory determined by the M groups of control point coordinates according to the description configuration of the target interactive trajectory; determine the scaling parameters for filling the window area into the video playback window according to the size information of the video playback window; scale the M groups of control point coordinates according to the scaling parameters to obtain M groups of target control point coordinates adapted to the video playback window; and update the M groups of control point coordinates in the description configuration of the target interactive trajectory to the M groups of target control point coordinates to obtain the adjusted description configuration of the target interactive trajectory.

12. A computer device comprising an input interface and an output interface, characterized in that: Also includes: A processor and a computer readable storage medium; The computer readable storage medium is used to store a computer program; The processor is used to run the computer program to implement the data processing method according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and executing the data processing method according to any one of claims 1 to 10.

14. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the data processing method according to any one of claims 1 to 10 is executed.

Images