Data processing method, device, computer equipment and readable storage medium

Abstract

The embodiments of the present application provide a data processing method, apparatus, computer device, and readable storage medium. The method can be applied to various scenarios such as cloud technology, artificial intelligence, smart transportation, and video. The method includes: displaying target video data in a video application; responding to a trigger operation for a progress time point marking function in the video application, displaying annotated media data in the video application; annotating the media data as media data associated with the target progress time point corresponding to the trigger operation; responding to a confirmation operation for the annotated media data, publishing the annotated media data; and the published annotated media data having a function of indicating that the target video data is to jump to a progress point based on the target progress time point. The present application can improve the efficiency of video progress positioning.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, apparatus, computer device, and readable storage medium. Background Art

[0002] With the development of multimedia technology, video has become the primary medium for people to obtain information and enjoy entertainment in their daily lives. When a user browses comments associated with video data (e.g., target video data) and sees a comment (e.g., comment P) that interests them (i.e., resonates with or disagrees with them), they will want to watch the video clip associated with comment P in the target video data.

[0003] Currently, if a user wants to watch a video clip associated with comment P, he or she needs to actively open the target video data and manually adjust the video progress bar of the target video data according to comment P, that is, manually search for the video clip associated with comment P in the target video data. Therefore, when using the existing manual positioning method to adjust the progress of the target video data, the user needs to adjust the video progress bar multiple times, which will bring inconvenience to the user and reduce the efficiency of video progress positioning. Summary of the Invention

[0004] The embodiments of the present application provide a data processing method, apparatus, computer device, and readable storage medium, which can improve the efficiency of video progress positioning.

[0005] On the one hand, an embodiment of the present application provides a data processing method, including:

[0006] Display target video data in a video application;

[0007] In response to a trigger operation for a progress time point marking function in a video application, the marked media data is displayed in the video application; the marked media data is media data associated with the target progress time point corresponding to the trigger operation;

[0008] In response to a confirmation operation on the annotated media data, the annotated media data is published; the published annotated media data has a function of indicating that the target video data performs a progress jump based on a target progress time point.

[0009] In one aspect, an embodiment of the present application provides a data processing device, including:

[0010] A first display module, configured to display target video data in a video application;

[0011] A first response module is configured to respond to a trigger operation for a progress time point marking function in a video application and display marked media data in the video application; the marked media data is media data associated with a target progress time point corresponding to the trigger operation;

[0012] The second response module is used to respond to the confirmation operation on the marked media data and publish the marked media data; the published marked media data has the function of indicating that the target video data is to jump to the target progress time point.

[0013] The annotated media data includes annotated image data captured from the target video data;

[0014] A first response module is specifically configured to display a media image capture control associated with a progress time point marking function in a video playback interface of a video application;

[0015] The first response module is specifically configured to respond to a trigger operation on the media image capture control at a target progress time point and display the annotated image data in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point;

[0016] The second response module is specifically configured to display a media image publishing control corresponding to the annotated image data in the video application;

[0017] The second response module is specifically configured to respond to a confirmation operation on the media image publishing control and publish the annotated image data.

[0018] The annotated media data includes target comment media data and annotated text data;

[0019] A first response module is specifically configured to display a media text capture control associated with a progress time point marking function in a video playback interface of a video application;

[0020] A first response module is specifically configured to respond to a trigger operation on a media text interception control at a target progress time point, and display the annotated text data in a text annotation area of ​​the video application;

[0021] A first response module is specifically configured to respond to an input operation on the text annotation area and display the input target comment media data in the text annotation area;

[0022] The second response module is specifically configured to display a media text publishing control corresponding to the annotated text data in the video application;

[0023] The second response module is specifically used to respond to the trigger operation of the media text publishing control and publish the target comment media data and annotated text data.

[0024] The first response module is specifically configured to respond to a trigger operation on the media text capture control at a target progress time point, and obtain a target video segment corresponding to the target progress time point among K video segments associated with the target video data; K is a positive integer;

[0025] The first response module is specifically configured to use the segment attribute information of the target video segment as the annotation text data, and display the annotation text data in the text annotation area of ​​the video application.

[0026] The annotated media data includes annotated text data and annotated image data captured from the target video data;

[0027] A first response module is specifically configured to display a media image capture control associated with a progress time point marking function in a video playback interface of a video application;

[0028] The first response module is specifically configured to respond to a trigger operation on the media image capture control at a target progress time point and display the annotated image data in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point;

[0029] The second response module is specifically configured to display a media image publishing control corresponding to the annotated image data in the video application;

[0030] A second response module is specifically configured to respond to a confirmation operation on the media image publishing control and display the annotation text data and the media data publishing control in the comment annotation area of ​​the video application;

[0031] The second response module is specifically used to respond to the trigger operation of the media data publishing control and publish the annotated text data and the annotated image data.

[0032] The annotated media data includes annotated video data captured from the target video data;

[0033] A first response module is specifically configured to display a media video capture control associated with a progress time point marking function in a video playback interface of a video application;

[0034] The first response module is specifically configured to respond to a trigger operation for a media video capture control at a trigger progress time point and display the annotated video data in a video annotation area of ​​a video application; the target progress time point is used to determine an interception start time in the target video data; and the duration of the annotated video data is the interception duration associated with the progress time point annotation function;

[0035] The second response module is specifically configured to respond to a confirmation operation on the annotated video data and display a media video publishing control corresponding to the annotated video data in the video application;

[0036] The second response module is specifically used to respond to the confirmation operation of the media video publishing control and publish the marked video data.

[0037] The annotated media data includes target comment media data;

[0038] A first response module is specifically configured to display a media text capture control associated with a progress time point marking function in a video playback interface of a video application;

[0039] A first response module is specifically configured to respond to a triggering operation on a media text interception control at a target progress time point and display a text annotation area in a video application;

[0040] A first response module is specifically configured to respond to an input operation on the text annotation area and display the input target comment media data in the text annotation area;

[0041] The second response module is specifically configured to display a media text publishing control corresponding to the target comment media data in the video application;

[0042] The second response module is specifically used to respond to the trigger operation of the media text publishing control and publish the target comment media data.

[0043] The annotated media data includes target comment media data and annotated image data captured from target video data;

[0044] A first response module is specifically configured to display a media image capture control associated with a progress time point marking function in a video playback interface of a video application;

[0045] The first response module is specifically configured to respond to a trigger operation on the media image capture control at a target progress time point and display the annotated image data in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point;

[0046] The second response module is specifically configured to display a media image publishing control corresponding to the annotated image data in the video application;

[0047] A second response module is specifically configured to respond to a confirmation operation on the media image publishing control and display the media data publishing control in the comment annotation area of ​​the video application;

[0048] The second response module is specifically configured to respond to an input operation on the comment annotation area and display the input target comment media data in the comment annotation area;

[0049] The second response module is specifically used to respond to the trigger operation of the media data publishing control and publish the target comment media data and annotated image data.

[0050] Among them, the first response module is specifically used to display a comment display control associated with the progress time point marking function in the video playback interface of the video application;

[0051] The first response module is specifically used to respond to the trigger operation of the comment display control and display the comment display area in the video playback interface; the comment display area includes a comment entry area;

[0052] The first response module is specifically configured to respond to a trigger operation on the comment entry area and display a media annotation area in the video playback interface; the media annotation area includes a media annotation control;

[0053] A first response module is specifically configured to respond to a trigger operation on a media annotation control and display annotated media data in a media annotation area;

[0054] The device is further specifically configured to display the published annotated media data in the comment display area after the annotated media data is published.

[0055] The device further comprises:

[0056] A second display module is used to display the published annotated media data in the media data display interface of the video application;

[0057] The progress jump module is used to respond to the trigger operation of the released annotated media data, and in the video application, perform progress jump on the target video data based on the target progress time point.

[0058] Among them, the media data display interface is the video playback interface;

[0059] The progress jump module is specifically used to respond to the trigger operation of the annotated media data after release and determine whether the video data is being played in the playback area of ​​the video playback interface;

[0060] The progress jump module is specifically used to jump the target video data based on the target progress time point in the playback area if the video data is being played in the playback area;

[0061] The progress jump module is specifically used to refresh the video playback interface if the media data is not played in the playback area, and to perform a progress jump to the target video data based on the target progress time point in the refreshed playback area.

[0062] The progress jump module is specifically used to determine the candidate video data identifier of the video data being played in the playback area, obtain the target video data identifier of the target video data, and compare the candidate video data identifier with the target video data identifier;

[0063] The progress jump module is specifically configured to determine that the video data being played in the playback area is the target video data if the candidate video data identifier is the same as the target video data identifier, and switch the playback progress of the target video data in the playback area to the playback progress indicated by the target progress time point;

[0064] The progress jump module is specifically used to determine that the video data being played in the playback area is not the target video data if the candidate video data identifier is different from the target video data identifier, switch the video data being played in the playback area to the target video data, and start playing the target video data from the playback progress indicated by the target progress time point.

[0065] Among them, the media data display interface is the media reading interface;

[0066] The progress jump module is specifically used to respond to the trigger operation of the annotated media data after release, and switch the media reading interface to the video playback interface in the video application;

[0067] The progress jump module is specifically used to perform progress jump on the target video data based on the target progress time point in the video playback interface.

[0068] Among them, the media data display interface is the media reading interface;

[0069] The progress jump module is specifically used to respond to the trigger operation of the annotated media data after release and display the media playback sub-interface in the video application;

[0070] The progress jump module is specifically used to perform progress jump on the target video data based on the target progress time point in the media playback sub-interface.

[0071] Among them, the media data display interface is the media reading interface;

[0072] The progress jump module is specifically used to respond to the trigger operation of the annotated media data after release and display the media playback area in the media reading interface;

[0073] The progress jump module is specifically used to perform progress jump on the target video data based on the target progress time point in the media playback area.

[0074] The device is further configured to display a prompt message for the historical playback progress in the video application if the historical playback progress corresponding to the target video data is obtained;

[0075] The device is also specifically configured to respond to a triggering operation for the prompt information, and in a video application, switch the playback progress of the target video data from the playback progress indicated by the target progress time point to the historical playback progress.

[0076] The comment display area is used to display comment media data associated with the target video data; the comment display area also includes a marking function control;

[0077] The first response module is further specifically configured to respond to a trigger operation on the annotation function control and display a progress time point list in the video application; the list items in the progress time point list include progress time points associated with the comment media data; the progress time points associated with the comment media data are sorted according to the number of associated comment media data; the progress time points associated with the comment media data include candidate progress time points;

[0078] The first response module is further specifically configured to respond to a trigger operation for a candidate progress time point, and in a video application, perform a progress jump on target video data based on the candidate progress time point.

[0079] The list items in the progress time point list also include candidate media browsing controls corresponding to the candidate progress time points;

[0080] The first response module is further specifically configured to respond to a triggering operation on a candidate media viewing control and display comment media data associated with the candidate progress time point in the video application.

[0081] Among them, the first response module is specifically used to respond to the trigger operation of the media video interception control at the trigger progress time point, input the target video data into the target classification model, classify the video frames in the target video data through the target classification model, and obtain the scene classification information corresponding to the video frames in the target video data;

[0082] The first response module is specifically configured to obtain intercepted video data having an interception duration from the target video data; the progress time point of the starting video frame of the intercepted video data is equal to the trigger progress time point; the intercepted video data includes N video frames; N is a positive integer greater than 1;

[0083] The first response module is specifically configured to obtain the number M of video frames in the intercepted video data whose scene classification information is equal to the starting scene classification information; M is a positive integer less than or equal to N; the starting scene classification information refers to the scene classification information corresponding to the starting video frame in the intercepted video data;

[0084] The first response module is specifically used to obtain annotated video data with an interception duration from the target video data based on the starting scene classification information and the starting video frame of the intercepted video data if the ratio between M and N is less than the ratio threshold, and display the annotated video data in the video annotation area of ​​the video application; the progress time point of the starting video frame of the annotated video data is the target progress time point, the annotated video data includes the starting video frame of the intercepted video data, and the ratio between the number H of video frames belonging to the starting scene classification information in the annotated video data and N is greater than or equal to the ratio threshold.

[0085] The first response module is specifically configured to respond to a trigger operation on a media text interception control at a target progress time point, and send a progress time point marking instruction to the player through the publisher;

[0086] The first response module is specifically used to obtain the progress time point information corresponding to the playback progress of the target video data through the core of the player, and send the progress time point information to the progress time point data generator;

[0087] The first response module is specifically used to render the progress time point information through the progress time point data generator, obtain the rendered progress time point information, and return the rendered progress time point information to the publisher;

[0088] The first response module is specifically configured to display the annotated text data corresponding to the rendered progress time point information in the text annotation area of ​​the video application through a publisher.

[0089] The device is further specifically configured to store the published annotated media data into a media database after publishing the annotated media data;

[0090] The device is also specifically configured to call the comment media reading service when refreshing the comment display area, read the published annotated media data from the media database through the comment media reading service, and display the published annotated media data in the refreshed comment display area.

[0091] In one aspect, an embodiment of the present application provides a computer device, including: a processor and a memory;

[0092] The processor is connected to a memory, wherein the memory is used to store a computer program. When the computer program is executed by the processor, the computer device executes the method provided in the embodiment of the present application.

[0093] On the one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program is suitable for being loaded and executed by a processor so that a computer device having the processor executes the method provided by the embodiment of the present application.

[0094] In one aspect, embodiments of the present application provide a computer program product or computer program, the computer program product including a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the method provided in the embodiments of the present application.

[0095] In an embodiment of the present application, after the target video data is displayed in the video application, the computer device can respond to a trigger operation for the progress time point marking function in the video application and display the marked media data in the video application. The marked media data is the media data associated with the target progress time point corresponding to the trigger operation. Further, the computer device can respond to a confirmation operation for the marked media data and publish the marked media data. The published marked media data has the function of indicating that the target video data is to jump to the progress based on the target progress time point. It can be seen from this that the embodiment of the present application can bind the target progress time point to the marked media data to realize the association relationship between the marked media data and the target video data. Therefore, after the marked media data is published, the target video data can be jumped to the progress of the target progress time point bound to the published marked media data, that is, the playback progress of the target video data is intelligently jumped to the playback progress indicated by the target progress time point in the video application, thereby eliminating the need to manually locate the playback progress associated with the marked media data in the target video data. Instead, the efficiency of video progress positioning is improved based on the association relationship between the marked media data and the target video data. BRIEF DESCRIPTION OF THE DRAWINGS

[0096] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0097] Figure 1 This is a schematic diagram of a network architecture provided by an embodiment of the present application;

[0098] Figure 2 This is a schematic diagram of a data interaction scenario provided by an embodiment of the present application;

[0099] Figure 3 This is a flow chart of a data processing method provided in an embodiment of the present application;

[0100] Figure 4 This is a schematic diagram of a scenario for opening target video data provided by an embodiment of the present application;

[0101] Figure 5 This is a schematic diagram of a scenario for switching playback modes provided in an embodiment of the present application;

[0102] Figure 6a This is a schematic diagram of a scenario for intercepting and annotating image data provided by an embodiment of the present application;

[0103] Figure 6b This is a schematic diagram of a scenario for intercepting and annotating image data provided by an embodiment of the present application;

[0104] Figure 7a This is a schematic diagram of a scenario for generating annotated text data provided by an embodiment of the present application;

[0105] Figure 7b This is a schematic diagram of a scenario for generating annotated text data provided by an embodiment of the present application;

[0106] Figure 8 This is a schematic diagram of a scenario for intercepting and annotating video data provided by an embodiment of the present application;

[0107] Figure 9 This is a schematic diagram of a scenario for intercepting and annotating animated image data provided by an embodiment of the present application;

[0108] Figure 10a This is a schematic diagram of a scenario for publishing annotated media data provided by an embodiment of the present application;

[0109] Figure 10b This is a schematic diagram of a scenario for publishing annotated media data provided by an embodiment of the present application;

[0110] Figure 11 This is a flow chart of a data processing method provided in an embodiment of the present application;

[0111] Figure 12a This is a schematic diagram of a scenario for displaying a media annotation control provided by an embodiment of the present application;

[0112] Figure 12b This is a schematic diagram of a scenario for displaying a media annotation control provided by an embodiment of the present application;

[0113] Figure 13 This is a schematic diagram of a process for calling a half-screen publisher provided by an embodiment of the present application;

[0114] Figure 14 This is a schematic diagram of a process for generating annotated media data provided by an embodiment of the present application;

[0115] Figure 15 This is a schematic diagram of a process for publishing annotated media data provided by an embodiment of the present application;

[0116] Figure 16 This is a schematic diagram of a scenario for publishing annotated media data provided by an embodiment of the present application;

[0117] Figure 17 This is a flow chart of a data processing method provided in an embodiment of the present application;

[0118] Figure 18a This is a schematic diagram of a scenario for displaying annotated media data provided by an embodiment of the present application;

[0119] Figure 18b This is a schematic diagram of a scenario for displaying annotated media data provided by an embodiment of the present application;

[0120] Figure 19 This is a schematic diagram of a scenario for switching playback progress provided by an embodiment of the present application;

[0121] Figure 20a This is a schematic diagram of a scenario for performing progress jump provided in an embodiment of the present application;

[0122] Figure 20b This is a schematic diagram of a scenario for performing progress jump provided in an embodiment of the present application;

[0123] Figure 20c This is a schematic diagram of a scenario for performing progress jump provided in an embodiment of the present application;

[0124] Figure 20d This is a schematic diagram of a scenario for performing progress jump provided in an embodiment of the present application;

[0125] Figure 21 is a structural diagram of a data processing device provided in an embodiment of the present application;

[0126] Figure 22 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0127] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0128] Artificial Intelligence (AI) is the theory, methods, techniques, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, to perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that seeks to understand the essence of intelligence and produce new intelligent machines that can respond in a manner similar to human intelligence. AI also involves studying the design principles and implementation methods of various intelligent machines, enabling them to possess the capabilities of perception, reasoning, and decision-making.

[0129] Artificial intelligence (AI) technology is a comprehensive discipline encompassing a wide range of fields, encompassing both hardware and software technologies. Foundational AI technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, as well as machine learning / deep learning, autonomous driving, and smart transportation.

[0130] For details, see Figure 1 , Figure 1 This is a schematic diagram of a network architecture provided by an embodiment of the present application. Figure 1 As shown, the network architecture may include a server 2000 and a terminal device cluster. Specifically, the terminal device cluster may include one or more terminal devices, and the number of terminal devices in the terminal device cluster is not limited here. Figure 1 As shown, the multiple terminal devices may specifically include terminal device 3000a, terminal device 3000b, terminal device 3000c, ..., terminal device 3000n; terminal device 3000a, terminal device 3000b, terminal device 3000c, ..., terminal device 3000n can respectively be directly or indirectly connected to the server 2000 through wired or wireless communication, so that each terminal device can exchange data with the server 2000 through the network connection.

[0131] Each terminal device in the terminal device cluster may include: smart phones, tablet computers, laptop computers, desktop computers, smart home appliances (e.g., smart TVs), wearable devices, vehicle-mounted terminals, and other smart terminals with video data processing capabilities. Figure 1 Each terminal device in the terminal device cluster shown can be installed with an application client. When the application client runs in each terminal device, it can be respectively connected to the above Figure 1Data is exchanged between the servers 2000. The application client may be an independent client or an embedded sub-client integrated in a client, which is not limited in this application.

[0132] Among them, the application client can specifically include a browser, a car client, a smart home client, an entertainment client, a multimedia client (for example, a video client), a social client, and an information client, etc., which have multimedia data processing functions. In other words, the embodiment of the present application can refer to the application client as a multimedia application, and illustrate it with a video application as an example.

[0133] Among them, server 2000 can be the server corresponding to the application client. The server 2000 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, as well as big data and artificial intelligence platforms.

[0134] For ease of understanding, the embodiments of the present application can be Figure 1 Select one terminal device from the multiple terminal devices shown as the target terminal device. For example, the embodiment of the present application can Figure 1 The terminal device 3000b shown is used as the target terminal device, and a video application with a video data processing function can be installed in the target terminal device. At this time, the target terminal device can exchange data with the server 2000 through the video application.

[0135] For ease of understanding, in the embodiment of the present application, the videos that a user (for example, object Y) selects in the video recommendation interface of the video application and that suit his or her interests are collectively referred to as target videos, and the video data corresponding to the target video can be target video data. Among them, the target video here can be a long video such as a variety show, a movie, a TV series, etc., or a short video intercepted from a long video, etc., which is not limited in this application. For ease of understanding, in the embodiment of the present application, the annotated media data can be referred to as comment information associated with the target video, or the annotated media data can be referred to as a post associated with the target video. For ease of understanding, in the embodiment of the present application, the user corresponding to the video application (for example, the above-mentioned object Y) can be referred to as the target object.

[0136] It should be understood that the business scenarios applicable to the above-mentioned network framework may specifically include: entertainment program on-demand scenarios, online cinema viewing scenarios, online classroom lecture scenarios, etc. The network framework can realize the marking of target progress time points in business scenarios such as entertainment program on-demand scenarios, online cinema viewing scenarios, and online classroom lecture scenarios. The business scenarios applicable to the network framework will not be listed one by one here. For example, in the entertainment program on-demand scenario, the target video here can be the entertainment program that suits the interests of object Y in the video recommendation interface (for example, the entertainment program recommendation list). For another example, in the online cinema viewing scenario, the target video here can be the movie that suits the interests of object Y in the video recommendation interface (for example, the movie recommendation list). For another example, in the online classroom lecture scenario, the target video here can be the course that suits the interests of object Y in the video recommendation interface (for example, the course recommendation list).

[0137] It should be understood that the target terminal device can respond to the trigger operation performed by object Y for the progress time point marking function, display the annotated media data associated with the target progress time point corresponding to the trigger operation, and then publish the annotated media data. The annotated media data after publication has the function of realizing progress jump, that is, the target video data can be based on the annotated media data marked with the target progress time point for progress jump. At this time, the annotated media data can be image data (including static images and dynamic images) and video data captured in the target video data, or it can be text data corresponding to the target progress time point (that is, the playback progress of the target video at a certain moment), or it can be comment data for the target video, which is not limited here.

[0138] For further understanding, please refer to Figure 2 , Figure 2 This is a schematic diagram of a data interaction scenario provided by an embodiment of the present application. Figure 2 The server 20a shown may be the above Figure 1 The server 2000 in the corresponding embodiment is as follows: Figure 2 The terminal device 20b shown can be the above Figure 1 The target terminal device in the corresponding embodiment. Among them, the terminal device 20b has a video application installed on it, which can be used to display the target video data and the annotated media data bound to the target progress time point; the user corresponding to the terminal device 20b can be the object 20c.

[0139] like Figure 2The terminal device 20b shown can display target video data through a video application. Here, the target video data may be target video data 21a. The target video data 21a has different playback progress at different times. The playback progress of the target video data 21a at time T1 may be playback progress J1, and the playback progress of the target video data 21a at time T2 may be playback progress J2.

[0140] like Figure 2 As shown, at time T1, object 20c can trigger the progress time point marking function. Thus, terminal device 20b can respond to the trigger operation performed by object 20c on the progress time point marking function, obtain the target progress time point corresponding to the trigger operation, obtain the annotated media data associated with the target progress time point from the target video data, and then display the annotated media data in the video application. The playback progress indicated by the target progress time point can be playback progress J3, which can be the same as playback progress J1 or different from playback progress J1.

[0141] Furthermore, object 20c can perform a confirmation operation on the annotated media data. In this way, terminal device 20b can respond to the confirmation operation performed by object 20c on the annotated media data, bind the target progress time point to the annotated media data, and publish the annotated media data bound to the target progress time point. At this point, terminal device 20b can send the annotated media data to server 20a, which can then verify the legality of the annotated media data and obtain the verification result.

[0142] It is understood that if the audit result indicates that the audit is passed (i.e., the annotated media data is legal), the server 20a can store the annotated media data in the media database 21b, and return the audit result indicating that the audit is passed to the terminal device 20b. The media database 21b can be set up separately, or integrated on the server 20a, or integrated on other devices or the cloud, which is not limited here. Optionally, if the audit result indicates that the audit is not passed (i.e., the annotated media data is not legal), the server 20a does not need to store the annotated media data in the media database 21b, and returns the audit result indicating that the audit is not passed to the terminal device 20b.

[0143] Media database 21b may include multiple databases, specifically database 22a, database 22b, ..., and database 22n. Databases 22a, 22b, ..., and 22n may be used to store data associated with video applications. For example, database 22a may be used to store video data, database 22b may be used to store interactive information, ..., and database 22n may be used to store topic data. Therefore, because the annotated media data represents commentary information about the video data, server 20a may store the annotated media data in database 22a, which is used to store video data.

[0144] It is understandable that if the audit result indicating that the audit is passed is received, the terminal device 20b can determine that the annotated media data is successfully published, and display the annotated media data after publication in the media data display interface of the video application. The annotated media data after publication has the function of indicating that the target video data is progress-jumped based on the target progress time point. Figure 2 As shown, at time T2, object 20c can perform a trigger operation on the annotated media data after publication. In this way, the terminal device 20b can respond to the trigger operation performed by object 20c on the annotated media data after publication, obtain the bound target progress time point from the annotated media data, and then perform a progress jump on the target video data based on the target progress time point, that is, switch the playback progress J2 of the target video data 21a at time T2 to the playback progress J3 indicated by the target progress time point.

[0145] It should be understood that the terminal device 20b can display the annotated media data in the video application after sending the annotated media data to the server 20a and before receiving the review result returned by the server 20a. At this time, the status of the annotated media data is under review. It is understandable that if an audit result indicating that the review is passed is received, the terminal device 20a can determine that the annotated media data is successfully published. At this time, the terminal device 20a can update the status of the annotated media data under review displayed in the video application. The updated status can indicate the release time of the annotated media data. Optionally, if an audit result indicating that the review is not passed is received, the terminal device 20a can determine that the annotated media data is not successfully published. At this time, the terminal device 20a can delete the annotated media data under review displayed in the video application and display an audit prompt message. For example, the audit prompt message here can be "Comment review failed!".

[0146] It can be seen from this that the embodiment of the present application can bind the target progress time point corresponding to the trigger operation to the annotated media data when responding to the trigger operation for the progress time point marking function. The target progress time point can be used to indicate the playback progress of the target video data. Therefore, after the annotated media data is published, the target progress time point bound to the published annotated media data can be used to realize the progress jump of the target video data, that is, the playback progress of the target video data is jumped to the playback progress indicated by the target progress time point, thereby improving the efficiency of video progress positioning.

[0147] Further, see Figure 3 , Figure 3 This is a flow chart of a data processing method provided by an embodiment of the present application. The method can be executed by a server, a terminal device, or a server and a terminal device together. The server can be the above-mentioned Figure 2 The server 20a in the corresponding embodiment, the terminal device can be the above Figure 2 The terminal device 20b of the corresponding embodiment. For ease of understanding, the embodiment of the present application takes the method executed by the terminal device as an example for explanation. Among them, the data processing method may include the following steps S101-step S103:

[0148] Step S101, displaying target video data in a video application;

[0149] It can be understood that when the target object needs to watch a certain video (for example, a target video) in a video application, a trigger operation can be performed on multiple recommended videos in the video recommendation interface of the video application. In this way, the terminal device can respond to the trigger operation performed by the target object on multiple recommended videos, determine the recommended video corresponding to the trigger operation as the target video, and then send a video playback request to the server corresponding to the video application based on the video identifier of the target video, and then display and play the target video data in the video playback interface of the video application after receiving the target video data corresponding to the target video returned by the server.

[0150] For easier understanding, see Figure 4 , Figure 4 This is a schematic diagram of a scenario for opening target video data provided by an embodiment of the present application. Figure 4 The video recommendation interface 40a and video playback interface 40b shown can be interfaces of video applications at different times, wherein the video recommendation interface 40a can include multiple recommended videos, and the multiple recommended videos can specifically include: recommended video 41a, recommended video 41b, recommended video 41c and recommended video 41d.

[0151] like Figure 4As shown, object 40c can perform a trigger operation on recommended video 41b (i.e., target video 41b) among multiple recommended videos. In this way, the terminal device can respond to the trigger operation performed by object 40c on recommended video 41b and, based on the video identifier of recommended video 41b, send a video playback request to the server corresponding to the video application, and then receive the video data corresponding to recommended video 41b (i.e., target video data) returned by the server. At this time, the terminal device can switch the video recommendation interface 40a to the video playback interface 40b, and display and play the video data corresponding to recommended video 41b in the video playback interface 40b.

[0152] It is understandable that if Figure 4 The video playback interface 40b shown can be referred to as a half-screen playback interface of a video application (i.e., half-screen playback interface 40b). When the target object needs to watch the target video data in full-screen mode, a trigger operation can be performed on the screen conversion control (also known as the full-screen conversion control) in the half-screen playback interface. In this way, the terminal device can respond to the trigger operation performed by the target object on the full-screen conversion control, and display and play the target video data in the full-screen playback interface of the video application. Among them, the half-screen playback interface and the full-screen playback interface can be collectively referred to as video playback interfaces. The half-screen playback interface and the full-screen playback interface can represent different playback modes of the target video data. The half-screen playback interface and the full-screen playback interface both represent the entire interface displayed by the display screen of the terminal device, that is, the half-screen playback interface and the full-screen playback interface are both application interfaces that occupy the entire terminal screen. The size of the playback area in the half-screen playback interface is smaller than the size of the entire terminal screen, and the size of the playback area in the full-screen playback interface is equal to the size of the entire terminal screen.

[0153] For easier understanding, see Figure 5 , Figure 5 This is a schematic diagram of a scenario for switching playback modes provided by an embodiment of the present application. Figure 5 The object 51b shown may be Figure 4 The object 40c shown; Figure 5 The video playback interface 50a and the video playback interface 50b shown may be video playback interfaces of the video application at different times, wherein the video playback interface 50a may be a half-screen playback interface, and the video playback interface 50b may be a full-screen playback interface.

[0154] It is understandable that when the object 51b needs to watch the target video data in full screen mode, Figure 4The video playback interface 40b shown performs a trigger operation (for example, a click operation), so that the terminal device can respond to the trigger operation performed by the object 51b on the video playback interface 40b, display the full-screen conversion control 51a in the video playback interface 40b, and obtain the video playback interface 50a (that is, the half-screen playback interface 50a).

[0155] Further, if Figure 5 As shown, object 51b can perform a trigger operation on the full-screen conversion control 51a in the video playback interface 50a. In this way, the terminal device can respond to the trigger operation performed by object 51b on the full-screen conversion control 51a, switch the video playback interface 50a to the video playback interface 50b (i.e., the full-screen playback interface 50b), and display and play the video data corresponding to the recommended video 41b in the video playback interface 50b.

[0156] Similarly, it is understood that when the target object needs to view the target video data in half-screen mode, a trigger operation can be performed on the screen conversion control (also known as the half-screen conversion control) in the full-screen playback interface. In this way, the terminal device can respond to the trigger operation performed by the target object on the half-screen conversion control and display and play the target video data in the half-screen playback interface of the video application. The specific process of displaying the half-screen conversion control in the full-screen playback interface can be found in the description of displaying the full-screen conversion control in the half-screen playback interface above, and will not be repeated here.

[0157] Step S102, in response to a triggering operation for a progress time point marking function in the video application, displaying the marked media data in the video application;

[0158] The annotated media data is media data associated with the target progress time point corresponding to the triggering operation; the target progress time point is used to bind to the annotated media data. The annotated media data can be at least one of annotated image data, annotated video data, annotated animated image data (Graphics Interchange Format, GIF for short), annotated text data, or target comment media data. The annotated image data and annotated animated image data here can be collectively referred to as image data. Regardless of which combination of the annotated media data is, the annotated media data can always be bound to the target progress time point, that is, in subsequent steps, no matter which combination of annotated media data is triggered, the target video data can be instructed to jump to a progress based on the target progress time point.

[0159] Among them, it can be understood that when the annotated media data includes at least two data among annotated image data, annotated video data, annotated animated image data, annotated text data and target comment media data, the progress time points bound to the at least two data can be the same progress time point or different progress time points. For example, when the annotated media data includes annotated image data and annotated text data, the progress time point bound to the annotated image data and the progress time point bound to the annotated text data can be the same progress time point (i.e., the target progress time point). For another example, when the annotated media data includes two annotated image data, the progress time points bound to the two annotated image data can be different progress time points. For another example, when the annotated media data includes annotated image data and annotated video data, the progress time point bound to the annotated image data and the progress time point bound to the annotated video data can be different progress time points.

[0160] The annotated media data includes annotated image data captured from the target video data. It should be understood that the terminal device can display a media image capture control associated with the progress time point annotation function in the video playback interface of the video application. Furthermore, the terminal device can respond to a trigger operation on the media image capture control at the target progress time point and display the annotated image data in the image annotation area of ​​the video application. There is a binding relationship between the annotated image data and the target progress time point; the progress time point of the annotated image data in the target video data is the target progress time point.

[0161] For easier understanding, see Figure 6a and Figure 6b , Figure 6a and Figure 6b This is a schematic diagram of a scenario for intercepting and annotating image data provided by an embodiment of the present application. Figure 6a The following is a schematic diagram of capturing the labeled image data in the full-screen playback interface. Figure 6b The following is a schematic diagram of a scene in which annotated image data is captured in a half-screen playback interface. It is understood that in the process of capturing annotated image data in both the full-screen playback interface and the half-screen playback interface, this application supports a one-click quick screenshot operation of the currently playing video data (i.e., the target video data).

[0162] like Figure 6a The video playback interface 60a (i.e., full-screen playback interface 60a) and Figure 5 The video playback interface 50b shown can be a video playback interface of a video application at different times. The video playback interface 60a can include a media image capture control 61a. The target video data is played in the video playback interface 60a. Figure 6aAs shown, the object 61b can perform a trigger operation on the media image capture control 61a at the target progress time point. In this way, the terminal device can respond to the trigger operation performed by the object 61b on the media image capture control 61a, switch the video playback interface 60a to the media control interface 60b, and display the annotated image data 61d in the image annotation area 61c of the media control interface 60b. The annotated image data 61d here is the image data corresponding to the target video data at the target progress time point.

[0163] like Figure 6a As shown, the media control interface 60b may further include a media image saving control 62a, a media image sharing control 62b, and a media image publishing control 62c. The media image saving control 62a may be used to save the annotated image data 61d to an album on the terminal device, the media image sharing control 62b may be used to share the annotated image data 61d to platforms other than the video application, and the media image publishing control 62c may be used to publish the annotated image data 61d within the video application.

[0164] like Figure 6b The video playback interface 63a (ie, half-screen playback interface 63a) shown in FIG. Figure 4 The video playback interface 40b shown may be a video playback interface of a video application at different times. The video playback interface 63a may include a media image capture control 64b. The target video data is played in the playback area 64a of the video playback interface 63a.

[0165] like Figure 6b As shown, object 64c can perform a trigger operation on the media image screenshot control 64b at the target progress time point. In this way, the terminal device can respond to the trigger operation performed by object 64c on the media image screenshot control 64b, switch the video playback interface 63a to the video playback interface 63b, and display the annotated image data in the image annotation area 64d of the video playback interface 63b. The annotated image data here can be annotated image data 65a, and the annotated image data 65a is the image data corresponding to the target video data at the target progress time point.

[0166] Optional, such as Figure 6bAs shown, object 64c can perform a trigger operation on the media image screenshot control 64b again at the next progress time point of the target progress time point (i.e., the auxiliary progress time point). In this way, the terminal device can respond to the trigger operation performed by object 64c on the media image screenshot control 64b again, switch the video playback interface 63b to the video playback interface 63c, and display the annotated image data in the video playback interface 63c. The annotated image data here can be annotated image data 65b, and the annotated image data 65b is the image data corresponding to the target video data at the auxiliary progress time point.

[0167] like Figure 6b As shown, the video playback interface 63c may also include a media image publishing control 64e, which can be used to publish annotated image data 65a and annotated image data 65b within the video application. Similarly, the video playback interface 63b may also include a media image publishing control 64e, which can be used to publish annotated image data 65a within the video application. Therefore, this embodiment of the present application can achieve the interception of multiple annotated image data, each of which can carry a different progress time point, thereby improving the operation efficiency of the target object.

[0168] Among them, the annotated media data includes target comment media data and annotated text data. It should be understood that the terminal device can display a media text interception control associated with the progress time point annotation function in the video playback interface of the video application. Furthermore, the terminal device can respond to the trigger operation for the media text interception control at the target progress time point, and display the annotated text data in the text annotation area of ​​the video application. Among them, there is a binding relationship between the annotated text data and the target progress time point. Further, the terminal device can respond to the input operation for the text annotation area, and display the input target comment media data in the text annotation area. Optionally, the terminal device does not need to respond to the input operation for the text annotation area, but directly uses the annotated text data displayed in the text annotation area as the annotated media data.

[0169] Optionally, the terminal device may display a media text interception control associated with the progress time point annotation function in the video playback interface of the video application, and then respond to a trigger operation on the media text interception control at the target progress time point by displaying a text annotation area in the video application. Then, in response to an input operation on the text annotation area, the terminal device may display the input target comment media data in the text annotation area. In this case, the terminal device may directly use the target comment media data displayed in the text annotation area as the annotated media data, that is, the annotated media data includes the target comment media data.

[0170] Among them, the annotated text data can be text data corresponding to the target progress time point. For example, when the target progress time point is 3 minutes and 12 seconds in episode 10, the annotated text data can be "Episode 10 00:03:12", that is, this application supports annotating the episode number information and time point information (i.e., current playback progress) of the currently playing video data (i.e., target video data), wherein "Episode 10" is the episode number information of the target video data, and "00:03:12" is the time point information of the target video data. Optionally, the target video data may not include the episode number (for example, the target video data is a movie). For example, when the target progress time point is 3 minutes and 12 seconds, the annotated text data can be "00:03:12". Optionally, the terminal device can also display the annotation icon data in the text annotation area of ​​the video application in response to the trigger operation for the media text interception control, and then use the annotation icon data as the annotation text data. For example, the annotation icon data can be icons such as triangles, squares, and emoticons.

[0171] Optionally, the terminal device may respond to a trigger operation for a media text capture control at a target progress time point, and obtain a target video segment corresponding to the target progress time point in the K video segments associated with the target video data. Here, K may be a positive integer. Furthermore, the terminal device may use the segment attribute information of the target video segment as annotation text data, and display the annotation text data in the text annotation area of ​​the video application. For example, the target video segment corresponding to the target progress time point may be the first video segment among the K video segments, and the segment attribute information of the first video segment may be "festive atmosphere", so the annotation text data may be "festive atmosphere". It should be understood that the terminal device may evenly divide the target video data into K video segments by time length, or may cluster the video frames in the target video data into K video segments by similarity. The embodiment of the present application does not limit the specific method of dividing the target video data. In addition, by inputting the K video segments obtained by division into the target attribute model, the segment attribute information corresponding to the K video segments may be output. The embodiment of the present application does not limit the model type of the target attribute model.

[0172] For easier understanding, see Figure 7a and Figure 7b , Figure 7a and Figure 7b This is a schematic diagram of a scenario for generating annotated text data provided by an embodiment of the present application. Figure 7a The following is a schematic diagram of a scenario in which annotated text data is generated in a full-screen playback interface. Figure 7b The figure shows a scenario diagram of generating annotated text data in a half-screen playback interface.

[0173] like Figure 7aThe video playback interface 70a (i.e., full-screen playback interface 70a) and Figure 5 The video playback interface 50b shown may be a video playback interface of a video application at different times. The video playback interface 70a may include a media text capture control 71a. The target video data is played in the video playback interface 70a.

[0174] like Figure 7a As shown, object 71b can perform a trigger operation on the media text interception control 71a at the target progress time point. In this way, the terminal device can respond to the trigger operation performed by object 71b on the media text interception control 71a, switch the video playback interface 70a to the video playback interface 70b, and display the annotated text data 72a in the text annotation area 72b of the video playback interface 70b. The annotated text data 72a here can be "Episode 1 00:10:15".

[0175] like Figure 7a As shown, the video playback interface 70b may also include a media text publishing control 72c, which can be used to publish the annotated text data 72a within the video application. In addition, the video playback interface 70b may also include a function control 72e, which can be used to perform more detailed editing of the annotated media data. The generated annotated media data can be updated through the function control 72e.

[0176] Optional, such as Figure 7a As shown, object 71b can perform input operations on the text annotation area 72b. In this way, the terminal device can respond to the input operations performed by object 71b on the text annotation area 72b, switch the video playback interface 70b to the video playback interface 70c, and display the input target comment media data 72d in the text annotation area 72b of the video playback interface 70c. The target comment media data 72d here can be "This is too good to hear."

[0177] Similarly, if Figure 7a As shown, the video playback interface 70c may further include a media text publishing control 72c. The media text publishing control 72c may be used to publish the annotation text data 72a and the target comment media data 72d within the video application.

[0178] like Figure 7b The video playback interface 73a shown (ie, half-screen playback interface 73a) can be the above Figure 6b In the corresponding embodiment, the video playback interface 63a and the video playback interface 73a may include a media text interception control 74b. Figure 7bAs shown, object 74c can perform a trigger operation on the media text interception control 74b at the target progress time point. In this way, the terminal device can respond to the trigger operation performed by object 74c on the media text interception control 74b, switch the video playback interface 73a to the video playback interface 73b, and display the annotated text data 74e in the text annotation area 74a of the video playback interface 73b. The annotated text data 74e is the text data corresponding to the target video data at the target progress time point. The annotated text data 74e here can be "Episode 1 00:10:15".

[0179] Optionally, the object 74c can perform an input operation on the text annotation area 74a. For the specific process of the object 74c performing the input operation on the text annotation area 74a, please refer to the above Figure 7a The description of the input operation performed by the object 71b on the text annotation area 72b in the corresponding embodiment will not be repeated here. Figure 7b As shown, the video playback interface 73b may further include a media text publishing control 74d, and the media text publishing control 74d may be used to publish the annotated text data 74e within the video application.

[0180] The annotated media data includes annotated text data and annotated image data captured from the target video data. It should be understood that the terminal device can display a media image capture control associated with the progress time point annotation function in the video playback interface of the video application. Furthermore, the terminal device can respond to a trigger operation for the media image capture control at the target progress time point and display the annotated image data in the image annotation area of ​​the video application. There is a binding relationship between the annotated image data and the target progress time point; the progress time point of the annotated image data in the target video data is the target progress time point. Furthermore, the terminal device can display a media image publishing control corresponding to the annotated image data in the video application. Furthermore, the terminal device can respond to a confirmation operation for the media image publishing control and display the annotated text data in the comment annotation area of ​​the video application. There is a binding relationship between the annotated text data and the target progress time point.

[0181] Understandably, please refer to Figure 6a and Figure 7a In response to a trigger operation on the media image publishing control 62c in the media control interface 60b, the terminal device can switch the media control interface 60b to the media control interface 70b, and display the annotated text data 72a in the text annotation area 72b of the media control interface 70b. Therefore, in response to a trigger operation on the media data publishing control 72c in the media control interface 70b, the terminal device can publish the annotated text data 72a and the annotated image data 61d within the video application.

[0182] Optionally, when object 71b enters target comment media data in text annotation area 72b, the terminal device can switch media control interface 70b to media control interface 70c, and display the entered target comment media data 72d in media control interface 70c. Therefore, the terminal device can respond to the triggering operation of media data publishing control 72c in media control interface 70c and publish the annotated text data 72a, annotated image data 61d, and target comment media data 72d within the video application. In this case, the annotated media data includes the target comment media data, the annotated text data, and the annotated image data captured from the target video data.

[0183] Optional, please also see Figure 6a and Figure 7a , the terminal device can respond to the confirmation operation of the media image publishing control 62c in the media control interface 60b, and switch the media control interface 60b to the media control interface. At this time, the switched media control interface can be a media control interface 70b that does not include the annotated text data 72a. Further, when the object 71b inputs the target comment media data in the text annotation area 72b, the terminal device can display the input target comment media data 72d in the text annotation area 72b, and obtain a media control interface 70c that does not include the annotated text data 72a. Therefore, the terminal device can respond to the trigger operation of the media data publishing control 72c in the media control interface 70c, and publish the annotated image data 61d and the target comment media data 72d within the video application. At this time, the annotated media data includes the target comment media data and the annotated image data intercepted from the target video data.

[0184] The annotated media data includes annotated video data captured from the target video data. It should be understood that the terminal device can display a media video capture control associated with the progress time point annotation function in the video playback interface of the video application. Furthermore, the terminal device can respond to the trigger operation for the media video capture control at the trigger progress time point and display the annotated video data in the video annotation area of ​​the video application. There is a binding relationship between the annotated video data and the target progress time point; the target progress time point is used to determine the capture start time in the target video data; and the duration of the annotated video data is the capture duration associated with the progress time point annotation function.

[0185] It is understood that, based on the trigger progress time point, the target progress time point can be determined in the target video data, and based on the interception start time indicated by the target progress time point, the interception end time can be determined in the target video data. It should be understood that the embodiment of the present application does not limit the specific duration of the interception duration associated with the progress time point marking function. For example, the interception duration can be 30 seconds.

[0186] For easier understanding, see Figure 8 , Figure 8 This is a schematic diagram of a scenario for intercepting and annotating video data provided by an embodiment of the present application. Figure 8 The following is a schematic diagram of capturing the annotated video data in the full-screen playback interface. Figure 8 The video playback interface 80a (i.e., full-screen playback interface 80a) shown in FIG. Figure 5 The video playback interface 50b shown can be the video playback interface of the video application at different times. The video playback interface 80a includes a media video capture control 81a. It should be understood that the specific process of capturing and annotating video data in the half-screen playback interface can be found in the description of capturing and annotating video data in the full-screen playback interface, and will not be further described in this application.

[0187] like Figure 8 As shown, the object 81b can perform a trigger operation on the media video interception control 81a at the trigger progress time point. In this way, the terminal device can respond to the trigger operation performed by the object 81b on the media video interception control 81a, switch the video playback interface 80a to the media control interface 80b, and display the annotated video data 82b in the video annotation area 82a of the media control interface 80b. Here, the starting progress time point of the annotated video data 82b in the target video data is the target progress time point, and the annotated video data 82b can be automatically played in the video annotation area 82a.

[0188] It should be understood that Figure 8 The figure shows the specific process of intercepting and annotating video data in the full-screen playback interface. For the specific process of intercepting and annotating video data in the half-screen playback interface, please refer to the description of intercepting and annotating video data in the full-screen playback interface. This application will not go into details.

[0189] like Figure 8As shown, the media control interface 80b includes a media video confirmation control 81c. Object 81b can perform a trigger operation on the media video confirmation control 81c. In this way, the terminal device can respond to the trigger operation performed by object 81b on the media video confirmation control 81c and switch the media control interface 80b to the media control interface 80c. The media control interface 80c may include a media video saving control 82a, a media video sharing control 82b, and a media video publishing control 82c. Among them, the media video saving control 82a can be used to save the annotated video data 82b to the album of the terminal device, the media video sharing control 82b can be used to share the annotated video data 82b to other platforms besides the video application, and the media video publishing control 82c can be used to publish the annotated video data 82b within the video application.

[0190] It should be understood that the specific process of the terminal device publishing the annotated video data 82b based on the media video publishing control 82c can be found in the above Figure 6a The description of publishing the annotated image data 61d based on the media image publishing control 62a in the corresponding embodiment will not be repeated here.

[0191] like Figure 8 As shown, the media control interface 80b also includes a media video adjustment control 81d, which can be used to adjust the video information of the annotated video data 82b, and update the annotated video data 82b with the adjusted annotated video data 82b. The video information of the annotated video data 82b may include video duration and video position. The video duration may indicate the duration of the annotated video data 82b captured in the target video data, and the video position may indicate the start time and end time of the annotated video data 82b captured in the target video data.

[0192] The annotated media data includes annotated animated image data captured from the target video data. It should be understood that the terminal device can display a media animated image capture control associated with the progress time point annotation function in the video playback interface of the video application. Furthermore, the terminal device can respond to a trigger operation for the media animated image capture control and display the annotated animated image data in the animated image annotation area of ​​the video application. There is a binding relationship between the annotated animated image data and the target progress time point; the target progress time point is used to determine the capture start time in the target video data.

[0193] For easier understanding, see Figure 9 , Figure 9 This is a schematic diagram of a scene for intercepting and annotating animated image data provided by an embodiment of the present application. Figure 9 The media control interface 90a shown can be the above Figure 8The media control interface 80b in the corresponding embodiment, the media control interface 90a may include a media animated image capture control 91a (i.e., an animated image switching control 91a), and the object 91b may perform a trigger operation on the media animated image capture control 91a. In this way, the terminal device may respond to the trigger operation performed by the object 91b on the media animated image capture control 91a, switch the media control interface 90a to the media control interface 90b, and display the annotated animated image data 92b in the animated image annotation area 92a of the media control interface 90b. Here, the starting progress time point of the annotated animated image data 92b in the target video data is the target progress time point, and the annotated animated image data 92b may be automatically played in the animated image annotation area 92a.

[0194] It should be understood that Figure 9 The figure shows the specific process of intercepting and annotating animated image data in the full-screen playback interface. For the specific process of intercepting and annotating animated image data in the half-screen playback interface, please refer to the description of intercepting and annotating animated image data in the full-screen playback interface. This application will not go into details.

[0195] like Figure 9 As shown, the media control interface 90b can also include a video switching control 91e, and the object 91b can perform a trigger operation on the video switching control 91e. In this way, the terminal device can respond to the trigger operation performed by the object 91b on the video switching control 91e and switch the media control interface 90b back to the media control interface 90a.

[0196] like Figure 9 As shown, the media control interface 90b also includes a media dynamic image confirmation control 91c. The object 91b can perform a trigger operation on the media dynamic image confirmation control 91c. In this way, the terminal device can respond to the trigger operation performed by the object 91b on the media dynamic image confirmation control 91c and switch the media control interface 90b. The switched media control interface 90b can refer to the above Figure 8 The media control interface 80c in the corresponding embodiment will not be described in detail here. Among them, the switched media control interface 90b may include a media dynamic image publishing control. It should be understood that the specific process of the terminal device publishing the annotated dynamic image data based on the media dynamic image publishing control can be referred to in the above Figure 6a The description of publishing the annotated image data 61d based on the media image publishing control 62a in the corresponding embodiment will not be repeated here.

[0197] like Figure 9As shown, the media control interface 90b also includes a media animation adjustment control 91d, which can be used to adjust the animation information of the annotated animation data 92b, and update the annotated animation data 92b with the adjusted annotated animation data 92b. The animation information of the annotated animation data 92b may include the animation duration and the animation position. The animation duration may indicate the number of video frames of the annotated animation data 92b in the target video data, and the animation position may indicate the start time and end time of the capture of the annotated animation data 92b in the target video data.

[0198] Optional, please also see Figure 8 and Figure 9 Similar to the media video capture control 91a, the terminal device can directly display the media animated image capture control 91a (not shown in the figure) in the video playback interface 80a. The terminal device can respond to the trigger operation of the media animated image capture control 91a in the video playback interface 80a, switch the video playback interface 80a to the media control interface 90b, and display the annotated animated image data 92b in the animated image annotation area 92a of the media control interface 90b.

[0199] It should be understood that both annotated animated image data and annotated video data can represent annotated media data captured from the target video data. Annotated video data can be understood as video clips from the target video data, and annotated animated image data can be understood as dynamic images composed of key video frames from the target video data. Key video frames are obtained by extracting frames from the target video data. Furthermore, annotated video data has sound, while annotated animated image data does not.

[0200] Step S103: In response to the confirmation operation on the annotated media data, the annotated media data is published.

[0201] The released annotated media data has the function of indicating that the target video data is to be progress-jumped based on the target progress time point. The specific process of progress-jumping the target video data based on the released annotated media data can be found in the following Figure 17 Description of the corresponding embodiment.

[0202] It is understandable that if the annotated media data includes annotated image data, the terminal device can display the media image publishing control corresponding to the annotated image data in the video application. Figure 6a The media image publishing control 62c in the corresponding embodiment can also be the above Figure 6b The corresponding embodiment of the media image publishing control 64e. Further, the terminal device can respond to the confirmation operation on the media image publishing control and publish the annotated image data bound to the target progress time point.

[0203] It is understandable that if the annotated media data includes annotated text data and target comment media data, the terminal device can display the media text publishing control corresponding to the annotated text data in the video application. Figure 7a The media text publishing control 72c in the corresponding embodiment can also be the above Figure 7b The corresponding embodiment of the media text publishing control 74d. Furthermore, the terminal device can respond to a trigger operation on the media text publishing control and publish the target comment media data and the annotated text data bound to the target progress time point. The target comment media data can be media data bound to the target progress time point or media data not bound to the target progress time point, which is not limited here.

[0204] It is understandable that if the annotated media data includes annotated text data and annotated image data, the terminal device can display the annotated text data in the comment annotation area and display the media data publishing control in the comment annotation area. Figure 7a The corresponding embodiment of the media data publishing control 72c. Further, the terminal device can respond to the trigger operation on the media data publishing control and publish the annotated text data bound to the target progress time point and the annotated image data bound to the target progress time point.

[0205] It is understandable that if the annotated media data includes annotated video data, the terminal device can respond to the confirmation operation for the annotated video data (for example, respond to the triggering operation for the media video confirmation control) and display the media video publishing control corresponding to the annotated video data in the video application. Figure 8 The corresponding embodiment of the media video publishing control 82c. Further, the terminal device can respond to the confirmation operation on the media video publishing control and publish the annotated video data bound to the target progress time point.

[0206] It is understood that if the annotated media data includes annotated animated image data, the terminal device can respond to a confirmation operation on the annotated animated image data (for example, in response to a trigger operation on a media animated image confirmation control) and display a media animated image publishing control corresponding to the annotated animated image data in the video application. Furthermore, the terminal device can respond to a confirmation operation on the media animated image publishing control and publish the annotated animated image data bound to the target progress time point.

[0207] It is understood that if the annotated media data includes target comment media data, the terminal device can display the media text publishing control corresponding to the target comment media data in the video application. Furthermore, the terminal device can respond to a trigger operation on the media text publishing control and publish the target comment media data. The target comment media data can be media data bound to the target progress time point or media data not bound to the target progress time point, which is not limited here.

[0208] It is understood that if the annotated media data includes target comment media data and annotated image data, the terminal device can display the media image publishing control corresponding to the annotated image data in the video application. Furthermore, the terminal device can respond to a confirmation operation on the media image publishing control by displaying the media data publishing control in the comment annotation area of ​​the video application. Furthermore, the terminal device can respond to an input operation on the comment annotation area by displaying the input target comment media data in the comment annotation area. Furthermore, the terminal device can respond to a trigger operation on the media data publishing control by publishing the target comment media data and annotated image data.

[0209] For easier understanding, see Figure 10a and Figure 10b , Figure 10a and Figure 10b This is a schematic diagram of a scenario for publishing annotated media data provided by an embodiment of the present application. Figure 10a The following is a schematic diagram of a scenario in which annotated media data is published in the media control interface. Figure 10b The figure shows a schematic diagram of a scenario in which annotated media data is published in a video playback interface.

[0210] like Figure 10a The media control interface 100a shown can be the above Figure 6a The media control interface 60b in the corresponding embodiment can also be the above Figure 8 The media control interface 80c in the corresponding embodiment is explained here by taking the media control interface 100a as the media control interface 60b as an example. The media control interface 100a may include a media image saving control 101a, a media image sharing control 101b and a media image publishing control 101c.

[0211] like Figure 10aAs shown, object 102a can perform a trigger operation on the media image publishing control 101c, so that the terminal device can respond to the trigger operation performed by object 102a on the media image publishing control 101c, publish the annotated media data (i.e., annotated image data) displayed in the media control interface 100a, and display the publishing prompt information 102b in the media control interface 100a to obtain the media control interface 100b. Among them, the publishing prompt information 102b here can be "Published successfully, you can view the post on your personal page." It is understandable that the terminal device can respond to the trigger operation on the publishing prompt information 102b and switch the media control interface 100b to the following Figure 18b The corresponding embodiment of the media browsing interface 183c.

[0212] like Figure 10b The video playback interface 103a shown and the above Figure 7b The video playback interface 73b in the corresponding embodiment may be a video playback interface of a video application at different times, and the video playback interface 103a may include a media text publishing control 104a.

[0213] like Figure 10b As shown, object 104b can perform a trigger operation on the media text publishing control 104a, so that the terminal device can respond to the trigger operation performed by object 104b on the media text publishing control 104a, publish the annotated media data (i.e., the annotated text data and the target comment media data) displayed in the video playback interface 103a, and display the publishing prompt information 104c in the video playback interface 103a to obtain the video playback interface 103b. Among them, the publishing prompt information 104c here can be "Published successfully, you can view the post on your personal page", and the video playback interface 103b here can also be called a long bottom discussion area. It can be understood that the terminal device can respond to the trigger operation on the publishing prompt information 104c and switch the video playback interface 103b to the following Figure 18b The corresponding embodiment of the media browsing interface 183c.

[0214] like Figure 10b As shown, the video playback interface 103b also includes a media data display area 104d. The terminal device can display the annotated media data being published in the media data display area 104d. The annotated media data being published indicates that the media data is being published (i.e., under review). At this time, the server is reviewing the annotated media data. After the server has reviewed and approved the annotated media data, the "under review" displayed in the media data display area 104d can be updated to the release time of the annotated media data.

[0215] It can be seen from this that the embodiments of the present application can bind the target progress time point to the annotated media data, thereby realizing the association relationship between the annotated media data and the target video data. Therefore, after the annotated media data is published, the target video data can be progress-jumped through the target progress time point bound to the published annotated media data, that is, the playback progress of the target video data can be intelligently jumped to the playback progress indicated by the target progress time point in the video application, so that there is no need to manually locate the playback progress associated with the annotated media data in the target video data, but the efficiency of video progress positioning is improved based on the association relationship between the annotated media data and the target video data.

[0216] Further, see Figure 11 , Figure 11 This is a flow chart of a data processing method provided by an embodiment of the present application. The data processing method may include the following steps S1021-S1022, and steps S1021-S1022 are Figure 3 A specific embodiment of step S102 in the corresponding embodiment.

[0217] Step S1021: Displaying a media annotation control associated with a progress time point annotation function in the video playback interface of the video application;

[0218] It should be understood that the terminal device can display a comment display control associated with the progress time point marking function in the video playback interface of the video application. Furthermore, the terminal device can respond to a trigger operation for the comment display control and display a comment display area in the video playback interface. Among them, the comment display area includes a comment entry area, and the comment display area can also be called a discussion area, and the comment entry area can be a publishing entrance to the discussion area. Further, the terminal device can respond to a trigger operation for the comment entry area and display a media annotation area in the video playback interface. Among them, the media annotation area includes a media annotation control, and the media annotation area can also be called a post publishing page.

[0219] Among them, the media annotation control may include at least one of a media image capture control, a media text capture control, a media video capture control, or a media animated image capture control. In other words, the embodiment of the present application may collectively refer to the media image capture control, the media text capture control, the media video capture control, and the media animated image capture control as media annotation controls. Similarly, the embodiment of the present application may collectively refer to the image annotation area, the text annotation area, the comment annotation area, the video annotation area, and the animated image annotation area as media annotation areas. Similarly, the embodiment of the present application may collectively refer to the media image publishing control, the media text publishing control, the media data publishing control, the media video publishing control, and the media animated image publishing control as media publishing controls.

[0220] For easier understanding, see Figure 12a and Figure 12b , Figure 12a and Figure 12b This is a schematic diagram of a scene showing a media annotation control provided by an embodiment of the present application. Figure 12a The following is a schematic diagram of a scene showing a media annotation control in a half-screen playback interface. Figure 12b The figure shows a scene diagram of displaying media annotation controls in a full-screen playback interface.

[0221] like Figure 12a The video playback interface 120a shown and the above Figure 5 The video playback interface 50a in the corresponding embodiment can be a video playback interface for a video application at different times. The video playback interface 120a includes a comment display control 121a associated with the progress time point marking function. The object 121b can perform a trigger operation on the comment display control 121a. In this way, the terminal device can respond to the trigger operation performed by the object 121b on the comment display control 121a, switch the video playback interface 120a to the video playback interface 120b, and display the comment display area 121c in the video playback interface 120b.

[0222] The comment display area 121c can be used to display comment media data associated with the target video data, such as Figure 12a As shown, the comment media data here may include the first comment media data published by object Y1, the second comment media data replied by object Y2 to the first comment media data, and the third comment media data replied by object Y3 to the first comment media data. The first comment media data may be "AAAAAAAAAAAAAAAAAAAAAAAAAAA", the second comment media data may be "BBBBB", and the third comment media data may be "CCCCCCCC".

[0223] Among them, it can be understood that the first comment media data can be annotated media data bound to a progress time point. Similarly, the second comment media data that object Y2 replies to the first comment media data can also be annotated media data bound to a progress time point. In other words, the first comment media data has the function of instructing the target media data to perform a progress jump based on the bound progress time point (i.e., the first progress time point), and the second comment media data has the function of instructing the target media data to perform a progress jump based on the bound progress time point (i.e., the second progress time point).

[0224] like Figure 12aAs shown, the comment display area 121c also includes a comment entry area 121d, and the object 121b can perform a trigger operation on the comment entry area 121d. In this way, the terminal device can respond to the trigger operation performed by the object 121b on the comment entry area 121d, switch the video playback interface 120b to the video playback interface 120c, and display the media annotation area 121e in the video playback interface 120b.

[0225] like Figure 12a As shown, the media annotation area 121e includes a media annotation control 121f, which can include a media image capture control (i.e., a "capture stills" control) and a media text capture control (i.e., a "mark time" control). At this time, the object 121b can perform a sliding operation on the media annotation control 121f. In this way, the terminal device can respond to the sliding operation performed by the object 121b on the media annotation control 121f and display the updated media annotation control 121f in the media annotation area 121e. The updated media annotation control 121f can include a media video capture control (i.e., a "capture video" control) and a media animated image capture control (i.e., a "capture animated image" control). The terminal device can display at least one of the annotated image data, the annotated text data, the annotated video data, the annotated animated image data, or the target comment media data in the media annotation area 121e.

[0226] like Figure 12b The video playback interface 122a shown and the above Figure 5 The video playback interface 50b in the corresponding embodiment can be a video playback interface of the video application at different times, such as Figure 12b The video playback interface 122b shown can be the above Figure 6a In the corresponding embodiment, the video playback interface 60a, the object 123a can perform a trigger operation (for example, a click operation) on the video playback interface 122a. In this way, the terminal device can respond to the trigger operation performed by the object 123a on the video playback interface 122a, display the media annotation control in the video playback interface 122a, and obtain the video playback interface 122b.

[0227] The media annotation controls in the video playback interface 122b may include a media image capture control 123b and a media video annotation control 123c. The specific types of media annotation controls displayed in the video playback interface 122b are not presented here. Furthermore, the media annotation controls displayed in the video playback interface 122b may be a single control, i.e., the media image capture control 123b and the media video annotation control 123c are a single control displayed in the video playback interface 122b. Furthermore, the video playback interface 122b may also include a screen conversion control 123d (i.e., a half-screen conversion control 123d), which may be used to switch the playback mode of the target video data in the video application.

[0228] It should be understood that Figure 12a The specific process of switching from the video playback interface 121c to the video playback interface 121d (ie, step S11 to step S20) can be found in Figure 13 , Figure 13 This is a flow chart of calling a half-screen publisher provided by an embodiment of the present application. Figure 13 As shown, the terminal device can execute step S11 to start the process, and call the comment box user interface (UserInterface, UI for short) module through step S12 to display the comment entry area 121d in the comment display area 121c, and then respond to the trigger operation performed by object 121b on the comment entry area 121d (i.e., comment box 121d). In step S13, the comment box logic layer is called through the comment box user interface module, so that the comment box logic layer calls the half-screen publisher.

[0229] Among them, since the premise of time point marking is that the publishing page (i.e., the media annotation area 121e) can exist at the same time as the playback page (i.e., the playback area), it is necessary to parse and call the half-screen publisher when pulling up the publishing page in a scenario that supports marking time. The half-screen publisher can be understood as a component in the terminal device, which is used to pull up the publishing page in the terminal device.

[0230] like Figure 13 As shown, the terminal device can execute step S14, call the half-screen publisher parser through step S14 to perform parsing processing, and then execute step S15, call the half-screen publisher logic layer through step S15 to perform logic processing, and then execute step S16, call the half-screen publisher user interface submodule through step S16. The half-screen publisher user interface submodule can be understood as a user interface submodule among the multiple submodules of the half-screen publisher, and the user interface submodule can be used to display the media annotation area 121e.

[0231] Furthermore, the terminal device needs to check the terminal device network configuration in step S17 to determine whether the terminal device currently has a network connection. If the terminal device currently does not have a network connection, the terminal device can execute step S18, which denies displaying the media annotation area 121e, and ends the process. Optionally, if the terminal device currently has a network connection, the terminal device can execute step S19, which calls the time point publishing module, and displays the media annotation control 121f in the media annotation area 121e through the time point publishing module, and then executes step S20, ending the process.

[0232] Step S1022: In response to a trigger operation on the media annotation control, display the annotated media data in the media annotation area;

[0233] Specifically, if the annotated media data includes annotated text data, the terminal device can respond to the trigger operation for the media text interception control at the target progress time point, and send a progress time point annotation instruction to the player (i.e., the playback component of the video application) through the publisher (i.e., the half-screen publisher). Furthermore, the terminal device can obtain the progress time point information corresponding to the playback progress of the target video data through the player's kernel (i.e., the player kernel), and send the progress time point information to the progress time point data generator. Furthermore, the terminal device can render the progress time point information through the progress time point data generator, obtain the rendered progress time point information, and return the rendered progress time point information to the publisher. Furthermore, the terminal device can display the annotated text data corresponding to the rendered progress time point information in the text annotation area of ​​the video application through the publisher.

[0234] Among them, it can be understood that if the terminal device is playing the target video data through the player, the core of the player can directly obtain the playback progress of the target video data; optionally, if the terminal device is playing advertising data through the player, the core of the player can obtain the playback progress of the target video data that is about to be played after the advertisement ends, that is, the playback progress of the target video data is the playback progress of the first video frame in the target video data played after the advertisement ends.

[0235] It should be understood that Figure 7b The specific process of switching from the video playback interface 73a to the video playback interface 73b (ie, step S31-step S42) can be found in Figure 14 , Figure 14 This is a flow chart of generating annotated media data provided by an embodiment of the present application. Figure 14As shown, the terminal device can execute step S31 to start the process, and call the time point publishing module response object 74c through step S32 to respond to the trigger operation performed by the media text interception control 74b. At this time, data interaction is required between the player and the half-screen publisher, that is, in step S33, the time point publishing module calls the half-screen publisher logic layer to send a time point marking instruction to the player, that is, the publisher sends a progress time point marking instruction to the player.

[0236] like Figure 14 As shown, the terminal device can execute steps S34 and S35, process the progress time point marking instruction through the player framework layer and the player logic layer, and then execute step S36. Step S36 calls the player kernel to send the obtained progress time point information (i.e., episode number information and time point information) to the time point data generator. Among them, since the progress time point information is calculated in milliseconds, it is necessary to call an additional layer of time point data generator. The time point data generator renders the obtained millisecond information into hour, minute, and second progress information that can be understood by the target object (i.e., the rendered progress time point information) through step S37.

[0237] like Figure 14 As shown, the time point data generator requires a network connection or calls other services. If the time point data generator fails to successfully generate the rendered progress time point information, the terminal device may execute step S38, refuse to display the annotation text data 74e, and terminate the process. Alternatively, if the time point data generator successfully generates the rendered progress time point information, the terminal device may return the rendered progress time point information to the half-screen publisher via the time point data generator.

[0238] like Figure 14 As shown, the terminal device can execute step S39, call the half-screen publisher logic layer through step S39 to receive the progress time point information after rendering, and then call the time point user interface rendering layer through step S40 to perform interface rendering, and then call the text display through step S41 to display the annotation text data 74e in the text annotation area 74a of the video playback interface 73b, and then execute step S42 to end the process. Similarly, when displaying other annotated media data in addition to the annotated text data in the media annotation area, the terminal device can execute the following Figure 14 The process shown will not be described in detail here.

[0239] It should be understood that if the annotated media data includes annotated video data, the terminal device can respond to a trigger operation on the media video capture control at the trigger progress time point and input the target video data into a target classification model. The target classification model then classifies the video frames in the target video data to obtain scene classification information corresponding to the video frames in the target video data. Furthermore, the terminal device can obtain intercepted video data having an interception duration from the target video data. The progress time point of the starting video frame of the intercepted video data is equal to the trigger progress time point; the intercepted video data includes N video frames, where N can be a positive integer greater than 1. Furthermore, the terminal device can obtain the number M of video frames in the intercepted video data whose scene classification information equals the starting scene classification information. M can be a positive integer less than or equal to N; the starting scene classification information refers to the scene classification information corresponding to the starting video frame in the intercepted video data. Furthermore, if the ratio between M and N is less than a ratio threshold, the annotated video data having an interception duration is obtained from the target video data based on the starting scene classification information and the starting video frame of the intercepted video data, and the annotated video data is displayed in the video annotation area of ​​the video application. The progress time point of the starting video frame of the annotated video data is the target progress time point, the annotated video data includes the starting video frame of the intercepted video data, and the ratio between the number of video frames H and N in the annotated video data that belong to the starting scene classification information is greater than or equal to a ratio threshold. Optionally, if the ratio between M and N is greater than or equal to the ratio threshold, the terminal device can directly use the intercepted video data as the annotated video data.

[0240] Optionally, the terminal device can also directly use the trigger progress time point as the target progress time point, that is, directly use the intercepted video data as the annotated video data. Therefore, the embodiment of the present application can intelligently determine the target progress time point in the target video data based on the auxiliary progress time point, thereby increasing the diversity of the generated annotated video data.

[0241] Among them, the target classification model is obtained by training the initial classification model. The embodiment of the present application can train the initial network model based on the sample video frame and the sample scene classification information of the sample video frame. Specifically, the terminal device can input the sample video frame into the initial classification model, and output the predicted scene classification information of the sample video frame through the initial classification model, and then determine the model loss value of the initial classification model based on the sample scene classification information and the predicted scene classification information. The initial classification model is iteratively trained based on the model loss value, and the iteratively trained initial classification model is determined as the target classification model. It should be understood that the embodiment of the present application does not limit the model types of the initial classification model and the target classification model.

[0242] It should be understood that after publishing the annotated media data, the terminal device may display the published annotated media data in the comment display area. Specifically, after publishing the annotated media data, the terminal device may store the published annotated media data in the media database. Furthermore, when refreshing the comment display area, the terminal device may call the comment media reading service to read the published annotated media data from the media database through the comment media reading service, and display the published annotated media data in the refreshed comment display area.

[0243] It should be understood that Figure 10b The specific process of switching from the video playback interface 103a to the video playback interface 103b (ie, step S51 to step S61) can be found in Figure 15 , Figure 15 This is a flow chart of publishing annotated media data provided by an embodiment of the present application. Figure 15 As shown, the terminal device can execute step S51 to start the process, call the publisher user interface module in step S52 to display the media text publishing control 104a in the video playback interface 103a, and then call the text display response object 104b in step S53 to respond to the trigger operation performed by the media text publishing control 104a. Then, call the text parser in step S54 to parse the target comment media data, and call the time point parser in step S55 to parse the annotated text data. The text parser and the time point parser can determine whether the text in the annotated media data belongs to the target comment media data or the annotated text data.

[0244] like Figure 15 As shown, the terminal device can call the publishing data generator through step S56 to generate annotated media data containing target comment media data and annotated text data. Furthermore, the terminal device needs to call the publishing background service, and pass the publishing data to the background (i.e., the server) through the publishing background service. The server can execute step S57, and store the annotated media data in the publishing queue through step S57, and then call the publishing background through step S58 to store the annotated media data in the media database, and obtain the comment list (i.e., the list composed of comment media data) from the media database through step S60, and display the comment media data in the comment list in the video application. Among them, the annotated text data will be saved in the post storage structure (i.e., the following Figure 16 In the video database in the corresponding embodiment, when the post is displayed, the time point information (i.e., the marked text data) in the video material will be read and used for the display of the post with the time point.

[0245] At the same time, during the process of publishing the annotated text data and the target comment media data, the terminal device can call the terminal pseudo display data generator through step S59, and display the annotated media data being published (i.e., the above-mentioned pseudo display data generator) in the media data display area 104d through the terminal pseudo display data generator. Figure 10b The corresponding embodiment displays the annotated media data being published in the media data display area 104d).

[0246] For easier understanding, see Figure 16 , Figure 16 This is a schematic diagram of a scenario for publishing annotated media data provided by an embodiment of the present application. Figure 16 As shown, the target object can publish annotated media data through the terminal device. At this time, the terminal device needs to authenticate the target object to determine whether the target object has the authority to publish annotated media data, that is, to determine whether the target object has logged in to the video application.

[0247] like Figure 16 As shown, if the terminal device determines that the authentication is successful (i.e., the target object has logged into the video application), the terminal device can call the post posting service to store the annotated media data in the media database, and at the same time call the post reading service to read the comment media data from the media database for display in the terminal device. The comment media data may include the annotated media data after publication. Optionally, if the terminal device determines that the authentication is unsuccessful (i.e., the target object has not logged into the video application), the terminal device does not need to store the annotated media data.

[0248] It is understood that a video application can correspond to multiple databases, specifically including a topic database, a video database, an object database, and an interaction database. The video database can be used to store video data, the interaction database can be used to store interaction information, the object database can be used to store object data, and so on. The topic database can be used to store topic data. Interaction information can include information such as likes and comments on video data. Therefore, a terminal device can call the post posting service to store annotated media data in the video database and call the post reading service to read comment media data from the video database.

[0249] It can be understood that in this application, when it involves object information, interactive information and other related data, when the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and national standards of the country.

[0250] The comment display area is used to display comment media data associated with the target video data; the comment display area also includes a marking function control. It should be understood that the terminal device can respond to a trigger operation for the marking function control and display a progress time point list in the video application. The list items in the progress time point list include progress time points that are bound to the comment media data; the progress time points that are bound to the comment media data are sorted according to the number of bound comment media data; and the progress time points that are bound to the comment media data include candidate progress time points. In other words, the list items in the progress time point list include progress time points associated with the comment media data; the progress time points associated with the comment media data are sorted according to the number of associated comment media data; and the progress time points associated with the comment media data include candidate progress time points. Further, the terminal device can respond to a trigger operation for the candidate progress time points and, in the video application, perform a progress jump to the target video data based on the candidate progress time points.

[0251] In addition, the list items in the progress time point list also include candidate media viewing controls corresponding to the candidate progress time points. It should be understood that the terminal device can respond to a trigger operation on the candidate media viewing control and display commentary media data associated with the candidate progress time points in the video application. In other words, the terminal device can respond to a trigger operation on the candidate media viewing control and display commentary media data associated with the candidate progress time points in the video application.

[0252] It can be seen from this that the embodiment of the present application can display annotated media data in the media annotation area when responding to a trigger operation on the media annotation control in the video playback interface. The annotated media data is bound to a target progress time point. The target progress time point carried by the annotated media data enables the terminal device to quickly jump the progress of the target video data based on the target progress time point when responding to a trigger operation on the annotated media data. The progress jump can position the playback progress of the target video data to the playback progress indicated by the target progress time point, thereby improving the efficiency of video progress positioning in the movie viewing scenario.

[0253] Further, see Figure 17 , Figure 17 This is a flow chart of a data processing method provided by an embodiment of the present application. The method can be executed by a server, a terminal device, or a server and a terminal device together. The server can be the above-mentioned Figure 2 The server 20a in the corresponding embodiment, the terminal device can be the above Figure 2The terminal device 20b in the corresponding embodiment. For ease of understanding, the embodiment of the present application takes the method executed by the terminal device as an example for explanation. Among them, the data processing method may include the following steps S201-S202:

[0254] Step S201: Displaying the published annotated media data in the media data display interface of the video application;

[0255] It is understood that the media data display interface may include but is not limited to a video playback interface and a media reading interface. The specific process of the terminal device displaying the annotated media data on the media reading interface can be found in Figure 18a and Figure 18b , Figure 18a and Figure 18b This is a schematic diagram of a scenario for displaying annotated media data provided by an embodiment of the present application. In addition, the specific process of displaying annotated media data in the video playback interface of the terminal device can be found in the above Figure 10b .

[0256] like Figure 18a The video recommendation interface 180a shown can be the above Figure 4 In the corresponding embodiment, the video recommendation interface 40a and the video recommendation interface 180a may include a media data viewing control 181a, and the object 181b may perform a trigger operation on the media data viewing control 181a. In this way, the terminal device may respond to the trigger operation performed by the object 181b on the media data viewing control 181a and switch the video recommendation interface 180a to the media viewing interface 180b.

[0257] like Figure 18a As shown, the media reading interface 180b may include comment media data 182a (the comment media data 182a may also be referred to as annotated media data 182a), and the comment media data 182a may include annotated text data 182b, where the annotated text data 182b may be "Episode 12 0:01:19", and the annotated text data 182b may be used to execute the following step S202. In addition, the media reading interface 180b may also include media topic information 182c, and the media topic information 182c may be used to switch the display interface of the terminal device from the media reading interface 180b to other media reading interfaces, and other media reading interfaces may be used to display other comment media data, which will not be described in detail here. In addition, the media reading interface 180b may also include a circle viewing control 182d, and the circle viewing control 182d may be used to switch the display interface of the terminal device from the media reading interface 180b to other media reading interfaces (i.e., circle reading interfaces), and circle reading interfaces may be used to display other comment media data, which will not be described in detail here.

[0258] Among them, it is understandable that Figure 18a The media reading interface 180b shown can be used to display the comment media data distributed by the server for the target object (i.e., object 181b). The server can generate the comment media data pushed to the target object based on the progress time point, that is, the progress time point can be used as the distribution basis of the comment media data in the video community (video devices including but not limited to squares, topic pages, circle pages, personal pages, etc.). Among them, squares, topic pages, circle pages, and personal pages can be collectively referred to as media reading interfaces. Squares can be Figure 18a The media browsing interface 180b shown in the figure can be Figure 18b The body reading interface 183c shown, the topic page can be other media reading interfaces displayed in response to a trigger operation performed on the media topic information 182c, and the circle page can be other media reading interfaces displayed in response to a trigger operation performed on the circle viewing control 182d.

[0259] like Figure 18b The video recommendation interface 183a shown can be the above Figure 18a The video recommendation interface 180a in the corresponding embodiment and the video recommendation interface 183a may include an information viewing control 184a, and the object 184b may perform a trigger operation on the information viewing control 184a. In this way, the terminal device may respond to the trigger operation performed by the object 184b on the information viewing control 184a and switch the video recommendation interface 183a to the information reading interface 183b.

[0260] like Figure 18b As shown, the information reading interface 183b can be used to display the reading records and interactive information of the object 184b in the video application. The information reading interface 183b can include a dynamic viewing control 184c. The object 184b can perform a trigger operation on the dynamic viewing control 184c. In this way, the terminal device can respond to the trigger operation performed by the object 184b on the dynamic viewing control 184c and switch the information reading interface 183b to the media reading interface 183c.

[0261] like Figure 18b As shown, media viewing interface 183c may include comment media data 185a (this comment media data 185a may also be referred to as annotated media data 185a), which may include annotated text data 185b. Here, annotated text data 185b may be "Episode 1 0:10:15." Annotated text data 185b may be used to execute step S202 below. Furthermore, media viewing interface 183c may also be used to display other comment media data. The comment media data displayed in media viewing interface 183c is all published by object 184b in the video application.

[0262] Step S202 : In response to a trigger operation on the published annotated media data, in a video application, a progress jump is performed on the target video data based on a target progress time point.

[0263] It should be understood that after the target video data is progress-jumped based on the target progress time point, if the historical playback progress corresponding to the target video data is obtained, the terminal device can display a prompt message for the historical playback progress in the video application. The historical playback progress can represent the playback progress of the target object for the target video data at a historical moment, and the historical playback progress can be stored in the terminal device or in the server. Furthermore, the terminal device can respond to a trigger operation for the prompt message and switch the playback progress of the target video data from the playback progress indicated by the target progress time point to the historical playback progress in the video application.

[0264] If the terminal device does not respond to the triggering operation for the prompt message within the target time period after displaying the prompt message, the prompt message can be canceled in the video application. In other words, the prompt message will continue to be displayed in the video application for a period of time, which is the above-mentioned target time period. It should be understood that the embodiment of the present application does not limit the specific length of the target time period. For example, the target time period can be 30 seconds.

[0265] It is understandable that when the target object consumes the annotated media data, it can quickly locate the episode number and time progress of the corresponding target video data and start playing through the trigger operation of the released annotated media data. During the playback of the main film, this application supports progress control of the player in the playback scenario (i.e., adjusting the playback progress).

[0266] Among them, the media data display interface can be a video playback interface. It should be understood that the terminal device can respond to the trigger operation for the annotated media data after release to determine whether the video data is being played in the playback area of ​​the video playback interface. Furthermore, if the video data is being played in the playback area, the terminal device can perform a progress jump to the target video data in the playback area based on the target progress time point. Optionally, if the media data is not being played in the playback area, the terminal device can refresh the video playback interface and perform a progress jump to the target video data in the refreshed playback area based on the target progress time point.

[0267] Among them, it can be understood that the terminal device can determine the candidate video data identifier of the video data being played in the playback area, obtain the target video data identifier of the target video data, and compare the candidate video data identifier with the target video data identifier. Further, if the candidate video data identifier is the same as the target video data identifier, the terminal device can determine that the video data being played in the playback area is the target video data, and switch the playback progress of the target video data in the playback area to the playback progress indicated by the target progress time point. Optionally, if the candidate video data identifier is different from the target video data identifier, the terminal device determines that the video data being played in the playback area is not the target video data, switches the video data being played in the playback area to the target video data, and starts playing the target video data from the playback progress indicated by the target progress time point.

[0268] For easier understanding, see Figure 19 , Figure 19 This is a schematic diagram of a scenario for switching playback progress provided by an embodiment of the present application. Figure 19 As shown, the terminal device can enter the post stream with episode time (i.e., comment media data) through step S71, that is, the terminal device can display the annotated media data after publication in the media data display interface of the video application. Further, when the target object clicks on the episode time through step S72, that is, when the target object clicks on the annotated media data after publication, the terminal device can execute step S73, and determine whether the progress needs to be switched through step S73, that is, determine the type of media data display interface.

[0269] It is understandable that if the media data display interface is a video playback interface, the terminal device does not need to switch interfaces and then executes step S77; if the media data display interface is a media reading interface, the terminal device needs to switch interfaces and then executes step S74. Figure 19 As shown, if the media data display interface is a media reading interface, the terminal device can determine whether it can jump to the link through step S74. Among them, if the terminal device can jump to the link, it jumps to the play page through step S76, that is, switches the media reading interface to the video playback interface, and then switches the progress in the player of the video playback interface through step S81. Optionally, if the terminal device cannot jump to the link, the process ends through step S75. At this time, the terminal device does not need to make any response to the triggering operation of step S72, or display a prompt message indicating that the jump was unsuccessful in the video application.

[0270] like Figure 19As shown, if the media data display interface is a video playback interface, the terminal device can determine whether there is a video identifier in step S77, that is, determine whether video data is being played in the playback area of ​​the video playback interface. Further, if the terminal device determines that there is a video identifier, the terminal device can execute step S79; optionally, if the terminal device determines that there is no video identifier, the terminal device can refresh the entire playback page in step S78, that is, refresh the video playback interface, and switch the progress in the refreshed playback area in step S81. In particular, since the playback service provided by the video application may have problems at a certain moment, the video application may not have a video identifier at that moment.

[0271] like Figure 19 As shown, the terminal device can determine whether the video identifiers are consistent through step S79, that is, determine whether the candidate video data identifier of the video data being played in the video playback interface is consistent with the target video data identifier of the target video data. If the candidate video data identifier and the target video data identifier are consistent, the terminal device can switch the progress in the player of the video playback interface through step S81, that is, switch the playback progress of the target video data in the playback area to the playback progress indicated by the target progress time point; optionally, if the candidate video data identifier and the target video data identifier are inconsistent, the terminal device can switch the video identifier through S80, and switch the progress in the player of the video playback interface through step S81, that is, switch the video data being played in the playback area to the target video data, and start playing the target video data from the playback progress indicated by the target progress time point.

[0272] In other words, if Figure 19 As shown, the terminal device can first determine whether it is currently in the playback scene through step S73. If it is not in the playback scene, it will directly jump to the main film playback page (i.e., the video playback interface) and switch to the corresponding progress. If it is in the playback scene, it will continue to determine whether there is a main film playing at present through step S77. Among them, if there is no main film playing, the playback page will be refreshed directly to switch the playback progress. If there is a main film playing, it will be determined through step S79 whether the main film information (i.e., the target video data identifier of the target video data) at the clicked time point is consistent with the main film information currently playing (i.e., the candidate video data identifier of the video data currently playing). Among them, if the candidate video data identifier and the target video data identifier are inconsistent, the main film playback is switched to achieve the effect of anchoring the time point. If the candidate video data identifier and the target video data identifier are consistent, the progress of the current player is directly switched.

[0273] The specific process of the terminal device to realize the progress jump in the video playback interface can be found in Figure 20a , Figure 20a This is a schematic diagram of a scenario for progress jump provided by an embodiment of the present application. Figure 20a The video playback interface 200a shown and the above Figure 10b The video playback interface 103b in the corresponding embodiment may be a video playback interface of a video application at different times, and the playback progress of the target video data in the video playback interface 200a is different from the playback progress of the target video data in the video playback interface 103b.

[0274] like Figure 20a As shown, the video playback interface 200a includes a playback area 201d, in which the target video data is played. The video playback interface 200a also includes annotated media data, which includes annotated text data 201a. The object 201b can perform a trigger operation on the annotated text data 201a. In this way, the terminal device can respond to the trigger operation performed by the object 201b on the annotated text data 201a, and in the playback area 201d, the target video data is jumped in progress based on the target progress time point indicated by the annotated text data 201a.

[0275] At this time, the terminal device can switch the video playback interface 200a to the video playback interface 200b, the playback progress of the target video data in the video playback interface 200a is the playback progress 202a, and the playback progress of the target video data in the video playback interface 200b is the playback progress 202c, and the playback progress 202c is the playback progress indicated by the annotated text data 201a.

[0276] Among them, it can be understood that when the terminal device responds to the trigger operation performed by the object 201b on the annotated text data 201a, if the video application has a playback record for the target video data, at this time, the terminal device will overwrite the original viewing progress of the target video data with the playback progress 202c indicated by the annotated text data 201a. In addition, the terminal device can also display a prompt message 201c in the playback area 201d to ensure that it does not affect the original playback history record (i.e., historical playback progress) of the target object in the video application, and supports the target object to quickly browse the plot content corresponding to the target progress time point and continue to play the historical playback progress, thereby ensuring the smooth viewing of the target object. The prompt message 201c here can be "Return to the previous progress X". Optionally, if the video application does not have a historical playback progress for the target video data, the terminal device does not need to display a prompt message 201c for the original viewing progress in the playback area 201d.

[0277] The media data display interface may be a media viewing interface. It should be understood that the terminal device may, in response to a trigger operation on the published annotated media data, switch the media viewing interface to a video playback interface within the video application. Furthermore, the terminal device may, within the video playback interface, jump to the target video data based on the target progress time point.

[0278] The specific process of the terminal device to realize the progress jump in the media reading interface can be found in Figure 20b , Figure 20b This is a schematic diagram of a scenario for progress jump provided by an embodiment of the present application. Figure 20b The media browsing interface 203a shown can be the above Figure 18b In the corresponding embodiment, the media reading interface 183c includes annotated media data in the media reading interface 203a, and the annotated media data includes annotated text data 204a. The object 204b can perform a trigger operation on the annotated text data 204a. In this way, the terminal device can respond to the trigger operation performed by the object 204b on the annotated text data 204a, switch the media reading interface 203a to the video playback interface 203b, and in the playback area 204c of the video playback interface 203b, perform a progress jump to the target video data based on the target progress time point indicated by the annotated text data 204a.

[0279] The target video data's playback progress in video playback interface 203b is playback progress 204d, which is the playback progress indicated by annotation text data 204a. Furthermore, the terminal device may display prompt information 204e in playback area 204c. Prompt information 204e may include "Last watched episode 12 at 23:45. Continue watching." Optionally, if the video application does not have a historical playback progress for the target video data, the terminal device does not need to display prompt information 204e regarding the previous viewing progress in playback area 204c.

[0280] Among them, the media data display interface can be a media reading interface. It should be understood that the terminal device can respond to the trigger operation for the annotated media data after release and display the media playback sub-interface in the video application. Furthermore, the terminal device can perform progress jumps on the target video data based on the target progress time point in the media playback sub-interface. In other words, the terminal device can play the complete target video data based on the target progress time point in the media playback sub-interface. Optionally, when the annotated media data is annotated video data or annotated animated image data, the terminal device can play the annotated video data or the annotated animated image data in the media playback interface.

[0281] The specific process of the terminal device to realize the progress jump in the media reading interface can be found in Figure 20c, Figure 20c This is a schematic diagram of a scenario for progress jump provided by an embodiment of the present application. Figure 20c The media browsing interface 205a shown can be the above Figure 20b In the corresponding embodiment, the media viewing interface 203a includes annotated media data in the media viewing interface 205a, which includes annotated text data 206a. An object 206b can perform a trigger operation on the annotated text data 206a. In this way, the terminal device can respond to the trigger operation performed by the object 206b on the annotated text data 206a and display a media playback sub-interface 206c independent of the media viewing interface 205a in the video application. In the media playback sub-interface 206c, the target video data is redirected based on the target progress time point indicated by the annotated text data 206a, resulting in the media viewing interface 205b. In this case, the terminal device does not need to display a prompt message regarding the historical playback progress in the video application.

[0282] Furthermore, the media playback sub-interface 206c may include an interface closing control 206d. After watching the video clip corresponding to the annotated text data 206a, the object 206b may perform a trigger operation on the interface closing control 206d. In this way, the terminal device may respond to the trigger operation performed by the object 206b on the interface closing control 206d and close the media playback sub-interface 206c in the media reading interface 205b, thereby allowing the object 206b to continue browsing the comment media data in the media reading interface 205a. Optionally, the media playback sub-interface 206c may also include an interface opening control 206e. The terminal device may respond to the trigger operation performed by the object 206b on the interface opening control 206e and switch the media reading interface 205b to the above Figure 20b The corresponding video playback interface 203b in the embodiment.

[0283] Among them, the media data display interface can be a media reading interface. It should be understood that the terminal device can respond to the trigger operation for the annotated media data after release and display the media playback area in the media reading interface. Furthermore, the terminal device can perform a progress jump to the target video data based on the target progress time point in the media playback area. In other words, the terminal device can play the complete target video data based on the target progress time point in the media playback area. Optionally, when the annotated media data is annotated video data or annotated animated image data, the terminal device can play the annotated video data or the annotated animated image data in the media playback area.

[0284] The specific process of the terminal device to realize the progress jump in the media reading interface can be found in Figure 20d , Figure 20dThis is a schematic diagram of a scenario for progress jump provided by an embodiment of the present application. Figure 20c The media browsing interface 207a shown can be the above Figure 20b In the corresponding embodiment, the media viewing interface 203a includes annotated media data in the media viewing interface 207a, which includes annotated text data 208a. An object 208b can perform a trigger operation on the annotated text data 208a. In this way, the terminal device can respond to the trigger operation performed by object 208b on the annotated text data 208a and display a media playback area 208c in the media viewing interface 207a. Then, in the media playback area 208c, the target video data is redirected based on the target progress time point indicated by the annotated text data 208a, resulting in the media viewing interface 207b. In this case, the terminal device does not need to display a prompt message regarding the historical playback progress in the video application.

[0285] Furthermore, the media playback area 208c may also include an area closing control 208d. After watching the video clip corresponding to the annotated text data 208a, the object 208b may perform a trigger operation on the area closing control 208d. In this way, the terminal device may respond to the trigger operation performed by the object 208b on the area closing control 208d and close the media playback area 208c in the media reading interface 207b, thereby allowing the object 208b to continue browsing the comment media data in the media reading interface 207a. Optionally, the media playback area 208c may also include an area opening control 208e. The terminal device may also respond to the trigger operation performed by the object 208b on the area opening control 208e to switch the media reading interface 207b to the above-mentioned area opening control 208e. Figure 20b The corresponding video playback interface 203b in the embodiment.

[0286] It is understandable that the above Figure 20a 、 Figure 20b 、 Figure 20c and Figure 20d The corresponding embodiment is that the annotated media data after publication includes annotated text data (ie Figure 20a The annotation text data 201a in the corresponding embodiment, Figure 20b The annotation text data 204a in the corresponding embodiment, Figure 20c The annotated text data 206a in the corresponding embodiment, and Figure 20d The annotated text data 208a) in the corresponding embodiment is used as an example to illustrate that the annotated media data after publication can also be target comment media data, annotated image data, annotated video data or annotated animated image data. When the terminal device responds to the trigger operation for the target comment media data, annotated image data, annotated video data or annotated animated image data, it can also achieve the same as the above. Figure 20a 、 Figure 20b 、 Figure 20c and Figure 20d The same effects as those of the corresponding embodiments.

[0287] Thus, the embodiment of the present application can display the annotated media data after publishing the annotated media data in the media data display interface of the media application. In this way, when responding to the trigger operation for the annotated media data after publishing, the terminal device can jump to the target media data based on the target progress time point in the media application. Therefore, the embodiment of the present application can realize the discussion of the plot point through the annotated media data during the playback of the target video data, and when consuming the annotated media data, it can quickly jump to the playback progress indicated by the annotated media data, thereby ensuring the accuracy of the video progress positioning while improving the efficiency of the video progress positioning. Among them, for the publishing side, it can help the target object's expression to be more focused and accurate, realize the linkage between the plot in the frame and the discussion outside the frame, and improve the publication penetration rate and completion rate; for the consumer side, it can make the discussion area content more closely integrated with the feature film (i.e., the target video data) and the plot, realize the expansion of consumption based on the viewing behavior, provide more abundant reasons for users to visit the long-bottom discussion area and improve the duration and community interaction rate. In addition, the embodiment of the present application can also improve the user experience while improving the user's sense of belonging to the platform and the use of stickiness, thereby improving the user's interaction rate for the target video data.

[0288] Further, see Figure 21 , Figure 21 1 is a structural diagram of a data processing device provided in an embodiment of the present application. The data processing device 1 may include: a first display module 11, a first response module 12, and a second response module 13; further, the data processing device 1 may also include: a second display module 14 and a progress jump module 15;

[0289] A first display module 11 is used to display target video data in a video application;

[0290] A first response module 12 is configured to respond to a trigger operation for a progress time point marking function in a video application and display marked media data in the video application; the marked media data is media data associated with a target progress time point corresponding to the trigger operation;

[0291] The second response module 13 is used to respond to the confirmation operation on the marked media data and publish the marked media data; the published marked media data has the function of indicating the target video data to jump to the target progress time point.

[0292] The annotated media data includes annotated image data captured from the target video data;

[0293] A first response module 12 is specifically configured to display a media image capture control associated with a progress time point marking function in a video playback interface of a video application;

[0294] The first response module 12 is specifically configured to respond to a triggering operation on the media image capture control at a target progress time point and display the annotated image data in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point;

[0295] The second response module 13 is specifically configured to display a media image publishing control corresponding to the annotated image data in the video application;

[0296] The second responding module 13 is specifically configured to respond to a confirmation operation on the media image publishing control and publish the annotated image data.

[0297] The annotated media data includes target comment media data and annotated text data;

[0298] A first response module 12 is specifically configured to display a media text capture control associated with a progress time point marking function in a video playback interface of a video application;

[0299] A first response module 12 is specifically configured to respond to a triggering operation on a media text interception control at a target progress time point, and display the annotated text data in a text annotation area of ​​the video application;

[0300] The first response module 12 is specifically configured to respond to an input operation on the text annotation area and display the input target comment media data in the text annotation area;

[0301] The second response module 13 is specifically configured to display a media text publishing control corresponding to the annotated text data in the video application;

[0302] The second response module 13 is specifically configured to respond to a triggering operation on the media text publishing control and publish the target comment media data and the annotated text data.

[0303] The first response module 12 is specifically configured to respond to a trigger operation on the media text capture control at a target progress time point, and obtain a target video segment corresponding to the target progress time point among K video segments associated with the target video data; K is a positive integer;

[0304] The first responding module 12 is specifically configured to use the segment attribute information of the target video segment as the annotation text data, and display the annotation text data in the text annotation area of ​​the video application.

[0305] The annotated media data includes annotated text data and annotated image data captured from the target video data;

[0306] A first response module 12 is specifically configured to display a media image capture control associated with a progress time point marking function in a video playback interface of a video application;

[0307] The first response module 12 is specifically configured to respond to a triggering operation on the media image capture control at a target progress time point and display the annotated image data in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point;

[0308] The second response module 13 is specifically configured to display a media image publishing control corresponding to the annotated image data in the video application;

[0309] The second response module 13 is specifically configured to respond to a confirmation operation on the media image publishing control and display the annotation text data and the media data publishing control in the comment annotation area of ​​the video application;

[0310] The second response module 13 is specifically configured to respond to a triggering operation on the media data publishing control and publish the annotated text data and the annotated image data.

[0311] The annotated media data includes annotated video data captured from the target video data;

[0312] A first response module 12 is specifically configured to display a media video capture control associated with a progress time point marking function in a video playback interface of a video application;

[0313] The first response module 12 is specifically configured to respond to a trigger operation for a media video capture control at a trigger progress time point and display the annotated video data in a video annotation area of ​​a video application; the target progress time point is used to determine an interception start time in the target video data; and the duration of the annotated video data is the interception duration associated with the progress time point annotation function;

[0314] The second response module 13 is specifically configured to respond to a confirmation operation on the annotated video data and display a media video publishing control corresponding to the annotated video data in the video application;

[0315] The second response module 13 is specifically configured to respond to a confirmation operation on the media video publishing control and publish the annotated video data.

[0316] The annotated media data includes target comment media data;

[0317] A first response module 12 is specifically configured to display a media text capture control associated with a progress time point marking function in a video playback interface of a video application;

[0318] A first response module 12 is specifically configured to respond to a triggering operation on a media text interception control at a target progress time point and display a text annotation area in a video application;

[0319] The first response module 12 is specifically configured to respond to an input operation on the text annotation area and display the input target comment media data in the text annotation area;

[0320] The second response module 13 is specifically configured to display a media text publishing control corresponding to the target comment media data in the video application;

[0321] The second response module is specifically used to respond 13 to the trigger operation of the media text publishing control and publish the target comment media data.

[0322] The annotated media data includes target comment media data and annotated image data captured from target video data;

[0323] A first response module 12 is specifically configured to display a media image capture control associated with a progress time point marking function in a video playback interface of a video application;

[0324] The first response module 12 is specifically configured to respond to a triggering operation on the media image capture control at a target progress time point and display the annotated image data in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point;

[0325] The second response module 13 is specifically configured to display a media image publishing control corresponding to the annotated image data in the video application;

[0326] The second response module 13 is specifically configured to respond to a confirmation operation on the media image publishing control and display the media data publishing control in the comment annotation area of ​​the video application;

[0327] The second response module 13 is specifically configured to respond to an input operation on the comment annotation area and display the input target comment media data in the comment annotation area;

[0328] The second response module 13 is specifically configured to respond to a triggering operation on the media data publishing control and publish the target comment media data and the annotated image data.

[0329] The first response module 12 is specifically configured to display a comment display control associated with the progress time point marking function in the video playback interface of the video application;

[0330] The first response module 12 is specifically configured to respond to a triggering operation on the comment display control and display a comment display area in the video playback interface; the comment display area includes a comment entry area;

[0331] The first response module 12 is specifically configured to respond to a trigger operation on the comment entry area and display a media annotation area in the video playback interface; the media annotation area includes a media annotation control;

[0332] A first response module 12 is specifically configured to respond to a triggering operation on the media annotation control and display the annotated media data in the media annotation area;

[0333] The data processing device 1 is further specifically configured to display the published annotated media data in the comment display area after the annotated media data is published.

[0334] The comment display area is used to display comment media data associated with the target video data; the comment display area also includes a marking function control;

[0335] The first response module 12 is further specifically configured to respond to a trigger operation on the annotation function control and display a progress time point list in the video application; the list items in the progress time point list include progress time points associated with the comment media data; the progress time points associated with the comment media data are sorted according to the number of associated comment media data; the progress time points associated with the comment media data include candidate progress time points;

[0336] The first response module 12 is further specifically configured to respond to a trigger operation on a candidate progress time point, and in a video application, perform a progress jump on the target video data based on the candidate progress time point.

[0337] The list items in the progress time point list also include candidate media browsing controls corresponding to the candidate progress time points;

[0338] The first response module 12 is further specifically configured to respond to a triggering operation on a candidate media viewing control and display comment media data associated with the candidate progress time point in the video application.

[0339] The first response module 12 is specifically configured to respond to a trigger operation on the media video capture control at a trigger progress time point, input the target video data into a target classification model, classify the video frames in the target video data using the target classification model, and obtain scene classification information corresponding to the video frames in the target video data;

[0340] The first response module 12 is specifically configured to obtain intercepted video data having an interception duration from the target video data; the progress time point of the starting video frame of the intercepted video data is equal to the trigger progress time point; the intercepted video data includes N video frames; N is a positive integer greater than 1;

[0341] The first response module 12 is specifically configured to obtain the number M of video frames in the intercepted video data whose scene classification information is equal to the starting scene classification information; M is a positive integer less than or equal to N; the starting scene classification information refers to the scene classification information corresponding to the starting video frame in the intercepted video data;

[0342] The first response module 12 is specifically used to obtain annotated video data with an interception duration from the target video data according to the starting scene classification information and the starting video frame of the intercepted video data if the ratio between M and N is less than the ratio threshold, and display the annotated video data in the video annotation area of ​​the video application; the progress time point of the starting video frame of the annotated video data is the target progress time point, the annotated video data includes the starting video frame of the intercepted video data, and the ratio between the number H of video frames belonging to the starting scene classification information in the annotated video data and N is greater than or equal to the ratio threshold.

[0343] The first response module 12 is specifically configured to respond to a trigger operation on a media text interception control at a target progress time point, and send a progress time point marking instruction to the player through a publisher;

[0344] The first response module 12 is specifically configured to obtain the progress time point information corresponding to the playback progress of the target video data through the core of the player, and send the progress time point information to the progress time point data generator;

[0345] The first response module 12 is specifically configured to render the progress time point information through the progress time point data generator to obtain the rendered progress time point information, and return the rendered progress time point information to the publisher;

[0346] The first response module 12 is specifically configured to display the annotated text data corresponding to the rendered progress time point information in the text annotation area of ​​the video application through a publisher.

[0347] The data processing device 1 is further configured to store the published annotated media data in the media database after publishing the annotated media data;

[0348] The data processing device 1 is also specifically used to call the comment media reading service when refreshing the comment display area, read the published annotated media data from the media database through the comment media reading service, and display the published annotated media data in the refreshed comment display area.

[0349] Optionally, a second display module 14 is configured to display the published annotated media data in the media data display interface of the video application;

[0350] The progress jump module 15 is used to respond to the trigger operation on the published annotated media data and, in the video application, perform progress jump on the target video data based on the target progress time point.

[0351] Among them, the media data display interface is the video playback interface;

[0352] The progress jump module 15 is specifically used to respond to the trigger operation of the released annotated media data and determine whether the video data is being played in the playback area of ​​the video playback interface;

[0353] The progress jump module 15 is specifically used to jump the target video data based on the target progress time point in the playback area if the video data is being played in the playback area;

[0354] The progress jump module 15 is specifically configured to refresh the video playback interface if no media data is played in the playback area, and perform a progress jump to the target video data based on the target progress time point in the refreshed playback area.

[0355] The progress jump module 15 is specifically used to determine the candidate video data identifier of the video data being played in the playback area, obtain the target video data identifier of the target video data, and compare the candidate video data identifier with the target video data identifier;

[0356] The progress jump module 15 is specifically configured to determine that the video data being played in the playback area is the target video data if the candidate video data identifier is the same as the target video data identifier, and switch the playback progress of the target video data in the playback area to the playback progress indicated by the target progress time point;

[0357] The progress jump module 15 is specifically used to determine that the video data being played in the playback area is not the target video data if the candidate video data identifier is different from the target video data identifier, switch the video data being played in the playback area to the target video data, and start playing the target video data from the playback progress indicated by the target progress time point.

[0358] Among them, the media data display interface is the media reading interface;

[0359] The progress jump module 15 is specifically used to respond to the trigger operation of the released annotated media data and switch the media reading interface to the video playing interface in the video application;

[0360] The progress jump module 15 is specifically used to perform progress jump on the target video data based on the target progress time point in the video playback interface.

[0361] Among them, the media data display interface is the media reading interface;

[0362] The progress jump module 15 is specifically used to respond to the trigger operation of the released annotated media data and display the media playback sub-interface in the video application;

[0363] The progress jump module 15 is specifically used to perform progress jump on the target video data based on the target progress time point in the media playback sub-interface.

[0364] Among them, the media data display interface is the media reading interface;

[0365] The progress jump module 15 is specifically used to respond to the trigger operation of the annotated media data after release and display the media playback area in the media reading interface;

[0366] The progress jump module 15 is specifically configured to perform progress jump on target video data based on a target progress time point in the media playback area.

[0367] The data processing device 1 is further configured to display a prompt message for the historical playback progress in the video application if the historical playback progress corresponding to the target video data is obtained;

[0368] The data processing device 1 is further specifically configured to respond to a triggering operation for the prompt information, and in a video application, switch the playback progress of the target video data from the playback progress indicated by the target progress time point to the historical playback progress.

[0369] The specific implementation of the first display module 11, the first response module 12 and the second response module 13 can be found in the above Figure 3 In the corresponding embodiment, steps S101 to S103, and Figure 11 The description of step S1021-step S1022 in the corresponding embodiment will not be repeated here. The specific implementation of the second display module 14 and the progress jump module 15 can be found in the above Figure 17 The description of steps S201 and S202 in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated here either.

[0370] Further, see Figure 22 , Figure 22 This is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. Figure 22The computer device 1000 shown can be the server or terminal device in the above embodiment. The computer device 1000 may include: a processor 1001, a network interface 1004 and a memory 1005. In addition, the above computer device 1000 may also include: a user interface 1003, and at least one communication bus 1002. The communication bus 1002 is used to realize the connection and communication between these components. In some embodiments, the user interface 1003 may include a display screen (Display), a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. Optionally, the network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk storage. Optionally, the memory 1005 may also be at least one storage device located away from the aforementioned processor 1001. As Figure 22 As shown, the memory 1005 as a computer-readable storage medium may include an operating system, a network communication module, a user interface module, and a device control application.

[0371] In such Figure 22 In the computer device 1000 shown, the network interface 1004 can provide network communication functions; the user interface 1003 is mainly used to provide an interface for user input; and the processor 1001 can be used to call the device control application stored in the memory 1005 to achieve:

[0372] Display target video data in a video application;

[0373] In response to a trigger operation for a progress time point marking function in a video application, the marked media data is displayed in the video application; the marked media data is media data associated with the target progress time point corresponding to the trigger operation;

[0374] In response to a confirmation operation on the annotated media data, the annotated media data is published; the published annotated media data has a function of indicating that the target video data performs a progress jump based on a target progress time point.

[0375] It should be understood that the computer device 1000 described in the embodiment of the present application can execute the above Figure 3 、 Figure 11 or Figure 17 The description of the data processing method in the corresponding embodiment can also be performed as described above. Figure 21 The description of the data processing device 1 in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated here either.

[0376] In addition, it should be noted that: the embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium stores the computer program executed by the data processing device 1 mentioned above. When the processor executes the computer program, it can execute the above-mentioned Figure 3 、 Figure 11 or Figure 17 Therefore, the description of the data processing method in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application.

[0377] In addition, it should be noted that: the embodiment of the present application also provides a computer program product, which may include a computer program, and the computer program may be stored in a computer-readable storage medium. The processor of the computer device reads the computer program from the computer-readable storage medium, and the processor may execute the computer program, so that the computer device performs the above Figure 3 、 Figure 11 or Figure 17 Therefore, the description of the data processing method in the corresponding embodiment will not be repeated here. In addition, the description of the beneficial effects of using the same method will not be repeated here. For technical details not disclosed in the computer program product embodiments involved in this application, please refer to the description of the method embodiments of this application.

[0378] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing related hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When executed, the program can include the processes in the above-described method embodiments. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0379] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A data processing method, characterized in that: include: Display target video data in a video application; In response to a triggering operation for a progress time point marking function in the video application, displaying the marked media data in the video application; The annotated media data is media data associated with the target progress time point corresponding to the trigger operation; if the annotated media data includes annotated video data intercepted from the target video data, then the annotated video data is obtained from the target video data according to the starting scene classification information and the starting video frame of the intercepted video data when the ratio between the number M and the number N is less than the ratio threshold; the progress time point of the starting video frame of the annotated video data is the target progress time point, the annotated video data includes the starting video frame of the intercepted video data, and the number H of video frames belonging to the starting scene classification information in the annotated video data is the same as the number H of video frames belonging to the starting scene classification information in the annotated video data. N is greater than or equal to the ratio threshold; the scene classification information corresponding to the video frames in the target video data is obtained by classifying the video frames in the target video data by the target classification model, and the starting scene classification information refers to the scene classification information corresponding to the starting video frame in the intercepted video data; the intercepted video data is a video with an interception duration obtained by performing an interception operation on the target video data, and N is the number of video frames contained in the intercepted video data; M is the number of video frames in the intercepted video data whose scene classification information is equal to the starting scene classification information, and M is a positive integer less than or equal to N; In response to a confirmation operation on the annotated media data, the annotated media data is published; the published annotated media data has a function of instructing the target video data to perform a progress jump based on the target progress time point.

2. The method according to claim 1, characterized in that The annotated media data includes annotated image data captured from the target video data; The responding to the triggering operation of the progress time point marking function in the video application, and displaying the marked media data in the video application, includes: Displaying a media image capture control associated with a progress time point marking function in a video playback interface of the video application; In response to a triggering operation on the media image capture control at the target progress time point, the annotated image data is displayed in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point; In response to a confirmation operation on the annotated media data, the annotated media data is published, including: Displaying a media image publishing control corresponding to the annotated image data in the video application; In response to a confirmation operation on the media image publishing control, the annotated image data is published.

3. The method according to claim 1, characterized in that The annotated media data includes target comment media data and annotated text data; The responding to the triggering operation of the progress time point marking function in the video application, and displaying the marked media data in the video application, includes: Displaying a media text interception control associated with a progress time point marking function in a video playback interface of the video application; In response to a triggering operation on the media text interception control at the target progress time point, the annotated text data is displayed in a text annotation area of ​​the video application; In response to an input operation on the text annotation area, displaying the input target comment media data in the text annotation area; In response to a confirmation operation on the annotated media data, the annotated media data is published, including: Displaying a media text publishing control corresponding to the annotated text data in the video application; In response to a triggering operation on the media text publishing control, the target comment media data and the annotated text data are published.

4. The method according to claim 3, characterized in that The step of responding to a triggering operation on the media text interception control at the target progress time point and displaying the annotated text data in a text annotation area of ​​the video application includes: In response to a triggering operation on the media text interception control at the target progress time point, obtaining a target video segment corresponding to the target progress time point among K video segments associated with the target video data, where K is a positive integer; The segment attribute information of the target video segment is used as the annotation text data, and the annotation text data is displayed in a text annotation area of ​​the video application.

5. The method according to claim 1, wherein The annotated media data includes annotated text data and annotated image data captured from the target video data; The responding to the triggering operation of the progress time point marking function in the video application, and displaying the marked media data in the video application, includes: Displaying a media image capture control associated with a progress time point marking function in a video playback interface of the video application; In response to a triggering operation on the media image capture control at the target progress time point, the annotated image data is displayed in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point; In response to a confirmation operation on the annotated media data, the annotated media data is published, including: Displaying a media image publishing control corresponding to the annotated image data in the video application; In response to a confirmation operation on the media image publishing control, displaying the annotation text data and the media data publishing control in a comment annotation area of ​​the video application; In response to a triggering operation on the media data publishing control, the annotated text data and the annotated image data are published.

6. The method according to claim 1, characterized in that The annotated media data includes annotated video data captured from the target video data; The responding to the triggering operation of the progress time point marking function in the video application, and displaying the marked media data in the video application, includes: Displaying a media video capture control associated with a progress time point marking function in a video playback interface of the video application; In response to a trigger operation for the media video capture control at a trigger progress time point, the annotated video data is displayed in a video annotation area of ​​the video application; the target progress time point is used to determine the capture start time in the target video data; the duration of the annotated video data is the capture duration associated with the progress time point annotation function; In response to a confirmation operation on the annotated media data, the annotated media data is published, including: In response to a confirmation operation on the annotated video data, displaying a media video publishing control corresponding to the annotated video data in the video application; In response to a confirmation operation on the media video publishing control, the annotated video data is published.

7. The method according to claim 1, characterized in that The annotated media data includes target comment media data; The responding to the triggering operation of the progress time point marking function in the video application, and displaying the marked media data in the video application, includes: Displaying a media text capture control associated with a progress time point marking function in a video playback interface of the video application; In response to a triggering operation on the media text interception control at the target progress time point, displaying a text annotation area in the video application; In response to an input operation on the text annotation area, displaying the input target comment media data in the text annotation area; In response to a confirmation operation on the annotated media data, the annotated media data is published, including: Displaying a media text publishing control corresponding to the target comment media data in the video application; In response to a triggering operation on the media text publishing control, the target comment media data is published.

8. The method according to claim 1, characterized in that The annotated media data includes target comment media data and annotated image data captured from the target video data; The responding to the triggering operation of the progress time point marking function in the video application, and displaying the marked media data in the video application, includes: Displaying a media image capture control associated with a progress time point marking function in a video playback interface of the video application; In response to a triggering operation on the media image capture control at the target progress time point, the annotated image data is displayed in the image annotation area of ​​the video application; the progress time point of the annotated image data in the target video data is the target progress time point; In response to a confirmation operation on the annotated media data, the annotated media data is published, including: Displaying a media image publishing control corresponding to the annotated image data in the video application; In response to a confirmation operation on the media image publishing control, displaying a media data publishing control in a comment annotation area of ​​the video application; In response to an input operation on the comment annotation area, displaying the input target comment media data in the comment annotation area; In response to a triggering operation on the media data publishing control, the target comment media data and the annotated image data are published.

9. The method according to claim 1, characterized in that The responding to the triggering operation of the progress time point marking function in the video application, and displaying the marked media data in the video application, includes: Displaying a comment display control associated with a progress time point marking function in the video playback interface of the video application; In response to a triggering operation on the comment display control, a comment display area is displayed in the video playback interface; the comment display area includes a comment entry area; In response to a triggering operation on the comment entry area, a media annotation area is displayed in the video playback interface; the media annotation area includes a media annotation control; In response to a triggering operation on the media annotation control, displaying the annotated media data in the media annotation area; The method further comprises: After the annotated media data is published, the published annotated media data is displayed in the comment display area.

10. The method according to claim 1, characterized in that The method further comprises: Displaying the published annotated media data in the media data display interface of the video application; In response to a triggering operation on the published annotated media data, in the video application, a progress jump is performed on the target video data based on the target progress time point.

11. The method according to claim 10, characterized in that The media data display interface is a video playback interface; In response to the triggering operation of the published annotated media data, in the video application, performing a progress jump on the target video data based on the target progress time point, including: In response to a triggering operation on the published annotated media data, determining whether video data is being played in a playback area of ​​the video playback interface; If video data is being played in the play area, then in the play area, progress jump is performed on the target video data based on the target progress time point; If the media data is not played in the playback area, the video playback interface is refreshed, and in the refreshed playback area, the target video data is progress-jumped based on the target progress time point.

12. The method according to claim 11, characterized in that The step of performing a progress jump on the target video data based on the target progress time point in the playback area includes: Determine candidate video data identifiers of video data currently being played in the playback area, obtain target video data identifiers of the target video data, and compare the candidate video data identifiers with the target video data identifiers; If the candidate video data identifier is the same as the target video data identifier, determining that the video data being played in the playback area is the target video data, and switching the playback progress of the target video data in the playback area to the playback progress indicated by the target progress time point; If the candidate video data identifier is different from the target video data identifier, it is determined that the video data being played in the playback area is not the target video data, the video data being played in the playback area is switched to the target video data, and the target video data is played starting from the playback progress indicated by the target progress time point.

13. The method according to claim 10, characterized in that The media data display interface is a media reading interface; In response to the triggering operation of the published annotated media data, in the video application, performing a progress jump on the target video data based on the target progress time point, including: In response to a triggering operation on the published annotated media data, switching the media viewing interface to a video playback interface in the video application; In the video playback interface, the target video data is progress-jumped based on the target progress time point.

14. The method according to claim 10, characterized in that The media data display interface is a media reading interface; In response to the triggering operation of the published annotated media data, in the video application, performing a progress jump on the target video data based on the target progress time point, including: In response to a triggering operation on the published annotated media data, displaying a media playback sub-interface in the video application; In the media playback sub-interface, the target video data is progress-jumped based on the target progress time point.

15. The method according to claim 10, characterized in that The media data display interface is a media reading interface; In response to the triggering operation of the published annotated media data, in the video application, performing a progress jump on the target video data based on the target progress time point, including: In response to a triggering operation on the published annotated media data, displaying a media playback area in the media viewing interface; In the media play area, the target video data is progress-jumped based on the target progress time point.

16. The method according to claim 10, characterized in that The method further comprises: If the historical playback progress corresponding to the target video data is obtained, prompt information for the historical playback progress is displayed in the video application; In response to a triggering operation for the prompt information, in the video application, the playback progress of the target video data is switched from the playback progress indicated by the target progress time point to the historical playback progress.

17. The method according to claim 9, characterized in that The comment display area is used to display comment media data associated with the target video data; the comment display area also includes a marking function control; The method further comprises: In response to a triggering operation on the annotation function control, a progress time point list is displayed in the video application; the list items in the progress time point list include progress time points associated with the comment media data; the progress time points associated with the comment media data are sorted according to the number of associated comment media data; the progress time points associated with the comment media data include candidate progress time points; In response to a triggering operation on the candidate progress time point, in the video application, a progress jump is performed on the target video data based on the candidate progress time point.

18. The method according to claim 17, characterized in that The list items in the progress time point list also include candidate media browsing controls corresponding to the candidate progress time points; The method further comprises: In response to a triggering operation on the candidate media viewing control, comment media data associated with the candidate progress time point is displayed in the video application.

19. The method according to claim 3, characterized in that The step of responding to a triggering operation on the media text interception control at the target progress time point and displaying the annotated text data in a text annotation area of ​​the video application includes: Responding to a trigger operation on the media text interception control at the target progress time point, sending a progress time point marking instruction to the player through the publisher; Obtaining, through the kernel of the player, progress time point information corresponding to the playback progress of the target video data, and sending the progress time point information to a progress time point data generator; Rendering the progress time point information by the progress time point data generator to obtain rendered progress time point information, and returning the rendered progress time point information to the publisher; The publisher displays the annotated text data corresponding to the rendered progress time point information in the text annotation area of ​​the video application.

20. The method according to claim 9, wherein After the annotated media data is published, displaying the published annotated media data in the comment display area includes: After publishing the annotated media data, storing the published annotated media data in a media database; When the comment display area is refreshed, the comment media reading service is called to read the published annotated media data from the media database through the comment media reading service, and the published annotated media data is displayed in the refreshed comment display area.

21. A data processing device, characterized in that: include: A first display module, configured to display target video data in a video application; A first response module is configured to respond to a triggering operation of a progress time point marking function in the video application and display the marked media data in the video application; The annotated media data is media data associated with the target progress time point corresponding to the trigger operation; if the annotated media data includes annotated video data intercepted from the target video data, then the annotated video data is obtained from the target video data according to the starting scene classification information and the starting video frame of the intercepted video data when the ratio between the number M and the number N is less than the ratio threshold; the progress time point of the starting video frame of the annotated video data is the target progress time point, the annotated video data includes the starting video frame of the intercepted video data, and the number H of video frames belonging to the starting scene classification information in the annotated video data is the same as the number H of video frames belonging to the starting scene classification information in the annotated video data. N is greater than or equal to the ratio threshold; the scene classification information corresponding to the video frames in the target video data is obtained by classifying the video frames in the target video data by the target classification model, and the starting scene classification information refers to the scene classification information corresponding to the starting video frame in the intercepted video data; the intercepted video data is a video with an interception duration obtained by performing an interception operation on the target video data, and N is the number of video frames contained in the intercepted video data; M is the number of video frames in the intercepted video data whose scene classification information is equal to the starting scene classification information, and M is a positive integer less than or equal to N; a second response module, configured to respond to a confirmation operation on the annotated media data and publish the annotated media data; The published annotated media data has the function of instructing the target video data to perform a progress jump based on the target progress time point.

22. A computer device, characterized in that: include: processor and memory; The processor is connected to the memory, wherein the memory is used to store a computer program, and the processor is used to call the computer program to enable the computer device to execute the method according to any one of claims 1 to 20.

23. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which is suitable for being loaded and executed by a processor, so that a computer device having the processor executes the method according to any one of claims 1 to 20.

24. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer-readable storage medium and is suitable for being read and executed by a processor, so as to enable a computer device having the processor to perform the method according to any one of claims 1 to 20.

Images