A data processing method and device, computer equipment and readable storage medium

By displaying virtual objects and a matching size of commentary media data display area in the video playback interface, the problem of bullet comments obstructing the video display was solved, thus optimizing the bullet comment effect and improving video quality.

CN116095381BActive Publication Date: 2026-05-26TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
TENCENT TECHNOLOGY (SHENZHEN) CO LTD
Filing Date
2021-11-05
Publication Date
2026-05-26

AI Technical Summary

Technical Problem

The existing bullet screen display method displays multiple bullet screens on the screen during video playback, which affects the video display effect. In particular, when the bullet screen density is high, the superimposed display further reduces the effect.

Method used

The virtual object and commentary media data display area are displayed in the media playback interface, overlaying the local media data. The size of the commentary media data display area is matched with the size of the target commentary media data. The display effect of the bullet comments is optimized by the relationship between the virtual object and the commentary media data display area.

Benefits of technology

It improved the presentation of commentary media data, reduced its impact on the presentation of target media data, and enhanced the overall viewing experience of video playback.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116095381B_ABST
    Figure CN116095381B_ABST
Patent Text Reader

Abstract

Embodiments of the present application provide a data processing method and device, computer equipment and readable storage medium, which can be applied to cloud technology, artificial intelligence, intelligent transportation, video and various scenes, and the method comprises: displaying target media data in a media playing interface; in response to a starting operation of a display function of comment media data in the media playing interface, displaying a virtual object and a comment media data display area associated with the virtual object in a target area of the media playing interface; and displaying target comment media data associated with the target media data in the comment media data display area. By using the present application, the simplified display of comment media data can be realized, thereby improving the display effect of comment media data and reducing the influence of comment media data on the display effect of target media data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method, apparatus, computer equipment, and readable storage medium. Background Technology

[0002] With the development of multimedia technology, video has become a major medium for obtaining information and enjoying entertainment in daily life. While watching videos, viewers often turn on the video's commentary media data features (such as the bullet screen feature) to display the video's commentary media data (i.e., bullet screen data) on the screen in order to see comments about the video.

[0003] Current bullet screen display methods show multiple bullet screens simultaneously in the current video frame, covering the entire screen and negatively impacting the video's presentation. Furthermore, when bullet screen data density is high, multiple bullet screens may be displayed side-by-side, potentially overlapping in the same location, further degrading the display quality. Summary of the Invention

[0004] This application provides a data processing method, apparatus, computer device, and readable storage medium, which can improve the display effect of commentary media data and reduce the impact of commentary media data on the display effect of target media data.

[0005] One embodiment of this application provides a data processing method, including:

[0006] Display the target media data in the media playback interface;

[0007] In response to the activation of the commentary media data display function in the media playback interface, a virtual object and the commentary media data display area associated with the virtual object are displayed in the target area of ​​the media playback interface; the virtual object and the commentary media data display area are displayed on top of the local media data, which is the media data located in the target area of ​​the media playback interface from the target media data;

[0008] In the commentary media data display area, target commentary media data associated with the target media data is displayed; the area size of the commentary media data display area matches the media size of the target commentary media data.

[0009] One embodiment of this application provides a data processing apparatus, including:

[0010] The first display module is used to display the target media data in the media playback interface;

[0011] The second display module is used to respond to the activation operation of the commentary media data display function in the media playback interface. In the target area of ​​the media playback interface, it displays a virtual object and a commentary media data display area associated with the virtual object. The virtual object and the commentary media data display area are displayed on top of the local media data, which is the media data located in the target area of ​​the media playback interface.

[0012] The third display module is used to display target commentary media data associated with the target media data in the commentary media data display area; the area size of the commentary media data display area matches the media size of the target commentary media data.

[0013] The second display module includes:

[0014] The first display unit is used to display commentary media data control controls associated with the commentary media data display function in the media playback interface;

[0015] The second display unit is used to display the commentary media data launch control in response to a trigger operation on the commentary media data control control.

[0016] The third display unit is used to respond to the launch operation of the commentary media data launch control and to display a virtual object and a commentary media data display area associated with the virtual object in the target area of ​​the media playback interface.

[0017] The device also includes:

[0018] The fourth display module is used to display the commentary media data update control associated with the commentary media data update function in the media playback interface;

[0019] The fifth display module is used to respond to trigger operations on the commentary media data update control and display N display duration controls; N is a positive integer;

[0020] The duration determination module is used to respond to the trigger operation of the target display duration control among N display duration controls, and to determine the display duration of the commentary media data indicated by the target display duration control as the display duration of the commentary media data corresponding to the target media data;

[0021] The third display module is specifically used to display target commentary media data associated with the target media data in the commentary media data display area based on the display duration of the commentary media data corresponding to the target media data.

[0022] The third display unit includes:

[0023] The first acquisition subunit is used to respond to the launch operation of the launch control for commentary media data and acquire a first set of commentary media data associated with the target media data; the first set of commentary media data includes commentary media data acquired from an initial set of commentary media data associated with the target media data based on a first playback progress; the first playback progress is the current playback progress of the target media data in the media playback interface;

[0024] The first display subunit is used to display a virtual object and a display area of ​​commentary media data associated with the virtual object in a target area of ​​the media playback interface, based on a first set of commentary media data.

[0025] The first display subunit includes:

[0026] The search processing subunit is used to perform search processing on the first set of commentary media data based on the first playback progress to obtain the search results;

[0027] The first search subunit is configured to determine the commentary media data corresponding to the first playback progress as the target commentary media data associated with the target media data if the search result indicates that the commentary media data corresponding to the first playback progress is found in the first commentary media data set.

[0028] The region display subunit is used to determine the virtual object that matches the target commentary media data and to determine the media size of the target commentary media data;

[0029] The area display subunit is used to determine the area size of the commentary media data display area associated with the virtual object based on the media size, and to display the virtual object and the commentary media data display area with the area size in the target area of ​​the media playback interface.

[0030] The regional display subunit is specifically used to input the target media data into the media data analysis model, and to perform scene type analysis on the target media data through the media data analysis model to obtain the media scene type of the target media data at different playback progress.

[0031] The area display sub-unit is specifically used to obtain the media scene type of the target media data in the first playback progress from the media scene types of the target media data in different playback progresses;

[0032] The area display subunit is specifically used to determine a virtual object that matches the target commentary media data based on the media scene type of the target media data in the first playback progress; the object attribute type of the virtual object matches the media scene type of the first playback progress.

[0033] The region display sub-unit is specifically used to input the target commentary media data into the commentary media data analysis model, and to perform semantic analysis on the target commentary media data through the commentary media data analysis model to obtain the semantic type of the target commentary media data.

[0034] The area display sub-unit is specifically used to determine virtual objects that match the target commentary media data based on semantic type; the object attribute type of the virtual object matches the semantic type.

[0035] The first display subunit further includes:

[0036] The second search subunit is used to continue searching the first set of commentary media data based on the second playback progress when the playback progress of the target media data moves from the first playback progress to the second playback progress if the search result indicates that no commentary media data corresponding to the first playback progress is found in the first commentary media data; the second playback progress is the next playback progress of the first playback progress.

[0037] The third display unit also includes:

[0038] The progress acquisition subunit is used to acquire the third playback progress corresponding to the target media data; the third playback progress is the playback progress after the first playback progress.

[0039] The second acquisition subunit is configured to acquire a second set of commentary media data associated with the target media data based on the third playback progress if no commentary media data associated with the target playback progress interval exists in the device memory; the second set of commentary media data includes commentary media data acquired from the initial set of commentary media data associated with the target media data based on the target playback progress interval; the minimum playback progress in the target playback progress interval is the third playback progress.

[0040] The second display subunit is used to display an updated virtual object and an updated commentary media data display area associated with the updated virtual object in the target area of ​​the media playback interface when the playback progress of the target media data played in the media playback interface is at the third playback progress, based on the second set of commentary media data.

[0041] The length of the target playback progress interval is the pre-configured request interval duration, which is less than the total playback duration of the target media data.

[0042] One embodiment of this application provides a data processing method, including:

[0043] The application client receives a request to retrieve commentary media data for target media data in the media playback interface. Based on the request, the application client retrieves a first set of commentary media data associated with the target media data. The request to retrieve commentary media data is sent by the application client after responding to the activation operation of the commentary media data display function in the media playback interface.

[0044] The first set of commentary media data is returned to the application client, enabling the application client to display a virtual object and a commentary media data display area associated with the virtual object in the target area of ​​the media playback interface, based on the first set of commentary media data. Within the commentary media data display area, target commentary media data associated with the target media data is displayed. The virtual object and the commentary media data display area are overlaid on the local media data, which is the media data located within the target area of ​​the media playback interface from the target media data. The first set of commentary media data includes the target commentary media data. The area size of the commentary media data display area matches the media size of the target commentary media data.

[0045] One embodiment of this application provides a data processing apparatus, including:

[0046] The request receiving module is used to receive the commentary media data acquisition request sent by the application client for the target media data in the media playback interface, and to acquire the first set of commentary media data associated with the target media data according to the commentary media data acquisition request; the commentary media data acquisition request is sent by the application client after responding to the start operation of the commentary media data display function in the media playback interface;

[0047] The collection return module is used to return the first set of commentary media data to the application client, so that the application client can display a virtual object and a display area of ​​commentary media data associated with the virtual object in the target area of ​​the media playback interface based on the first set of commentary media data. In the commentary media data display area, the target commentary media data associated with the target media data is displayed. The virtual object and the commentary media data display area are displayed on top of the local media data, which is the media data located in the target area of ​​the media playback interface from the target media data. The first set of commentary media data includes the target commentary media data. The area size of the commentary media data display area matches the media size of the target commentary media data.

[0048] The device also includes:

[0049] The data acquisition module is used to acquire a comprehensive set of commentary media data associated with the target media data, and to acquire key text filtering data for filtering the comprehensive set of commentary media data.

[0050] The filtering module is used to filter the commentary media data containing key text filtering data in the comprehensive commentary media data set, and to determine the comprehensive commentary media data set after filtering as the filtered commentary media data set;

[0051] The aggregation processing module is used to aggregate the commentary media data in the filtered commentary media data set to obtain an initial commentary media data set associated with the target media data.

[0052] The request receiving module is specifically used to obtain the first playback progress carried by the request based on the commentary media data, and to obtain the first commentary media data set associated with the target media data from the initial commentary media data set.

[0053] The aggregation processing module includes:

[0054] The data partitioning unit is used to obtain the commentary media time indicated by the commentary media data in the filtered commentary media data set, and to partition the commentary media data in the filtered commentary media data set according to the commentary media time to obtain a partitioned commentary media data set; each commentary media data in a partitioned commentary media data set indicates the same commentary media time;

[0055] The time mapping unit is used to obtain the comprehensive semantic similarity corresponding to each piece of commentary media data in the segmented commentary media data set. The commentary media data with the highest comprehensive semantic similarity in the segmented commentary media data set is regarded as the commentary media data with a mapping relationship with the time of the commentary media. The comprehensive semantic similarity corresponding to a piece of commentary media data is determined by the semantic similarity between that piece of commentary media data and each piece of commentary media data in the segmented commentary media data set to which it belongs.

[0056] The first constituent unit is used to construct an initial set of commentary media data associated with the target media data by taking commentary media data that has a mapping relationship with the commentary media time.

[0057] The request receiving module includes:

[0058] The interval determination unit is used to obtain the first playback progress carried by the request based on the commentary media data, and determine the interval of the requested playback progress corresponding to the first playback progress; the minimum playback progress in the interval of the requested playback progress is the first playback progress; the interval length of the interval of the requested playback progress is the pre-configured request interval duration, and the request interval duration is less than the total playback duration of the target media data;

[0059] The second constituent unit is used to obtain the commentary media data within the requested playback progress interval from the initial commentary media data set, and to form a first commentary media data set associated with the target media data from the commentary media data within the requested playback progress interval.

[0060] The device also includes:

[0061] The collection review module is used to send the initial set of commentary media data to the management device used for monitoring application clients, so that the management device can review the initial set of commentary media data and obtain the review results;

[0062] The result receiving module is used to receive the review result returned by the management device. If the review result is a pass result, the module executes the step of obtaining the first set of commentary media data associated with the target media data from the initial set of commentary media data based on the first playback progress carried by the commentary media data acquisition request.

[0063] One embodiment of this application provides a computer device, including: a processor and a memory;

[0064] The processor is connected to a memory, which stores a computer program. When the computer program is executed by the processor, it causes the computer device to perform the method provided in the embodiments of this application.

[0065] One aspect of this application provides a computer-readable storage medium storing a computer program adapted to be loaded and executed by a processor, so that a computer device having the processor performs the method provided in this application.

[0066] One embodiment of this application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in this application embodiment.

[0067] The computer device in this embodiment can display target media data in a media playback interface, and then respond to the activation operation of the commentary media data display function in the media playback interface. In the target area of ​​the media playback interface, a virtual object and a commentary media data display area associated with the virtual object are displayed. The virtual object and the commentary media data display area are displayed over local media data, which refers to the media data located in the target area of ​​the media playback interface within the target media data. Furthermore, the computer device can display target commentary media data associated with the target media data in the commentary media data display area, where the area size of the commentary media data display area matches the media size of the target commentary media data. Therefore, this embodiment can display target media data in a media playback interface, and then activate the commentary media data display function for the target media data. This displays a virtual object and a commentary media data display area associated with the virtual object on top of the local media data in the target area of ​​the media playback interface. Thus, the display effect of the commentary media data can be improved through the virtual object and the commentary media data display area, and the impact of the commentary media data on the display effect of the target media data can be reduced through the relationship between the target area and the virtual object and the commentary media data display area. Attached Figure Description

[0068] To more clearly illustrate the technical solutions in the embodiments or related technologies of this application, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0069] Figure 1 This is a schematic diagram of a network architecture provided in an embodiment of this application;

[0070] Figure 2 This is a schematic diagram of a data interaction scenario provided in an embodiment of this application;

[0071] Figure 3 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0072] Figure 4 This is a schematic diagram illustrating a scenario for activating a commentary media data display function, as provided in an embodiment of this application.

[0073] Figure 5 This is a schematic diagram illustrating a scenario for determining the display duration of commentary media data, provided in an embodiment of this application.

[0074] Figure 6 This is a schematic diagram illustrating a scenario where the commentary media display function is disabled, as provided in an embodiment of this application.

[0075] Figure 7 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0076] Figure 8 This is a schematic diagram of a process for displaying commentary media data provided in an embodiment of this application;

[0077] Figure 9 This is a schematic diagram of a process for segmented preloading of a set of commentary media data provided in an embodiment of this application;

[0078] Figure 10a This is a schematic diagram illustrating a scenario for switching commentary media data, provided in an embodiment of this application.

[0079] Figure 10b This is a schematic diagram illustrating a scenario for switching commentary media data, provided in an embodiment of this application.

[0080] Figure 11 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0081] Figure 12 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0082] Figure 13 This is a schematic diagram of a process for determining an initial set of commentary media data provided in an embodiment of this application;

[0083] Figure 14 This is a schematic diagram of a process for generating an initial set of commentary media data, provided in an embodiment of this application;

[0084] Figure 15 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;

[0085] Figure 16 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;

[0086] Figure 17 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;

[0087] Figure 18 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;

[0088] Figure 19 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application;

[0089] Figure 20 This is a schematic diagram of the structure of a data processing system provided in an embodiment of this application. Detailed Implementation

[0090] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0091] It should be understood that Artificial Intelligence (AI) is the theory, methods, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to possess the functions of perception, reasoning, and decision-making.

[0092] Artificial intelligence (AI) is a comprehensive discipline encompassing a wide range of fields, including both hardware and software technologies. Fundamental AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies primarily include computer vision, speech processing, natural language processing, as well as machine learning / deep learning, autonomous driving, and intelligent transportation.

[0093] For details, please see Figure 1 , Figure 1 This is a schematic diagram of a network architecture provided in an embodiment of this application. Figure 1 As shown, this network architecture may include a service server 2000 and a terminal device cluster. The terminal device cluster may specifically include one or more terminal devices; the number of terminal devices in the cluster is not limited here. Figure 1As shown, the multiple terminal devices may specifically include terminal device 3000a, terminal device 3000b, terminal device 3000c, ..., terminal device 3000n; terminal device 3000a, terminal device 3000b, terminal device 3000c, ..., terminal device 3000n can be directly or indirectly connected to the business server 2000 via wired or wireless communication, so that each terminal device can interact with the business server 2000 through the network connection.

[0094] Each terminal device in the terminal device cluster can include: smart TVs, smartphones, tablets, laptops, desktop computers, smart home devices, wearable devices, in-vehicle terminals, and other smart terminals with data processing capabilities. It should be understood that, for example... Figure 1 Each terminal device in the terminal device cluster shown can be integrated with an application client. When the application client runs on each terminal device, it can interact with the aforementioned... Figure 1 The business servers 2000 shown interact with each other. The application client can be a standalone client or an embedded sub-client integrated into another client; this application does not impose any limitations on this.

[0095] Specifically, the application clients can include browsers, in-vehicle clients, smart home clients, entertainment clients, multimedia clients (e.g., video clients), social media clients, and news clients, as well as other clients with data processing capabilities. The in-vehicle terminal can be a smart terminal in a smart transportation scenario, and the application clients on this in-vehicle terminal can be the aforementioned in-vehicle clients.

[0096] Among them, the business server 2000 can be the server corresponding to the application client. The business server 2000 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0097] For ease of understanding, the embodiments of this application may be described in detail below. Figure 1 From the multiple terminal devices shown, one terminal device is selected as the target terminal device. For example, in the embodiments of this application, a terminal device can be selected as the target terminal device. Figure 1 The terminal device 3000b shown serves as the target terminal device, which may integrate an application client with data processing capabilities. In this case, the target terminal device can interact with the business server 2000 through this application client.

[0098] In this application embodiment, the target media data can be video data (e.g., movie data), audio data (e.g., music data), or text data (e.g., novel data). No limitation is imposed here; for ease of understanding, this application embodiment uses video data as the target media data for illustration. For ease of understanding, this application embodiment can refer to the bullet comments in the video data as commentary media data. Bullet comments can represent short comments sent by users watching the video, achieving a presentation method where viewers can see comments on the video while watching it. Furthermore, this application embodiment can refer to audio comments in the audio data and text comments in the text data as commentary media data.

[0099] For ease of understanding, in this application embodiment, the media (e.g., movies) that match the user's interests in the media recommendation interface (e.g., video recommendation interface, audio recommendation interface, text recommendation interface) of an application client can be collectively referred to as target media, and the media data corresponding to the target media can be target media data.

[0100] It should be understood that the business scenarios applicable to the aforementioned network framework can specifically include: entertainment program on-demand scenarios, online music listening scenarios, online novel reading scenarios, etc. This network framework can achieve simplified display of commentary media data in business scenarios such as entertainment program on-demand scenarios, online music listening scenarios, and online novel reading scenarios. The specific business scenarios applicable to this network framework will not be listed here. For example, in the entertainment program on-demand scenario, the target media can be the entertainment programs that user Y selects from the video recommendation interface (e.g., the entertainment program recommendation list) that match their interests. Similarly, in the online music listening scenario, the target media can be the popular music that user Y selects from the audio recommendation interface (e.g., the popular song list) that matches their interests. And in the online novel reading scenario, the target media can be the popular novels that user Y selects from the text recommendation interface (e.g., the novel ranking list) that match their interests.

[0101] It should be understood that when a user (e.g., user Y) watches target media data (e.g., video data S) in the application client of the target terminal device, the application client can display video data S in the media playback interface. Furthermore, when user Y needs to enable the commentary media data display function (e.g., bullet screen function) of the application client, a startup operation can be performed on the bullet screen function in the media playback interface. In response to user Y's startup operation on the bullet screen function, the application client can send a commentary media data retrieval request (e.g., bullet screen retrieval request) to the business server 2000. Therefore, after receiving the bullet screen retrieval request sent by the application client in the target terminal device, the business server 2000 can retrieve a first set of commentary media data associated with the video data S, and then return this first set of commentary media data to the application client. This allows the application client to retrieve the target commentary media data from the first set of commentary media data, display a virtual object associated with the target commentary media data and a commentary media data display area associated with the virtual object in the target area of ​​the media playback interface, and display the target commentary media data in the commentary media data display area.

[0102] For better understanding, please refer to [link / reference]. Figure 2 , Figure 2 This is a schematic diagram illustrating a data interaction scenario provided in an embodiment of this application. For example... Figure 2 The server 20a shown can be the one described above. Figure 1 The corresponding business server 2000 in the embodiment, such as Figure 2 The terminal device 20b shown can be the one described above. Figure 1 The target terminal device in the corresponding embodiment. The terminal device 20b has an application client installed, which can be used to display target media data and associated commentary media data. For example, Figure 2 The media playback interfaces 21a and 21c shown can be the media playback interfaces of the application client in the terminal device 20b at different times. Specifically, when the terminal device 20b is a smart TV, the application client on the terminal device 20b can be a video client on the smart TV.

[0103] like Figure 2As shown, the application client can display the target media data in the media playback interface 21a using the media identifier (e.g., video identifier). Then, when the user of the application client initiates a startup operation for the commentary media data display function in the media playback interface 21a, the application client can respond to the startup operation in the media playback interface 21a for the commentary media data display function, determine the playback progress of the target media data in the application client (e.g., playback progress J), and send a commentary media data retrieval request for the target media data to the server 20a based on the playback progress J. Thus, after receiving the commentary media data retrieval request, the server 20a can retrieve the initial set of commentary media data associated with the target media data from the commentary media data set 21b based on the media identifier of the target media data.

[0104] The commentary media data set 21b may include multiple commentary media data sets, specifically including: initial commentary media data set 30a, initial commentary media data set 30b, ..., initial commentary media data set 30n. These initial commentary media data sets can be associated with different media data sets; for example, initial commentary media data set 30a may be associated with media data S1, initial commentary media data set 30b may be associated with media data S2, ..., initial commentary media data set 30n may be associated with media data S1, S2, ..., S3, S3, S4, S5, S6, S7, S8, S9, S1 ... n Related. For example, when the target media data is media data S1, server 20a can obtain an initial commentary media data set 30a from the commentary media data set 21b. This initial commentary media data set 30a is the initial commentary media data set associated with the target media data.

[0105] like Figure 2 As shown, after obtaining the initial commentary media data set 30a, server 20a can retrieve a first commentary media data set from the initial commentary media data set 30a based on the playback progress J carried in the commentary media data retrieval request, and then return the first commentary media data set to the application client in terminal device 20b. The first commentary media data set may include commentary media data within the requested playback progress interval after playback progress J, where the request interval duration of the requested playback progress interval may be less than the total interval duration after playback progress J. Optionally, the first commentary media data set may also include commentary media data within all playback progress intervals corresponding to the total interval duration after playback progress J. Optionally, the first commentary media data set may also include commentary media data from the initial commentary media data set associated with the target media data.

[0106] like Figure 2 As shown, after receiving the first set of commentary media data, terminal device 20b can obtain the commentary media data corresponding to the playback progress J of the target media data from the first set of commentary media data. If there is corresponding commentary media data for the target media data at playback progress J, then the commentary media data corresponding to playback progress J is determined as the target commentary media data. Optionally, if there is no corresponding commentary media data for the target media data at playback progress J, then the next playback progress (e.g., playback progress (J+1)) is obtained, and then the commentary media data corresponding to playback progress (J+1) of the target media data is obtained from the first set of commentary media data. Thus, when there is corresponding commentary media data for the target media data at playback progress (J+1), the commentary media data corresponding to playback progress (J+1) is determined as the target commentary media data.

[0107] Furthermore, the terminal device 20b can divide the media playback interface 21a into a target area 21d, and then display a virtual object 22b associated with the target commentary media data, as well as a commentary media data display area 22a associated with the virtual object 22b, in the target area 21d. At this time, the media playback interface switches from the media playback interface 21a to the media playback interface 21c. The media data located in the target area 21d within the target media data can be referred to as local media data. The virtual object 22b and the commentary media data display area 22a are displayed overlaid on this local media data. For example, the virtual object 22b is an object independent of the local media data, and the commentary media data display area 22a is an area independent of the local media data. In other words, the virtual object 22b is an object floating above the local media data, and the commentary media data display area 22a is an area floating above the local media data. Furthermore, the virtual object 22b and the commentary media data display area 22a can be used to obscure partial media data for display; the virtual object 22b and the commentary media data display area 22a can also be displayed by adjusting their transparency, so that the virtual object 22b, the commentary media data display area 22a, and the partial media data can be displayed together in the target area.

[0108] The target area 21d can be located anywhere in the media playback interface 21c to reduce the impact on the display effect of the target media data. Generally, the target area 21d can be located at the edge of the media playback interface 21c. For ease of understanding, this embodiment of the application takes the target area 21d being located in the lower right position of the media playback interface 21c as an example. Correspondingly, the virtual object 22b and the commentary media data display area 22a are located in the lower right position of the media playback interface 21c.

[0109] Therefore, in this embodiment of the application, when displaying target media data in the media playback interface, the user's activation operation for the commentary media data display function can be received. This allows the display of virtual objects and a commentary media data display area in the target area of ​​the media playback interface. The commentary media data display area can be used to display target commentary media data associated with the target media data. Thus, this embodiment of the application can improve the display effect of commentary media data through virtual objects and the commentary media data display area when the commentary media data display function is activated, and reduce the impact of commentary media data on the display effect of the target media data through the relationship between the virtual objects, the commentary media data display area, and the target area.

[0110] Further, please see Figure 3 , Figure 3 This is a flowchart illustrating a data processing method provided in an embodiment of this application. The method can be executed by a server, by an application client, or by both a server and an application client. The server can be one of the aforementioned... Figure 2 The server 20a in the corresponding embodiment can be the application client described above. Figure 2 The corresponding embodiment describes the application client. For ease of understanding, this application embodiment uses the method executed by the application client as an example for illustration. The data processing method may include the following steps S101-S103:

[0111] Step S101: Display the target media data in the media playback interface;

[0112] Understandably, when a user (e.g., user Y) of an application client needs to watch a certain media (e.g., target media), they can perform a playback operation on the target media (e.g., target video) in the media recommendation interface (e.g., video recommendation interface) of the smart TV. In this way, the application client can respond to the playback operation performed by user Y on the target media, and send a media playback request (e.g., video playback request) to the server corresponding to the application client based on the media identifier (e.g., video identifier) ​​of the target media. After receiving the target media data corresponding to the target media, the application client can display the target media data in the media playback interface (e.g., video playback interface) of the smart TV.

[0113] Step S102: In response to the activation operation of the commentary media data display function in the media playback interface, a virtual object and a commentary media data display area associated with the virtual object are displayed in the target area of ​​the media playback interface;

[0114] Specifically, the application client in the smart TV can display commentary media data control controls associated with the commentary media data display function on the media playback interface. Furthermore, through data interaction between the smart TV and the smart TV remote control, the application client can respond to trigger operations on the commentary media data control controls and display the commentary media data launch control. Further, the application client can respond to launch operations on the commentary media data launch control and display a virtual object and the commentary media data display area associated with the virtual object in the target area of ​​the media playback interface. The virtual object and the commentary media data display area are displayed overlaid on the local media data, which is the media data located in the target area of ​​the media playback interface within the target media data.

[0115] The application client can respond to trigger operations on the media playback interface, display a media control interface independent of the media playback interface, and display commentary media data control controls associated with the commentary media data display function in the media control interface.

[0116] The triggering and initiation operations mentioned here can include contact operations such as clicking, long pressing, and swiping, as well as non-contact operations such as voice and gestures; this application does not impose any limitations on these. When the terminal device is a smart TV, the triggering operation can be a click on the player menu on the smart TV remote control or a click on the TV button on the smart TV.

[0117] For easier understanding, please refer to Figure 4 , Figure 4 This is a schematic diagram illustrating a scenario for activating a commentary media data display function, provided in an embodiment of this application. The media playback interface in the application client can be as follows: Figure 4 The media playback interface 40a shown can display the target media data. For example... Figure 4 As shown, the application client can respond to a trigger operation on the media playback interface 40a and display a media control interface 40b independent of the media playback interface 40a. The media control interface 40b may include a commentary media data control control 41a associated with the commentary media data display function.

[0118] like Figure 4 As shown, the application client can respond to a trigger operation on the commentary media data control control 41a and display the commentary media data launch control 41b. In addition, the application client can also display a commentary media data close control, which is on by default and can be used to disable the commentary media data display function.

[0119] It can be understood that the user of the application client can perform a launch operation on the commentary media data launch control 41b. In this way, the application client can respond to the launch operation on the commentary media data launch control 41b, displaying a virtual object (not shown in the figure) and the associated commentary media data display area (not shown in the figure) in the target area of ​​the media playback interface 40a. Here, the virtual object can be one of the aforementioned... Figure 2 The virtual object 22b in the corresponding embodiment, the commentary media data display area here can be as described above. Figure 2 The commentary media data display area 22a in the corresponding embodiment.

[0120] Step S103: In the commentary media data display area, display the target commentary media data associated with the target media data.

[0121] The size of the display area for commentary media data matches the media size of the target commentary media data. The media size of the target commentary media data is determined by its text length. For example, if the target commentary media data is "This person is so fierce!", it includes the words "this", "person", "good", "fierce", and "!". The text length of the target commentary media data is 6, meaning its media size is 6, and therefore the display area size is 6. Similarly, if the target commentary media data is "Wow, sounds good!", it includes the words "wow", ",", "good", "sounds good", and "!". The text length of the target commentary media data is 5, meaning its media size is 5, and therefore the display area size is 5. Thus, a display area for commentary media data with a size of 6 is larger than a display area for commentary media data with a size of 5.

[0122] It should be understood that the application client can display a commentary media data update control associated with the commentary media data update function in the media playback interface. Furthermore, the application client can respond to a trigger operation on the commentary media data update control to display N display duration controls, where N can be a positive integer. Further, the application client can respond to a trigger operation on the target display duration control among the N display duration controls, determining the commentary media data display duration indicated by the target display duration control as the commentary media data display duration corresponding to the target media data.

[0123] The application client can respond to trigger operations on the media playback interface, display a media control interface independent of the media playback interface, and display commentary media data update controls associated with the commentary media data update function in the media control interface.

[0124] The triggering operation here may include contact operations such as clicking, long pressing, and swiping, or non-contact operations such as voice and gestures. This application does not limit it here.

[0125] Therefore, the application client can display the target commentary media data associated with the target media data in the commentary media data display area based on the display duration of the commentary media data corresponding to the target media data. In other words, the application client can continuously display virtual objects and the commentary media data display area as the target media data plays, and synchronously and continuously display the virtual objects and the commentary media data display area in the target area based on the display duration of the commentary media data (i.e., the display time of the virtual objects and the commentary media data display area is determined by the display duration of the commentary media data). At the same time, the target commentary media data is displayed in the commentary media data display area based on the display duration of the commentary media data. Compared with related technologies, this application can reduce the display speed and quantity of commentary media data, making it more convenient for review and control.

[0126] For easier understanding, please refer to Figure 5 , Figure 5 This is a schematic diagram illustrating a scenario for determining the display duration of commentary media data, provided in an embodiment of this application. The media playback interface in the application client can be as follows: Figure 5 The media playback interface 50a shown can display target media data. For example... Figure 5 As shown, the application client can respond to a trigger operation on the media playback interface 50a and display a media control interface 50b independent of the media playback interface 50a. The media control interface 50b may include a commentary media data update control 51a associated with the commentary media data update function.

[0127] like Figure 5As shown, the application client can respond to the trigger operation of the commentary media data update control 51a, displaying N display duration controls. Here, N can be a positive integer; taking N equal to 5 as an example, the five display duration controls can specifically include: display duration control 52b, display duration control 52c, display duration control 52d, display duration control 52e, and display duration control 52f. These five display duration controls are used to indicate different display durations of the commentary media data (referred to as display durations). Display duration control 52b indicates a display duration of 1 second, display duration control 52c indicates a display duration of 2 seconds, display duration control 52d indicates a display duration of 3 seconds, display duration control 52e indicates a display duration of 5 seconds, and display duration control 52f indicates a display duration of 8 seconds.

[0128] In this context, it's understandable that when the display duration control 52f is used as the target display duration control, the user of the application client can perform a trigger operation on the display duration control 52f. In this way, the application client can respond to the trigger operation on the display duration control 52f, determining the display duration of the commentary media data (i.e., 8 seconds) indicated by the display duration control 52f as the display duration of the commentary media data corresponding to the target media data. Therefore, the virtual object and the commentary media data display area will be synchronously and continuously displayed in the target area for 8 seconds.

[0129] It should be understood that as the virtual object and the commentary media data display area continue to be displayed, the playback progress of the target media data in the media playback interface will continuously change until an auxiliary virtual object (i.e., a new virtual object) and an auxiliary commentary media data display area associated with the auxiliary virtual object (i.e., a new commentary media data display area) are displayed in the target area. In other words, the virtual object will automatically transform into an auxiliary virtual object, and the commentary media data display area (i.e., the bubble) will automatically enlarge or shrink to become the auxiliary commentary media data display area. For example, as the virtual object and the commentary media data display area continue to be displayed, the above... Figure 2 The media playback interface 21c shown will play to Figure 6 The virtual objects in the media playback interface 60a shown, i.e., the media playback interface 21c, will switch to the auxiliary virtual objects in the media playback interface 60a, and the commentary media data display area in the media playback interface 21c will switch to the auxiliary commentary media data display area in the media playback interface 60a.

[0130] It should be understood that when a user needs to disable the commentary media display function (e.g., the bullet comment function) in the application client, they can perform a disable operation on the commentary media display function in the media playback interface. In this way, the application client can display the commentary media data control controls associated with the commentary media display function in the media playback interface. Furthermore, the application client can respond to a trigger operation on the commentary media data control controls by displaying a commentary media data disable control. Furthermore, the application client can respond to a disable operation on the commentary media data disable control by de-displaying the auxiliary virtual object and the auxiliary commentary media data display area associated with the auxiliary virtual object in the target area of ​​the media playback interface.

[0131] The closing operation here may include contact operations such as clicking, long pressing, and swiping, or non-contact operations such as voice and gestures; this application does not limit it.

[0132] For easier understanding, please refer to Figure 6 , Figure 6 This is a schematic diagram illustrating a scenario where the commentary media display function is disabled, as provided in an embodiment of this application. The media playback interface in the application client can be as follows: Figure 6 The media playback interface 60a shown can display target media data. For example... Figure 6 As shown, the application client can respond to a trigger operation on the media playback interface 60a and display a media control interface 60b independent of the media playback interface 60a. The media control interface 60b may include a commentary media data control control 61a associated with the commentary media data display function.

[0133] like Figure 6 As shown, the application client can respond to a trigger operation on the commentary media data control control 61a and display the commentary media data close control 61b. Additionally, the application client can also display a commentary media data launch control, which is open by default and allows the commentary media data display function to be enabled.

[0134] It can be understood that the user of the application client can perform a closing operation on the commentary media data close control 61b. In response to this closing operation, the application client can de-display the auxiliary virtual object and its associated auxiliary commentary media data display area in the target area of ​​the media playback interface 60a, resulting in the media playback interface 60c. Here, the auxiliary virtual object can be the virtual object displayed in the media playback interface 60a, and the auxiliary commentary media data display area can be the commentary media data display area displayed in the media playback interface 60a.

[0135] Therefore, the embodiments of this application can display target media data in the media playback interface, and then activate the commentary media data display function for the target media data. This allows for the display of virtual objects and commentary media data display areas associated with the virtual objects on top of local media data in the target area of ​​the media playback interface. Thus, the display effect of commentary media data can be improved through virtual objects and commentary media data display areas. Furthermore, the impact of commentary media data on the display effect of target media data can be reduced through the relationship between the target area and the virtual objects and commentary media data display areas.

[0136] Further, please see Figure 7 , Figure 7 This is a flowchart illustrating a data processing method provided in an embodiment of this application. The method can be executed by a server, by an application client, or by both a server and an application client. The server can be one of the aforementioned... Figure 2 The server 20a in the corresponding embodiment can be the application client described above. Figure 2 The corresponding application client in the embodiments. For ease of understanding, this application embodiment uses the method executed by the application client as an example for explanation. Steps S201-S204 are... Figure 3 A specific embodiment of step S102 in the corresponding embodiment. The data processing method may include the following steps S201-S207:

[0137] Step S201: Display the commentary media data control controls associated with the commentary media data display function in the media playback interface;

[0138] The specific process of displaying commentary media data control controls on the application client can be found above. Figure 3 The description of step S102 in the corresponding embodiments will not be repeated here.

[0139] Step S202: In response to a trigger operation on the commentary media data control control, display the commentary media data launch control;

[0140] For details on how the application client displays the commentary media data launch control, please refer to the above. Figure 3 The description of step S102 in the corresponding embodiments will not be repeated here.

[0141] Step S203: In response to the launch operation of the launch control for commentary media data, obtain the first set of commentary media data associated with the target media data;

[0142] The first set of commentary media data includes commentary media data obtained from the initial set of commentary media data associated with the target media data based on the first playback progress; the first playback progress is the current playback progress of the target media data in the media playback interface.

[0143] In other words, the application client can obtain the current playback progress of the target media data in the media playback interface, determine the current playback progress as the first playback progress, and then send a request to the server corresponding to the application client to obtain commentary media data based on the first playback progress. This allows the server to obtain commentary media data from the initial set of commentary media data associated with the target media data based on the first playback progress. The obtained commentary media data is then used to form the first set of commentary media data, which is then returned to the application client.

[0144] The first commentary media data includes commentary media data within the requested playback progress interval. The minimum playback progress within the requested playback progress interval is the first playback progress. The interval length of the requested playback progress interval is a pre-configured request interval duration. The request interval duration is less than the total playback duration of the target media data. That is, the application client can obtain the commentary media data associated with the target media data in segments. The commentary media data obtained by the application client in the first playback progress is the commentary media data in the first commentary media data set.

[0145] Optionally, when the commentary media data display function is enabled by default, the application client can directly obtain the first set of commentary media data based on the first playback progress without needing to execute the startup steps for the commentary media data display function in the response media playback interface. Here, the first playback progress can be the initial playback progress of the target media data, the playback progress when the application client last exited playback of the target media data, or the playback progress after navigating to the target media data's playback progress.

[0146] Optionally, before sending a request to the server to retrieve commentary media data based on the first playback progress, the application client can check the local memory of the terminal device (i.e., device memory, which can be used to store commentary media data associated with the application client) to determine whether a first set of commentary media data exists in the local memory. If the first set of commentary media data exists in the local memory, the storage time for storing the first set of commentary media data is determined. Further, if the storage time is within the validity period, the application client can directly use the first set of commentary media data; if the storage time is not within the validity period, the application client can send a request to the server to retrieve the commentary media data. Therefore, when the application client watches the same target media data within a similar time frame, it can directly use the commentary media data stored in the local memory without repeatedly requesting the server to retrieve the commentary media data.

[0147] Step S204: Based on the first set of commentary media data, display the virtual object and the commentary media data display area associated with the virtual object in the target area of ​​the media playback interface;

[0148] Specifically, the application client can perform a search on the first set of commentary media data based on the first playback progress to obtain the search results. Further, if the search results indicate that commentary media data corresponding to the first playback progress is found in the first set of commentary media data, the application client can identify the commentary media data corresponding to the first playback progress as the target commentary media data associated with the target media data. Further, the application client can identify the virtual object matching the target commentary media data and determine the media size of the target commentary media data. Further, the application client can determine the area size of the commentary media data display area associated with the virtual object based on the media size, and display the virtual object and the commentary media data display area with the area size in the target area of ​​the media playback interface.

[0149] The specific process by which the application client determines the media size of the target commentary media data can be found in the above. Figure 3 The description of step S103 in the corresponding embodiment will not be repeated here.

[0150] In reality, there is a time delay in the application client obtaining the first set of commentary media data based on the first playback progress. After receiving the first set of commentary media data, the application client will search for the commentary media data corresponding to the current playback progress in the first set of commentary media data according to the current playback progress of the target media data on the media playback interface (generally, the current playback progress is the playback progress after the first playback progress). For ease of understanding, this application embodiment uses the current playback progress as the first playback progress as an example for explanation.

[0151] Optionally, if the search result indicates that no commentary media data corresponding to the first playback progress is found in the first commentary media data set, the application client can continue searching the first commentary media data set based on the second playback progress when the playback progress of the target media data changes from the first playback progress to the second playback progress. The second playback progress can be the next playback progress after the first playback progress. Because the second playback progress is the next playback progress after the first playback progress, the application client can directly search for the commentary media data corresponding to the second playback progress in the first commentary media data set. The specific process of the application client searching for the commentary media data corresponding to the second playback progress in the first commentary media data set can be found in the description of searching for the commentary media data corresponding to the first playback progress in the first commentary media data set above, and will not be repeated here.

[0152] The playback progress here can be in seconds or frames; this application does not limit the unit of playback progress. For example, when the playback progress is in seconds, the first playback progress can be the 1st second, and the second playback progress can be the 2nd second. For ease of understanding, this application's embodiments will be described using playback progress in seconds as an example.

[0153] Because the application client acquires commentary media data (e.g., bullet screen data) in segments, it always retains bullet screen data for a period of time starting from the current playback progress during the playback of the target media data (e.g., target video data). Users can trigger bullet screen display at any time during the playback of the target media data on the application client, and then periodically refresh the currently displayed bullet screen data according to the bullet screen display duration set (i.e., the user-set commentary media data display duration or the default commentary media data display duration).

[0154] For easier understanding, please refer to Figure 8 , Figure 8 This is a schematic diagram illustrating a process for displaying commentary media data, provided in an embodiment of this application. Figure 8As shown, when the video starts playing (i.e., the video begins playing), assuming the application client has enabled the commentary media data display function, the application client can read the current playback time (e.g., the first playback progress) and then determine whether there are bullet comments at that time (i.e., read the bullet comments at the current time). If there are bullet comments at that time, the bullet comment display time (i.e., the display duration of commentary media data) is read, and the bullet comments corresponding to the first playback progress are displayed in the application client for a certain period of time.

[0155] Optional, such as Figure 8 As shown, if there are no bullet comments at that time, wait for the next second (e.g., the second playback progress), read the playback time of the next second, and then determine whether there are bullet comments at that time. This process continues until there are no comment media data in the first set of comment media data that are associated with the playback progress interval with the next second as the minimum playback progress.

[0156] It is understood that the application client can use an artificial intelligence model to determine a virtual object that matches the target commentary media data. This artificial intelligence model can be a media data analysis model or a commentary media data analysis model. It should be understood that this application embodiment does not limit the model type of the media data analysis model or the commentary media data analysis model.

[0157] Specifically, the application client can input target media data into a media data analysis model. The model then performs scene type analysis on the target media data to determine its media scene type at different playback stages. Further, the application client can extract the media scene type of the target media data at the first playback stage from these different playback stage types. Furthermore, based on the media scene type of the target media data at the first playback stage, the application client can determine a virtual object that matches the target commentary media data. The object attribute type of this virtual object matches the media scene type at the first playback stage.

[0158] Optionally, the application client can input the target commentary media data into a commentary media data analysis model. The model then performs semantic analysis on the target commentary media data to obtain its semantic type. Further, the application client can determine virtual objects that match the target commentary media data based on the semantic type. The object attribute type of the virtual object matches the semantic type.

[0159] Step S205: Obtain the third playback progress corresponding to the target media data;

[0160] The third playback progress is the playback progress after the first playback progress.

[0161] It is understood that if the third playback progress falls within the aforementioned requested playback progress range, the application client can perform a search and processing on the first set of commentary media data based on the third playback progress. Optionally, if the third playback progress does not fall within the aforementioned requested playback progress range, the application client can execute the following step S206. For ease of understanding, this embodiment of the application will be described using the example of the third playback progress not falling within the aforementioned requested playback progress range.

[0162] The third playback progress can be the playback progress obtained by playing the target media data sequentially. Optionally, the third playback progress can also be the playback progress obtained by jumping to different parts of the target media data.

[0163] Step S206: If there is no commentary media data associated with the target playback progress interval in the device memory, then based on the third playback progress, obtain the second set of commentary media data associated with the target media data;

[0164] The second set of commentary media data includes commentary media data obtained from the initial set of commentary media data associated with the target media data based on the target playback progress interval; the minimum playback progress in the target playback progress interval is the third playback progress.

[0165] The specific process by which the application client obtains the second set of commentary media data associated with the target media data based on the third playback progress can be found in the description above of obtaining the first set of commentary media data associated with the target media data based on the first playback progress, and will not be repeated here.

[0166] The target playback progress interval has a length that is a pre-configured request interval, which is less than the total playback duration of the target media data. The target playback progress interval length is equal to the length of the requested playback progress interval; however, this embodiment does not limit the interval length.

[0167] Understandably, since the target media data is played sequentially in the media playback interface, if the third playback progress does not belong to the requested playback progress interval, then the third playback progress can be determined as the minimum playback progress of the target playback progress interval. The target playback progress interval is the next playback progress interval after the requested playback progress interval.

[0168] Step S207: When the playback progress of the target media data played in the media playback interface is the third playback progress, based on the second set of commentary media data, the updated virtual object and the updated commentary media data display area associated with the updated virtual object are displayed in the target area of ​​the media playback interface.

[0169] The process by which the application client, based on the second set of commentary media data, displays updated virtual objects and associated updated commentary media data display areas in the target area of ​​the media playback interface is detailed above. This process is similar to the description above regarding the display of virtual objects and associated commentary media data display areas in the target area of ​​the media playback interface based on the first set of commentary media data, and will not be repeated here. The "updating virtual object" function can be used to update virtual objects, and the "updating commentary media data display area" function can be used to update commentary media data display areas.

[0170] The specific process by which the application client determines the update of the virtual object can be found in the description of determining the virtual object above. The specific process by which the application client determines the update of the commentary media data display area can also be found in the description of determining the commentary media data display area above. These details will not be repeated here.

[0171] It is understandable that, considering a target media data (e.g., a film) may be 2-3 hours long, even if there is one bullet comment per second of the film, there may be tens of thousands of bullet comments. It is impractical to return tens of thousands of bullet comments to the client at once. Therefore, in this embodiment, the bullet comment data can be loaded in segments by the client, and the client needs to preload the data to ensure that no bullet comment data is missed.

[0172] Specifically, the application client does not retrieve the second set of commentary media data only when the playback progress of the target media data in the media playback interface reaches the third playback progress; instead, it retrieves the second set of commentary media data before reaching the third playback progress. The application client can retrieve the second set of commentary media data based on the third playback progress when the playback progress of the target media data in the media playback interface reaches the fourth playback progress, where the fourth playback progress refers to the playback progress between the third and fourth playback progresses. For example, the application client can retrieve the commentary media data from the 6th to the 15th second at the 5th second. Here, the 5th second can be considered the fourth playback progress, the 6th second can be considered the third playback progress, and the commentary media data from the 6th to the 15th second can be considered the commentary media data in the second set of commentary media data.

[0173] For easier understanding, please refer to Figure 9 , Figure 9 This is a schematic diagram illustrating a process for segmented preloading of a set of commentary media data provided in an embodiment of this application. For example... Figure 9As shown, when a video starts playing (i.e., when the video begins playing), the application client can read the current playback time (e.g., the third playback progress) and then determine whether there are any bullet comments at that time (i.e., determine whether there is any commentary media data in the device memory associated with the target playback progress interval). If there are bullet comments at that time, then through the above... Figure 8 The flowchart shown illustrates the bullet comments. In reality, the current playback time is not equal to the third playback progress, but rather can be the playback progress preceding the third playback progress.

[0174] Optional, such as Figure 9 As shown, if no comments are present at a given time, the application client can request the backend (i.e., the server) to load comment data in segments (e.g., 10 minutes) (i.e., the second set of commentary media data). It then continues to read the latest playback time (e.g., the playback progress following the third playback progress) to determine if comments exist at that time, and so on, until the playback time read is the last playback progress of the target media data. In reality, the latest playback time is not necessarily equal to the playback progress following the third playback progress; it can be the third playback progress itself.

[0175] For easier understanding, please refer to Figure 10a and Figure 10b , Figure 10a and Figure 10b This is a schematic diagram illustrating a scenario for switching commentary media data, provided in an embodiment of this application. For example... Figure 10a As shown, media playback interface 10a can be the media playback interface of the application client at the first playback progress (e.g., moment 1), media playback interface 10b can be the media playback interface of the application client at the second playback progress (e.g., moment 2), ..., media playback interface 10c can be the media playback interface of the application client at the fifth playback progress (e.g., moment n). Here, moment n can be any moment after moment 2.

[0176] like Figure 10a As shown, the application client can search for commentary media data corresponding to time 1. If no commentary media data corresponding to time 1 is found, the playback progress of the target media data in the media playback interface 10a is moved from time 1 to time 2. Furthermore, the application client can search for commentary media data corresponding to time 2. If no commentary media data corresponding to time 2 is found, the playback progress of the target media data in the media playback interface 10b is moved from time 2 to time 3 (not shown in the figure).

[0177] This process continues until the application client finds the commentary media data corresponding to time n. When the commentary media data corresponding to time n is found, the virtual object 11b and the commentary media data display area 11c are displayed in the target area 11a of the media playback interface 10c. The commentary media data display area 11c includes the target commentary media data (i.e., the commentary media data corresponding to time n), which can be something like "This person is so fierce!". This target commentary media data can be associated with the virtual object 11b, and the commentary media data display area 11c can be associated with the virtual object 11b.

[0178] Optional, such as Figure 10b As shown, media playback interface 10d can be the media playback interface of the application client at the first playback progress (e.g., the first moment), media playback interface 10e can be the media playback interface of the application client at the second playback progress (e.g., the second moment), ..., media playback interface 10c can be the media playback interface of the application client at the fifth playback progress (e.g., the nth moment). Figure 10b The media playback interface 10c shown can be Figure 10a The media playback interface 10c is shown. Here, the nth time can be any time after the second time.

[0179] like Figure 10b As shown, the application client can search for the commentary media data corresponding to the first moment. When the commentary media data corresponding to the first moment is found, a virtual object 12b and a commentary media data display area 12c are displayed in the target area 12a of the media playback interface 10d. The commentary media data display area 12c includes the target commentary media data, which can be "Wow, that sounds good!". This target commentary media data can be associated with the virtual object 12b, and the commentary media data display area 12c can be associated with the virtual object 12b. Furthermore, the application client can continue to display the virtual object 12b and the commentary media data display area 12c in the media playback interface 10e at the second moment, based on the duration of the commentary media data display.

[0180] This process continues until the application client finds the commentary media data corresponding to time n. When the commentary media data corresponding to time n is found, a virtual object 11b is displayed in the target area 11a of the media playback interface 10c (see...). Figure 10a ) and commentary media data display area 11c (see Figure 10aOptionally, the application client may also continue to display the virtual object 11b in the media playback interface 10c at time n, based on the duration of the commentary media data presentation, at any time before time n (e.g., time (n-1) (not shown in the figure)). Figure 10a ) and commentary media data display area 11c (see Figure 10a ).

[0181] Therefore, the embodiments of this application can activate the commentary media data display function in the media playback interface. Based on the playback progress of the target media data in the media playback interface, a set of commentary media data associated with the target media data is obtained. Then, based on the obtained set of commentary media data, a virtual object and a display area of ​​commentary media data associated with the virtual object are displayed in the target area of ​​the media playback interface. Based on this, this application proposes an atypical commentary media data display scheme. When watching the target media data, a virtual image can be constructed in the target area. The commentary media data is displayed according to the current playback progress through the virtual image using cartoon-like bubbles, providing a feeling of the virtual image commenting on the plot. This indirectly displays the commentary media data in the media playback interface, thereby improving the display effect of the commentary media data and reducing the impact of the commentary media data on the display effect of the target media data.

[0182] Further, please see Figure 11 , Figure 11 This is a flowchart illustrating a data processing method provided in an embodiment of this application. The method can be executed by a server, by an application client, or by both a server and an application client. The server can be one of the aforementioned... Figure 2 The server 20a in the corresponding embodiment can be the application client described above. Figure 2 The corresponding application client in the embodiments. For ease of understanding, this application embodiment uses the method executed by the server as an example for illustration. The data processing method may include the following steps S301-S302:

[0183] Step S301: Receive a request from the application client to obtain commentary media data for target media data in the media playback interface; and obtain a first set of commentary media data associated with the target media data based on the request.

[0184] The request for retrieving commentary media data is sent by the application client after it responds to the activation operation of the commentary media data display function in the media playback interface.

[0185] Understandably, the server can receive a request from the application client to retrieve commentary media data for target media data in the media playback interface. Based on the first playback progress carried in the commentary media data retrieval request, the server retrieves a first set of commentary media data associated with the target media data from the initial set of commentary media data. Here, the first playback progress refers to the current playback progress of the target media data in the application client's media playback interface, and the first set of commentary media data includes commentary media data starting from the first playback progress.

[0186] Step S302: Return the first set of commentary media data to the application client.

[0187] Upon receiving the first set of commentary media data, the application client can, based on this first set of commentary media data, display a virtual object and a display area for commentary media data associated with the virtual object within a target area of ​​the media playback interface. Furthermore, within the commentary media data display area, target commentary media data associated with the target media data is displayed. The virtual object and the commentary media data display area are displayed overlaid on the local media data, which is the media data located within the target area of ​​the media playback interface from the target media data. The first set of commentary media data includes the target commentary media data. The size of the commentary media data display area matches the media size of the target commentary media data.

[0188] Understandably, after receiving the first set of commentary media data, the application client can perform a search on the first set of commentary media data based on the first playback progress. When it finds commentary media data corresponding to the first playback progress within the first set of commentary media data, it identifies that commentary media data as the target commentary media data. Furthermore, the application client can determine the virtual object matching the target media data, determine the media size of the target media data, and then, based on the media size, determine the area size of the commentary media data display area associated with the virtual object. Within the target area of ​​the media playback interface, the virtual object and the commentary media data display area with the defined area size are then displayed.

[0189] Optionally, when the server obtains the first set of commentary media data associated with the target media data, it can determine the virtual object that matches each commentary media data in the first set of commentary media data, determine the media size of each commentary media data, and then return the virtual object, media size, and the first set of commentary media data to the application client. This allows the application client to directly determine the area size of the commentary media data display area associated with the virtual object based on the media size, and display the virtual object and the commentary media data display area with the area size in the target area of ​​the media playback interface.

[0190] Therefore, in this embodiment, the server, upon receiving a request from the application client to retrieve commentary media data related to target media data in the media playback interface, can obtain a set of commentary media data associated with the target media data based on the request, and then return the retrieved set of commentary media data to the application client. Thus, this embodiment can retrieve the set of commentary media data associated with the playback progress of the target media data in segments according to the playback progress in the media playback interface, thereby improving the efficiency of retrieving commentary media data and thus improving the efficiency of displaying commentary media data by the application client.

[0191] Further, please see Figure 12 , Figure 12 This is a flowchart illustrating a data processing method provided in an embodiment of this application. The method can be executed by a server, by an application client, or by both a server and an application client. The server can be one of the aforementioned... Figure 2 The server 20a in the corresponding embodiment can be the application client described above. Figure 2 The corresponding application client in the embodiments. For ease of understanding, this application embodiment uses the method executed by the server as an example for illustration. The data processing method may include the following steps S401-S407:

[0192] Step S401: Obtain a comprehensive set of commentary media data associated with the target media data, and obtain key text filtering data for filtering the comprehensive set of commentary media data;

[0193] The comprehensive commentary media dataset can include all commentary media data associated with the target media data, and the key text filtering data can be used to filter all commentary media data to obtain filtered commentary media data.

[0194] It should be understood that the commentary media data associated with the target media data is constantly changing. Therefore, the comprehensive commentary media data set associated with the target media data is also constantly changing; that is, the target media data has different comprehensive commentary media data sets at different times. The server can periodically obtain the latest comprehensive commentary media data set and then filter it. For example, at time T1, the comprehensive commentary media data set associated with the target media data may include L1 (e.g., 2) commentary media data, and at time T2, it may include L2 (e.g., 5) commentary media data, where L1 and L2 can be positive integers.

[0195] It is understandable that key text filtering data can be sensitive words (i.e., keywords). Key text filtering data can represent words that are not suitable for display in the application client. Here, sensitive words can represent vulgar words, as well as other sensitive words. Not all sensitive words will be listed here.

[0196] Step S402: Filter the commentary media data containing key text filtering data in the comprehensive commentary media data set, and determine the filtered comprehensive commentary media data set as the filtered commentary media data set;

[0197] Specifically, when all commentary media data contains key text filtering data, all commentary media data containing key text filtering data is removed to obtain filtered commentary media data. This filtered commentary media data does not contain key text filtering data. Furthermore, the server can construct a filtered commentary media data set from this filtered commentary media data.

[0198] Step S403: Aggregate the commentary media data in the filtered commentary media data set to obtain an initial commentary media data set associated with the target media data;

[0199] Specifically, the server can obtain the commentary media time indicated by the commentary media data in the filtered commentary media data set, and divide the commentary media data in the filtered commentary media data set according to the commentary media time to obtain a segmented commentary media data set. Each commentary media data in a segmented commentary media data set indicates the same commentary media time. Further, the server can obtain the comprehensive semantic similarity corresponding to each commentary media data in the segmented commentary media data set, and select the commentary media data with the highest comprehensive semantic similarity in the segmented commentary media data set as the commentary media data with a mapping relationship to the commentary media time. The comprehensive semantic similarity corresponding to a commentary media data is determined by the semantic similarity between that commentary media data and each commentary media data in its respective segmented commentary media data set. Further, the server can construct an initial commentary media data set associated with the target media data from the commentary media data with the commentary media time mapping relationship.

[0200] Understandably, for each partitioned commentary media dataset, the server can analyze the commentary media data within that dataset to obtain the semantic similarity between each piece of commentary media data (e.g., commentary media data K) and the remaining commentary media data in that partitioned dataset, thereby determining the comprehensive semantic similarity for each piece of commentary media data. Here, the remaining commentary media data can represent the commentary media data in the partitioned dataset containing commentary media data K, excluding commentary media data K itself.

[0201] Understandably, the server can construct an initial set of commentary media data by mapping commentary media data with key information to each commentary media time. This set of commentary media data with key information to each commentary media time can represent the most relevant commentary media data for each commentary media time. For example, the target media data may include three time points, specifically T. 11 Time, T 12 Time and T 13 At time T, if the time indicated by the commentary media data in the filtered commentary media dataset is... 12 Time and T 13 At that time, the server can aggregate the commentary media data in the filtered commentary media data set and then combine it with T. 12 Time and T 13 The commentary media data, which have mapping relationships at different times, constitute the initial set of commentary media data.

[0202] Because commentary media data (e.g., bullet screen data) is strongly correlated with media playback time (e.g., video playback time), servers typically use the structure shown in Table 1 below when storing commentary media data:

[0203] Table 1

[0204]

[0205] As shown in Table 1, DM represents the commentary media data identifier (i.e., the bullet screen ID), UID represents the sender, VID represents the media data identifier (i.e., the video ID), and the time point can represent the commentary media time. Optionally, the commentary media data can also include other information, such as speed and color. Here, speed can represent the display time of the commentary media data in the application client (i.e., different commentary media data have different display durations), and color can represent the display color of the commentary media data in the application client.

[0206] Specifically, DM0001 indicates that at 600 seconds (i.e., 600s) of video VID0002, the commentary media data "Wow, that sounds good!" sent by UID0001 needs to be displayed; DM0002 indicates that at 608 seconds (i.e., 608s) of video VID0002, the commentary media data "This person is so fierce!" sent by UID0002 needs to be displayed.

[0207] Optionally, the server can also obtain a comprehensive set of commentary media data associated with the target media data, segment the commentary media data in the comprehensive set of commentary media data, and obtain an aggregated set of commentary media data associated with the target media data. Further, the server can obtain key text filtering data for filtering the aggregated set of commentary media data, filter the commentary media data containing the key text filtering data in the aggregated set of commentary media data, and determine the segmented set of commentary media data as the final set of aggregated set of commentary media data.

[0208] For easier understanding, please refer to Figure 13 , Figure 13 This is a schematic diagram illustrating a process for determining an initial set of commentary media data, provided in an embodiment of this application. Figure 13As shown, the server can obtain a comprehensive commentary media data set 130a associated with the target media data. The comprehensive commentary media data set 130a may include multiple commentary media data. Here, we take an example where the number of commentary media data in the comprehensive commentary media data set 130a is 5. The 5 commentary media data may specifically include: commentary media data 13a, commentary media data 13b, commentary media data 13c, commentary media data 13d, and commentary media data 13e.

[0209] Understandably, based on the time point and the video ID, one can find all the commentary media data (e.g., all bullet comments) that can be displayed for the same video at a specific moment. Dividing these bullet comments can yield multiple aggregated commentary media data sets. Specifically, commentary media data 13a and 13b correspond to commentary media time point T1, while commentary media data 13c, 13d, and 13e correspond to commentary media time point T2. By dividing these five commentary media data sets, commentary media data 13a and 13b can form aggregated commentary media data set 130b, and commentary media data 13c, 13d, and 13e can form aggregated commentary media data set 130c.

[0210] like Figure 13 As shown, the server can filter the commentary media data containing key text filtering data in aggregated commentary media data set 130b and aggregated commentary media data set 130c to obtain segmented commentary media data set 130d corresponding to aggregated commentary media data set 130b, and segmented commentary media data set 130e corresponding to aggregated commentary media data set 130c. Segmented commentary media data set 130d includes commentary media data 13a, and segmented commentary media data set 130e includes commentary media data 13c and commentary media data 13e.

[0211] Understandably, the server can directly use commentary media data 13a from the segmented commentary media data set 130d as the commentary media data with a specific mapping relationship at time T1. When the comprehensive semantic similarity corresponding to commentary media data 13c is greater than the comprehensive semantic similarity corresponding to commentary media data 13e, the server can use commentary media data 13c from the segmented commentary media data set 130e as the commentary media data with a specific mapping relationship at time T2. Further, the server can use commentary media data 13a and commentary media data 13c to form an initial commentary media data set associated with the target media data. Optionally, the server can also randomly obtain commentary media data (e.g., commentary media data 13c) from the segmented commentary media data set 130e to determine the obtained commentary media data as the commentary media data with a specific mapping relationship at time T2.

[0212] Optionally, the server can also directly filter the commentary media data containing key text filtering data in the comprehensive commentary media data set 130a to obtain a filtered commentary media data set (not shown in the figure). This filtered commentary media data set (not shown in the figure) may include commentary media data 13a, commentary media data 13c, and commentary media data 13e. Further, the server can partition the commentary media data 13a, commentary media data 13c, and commentary media data 13e to obtain partitioned commentary media data sets 130d and 130e.

[0213] Step S404: Send the initial set of commentary media data to the management device used to monitor the application client;

[0214] It should be understood that, in order to ensure that the application client loads commentary media data (e.g., bullet screen data) from the background more quickly, and to provide an initial set of commentary media data to the management device for review in advance, it is necessary to periodically generate and save the initial set of commentary media data, and periodically send the latest generated set of initial commentary media data to the management device for review. When the terminal device is a smart TV, a video client is installed on the smart TV. The management device here can be the licensee corresponding to the TV (i.e., television) end (i.e., the smart TV). This licensee can be an integrated broadcast control platform with an internet TV license that controls the broadcast of internet content accessed by the smart TV. It should be understood that displaying commentary media data in the atypical manner provided in this application embodiment can pass the licensee's review.

[0215] Understandably, after receiving the initial set of commentary media data, the management device can review the initial set of commentary media data, obtain the review results, and then return the review results to the server.

[0216] Step S405: Receive the audit result returned by the management device;

[0217] Understandably, if the review result is a pass result (i.e., the review result indicates successful review), the server can execute step S406, which involves retrieving the first set of commentary media data associated with the target media data from the initial set of commentary media data based on the first playback progress carried by the commentary media data retrieval request.

[0218] Optionally, if the review result is a failure (i.e., the review result indicates that the review failed), the server can re-execute the above steps S401-S403 to determine the initial set of commentary media data associated with the target media data.

[0219] Terminal devices are generally divided into TV terminals (i.e., smart TVs) and non-TV terminals (e.g., laptops). However, the playback data (i.e., target media data, such as target video data) is only stored once by the server, and the same applies to commentary media data (e.g., bullet screen data). Clearly, general bullet screen data (i.e., all bullet screen data) contains hundreds or even more data entries at any given time. For the atypical bullet screen provided in this application, only one entry needs to be displayed every few seconds, and this atypical bullet screen can be used for display on the TV terminal. Therefore, a solution is needed to generate atypical bullet screen data (i.e., commentary media data in the initial set of commentary media data) from general bullet screen data.

[0220] For easier understanding, please refer to Figure 14 , Figure 14 This is a schematic diagram illustrating a process for generating an initial set of commentary media data, provided in an embodiment of this application. For example... Figure 14 As shown, the server can load general bullet comment data (i.e., commentary media data from a comprehensive set of commentary media data), filter the general bullet comment data, and obtain filtered general bullet comment data. Further, the server can read the first second of the filtered general bullet comment data to determine if bullet comment data exists in that second. If bullet comment data exists, the server reads the data for that second, performs statistical analysis and categorizes it to obtain the most typical bullet comment data corresponding to that second (i.e., the bullet comment data with the highest comprehensive semantic similarity). Further, the server can read the next second of the filtered general bullet comment data and execute the above steps sequentially until the entire film has been processed.

[0221] Optionally, if there is no bullet comment data in a given second, the system checks whether the server has already processed the entire video. If the server has processed the entire video, the process ends. To address the issue of a second without bullet comment data if not all bullet comment data has been processed, the server can continue reading bullet comment data for the next second, repeating the above steps until the entire video has been processed.

[0222] Step S406: Receive a request from the application client to obtain commentary media data for the target media data in the media playback interface; and obtain a first set of commentary media data associated with the target media data from the initial set of commentary media data based on the first playback progress carried in the request.

[0223] Specifically, the server can receive a request from the application client to retrieve commentary media data for target media data in the media playback interface. Further, the server can determine the requested playback progress interval corresponding to the first playback progress carried in the commentary media data retrieval request. The minimum playback progress within the requested playback progress interval is the first playback progress; the interval length is a pre-configured request interval duration, which is less than the total playback duration of the target media data. Further, the server can retrieve commentary media data within the requested playback progress interval from the initial commentary media data set, and combine this data to form a first commentary media data set associated with the target media data.

[0224] Step S407: Return the first set of commentary media data to the application client.

[0225] Therefore, this application embodiment can acquire a comprehensive set of commentary media data associated with the target media data, generate an initial set of commentary media data associated with the target media data based on this comprehensive set of commentary media data, and then send this initial set of commentary media data to the management device for review. Thus, after receiving a request for commentary media data from the application client, the server can retrieve a first set of commentary media data associated with the target media data from the initial set of commentary media data, and then return this first set of commentary media data to the application client. Based on this, this application embodiment can achieve segmented acquisition of commentary media data to simplify the display of commentary media data in the application client.

[0226] Further, please see Figure 15 , Figure 15This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application. The data processing device 10 may include: a first display module 101, a second display module 102, and a third display module 103.

[0227] The first display module 101 is used to display target media data in the media playback interface;

[0228] The second display module 102 is used to respond to the start operation of the commentary media data display function in the media playback interface. In the target area of ​​the media playback interface, a virtual object and a commentary media data display area associated with the virtual object are displayed. The virtual object and the commentary media data display area are displayed on top of the local media data, which is the media data located in the target area of ​​the media playback interface in the target media data.

[0229] The third display module 103 is used to display target commentary media data associated with the target media data in the commentary media data display area; the area size of the commentary media data display area matches the media size of the target commentary media data.

[0230] The specific implementation methods of the first display module 101, the second display module 102, and the third display module 103 can be found in the above description. Figure 3 The descriptions of steps S101-S103 in the corresponding embodiments will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated.

[0231] Further, please see Figure 16 , Figure 16 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application. The data processing device 1 may include: a first display module 11, a second display module 12, and a third display module 13; further, the data processing device 1 may also include: a fourth display module 14, a fifth display module 15, and a duration determination module 16.

[0232] The first display module 11 is used to display target media data in the media playback interface;

[0233] The second display module 12 is used to respond to the start operation of the commentary media data display function in the media playback interface. In the target area of ​​the media playback interface, a virtual object and a commentary media data display area associated with the virtual object are displayed. The virtual object and the commentary media data display area are displayed on top of the local media data, which is the media data located in the target area of ​​the media playback interface in the target media data.

[0234] The second display module 12 includes: a first display unit 121, a second display unit 122, and a third display unit 123;

[0235] The first display unit 121 is used to display commentary media data control controls associated with the commentary media data display function in the media playback interface;

[0236] The second display unit 122 is used to display the commentary media data launch control in response to a trigger operation on the commentary media data control control.

[0237] The third display unit 123 is used to respond to the launch operation of the commentary media data launch control and display a virtual object and a commentary media data display area associated with the virtual object in the target area of ​​the media playback interface.

[0238] The third display unit 123 includes: a first acquisition subunit 1231 and a first display subunit 1232; optionally, the third display unit 123 may further include: a progress acquisition subunit 1233, a second acquisition subunit 1234, and a second display subunit 1235.

[0239] The first acquisition subunit 1231 is used to respond to the launch operation of the launch control for commentary media data and acquire a first set of commentary media data associated with the target media data; the first set of commentary media data includes commentary media data acquired from an initial set of commentary media data associated with the target media data based on a first playback progress; the first playback progress is the current playback progress of the target media data in the media playback interface;

[0240] The first display subunit 1232 is used to display a virtual object and a commentary media data display area associated with the virtual object in a target area of ​​the media playback interface based on a first set of commentary media data.

[0241] The first display subunit 1232 includes: a search processing subunit 12321, a first search subunit 12322, and a region display subunit 12323; optionally, the first display subunit 1232 may further include: a second search subunit 12324.

[0242] The search processing subunit 12321 is used to perform search processing on the first set of commentary media data based on the first playback progress to obtain the search result;

[0243] The first search subunit 12322 is used to determine the commentary media data corresponding to the first playback progress as the target commentary media data associated with the target media data if the search result indicates that the commentary media data corresponding to the first playback progress is found in the first commentary media data set.

[0244] The area display subunit 12323 is used to determine the virtual object that matches the target commentary media data and to determine the media size of the target commentary media data;

[0245] The area display subunit 12323 is used to determine the area size of the commentary media data display area associated with the virtual object based on the media size, and to display the virtual object and the commentary media data display area with the area size in the target area of ​​the media playback interface.

[0246] Among them, the area display subunit 12323 is specifically used to input the target media data into the media data analysis model, and to perform scene type analysis on the target media data through the media data analysis model to obtain the media scene type of the target media data at different playback progress.

[0247] The area display subunit 12323 is specifically used to obtain the media scene type of the target media data in the first playback progress from the media scene types of the target media data in different playback progresses;

[0248] The area display subunit 12323 is specifically used to determine a virtual object that matches the target commentary media data based on the media scene type of the target media data in the first playback progress; the object attribute type of the virtual object matches the media scene type of the first playback progress.

[0249] Among them, the area display subunit 12323 is specifically used to input the target commentary media data into the commentary media data analysis model, and to perform semantic analysis on the target commentary media data through the commentary media data analysis model to obtain the semantic type of the target commentary media data;

[0250] The area display subunit 12323 is specifically used to determine virtual objects that match the target commentary media data based on semantic type; the object attribute type of the virtual object matches the semantic type.

[0251] Optionally, the second search subunit 12324 is used to continue searching the first set of commentary media data based on the second playback progress when the playback progress of the target media data moves from the first playback progress to the second playback progress if the search result indicates that no commentary media data corresponding to the first playback progress is found in the first commentary media data; the second playback progress is the next playback progress of the first playback progress.

[0252] The specific implementation methods of the search processing subunit 12321, the first search subunit 12322, the area display subunit 12323, and the second search subunit 12324 can be found above. Figure 7 The description of step S204 in the corresponding embodiments will not be repeated here.

[0253] Optionally, the progress acquisition subunit 1233 is used to acquire the third playback progress corresponding to the target media data; the third playback progress is the playback progress after the first playback progress.

[0254] The second acquisition subunit 1234 is used to acquire a second set of commentary media data associated with the target media data based on the third playback progress if no commentary media data associated with the target playback progress interval exists in the device memory; the second set of commentary media data includes commentary media data acquired from the initial set of commentary media data associated with the target media data based on the target playback progress interval; the minimum playback progress in the target playback progress interval is the third playback progress.

[0255] The length of the target playback progress interval is the pre-configured request interval duration, which is less than the total playback duration of the target media data.

[0256] The second display subunit 1235 is used to display an updated virtual object and an updated commentary media data display area associated with the updated virtual object in the target area of ​​the media playback interface when the playback progress of the target media data played in the media playback interface is the third playback progress, based on the second set of commentary media data.

[0257] The specific implementation methods of the first acquisition subunit 1231, the first display subunit 1232, the progress acquisition subunit 1233, the second acquisition subunit 1234, and the second display subunit 1235 can be found above. Figure 7 The descriptions of steps S203-S207 in the corresponding embodiments will not be repeated here.

[0258] The specific implementation methods of the first display unit 121, the second display unit 122, and the third display unit 123 can be found in the above description. Figure 3 In the corresponding embodiment, steps S102 and Figure 7 The descriptions of steps S201-S207 in the corresponding embodiments will not be repeated here.

[0259] The third display module 13 is used to display target commentary media data associated with the target media data in the commentary media data display area; the area size of the commentary media data display area matches the media size of the target commentary media data.

[0260] Optionally, the fourth display module 14 is used to display the commentary media data update control associated with the commentary media data update function in the media playback interface;

[0261] The fifth display module 15 is used to respond to the trigger operation of the commentary media data update control and display N display duration controls; N is a positive integer;

[0262] The duration determination module 16 is used to respond to the trigger operation of the target display duration control among the N display duration controls, and to determine the display duration of the commentary media data indicated by the target display duration control as the display duration of the commentary media data corresponding to the target media data;

[0263] The third display module 13 is specifically used to display target commentary media data associated with the target media data in the commentary media data display area based on the display duration of commentary media data corresponding to the target media data.

[0264] The specific implementation methods of the first display module 11, the second display module 12, the third display module 13, the fourth display module 14, the fifth display module 15, and the duration determination module 16 can be found in the above description. Figure 3 In the corresponding embodiment, steps S101-S103 and Figure 7 The descriptions of steps S201-S207 in the corresponding embodiments will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. The first display module 11 corresponds to the above... Figure 15 The first display module 101 in the corresponding embodiment and the second display module 12 correspond to the above. Figure 15 The second display module 102 and the third display module 13 in the corresponding embodiments correspond to the above. Figure 15 The third display module 103 in the corresponding embodiment.

[0265] Further, please see Figure 17 , Figure 17 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application. The data processing device 20 may include: a request receiving module 201 and a collection return module 202.

[0266] The request receiving module 201 is used to receive a request from the application client to obtain commentary media data for target media data in the media playback interface, and to obtain a first set of commentary media data associated with the target media data based on the request. The request for obtaining commentary media data is sent by the application client after responding to the start operation of the commentary media data display function in the media playback interface.

[0267] The collection return module 202 is used to return the first set of commentary media data to the application client, so that the application client can display a virtual object and a display area of ​​commentary media data associated with the virtual object in the target area of ​​the media playback interface based on the first set of commentary media data. In the commentary media data display area, the target commentary media data associated with the target media data is displayed. The virtual object and the commentary media data display area are displayed on top of the local media data, which is the media data located in the target area of ​​the media playback interface from the target media data. The first set of commentary media data includes the target commentary media data. The area size of the commentary media data display area matches the media size of the target commentary media data.

[0268] The specific implementation methods of the request receiving module 201 and the set return module 202 can be found in the above description. Figure 11 The descriptions of steps S301-S302 in the corresponding embodiments will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated.

[0269] Further, please see Figure 18 , Figure 18 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application. The data processing device 2 may include: a request receiving module 21 and a collection return module 22; further, the data processing device 2 may also include: a data acquisition module 23, a filtering processing module 24, an aggregation processing module 25, a collection review module 26, and a result receiving module 27.

[0270] The request receiving module 21 is used to receive a request from the application client to obtain commentary media data for target media data in the media playback interface, and to obtain a first set of commentary media data associated with the target media data based on the request. The request for obtaining commentary media data is sent by the application client after responding to the start operation of the commentary media data display function in the media playback interface.

[0271] The collection return module 22 is used to return the first set of commentary media data to the application client, so that the application client can display a virtual object and a display area of ​​commentary media data associated with the virtual object in the target area of ​​the media playback interface based on the first set of commentary media data. In the commentary media data display area, the target commentary media data associated with the target media data is displayed. The virtual object and the commentary media data display area are displayed on top of the local media data, which is the media data located in the target area of ​​the media playback interface from the target media data. The first set of commentary media data includes the target commentary media data. The area size of the commentary media data display area matches the media size of the target commentary media data.

[0272] Optionally, the data acquisition module 23 is used to acquire a comprehensive set of commentary media data associated with the target media data, and to acquire key text filtering data for filtering the comprehensive set of commentary media data;

[0273] The filtering processing module 24 is used to filter the commentary media data containing key text filtering data in the comprehensive commentary media data set, and to determine the comprehensive commentary media data set after filtering as the filtered commentary media data set;

[0274] The aggregation processing module 25 is used to aggregate the commentary media data in the filtered commentary media data set to obtain an initial commentary media data set associated with the target media data;

[0275] The aggregation processing module 25 includes: a data partitioning unit 251, a time mapping unit 252, and a first constituent unit 253;

[0276] Data partitioning unit 251 is used to obtain the commentary media time indicated by the commentary media data in the filtered commentary media data set, and partition the commentary media data in the filtered commentary media data set according to the commentary media time to obtain a partitioned commentary media data set; each commentary media data in a partitioned commentary media data set indicates the same commentary media time;

[0277] The time mapping unit 252 is used to obtain the comprehensive semantic similarity corresponding to each piece of commentary media data in the segmented commentary media data set, and to take the commentary media data with the highest comprehensive semantic similarity in the segmented commentary media data set as the commentary media data with a mapping relationship with the commentary media time; the comprehensive semantic similarity corresponding to a piece of commentary media data is determined by the semantic similarity between the commentary media data and each piece of commentary media data in the segmented commentary media data set to which it belongs;

[0278] The first constituent unit 253 is used to form an initial set of commentary media data associated with the target media data by taking commentary media data that has a mapping relationship with the commentary media time.

[0279] The specific implementation methods of the data partitioning unit 251, the time mapping unit 252, and the first constituent unit 253 can be found in the above description. Figure 12 The description of step S403 in the corresponding embodiment will not be repeated here.

[0280] The request receiving module 21 is specifically used to obtain the first set of commentary media data associated with the target media data from the initial set of commentary media data based on the first playback progress carried in the request for commentary media data.

[0281] The request receiving module 21 includes: an interval determination unit 211 and a second constituting unit 212;

[0282] The interval determination unit 211 is used to obtain the first playback progress carried by the request based on the commentary media data, and determine the playback progress interval to be requested corresponding to the first playback progress; the minimum playback progress in the playback progress interval to be requested is the first playback progress; the interval length of the playback progress interval to be requested is the pre-configured request interval duration, and the request interval duration is less than the total playback duration of the target media data.

[0283] The second constituent unit 212 is used to obtain the commentary media data within the requested playback progress interval from the initial commentary media data set, and to form a first commentary media data set associated with the target media data from the commentary media data within the requested playback progress interval.

[0284] The specific implementation of the interval determination unit 211 and the second constituting unit 212 can be found in the above description. Figure 12 The description of step S406 in the corresponding embodiment will not be repeated here.

[0285] Optionally, the collection review module 26 is used to send the initial commentary media data set to the management device used for monitoring application clients, so that the management device can review the initial commentary media data set and obtain the review result;

[0286] The result receiving module 27 is used to receive the review result returned by the management device. If the review result is a pass result, the step of obtaining the first set of commentary media data associated with the target media data from the initial set of commentary media data based on the first playback progress carried by the commentary media data acquisition request is executed.

[0287] The specific implementation methods of the request receiving module 21, the collection return module 22, the data acquisition module 23, the filtering processing module 24, the aggregation processing module 25, the collection review module 26, and the result receiving module 27 can be found above. Figure 11 In the corresponding embodiment, steps S301-S302 and Figure 12 The descriptions of steps S401-S407 in the corresponding embodiments will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. The request receiving module 21 corresponds to the above... Figure 17 The request receiving module 201 and the set return module 22 in the corresponding embodiments correspond to the above. Figure 17 The set return module 202 in the corresponding embodiment.

[0288] Further, please see Figure 19 , Figure 19 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Figure 19 As shown, the computer device 1000 can be Figure 2 The terminal device 20b shown can also be Figure 2 The server 20a shown, computer device 1000 may include: a processor 1001, a network interface 1004, and a memory 1005. Furthermore, the computer device 1000 may also include: a user interface 1003, and at least one communication bus 1002. The communication bus 1002 is used to implement communication between these components. In some embodiments, the user interface 1003 may include a display screen and a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. Optionally, the network interface 1004 may include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be high-speed RAM or non-volatile memory, such as at least one disk storage device. Optionally, the memory 1005 may also be at least one storage device located remotely from the aforementioned processor 1001. Figure 19 As shown, the memory 1005, which is a computer-readable storage medium, may include an operating system, a network communication module, a user interface module, and a device control application.

[0289] In such Figure 19 In the computer device 1000 shown, the network interface 1004 provides network communication functions; the user interface 1003 is mainly used to provide an input interface for users; and the processor 1001 can be used to call the device control application stored in the memory 1005.

[0290] It should be understood that the computer device 1000 described in the embodiments of this application can execute the foregoing text. Figure 3 , Figure 7 , Figure 11 or Figure 12 The description of the data processing method in the corresponding embodiments can also be performed as described above. Figure 15 The corresponding embodiment refers to the data processing device 10, Figure 16 In the corresponding embodiment, data processing device 1, Figure 17 In the corresponding embodiment, the data processing device 20 or Figure 18 The description of the data processing device 2 in the corresponding embodiments will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated.

[0291] Furthermore, it should be noted that this application embodiment also provides a computer-readable storage medium storing a computer program executed by the aforementioned data processing device 10, data processing device 1, data processing device 20, or data processing device 2. The computer program includes program instructions, and when the processor executes the program instructions, it can execute the aforementioned... Figure 3 , Figure 7 , Figure 11 or Figure 12 The description of the data processing method in the corresponding embodiments is already provided and will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. For technical details not disclosed in the computer-readable storage medium embodiments related to this application, please refer to the description of the method embodiments of this application.

[0292] Furthermore, it should be noted that this application also provides a computer program product or computer program, which may include computer instructions, which may be stored in a computer-readable storage medium. The processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor may execute the computer instructions, causing the computer device to perform the aforementioned actions. Figure 3 , Figure 7 , Figure 11 or Figure 12 The description of the data processing method in the corresponding embodiments is already provided and will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. For technical details not disclosed in the computer program products or computer program embodiments related to this application, please refer to the description of the method embodiments of this application.

[0293] For further details, please see Figure 20 , Figure 20This is a schematic diagram of the structure of a data processing system provided in an embodiment of this application. The data processing system 300 may include a data processing device 300a and a data processing device 300b. The data processing device 300a may be the one described above. Figure 15 The data processing device 10 in the corresponding embodiment or Figure 16 Regarding the data processing device 1 in the corresponding embodiment, it is understood that the data processing device 300a can be integrated into the above-mentioned... Figure 2 The terminal device 20b in the corresponding embodiment will not be described in detail here. The data processing device 300b can be the one described above. Figure 17 The data processing device 20 in the corresponding embodiment or Figure 18 Regarding the data processing device 2 in the corresponding embodiment, it is understood that the data processing device 300b can be integrated into the above-mentioned... Figure 2 The server 20a in the corresponding embodiment will not be described again here. Furthermore, the beneficial effects of using the same method will also not be described again. For technical details not disclosed in the embodiments of the data processing system involved in this application, please refer to the description of the method embodiments of this application.

[0294] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0295] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A data processing method, characterized in that, include: Display the target media data in the media playback interface; In response to the activation operation of the commentary media data display function in the media playback interface, determine the first playback progress of the target media data in the media playback interface; The device memory is searched, and if a set of commentary media data associated with the first playback progress exists in the device memory, the storage time of the commentary media data set is determined. If the storage time is within the time validity period, then the commentary media data set is determined as the first commentary media data set; If the storage time is not within the time validity period, a commentary media data acquisition request carrying the first playback progress is generated, and the commentary media data acquisition request is sent to the server, so that the server can acquire a first commentary media data set including the target commentary media data from the initial commentary media data set according to the first playback progress carried by the commentary media data acquisition request, and return the first commentary media data set to the application client; The initial set of commentary media data consists of commentary media data that is mapped to commentary media time. Commentary media data that has a mapping relationship with commentary media time refers to commentary media data with the highest comprehensive semantic similarity in a set of commentary media data. The overall semantic similarity of a commentary media data is determined by the semantic similarity between that commentary media data and each commentary media data in the segmented commentary media data set to which it belongs; the segmented commentary media data set is obtained by segmenting the commentary media data in the filtered commentary media data set associated with the target media data according to the commentary media time. Each piece of commentary media data in a segmented set of commentary media data indicates the same commentary media time. Based on the first set of commentary media data, a virtual object and a commentary media data display area associated with the virtual object are displayed in the target area of ​​the media playback interface; the virtual object and the commentary media data display area are overlaid on local media data, which are the media data located in the target area of ​​the media playback interface from the target media data; In the commentary media data display area, target commentary media data associated with the target media data is displayed; the area size of the commentary media data display area matches the media size of the target commentary media data.

2. The method according to claim 1, characterized in that, The step of responding to the activation operation of the commentary media data display function in the media playback interface and determining the first playback progress of the target media data in the media playback interface includes: The media playback interface displays commentary media data control controls associated with the commentary media data display function; In response to a trigger operation on the commentary media data control control, the commentary media data launch control is displayed; In response to the launch operation of the launch control for the commentary media data, the first playback progress of the target media data in the media playback interface is determined.

3. The method according to claim 1, characterized in that, The method further includes: The media playback interface displays a commentary media data update control associated with the commentary media data update function; In response to a trigger operation on the commentary media data update control, N display duration controls are displayed; where N is a positive integer. In response to a trigger operation targeting a target display duration control among the N display duration controls, the display duration of the commentary media data indicated by the target display duration control is determined as the display duration of the commentary media data corresponding to the target media data; The step of displaying target commentary media data associated with the target media data in the commentary media data display area includes: Based on the display duration of the commentary media data corresponding to the target media data, the target commentary media data associated with the target media data is displayed in the commentary media data display area.

4. The method according to claim 1, characterized in that, The step of displaying a virtual object and a commentary media data display area associated with the virtual object in a target area of ​​the media playback interface based on the first set of commentary media data includes: Based on the first playback progress, the first set of commentary media data is searched to obtain the search results; If the search result indicates that the commentary media data corresponding to the first playback progress is found in the first commentary media data set, then the commentary media data corresponding to the first playback progress is determined as the target commentary media data associated with the target media data; Identify a virtual object that matches the target commentary media data, and determine the media size of the target commentary media data; Based on the media size, determine the area size of the commentary media data display area associated with the virtual object, and display the virtual object and the commentary media data display area with the specified area size in the target area of ​​the media playback interface.

5. The method according to claim 4, characterized in that, The process of determining the virtual object that matches the target commentary media data includes: The target media data is input into a media data analysis model, and the media data analysis model is used to perform scene type analysis on the target media data to obtain the media scene type of the target media data at different playback progress. From the media scene types of the target media data at different playback progresses, obtain the media scene type of the target media data at the first playback progress; Based on the media scene type of the target media data in the first playback progress, a virtual object matching the target commentary media data is determined; the object attribute type of the virtual object matches the media scene type of the first playback progress.

6. The method according to claim 4, characterized in that, The process of determining the virtual object that matches the target commentary media data includes: The target commentary media data is input into the commentary media data analysis model, and the semantic analysis of the target commentary media data is performed by the commentary media data analysis model to obtain the semantic type of the target commentary media data; Based on the semantic type, a virtual object matching the target commentary media data is determined; the object attribute type of the virtual object matches the semantic type.

7. The method according to claim 4, characterized in that, The method further includes: If the search result indicates that no commentary media data corresponding to the first playback progress is found in the first commentary media data, then when the playback progress of the target media data moves from the first playback progress to the second playback progress, the search process for the first commentary media data set continues based on the second playback progress; the second playback progress is the next playback progress of the first playback progress.

8. The method according to claim 1, characterized in that, The method further includes: Obtain the third playback progress corresponding to the target media data; the third playback progress is the playback progress after the first playback progress. If no commentary media data associated with the target playback progress interval exists in the device memory, then based on the third playback progress, a second set of commentary media data associated with the target media data is obtained; the second set of commentary media data includes commentary media data obtained from the initial set of commentary media data associated with the target media data based on the target playback progress interval; the minimum playback progress in the target playback progress interval is the third playback progress. When the playback progress of the target media data played in the media playback interface reaches the third playback progress, based on the second set of commentary media data, an updated virtual object and an updated commentary media data display area associated with the updated virtual object are displayed in the target area of ​​the media playback interface.

9. The method according to claim 8, characterized in that, The length of the target playback progress interval is a pre-configured request interval duration, which is less than the total playback duration of the target media data.

10. A data processing method, characterized in that, include: Obtain a set of filtered commentary media data associated with the target media data; divide the commentary media data in the filtered commentary media data set according to the commentary media time indicated by the commentary media data in the filtered commentary media data set to obtain a divided set of commentary media data; each commentary media data in a divided set of commentary media data indicates the same commentary media time; Obtain the comprehensive semantic similarity corresponding to each piece of commentary media data in the segmented commentary media data set, and take the commentary media data with the highest comprehensive semantic similarity in the segmented commentary media data set as the commentary media data that has a mapping relationship with the commentary media time. The overall semantic similarity of a commentary media data is determined by the semantic similarity between that commentary media data and each commentary media data in the set of segmented commentary media data to which it belongs; The commentary media data that has a mapping relationship with the commentary media time constitutes an initial set of commentary media data associated with the target media data; The application client receives a request to retrieve commentary media data for the target media data in the media playback interface. The request is generated when the application client, after responding to the activation operation of the commentary media data display function in the media playback interface, determines that there is a set of commentary media data associated with the first playback progress in the device memory, and the storage time of the commentary media data set is not within the time validity period. Based on the first playback progress carried in the commentary media data acquisition request, a first commentary media data set associated with the target media data is obtained from the initial commentary media data set; The first set of commentary media data is returned to the application client, so that the application client, based on the first set of commentary media data, displays a virtual object and a commentary media data display area associated with the virtual object in the target area of ​​the media playback interface. In the commentary media data display area, target commentary media data associated with the target media data is displayed. The virtual object and the commentary media data display area are overlaid on local media data, which are the media data located in the target area of ​​the media playback interface from the target media data. The first set of commentary media data includes the target commentary media data. The area size of the commentary media data display area matches the media size of the target commentary media data.

11. The method according to claim 10, characterized in that, The acquisition of the filtered commentary media data set associated with the target media data includes: Obtain a comprehensive set of commentary media data associated with the target media data, and obtain key text filtering data for filtering the comprehensive set of commentary media data; The commentary media data containing the key text filtering data in the comprehensive commentary media data set is filtered, and the filtered comprehensive commentary media data set is determined as the filtered commentary media data set.

12. The method according to claim 10, characterized in that, The step of obtaining a first set of commentary media data associated with the target media data from the initial set of commentary media data based on the first playback progress carried in the commentary media data acquisition request includes: Based on the first playback progress carried in the request for the commentary media data, a playback progress interval to be requested corresponding to the first playback progress is determined; the minimum playback progress in the playback progress interval to be requested is the first playback progress; the interval length of the playback progress interval to be requested is a pre-configured request interval duration, and the request interval duration is less than the total playback duration of the target media data. The commentary media data within the requested playback progress interval is obtained from the initial commentary media data set, and the commentary media data within the requested playback progress interval is used to form a first commentary media data set associated with the target media data.

13. The method according to claim 10, characterized in that, The method further includes: The initial set of commentary media data is sent to a management device used to monitor the application client, so that the management device can review the initial set of commentary media data and obtain the review result; If the review result returned by the management device is approved, then the step of obtaining the first set of commentary media data associated with the target media data from the initial set of commentary media data based on the first playback progress carried by the commentary media data acquisition request is executed.

14. A data processing apparatus, characterized in that, include: The first display module is used to display the target media data in the media playback interface; The second display module is used to respond to the activation operation of the commentary media data display function in the media playback interface and determine the first playback progress of the target media data in the media playback interface. The second display module is also used to search the device memory, and if there is a set of commentary media data associated with the first playback progress in the device memory, then determine the storage time of the set of commentary media data. The second display module is further configured to determine the commentary media data set as the first commentary media data set if the storage time is within the time validity period; The second display module is further configured to, if the storage time is not within the time validity period, generate a commentary media data acquisition request carrying the first playback progress, send the commentary media data acquisition request to the server, so that the server acquires a first commentary media data set including the target commentary media data from the initial commentary media data set according to the first playback progress carried by the commentary media data acquisition request, and returns the first commentary media data set to the application client; The initial set of commentary media data consists of commentary media data that is mapped to commentary media time. Commentary media data that has a mapping relationship with commentary media time refers to commentary media data with the highest comprehensive semantic similarity in a set of commentary media data. The overall semantic similarity of a commentary media data is determined by the semantic similarity between that commentary media data and each commentary media data in the segmented commentary media data set to which it belongs; the segmented commentary media data set is obtained by segmenting the commentary media data in the filtered commentary media data set associated with the target media data according to the commentary media time. Each piece of commentary media data in a segmented set of commentary media data indicates the same commentary media time. The second display module is further configured to display a virtual object and a commentary media data display area associated with the virtual object in a target area of ​​the media playback interface based on the first set of commentary media data; the virtual object and the commentary media data display area are overlaid on local media data, which are media data located in the target area of ​​the media playback interface from the target media data; The third display module is used to display target commentary media data associated with the target media data in the commentary media data display area; The size of the area displaying the commentary media data matches the media size of the target commentary media data.

15. A data processing apparatus, characterized in that, include: An aggregation processing module is used to acquire a set of filtered commentary media data associated with target media data, and to divide the commentary media data in the set of filtered commentary media data according to the commentary media time indicated by the commentary media data in the set of filtered commentary media data to obtain a divided set of commentary media data; each commentary media data in a divided set of commentary media data indicates the same commentary media time; The aggregation processing module is further configured to obtain the comprehensive semantic similarity corresponding to each piece of commentary media data in the segmented commentary media data set, and to take the commentary media data with the highest comprehensive semantic similarity in the segmented commentary media data set as the commentary media data that has a mapping relationship with the commentary media time. The overall semantic similarity of a commentary media data is determined by the semantic similarity between that commentary media data and each commentary media data in the set of segmented commentary media data to which it belongs; The aggregation processing module is further configured to construct an initial set of commentary media data associated with the target media data by combining the commentary media data that has a mapping relationship with the commentary media time. The request receiving module is used to receive a commentary media data acquisition request sent by the application client for the target media data in the media playback interface; The commentary media data acquisition request is generated when the application client responds to the launch operation of the commentary media data display function in the media playback interface, determines that there is a set of commentary media data associated with the first playback progress in the device memory, and the storage time of the commentary media data set is not within the time validity period; The request receiving module is further configured to obtain the first playback progress carried by the request based on the commentary media data, and obtain the first commentary media data set associated with the target media data from the initial commentary media data set; The collection return module is used to return the first set of commentary media data to the application client, so that the application client, based on the first set of commentary media data, displays a virtual object and a commentary media data display area associated with the virtual object in the target area of ​​the media playback interface. In the commentary media data display area, target commentary media data associated with the target media data is displayed. The virtual object and the commentary media data display area are overlaid on partial media data, which is the media data located in the target area of ​​the media playback interface from the target media data. The first set of commentary media data includes the target commentary media data. The area size of the commentary media data display area matches the media size of the target commentary media data.

16. A computer device, characterized in that, include: Processor and memory; The processor is connected to the memory, wherein the memory is used to store a computer program, and the processor is used to invoke the computer program to cause the computer device to perform the method according to any one of claims 1-13.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-13.

18. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium and adapted to be read and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-13.