Comment display method, device, equipment, medium and product

Abstract

This application discloses a comment display method, apparatus, device, medium, and product, applicable to the field of data processing technology. The method includes: displaying target comment data for target published content, the target comment data including at least a comment video; and displaying, in association with the comment video, at least one of the following: audio description text corresponding to the audio content in the comment video, and video description text corresponding to the comment video. Using this application can improve the display effect of comments, thereby enhancing the interactive effect of comments.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to comment display methods, apparatus, devices, media, and products. Background Technology

[0002] With the rapid development of internet technology and the diversification of information dissemination channels, users' participation in and interaction with online content has increased significantly. As a core interactive carrier connecting content creators and users, the comment function is becoming increasingly important.

[0003] In existing technologies, traditional commenting methods mostly rely on text or emoticons for communication. This approach is relatively simplistic and limits the expressive power of comments, thus impacting the effectiveness of interactive commenting. Summary of the Invention

[0004] This application provides a comment display method, apparatus, device, medium, and product, which can improve the display effect of comments and thus enhance the interactive effect of comments.

[0005] On one hand, this application discloses a comment display method, characterized in that the method includes: Displays target comment data for the target published content; the target comment data includes at least the commented video. Display at least one of the following in association with the comment video: audio description text corresponding to the audio content in the comment video, and video description text corresponding to the comment video.

[0006] On one hand, embodiments of this application disclose a comment display device, characterized in that the device comprises: The display module is used to display the target comment data of the target published content. The target comment data includes at least the comment video. The display module is also used to display, in association with the comment video, at least one of the audio description text corresponding to the audio content in the comment video and the video description text corresponding to the comment video.

[0007] In one possible implementation, the display module displays target comment data for the target published content and performs at least one of the following operations: In response to video commenting actions on the target content, display the target comment data on the comment display page of the target content; In response to a comment browsing action on the target published content, load the target comment data on the comment display page of the target published content.

[0008] In one possible implementation, the display module, in response to a video comment operation on the target published content, displays the target comment data on the comment display page of the target published content, for performing the following operations: In response to the operation of selecting a comment video for the target published content, determine the comment video; or in response to the operation of recording a comment video for the target published content, determine the comment video. In response to a comment confirmation action on the target published content, target comment data, including the comment video, is displayed on the comment display page of the target published content.

[0009] In one possible implementation, the comment data also includes the comment text; The display module is also used to perform the following operations: In response to a text conversion operation on the audio content in the comment video, an initial audio description text is determined; the initial audio description text includes multiple words. The comment text is matched with multiple word segments to obtain matching values ​​for each word segment. Determine the target matching value from the matching values ​​corresponding to multiple word segments; the target matching value is equal to or greater than the remaining matching values ​​other than the target matching value among the matching values ​​corresponding to multiple word segments. The words corresponding to the target matching value in multiple word segments are identified as the target key text, and audio description text is generated based on the target key text.

[0010] In one possible implementation, the display module is also used to perform the following operations: Perform video understanding on the comment video to obtain video understanding data of the comment video, which includes video understanding text; The video understanding text is optimized based on at least one of the target published content, the comment context of the target comment data, and the audio description text to obtain the video description text.

[0011] In one possible implementation, video understanding data also includes the video's expressive intent; The display module optimizes the video understanding text based on at least one of the target published content, the comment context of the target comment data, and the audio description text, to obtain the video description text, which is used to perform the following operations: Determine the optimized guidance data corresponding to the video's intended message; Based on at least one of the target published content, the comment context of the target comment data, the audio description text, and the optimized guidance data, the video understanding text is optimized to obtain the video description text.

[0012] In one possible implementation, the display module displays, in association with the comment video, at least one of the audio description text corresponding to the audio content in the comment video and the video description text corresponding to the comment video, for performing at least one of the following operations: An audio description text is displayed in association with the comment video, and a first source information for the audio description text is displayed at the end of the audio description text, which indicates that the audio description text was generated based on the audio content in the comment video; Video description text is displayed in association with the comment video, and a second source information for the video description text is displayed at the end of the video description text, which indicates that the video description text was generated by identifying the comment video.

[0013] In one possible implementation, the display module is also used to perform the following operations: The target published content and the audio description text are matched to obtain the first matching value; The target published content and video description text are matched to obtain a second matching value; The first and second matching values ​​are weighted and merged to obtain the total matching value. Based on the total match value, the location of the target area for displaying the target comment data is determined on the comment display page of the target published content. There is a positive relationship between the location of the target area on the comment display page and the total match value.

[0014] In one possible implementation, the display module is also used to perform the following operations: In response to a trigger action on the target keyword text, play the video segment corresponding to the target keyword text in the comment video.

[0015] In one possible implementation, the commentary video includes multiple audio tracks; The display module is also used to perform at least one of the following operations: Determine the volume values ​​corresponding to multiple audio tracks, determine the maximum volume value among the multiple volume values, and perform text conversion processing on the audio content of the audio track corresponding to the maximum volume value among the multiple audio tracks to obtain the audio description text; The audio content of multiple audio tracks is converted into text to obtain the text corresponding to each audio track. The text corresponding to each audio track is then annotated by the user to obtain the audio description text.

[0016] In one possible implementation, the display module is also used to perform the following operations: In response to a triggered action on the comment video, the comment video is played via a video player; the video player includes a text content area; Display the comment text from the comment data in the text content area. When the display duration of the comment text equals the display duration threshold, update the comment text in the text content area to audio description text and / or video description text.

[0017] One aspect of this application provides a computer device, including a memory and a processor; the memory is connected to the processor, the memory is used to store a computer program, and the processor is used to invoke the computer program so that the computer device executes the method provided in any of the above aspects.

[0018] One aspect of this application provides a computer-readable storage medium storing a computer program adapted to be loaded and executed by a processor, so that a computer device having a processor performs the method provided in any of the above aspects.

[0019] One aspect of this application provides a computer program product, which includes a computer program stored in a computer-readable storage medium. The computer program is adapted to be read and executed by a processor so that a computer device having a processor performs the method provided in any of the above aspects.

[0020] In this embodiment, a computer device displays target comment data for a target published content. The target comment data includes at least a comment video. Associated with the comment video, at least one of the following is displayed: audio description text corresponding to the audio content in the comment video, and video description text corresponding to the comment video. As described above, this embodiment can provide comment videos, and for each comment video, it can provide audio description text and / or video description text associated with the audio content. The audio description text and / or video description text can describe the comment video; therefore, the display effect of the comment can be improved through the audio description text and / or video description text, thereby improving the interactive effect of the comment. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a schematic diagram of the structure of a comment display system provided in an embodiment of this application; Figure 2 This is a flowchart illustrating a comment display method provided in an embodiment of this application. Figure 1 ; Figure 3This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 1 ; Figure 4 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 2 ; Figure 5 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 3 ; Figure 6 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 4 ; Figure 7 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 5 ; Figure 8 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 6 ; Figure 9 This is a flowchart illustrating a comment display method provided in an embodiment of this application. Figure 2 ; Figure 10 This is a flowchart illustrating a comment display method provided in an embodiment of this application. Figure 3 ; Figure 11 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 7 ; Figure 12 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 8 ; Figure 13 This is an interactive flowchart of a comment display method provided in an embodiment of this application; Figure 14 This is a schematic diagram of the structure of a comment display device provided in an embodiment of this application; Figure 15 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0023] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0024] The following are explanations of some key terms used in this application: "In response to" indicates the state in which a corresponding event occurs or a condition is met. The timing of subsequent actions performed in response to this event or condition is not necessarily strongly correlated with the time when the event occurs or the condition is met. For example, in some cases, subsequent actions may be performed immediately when the event occurs or the condition is met; while in other cases, subsequent actions may be performed some time after the event occurs or the condition is met.

[0025] Triggered operations refer to actions performed on information (such as controls) provided by a computer device. These operations send corresponding instructions to the computer device, triggering it to execute the next task. The next task triggered by different triggered operations on different information can all be pre-programmed. These triggered operations can be performed manually by the user; for example, clicks, double-clicks, long presses, and swipes performed by the user on content displayed on the computer screen are all triggered operations. In some cases, these triggered operations can also be executed by the computer device based on a pre-defined program.

[0026] Published content refers to the information that users publish in advance or in real time on the content platform. This can include text, images, audio, and video, and is therefore also called multimedia content. It can be displayed in the form of notes, articles, video files, video streams, etc. The specific content information included in published content can be adjusted according to different scenarios, and the content information in the published content can be determined by the publisher. Published content is stored on the server and distributed to users browsing the content platform through a content distribution algorithm deployed on the server.

[0027] The comment display page can be understood as a page used to display comments (including video comments). The comment display page can also display interactive information about the comments, such as the number of views, likes, and favorites.

[0028] Comments can be understood as comment data on published content. In this embodiment, comment data mainly includes comment videos. Comment videos can be understood as comment data that can be presented in video format. Optionally, comment videos can also be combined with at least one of text comments, image comments, and emoticon comments to form multimodal comments.

[0029] Please see Figure 1 , Figure 1 This is a schematic diagram of the structure of a comment display system provided in an embodiment of this application. For example... Figure 1 As shown, the comment indicates that the system may include terminal devices (such as device 11a, device 12a, device 13a) and server 100a. It is understandable that... Figure 1The number of terminal devices and servers shown is merely illustrative; any number of terminal devices and servers can be used as needed. Terminal devices (such as devices 11a, 12a, and 13a) can communicate with servers via a network (i.e., through a medium providing a communication link via wired, wireless communication links, or fiber optic cables, etc.) to transmit data.

[0030] It is understood that a client can run on the terminal device (such as device 12a), which can be a program that provides local services to the user (also known as the business object or operation object). Server 100a can be the server corresponding to the client, and a program running on server 100a can provide resources, service data, and other services to the client. It is understood that the client running on the terminal device can be any type of client, such as a social client, an instant messaging client (e.g., a conferencing client), an entertainment client (e.g., a live streaming client), a multimedia client (e.g., a video client), an information client (e.g., a news client), a shopping client, or a client with comment and interaction functions. The specific type of application client is not limited here.

[0031] A client, also known as an application client, business client, etc., allows users to log in with an account and post comments on videos or interact with them. For example, the client running on device 11a corresponding to user U1 can log in with account ZH1, and then retrieve the comment data of the posted content from the server and display it on device 11a.

[0032] It is understood that terminal devices (such as device 11a) may include, but are not limited to, mobile phones, computers, smart voice interaction devices, smart home appliances, vehicle terminals, aircraft, smart speakers, etc., without limitation. The server 100a may be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms, without limitation.

[0033] Please see Figure 2 , Figure 2 This is a flowchart illustrating a comment display method provided in an embodiment of this application. Figure 1The comment indicates that the implementation of this method can be performed on a terminal device, or it can be performed interactively between the terminal device and the server; no limitation is made here. For ease of description and understanding, this application's embodiment uses the implementation on a terminal device as an example, i.e., the terminal device is considered as a computer device. The terminal device can be one of the aforementioned... Figure 1 Any one of the terminal devices in the corresponding embodiment. The comment display method may include the following steps S101-S102.

[0034] Step S101: Display the target comment data of the target published content. The target comment data includes at least the comment video.

[0035] Specifically, target content can be understood as published information that allows users to comment and interact. For example, target content may include at least one of the following: target post notes, target post videos, target live stream content, and target products.

[0036] Target comment data can be understood as comment data that comments on target published content, and target comment data includes at least comment videos. Comment videos can be understood as comment data that can be presented in video format. Optionally, target comment data may also include at least one of the following: comment text, comment images, and comment emoticons.

[0037] In an optional embodiment, the target comment data can be displayed on the comment display page of the target published content. The comment display page can be understood as a page used to display the target comment data. The comment display page may also display interactive information related to the target comment data, such as at least one of the following: number of views, number of likes, and number of favorites.

[0038] The following example illustrates how a comment display page can be shown. It is important to note that this example only illustrates that the comment display page can include at least one of the various methods described below, and should not be construed as limiting the specific display method of the comment display page.

[0039] Specifically, in response to video commenting on the target content, the target comment data is displayed on the comment display page of the target content.

[0040] Specifically, the process of displaying target comment data on the comment display page of the target published content in response to a video comment operation on the target published content may include: determining a comment video in response to a comment video selection operation on the target published content, or determining a comment video in response to a comment video shooting operation on the target published content; and displaying target comment data including the comment video on the comment display page of the target published content in response to a comment confirmation operation on the target published content.

[0041] Please see also Figure 3 , Figure 3 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 1 .like Figure 3 As shown, the terminal device displays the content display page 20a of the target published content (which can also be understood as multimedia content). The content display page refers to the page used to display the target published content. This application embodiment does not limit the target published content, nor does it limit the content modality of the target published content. It can be determined according to the actual application scenario.

[0042] Figure 3 The example target content is published by a user named ai, and is multimodal content, including image content 201a and text content 202a (e.g., ...). Figure 3 Example of “Let’s sing together, I’ll go first” and voice content 203a. Figure 3 Example audio content 203a is a 15-second song, and content display page 20a can display this information, such as... Figure 3 The example shown is voice recognition prompt 205a, namely... Figure 3 The displayed message "Singing detected" is converted to text by voice content 203a, and the text content is as follows: Figure 3 Example of "New Year xx".

[0043] Content display page 20a can also display interactive controls for the target published content, such as... Figure 3 The page includes comment controls 206a, like controls 207a, favorite controls 208a, and comment display controls 209a. The content display page 20a can also display account information of the content-publishing account, such as the account avatar and account name.

[0044] Understandable, Figure 3 The interfaces and controls shown in the accompanying drawings described below are merely some forms of representation for reference. In actual business scenarios, developers can make relevant designs according to product requirements. The embodiments of this application do not limit the specific forms of the interfaces and controls involved.

[0045] If the user corresponding to the terminal device (hereinafter referred to as the target user) triggers the comment control 206a in the content display page 20a, the terminal device responds to the trigger operation on the comment control 206a and displays the comment input page 20b corresponding to the content display page 20a. This application embodiment does not limit the relationship between the content display page 20a and the comment input page 20b, which can be set according to the actual application scenario, including but not limited to the content display page 20a and the comment input page 20b being two independent pages, with the comment input page 20b being a floating page on top of the content display page 20a.

[0046] Optionally, if the target user triggers the comment display control 209a in the content display page 20a, the terminal device responds to the trigger operation on the comment display control 209a and displays the comment display page 20c corresponding to the content display page 20a. For example... Figure 3 As shown, the comment display page 20c includes a comment control 206a. If the target user triggers the comment control 206a in the comment display page 20c, the terminal device also displays a comment input page corresponding to the target published content, and the function of this comment input page is the same as... Figure 3 The example comment input page 20b has the same functionality.

[0047] The terminal device displays comment data on the comment display page 20c. This application embodiment does not limit the content modality of the comment data, which may include at least one of images, audio, video and text. Figure 3 Example comment display page 20c includes 6 comments, with 2 currently displayed as independent comments: the comment data displayed in comment display area 201d (hereinafter referred to as the first comment data for ease of description), and the comment data displayed in comment display area 202d (hereinafter referred to as the second comment data for ease of description).

[0048] Figure 3 The first comment in the example was posted by user number 11. This first comment is a multimodal comment, including the comment text, such as... Figure 3 The example "Let's sing a song together" also includes comment voice 201c. Figure 3 Example comment audio 201c is a 4-second song clip, and the comment display page 20c can display this information, such as... Figure 3 The example shown is voice recognition prompt 203c, i.e. Figure 3 The displayed message "Singing detected" indicates that the comment, after being converted to text using the 201c audio format, contains the following text: Figure 3 Example: "Unforgettable xx, unforgettable xx".

[0049] Figure 3 The second comment data in the example was also posted by a user named 11. This second comment data is a multimodal comment, including the comment text, such as... Figure 3 The example "Wishing everyone eternal happiness" also includes comment voice 202c. Figure 3 Example comment audio 202c is a 4-second song clip, and the comment display page 20c can display this information, such as... Figure 3 The example shown is voice recognition prompt 204c, which is... Figure 3 The displayed message "Singing detected" indicates that the comment, after being converted from voice to text (202c), contains the following text: Figure 3 Example of "New Year xx".

[0050] Video commenting can be understood as the act of commenting on target content. Optionally, the terminal device can also respond to text commenting on the comment input page and display the comment text on the comment display page; it can also respond to image commenting on the comment input page and display the comment image on the comment display page; and it can also respond to emoji commenting on the comment input page and display the comment emoji on the comment display page.

[0051] The following is an example of how to comment on videos. It should be noted that this should not be interpreted as a limitation on specific commenting actions.

[0052] In an optional embodiment, in response to a comment entry operation, the comment video and the target text associated with the comment video can be collected and saved; in response to a comment confirmation operation on the comment video, the comment video and the target text can be displayed on the comment display page. In the above steps, by collecting the comment video and the target text associated with the comment video, both video and text comments on the target published content can be simultaneously realized. This allows users to combine different types of comment methods to achieve more accurate comment expression, while also simplifying the commenting process.

[0053] Optionally, the comment input page may display at least one media control, which may include at least one of audio controls, emoticon controls, text controls, and image controls. Correspondingly, the terminal device may, in response to a trigger operation on the image control, display a candidate image page; in response to a completion operation on the comment video on the candidate image page, save the comment video; in response to a trigger operation on the text control, display a text input control on the comment input page; in response to a text editing operation on the text input control, collect the entered target text; and in response to a comment confirmation operation on the comment video, display the comment video and the target text on the comment display page.

[0054] Please see also Figure 3 as well as Figure 4 , Figure 4 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 2 The terminal device responds to... Figure 3 The example image control 201b trigger operation displays... Figure 4 Example candidate image page 20e, candidate image page 20e includes multiple categories, such as Figure 4 The system includes all categories: photo, video, and live view. When a target user triggers the video category, the terminal device displays a video list, which includes videos stored on the terminal device, such as... Figure 4 As shown. Optionally, the terminal device displays video information for each video in the video list, such as the video cover and video length.

[0055] Target users can select videos from the video list. For example, each video is associated with a checkbox. Triggering or activating a checkbox indicates that the target user has selected the video corresponding to that checkbox. Please refer to [link / reference]. Figure 4 If the target user triggers the selection of region 201e, the terminal device will determine the video associated with the selected region 201e as the initial comment video.

[0056] After the target user selects an initial comment video, they can trigger a preview control. The terminal device will then respond to the trigger operation of the preview control and display... Figure 4 Example video editing page 20f plays the initial comment video. Optionally, if the target user triggers multiple checkboxes, the terminal device identifies the videos associated with each checkbox as the initial comment video and plays them sequentially (e.g., in display order) on video editing page 20f.

[0057] like Figure 4 As shown, the video editing page 20f can display the number of initial comment videos. Figure 4 The example initially displays one comment video. An editing control is available, which the target user can trigger to edit the initial comment video. When the target user triggers the completion control on video editing page 20f, the terminal device will identify the edited video on video editing page 20f as the comment video and return to the comment input page 20b.

[0058] Optionally, after the target user triggers the selected area—in other words, after confirming the initial comment video—they can trigger the completion control 202f for the initial comment video. The terminal device responds to the triggering operation of the completion control 202f by displaying… Figure 4 Comments input page 20b.

[0059] The terminal device adds a comment video 201f to the comment input page 20b. The target user can trigger a delete control for comment video 201f, at which point the terminal device will delete the comment video added to the comment input page 20b. If the target user confirms the comment video and other modal comment data (such as comment text, emoticons, etc.), they can trigger a send control on the comment input page 20b. At this time, the terminal device responds to the posting operation for comment data including comment video 201f and displays... Figure 5 The example comment shows page 20g, where, Figure 5 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 3 .

[0060] and Figure 3 The example comments show a comparison between page 20c and... Figure 5 The example comment display page 20g additionally displays newly posted target comment data displayed in the comment display area 203d. For ease of understanding, Figure 5 The example target comment data is posted by user name 12. The target comment data is a multimodal comment, including the comment text, such as... Figure 5 The example "Singing online hihi" includes comment video 201f. Figure 5 The example comment video 201f is a 10-second video.

[0061] Figure 4 This mainly describes the scenario of selecting comment videos. Another feasible implementation method is as follows: Please refer to [link / reference]. Figure 3 as well as Figure 6 , Figure 6 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 4 When the target user triggers the expand control 202b on the comment input page 20b, the terminal device responds to the triggering operation on the expand control 202b and displays... Figure 6 Example of a function display area 203b. Function display area 203b can display one or more functions, such as... Figure 6 Examples include photos, notes, locations, products, and group chats.

[0062] When the target user triggers the shooting entry point in the function display area 203b, the terminal device responds to the trigger operation on the shooting entry point by displaying the shooting interface 20h. Through the shooting interface 20h, the terminal device can capture and save the comment video. Optionally, Figure 4 The example candidate image page 20e includes a shooting entry point. In response to a triggering operation on the shooting entry point in the candidate image page 20e, the terminal device can also display a shooting interface.

[0063] The above text Figures 3-5The described hierarchy of target comment data, including the video comment, is level one; in other words, the target comment data is a level one comment or main comment. In practical applications, the hierarchy of target comment data is k levels (k is a positive integer greater than 0), meaning the target comment data can be a sub-comment data. Please refer to [link / reference needed]. Figure 7 , Figure 7 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 5 .like Figure 7 As shown, the content of the target comment data 204f is consistent with the above. Figure 5 The content of the target comment data displayed in the comment display area 203d in the example is the same, both including the comment video 201f. The difference between the two is that the target comment data displayed in the comment display area 203d is a first-level comment data, which is generated by commenting on the target published content, while the target comment data 204f is a second-level comment data, which is generated by commenting on the first comment data that belongs to the first-level comment and is displayed in the comment display area 202d.

[0064] It should be noted that all user data collected in this application is collected with the user's consent and authorization, and the collection, use, and processing of relevant user data must comply with the relevant laws, regulations, and standards of the relevant regions. For example, this application may display prompts before and during the collection of user data to inform the user that their data is being collected. This ensures that the application only begins the steps of collecting user data after receiving confirmation from the user regarding the prompt; otherwise (i.e., without receiving confirmation from the user), the steps of collecting user data are terminated, meaning that user data is not collected.

[0065] It is understood that the above scenarios are merely examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of this application. The technical solutions of this application can also be applied to other scenarios. For example, as those skilled in the art will know, with the evolution of system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0066] Step S102: Display at least one of the audio description text corresponding to the audio content in the comment video and the video description text corresponding to the comment video, in association with the comment video.

[0067] Specifically, audio description text is displayed in association with the comment video, and a first source information of the audio description text is displayed at the end of the audio description text, which indicates that the audio description text is generated based on the audio content in the comment video; video description text is displayed in association with the comment video, and a second source information of the video description text is displayed at the end of the video description text, which indicates that the video description text is generated by identifying the comment video.

[0068] This step may further include: matching the target published content and the audio description text to obtain a first matching value; matching the target published content and the video description text to obtain a second matching value; performing weighted fusion processing on the first and second matching values ​​to obtain a total matching value; and determining the position of the target area for displaying the target comment data on the comment display page of the target published content based on the total matching value, wherein the position of the target area on the comment display page has a positive relationship with the total matching value.

[0069] One feasible implementation method is as follows: Please refer to [link / reference] Figure 7 The target comment data 204f includes the comment text ( Figure 7 The example is "Singing online hihi") and a 10-second comment video 201f. The terminal device displays the audio description text corresponding to the audio content in the comment video 201f in association with the comment video 201f. Figure 7 The example is "New Year xx", and the first source information of the audio description text is displayed at the end of the audio description text, such as... Figure 7 The example "Identify background noise" means that the audio description text is generated based on the audio content of the comment video 201f.

[0070] Another feasible implementation is as follows: In addition to displaying audio description text, the terminal device can also display video description text corresponding to video comments. Please refer to [link / reference]. Figure 8 , Figure 8 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 6 .like Figure 8 As shown, the comment display page 20i includes two main comment data sets: a first main comment data set displayed in the comment display area 201i and a second main comment data set displayed in the comment display area 202i. The first and / or second main comment data sets can be used as the target comment data in this embodiment.

[0071] in, Figure 8 The first main comment in the example was posted by user number 11. This first main comment is a multimodal comment, including the comment text, such as... Figure 8The example "I'm posting a video" also includes a 1 minute 10 second comment video 201j. The terminal device displays the audio description text corresponding to the audio content in the comment video 201j, as associated with it. Figure 8 The example states, "1. Pandas mainly eat bamboo, which makes up about 99% of their diet. They consume approximately 25 kilograms of bamboo daily. 2. The diet of captive giant pandas includes ample amounts of high-quality fresh bamboo." The first source information is displayed at the end of the audio description text, such as... Figure 8 The example shown is "Identify background noise". Additionally, the terminal device displays video description text associated with the comment video 201j, such as... Figure 8 The example shown is labeled "Science Popularization," indicating that the commentary video 201j has science popularization functions; the terminal device also displays second-source information at the end of the video description text, such as... Figure 8 The example "identified video" indicates that the video description text is obtained by identifying the comment video 201j.

[0072] in, Figure 8 The second main comment data in the example was posted by user number 12. This second main comment data is a multimodal comment, including the comment text, such as... Figure 8 The example "Just watching pandas" also includes a 10-second commentary video 202j. The terminal device displays, in association with the commentary video 202j, the audio description text corresponding to the audio content in the commentary video 202j, such as... Figure 8 The example is "Let me show you a panda eating bamboo"; and the first source information is displayed at the end of the audio description text, such as... Figure 8 The example shown is "Identify background noise". Additionally, the terminal device displays video description text associated with the comment video 202j, such as... Figure 8 The example shown, "personal check-in," indicates that the comment video 202j was entered by the user when it was posted; the terminal device also displays second-source information at the end of the video description text, such as... Figure 8 The example "identified video" indicates that the video description text is obtained by identifying the comment video 202j.

[0073] Figure 8 In this example, both the first and second main comment data are used to comment on the target content. For ease of understanding, the target content is exemplified as a question, such as "What do pandas eat?" The description text of the first main comment data will be referred to as the first description text, which includes the first audio description text and / or the first video description text. The description text of the second main comment data will be referred to as the second description text, which includes the second audio description text and / or the second video description text.

[0074] The terminal device performs matching processing on the target published content (e.g., "What do pandas eat?") and the first description text. It can be understood that if the first description text includes the first audio description text and the first video description text, then specifically, the target published content and the first audio description text are matched to obtain the first matching value 1; the target published content and the first video description text are matched to obtain the second matching value 1; and the first matching value 1 and the second matching value 1 are weighted and fused to obtain the total matching value 1.

[0075] The terminal device performs matching processing on the target published content (e.g., "What do pandas eat?") and the second description text. It can be understood that if the second description text includes a second audio description text and a second video description text, then specifically, the target published content and the second audio description text are matched to obtain a first matching value 2; the target published content and the second video description text are matched to obtain a second matching value 2; and the first matching value 2 and the second matching value 2 are weighted and fused to obtain a total matching value 2.

[0076] If the total match value 1 is equal to or greater than the total match value 2, the terminal device determines the position of the comment display area for displaying the first main comment data, prior to (or better than) the position of the comment display area for displaying the second main comment data. If the total match value 1 is less than the total match value 2, the terminal device determines the position of the comment display area for displaying the second main comment data, prior to (or better than) the position of the comment display area for displaying the first main comment data. Figure 8 In the example, the total matching value 1 corresponding to the first main comment data is equal to or greater than the total matching value 2 corresponding to the second main comment data. Therefore, the display order of comment display area 201i is superior to the display order of comment display area 202i.

[0077] As described above, the embodiments of this application can provide comment videos, and for the comment videos, audio description text and / or video description text associated with the audio content can be provided. The audio description text and / or video description text can describe the comment videos, so the display effect of the comments can be improved through the audio description text and / or video description text, thereby improving the interactive effect of the comments.

[0078] Based on the above description, this application proposes a comment display method. Please refer to [link to relevant documentation]. Figure 9 , Figure 9 This is a flowchart illustrating a comment display method provided in an embodiment of this application. Figure 2 This method can be executed by a computer device, which can be a terminal device (such as the one mentioned above). Figure 1 (Device 11a in the text). This comment shows that the method may include the following steps S201-S202.

[0079] S201. In response to the comment browsing operation of the target published content, load the target comment data on the comment display page of the target published content. The target comment data includes at least the comment video.

[0080] Specifically, the comment display page is used to display comment data for the target published content. The target published content can be text and image content (referred to as text and image content), video content (referred to as video content), live content (referred to as live content, i.e., content containing live images), live stream content (referred to as live stream content), etc. As mentioned above... Figure 3 As shown in the example, the comment display page can be a subpage of the content display page. The content display page is used to display the target published content. The content display page can display the content details of the target published content, as well as content interaction controls for the target published content.

[0081] The comment display page can display account information for interactive accounts (including the account that posted the comment and the account that interacted with the comment), such as the account avatar and account name. The displayed account information can be all or part of the account information of the interactive account.

[0082] It is understandable that users corresponding to terminal devices can participate in the following three scenarios: 1. The user corresponding to the terminal device is the target audience for the published content, and can browse the target comment data of the published content.

[0083] 2. The user corresponding to the terminal device is the target audience of the target published content. They can browse the target comment data of the target published content and can comment and interact on the target published content and / or the comment data of the target published content.

[0084] 3. The user corresponding to the terminal device is not the target audience of the target published content. However, the user can browse the target comment data of the target published content and can comment and interact on the target published content and / or the comment data of the target published content.

[0085] S202. Display at least one of the following in association with the comment video: audio description text corresponding to the audio content in the comment video, and video description text corresponding to the comment video.

[0086] Specifically, in response to the text conversion operation of the audio content in the comment video, an initial audio description text is determined; when the number of text characters in the initial audio description text is less than or equal to a quantity threshold, the initial audio description text is determined as the audio description text; when the number of text characters in the initial audio description text is greater than the quantity threshold, key content is extracted from the initial audio description text to obtain the audio description text, wherein the number of text characters in the audio description text is less than or equal to the quantity threshold.

[0087] Specifically, the comment data also includes comment text; in response to the text conversion operation for the audio content in the comment video, an initial audio description text is determined; the initial audio description text includes multiple word segments; the comment text is matched with the multiple word segments respectively to obtain the matching values ​​corresponding to the multiple word segments respectively; a target matching value is determined among the matching values ​​corresponding to the multiple word segments respectively; the target matching value is equal to or greater than the remaining matching values ​​other than the target matching value among the matching values ​​corresponding to the multiple word segments respectively; the word segment corresponding to the target matching value among the multiple word segments is determined as the target key text, and the audio description text is generated based on the target key text.

[0088] The number of target matching values ​​can be one or more. If there are multiple target matching values, the terminal device will concatenate or assemble the word segments corresponding to the multiple target matching values ​​to generate audio description text with complete sentence order.

[0089] This step may also include: performing video understanding on the comment video to obtain video understanding data for the comment video, the video understanding data including video understanding text; optimizing the video understanding text based on at least one of the target published content, the comment context of the target comment data, and audio description text to obtain video description text.

[0090] The video understanding data also includes the video's expressive intent. The specific process of optimizing the video understanding text to obtain the video description text based on at least one of the target published content, the comment context of the target comment data, and the audio description text may include: determining the optimized guidance data corresponding to the video's expressive intent; optimizing the video understanding text based on at least one of the target published content, the comment context of the target comment data, the audio description text, and the optimized guidance data to obtain the video description text.

[0091] Comment context can be understood as related comment content associated with the target comment data. An exemplary comment context may include the preceding comment above the target comment data in the comment hierarchy, and the following comment below the target comment data in the comment hierarchy. It can be understood that the parent comment responded to by the target comment data is above the target comment data in the comment hierarchy, and the child comments triggered by the target comment data are below the target comment data in the comment hierarchy.

[0092] Video understanding data can be understood as the data obtained after mining relevant information or classifying videos based on comments.

[0093] For example, video understanding data may include video understanding text, which can be understood as preliminary descriptive data obtained after relevant information mining of comment videos.

[0094] For example, video understanding data may also include video categories, which may include at least one of the following: language type, language emotion category, music category, and environment category.

[0095] In one optional embodiment, the comment video can be input into a video understanding model to obtain the video understanding text and corresponding video category of the comment video. In another optional embodiment, the comment video can be input into a video description model to obtain the video understanding text of the comment video; and the comment video can be input into a video classification model to obtain the video category of the comment video.

[0096] The audio understanding model, video description model, and video classification model can be traditional machine learning models, neural network models, large language models, or multimodal models; this application does not impose any restrictions on them.

[0097] In an optional embodiment, the comment videos can be classified to obtain video categories; based on the understanding guidance data of the video categories, video understanding can be performed on the comment videos to obtain video description text, thereby enabling the focus on the description direction related to the understanding guidance data of the corresponding video categories, and also making it easy to obtain semantically rich video description text.

[0098] To assist users in various scenarios without increasing functional complexity, this application embodiment not only supports users posting video comments but also identifies background sounds within the video and recognizes the video itself. It then presents the audio content (i.e., audio description text) and video content (i.e., video description text) using text bubbles, helping users understand the video content in advance. Therefore, users can decide whether to click to view the content based on the audio and video description text. Thus, this application embodiment better supports video consumption scenarios, avoiding the need for users to view the video to obtain information. Simultaneously, the multimedia content in the comment section better helps users express themselves and increases comment section activity.

[0099] Please see Figure 10 , Figure 10 This is a flowchart illustrating a comment display method provided in an embodiment of this application. Figure 3 This method can be executed by a computer device, which can be a terminal device (such as the one mentioned above). Figure 1 (Device 11a in the text). This comment shows that the method may include the following steps S301-S303.

[0100] S301. Display the target comment data for the target published content. The target comment data shall include at least the comment video.

[0101] S302. Display at least one of the following in association with the comment video: audio description text corresponding to the audio content in the comment video, and video description text corresponding to the comment video.

[0102] Specifically, the comment video includes multiple audio tracks; the volume values ​​corresponding to each of the multiple audio tracks are determined, the maximum volume value among the multiple volume values ​​is determined, the audio content in the audio track corresponding to the maximum volume value among the multiple audio tracks is processed by text conversion to obtain audio description text; and / or the audio content included in each of the multiple audio tracks is processed by text conversion to obtain the text corresponding to each of the multiple audio tracks, and the text corresponding to each of the multiple audio tracks is annotated by the user to obtain audio description text.

[0103] S303. In response to the triggering operation on the target key text, play the video segment corresponding to the target key text in the comment video.

[0104] Specifically, in response to a triggered operation on a comment video, the comment video is played via a video player; the video player includes a text content area; the comment text from the comment data is displayed in the text content area, and when the display duration of the comment text is equal to a display duration threshold, the comment text in the text content area is updated to audio description text and / or video description text.

[0105] If the user corresponding to the terminal device (hereinafter referred to as the target user) triggers a comment video, the terminal device can output the video content of the comment video. Please see also Figure 8 The terminal device responds to the trigger operation for the comment video 202j and plays it. Figure 11 The example video playback page 20z (i.e., the video player) contains... Figure 11 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 7 This application embodiment does not limit the relationship between the video playback page 20z and the comment display page 20i, and can be set according to the actual application scenario.

[0106] The terminal device starts playing the comment video from the beginning frame on the video playback page 20z; optionally, if the target user triggers the comment video a second time, the terminal device determines the previous end playback progress of the comment video 202j (representing the progress at the time of the previous end playback) and starts playing the comment video 202j from the previous end playback progress.

[0107] The video playback page 20z includes a text content area 201z, which can display the posting information of comment data. Figure 8 as well as Figure 11 Examples include the posting object information for comment data in video 202j, including account avatar and account name ( Figure 8 Example 12), the text content area 201z can also display the comment text from the comment data, such as Figure 8 as well as Figure 11 The example is someone watching pandas.

[0108] The terminal device counts the display duration of the comment text. When the display duration equals the display duration threshold, the comment text in the text content area 201z is updated to display as audio description text and / or video description text. The display duration threshold is an adjustable parameter, such as 3 seconds or 4 seconds. Figure 11 The example shows a duration threshold of 4 seconds. Therefore, when the terminal device plays the comment video 202j, the comment text is displayed in the text content area 201z for the first 4 seconds. When the display duration of the comment text is equal to 4 seconds, the audio description text and / or video description text are displayed in the text content area 201z.

[0109] In practice, if both audio and video description text exist, the terminal device can display the audio description text in the text content area 201z. If its display duration equals the display duration threshold, the video description text can be displayed in the text content area 201z. Similarly, if the display duration of the video description text equals the display duration threshold, the terminal device will redisplay the comment text in the text content area 201z.

[0110] Please see also Figure 12 , Figure 12 This is a schematic diagram of a comment display scenario provided in an embodiment of this application. Figure 8 .like Figure 12 As shown, the audio description text corresponding to comment video 202j includes the highlighted target keyword text. Figure 12 The example is the bolded and underlined text "A panda is eating bamboo." If the target user does not trigger the comment video 202j, but instead triggers the target keyword text in the audio description text, the terminal device will respond to the triggering operation on the target keyword text by playing the video segment corresponding to the target keyword text in the comment video 202j. Figure 12 The starting frame of the video segment corresponding to the example target key text is the video frame corresponding to the 3rd second of comment video 202j. If the video segment corresponding to the target key text includes the content from the 3rd second to the 7th second of comment video 202j, then the terminal device will play the content from the 3rd second to the 7th second of comment video 202j.

[0111] Understandable, Figure 12 This description uses audio description text, which includes target key text, as an example. In practical applications, video description text can also include target key text.

[0112] To assist users in various scenarios without increasing functional complexity, this application embodiment not only supports users posting video comments but also identifies background sounds within the video and recognizes the video itself. It then presents the audio content (i.e., audio description text) and video content (i.e., video description text) using text bubbles, helping users understand the video content in advance. Therefore, users can decide whether to click to view the content based on the audio and video description text. Thus, this application embodiment better supports video consumption scenarios, avoiding the need for users to view the video to obtain information. Simultaneously, the multimedia content in the comment section better helps users express themselves and increases comment section activity.

[0113] Please see Figure 13 , Figure 13 This is an interactive flowchart of a comment display method provided in an embodiment of this application. The method can be interactively executed by the aforementioned terminal device (e.g., device 11a) and server (e.g., server 100a), and the terminal device can run a client. The comment display method may include the following steps S401-S404.

[0114] S401. In response to the comment confirmation operation of the comment video, the client sends the comment video to the server.

[0115] S402. The server performs text conversion processing on the audio content in the comment video to obtain audio description text, and / or performs video understanding and optimization on the comment video to obtain video description text.

[0116] S403. The server sends audio description text and / or video description text to the client.

[0117] S404. The client displays audio description text and / or video description text in association with the video being commented on on the comment display page.

[0118] As described above, the embodiments of this application can provide comment videos, and for the comment videos, audio description text and / or video description text associated with the audio content can be provided. The audio description text and / or video description text can describe the comment videos, so the display effect of the comments can be improved through the audio description text and / or video description text, thereby improving the interactive effect of the comments.

[0119] Please see Figure 14 , Figure 14This is a schematic diagram of the structure of a comment display device provided in an embodiment of this application. Figure 14 As shown, the comment display device 1 can be a computer device (e.g., the one described above). Figure 1 A computer program (including program code) for device 11a), for example, the comment display device 1 is an application software; it is understood that the comment display device 1 can be used to perform corresponding steps in the comment display method provided in the embodiments of this application. Figure 14 As shown, the comment display device 1 may include a display module 11.

[0120] Display module 11 is used to display target comment data of the target published content, and the target comment data includes at least the comment video; The display module 11 is also used to display, in association with the comment video, at least one of the audio description text corresponding to the audio content in the comment video and the video description text corresponding to the comment video.

[0121] In one possible implementation, the display module 11 displays target comment data for the target published content, and performs at least one of the following operations: In response to video commenting actions on the target content, display the target comment data on the comment display page of the target content; In response to a comment browsing action on the target published content, load the target comment data on the comment display page of the target published content.

[0122] In one possible implementation, the display module 11, in response to a video comment operation on the target published content, displays target comment data on the comment display page of the target published content, for performing the following operations: In response to the operation of selecting a comment video for the target published content, determine the comment video; or in response to the operation of recording a comment video for the target published content, determine the comment video. In response to a comment confirmation action on the target published content, target comment data, including the comment video, is displayed on the comment display page of the target published content.

[0123] In one possible implementation, display module 11 is also used to perform the following operations: In response to a text conversion operation on the audio content in the comment video, an initial audio description text is determined; the initial audio description text includes multiple words. The comment text is matched with multiple word segments to obtain matching values ​​for each word segment. Determine the target matching value from the matching values ​​corresponding to multiple word segments; the target matching value is equal to or greater than the remaining matching values ​​other than the target matching value among the matching values ​​corresponding to multiple word segments. The words corresponding to the target matching value in multiple word segments are identified as the target key text, and audio description text is generated based on the target key text.

[0124] In one possible implementation, display module 11 is also used to perform the following operations: Perform video understanding on the comment video to obtain video understanding data of the comment video, which includes video understanding text; The video understanding text is optimized based on at least one of the target published content, the comment context of the target comment data, and the audio description text to obtain the video description text.

[0125] In one possible implementation, video understanding data also includes the video's expressive intent; Display module 11 optimizes the video understanding text based on at least one of the target published content, the comment context of the target comment data, and the audio description text, to obtain the video description text, which is used to perform the following operations: Determine the optimized guidance data corresponding to the video's intended message; Based on at least one of the target published content, the comment context of the target comment data, the audio description text, and the optimized guidance data, the video understanding text is optimized to obtain the video description text.

[0126] In one possible implementation, the display module 11 displays, in association with the comment video, at least one of the audio description text corresponding to the audio content in the comment video and the video description text corresponding to the comment video, for performing at least one of the following operations: An audio description text is displayed in association with the comment video, and a first source information for the audio description text is displayed at the end of the audio description text, which indicates that the audio description text was generated based on the audio content in the comment video; Video description text is displayed in association with the comment video, and a second source information for the video description text is displayed at the end of the video description text, which indicates that the video description text was generated by identifying the comment video.

[0127] In one possible implementation, display module 11 is also used to perform the following operations: The target published content and the audio description text are matched to obtain the first matching value; The target published content and video description text are matched to obtain a second matching value; The first and second matching values ​​are weighted and merged to obtain the total matching value. Based on the total match value, the location of the target area for displaying the target comment data is determined on the comment display page of the target published content. There is a positive relationship between the location of the target area on the comment display page and the total match value.

[0128] In one possible implementation, display module 11 is also used to perform the following operations: In response to a trigger action on the target keyword text, play the video segment corresponding to the target keyword text in the comment video.

[0129] In one possible implementation, the commentary video includes multiple audio tracks; The display module is also used to perform at least one of the following operations: Determine the volume values ​​corresponding to multiple audio tracks, determine the maximum volume value among the multiple volume values, and perform text conversion processing on the audio content of the audio track corresponding to the maximum volume value among the multiple audio tracks to obtain the audio description text; The audio content of multiple audio tracks is converted into text to obtain the text corresponding to each audio track. The text corresponding to each audio track is then annotated by the user to obtain the audio description text.

[0130] In one possible implementation, the display module is also used to perform the following operations: In response to a triggered action on the comment video, the comment video is played via a video player; the video player includes a text content area; Display the comment text from the comment data in the text content area. When the display duration of the comment text equals the display duration threshold, update the comment text in the text content area to audio description text and / or video description text.

[0131] As described above, the embodiments of this application can provide comment videos, and for the comment videos, audio description text and / or video description text associated with the audio content can be provided. The audio description text and / or video description text can describe the comment videos, so the display effect of the comments can be improved through the audio description text and / or video description text, thereby improving the interactive effect of the comments.

[0132] Please see Figure 15 , Figure 15 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Figure 15As shown, the computer device 1000 may include a processor 1001, a network interface 1004, and a memory 1005. Furthermore, the computer device 1000 may also include a user interface 1003 and at least one communication bus 1002. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be high-speed RAM or non-volatile memory, such as at least one disk storage device. Optionally, the memory 1005 may also be at least one storage device located remotely from the processor 1001. Figure 15 As shown, the memory 1005, which is a computer-readable storage medium, may include an operating system, a network communication module, a user interface module, and a device control application.

[0133] In such Figure 15 In the computer device 1000 shown, the network interface 1004 provides network communication functionality; the user interface 1003 is mainly used to provide an input interface for the user; and the processor 1001 can be used to call the device control application stored in the memory 1005 to execute the description of the comment display method in any of the corresponding embodiments above, which will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated.

[0134] Furthermore, it should be noted that this application also provides a computer-readable storage medium storing a computer program adapted to be loaded and executed by a processor, so that a computer device having a processor performs the methods described in the preceding embodiments. Therefore, these will not be repeated here. Additionally, the beneficial effects of using the same method will also not be repeated. For technical details not disclosed in the embodiments of the computer-readable storage medium involved in this application, please refer to the description of the method embodiments of this application.

[0135] The aforementioned computer-readable storage medium can be the apparatus provided in any of the foregoing embodiments or the internal storage unit of the aforementioned computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium can also be an external storage device of the computer device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., provided on the computer device. Furthermore, the computer-readable storage medium may include both internal storage units and external storage devices of the computer device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0136] Furthermore, it should be noted that this application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. The computer program is adapted to be read and executed by a processor, so that a computer device having a processor performs the method provided in any of the corresponding embodiments described above. Additionally, the beneficial effects of using the same method will not be repeated here. For technical details not disclosed in the computer program product or computer program embodiments involved in this application, please refer to the description of the method embodiments of this application.

[0137] The terms "first," "second," etc., in the specification, claims, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the term "comprising," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, apparatus, product, or device that includes a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other step units inherent to these processes, methods, apparatuses, products, or devices.

[0138] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this application.

[0139] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.

Claims

1. A method for displaying comments, characterized in that, The method includes: Displaying target comment data for the target published content, wherein the target comment data includes at least the comment video; At least one of the following is displayed in association with the comment video: audio description text corresponding to the audio content in the comment video, and video description text corresponding to the comment video.

2. The method according to claim 1, characterized in that, The target comment data for displaying the target published content includes at least one of the following: In response to a video commenting action on the target published content, the target comment data is displayed on the comment display page of the target published content; In response to a comment browsing operation on the target published content, target comment data is loaded on the comment display page of the target published content.

3. The method according to claim 2, characterized in that, The step of displaying target comment data on the comment display page of the target published content in response to a video comment operation on the target published content includes: In response to a video selection operation for commenting on the target published content, a video for commenting is determined; or in response to a video recording operation for commenting on the target published content, a video for commenting is determined. In response to a comment confirmation operation on the target published content, target comment data, including the comment video, is displayed on the comment display page of the target published content.

4. The method according to claim 1, characterized in that, The comment data also includes the comment text; The method further includes: In response to a text conversion operation on the audio content in the comment video, an initial audio description text is determined; the initial audio description text includes multiple word segments; The comment text is matched with the multiple word segments to obtain the matching values ​​corresponding to the multiple word segments respectively; A target matching value is determined from the matching values ​​corresponding to the plurality of word segments; the target matching value is equal to or greater than the remaining matching values ​​other than the target matching value among the matching values ​​corresponding to the plurality of word segments. The word segment corresponding to the target matching value among the multiple word segments is determined as the target key text, and audio description text is generated based on the target key text.

5. The method according to claim 1, characterized in that, The method further includes: The comment video is subjected to video understanding to obtain video understanding data of the comment video, and the video understanding data includes video understanding text; The video understanding text is optimized based on at least one of the target published content, the comment context of the target comment data, and the audio description text to obtain the video description text.

6. The method according to claim 5, characterized in that, The video understanding data also includes the video's expressive intent; The step of optimizing the video understanding text based on at least one of the target published content, the comment context of the target comment data, and the audio description text to obtain the video description text includes: Determine the optimized guidance data corresponding to the video's expressive intent; The video understanding text is optimized based on at least one of the target published content, the comment context of the target comment data, the audio description text, and the optimization guidance data to obtain the video description text.

7. The method according to claim 1, characterized in that, The display of at least one of the audio description text corresponding to the audio content in the comment video and the video description text corresponding to the comment video, associated with the comment video, includes at least one of the following: An audio description text is displayed in association with the comment video, and a first source information of the audio description text is displayed at the end of the audio description text, the first source information indicating that the audio description text is generated based on the audio content in the comment video; Video description text is displayed in association with the comment video, and second source information of the video description text is displayed at the end of the video description text, the second source information being used to indicate that the video description text was generated by identifying the comment video.

8. The method according to claim 7, characterized in that, The method further includes: The target published content and the audio description text are matched to obtain a first matching value; The target published content and the video description text are matched to obtain a second matching value; The first matching value and the second matching value are weighted and fused to obtain the total matching value; Based on the total matching value, the location of a target area for displaying the target comment data is determined on the comment display page of the target published content, and the location of the target area on the comment display page has a positive relationship with the total matching value.

9. The method according to claim 4, characterized in that, The method further includes: In response to a triggering operation on the target key text, the video segment corresponding to the target key text in the comment video is played.

10. The method according to claim 1, characterized in that, The commentary video includes multiple audio tracks; The method further includes at least one of the following: Determine the volume values ​​corresponding to the multiple audio tracks, determine the maximum volume value among the multiple volume values, and perform text conversion processing on the audio content in the audio track corresponding to the maximum volume value among the multiple audio tracks to obtain audio description text; The audio content of each of the multiple audio tracks is converted into text to obtain the text corresponding to each audio track. The text corresponding to each of the multiple audio tracks is then annotated by the user to obtain the audio description text.

11. The method according to claim 1, characterized in that, The method further includes: In response to a triggered operation on the comment video, the comment video is played via a video player; the video player includes a text content area; The comment text in the comment data is displayed in the text content area. When the display duration of the comment text is equal to the display duration threshold, the comment text in the text content area is updated to the audio description text and / or the video description text.

12. A comment display device, characterized in that, The device includes: A display module is used to display target comment data for the target published content, wherein the target comment data includes at least the comment video; The display module is further configured to display, in association with the comment video, at least one of the audio description text corresponding to the audio content in the comment video and the video description text corresponding to the comment video.

13. A computer device, characterized in that, Including memory and processor; The memory is connected to the processor, the memory is used to store computer programs, and the processor is used to invoke the computer programs so that the computer device performs the method according to any one of claims 1-11.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted to be loaded and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-11.

15. A computer program product, characterized in that, The computer program product includes a computer program stored in a computer-readable storage medium, the computer program being adapted to be read and executed by a processor to cause a computer device having the processor to perform the method of any one of claims 1-11.

Images