Video processing method and device

Abstract

The embodiment of the invention provides a video processing method. The video processing method comprises the following steps: acquiring a plurality of bullet screens of a target video and interaction data of the bullet screens; selecting a target bullet screen from the plurality of bullet screens according to the interaction data of the plurality of bullet screens; converting the target bullet screen into a comment in a target comment area; and associating the comments in the target comment area with the target video so as to display the comments on a playing page of the target video in a comment form. According to the technical scheme provided by the embodiment of the invention, the interactivity and topic degree of the target video can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of multimedia technology, and in particular to a video processing method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] With the increasing popularity of the internet and the continuous advancement of technology, video content has become an indispensable part of people's daily lives. Online video platforms provide users with a rich array of entertainment, educational, and social experiences. As a unique form of interaction, barrage allows users to post real-time comments during video playback, greatly enhancing the interactivity and engagement of the viewing experience. It has become an indispensable feature of many video platforms.

[0003] However, the existing barrage system has certain limitations. On the one hand, with the rapid increase in the number of barrages, users find it difficult to find valuable information in the vast amount of barrages. On the other hand, the immediacy and fluidity of barrages make it easy for some interesting comments to be ignored or missed, thus reducing the discussion of the video.

[0004] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the Invention

[0005] The embodiments of the present application provide a video processing method, apparatus, computer device, computer-readable storage medium, and computer program product to solve or alleviate one or more of the technical problems raised above.

[0006] One aspect of an embodiment of the present application provides a video processing method for a server, the method comprising: Obtain multiple bullet comments of a target video and interaction data of the multiple bullet comments; Selecting a target barrage from the plurality of barrages according to interaction data of the plurality of barrages; Convert the target comment into a comment in the target comment area; The target comment area comments are associated with the target video so as to be displayed in the form of comments on the playback page of the target video.

[0007] Optionally, the interaction data includes the number of consecutive barrage hits; Selecting a target bullet screen from the plurality of bullet screens according to interaction data of the plurality of bullet screens includes: Obtain the number of consecutive barrage hits corresponding to each of the multiple barrages; Selecting the target barrage from the multiple initial barrages according to the number of barrage combos corresponding to each of the multiple barrages; Among them, the number of consecutive hits of the target barrage is greater than the first preset threshold.

[0008] Optionally, the interaction data includes the number of likes for the bullet screen; Selecting a target bullet screen from the plurality of bullet screens according to interaction data of the plurality of bullet screens includes: Obtain the number of likes for each of the multiple barrages; Selecting the target barrage from the multiple initial barrages according to the number of likes for each barrage corresponding to the multiple barrages; Among them, the number of likes for the target barrage is greater than the second preset threshold.

[0009] Optionally, the comment is displayed on the target video playback page, including: Determine, based on the interaction data of the target barrage, a comment display effect of the target comment area comments on the playback page; Among them, different interaction data corresponds to different comment display effects.

[0010] Optionally, converting the target bullet comment into a comment in a target comment area includes: Convert the target barrages into one or more nested comments according to the number of barrage combos corresponding to the target barrages; The nested comments include a main comment and multiple sub-comments, and the sub-comments reply to other sub-comments or the main comment to form a hierarchical reply structure.

[0011] Another aspect of an embodiment of the present application provides a video processing method for a client, the method comprising: Displaying a play page of the target video, wherein the play page has a play area and a comment area; displaying a plurality of comment area comments in the comment area; Among them, the multiple comment area comments include: target comment area comments obtained by converting the target barrage of the target video.

[0012] Another aspect of an embodiment of the present application provides a video processing method for a client, the method comprising: Displaying a play page of the target video, wherein the play page has a play area and a comment area; displaying a plurality of comment area comments in the comment area; Among them, the multiple comment area comments include: target comment area comments obtained by converting the target barrage of the target video.

[0013] Another aspect of an embodiment of the present application provides a video processing device for a server, the device comprising: An acquisition module, configured to acquire multiple bullet comments of a target video and interaction data of the multiple bullet comments; A selection module, configured to select a target barrage from the plurality of barrages according to the interaction data of the plurality of barrages; A conversion module, configured to convert the target bullet comments into comments in a target comment area; An association module is used to associate the comments in the target comment area with the target video so that they are displayed in the form of comments on the playback page of the target video.

[0014] Another aspect of an embodiment of the present application provides a video processing device for a client, the device comprising: A display module is used to display the play page of the target video, wherein the play page has a play area and a comment area; A display module, configured to display a plurality of comments in the comment area; Among them, the multiple comment area comments include: target comment area comments obtained by converting the target barrage of the target video.

[0015] Another aspect of an embodiment of the present application provides a computer device, including: at least one processor; and a memory communicatively coupled to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described above.

[0016] Another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method described above is implemented.

[0017] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the above-mentioned method when executed by a processor.

[0018] The embodiment of the present application adopts the above technical solution, which may include the following advantages: by obtaining multiple barrages of the target video and the interaction data of multiple barrages (for example, the number of likes of the barrage, the number of combos, etc.).

[0019] Based on the interaction data of multiple bullet comments, a target bullet comment is selected from the multiple bullet comments. The target bullet comment is converted into a comment in the target comment area. The comment in the target comment area is then associated with the target video so that it can be displayed as a comment on the target video's playback page, thereby increasing the interactivity and topicality of the target video. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings illustrate exemplary embodiments and constitute a part of the specification. Together with the description of the specification, they serve to explain exemplary implementation of the embodiments. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals designate similar, but not necessarily identical, elements.

[0021] Figure 1 The following schematically shows an operating environment diagram of the video processing method according to the first embodiment of the present application; Figure 2 The flowchart of the video processing method according to the first embodiment of the present application is schematically shown; Figure 3 Schematically shows Figure 2 Flowchart of sub-steps of step S202; Figure 4 Schematically shows Figure 2 Flowchart of sub-steps of step S202; Figure 5 The flowchart of the video processing method according to the second embodiment of the present application is schematically shown; Figure 6 The following schematically shows an exemplary application flow chart of the present application; Figure 7 Schematically shows the effect diagram of the embodiment of the present application; Figure 8 A block diagram schematically shows a video processing device according to a third embodiment of the present application; and Figure 9 A block diagram schematically shows a video processing device according to a fourth embodiment of the present application; and Figure 10 The following schematically shows a hardware architecture diagram of a computer device according to the fourth embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solutions and advantages of this application more clear, the present application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0023] It should be noted that the descriptions of "first", "second", etc. in the embodiments of the present application are for descriptive purposes only and should not be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but this must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0024] In the description of this application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed. They are only used to facilitate the description of this application and to distinguish each step. Therefore, they cannot be understood as limitations on this application.

[0025] First, an explanation of the terms used in this application is provided: Danmu refers to subtitles or images that pop up and move in a predetermined direction when watching videos online. While there's no fixed term for this term in English, it's commonly referred to as comment, danmaku, barrage, bullet screen, or bullet-screen comment. Danmu allows viewers to leave comments or reflections, but unlike typical video sharing websites where comments are displayed in a dedicated area below the video player, these comments appear in real time as sliding subtitles on the video screen, ensuring that all viewers are aware of them. Danmu can be managed through a Danmu system. Some Danmu systems utilize CSS (Cascading Style Sheets) or JavaScript to provide customized Danmu formats, such as allowing them to appear or disappear at specific locations, control their speed, and position. Furthermore, Danmu that appears fixed at the bottom or top of the screen can also serve as subtitles for videos without subtitles.

[0026] For example, the data structure of a bullet comment can be as follows: { The time of emission in the video is in seconds; Type of barrage; The size of the barrage text; The color of the barrage text; Date the comment was created; The class name of the barrage; The user ID that created the barrage; Bullet chat identifier (e.g., bullet chat group identifier); Bullet comment content (e.g., text, images, controls); The duration of the barrage; Whether the bullet screen has a border; The color of the bullet screen border; The interline style of the barrage; } Combo: In gaming, this refers to a combo. Combos appear in most games and refer to the score increase caused by two or more consecutive valid scores. In live streaming, this can refer to multiple consecutive identical comments.

[0027] Video on demand: It is an online video service that allows users to choose viewing time, playback speed, pause, rewind, and other operations according to their needs.

[0028] Secondly, to facilitate technical personnel in this field to understand the technical solutions provided by the embodiments of the present application, the relevant technologies are explained below: When a live video is recorded and published as a video on demand, the barrage content generated during the live broadcast is often not reproduced in the video on demand, which makes the interactivity and topicality of the video on demand low.

[0029] To this end, the present application provides a video processing technology solution to overcome the above-mentioned problems. Detailed description is provided below.

[0030] Finally, for ease of understanding, an exemplary operating environment is provided below.

[0031] like Figure 1 As shown, the operating environment diagram includes: Figure 1 As shown, the operating environment diagram includes: a service platform 2, and clients (4A, 4B, ..., 4N).

[0032] The service platform 2 can be connected to the client terminals ( 4A, 4B, ..., 4N) via a network.

[0033] The service platform 2 can be a single server, a server cluster or a cloud computing service center.

[0034] Service platform 2 can provide the client with services such as storing barrage information.

[0035] Service platform 2 can be located in a single location, such as a data center, or distributed across different geographical locations (e.g., multiple locations). Service platform 2 can provide services via a network. The network includes various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices, and / or the like. The network can include physical links, such as coaxial cable links, twisted pair cable links, fiber optic links, combinations thereof, or wireless links, such as cellular links, satellite links, Wi-Fi links, and the like.

[0036] Clients (4A, 4B, ..., 4N) can be configured to access content and services on the service platform 2. Clients (4A, 4B, ..., 4N) can include electronic devices with or connected to display panels, such as mobile devices, tablets, laptops, workstations, virtual reality devices, gaming devices, digital streaming devices, vehicle terminals, smart televisions, set-top boxes, and the like. They can also include virtualized computing instances. Virtualized computing instances can include virtual machines, such as emulations of computer systems, operating systems, servers, and the like. Computing devices can load virtual machines based on virtual images and / or other data defining specific software (e.g., operating systems, specialized applications, servers) for emulation. As demand for different types of processing services changes, different virtual machines can be loaded and / or terminated on one or more computing devices.

[0037] Clients (4A, 4B, ..., 4N) can be associated with one or more users. A single user can also use one or more of the clients (4A, 4B, ..., 4N) to access the service platform 2. Clients (4A, 4B, ..., 4N) can travel to various locations and use different networks to access the service platform 2.

[0038] The client (4A, 4B, ..., 4N) may include an interface. The interface may include a touchpad, a touch screen, a mouse, a keyboard, or other sensing elements. For example, the input element may be configured to receive user instructions, which may cause the client (4A, 4B, ..., 4N) to perform various operations, such as recording a video, uploading a video, etc.

[0039] It should be noted that the above devices are exemplary, and the number and type of devices can be adjusted in different scenarios or according to different needs.

[0040] Example 1 This method embodiment can be executed in a server. Below, the server is used as the execution subject of this process.

[0041] Figure 2 The flowchart of the video processing method according to the first embodiment of the present application is schematically shown.

[0042] like Figure 2 As shown, the video processing method may include steps S200 to S206, wherein: Step S200, obtaining multiple bullet comments of a target video and interaction data of the multiple bullet comments; Step S202, selecting a target barrage from the multiple barrages based on the interaction data of the multiple barrages; Step S204, converting the target bullet comment into a comment in the target comment area; Step S206: Associating the target comment area comments with the target video so as to be displayed in the form of comments on the play page of the target video.

[0043] The video processing method provided in this embodiment obtains multiple bullet comments from a target video and their interaction data (e.g., number of likes, combo counts, etc.). Based on the interaction data, a target bullet comment is selected from the multiple bullet comments. The target bullet comment is converted into a comment in the target comment section. The comment in the target comment section is then associated with the target video so that it can be displayed as a comment on the target video's playback page, thereby increasing the interactivity and topicality of the target video.

[0044] The following combination Figure 2 , each step in steps S200~S206 and other optional steps are described in detail.

[0045] Step S200 , obtain multiple barrages of the target video and the interaction data of the multiple barrages.

[0046] For example, target videos can include educational lectures, entertainment performances, sports events, technology demonstrations, and other content. They can be live streams, short videos, on-demand videos, and other formats. Comments can include content, sender information, posting time, and location information. Interaction data includes the number of likes, replies, and combo counts for a comment.

[0047] In some embodiments, a target activity can be created. When a user participates in the target activity, the server creates a unique activity identifier for the user participating in the activity and records the association between the activity identifier and the user in a database. For target videos or live broadcast rooms associated with users who did not participate in the target activity, there is no need to perform the subsequent steps in the embodiments of the present application. In other words, there is no need to convert the target barrage corresponding to the target video into comments in the comment area.

[0048] Step S202 , based on the interaction data of multiple barrages, select a target barrage from the multiple barrages.

[0049] For example, the number of replies to a barrage can reflect the audience's active discussion of the content of the barrage, so the barrage with a number of replies exceeding a certain threshold (such as 3) can be used as the target barrage.

[0050] Each barrage is associated with its content and other barrage information. This barrage information may include interaction data, sender information (e.g., username, user ID, user avatar, user level or privilege status), sending time, location information, format and style (e.g., font size, color, font type, background color, border, scrolling speed), and associated content (e.g., product links, related video recommendations, comment quotes, etc.). In some embodiments, in addition to selecting a target barrage from multiple barrages based on their interaction data, it is also possible to select a target barrage from multiple barrages based on other barrage information corresponding to each barrage. For example, barrages posted within a specific time period can be selected as target barrages. For example, barrages posted within the last 5 or 10 minutes can be selected. Barrages related to the live broadcast theme, product, etc. can also be selected as target barrages. Barrages sent by users with specific identities can also be selected as target barrages. For example, barrages from live streamers, specific fan groups (e.g., fan club members), etc. can be selected.

[0051] In some embodiments, if the target video is a live stream, the content during the panning process can be recorded and converted into a video on demand. Multiple bullet comments and their interaction data can then be captured and stored in a database. This database may include a live broadcast table, an on-demand table, and a bullet comment table. The live broadcast table may include the live broadcast room number, host ID, live broadcast start time, live broadcast end time, and bullet comment ID. The on-demand table may include the on-demand video ID, host ID, recording start time (i.e., slice start time), recording end time (i.e., slice end time), and more. The bullet comment table may include the bullet comment ID, sender, bullet comment content, and posting time. It can be seen that a target bullet comment can be selected from multiple bullet comments based on the target time period during the live broadcast of the on-demand video. For example, if the live broadcast time is from 6:00 PM to 8:00 PM, the recorded live video segment (i.e., the live slice used to form the on-demand video) will be from 6:42 PM to 7:00 PM. According to the on-demand video identifier, multiple barrages in the live broadcast room corresponding to the on-demand video in the time period from 18:42 to 19:00 can be obtained from the database as multiple target barrages, so that these target barrages can be subsequently converted into comments in the on-demand video comment area, thereby realizing the conversion of target barrages (such as high-energy barrages, etc.) in the live video into comments in the on-demand video comment area.

[0052] In an optional embodiment, the interaction data includes the number of consecutive barrage hits; Figure 3 As shown, step S202 may include: Step S300, obtaining the number of consecutive clicks of each of the multiple barrages; Step S302, selecting the target barrage from the multiple initial barrages according to the number of barrage combos corresponding to each of the multiple barrages; Among them, the number of consecutive hits of the target barrage is greater than the first preset threshold.

[0053] For example, the number of consecutive hits (i.e., combo count) of a barrage can reflect the audience's interest in a particular topic. Therefore, barrages with a combo count exceeding a first preset threshold (e.g., 7) can be targeted. Specifically, the number of consecutive hits (i.e., combo count) for each barrage can be counted using various methods, such as counters, machine learning algorithms (e.g., clustering algorithms, time series analysis, etc.). Whenever a new barrage is received, its content can be checked to see if it is identical or similar to the previously received barrage. For example, if the similarity reaches a certain threshold (e.g., above 80%), the two barrages are considered similar, and the combo count for that barrage can be increased. In some embodiments, an appropriate time window for counting combo counts can be set based on the live stream's pace and audience interaction, thereby improving statistical accuracy. For example, in a fast-paced game live stream, viewers may frequently send similar barrages to express excitement or support. In this case, a shorter time window (e.g., 5 seconds) can be used. In a slower-paced lecture or interview live stream, audience interaction may be less frequent and the focus may be on in-depth discussion. In this case, a longer time window (e.g., 10 seconds) can be used. The length of the time window can also be dynamically adjusted based on the real-time situation of the live broadcast. For example, if a sudden increase in the frequency of audience interaction is detected, the time window can be automatically shortened to more accurately capture the number of combos.

[0054] Multiple barrages are selected from the multiple initial barrages based on the number of consecutive hits (e.g., 2, 5, 6, etc.) corresponding to each of the multiple initial barrages, wherein the number of consecutive hits of the selected barrages is greater than a preset threshold (e.g., 5, etc.).

[0055] In this embodiment, by filtering out bullet comments with a number of consecutive clicks exceeding a preset threshold, low-quality content in the comment section can be reduced. The filtered bullet comments are subsequently displayed as comments in the comment section of a target on-demand video (e.g., a video on demand). This embodiment can reduce low-quality content in the comment section, allowing viewers to browse valuable information and enhancing discussion and interactivity around the target on-demand video.

[0056] In an optional embodiment, the interaction data includes the number of likes of the bullet screen; Figure 4 As shown, step S202 may include: Step S400, obtaining the number of likes for each of the multiple barrages; Step S402, selecting the target barrage from the multiple initial barrages according to the number of likes for each barrage corresponding to the multiple barrages; Among them, the number of likes for the target barrage is greater than the second preset threshold.

[0057] For example, the number of likes on a barrage can reflect the audience's recognition and liking of the content of these barrages. Therefore, barrages with a number of likes exceeding a second preset threshold (such as 5) can be selected as target barrages. When a user likes a barrage, the server can record the like behavior. Specifically, the like behavior can be associated with the barrage based on the identifier (such as ID) of each barrage. Then, the like data of the barrage is stored in the database. The like data includes the barrage ID, the like user ID, the like time, etc. Whenever a new like behavior occurs, the number of likes for the corresponding barrage in the database is updated in real time.

[0058] In some embodiments, in order to ensure the accuracy of the like data, the like data can be processed regularly, such as deleting invalid like records, correcting incorrect like times, etc.

[0059] In this embodiment, target barrages having a number of likes exceeding a second preset threshold can be screened out from the barrages based on the number of likes of multiple barrages. The screened barrages are subsequently used to be displayed in the comment area of ​​the target video (for example, on-demand video, etc.) in the form of comments. It can be seen that this embodiment can reduce low-quality content in the comment area, thereby enabling viewers to browse valuable information and enhancing the discussion and interactivity of the on-demand video.

[0060] For example, during the live broadcast process, the barrage posted by the user can be obtained and recorded in real time, including information such as the barrage content, the posting user, and the posting time. The obtained barrage data can be stored in the database of the server.

[0061] In some embodiments, the recorded comments can be pre-processed, such as deduplication, filtering, and statistics, to improve the accuracy and efficiency of subsequent analysis.

[0062] In some embodiments, a target activity can be created. When a streamer participates in the target activity, the server creates a unique activity identifier for the streamer and records the association between the activity identifier and the streamer in a database. For live streaming rooms associated with streamers who did not participate in the target activity, there is no need to perform the subsequent steps in the embodiments of this application. In other words, there is no need to convert the target comments generated by these live streaming rooms during the live broadcast into comments in the on-demand video.

[0063] In an optional embodiment, if Figure 3 As shown, step S202 may include: Step S300: obtaining multiple initial bullet comments during the live broadcast, each of which is associated with corresponding bullet comment information; Step S302 : selecting the multiple barrages from the multiple initial barrages according to the barrage information corresponding to each of the multiple initial barrages.

[0064] For example, an initial barrage refers to a barrage sent by viewers during a live broadcast that has not yet been filtered. Each initial barrage is associated with the barrage content and other barrage information. Barrage information can include sender information (such as username, user ID, user profile picture, user level or privilege status), sending time, location information, format and style (such as font size, color, font type, background color, border, scrolling speed), interaction data (such as likes, replies, etc.), and related content (such as product links, related video recommendations, comment quotes, etc.).

[0065] Multiple barrages can be selected from multiple initial barrages based on the barrage information corresponding to each of the multiple initial barrages. For example, barrages within a specific release time period can be selected from multiple initial barrages. For example, barrages sent within the last 5 minutes or 10 minutes can be selected. Barrages related to the theme, product, etc. of the live broadcast can be selected from multiple initial barrages. Barrages sent by users with specific identities can be selected from multiple initial barrages. For example, barrages of anchors, specific fan groups (such as fan club members, etc.) can be selected. Barrages with a certain threshold of likes, replies, or shares can be selected from multiple initial barrages.

[0066] In this embodiment, according to the barrage information corresponding to each of the multiple initial barrages (for example, the release time of the barrage, etc.), barrages that meet the conditions are selected from the multiple initial barrages, so that the selected barrages are more targeted.

[0067] In an optional embodiment, the barrage information includes the number of barrage consecutive hits; Figure 4 As shown, step S302 may include: Step S400, obtaining the number of consecutive barrage clicks corresponding to each of the multiple initial barrages; Step S402, selecting a plurality of barrages from the plurality of initial barrages according to the number of barrage combos corresponding to each of the plurality of initial barrages; Among them, the number of consecutive hits of each of the selected barrages is greater than a preset threshold.

[0068] For example, the number of consecutive hits (i.e., combo counts) for each bullet comment can be counted using various methods, such as counters or machine learning algorithms (such as clustering algorithms or time series analysis). Whenever a new bullet comment is received, its content can be checked to see if it is identical or similar to the previously received content. For example, if the similarity reaches a certain threshold (e.g., above 80%), the two comments are considered similar, and the combo count for that comment can be increased. In some embodiments, an appropriate time window for counting combo counts can be set based on the live stream's tempo and audience interaction, thereby improving statistical accuracy. For example, in a fast-paced game live stream, viewers may frequently send similar comments to express excitement or support. In this case, a shorter time window (e.g., 5 seconds) can be set. In a slower-paced lecture or interview live stream, audience interaction may be less frequent and the focus may be on in-depth discussion. In this case, a longer time window (e.g., 10 seconds) can be set. The length of the time window can also be dynamically adjusted based on the live stream's real-time conditions. For example, if a sudden increase in audience interaction is detected, the time window can be automatically shortened to more accurately capture combo counts.

[0069] Multiple barrages are selected from the multiple initial barrages based on the number of consecutive hits (e.g., 2, 5, 6, etc.) corresponding to each of the multiple initial barrages, wherein the number of consecutive hits of the selected barrages is greater than a preset threshold (e.g., 5, etc.).

[0070] In this embodiment, by filtering out bullet comments with a number of consecutive clicks exceeding a preset threshold, low-quality content in the comment section can be reduced. The filtered bullet comments are subsequently used to display in the comment section of the on-demand video in the form of comments, allowing viewers to browse valuable information and enhancing the discussion and interactivity of the on-demand video.

[0071] Step S204: convert the target bullet comments into comments in the target comment area.

[0072] For example, the target comment area comment can be generated based on the target comment content and the target comment information associated with the target comment, such as user avatar, user nickname, release time, etc. The comment content can include text, emoticons, links, etc. In some embodiments, the extracted comment content can be formatted (for example, adjusting the text length, processing special characters, adding timestamps) to adapt to the format requirements of the comments in the comment area. The target comment area comment can include comment content, sender information (such as user nickname, user avatar), sending time, etc. For example, in order to facilitate understanding, it can be combined with Figure 7, a comment in the target comment area can be generated based on the content of the comment and other information such as the user's avatar, nickname, and posting time. The comment content is "Wow! This video is amazing [emoji], everyone come and watch [video link]", the user nickname is "enthusiastic viewer", the user avatar is "[avatar link]" (displayed as an image in the comment area), and the posting time is "2023-10-05 14:30".

[0073] In some embodiments, a weighted ranking can be performed based on the target comment's posting time, number of likes, number of replies, and other dimensions. The ranking order can be used to determine the display position of the target comment area in the comment area of ​​the on-demand video. For example, the target comment area corresponding to the target comment will be displayed in the comment area of ​​the on-demand video in the ranking order from the top downwards until a preset display limit is reached.

[0074] As can be seen, the target barrage needs to be displayed at a specific time and can only be displayed for a certain period of time. In this embodiment, by converting the target barrage (for example, barrages with high combo counts and high likes) in the target video into comments in the comment area, viewers can directly see the high-quality comments converted from the target barrage in the comment area when viewing the target video, thereby increasing the interactivity and topicality of the target video.

[0075] In an optional embodiment, step S204 may include: Convert the target barrages into one or more nested comments according to the number of barrage combos corresponding to the target barrages; The nested comments include a main comment and multiple sub-comments, and the sub-comments reply to other sub-comments or the main comment to form a hierarchical reply structure.

[0076] It should be noted that in nested comments, the main comment is the starting point of the comment, and the sub-comments are comments other than the main comment.

[0077] Exemplarily, the first barrage sent in a Combo barrage (i.e., barrages that are sent continuously, are content-related, or form interactions) and the subsequent barrages that follow can be converted into one or more nested comments. For example, any one or more barrages that form a Combo barrage can be converted into a main comment (the main comment can be one or more). The remaining barrages are converted into sub-comments. Then, the nested comments can be presented in the form of these sub-comments replying to any other comments (for example, any main comment, any other sub-comments, etc.) to form a hierarchical reply structure. For example, the first sub-comment and the second sub-comment reply to the first main comment, the third sub-comment replies to the second main comment, and the fourth sub-comment replies to the third sub-comment to form a hierarchical reply structure. It is also possible to convert the first barrage sent in a Combo barrage into a main comment, and the subsequent barrages that follow can be converted into the first sub-comment, the second sub-comment, the third sub-comment, the fourth sub-comment, etc. based on the order of sending time. Then, the nested comments can be presented as the first sub-comment replying to the main comment, the second sub-comment replying to the first sub-comment, the third sub-comment replying to the second sub-comment, the fourth sub-comment replying to the third sub-comment, and so on, to form a hierarchical reply structure.

[0078] In some embodiments, a target comment can be converted into a nested comment based on its replies. For example, if a target comment receives replies from other users, and these replies are related or interactive, we can convert these replies and the original comment into a nested comment structure to show a more complete discussion process.

[0079] In this embodiment, the target barrage is converted into a nested comment containing multiple levels of replies according to the number of barrage consecutive hits, thereby enhancing the layering of the comments.

[0080] Step S206 , associate the target comment area comments with the target video so that they are displayed in the form of comments on the playback page of the target video.

[0081] It should be noted that the target barrage corresponding to the target video can be converted into comments in the target comment section of the target video. The target barrage corresponding to the target video can also be converted into comments in the comment section of other related videos. For example, if the target video is part of a series or has some connection with other videos (such as the same theme, characters, events, etc.), these popular barrages can be converted into the comment section of the related videos to stimulate cross-video discussion and interaction, thereby increasing the interactivity and topicality of the video.

[0082] In an optional embodiment, step S206 may include: Determine, based on the interaction data of the target barrage, a comment display effect of the target comment area comments on the playback page; Among them, different interaction data corresponds to different comment display effects.

[0083] For example, if there are two target barrages, these two target barrages can be converted into two target comment area comments respectively. For the first target comment area comment, if the number of likes and replies to its corresponding barrage is high, the comment in this target comment area can be processed. For example, add animation effects, special marks, set highlights, set top display, etc., so that more viewers can notice and participate in related discussions. For the second target comment area comment, compared with the first comment, the number of likes and replies is less, so it can be set to a normal comment display effect. For example, it can be displayed in the comment area in chronological order or other sorting rules.

[0084] Example 2 This method embodiment can be executed in a client. Below, the client is used as the execution subject of this process.

[0085] It should be noted that the technical details and technical effects of this embodiment can be referred to Example 1.

[0086] Figure 5 The flowchart of the video processing method according to the second embodiment of the present application is schematically shown.

[0087] like Figure 5 As shown, the video processing method may include steps S500 to S502, wherein: Step S500: Displaying a play page of the target video, wherein the play page has a play area and a comment area; Step S502, displaying a plurality of comments in the comment area; Among them, the multiple comment area comments include: target comment area comments obtained by converting the target barrage of the target video.

[0088] Exemplarily, multiple barrages of the target video and interaction data of the multiple barrages (for example, the number of likes, the number of combos, etc. of the barrages) are obtained, and then based on the interaction data of the multiple barrages, a target barrage (for example, a barrage with a high number of likes and a large number of combos) is selected from the multiple barrages.

[0089] It should be noted that, in the embodiment of the present application, when the target barrage in the target video is converted into comments in the comment area, users watching the on-demand video can also send comments in the comment area.

[0090] As can be seen, the target barrage needs to be displayed at a specific time and can only be displayed for a certain period of time, resulting in a low level of discussion. However, in this embodiment, by displaying the target video's playback page and converting the target barrage into comments in the comment area, viewers can directly see high-quality comments converted from the target barrage in the comment area when browsing the target video, thereby increasing the target video's topicality and interactivity.

[0091] In order to make this application easier to understand, the following Figure 6 An exemplary application is provided.

[0092] In step S11, when a streamer participates in an activity (i.e., the target activity mentioned above) to convert high-energy bullet comments into on-demand comments, the server creates a unique activity identifier for the streamer participating in the activity. High-energy bullet comments are bullet comments with a number of consecutive hits exceeding a preset threshold.

[0093] In step S12, the server records the association between the activity identifier and the anchor in a database to filter out anchors who have not participated in the activity.

[0094] In step S13, when the anchor participating in the event starts broadcasting, the server stores the relevant information of all high-energy barrages sent by the audience during the live broadcast, including the posting user, posting time, barrage content and Combo times (i.e., the number of consecutive hits), etc.

[0095] In step S14, the host records the live broadcast content on the client to generate a video on demand. During the recording process, the server will record the recording start time, recording end time, recording script ID (i.e., video on demand ID), host ID, and room number.

[0096] In step S15, the host uploads the on-demand video to the server.

[0097] In step S16, the server forwards the on-demand video to multiple clients for playback.

[0098] Step S17: Display the video-on-demand playback page on the client, wherein the playback page includes a comment area and a playback area for playing the video-on-demand.

[0099] Step S18: The client searches for stored high-energy comments from the server according to the recorded script identifier.

[0100] In step S19, the server converts the high-energy barrage into a comment in the target comment area and forwards it to the client.

[0101] Step S20: Display the target comment area comments in the comment area of ​​the video-on-demand playback page of the client.

[0102] Example 3 Figure 8The block diagram of the video processing device according to the third embodiment of the present application is schematically shown. The device is used in a server. The device can be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Figure 8 As shown, the apparatus 1000 may include: an acquisition module 1100, a selection module 1200, a conversion module 1300, and an association module 1400, wherein: An acquisition module 1100 is configured to acquire multiple bullet comments of a target video and interaction data of the multiple bullet comments; A selection module 1200 is configured to select a target bullet comment from the plurality of bullet comments based on interaction data of the plurality of bullet comments; A conversion module 1300 is used to convert the target bullet comment into a comment in a target comment area; The association module 1400 is used to associate the comments in the target comment area with the target video so as to display them in the form of comments on the playback page of the target video.

[0103] In an optional embodiment, the interaction data includes the number of consecutive barrage hits; Selecting a target bullet screen from the plurality of bullet screens according to interaction data of the plurality of bullet screens includes: Obtain the number of consecutive barrage hits corresponding to each of the multiple barrages; Selecting the target barrage from the multiple initial barrages according to the number of barrage combos corresponding to each of the multiple barrages; Among them, the number of consecutive hits of the target barrage is greater than the first preset threshold.

[0104] In an optional embodiment, the interaction data includes the number of likes for the bullet screen; Selecting a target bullet screen from the plurality of bullet screens according to interaction data of the plurality of bullet screens includes: Obtain the number of likes for each of the multiple barrages; Selecting the target barrage from the multiple initial barrages according to the number of likes for each barrage corresponding to the multiple barrages; Among them, the number of likes for the target barrage is greater than the second preset threshold.

[0105] In an optional embodiment, the comment is displayed on the target video playback page, including: Determine, based on the interaction data of the target barrage, a comment display effect of the target comment area comments on the playback page; Among them, different interaction data corresponds to different comment display effects.

[0106] In an optional embodiment, converting the target bullet comment into a comment in a target comment area includes: Convert the target barrages into one or more nested comments according to the number of barrage combos corresponding to the target barrages; The nested comments include a main comment and multiple sub-comments, and the sub-comments reply to other sub-comments or the main comment to form a hierarchical reply structure.

[0107] Example 4 Figure 9 The block diagram of the video processing device according to the fourth embodiment of the present application is schematically shown. The device is used for a client and can be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can perform specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Figure 9 As shown, the device 2000 may include: a presentation module 2100 and a display module 2200, wherein: A display module 2100 is used to display a play page of a target video, wherein the play page has a play area and a comment area; A display module 2200 is used to display multiple comments in the comment area; Among them, the multiple comment area comments include: target comment area comments obtained by converting the target barrage of the target video.

[0108] Example 5 Figure 10 The following schematically shows a hardware architecture diagram of a computer device 10000 suitable for implementing a video processing method according to the fifth embodiment of the present application. In some embodiments, the computer device 10000 may be a terminal device such as a smart phone, a wearable device, a tablet computer, a personal computer, a vehicle-mounted terminal, a game console, a virtual device, a workbench, a digital assistant, a set-top box, a robot, etc. In other embodiments, the computer device 10000 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server or a server cluster composed of multiple servers), etc. Figure 10 As shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other via a system bus. Memory 10010 includes at least one type of computer-readable storage medium, including flash memory, a hard disk, a multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, a magnetic disk, an optical disk, and the like. In some embodiments, memory 10010 may be an internal storage module of computer device 10000, such as a hard disk or memory of computer device 10000. In other embodiments, memory 10010 may also be an external storage device of computer device 10000, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, and the like equipped on computer device 10000. Of course, memory 10010 may also include both internal storage modules and external storage devices of computer device 10000. In this embodiment, the memory 10010 is generally used to store an operating system and various application software installed on the computer device 10000, such as program codes of a video processing method, etc. In addition, the memory 10010 can also be used to temporarily store various data that has been output or is to be output.

[0109] In some embodiments, processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other chips. Processor 10020 is typically used to control the overall operation of computer device 10000, such as performing control and processing related to data exchange or communication with computer device 10000. In this embodiment, processor 10020 is used to execute program code stored in memory 10010 or process data.

[0110] Network interface 10030 may include a wireless network interface or a wired network interface. Network interface 10030 is typically used to establish a communication link between computer device 10000 and other computer devices. For example, network interface 10030 is used to connect computer device 10000 to an external terminal via a network, establishing a data transmission channel and a communication link between computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile Communications (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth, or Wi-Fi.

[0111] It should be pointed out that Figure 10 Only a computer device having components 10010 - 10030 is shown, but it should be understood that implementing all of the shown components is not a requirement, and more or fewer components may alternatively be implemented.

[0112] In this embodiment, the video processing method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiment of the present application.

[0113] Example 6 An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the video processing method in the embodiment are implemented.

[0114] In this embodiment, computer-readable storage media include flash memory, hard disks, multimedia cards, card-type memories (e.g., SD or DX memories), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disks, optical disks, and the like. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as the computer device's hard disk or memory. In other embodiments, the computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, and the like. Of course, the computer-readable storage medium may also include both the internal storage unit and external storage devices of the computer device. In this embodiment, the computer-readable storage medium is typically used to store the operating system and various application software installed on the computer device, such as the program code of the video processing method described in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that has been output or is about to be output.

[0115] Example 7 An embodiment of the present application further provides a computer program product, including a computer program, which implements the method in the above embodiment when executed by a processor.

[0116] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented using general-purpose computer devices. They can be concentrated on a single computer device or distributed on a network composed of multiple computer devices. Alternatively, they can be implemented using program codes executable by the computer device, so that they can be stored in a storage device and executed by the computer device. In some cases, the steps shown or described can be performed in a different order than herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0117] It should be noted that the above are only preferred embodiments of the present application and do not limit the scope of patent protection of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of this application, or directly or indirectly applied in other related technical fields, are also included in the scope of patent protection of the present application.

Claims

1. A video processing method, characterized in that: For the server, the method includes: Acquire multiple bullet comments of a target video and interaction data of the multiple bullet comments; Selecting a target bullet screen from the plurality of bullet screens according to the interaction data of the plurality of bullet screens; Convert the target bullet comments into target comment area comments; The target comment area comments are associated with the target video so as to be displayed in the form of comments on the play page of the target video.

2. The method according to claim 1, characterized in that The interaction data includes the number of barrage combos; According to the interaction data of the plurality of barrages, selecting a target barrage from the plurality of barrages comprises: Obtain the number of barrage combos corresponding to each of the multiple barrages; Selecting the target barrage from the multiple initial barrages according to the number of barrage combos corresponding to each of the multiple barrages; Among them, the number of consecutive hits of the target barrage is greater than the first preset threshold.

3. The method according to claim 1, characterized in that The interaction data includes the number of likes of the bullet screen; According to the interaction data of the plurality of barrages, selecting a target barrage from the plurality of barrages comprises: Obtain the number of likes for each of the multiple bullet comments; Selecting the target barrage from the multiple initial barrages according to the number of likes for the barrages corresponding to the multiple barrages; Among them, the number of likes of the target barrage is greater than the second preset threshold.

4. The method according to claim 1, characterized in that The comment is displayed on the playback page of the target video, including: Determine, according to the interaction data of the target bullet screen, a comment display effect of the target comment area comments on the playback page; Among them, different interaction data corresponds to different comment display effects.

5. The method according to claim 1, characterized in that Convert the target bullet comments into target comment area comments, including: According to the number of consecutive hits of the target bullet comments, the target bullet comments are converted into one or more nested comments; The nested comments include a main comment and multiple sub-comments, and the sub-comments reply to other sub-comments or the main comment to form a hierarchical reply structure.

6. A video processing method, characterized in that: For a client, the method comprises: Displaying a play page of the target video, wherein the play page has a play area and a comment area; displaying a plurality of comment area comments in the comment area; Among them, the multiple comment area comments include: target comment area comments obtained by converting the target barrage of the target video.

7. A video processing device, characterized in that: For a server, the device comprises: An acquisition module, used to acquire multiple bullet comments of a target video and interaction data of the multiple bullet comments; A selection module, configured to select a target bullet screen from the plurality of bullet screens according to the interaction data of the plurality of bullet screens; A conversion module, used to convert the target bullet comment into a comment in a target comment area; An association module is used to associate the comments in the target comment area with the target video so that they can be displayed in the form of comments on the playback page of the target video.

8. A video processing device, characterized in that: For a client, the device comprises: A display module, used to display the play page of the target video, wherein the play page has a play area and a comment area; A display module, used for displaying a plurality of comments in the comment area; Among them, the multiple comment area comments include: target comment area comments obtained by converting the target barrage of the target video.

9. A computer device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein: The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 6 is implemented.

11. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claims 1 to 6 are implemented.

Images