Bullet screen information display method and device, computer equipment and storage medium

Abstract

The invention relates to a bullet screen information display method and device, computer equipment, a storage medium and a computer program product. The method comprises the steps that a video is played on a video playing interface, and the video playing interface is used for displaying at least one piece of bullet screen information associated with the video in a rolling mode and controlling a bullet screen sound mode to be switched between an opening state and a closing state; in response to the fact that at least one piece of target bullet screen information meeting a preset condition is displayed in the video playing interface and a bullet screen sound mode is in an open state, playing target background music associated with the content of the at least one piece of target bullet screen information; and in the process of playing the target background music, when the display of the at least one piece of target bullet screen information is canceled, stopping playing the target background music. By adopting the method, the effectiveness of the equipment for storing the bullet screen information can be improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a bullet screen information display method, device, computer equipment, storage medium and computer program product. Background Art

[0002] With the development of computer technology, video playback applications that can play videos have emerged. In order to improve the interactivity of video viewing, many video playback applications provide a barrage function, which refers to the commentary subtitles that pop up when watching videos on the Internet. During the video playback process, the viewer can view the barrage posted by other video viewers, and can also send barrages while watching the video, and the sent barrages will also be seen by other viewers.

[0003] In the conventional technology, the barrage information is displayed in a manner that it flies in from the right edge of the video playback interface and flies out from the left edge of the video playback interface. However, the style of the displayed barrage information is fixed, and the barrage information is similar. When the viewers see a large amount of barrage information, it is difficult to find the key barrage information from it, and the utilization rate of the barrage information is low, resulting in low utility of the device storing the barrage information. Summary of the invention

[0004] Based on this, it is necessary to provide a barrage information display method, device, computer device, computer-readable storage medium and computer program product that can improve the effectiveness of the device that stores barrage information in response to the above-mentioned technical problems.

[0005] In a first aspect, the present application provides a method for displaying bullet message information. The method comprises:

[0006] Playing a video on a video playback interface, the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and is used to control the switching of the bullet screen sound mode between an on state and an off state;

[0007] In response to at least one target bullet screen information meeting a preset condition being displayed in the video playback interface, and the bullet screen sound mode being in an on state, playing target background music associated with the content of the at least one target bullet screen information;

[0008] During the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played.

[0009] In one embodiment, the bullet screen information display method further includes:

[0010] In response to a triggering operation on the background music icon, the target background music is stopped from being played, and the background music icon is undisplayed.

[0011] In a second aspect, the present application also provides a bullet screen information display device. The device comprises:

[0012] A video playback module, used to play a video on a video playback interface, wherein the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and to control the switching of the bullet screen sound mode between an on state and an off state;

[0013] A background music playing module, configured to respond to at least one target bullet screen information meeting a preset condition being displayed in the video playing interface and the bullet screen sound mode being turned on, and play target background music associated with the content of the at least one target bullet screen information;

[0014] The playing control module is used to stop playing the target background music when at least one target barrage information is cancelled during the playing of the target background music.

[0015] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0016] Playing a video on a video playback interface, the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and is used to control the switching of the bullet screen sound mode between an on state and an off state;

[0017] In response to at least one target bullet screen information meeting a preset condition being displayed in the video playback interface, and the bullet screen sound mode being in an on state, playing target background music associated with the content of the at least one target bullet screen information;

[0018] During the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played.

[0019] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0020] Playing a video on a video playback interface, the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and is used to control the switching of the bullet screen sound mode between an on state and an off state;

[0021] In response to at least one target bullet screen information meeting a preset condition being displayed in the video playback interface, and the bullet screen sound mode being in an on state, playing target background music associated with the content of the at least one target bullet screen information;

[0022] During the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played.

[0023] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0024] Playing a video on a video playback interface, the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and is used to control the switching of the bullet screen sound mode between an on state and an off state;

[0025] In response to at least one target bullet screen information meeting a preset condition being displayed in the video playback interface, and the bullet screen sound mode being in an on state, playing target background music associated with the content of the at least one target bullet screen information;

[0026] During the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played.

[0027] The above-mentioned barrage information display method, device, computer equipment, storage medium and computer program product play a video on a video playback interface, and the video playback interface is used to scroll and display at least one barrage information associated with the video, and is used to control the switching of the barrage sound mode between the on and off states. The video playback interface can be used to realize the display of barrage information and the opening of the barrage sound mode, so that in response to at least one target barrage information that meets the preset conditions being displayed in the video playback interface and the barrage sound mode being in the on state, the target background music associated with the content of the at least one target barrage information can be played. In the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played. At least one target barrage information can be highlighted by playing the target background music, so that at least one target barrage information that meets the preset conditions and is key barrage information can be quickly located from a large amount of barrage information, thereby improving the utilization rate of the barrage information and being able to improve the effectiveness of the device storing the barrage information. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A diagram showing an application environment of a bullet screen information display method in an embodiment;

[0029] Figure 2 A schematic diagram of a process of displaying bullet screen information in one embodiment;

[0030] Figure 3 is a schematic diagram of a scrolling display method in an embodiment;

[0031] Figure 4 is a schematic diagram of playing target background music in one embodiment;

[0032] Figure 5 A schematic diagram showing a background music icon in one embodiment;

[0033] Figure 6 A schematic diagram of canceling the display of a background music icon in an embodiment;

[0034] Figure 7 A schematic diagram of displaying a background music icon in another embodiment;

[0035] Figure 8 is a schematic diagram of stopping playing target background music in one embodiment;

[0036] Fig. 9 A schematic diagram of obtaining background music associated with the content of each barrage information in a barrage information set in one embodiment;

[0037] Fig.10 A schematic diagram of filtering a bullet message set in one embodiment;

[0038] Fig.11 A schematic diagram of obtaining background music associated with the content of each barrage information in a barrage information set in another embodiment;

[0039] Fig.12 A schematic diagram of a flow chart of a method for displaying bullet screen information in another embodiment;

[0040] Fig.13 A schematic diagram of displaying bullet screen information and background music icons in one embodiment;

[0041] Fig.14 It is a structural block diagram of a bullet screen information display device in one embodiment;

[0042] Fig.15 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0044] The bullet screen information display method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown. Among them, a client for realizing the display of bullet screen information is installed on the terminal 102, and the client can be a video application, a web client, or a sub-application running in the operating environment of the parent application. The terminal 102 communicates with the server 104 through the network. The data storage system can store data that the server 104 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other servers. The terminal 102 plays the video on the video playback interface, and the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and is used to control the switching of the bullet screen sound mode between the on state and the off state. In response to the display of at least one target bullet screen information that meets the preset conditions in the video playback interface, and the bullet screen sound mode is in the on state, the target background music associated with the content of at least one target bullet screen information is played, and in the process of playing the target background music, when at least one target bullet screen information is canceled, the target background music is stopped. Among them, at least one bullet screen information is sent to the terminal 102 by the server 104.

[0045] The terminal 102 may be, but is not limited to, various desktop computers, laptop computers, smart phones, tablet computers, IoT devices, and portable wearable devices. The IoT devices may be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. The portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. The server 104 may be implemented as an independent server or a server cluster consisting of multiple servers.

[0046] In one embodiment, Figure 2 As shown, a method for displaying bullet screen information is provided, which can be executed by a terminal or a server alone, or by a terminal and a server in collaboration. In the embodiment of the present application, the method is applied to a terminal as an example for explanation, and includes the following steps:

[0047] Step 202, play the video on the video playback interface, the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and is used to control the switching of the bullet screen sound mode between the on state and the off state.

[0048] The video playback interface refers to an interface for playing videos. For example, the video playback interface may specifically refer to an interface for playing videos in a video application. For another example, the video playback interface may specifically refer to an interface for playing videos in a web client. The video played in the video playback interface may be a video related to a film or television work, or other types of videos. For example, the video may specifically be a movie, or an episode of a TV series. For another example, the video may specifically be a short film edited by the video uploader.

[0049] Among them, barrage information refers to the commentary subtitles that pop up when watching a video, which represents the views on the video being watched and can increase the interactivity between viewers. Barrage sound mode refers to the mode of playing the sound associated with the barrage information while allowing the barrage information to be scrolled. For example, the sound associated with the barrage information can be a piece of music associated with the barrage information. For another example, the sound associated with the barrage information can be the voice associated with the barrage information, which is obtained by converting the barrage information into voice.

[0050] Specifically, the terminal will play the video on the video playback interface. If there is at least one bullet screen information associated with the video, the video playback interface will scroll and display the at least one bullet screen information associated with the video during the video playback process. In addition, the video playback interface is also used to control the switching of the bullet screen sound mode between the on state and the off state. In a specific application, the at least one bullet screen information associated with the video is stored in the server, and when playing the video, the terminal can obtain the at least one bullet screen information associated with the video from the server.

[0051] In a specific application, during the video playback process, when the barrage information in the video is displayed and the barrage mode is turned on, the barrage information associated with the barrage display time is scrolled in the video playback interface. Among them, the barrage information display time refers to the moment when the barrage information is displayed. Specifically, the barrage information display time can be the moment when the barrage information is released. When each barrage information is released, it will be associated with the time when it is released. Among them, the time of release can specifically refer to the video node in the video. For example, if the barrage information is released when the video is played for five minutes, the barrage information can be associated with the moment when the video is played for five minutes. During the video playback process, when the video is played to the moment of five minutes, the barrage information released at the moment of five minutes is scrolled.

[0052] Among them, the barrage mode refers to the mode of scrolling barrage information. When the barrage mode is on, it means that the barrage information is allowed to scroll during the video playback. If the barrage mode is off, it means that the barrage information is not allowed to scroll during the video playback. The video playback interface is also used to control the barrage mode to switch between the on and off states.

[0053] In a specific application, the terminal may scroll and display at least one bullet screen information associated with the video in a preconfigured scrolling display mode, and the preconfigured scrolling display mode may be configured according to the actual application scenario. Figure 3 As shown, the preconfigured scrolling display mode may be flying in from the right edge of the video playing interface and flying out from the left edge of the video playing interface.

[0054] Step 204, in response to at least one target bullet screen information meeting preset conditions being displayed in the video playback interface, and the bullet screen sound mode being turned on, play target background music associated with the content of the at least one target bullet screen information.

[0055] Among them, meeting the preset conditions means meeting the pre-set popular barrage conditions, and the preset conditions can be configured according to the actual application scenario. For example, the preset condition can be that the barrage information weight of the barrage information is greater than the pre-configured weight threshold, and the pre-configured weight threshold can be configured according to the actual application scenario. Target background music refers to music associated with the content of at least one target barrage information as background music, usually referring to music used to adjust the atmosphere in TV series, movies, animations, electronic games, and websites. Inserted into the dialogue, it can enhance the expression of emotions and achieve a feeling that allows the audience to be immersive. For example, the target background music can specifically refer to the background music associated with the content of at least one target barrage information. The association can be understood as matching the style of the content of at least one target barrage information. For example, when the style of the content of at least one target barrage information is festive, the target background music associated with it can be music with a festive style.

[0056] Specifically, in the process of scrolling and displaying at least one barrage information associated with the video, the terminal will determine whether at least one target barrage information that meets the preset conditions is displayed in the video playback interface. When at least one target barrage information that meets the preset conditions is displayed in the video playback interface, in response to at least one target barrage information that meets the preset conditions being displayed in the video playback interface, and the barrage sound mode is in the on state, the terminal will play the target background music associated with the content of the at least one target barrage information. It should be noted that while playing the target background music, the terminal will also keep playing the video.

[0057] In a specific application, at least one target barrage information that meets the preset conditions is pre-screened from at least one barrage information through the preset conditions, and the screening process can be performed by the terminal or by the server. It should be noted that the screening process is performed before the video is played on the video playback interface, that is, before the video is played on the video playback interface, at least one target barrage information that meets the preset conditions has been determined. In a specific application, when the screening process is performed by the server, after determining the video to be played, the terminal can directly pull at least one barrage information associated with the video from the server, and the at least one barrage information associated with the video includes at least one target barrage information that has been screened out and meets the preset conditions.

[0058] In a specific application, when at least one target barrage information is a single target barrage information, the target background music associated with the content of the at least one target barrage information is the background music associated with the content of the single target barrage information. When at least one target barrage information is multiple target barrage information, and the content of each of the multiple target barrage information is respectively associated with background music, the terminal needs to play the target background music associated with the content of the at least one target barrage information based on the background music associated with the content of each of the multiple target barrage information.

[0059] Step 206, during the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played.

[0060] Specifically, during the process of playing the target background music, when at least one target bullet screen information is canceled from being displayed, the terminal will stop playing the target background music. In a specific application, at least one target bullet screen information is displayed in a preconfigured scrolling display mode. Assuming that the preconfigured scrolling display mode is to fly in from the right edge of the video playback interface and fly out from the left edge of the video playback interface, then Figure 4 As shown, when at least one target barrage information flies in from the right edge of the video playback interface, the target background music will start playing, and when at least one target barrage information flies out from the left edge of the video playback interface to the canceled display, the target background music will stop playing.

[0061] In a specific application, when the barrage mode is in the on state, at least one target barrage information will be displayed on the video playback interface. During the process of playing the target background music, if the barrage mode is switched from the on state to the off state, in response to the barrage mode switching from the on state to the off state, the terminal will cancel the display of at least one target barrage information and stop playing the target background music. In a specific application, the video playback interface is also used to control the switching of the barrage mode between the on state and the off state. A state switching control of the barrage mode is displayed on the video playback interface. The viewing object can switch the state of the barrage mode through the state switching control. The state switching here refers to switching the barrage mode from the on state to the off state, or from the off state to the on state.

[0062] The above-mentioned barrage information display method plays a video on a video playback interface, and the video playback interface is used to scroll and display at least one barrage information associated with the video, and is used to control the switching of the on and off states of the barrage sound mode. The video playback interface can be used to realize the display of barrage information and the opening of the barrage sound mode, so that in response to at least one target barrage information that meets the preset conditions being displayed in the video playback interface, and the barrage sound mode being in the on state, the target background music associated with the content of the at least one target barrage information is played. In the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played. At least one target barrage information can be highlighted by playing the target background music, so that at least one target barrage information that meets the preset conditions and is the key barrage information can be quickly located from a large amount of barrage information, thereby improving the utilization rate of the barrage information and being able to improve the effectiveness of the device storing the barrage information.

[0063] In one embodiment, the bullet screen information display method further includes:

[0064] During the process of playing the target background music, on the video playback interface, along with at least one target bullet screen information being scrolled, a background music icon indicating that the target background music is being played is displayed.

[0065] Among them, the background music icon is used to indicate that the target background music is playing, and is displayed when the target background music is playing. The style of the background music icon can be configured according to the actual application scenario. For example, the background music icon can be specifically in the form of a musical note.

[0066] Specifically, during the process of playing the target background music, in the video playback interface, following the scrolling display of at least one target bullet screen information, the terminal will display a background music icon representing that the target background music is playing. In a specific application, it is assumed that the background music icon is in the form of a musical note, and at least one target bullet screen information is a single target bullet screen information, such as Figure 5 As shown, in the video playback interface, following the scrolling display of the single target bullet screen information, the terminal will display a background music icon representing the target background music being played after the single target bullet screen information, so as to realize the marking of the single target bullet screen information. Figure 5 As shown, the number of likes is also displayed after the target bullet message (such as Figure 5 402). Figure 5 In addition to at least one target bullet message, other bullet message information is also displayed in Figure 5 It is indicated by XXXXX.

[0067] In a specific application, when at least one target barrage information is a barrage information group including multiple target barrage information, and the target background music is the background music that matches the barrage information group, then in the process of playing the target background music, in the video playback interface, following the scrolling display of multiple target barrage information, the terminal will display a background music icon indicating that the target background music is playing after the multiple target barrage information.

[0068] In this embodiment, by displaying the background music icon representing the target background music being played along with at least one target barrage information, it is possible to mark at least one target barrage information, so that at least one target barrage information can be quickly located from at least one barrage information displayed in a scrolling manner, thereby improving the utilization rate of the barrage information and the effectiveness of the device storing the barrage information.

[0069] In one embodiment, the bullet screen information display method further includes:

[0070] In the case where at least one target bullet screen information is scrollingly displayed, in response to a playback interruption event of the target background music, the target background music is stopped from being played, and the background music icon displayed following the at least one target bullet screen information is cancelled from being displayed.

[0071] The playback interruption event refers to an event that interrupts the playback of the target background music. For example, the playback interruption event may specifically control the barrage sound mode to switch from an on state to an off state.

[0072] Specifically, when at least one target barrage information is scrolling and displayed, the terminal will monitor the playback interruption event of the target background music. When the playback interruption event of the target background music is triggered, in response to the playback interruption event of the target background music, the terminal will stop playing the target background music and cancel the display of the background music icon that follows at least one target barrage information.

[0073] In a specific application, it is assumed that the background music icon is in the form of a musical note, and is followed by at least one target bullet screen information that is scrolled and displayed after at least one target bullet screen information, such as Figure 6 As shown, in response to the target background music playback interruption event, the terminal will cancel the background music icon displayed following at least one target bullet screen information. Figure 6 In addition to at least one target bullet message, other bullet message information is also displayed in Figure 6 It is indicated by XXXXX.

[0074] In a specific application, the playback interruption event can be triggered by switching the barrage sound mode from on to off, that is, when the barrage sound mode is switched from on to off, the playback interruption event can be triggered. The playback interruption event can also be triggered by selecting the background music icon, that is, when the background music icon is selected, the playback interruption event can be triggered.

[0075] In this embodiment, in response to the target background music playback interruption event, the target background music is stopped, and the background music icon displayed following at least one target bullet message is cancelled, so that the viewing object can intuitively perceive the playback interruption of the target background music.

[0076] In one embodiment, the bullet screen information display method further includes:

[0077] When the background music associated with the content of any target barrage information in at least one target barrage information is played, the background music icon is displayed along with the scrolling target barrage information associated with the background music being played.

[0078] Specifically, when at least one target barrage information is multiple target barrage information, and the contents of each of the multiple target barrage information are respectively associated with background music, then in the process of playing the target background music, when the background music associated with the content of any target barrage information in at least one target barrage information is played, the terminal will follow the scrolling target barrage information associated with the background music being played, and display the background music icon. The background music icon can be displayed after the scrolling target barrage information.

[0079] In specific applications, such as Figure 7 As shown, when the background music associated with the content of the target barrage information 1 is played, the terminal will follow the target barrage information 1 and display the background music icon. When the background music associated with the content of the target barrage information 2 is played, the terminal will follow the target barrage information 2 and display the background music icon.

[0080] In this embodiment, by displaying the background music icon following the scrolling target barrage information associated with the background music being played, it is possible to mark the scrolling target barrage information associated with the background music being played, so that the scrolling target barrage information associated with the background music being played can be quickly located from at least one barrage information scrolling, thereby improving the utilization rate of the barrage information and improving the effectiveness of the device storing the barrage information.

[0081] In one embodiment, the bullet screen information display method further includes:

[0082] In response to a trigger operation on a background music icon, the target background music is stopped from being played, and the background music icon is undisplayed.

[0083] Specifically, when the background music icon is displayed, in response to the triggering operation on the background music icon, the terminal stops playing the target background music and cancels the display of the background music icon. On this basis, the terminal maintains the scrolling display of at least one target bullet screen information, that is, whether the target background music is played and whether the background music icon is displayed does not affect the scrolling display of at least one target bullet screen information.

[0084] In a specific application, during the process of playing the target background music and displaying the background music icon, if the viewing object needs to stop playing the target background music, a trigger operation for the background music icon can be initiated. In response to the trigger operation for the background music icon, the terminal will stop playing the target background music and cancel the display of the background music icon. The trigger operation for the background music icon can be configured according to the actual application scenario. For example, the trigger operation for the background music icon can be a single click, double click, long press operation, etc. for the background music icon.

[0085] In this embodiment, the displayed background music icon can be used to control the playback of the target background music without affecting the scrolling display of at least one target barrage information.

[0086] In one embodiment, the bullet screen information display method further includes:

[0087] Display the status switch control of the barrage sound mode;

[0088] During the process of playing the target background music, in response to a triggering operation on the state switching control component, the target background music is stopped from being played, and the scrolling display of at least one target bullet screen information is maintained.

[0089] Among them, the state switching control refers to a control used to switch the on state and off state of the barrage sound mode. Through the state switching control, the barrage sound mode can be switched from the on state to the off state, and the barrage sound mode can also be switched from the off state to the on state.

[0090] Specifically, the terminal displays a status switching control control for the barrage sound mode. During the process of playing the target background music, in response to a triggering operation on the status switching control control, the barrage sound mode will switch from an on state to an off state, the terminal will stop playing the target background music, and maintain the scrolling display of at least one target barrage information, that is, whether the target background music is played does not affect the scrolling display of at least one target barrage information.

[0091] In a specific application, during the video playback process, the state switching control is not displayed at the beginning. In response to the trigger operation on the video playback interface, the terminal will display the state switching control of the barrage sound mode. Therefore, during the playback of the target background music, if the viewing object needs to stop playing the target background music, a trigger operation can be initiated for the video playback interface. In response to the trigger operation on the video playback interface, the terminal will display the state switching control of the barrage sound mode. In addition, the state switching control can also be automatically displayed when the target background music starts playing, so that the viewing object can realize the state switching control of the barrage sound mode.

[0092] In a specific application, such as Figure 8 As shown, during the process of playing the target background music, the video playback interface displays the video being played and the scrolling bullet screen information including at least one target bullet screen information (other bullet screen information is in Figure 8 Indicated by XXXXX in the figure), if the viewing object needs to stop playing the target background music, a trigger operation can be initiated for the video playback interface. In response to the trigger operation on the video playback interface, the terminal will display the state switching control control of the barrage sound mode. When the viewing object initiates the trigger operation on the state switching control control, the terminal responds to the trigger operation on the state switching control control, stops playing the target background music, and keeps the scrolling display of at least one target barrage information.

[0093] In this embodiment, the state switching control of the displayed barrage sound mode can be used to control the state switching of the barrage sound mode, and based on this, the playback of the target background music can be controlled without affecting the scrolling display of at least one target barrage information.

[0094] In one embodiment, playing target background music associated with content of at least one target barrage information includes:

[0095] When at least one target barrage information is multiple target barrage information, and the contents of each of the multiple target barrage information are respectively associated with background music, the background music associated with the contents of each of the multiple target barrage information will be played sequentially in the order in which the multiple target barrage information are scrolled and displayed on the video playback interface.

[0096] Specifically, when at least one target barrage information is multiple target barrage information, and the contents of each of the multiple target barrage information are respectively associated with background music, the target background music can specifically be that the contents of each of the multiple target barrage information are respectively associated with background music. When the terminal plays the target background music, the background music associated with the contents of each of the multiple target barrage information will be played in sequence according to the order in which the multiple target barrage information are scrolled and displayed on the video playback interface.

[0097] In a specific application, the order in which multiple target barrage information is scrolled and displayed on the video playback interface can be determined according to the display time of the barrage information associated with each of the multiple target barrage information. The target barrage information with an earlier display time is scrolled and displayed first, and the target barrage information with a later display time is scrolled and displayed later. For example, when there are two target barrage information, and the display time of the barrage information associated with target barrage information 1 is the moment when the video is played to the fifth minute, and the display time of the barrage information associated with target barrage information 2 is the moment when the video is played to the fifth minute and thirty seconds, then the order in which target barrage information 1 and target barrage information 2 are scrolled and displayed on the video playback interface is that target barrage information 1 is displayed first, and target barrage information 2 is displayed half a minute after target barrage information 1 is displayed.

[0098] In this embodiment, when at least one target barrage information is multiple target barrage information, and the contents of each of the multiple target barrage information are respectively associated with background music, the order in which the multiple target barrage information are scrolled and displayed on the video playback interface can be utilized to achieve the sequential playback of the background music associated with the contents of each of the multiple target barrage information.

[0099] In one embodiment, playing target background music associated with the content of at least one target bullet screen information includes:

[0100] When at least one target barrage information is a barrage information group including multiple target barrage information, and there is background music matching the barrage information group, the background music matching the barrage information group is played.

[0101] Specifically, when at least one target barrage information is a barrage information group including multiple target barrage information, and there is background music matching the barrage information group, the target background music can specifically be the background music matching the barrage information group, and the terminal will directly play the background music matching the barrage information group.

[0102] In a specific application, the background music that matches the barrage information group may specifically refer to the background music that matches multiple target barrage information in the barrage information group. The background music may be mixed music or spliced ​​music. The background music may be obtained based on the background music associated with the content of each of the multiple target barrage information.

[0103] In a specific application, the music duration of the background music matching the barrage information group is positively correlated with the duration of the barrage information group scrolling display in the video playback interface, that is, the longer the scrolling display duration, the longer the music duration of the background music matching the barrage information group. Specifically, the music duration of the background music matching the barrage information group is the same as the duration of the barrage information group scrolling display in the video playback interface.

[0104] In this embodiment, when at least one target barrage information is a barrage information group including multiple target barrage information, and there is background music matching the barrage information group, the target background music can be played by playing the background music matching the barrage information group.

[0105] In one embodiment, the content of each of the multiple target barrage information is associated with background music respectively; the background music matching the barrage information group is mixed music, and the mixed music includes music elements corresponding to each of the multiple target barrage information, and each music element comes from the background music associated with the content of the corresponding target barrage information.

[0106] Among them, mixed music refers to music obtained by mixing multiple music elements, and music elements refer to various elements that constitute the mixed music. In this embodiment, each music element corresponds to multiple target barrage information respectively, and each music element comes from the background music associated with the content of the corresponding target barrage information.

[0107] Specifically, when the contents of multiple target barrage information are respectively associated with background music, and the background music matching the barrage information group is mixed music, the mixed music will include music elements corresponding to multiple target barrage information, and each music element comes from the background music associated with the content of the corresponding target barrage information.

[0108] In a specific application, for each target barrage information, the background music associated with the content of the target barrage information can be directly used as the music element corresponding to the target barrage information, or a part of the music clip can be extracted from the background music associated with the content of the target barrage information as the music element corresponding to the target barrage information.

[0109] In a specific application, the background music matching the barrage information group is pre-generated, and the pre-generation process can be executed by the terminal or by the server. It should be noted that the pre-generation process is executed before the video is played in the video playback interface, that is, before the video is played in the video playback interface, the background music matching the barrage information group has been pre-generated. In a specific application, when the pre-generation process is executed by the server, the terminal can directly pull the background music matching the barrage information group from the server after determining the video to be played.

[0110] In this embodiment, when the contents of multiple target barrage information are respectively associated with background music, the background music associated with the contents of multiple target barrage information can be used to obtain the music elements in the mixed music, so that the background music matching the barrage information group can be obtained by mixing the music elements, and then the target background music can be played by playing the background music matching the barrage information group.

[0111] In one embodiment, the content of each of the multiple target barrage information is respectively associated with background music; the background music matching the barrage information group is spliced ​​music, and the spliced ​​music includes music clips corresponding to each of the multiple target barrage information, each music clip comes from the background music associated with the content of the corresponding target barrage information, and the splicing order of the music clips in the spliced ​​music corresponds one by one to the barrage heat order of the multiple target barrage information.

[0112] Among them, spliced ​​music refers to music obtained by splicing multiple music clips, and music clips refer to multiple clips that constitute the spliced ​​music. In this embodiment, each music clip corresponds to multiple target barrage information respectively, and each music clip comes from the music background associated with the content of the corresponding target barrage information. The barrage heat order refers to the order obtained by sorting the barrage heat of multiple target barrage information. The barrage heat is used to characterize the popularity of the target barrage information. For example, the barrage heat can be reflected by the number of likes of the target barrage information. The more likes the target barrage information has, the higher the heat of the target barrage information.

[0113] Specifically, when the content of each of the multiple target barrage information is respectively associated with background music, and the background music matching the barrage information group is spliced ​​music, the spliced ​​music will include the music clips corresponding to each of the multiple target barrage information, each music clip comes from the background music associated with the content of the corresponding target barrage information, and the splicing order of the music clips in the spliced ​​music corresponds one-to-one to the barrage popularity order of the multiple target barrage information. In a specific application, the barrage popularity of the target barrage information can be reflected by the number of likes of the target barrage information, and the splicing order of the music clips in the spliced ​​music can correspond one-to-one to the order of the number of likes of the multiple target barrage information.

[0114] For example, assuming that multiple target barrage information include target barrage information 1, target barrage information 2 and target barrage information 3, and the barrage heat value of target barrage information 1 is 400, the barrage heat value of target barrage information 2 is 350, and the barrage heat value of target barrage information 3 is 500, then the music clips corresponding to the multiple target barrage information (music clip 1, music clip 2, music clip 3 respectively) are spliced ​​in the spliced ​​music in the order of music clip 3-music clip 1-music clip 2.

[0115] In a specific application, for each target barrage information, the background music associated with the content of the target barrage information can be directly used as the music clip corresponding to the target barrage information, or a part of the background music associated with the content of the target barrage information can be extracted as the music clip corresponding to the target barrage information.

[0116] In this embodiment, when the contents of multiple target barrage information are respectively associated with background music, the background music associated with the contents of multiple target barrage information can be used to obtain music clips in the spliced ​​music, so that the background music matching the barrage information group can be obtained by splicing the music clips, and then the target background music can be played by playing the background music matching the barrage information group.

[0117] In one embodiment, at least one target bullet comment information belongs to a bullet comment information set associated with the video and meeting a preset condition; the bullet comment information set is obtained in the following manner:

[0118] Obtain at least one bullet comment information associated with the video and the bullet comment release time of each of the at least one bullet comment information;

[0119] Performing word segmentation on at least one bullet chat information respectively to obtain a word segmentation result of at least one bullet chat information;

[0120] The barrage information is filtered based on the word segmentation result and the barrage release time of at least one barrage information, and a barrage information set is filtered out from the at least one barrage information.

[0121] The bullet chat release time refers to the time when the video is played when the bullet chat information is released. For example, if the bullet chat information is released when the video is played to the fifth minute, the bullet chat release time is the fifth minute of the video.

[0122] Specifically, at least one target barrage information belongs to a barrage information set associated with the video that meets preset conditions, and the barrage information set is obtained by screening the barrage information of at least one barrage information. When screening the barrage information, the terminal first obtains at least one barrage information associated with the video and the barrage release time of each of the at least one barrage information, and then performs word segmentation on the at least one barrage information to obtain the word segmentation result of each of the at least one barrage information, so as to understand the at least one barrage information through the word segmentation result, and finally, based on the word segmentation result and the barrage release time of each of the at least one barrage information, the barrage information with consistent barrage content expression and similar release time is integrated to obtain at least one integrated barrage information, and the barrage information set is screened out from the at least one integrated barrage information.

[0123] In a specific application, the terminal can segment at least one bullet screen information by a preconfigured segmentation method, and the preconfigured segmentation method can be configured according to the actual application scenario. For example, the terminal can segment at least one bullet screen information by a preconfigured dictionary, and the preconfigured dictionary includes a large number of preconfigured common words.

[0124] In this embodiment, by separately segmenting at least one barrage information, the segmentation results of at least one barrage information can be obtained, and then the barrage information can be filtered in combination with the segmentation results of at least one barrage information and the barrage release time, and a barrage information set can be filtered out from at least one barrage information.

[0125] In one embodiment, the barrage information is filtered based on the word segmentation result and the barrage release time of at least one barrage information, and filtering the barrage information set from the at least one barrage information includes:

[0126] Based on the word segmentation result and the release time of the at least one barrage information, the barrage information whose barrage content similarity is greater than the similarity threshold and whose release interval is less than the interval threshold in the at least one barrage information is integrated to obtain at least one integrated barrage information;

[0127] Determine the barrage information weight of each of the at least one barrage information after integration, and based on the barrage information weight, filter out a barrage information set from the at least one barrage information after integration.

[0128] Among them, the barrage content similarity is used to describe the similarity between the contents of two barrage information.

[0129] Specifically, based on the word segmentation results of at least one barrage information, the terminal can analyze the similarity of the barrage content of any two barrage information in the at least one barrage information, obtain the barrage content similarity of any two barrage information, and determine the barrage information in the at least one barrage information whose barrage content similarity is greater than the similarity threshold. Based on the barrage release time of each of the at least one barrage information, the terminal can analyze the release interval of any two barrage information in the at least one barrage information, and obtain the barrage information whose release interval is less than the interval threshold. In the case of obtaining the barrage information whose barrage content similarity is greater than the similarity threshold and the barrage information whose release interval is less than the interval threshold, the terminal will integrate the barrage information whose barrage content similarity is greater than the similarity threshold and whose release interval is less than the interval threshold in the at least one barrage information, obtain the integrated at least one barrage information, and then determine the barrage information weight of each of the integrated at least one barrage information, and based on the barrage information weight, filter out the barrage information set from the integrated at least one barrage information.

[0130] The similarity threshold and the interval threshold can be configured according to the actual application scenario. For example, the similarity threshold can be 80% and the interval threshold can be 10 seconds. Then the terminal will integrate at least one bullet screen information whose bullet screen content similarity is greater than 80% and whose release interval is less than 10 seconds.

[0131] In a specific application, when analyzing the similarity of the bullet content of any two bullet messages in at least one bullet message based on the word segmentation results of each of the at least one bullet message, the terminal can obtain the bullet information vectors of the two bullet messages based on the word segmentation results, and then use the bullet information vectors to calculate the similarity of the bullet content. For example, if bullet message 1 can be split into A / (this) dance / so handsome, and bullet message 2 can be split into A / dance / blowing up the whole audience, then it can be considered that bullet message 1 and bullet message 2 are bullet messages whose bullet content similarity is greater than the similarity threshold.

[0132] In a specific application, since only the barrage information whose content similarity is greater than the similarity threshold and whose publishing interval is less than the interval threshold is integrated, the at least one barrage information obtained after integration may include unintegrated barrage information and barrage information obtained by integrating at least two barrage information. For the unintegrated barrage information, the barrage information weight is the barrage heat value. For the barrage information obtained by integrating at least two barrage information, the barrage information weight is the superposition of the barrage heat values ​​of the at least two integrated barrage information. In a specific application, the barrage heat value can specifically be the number of likes. Then, for the barrage information obtained by integrating at least two barrage information, the barrage information weight is the superposition of the number of likes of the at least two integrated barrage information.

[0133] In a specific application, the barrage information obtained by integrating at least two barrage information may specifically refer to the barrage information that is first released among the at least two integrated barrage information. For example, assuming that barrage information 1 and barrage information 2 are barrage information whose barrage content similarity is greater than a similarity threshold and whose release interval is less than an interval threshold, the terminal will integrate barrage information 1 and barrage information 2. When the barrage release time of barrage information 1 is earlier than that of barrage information 2, the terminal will integrate barrage information 2 into barrage information 1. When the barrage release time of barrage information 2 is earlier than that of barrage information 1, the terminal will integrate barrage information 1 into barrage information 2.

[0134] In a specific application, after determining the weight of each barrage information of the at least one barrage information after integration, the terminal can filter out the barrage information whose weight is greater than a pre-configured weight threshold from the at least one barrage information after integration to obtain a barrage information set. The pre-configured weight threshold can be configured according to the actual application scenario.

[0135] In a specific application, after determining the weight of each barrage information of the at least one barrage information after integration, the terminal can sort the at least one barrage information after integration based on the barrage information weight, and use the N barrage information with the largest barrage information weight as the barrage information set. Wherein, N is a positive integer and can be configured according to the actual application scenario.

[0136] In this embodiment, the barrage information can be integrated using the barrage content similarity and the publishing interval, so that on the basis of determining the barrage information weight of each of the at least one barrage information after integration, the barrage information weight can be used to filter out a barrage information set from the at least one barrage information after integration.

[0137] In one embodiment, for each bullet-screen information in the bullet-screen information set, the background music associated with the content of the bullet-screen information is obtained by:

[0138] Based on the time when the barrage information is released, extracting a video clip associated with the barrage information from the video;

[0139] Extracting video features from the video clip to obtain video clip features of the video clip;

[0140] Background music matching is performed based on the targeted bullet comment information and video clip features to obtain background music associated with the content of the targeted bullet comment information.

[0141] Specifically, for each barrage information in the barrage information set, the terminal will determine the background music associated with the content of the barrage information. When determining the background music associated with the content of the barrage information, the terminal will determine the video segment period of the video segment to be extracted in the video based on the barrage release time of the barrage information, and extract the video segment associated with the barrage information from the video according to the video segment period. After extracting the video segment, the terminal will perform video feature extraction on the video segment to obtain video segment features that can characterize the features of the video segment. After obtaining the video segment features, the terminal will perform background music matching based on the barrage information and the video segment features, and determine the background music associated with the content of the barrage information from multiple candidate background music.

[0142] In a specific application, the terminal will determine the video segment period of the video segment to be extracted based on the preconfigured extraction segment duration and the bullet screen release time of the targeted bullet screen information. Among them, the preconfigured extraction segment duration can be configured according to the actual application scenario. In a specific application, the terminal can use the bullet screen release time of the targeted bullet screen information as the starting extraction time, the ending extraction time or the midpoint extraction time, and determine the video segment period in combination with the preconfigured extraction segment duration. For example, when the bullet screen release time is five minutes of video playback, and the extraction segment duration is one minute, if the bullet screen release time is used as the starting extraction time, the determined video segment period is five minutes to six minutes of the video. If the bullet screen release time is used as the ending extraction time, the determined video segment period is four minutes to five minutes of the video. If the bullet screen release time is used as the midpoint extraction time, the determined video segment period is four and a half minutes to five and a half minutes of the video.

[0143] In a specific application, after extracting the video clip, the terminal can extract video features from the video clip through a pre-trained video feature extraction network to obtain video clip features that can characterize the features of the video clip. The pre-trained video feature extraction network can be trained according to actual application scenarios, where the actual application scenarios can specifically refer to the features to be extracted, that is, the video feature extraction network is trained with reference to the features to be extracted. For example, the video clip features can specifically include video object features in the video clip, video clip scene features, etc.

[0144] In this embodiment, the barrage release time of the targeted barrage information can be used to extract a video clip associated with the targeted barrage information from the video, and then the video feature of the video clip can be extracted to obtain the video clip feature. The targeted barrage information and the video clip feature can be used to match the background music, thereby determining the background music associated with the content of the targeted barrage information.

[0145] In one embodiment, video features are extracted from the video clip to obtain video clip features of the video clip, including:

[0146] Identify video objects from video clips;

[0147] Extracting object features from video objects to obtain video object features, and identifying scene features from video clips to obtain video clip scene features;

[0148] Based on the object features and the video segment scene features, video segment features of the video segment are obtained.

[0149] The video object refers to the key object that appears in the video clip. For example, the video object may specifically refer to the key person that appears in the video clip. For example, when the video clip is a film or TV series clip, the video object may specifically refer to the main actor that appears in the video clip. For another example, the video object may specifically refer to the key animal that appears in the video clip.

[0150] Specifically, the terminal will identify the video object from the video clip through frame-by-frame comparative analysis, extract object features of the video object to obtain video object features, and perform scene feature recognition on the video clip to obtain video clip scene features, and determine the tonal features of the video based on the object features and the video clip scene features, and use the object features, video clip scene features and the determined tonal features as the video clip features of the video clip.

[0151] In a specific application, the terminal will extract frames from the video clip to obtain a set of video frames corresponding to the video clip, and then perform frame-by-frame comparative analysis on each video frame in the video frame set, and count the number of times each object that appears in the video clip appears in each video frame. Based on the number of times each object appears in each video frame, the corresponding appearance ratio of each object is determined, and at least one object with the largest appearance ratio is determined as the video object.

[0152] In a specific application, after identifying a video object from a video clip, the terminal will extract a target video frame set containing the video object from the video clip, and use the target video frame set to extract object features of the video object to obtain video object features. In a specific application, the terminal can input each target video frame in the target video frame set into a pre-trained object feature extraction network, extract object features of the video object, and obtain video object features. Among them, the pre-trained object feature extraction network can be trained according to the actual application scenario, and the actual application scenario here can refer to the features to be extracted, that is, the object feature extraction network is trained with reference to the features to be extracted. For example, object features can specifically include object emotion features, object action features, etc.

[0153] In a specific application, when performing scene feature recognition on a video clip, the terminal can recognize key items that appear in the video clip and are used to represent a specific scene. When a key item is recognized, the key item is used as part of the scene feature of the video clip. For example, the key item can be a cake or fireworks that represent a celebration scene, or a rose or red wine that represents a romantic scene.

[0154] In a specific application, when performing scene feature recognition on a video clip, the terminal can perform scene feature recognition on the video clip, determine the video background style content features, and use the video background style content features as part of the video clip scene features. For example, when performing scene feature recognition, the scene features that may appear may be a ski resort, a beach, a sea, a rural field, etc. In a specific application, the terminal can process the video clip through a pre-trained scene feature recognition model to obtain the video background style content features. The pre-trained scene feature recognition model can be configured according to the actual application scenario.

[0155] In a specific application, when the scene feature recognition is performed on a video clip, the terminal can also recognize the number of objects appearing in the video clip, and the number of objects is also used as part of the scene feature of the video clip. After obtaining the object feature and the scene feature of the video clip, the terminal can use the object feature and the scene feature of the video clip to determine the tonality feature of the video. The tonality feature of the video is used to characterize the style of the video. For example, the tonality feature of the video can be specifically festive, rural laziness, sports, ancient style, aesthetics, etc. In a specific application, the terminal can directly obtain the tonality feature of the video by inputting the object feature and the scene feature of the video clip into a pre-trained video tonality classification model. Among them, the pre-trained video tonality classification model can be trained according to the actual application scenario. For example, when the object feature is an object emotion feature, and the object emotion feature is joy, and the scene feature of the video clip includes a large number of objects and fireworks, the tonality feature of the video can be determined to be festive. For another example, when the object feature is an object action feature, and the object action feature is riding a bicycle, and the scene feature of the video clip includes a rural field, the tonality feature of the video can be determined to be rural laziness.

[0156] In this embodiment, by identifying the video object from the video clip and extracting the object features of the video object, the video object features can be obtained. By identifying the scene features of the video clip, the video clip scene features can be obtained. Then, the object features and the video clip scene features can be used to determine the video clip features of the video clip.

[0157] In one embodiment, object features are extracted from video objects to obtain video object features including:

[0158] extracting object images of video objects from videos;

[0159] Performing emotion recognition on the video object based on the object image to obtain the object emotion feature, and performing action recognition on the video object based on the object image to obtain the object action feature;

[0160] The object emotion features and object action features are used as video object features.

[0161] Among them, the object image refers to the image containing the video object in the video. The object emotion feature refers to the feature that represents the emotion of the object. For example, the object emotion feature can specifically be a description of the emotion of the object. For example, the object emotion feature can specifically be disgust, fear, sadness, surprise, happiness, sadness, etc. The object action feature refers to the feature that represents the action of the object. For example, the object action feature can specifically be a description of the action of the object. For example, the object action feature can specifically be dancing, parachuting, making a heart shape, etc.

[0162] Specifically, when the video object is determined, the terminal can directly extract the object image of the video object from the video, and then use the object image to perform object feature recognition on the video object to obtain the video object feature. After obtaining the object image, the terminal will perform emotion recognition on the video object based on the object image and the preconfigured sample expression image set to obtain the object emotion feature, and perform action recognition on the video object based on the object image and the preconfigured sample action image set to obtain the object action feature, and use the object emotion feature and the object action feature as the video object feature. Among them, the preconfigured sample expression image set and the preconfigured sample action image set can be configured according to the actual application scenario.

[0163] In a specific application, the preconfigured sample expression image set can be specifically an image extracted from the JAFFE expression database, which is an open expression image database that includes images of multiple different expressions of multiple different objects, and each expression has multiple sample images. The terminal will use the preconfigured sample expression image set to establish a standard expression template for each expression, and then match the object image with various standard expression templates, and use the expression corresponding to the expression template with the highest matching degree as the object emotion feature.

[0164] In a specific application, the terminal will preprocess and extract features for each sample expression image in a preconfigured sample expression image set to obtain a first image feature of each sample expression image, and then preprocess and extract emotional features for the object image to obtain a second image feature that represents the emotion of the object. The first image features of each sample expression image are matched with the second image features respectively to determine the sample expression image that best matches the object image, and the expression of the best matching sample expression image is used as part of the object emotion feature. The object emotion feature can be specifically in the form of video + video object + expression.

[0165] In a specific application, the terminal can match the first image feature and the second image feature of each sample expression image through a pre-trained classifier to determine the sample expression image that best matches the object image, that is, classify the object image using each sample expression image as a pre-configured category. The pre-trained classifier can be trained according to the actual application scenario.

[0166] In a specific application, the method of performing action recognition on a video object and obtaining the object's action features is similar to the method of performing emotion recognition on a video object and obtaining the object's emotion features. The main difference lies in the different image sets used when training the pre-trained classifier. When performing emotion recognition on a video object, the image set used is a pre-configured sample expression image set, and when performing action recognition on a video object, the image set used is a pre-configured sample action image set.

[0167] In a specific application, the terminal will preprocess and extract features for each sample action image in the preconfigured sample action image set to obtain a third image feature of each sample action image, and then preprocess and extract action features for the object image to obtain a fourth image feature representing the object action. The third image feature of each sample action image will be matched with the fourth image feature respectively to determine the sample action image that best matches the object image, and the action of the best matching sample action image will be used as part of the object action feature. The object action feature can be specifically in the form of video + video object + action.

[0168] In this embodiment, when an object image of a video object is extracted from a video, the object emotion features can be obtained by performing emotion recognition on the video object based on the object image, and the object action features can be obtained by performing action recognition on the video object based on the object image. Furthermore, the object emotion features and object action features can be used as video object features to achieve the acquisition of video object features.

[0169] In one embodiment, background music matching is performed based on the targeted bullet-chat information and video clip features, and the background music associated with the content of the targeted bullet-chat information is obtained, including:

[0170] The targeted bullet comment information and video clip features are used as features to be matched, and feature matching is performed with background music features of multiple candidate background music respectively;

[0171] According to the feature matching result, background music associated with the content of the targeted barrage information is selected from multiple candidate background music.

[0172] The background music feature refers to a feature used to characterize the candidate background music. For example, the background music feature may be a description of the candidate background music. For example, the background music feature may be a music style label describing the background music, such as festive, rural, lazy, etc.

[0173] Specifically, the terminal will use the targeted bullet-chat information and video clip features as features to be matched, and perform feature matching with the background music features of multiple candidate background music to obtain feature matching results, which include the matching degree of multiple candidate background music and the features to be matched. Based on the matching degree, the terminal can filter out the background music associated with the content of the targeted bullet-chat information from the multiple candidate background music. In a specific application, after obtaining the matching degree, the terminal will sort the multiple candidate background music based on the matching degree, and use the candidate background music with the highest matching degree as the background music associated with the content of the targeted bullet-chat information.

[0174] In a specific application, when the targeted barrage information and video clip features are used as features to be matched, the terminal will first extract the barrage label from the targeted barrage information, and then use the extracted barrage label and video clip features as features to be matched. In a specific application, the terminal can use at least one word in the word segmentation result of the targeted barrage information that has the highest overlap with other barrage information as the barrage label of the targeted barrage information. For example, if barrage information 1 can be split into A / (this) dance / so handsome, and barrage information 2 can be split into A / dance / blowing up the whole audience, then it can be considered that the words with the highest overlap between barrage information 1 and other barrage information are A and dance, and A and dance can be used as the barrage labels of barrage information 1.

[0175] In a specific application, the terminal can extract the barrage tag from the targeted barrage information through a preconfigured tag set. The preconfigured tag set can be configured according to the actual application scenario. The preconfigured tag set can include various types of tags, such as tags for various characters, tags for various emotions, tags for various actions, etc.

[0176] In a specific application, the terminal can perform feature matching between the feature to be matched and the background music features of multiple candidate background music through a pre-trained feature matching network to obtain a feature matching result. The pre-trained feature matching network can be configured according to the actual application scenario. In a specific application, for each candidate background music in multiple candidate background music, the terminal will take the candidate background music and the feature to be matched as input to the pre-trained feature matching network, and the feature matching network can output the matching degree between the candidate background music and the feature to be matched.

[0177] In this embodiment, it is possible to utilize the features to be matched including the targeted barrage information and video clip features, and to screen out the background music associated with the content of the targeted barrage information from multiple candidate background music by performing feature matching with the background music features of multiple candidate background music respectively, thereby determining the background music associated with the content of the targeted barrage information.

[0178] In one embodiment, the targeted bullet comment information and video clip features are used as features to be matched, and feature matching is performed with background music features of multiple candidate background music respectively, including:

[0179] Obtain the historical viewing records of the video, and extract the viewing object features of the video based on the historical viewing records;

[0180] The viewing object features, the targeted barrage information and the video clip features are used as features to be matched, and feature matching is performed with the background music features of multiple candidate background music respectively.

[0181] Among them, historical viewing records refer to the viewing records of all viewing objects for the video in the past period of time. The length of the past period of time can be configured according to the actual application scenario. For example, the past period of time can be specifically the past month or the past two months. Viewing object features refer to the features of the object watching the video. For example, viewing object features can specifically be the video type labels that the object watching the video often watches. For example, viewing object features can specifically be action, drama, etc.

[0182] Specifically, the terminal obtains the historical viewing records of the video, determines the historical viewing objects of the viewed video based on the historical viewing records, extracts the viewing object features of the video based on the viewing records of the historical viewing objects, uses the viewing object features, the targeted barrage information and the video clip features as the features to be matched, and performs feature matching with the background music features of multiple candidate background music respectively, so as to obtain a feature matching result including the matching degree of multiple candidate background music and the features to be matched. In a specific application, based on the viewing records of the historical viewing objects, the video types of the viewed videos of the historical viewing objects can be determined, and then at least one video type with the largest number of occurrences can be selected as the viewing object feature.

[0183] In this embodiment, by obtaining the historical viewing records of the video, the viewing object features of the video are extracted according to the historical viewing records, and the viewing object features, the targeted barrage information and the video clip features are used as features to be matched, and feature matching is performed with the background music features of multiple candidate background music respectively. The multiple candidate background music can be screened in combination with the viewing object features, so that the screened background music can be more in line with the preferences of the viewing object.

[0184] In one embodiment, the bullet screen information display method of the present application is illustrated by taking the collaborative execution of the terminal and the server as an example.

[0185] like Fig. 9As shown, the server obtains at least one barrage information associated with the video and the barrage release time of each barrage information, and based on the barrage release time of each barrage information and the understanding of the barrage content of at least one barrage information, screens out a barrage information set associated with the video that meets preset conditions from at least one barrage information, and the barrage information set can be understood as a popular barrage. On the basis of screening out the barrage information set, for each barrage information in the barrage information set, the server extracts the video clip associated with the targeted barrage information from the video based on the barrage release time of the targeted barrage information, performs video understanding (i.e., video feature extraction) on the video clip, obtains the video clip feature of the video clip, performs background music matching based on the targeted barrage information and the video clip feature, and obtains the background music associated with the content of the targeted barrage information. After obtaining the background music associated with the content of each barrage information in the barrage information set, when the terminal is about to play the video, the server will send at least one barrage information including the barrage information set and the background music associated with the content of each barrage information in the barrage information set to the terminal, so that the terminal can display the barrage information according to the sent data (this step is not included in Fig. 9 ).

[0186] In one embodiment, the server can interact with the speech understanding server to filter out the set of bullet-screen information associated with the video that meets the preset conditions from at least one bullet-screen information. Fig.10 As shown, when it is necessary to filter the barrage information set, the operation object will upload the video whose barrage information set needs to be filtered to the server. When it is determined that the video whose barrage information set needs to be filtered, the server will obtain at least one barrage information associated with the video and the barrage release time of each barrage information, and send the obtained at least one barrage information associated with the video and the barrage release time of each barrage information to the semantic understanding server. The semantic understanding server will segment the at least one barrage information respectively to obtain the segmentation result of each at least one barrage information, understand the barrage content based on the segmentation result of each at least one barrage information, integrate and count the barrage information with consistent content expression and short release time interval (that is, the barrage information with barrage content similarity greater than the similarity threshold and the release interval less than the interval threshold in at least one barrage information is integrated to obtain at least one integrated barrage information), determine the barrage information weight of each integrated barrage information, and based on the barrage information weight, filter out the barrage information set from the integrated at least one barrage information, and return the barrage information set and the barrage release time of each barrage information in the barrage information set to the server. It should be noted that the above process of filtering out the barrage information set associated with the video that meets the preset conditions can also be executed by the server alone.

[0187] The semantic understanding server includes a pre-trained natural language processing model, which can be used to understand the content of the bullet screen and determine the bullet screen information with consistent content expression. The pre-trained natural language processing model can be trained according to the actual application scenario. Natural language processing is a technology that studies computer processing of human language, including: syntactic and semantic analysis, information extraction, text mining, machine translation, information retrieval, question-answering system, and dialogue system.

[0188] In one embodiment, the server can interact with other servers to obtain the bullet screen information set and the background music associated with the content of each bullet screen information in the bullet screen information set. Fig.11 As shown, taking the hot barrage as an example, the server can obtain the hot barrage and the background music associated with the content of the hot barrage by interacting with the semantic understanding server, the video understanding server and the background music recommendation system.

[0189] Specifically, when it is necessary to filter the barrage information set, the operation object will upload the video whose barrage information set needs to be filtered to the server. When it is determined that the video whose barrage information set needs to be filtered is required, the server will obtain at least one barrage information associated with the video and the barrage release time of each barrage information, and send the at least one barrage information associated with the video and the barrage release time of each barrage information to the semantic understanding server. The semantic understanding server will segment the at least one barrage information respectively to obtain the segmentation result of each at least one barrage information, understand the barrage content based on the segmentation result of each at least one barrage information, integrate and count the barrage information with consistent content expression and short release time interval (that is, the barrage information with barrage content similarity greater than the similarity threshold and the release interval less than the interval threshold in at least one barrage information is integrated to obtain at least one integrated barrage information), determine the barrage information weight of each integrated at least one barrage information, and based on the barrage information weight, filter out popular barrages (that is, the barrage information set) from the integrated at least one barrage information, return the content tag of the popular barrage to the background music recommendation system, and return the barrage release time of the popular barrage to the video understanding server.

[0190] After receiving the release time of the popular barrage, the video understanding server will identify the video clip features of the release time of the barrage, and return the identified video clip features to the background music recommendation system, so that the background music recommendation system can match the background music according to the content tags and video clip features of the popular barrage, determine the background music associated with the content of the popular barrage, and return the background music associated with the content of the popular barrage to the server for storage.

[0191] Among them, after receiving the release time of the popular barrage, the video understanding server will extract the video clip associated with the popular barrage from the video based on the release time of the barrage, identify the video object from the video clip, extract the object image of the video object from the video, perform emotion recognition on the video object based on the object image to obtain the object emotion feature, and perform action recognition on the video object based on the object image to obtain the object action feature, use the object emotion feature and the object action feature as the video object feature, perform scene feature recognition on the video clip to obtain the video clip scene feature, and obtain the video clip feature of the video clip based on the object feature and the video clip scene feature.

[0192] Among them, when matching background music, the background music recommendation system will obtain the historical viewing records of the video, extract the viewing object features of the video based on the historical viewing records, and use the viewing object features, content tags of popular barrages, and video clip features as features to be matched, and perform feature matching with the background music features of multiple candidate background music respectively. Based on the feature matching results, the background music associated with the content of the popular barrages is screened out from multiple candidate background music.

[0193] In one embodiment, the bullet screen information display method of the present application can be divided into the following steps: Fig.12 The several parts shown include result display part, behavior log part, feature engineering part, recall part and sorting part.

[0194] Among them, the result display part is used to show the background music associated with the content of each barrage information in the matched barrage information set to the viewing object, that is, the barrage information is displayed and the background music is played on the terminal based on the data sent by the server.

[0195] Among them, the behavior log part is used to iteratively generate new models for prediction based on video understanding data, that is, to update the model used to determine the barrage information set, obtain object features, video clip features and other features.

[0196] Among them, the feature engineering part is used to extract labels such as barrage information, video clip features, and video tonal features in the barrage information set, and use these features as input to provide data for the recall part.

[0197] Among them, the recall part is used to lock multiple candidate background music from the music library according to the features provided by the feature engineering part, using data engineering and algorithms, and match the features provided by the feature engineering part with the background music features of multiple candidate background music to obtain feature matching results, which to a certain extent determines the efficiency of the sorting stage and the quality of the recommendation results.

[0198] Among them, the sorting part is used to sort multiple candidate background music according to the feature matching results, and filter out the background music related to the content of the targeted barrage information from the multiple candidate background music.

[0199] The inventor believes that when watching barrages, there are often many highly popular, highly liked, highly overlapping and efficient barrages, and simple text expressions cannot fully reflect the emotions at this time. If these barrages can be converted into a target background music playback at the same time, the viewers can experience the humor and emotions in these barrages.

[0200] Based on this, in the barrage information display method of the present application, the terminal will play the video on the video playback interface, and when at least one target barrage information that meets the preset conditions is displayed in the video playback interface, and the barrage sound mode is in the on state, in response to at least one target barrage information (i.e., popular barrage) that meets the preset conditions being displayed in the video playback interface, the target background music associated with the content of the at least one target barrage information is played, and following the scrolling display of the at least one target barrage information, a background music icon representing the playback of the target background music is displayed. During the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the playback of the target background music is stopped.

[0201] In one embodiment, Fig.13 As shown, when the target barrage information "YiLaw is the light of justice, not for money but for justice" pops up, the terminal will start playing the target background music that matches the barrage information (with justice as the keyword) and the video content (lawyer-related), and following the scrolling barrage information, a background music icon indicating that the target background music is playing will be displayed behind it. Fig.13 In addition to the target bullet message information, other bullet message information is also displayed in Fig.13 XXXXX is used in the text, and the target bullet message also displays the number of likes for the target bullet message ( Fig.13 402 in the case of a .

[0202] The barrage information display method of the present application will not only identify video clip features (such as confession, bungee jumping and other scenes), but also classify the video category and tonality (such as light comedy, drama, literature, horror, etc.), and combine popular barrages, video clip features corresponding to popular barrages, and video category and tonality to match background music. Due to the combination of a deeper understanding of the video, the matched background music can also be more accurate. For example, if the video is a dance competition, the highlight of the plot is the starring dancer holding his breath waiting for the final dance competition result to be announced, and the popular barrage at this time is "high energy warning", then the background music for the announcement of the competition result can be matched according to the time when the barrage was released and the understanding of the video.

[0203] Through the barrage information display method of the present application, at least one target barrage information can be highlighted by playing the target background music, so that at least one target barrage information that meets the preset conditions and is the key barrage information can be quickly located from a large amount of barrage information, thereby improving the utilization rate of the barrage information and improving the utility of the device storing the barrage information. At the same time, the barrage can also be made more interactive and interesting.

[0204] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0205] Based on the same inventive concept, the embodiment of the present application also provides a bullet screen information display device for implementing the bullet screen information display method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more embodiments of the bullet screen information display device provided below can refer to the limitations of the bullet screen information display method above, and will not be repeated here.

[0206] In one embodiment, Fig.14 As shown, a bullet screen information display device is provided, including: a video playback module 1402, a background music playback module 1404 and a playback control module 1406, wherein:

[0207] The video playing module 1402 is used to play the video on the video playing interface, where the video playing interface is used to scroll and display at least one bullet screen information associated with the video, and to control the switching of the bullet screen sound mode between an on state and an off state;

[0208] The background music playing module 1404 is used to play the target background music associated with the content of the at least one target barrage information in response to at least one target barrage information meeting the preset conditions being displayed in the video playing interface and the barrage sound mode being turned on;

[0209] The playing control module 1406 is used to stop playing the target background music when at least one target barrage information is cancelled during the playing of the target background music.

[0210] The above-mentioned barrage information display device plays a video on a video playback interface, and the video playback interface is used to scroll and display at least one barrage information associated with the video, and is used to control the switching of the on and off states of the barrage sound mode. The video playback interface can be used to realize the display of barrage information and the opening of the barrage sound mode, so that in response to at least one target barrage information that meets the preset conditions being displayed in the video playback interface, and the barrage sound mode being in the on state, the target background music associated with the content of the at least one target barrage information is played. In the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played. At least one target barrage information can be highlighted by playing the target background music, so that at least one target barrage information that meets the preset conditions and is key barrage information can be quickly located from a large amount of barrage information, thereby improving the utilization rate of the barrage information and being able to improve the effectiveness of the device that stores the barrage information.

[0211] In one embodiment, the barrage information display device also includes an icon display module, which is used to display a background music icon representing that the target background music is playing, following the scrolling display of at least one target barrage information, on the video playback interface during the process of playing the target background music.

[0212] In one embodiment, the icon display module is also used to stop playing the target background music and cancel the display of the background music icon displayed following the at least one target barrage information in response to a playback interruption event of the target background music when at least one target barrage information is scrolling.

[0213] In one embodiment, the icon display module is also used to display the background music icon when playing background music associated with the content of any target barrage information in at least one target barrage information, following the scrolling target barrage information associated with the background music being played.

[0214] In one embodiment, the playback control module is also used to display the status switching control of the barrage sound mode. During the process of playing the target background music, in response to the triggering operation of the status switching control, the target background music is stopped and the scrolling display of at least one target barrage information is maintained.

[0215] In one embodiment, the background music playback module is also used to play the background music associated with the contents of each of the multiple target barrage information in the order in which the multiple target barrage information are scrolled and displayed on the video playback interface when at least one target barrage information is multiple target barrage information and the contents of each of the multiple target barrage information are respectively associated with background music.

[0216] In one embodiment, the background music playing module is also used to play the background music matching the barrage information group when at least one target barrage information is a barrage information group including multiple target barrage information and there is background music matching the barrage information group.

[0217] In one embodiment, the content of each of the multiple target barrage information is associated with background music respectively; the background music matching the barrage information group is mixed music, and the mixed music includes music elements corresponding to each of the multiple target barrage information, and each music element comes from the background music associated with the content of the corresponding target barrage information.

[0218] In one embodiment, the content of each of the multiple target barrage information is respectively associated with background music; the background music matching the barrage information group is spliced ​​music, and the spliced ​​music includes music clips corresponding to each of the multiple target barrage information, each music clip comes from the background music associated with the content of the corresponding target barrage information, and the splicing order of the music clips in the spliced ​​music corresponds one by one to the barrage heat order of the multiple target barrage information.

[0219] In one embodiment, at least one target barrage information belongs to a barrage information set associated with the video that meets preset conditions; the background music playback module is also used to obtain at least one barrage information associated with the video and the barrage release time of at least one barrage information, respectively segment the at least one barrage information, obtain the segmentation result of at least one barrage information, filter the barrage information based on the segmentation result and barrage release time of at least one barrage information, and filter out the barrage information set from at least one barrage information.

[0220] In one embodiment, the background music playback module is also used to integrate the barrage information whose barrage content similarity is greater than a similarity threshold and whose release interval is less than an interval threshold in at least one barrage information based on the word segmentation result and barrage release time of at least one barrage information, to obtain at least one integrated barrage information, determine the barrage information weight of each integrated at least one barrage information, and filter out a barrage information set from the at least one integrated barrage information based on the barrage information weight.

[0221] In one embodiment, for each barrage information in the barrage information set, the background music playback module is also used to extract a video clip associated with the targeted barrage information from the video based on the barrage release time of the targeted barrage information, perform video feature extraction on the video clip to obtain video clip features of the video clip, perform background music matching based on the targeted barrage information and the video clip features to obtain background music associated with the content of the targeted barrage information.

[0222] In one embodiment, the background music playback module is also used to identify video objects from the video clip, perform object feature extraction on the video object to obtain video object features, and perform scene feature recognition on the video clip to obtain video clip scene features, and based on the object features and the video clip scene features, obtain video clip features of the video clip.

[0223] In one embodiment, the background music playback module is also used to extract an object image of a video object from the video, perform emotion recognition on the video object based on the object image to obtain object emotion features, and perform action recognition on the video object based on the object image to obtain object action features, and use the object emotion features and object action features as video object features.

[0224] In one embodiment, the background music playback module is also used to use the targeted barrage information and video clip features as features to be matched, and perform feature matching with the background music features of multiple candidate background music respectively, and based on the feature matching results, filter out the background music associated with the content of the targeted barrage information from the multiple candidate background music.

[0225] In one embodiment, the background music playback module is also used to obtain the historical viewing records of the video, extract the viewing object features of the video based on the historical viewing records, and use the viewing object features, the targeted barrage information and the video clip features as features to be matched, and perform feature matching with the background music features of multiple candidate background music.

[0226] Each module in the above-mentioned bullet message display device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each of the above modules.

[0227] In one embodiment, a computer device is provided. The computer device may be a terminal or a server. Taking the computer device as a terminal as an example, its internal structure diagram may be as follows: Fig.15As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless method can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a method for displaying bullet screen information is implemented. The display unit of the computer device is used to form a visually visible image, and can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the computer device casing, or an external keyboard, touchpad or mouse, etc.

[0228] Those skilled in the art will understand that Fig.15 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0229] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

[0230] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0231] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0232] It should be noted that the information (including but not limited to historical viewing records, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0233] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0234] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0235] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for displaying bullet screen information, characterized in that: The method comprises: Playing a video on a video playback interface, the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and is used to control the switching of the bullet screen sound mode between an on state and an off state; In response to at least one target bullet screen information meeting a preset condition being displayed in the video playback interface, and the bullet screen sound mode being in an on state, playing target background music associated with the content of the at least one target bullet screen information; During the process of playing the target background music, when at least one target barrage information is canceled from being displayed, the target background music is stopped from being played.

2. The method according to claim 1, characterized in that The method further comprises: During the process of playing the target background music, on the video playback interface, along with the scrolling display of at least one target barrage information, a background music icon indicating that the target background music is being played is displayed.

3. The method according to claim 2, characterized in that The method further comprises: In the case where at least one target barrage information is scrollingly displayed, in response to a playback interruption event of the target background music, the target background music is stopped from being played, and the background music icon displayed following the at least one target barrage information is cancelled from being displayed.

4. The method according to claim 2, characterized in that: The method further comprises: When the background music associated with the content of any target barrage information among the at least one target barrage information is played, the background music icon is displayed along with the scrolling target barrage information associated with the background music being played.

5. The method according to claim 1, characterized in that The method further comprises: Display the state switching control of the barrage sound mode; During the process of playing the target background music, in response to a triggering operation on the state switching control component, the target background music is stopped from being played, and the scrolling display of the at least one target bullet screen information is maintained.

6. The method according to claim 1, characterized in that The playing of the target background music associated with the content of the at least one target bullet screen information comprises: When the at least one target barrage information includes multiple target barrage information, and the contents of each of the multiple target barrage information are respectively associated with background music, the background music associated with the contents of each of the multiple target barrage information will be played sequentially in the order in which the multiple target barrage information are scrolled and displayed on the video playback interface.

7. The method according to claim 1, characterized in that The playing of the target background music associated with the content of the at least one target bullet screen information comprises: When the at least one target barrage information is a barrage information group including multiple target barrage information, and there is background music matching the barrage information group, the background music matching the barrage information group is played.

8. The method according to claim 7, characterized in that The contents of each of the multiple target barrage information are respectively associated with background music; the background music matching the barrage information group is mixed music, and the mixed music includes the music elements corresponding to each of the multiple target barrage information, and each music element comes from the background music associated with the content of the corresponding target barrage information.

9. The method according to claim 7, characterized in that: The content of each of the multiple target barrage information is respectively associated with background music; the background music matching the barrage information group is spliced ​​music, and the spliced ​​music includes music clips corresponding to each of the multiple target barrage information, each music clip comes from the background music associated with the content of the corresponding target barrage information, and the splicing order of the music clips in the spliced ​​music corresponds one by one to the barrage heat order of the multiple target barrage information.

10. The method according to any one of claims 1 to 9, characterized in that: The at least one target bullet screen information belongs to a bullet screen information set associated with the video and meeting the preset condition; the bullet screen information set is obtained in the following manner: Obtain at least one bullet screen information associated with the video and the bullet screen release time of each of the at least one bullet screen information; Performing word segmentation on the at least one bullet chat information respectively to obtain word segmentation results of the at least one bullet chat information; The barrage information is filtered based on the word segmentation result and the barrage release time of each of the at least one barrage information, and the barrage information set is filtered out from the at least one barrage information.

11. The method according to claim 10, characterized in that The step of filtering the barrage information based on the word segmentation result and the barrage release time of each of the at least one barrage information, and filtering the barrage information set from the at least one barrage information comprises: Based on the word segmentation results and the release time of the at least one barrage information, the barrage information whose barrage content similarity is greater than a similarity threshold and whose release interval is less than an interval threshold in the at least one barrage information is integrated to obtain at least one integrated barrage information; Determine the barrage information weight of each of the at least one barrage information after integration, and based on the barrage information weight, filter out the barrage information set from the at least one barrage information after integration.

12. The method according to claim 10, characterized in that For each bullet-screen information in the bullet-screen information set, the background music associated with the content of the bullet-screen information is obtained in the following manner: Based on the bullet comment release time of the targeted bullet comment information, extracting a video segment associated with the targeted bullet comment information from the video; Performing video feature extraction on the video clip to obtain video clip features of the video clip; Background music matching is performed based on the targeted barrage information and the video clip features to obtain background music associated with the content of the targeted barrage information.

13. The method according to claim 12, characterized in that The extracting video features from the video clip to obtain the video clip features of the video clip comprises: identifying a video object from the video clip; Extracting object features from the video object to obtain the video object features, and identifying scene features from the video clip to obtain video clip scene features; Based on the object features and the video segment scene features, video segment features of the video segment are obtained.

14. The method according to claim 13, characterized in that The extracting object features of the video object to obtain the video object features comprises: extracting an object image of the video object from the video; Performing emotion recognition on the video object based on the object image to obtain object emotion features, and performing action recognition on the video object based on the object image to obtain object action features; The object emotion feature and the object action feature are used as the video object feature.

15. The method according to claim 12, characterized in that The matching of background music based on the targeted bullet-chat information and the video clip features to obtain the background music associated with the content of the targeted bullet-chat information includes: The targeted bullet comment information and the video clip features are used as features to be matched, and feature matching is performed with background music features of multiple candidate background music respectively; According to the feature matching result, the background music associated with the content of the targeted barrage information is filtered out from the multiple candidate background music.

16. The method according to claim 15, characterized in that The step of taking the targeted bullet comment information and the video clip features as features to be matched and performing feature matching with background music features of multiple candidate background music respectively includes: Acquire historical viewing records of the video, and extract viewing object features of the video according to the historical viewing records; The viewing object features, the targeted barrage information and the video clip features are used as features to be matched, and feature matching is performed with background music features of multiple candidate background music respectively.

17. A bullet screen information display device, characterized in that: The device comprises: A video playback module, used to play a video on a video playback interface, wherein the video playback interface is used to scroll and display at least one bullet screen information associated with the video, and to control the switching of the bullet screen sound mode between an on state and an off state; A background music playing module, configured to respond to at least one target bullet screen information meeting a preset condition being displayed in the video playing interface and the bullet screen sound mode being turned on, and play target background music associated with the content of the at least one target bullet screen information; The playing control module is used to stop playing the target background music when at least one target barrage information is cancelled during the playing of the target background music.

18. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 16 are implemented.

19. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.

20. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.

Images