Processing method of chorus music bullet screen, related device and storage medium

Abstract

The invention discloses a chorus music bullet screen processing method, a related device and a storage medium, and the method comprises the steps: requesting bullet screen data related to the current playing content of an on-demand video when a music bullet screen is triggered; creating a plurality of music barrages by using barrage data associated with the current playing content of the on-demand video; each music bullet screen is rendered, so that each music bullet screen is displayed on a playing interface of the current on-demand video; when any one of the music bullet screens is clicked, controlling the rest of the music bullet screens except the clicked music bullet screen to be initialized; using the current playing time point of the current on-demand video and the audio playing start time point stored in the clicked music bullet screen to calculate a current audio playing time deviation; and performing jump playing on the audio file stored in the clicked music bullet screen according to the current audio playing time deviation.

Description

Technical Field

[0001] The present application relates to the field of multimedia technology, and particularly relates to a method for processing chorus music bullet screens, related devices, and storage media. Background Art

[0002] In order to increase user interaction, current multimedia supports users to send text bullet screens when playing videos. However, with the continuous development of multimedia and the continuous improvement of user needs, text bullet screens can no longer well meet the diverse needs of users. Therefore, some multimedia platforms have begun to try to launch audio bullet screens.

[0003] The current implementation method of audio bullet screens is almost the same as that of text bullet screens. When playing a video, users can output audio and send it. At this time, an audio bullet screen will be generated according to the input audio and displayed at the playback node. At the same time, the timestamp of the currently played video will be recorded. And when subsequent users play back this video, they will first obtain all the audio bullet screens and their corresponding timestamps, and listen to the playback time in real time, so as to display the audio bullet screen on the playback interface when the video plays to the timestamp corresponding to the audio bullet screen. Users can click on the audio bullet screen to play the corresponding audio, thus realizing audio interaction between users.

[0004] However, this method requires requesting a large amount of data in full each time of on-demand playback, and also requires real-time listening to the playback time, so it is rather cumbersome. More importantly, it can only realize interaction between users and cannot realize interaction between users and the playback content, so it cannot effectively improve user participation. And the played audio bullet screens have a poor correlation with the playback content, or even no correlation, and it is easy to have the situation where multiple audio bullet screens are played simultaneously, which will seriously affect the playback effect and the user viewing experience. Summary of the Invention

[0005] Based on the above deficiencies of the prior art, the present application provides a method for processing chorus music bullet screens, related devices, and storage media to solve the problems that the prior art cannot meet the requirements and will affect the playback effect.

[0006] To achieve the above object, the present application provides the following technical solutions:

[0007] The first aspect of the present application provides a method for processing chorus music bullet screens, including:

[0008] When a music bullet screen is triggered, request the bullet screen data associated with the current playback content of the on-demand video;

[0009] Create multiple music bullet screens by using the bullet screen data associated with the current playback content of the on-demand video;

[0010] Render each of the music bullet screens to display each of the music bullet screens on the playback interface of the current on-demand video;

[0011] When any one of the music bullet screens is clicked, control the initialization of the remaining music bullet screens except the clicked one;

[0012] Calculate the current audio playback time deviation by using the current playback time point of the current on-demand video and the audio start time point stored in the clicked music bullet screen;

[0013] Jump and play the audio file stored in the clicked music bullet screen according to the current audio playback time deviation.

[0014] Optionally, in the above method for processing chorus music bullet screens, before the step of requesting the bullet screen data associated with the current playback content of the on-demand video when triggering a music bullet screen, it further includes:

[0015] Obtain the text bullet screens on the playback interface of the current on-demand video in real time;

[0016] Perform big data analysis on the text of each of the text bullet screens to determine each keyword;

[0017] If each of the determined keywords meets the preset conditions, trigger a music bullet screen.

[0018] Optionally, in the above method for processing chorus music bullet screens, the step of requesting the bullet screen data associated with the current playback content of the on-demand video when triggering a music bullet screen includes:

[0019] When triggering a music bullet screen, upload the start time point of the current playback content of the on-demand video and the identifier of the on-demand video to the server, so as to request the server to find the media assets corresponding to the on-demand video according to the identifier of the on-demand video, and find out the bullet screen data associated with the music start time point of the current playback content of the on-demand video from the media assets corresponding to the on-demand video and feedback it.

[0020] Optionally, in the above method for processing chorus music bullet screens, the step of creating multiple music bullet screens by using the bullet screen data associated with the current playback content of the on-demand video includes:

[0021] Construct a listening management object and a container;

[0022] Create a music bullet screen object for each audio file in the bullet screen data associated with the current playback content of the on-demand video;

[0023] Assign a storage attribute to the music barrage object to store the barrage data and the identifier of the music barrage, and assign a display attribute to the music barrage object to render and display the music barrage; wherein, the barrage data includes an audio file, an audio duration, and an audio start time point.

[0024] Call the monitoring management object to register a monitoring notification for the music barrage object and store the music barrage object in the container.

[0025] Optionally, in the above method for processing the chorus music barrage, when any one of the music barrages is clicked, controlling the initialization of each of the remaining music barrages except the clicked music barrage includes:

[0026] When any one of the music barrages is clicked, call the monitoring management object to send a play notification to each of the music barrages registered with the monitoring notification; wherein, the play notification includes the identifier of the clicked music barrage.

[0027] Compare the identifier stored in each music barrage itself with the identifier in the received play notification respectively.

[0028] If the identifier stored in itself is inconsistent with the identifier in the received play notification, then execute the state restoration method.

[0029] Optionally, in the above method for processing the chorus music barrage, when any one of the music barrages is clicked, controlling the initialization of each of the remaining music barrages except the clicked music barrage includes:

[0030] Traverse each music barrage and compare the identifier of the traversed music barrage with the identifier of the clicked music barrage.

[0031] If the identifier of the traversed music barrage is inconsistent with the identifier of the clicked music barrage, then execute the state restoration method on the traversed music barrage to initialize the clicked music barrage.

[0032] Optionally, in the above method for processing the chorus music barrage, the jumping and playing of the audio file stored in the clicked music barrage according to the current audio playback time deviation includes:

[0033] In response to a user's chorus adjustment operation on the clicked music barrage, stop playing the audio file of the music barrage and the on-demand video, and jump to the chorus recording page of the song being played in the current playback content of the on-demand video.

[0034] Real-time collect the chorus recording audio of the user;

[0035] When the user finishes the chorus recording, save the audio file of the chorus recording audio as the corresponding bullet screen data of the current playing content of the on-demand video;

[0036] Exit the chorus recording page, and resume playing the audio file of the music bullet screen and the on-demand video.

[0037] The second aspect of the present application provides a processing device for chorus music bullet screens, including:

[0038] A data request unit, configured to request bullet screen data associated with the current playing content of the on-demand video when a music bullet screen is triggered;

[0039] A bullet screen creation unit, configured to create a plurality of music bullet screens by using the bullet screen data associated with the current playing content of the on-demand video;

[0040] A bullet screen rendering unit, configured to render each of the music bullet screens to display each of the music bullet screens on the playing interface of the current on-demand video;

[0041] An initialization unit, configured to control the initialization of each of the remaining music bullet screens except the clicked music bullet screen when any one of the music bullet screens is clicked;

[0042] A deviation calculation unit, configured to calculate the current audio playing time deviation by using the current playing time point of the current on-demand video and the audio start playing time point stored in the clicked music bullet screen;

[0043] An audio playing unit, configured to jump and play the audio file stored in the clicked music bullet screen according to the current audio playing time deviation.

[0044] Optionally, in the above-mentioned processing device for chorus music bullet screens, it further includes:

[0045] A bullet screen acquisition unit, configured to acquire the text bullet screens on the playing interface of the current on-demand video in real time;

[0046] A keyword analysis unit, configured to perform big data analysis on the text of each of the text bullet screens to determine each keyword;

[0047] A trigger unit, configured to trigger a music bullet screen when each of the determined keywords meets a preset condition.

[0048] Optionally, in the above-mentioned processing device for chorus music bullet screens, the data request unit includes:

[0049] A data request subunit, configured to upload the start time point of the current playing content of the on-demand video and the identifier of the on-demand video to the server when a music barrage is triggered, so as to request the server to find the media asset corresponding to the on-demand video according to the identifier of the on-demand video, and find the barrage data associated with the music start time point of the current playing content of the on-demand video from the media asset corresponding to the on-demand video and feedback it.

[0050] Optionally, in the above-mentioned processing device for chorus music barrages, the barrage creation unit includes:

[0051] A construction unit, configured to construct a monitoring management object and a container;

[0052] An object creation unit, configured to create a music barrage object for each audio file in the barrage data associated with the current playing content of the on-demand video;

[0053] An attribute assignment unit, configured to assign storage attributes to the music barrage object to store the barrage data and the identifier of the music barrage, and assign display attributes to the music barrage object to render and display the music barrage; wherein, the barrage data includes an audio file, an audio duration, and an audio start time point;

[0054] A registration unit, configured to call the monitoring management object to register a monitoring notification for the music barrage object and store the music barrage object in the container.

[0055] Optionally, in the above-mentioned processing device for chorus music barrages, the initialization unit includes:

[0056] A notification sending unit, configured to call the monitoring management object to send a play notification to each of the music barrages registered with the monitoring notification when any one of the music barrages is clicked; wherein, the play notification includes the identifier of the clicked music barrage;

[0057] A first comparison unit, configured to respectively compare the identifier stored by itself with the identifier in the received play notification through each of the music barrages;

[0058] A first restoration unit, configured to execute a state restoration method when the identifier stored by itself is inconsistent with the identifier in the received play notification.

[0059] Optionally, in the above-mentioned processing device for chorus music barrages, the initialization unit includes:

[0060] A second comparison unit, configured to traverse each of the music bullet screens, and compare the identifier of the traversed music bullet screen with the identifier of the clicked music bullet screen;

[0061] A second restoration unit, configured to, when the identifier of the traversed music bullet screen is inconsistent with the identifier of the clicked music bullet screen, execute a status restoration method on the traversed music bullet screen to initialize the clicked music bullet screen.

[0062] Optionally, in the above-mentioned processing device for chorus music bullet screens, it further includes:

[0063] A jump unit, configured to respond to a chorus adjustment operation of the user on the clicked music bullet screen, stop playing the audio file of the music bullet screen and the on-demand video, and jump to the chorus recording page of the playing song of the current playing content of the on-demand video;

[0064] An acquisition unit, configured to acquire the chorus recording audio of the user in real time;

[0065] A storage unit, configured to, when the user finishes the chorus recording, save the audio file of the chorus recording audio as the corresponding bullet screen data of the current playing content of the on-demand video;

[0066] A restoration unit, configured to exit the chorus recording page and resume playing the audio file of the music bullet screen and the on-demand video.

[0067] A third aspect of the present application provides an electronic device, including:

[0068] A memory and a processor;

[0069] Wherein, the memory is used to store a program;

[0070] The processor is used to execute the program, and when the program is executed, it is specifically used to implement the processing method for chorus music bullet screens as described in any one of the above.

[0071] A fourth aspect of the present application provides a computer storage medium, used to store a computer program, and when the computer program is executed by a processor, it is used to implement the processing method for chorus music bullet screens as described in any one of the above.

[0072] A method for processing chorus music bullet screens provided by the present application. When a music bullet screen is triggered, it requests the bullet screen data associated with the current playing content of the on-demand video, so that only when the music bullet screen needs to be displayed, the data associated with the current playing content is obtained, while all data is obtained during on-demand, and it can be ensured that the generated bullet screens are associated with the playing content, avoiding affecting the playing effect when the music bullet screen is played. Then, multiple music bullet screens are created using the bullet screen data associated with the current playing content of the on-demand video, and each of the music bullet screens is rendered to display each of the music bullet screens on the playing interface of the current on-demand video. When any one of the music bullet screens is clicked, the remaining music bullet screens except the clicked one are controlled to be initialized, so as to effectively avoid multiple music bullet screens playing simultaneously, resulting in crosstalk and affecting the playing effect. Then, using the current playing time point of the current on-demand video and the audio start time point stored in the clicked music bullet screen, the current audio playing time deviation is calculated, and the audio file stored in the clicked music bullet screen is jumped and played according to the current audio playing time deviation, so as to ensure that the audio of the played music bullet screen is synchronized with the picture of the on-demand video, improving the playing effect. Moreover, since the music of the played music bullet screen is associated with the playing content, users can participate in the synchronized video content through the audio, realizing interaction with the video content or characters, rather than simply user-to-user interaction, better meeting the needs of users. Description of the Drawings

[0073] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only the embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained according to the provided drawings.

[0074] Figure 1 It is a flowchart of a method for processing chorus music bullet screens provided by an embodiment of the present application;

[0075] Figure 2 It is a flowchart of a method for triggering a music bullet screen provided by an embodiment of the present application;

[0076] Figure 3 It is a flowchart of a method for creating a music bullet screen provided by an embodiment of the present application;

[0077] Figure 4 It is a flowchart of a method for initializing the unclicked music bullet screens provided by an embodiment of the present application;

[0078] Figure 5Flow chart of another method for initializing unclicked music bullet screens provided by an embodiment of the present application;

[0079] Figure 6 Flow chart of a method for chorus recording provided by an embodiment of the present application;

[0080] Figure 7 Schematic diagram of the architecture of a processing device for chorus music bullet screens provided by an embodiment of the present application;

[0081] Figure 8 Schematic diagram of the architecture of an electronic device provided by an embodiment of the present application. Detailed implementation manners

[0082] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0083] In the present application, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, elements defined by the statement "including a..." do not exclude the existence of additional identical elements in the process, method, article or device including the said element.

[0084] An embodiment of the present application provides a method for processing chorus music bullet screens, as Figure 1 shown, including the following steps:

[0085] S101. When a music bullet screen is triggered, request the bullet screen data associated with the current playing content of the on-demand video.

[0086] Among them, triggering a music bullet screen means that it is necessary to trigger the rendering and display of the music bullet screen. That is, when the music bullet screen is not triggered, the music bullet screen will not be displayed. Usually, when the on-demand video plays to content suitable for users to participate in and interact, the music bullet screen is triggered. That is, the current playing content is usually content suitable for users to participate in and interact, mainly when a singer is singing a song, etc. At this time, users can sing in chorus with the singing through the music bullet screen.

[0087] In order not to obtain the relevant data of all the barrage when on-demand is not required, and also to monitor the playing time in real time, and in order to make the music barrage associated with the playing content, avoid affecting the playing effect, and allow users to better participate in the playing content and achieve interaction with the playing content, so in the embodiments of the present application, only when the music barrage is triggered, that is, when the music barrage needs to be displayed, the data of the music barrage is requested from the server. And, in the embodiments of the present application, when the music barrage is triggered once, only the barrage data associated with the current playing content is requested, so that only the data required at present is obtained, making the display of the barrage more efficient and convenient. And, only using the reason data associated with the current playing content to generate the music barrage can ensure its association with the current playing content.

[0088] Among them, the barrage data associated with the current playing content mainly includes the audio file for generating the music barrage and other relevant information of the audio file. Specifically, the barrage data associated with the current playing content mainly includes the audio files recorded by previous users when watching the current playing content, and a small number of audio files uploaded by the background personnel in order to guide users to participate in the chorus and send music barrages. Specifically, it can be the audio of the song sung by the singer in the current playing content, or the audio file of the song uploaded by the singer himself, etc. Of course, it will also include the audio start time point, etc.

[0089] Therefore, before performing step S101, the music barrage needs to be triggered first. Optionally, in another embodiment of the present application, a method for triggering the music barrage is provided, as Figure 2 shown, including the following steps:

[0090] S201. Obtain the text barrage on the playing interface of the current on-demand video in real time.

[0091] It should be noted that in the embodiments of the present application, the on-demand video still supports the text barrage. Since when playing the content suitable for users to participate in, users will send a large number of relevant subtitles in order to actively participate and interact. For example, chorus, singer name, song name, etc. Therefore, it is possible to determine whether to trigger the music barrage by analyzing the text barrage, so it is necessary to obtain the text barrage on the playing interface of the current on-demand video in real time.

[0092] S202. Perform big data analysis on the text of each text barrage to determine each keyword.

[0093] Optionally, the keywords stored in the text barrage can be determined by means of rule matching or vocabulary comparison, etc.

[0094] S203. Determine whether each determined keyword meets the preset conditions.

[0095] Optionally, it may be to determine whether the number of each keyword reaches a threshold, and / or determine whether the proportion of the number of each keyword in the total number of all barrage words reaches a preset threshold, etc., to determine whether each keyword meets the preset conditions.

[0096] Among them, if each determined keyword meets the preset conditions, then step S204 is executed.

[0097] S204. Trigger music barrage.

[0098] Optionally, in another embodiment of the present application, a specific implementation manner of step S101 includes:

[0099] When triggering the music barrage, upload the start time point of the current playing content of the on-demand video and the identifier of the on-demand video to the server, so as to request the server to find the media asset corresponding to the on-demand video according to the identifier of the on-demand video, and find out the barrage data associated with the music start time point of the current playing content of the on-demand video from the media asset corresponding to the on-demand video and feedback it.

[0100] Among them, the start time point of the current playing content refers to the time point of the on-demand video when this segment of playing content starts playing as preset. For example, if the current playing content is singer A singing song B, then the start time point of the current playing content is the time point of the on-demand video when singer A starts singing song B.

[0101] Since a video usually has multiple segments that can trigger music barrages, in order to accurately find the barrage data associated with the current playing content, in the embodiment of the present application, the client determines the start time point of the current playing content and the identifier of the on-demand video and uploads them to the server, so as to request the server to find the media asset corresponding to the on-demand video according to the identifier of the on-demand video, and then find out the barrage data associated with the music start time point of the current playing content of the on-demand video from the media asset corresponding to the on-demand video and feedback it to the client.

[0102] S102. Create multiple music barrages by using the barrage data associated with the current playing content of the on-demand video.

[0103] Specifically, each audio file and its related information in the barrage data can be used to generate a music barrage respectively, or some audio files can be selected for generating music barrages. Optionally, all music barrages can be generated at one time, and then rendered and displayed one by one through step S103. It can also be to generate music barrages while rendering and displaying them.

[0104] Optionally, in another embodiment of the present application, a specific implementation manner of step S102 is as Figure 3 shown and includes the following steps:

[0105] S301. Construct a monitoring management object and a container.

[0106] It should be noted that the number of music bullet screens is not fixed, and each music bullet screen has the possibility of being clicked and may be clicked multiple times. Therefore, in order to avoid the occurrence of music bullet screen playback conflicts and affect the playback effect, it is necessary to effectively monitor the playback of each music bullet screen so as to perform corresponding operations according to the monitoring situation. Therefore, in the embodiment of this application, a monitoring management object Manager is constructed to manage each currently generated music bullet screen through it. And in order to facilitate the management and display of the currently generated music bullet screens, a container is also generated in this application to place each currently generated music bullet screen.

[0107] S302. For each audio file in the bullet screen data associated with the current playback content of the on-demand video, create a music bullet screen object.

[0108] It should be noted that the music bullet screens generated in the embodiment of this application are different from the existing bullet screens that are only equivalent to a visual audio. They not only need to support visualization, but also need to store information such as audio files, time points, and identifiers. And they can further have functions such as initialization and page jump. Therefore, in the embodiment of this application, a music bullet screen object is first created to facilitate subsequent operations and implement corresponding functions.

[0109] Optionally, for all audio files in the bullet screen data associated with the current playback content of the on-demand video, a music bullet screen object can be created for each to generate music bullet screens corresponding to each audio file. Of course, considering that there may be too many audio files and other situations, it is also possible to screen out some better audio files through corresponding algorithms for music bullet screen generation.

[0110] S303. Endow the music bullet screen object with storage attributes to store bullet screen data and the identifier of the music bullet screen, and endow the music bullet screen object with display attributes to render and display the music bullet screen.

[0111] Among them, the bullet screen data includes the audio file, the audio duration, and the audio start time point.

[0112] To distinguish different music bullet screens, enable accurate generation of music bullet screens and avoid conflicts in music bullet screen playback, that is, multiple music bullet screens playing simultaneously, a unique identification ID is generated for each music bullet screen. Also, since the bullet screen data is required when playing a music bullet screen, a storage attribute is assigned to the music bullet screen, and the identification of the music bullet screen and its corresponding bullet screen data are stored. Optionally, since the media duration of an on-demand video is fixed, we can pre-distribute relevant identifications and the like through the server.

[0113] To enable the music bullet screen to be displayed on the playback interface, a display attribute also needs to be assigned to the music bullet screen object, such as displaying the corresponding text and note tags, such as the user ID, etc. Also, a translation animation can be performed by executing the animation ability of Layer, that is, making the displayed music bullet screen translate on the playback interface.

[0114] S304. Call the monitoring management object to register a monitoring notification for the music bullet screen object and store the music bullet screen object in a container.

[0115] To enable each music bullet screen to monitor the notification of the music bullet screen to be played, so as to accurately initialize or play according to the notification and avoid playback conflicts, in the embodiments of this application, the monitoring management object Manager is called to register a monitoring notification for each music bullet screen object. Optionally, the monitoring management object Manager can specifically register a notification named StartPlayingMusicBarrage through NSNotificationCenter.

[0116] Also, for ease of management, each music bullet screen is stored in the created container. When the music bullet screen leaves the screen, that is, after the end of the display of the music bullet screen, the music bullet screen can be removed from the container.

[0117] S103. Render each music bullet screen to display each music bullet screen on the playback interface of the current on-demand video.

[0118] Specifically, the music bullet screen can be rendered according to the set rendering characteristics so that it is displayed on the playback interface of the current on-demand video. Also, the music bullet screen can be translated and displayed on the playback interface, that is, it appears from one side of the playback interface and ends the display when it moves to the other side.

[0119] Also, since the current playback content lasts for a period of time, to ensure that audio bullet screens are displayed during this period, randomly selected parts of the generated music bullet screens are continuously rendered and displayed during video playback. Of course, it can also be played according to the recording time points of the audio files in the music bullet screen, or other strategies can be adopted.

[0120] Optionally, since text bullet screens are usually supported simultaneously, and at this time music bullet screens are the main focus, the text bullet screens can be displayed below the music bullet screens. Or directly block the display of text bullet screens at this time. Specifically, it can be preset whether to display text bullet screens, or determine whether to display text bullet screens according to the user's current selection.

[0121] It should be noted that when music bullet screens are displayed, it will not affect the playback of the currently on-demand video, that is, the video data and audio data of the currently on-demand video are still played normally.

[0122] S104. When any music bullet screen is clicked, control the initialization of the remaining music bullet screens except the clicked one.

[0123] It should be noted that for each music bullet screen displayed on the playback interface, users can click on it to play the audio corresponding to the music bullet screen. Considering that the audio corresponding to the previously clicked music bullet screen is playing normally at this time, in order to avoid playback conflicts between the currently clicked music bullet screen and the previously played music bullet screen. Therefore, when any music bullet screen is clicked currently, the remaining music bullet screens except the clicked one will be controlled to be initialized to initialize the states of the remaining music bullet screens. Among them, the initialization of the music bullet screen is to restore its state to the initial state. In the initial state of the music bullet screen, it is not played, so playback conflicts can be effectively avoided.

[0124] Optionally, after the user clicks on a music bullet screen, in order to enable the user to continuously know the music bullet screen they clicked on, the movement of the music bullet screen can be stopped and it can be prominently displayed, such as magnifying it and rendering special effects, etc. And in order to prevent the user from accidentally touching and playing the music bullet screen, a play button can also be set on the music bullet screen, so it needs to start playing after the user clicks on the music bullet screen and then clicks on the play button.

[0125] Optionally, in another embodiment of the present application, when step S102 is implemented using Figure 3 the method shown, a specific implementation manner of step S104, as Figure 4 shown, includes the following steps:

[0126] S401. When any music bullet screen is clicked, call the listening management object to send a play notification to each music bullet screen registered for listening notifications.

[0127] Among them, the play notification includes the identifier of the clicked music bullet screen.

[0128] When a music barrage is clicked, since each music barrage has formed a monitoring notification, the monitoring management object will send a playback notification containing the identifier of the clicked music barrage and pass it to each music barrage to inform each music barrage to play the clicked barrage. Optionally, the monitoring management object can specifically send a notification named StartPlayingMusicBarrage.

[0129] S402. Respectively, through each music barrage, compare the identifier stored in itself with the identifier in the received playback notification.

[0130] Specifically, after receiving the playback notification, each music barrage will compare the identifier stored in itself with the identifier in the received playback notification, that is, compare its own identifier with the identifier of the music barrage to be played.

[0131] S403. Determine whether the identifier stored in itself is consistent with the identifier in the received playback notification.

[0132] Among them, if the identifier stored in itself is inconsistent with the identifier in the received playback notification, it means that it is not the current audio barrage to be played, so step S404 is executed at this time.

[0133] S404. Execute the state restoration method.

[0134] It should be noted that when the music barrage executes the state restoration method, it will be initialized. Optionally, the state restoration method can be defined as: self clearChorusPlayingState.

[0135] Optionally, in another embodiment of the present application, another specific implementation manner of step S104 is as Figure 5 shown, including the following steps:

[0136] S501. Traverse each music barrage and compare the identifier of the traversed music barrage with the identifier of the clicked music barrage.

[0137] Optionally, specifically, it can be to traverse each music barrage in the container. Since the music barrages not in the container are no longer displayed on the playback interface and will not be played anymore, they will not cause playback conflicts, so it is not necessary to compare their identifiers.

[0138] S502. Determine whether the identifier of the traversed music barrage is consistent with the identifier of the clicked music barrage.

[0139] Among them, if the identifier of the traversed music barrage is inconsistent with the identifier of the clicked music barrage, step S503 is executed.

[0140] S503. Execute the status restoration method for the traversed music bullet screens to initialize the clicked music bullet screen.

[0141] Optionally, in another embodiment of the present application, Figure 4 The method shown and Figure 5 The method shown are executed simultaneously, so as to double ensure that the status of the unclicked music bullet screens is restored, and accurately locate the clicked music bullet screen, thereby avoiding playback conflicts and cross-talk situations, which may affect the playback effect.

[0142] S105. Calculate the current audio playback time deviation by using the current playback time point of the currently on-demand video and the audio start time point stored in the clicked music bullet screen.

[0143] It should be noted that the audio file of the music bullet screen played in the embodiments of the present application is for the purpose of interacting with the playback content and participating in the effect. Therefore, when playing the music bullet screen, the picture of the currently on-demand video will not stop playing. For the audio of the video, it can be played normally or blocked to avoid interference with the played content. Thus, the effect of the interactive playback of the played music bullet screen and the video picture can be achieved. For example, playing the music bullet screen of the user singing song B to achieve the effect of the user singing in chorus with the singer who is normally singing song B in the video.

[0144] Since the length of the audio in the audio bullet screen is usually the same as the length of the audio of the current playback content, such as both being the length of song B. In order to ensure that the audio and the picture are synchronized, in the embodiments of the present application, it is necessary to calculate the current audio playback time deviation by using the current playback time point of the currently on-demand video and the audio start time point stored in the clicked music bullet screen, that is, to determine the time difference between the two, so as to determine from which time point to start playing.

[0145] Specifically, subtract the audio start time point (startTime) stored in the clicked music bullet screen from the current playback time point (playTime) of the currently on-demand video, that is, the time point where the currently on-demand video is played, to obtain the current audio playback time deviation (spaceTime), that is, spaceTime = playTime - startTime.

[0146] S106. Jump and play the audio file stored in the clicked music bullet screen according to the current audio playback time deviation.

[0147] It should be noted that since this solution mainly targets the barrage of choral music, finally, according to the current audio playback time deviation, the playback position of the audio file stored in the clicked music barrage is adjusted, so that it can jump to the position synchronized with the current playback time point and start playing, so that the audio of the currently played music barrage conforms to the current playback content, avoiding the situation where the audio is inconsistent with the playback picture. For example, when the picture plays to a certain singer singing a certain line A1 of song A, it is necessary to adjust the playback position of the audio file stored in the clicked music barrage according to the current audio playback time deviation, so that the audio file in the music barrage starts playing from the audio position of singing line A1 of song A, realizing audio and picture synchronization and achieving the effect of singing in chorus with the singer.

[0148] Optionally, specifically, the player can execute the seekTime:spaceTime method to jump to the accurate time point for playing, ensuring audio and video synchronization.

[0149] Optionally, in another embodiment of the present application, after executing step S106, the user can also perform choral recording to send the choral music barrage. As Figure 6 shown, a method for choral recording provided by an embodiment of the present application includes the following steps:

[0150] S601. In response to the user's choral adjustment operation on the clicked music barrage, stop playing the audio file of the music barrage and the on-demand video, and adjust to the choral recording page of the playing song of the current playback content of the on-demand video.

[0151] In the embodiment of the present application, a button for jumping to the choral page is also displayed on the clicked music barrage. When the user clicks this button, it jumps to the choral recording page of the playing song. In order for the user to continue watching after the recording ends, it is necessary to stop playing the audio file of the music barrage and the on-demand video at this time.

[0152] S602. Real-time collect the user's choral recording audio.

[0153] S603. When the user finishes choral recording, save the audio file of the choral recording audio as the corresponding barrage data of the current playback content of the on-demand video.

[0154] It should be noted that since the audio recorded by the user at this time is associated with the current playback content, and the user sends the recorded audio as a music barrage, the audio file of the choral recording audio is saved as the corresponding barrage data of the current playback content of the on-demand video at this time, so that the choral recording audio can be obtained from the corresponding barrage data of the current playback content, and then the corresponding music barrage can be generated.

[0155] Optionally, after executing step S603, it can be immediately used to obtain the chorus recording audio, generate its corresponding music barrage, and then display it so that users can see the generated music barrage in a timely manner. Of course, it can also be that during subsequent playback, when this solution is executed again, the music barrage is obtained along with the acquisition of the barrage data, and then the corresponding music barrage is generated for display, thus eliminating the need to add the logic of immediately generating music barrages.

[0156] S604. Exit the chorus recording page, and resume playing the audio file of the music barrage and the on-demand video.

[0157] Specifically, exit the chorus recording page, jump back to the original playback interface, and then resume playing the audio file of the music barrage and the on-demand video.

[0158] The embodiment of the present application provides a method for processing chorus music barrages. When a music barrage is triggered, request the barrage data associated with the current playback content of the on-demand video, so that the data associated with the current playback content is obtained only when the music barrage needs to be displayed, while all data is obtained during on-demand. And it can ensure that the generated barrages are associated with the playback content, avoiding affecting the playback effect when the music barrages are played. Then, create multiple music barrages using the barrage data associated with the current playback content of the on-demand video, and render each of the music barrages to display each of the music barrages on the playback interface of the current on-demand video. When any one of the music barrages is clicked, control the initialization of the remaining music barrages except the clicked music barrage, thereby effectively avoiding simultaneous playback of multiple music barrages, resulting in crosstalk and affecting the playback effect. Then, calculate the current audio playback time deviation using the current playback time point of the current on-demand video and the audio start time point stored in the clicked music barrage, and jump and play the audio file stored in the clicked music barrage according to the current audio playback time deviation, so as to ensure the synchronization of the audio of the played music barrage with the picture of the on-demand video and improve the playback effect. Moreover, since the music of the played music barrage is associated with the playback content, users can participate in the synchronized video content through the audio, realizing interaction with the video content or characters, rather than just interaction between users, better meeting the needs of users.

[0159] Another embodiment of the present application provides a device for processing chorus music barrages, as Figure 7 shown, including:

[0160] A data request unit 701, configured to request barrage data associated with the current playback content of the on-demand video when a music barrage is triggered.

[0161] A bullet screen creation unit 702, configured to create a plurality of music bullet screens by using bullet screen data associated with the current playing content of the on-demand video.

[0162] A bullet screen rendering unit 703, configured to render each music bullet screen, so as to display each music bullet screen on the playing interface of the current on-demand video.

[0163] An initialization unit 704, configured to, when any one of the music bullet screens is clicked, control the remaining music bullet screens except the clicked music bullet screen to be initialized.

[0164] A deviation calculation unit 705, configured to calculate a current audio playing time deviation by using the current playing time point of the current on-demand video and the audio start playing time point stored in the clicked music bullet screen.

[0165] An audio playing unit 706, configured to jump and play the audio file stored in the clicked music bullet screen according to the current audio playing time deviation.

[0166] Optionally, in the processing device for chorus music bullet screens provided in another embodiment of the present application, it further includes:

[0167] A bullet screen acquisition unit, configured to acquire text bullet screens on the playing interface of the current on-demand video in real time.

[0168] A keyword analysis unit, configured to perform big data analysis on the text of each text bullet screen to determine each keyword.

[0169] A trigger unit, configured to trigger a music bullet screen when each determined keyword meets a preset condition.

[0170] Optionally, in the processing device for chorus music bullet screens provided in another embodiment of the present application, a data request unit includes:

[0171] A data request subunit, configured to, when a music bullet screen is triggered, upload the start playing time point of the current playing content of the on-demand video and the identifier of the on-demand video to the server, so as to request the server to find the media asset corresponding to the on-demand video according to the identifier of the on-demand video, and find and feedback the bullet screen data associated with the music start playing time point of the current playing content of the on-demand video from the media asset corresponding to the on-demand video.

[0172] Optionally, in the processing device for chorus music bullet screens provided in another embodiment of the present application, the bullet screen creation unit includes:

[0173] A construction unit, configured to construct a listening management object and a container.

[0174] An object creation unit, configured to create a music bullet screen object for each audio file in the bullet screen data associated with the current playing content of the on-demand video respectively.

[0175] An attribute assignment unit, configured to assign a storage attribute to the music bullet screen object to store the bullet screen data and the identifier of the music bullet screen, and assign a display attribute to the music bullet screen object to render and display the music bullet screen. Wherein, the bullet screen data includes the audio file, the audio duration, and the audio start time point.

[0176] A registration unit, configured to call a listening management object to register a listening notification for the music bullet screen object and store the music bullet screen object in a container.

[0177] Optionally, in the processing device for chorus music bullet screens provided in another embodiment of the present application, the initialization unit includes:

[0178] A notification sending unit, configured to, when any music bullet screen is clicked, call the listening management object to send a playback notification to each music bullet screen registered with the listening notification. Wherein, the playback notification includes the identifier of the clicked music bullet screen.

[0179] A first comparison unit, configured to compare the identifier stored in itself with the identifier in the received playback notification respectively through each music bullet screen.

[0180] A first restoration unit, configured to execute a state restoration method when the identifier stored in itself is inconsistent with the identifier in the received playback notification.

[0181] Optionally, in the processing device for chorus music bullet screens provided in another embodiment of the present application, the initialization unit includes:

[0182] A second comparison unit, configured to traverse each music bullet screen and compare the identifier of the traversed music bullet screen with the identifier of the clicked music bullet screen.

[0183] A second restoration unit, configured to execute a state restoration method on the traversed music bullet screen when the identifier of the traversed music bullet screen is inconsistent with the identifier of the clicked music bullet screen to initialize the clicked music bullet screen.

[0184] Optionally, in the processing device for chorus music bullet screens provided in another embodiment of the present application, it further includes:

[0185] A jump unit, configured to respond to a chorus adjustment operation of the user on the clicked music bullet screen, stop playing the audio file of the music bullet screen and the on-demand video, and jump to the chorus recording page of the playing song of the current playing content of the on-demand video.

[0186] An acquisition unit, configured to acquire the user's chorus recording audio in real time.

[0187] A storage unit, configured to save the corresponding bullet screen data of the audio file of the chorus recording audio as the current playing content of the on-demand video when the user finishes the chorus recording.

[0188] A restoration unit, configured to exit the chorus recording page and resume playing the audio file of the music bullet screen and the on-demand video.

[0189] It should be noted that for the specific processes of the respective units provided in the above embodiments of the present application, reference may be correspondingly made to the implementation processes of the corresponding steps provided in the above method embodiments, which will not be elaborated herein.

[0190] Another embodiment of the present application provides an electronic device, as Figure 8 shown, including:

[0191] A memory 801 and a processor 802.

[0192] Among them, the memory 801 is used to store programs.

[0193] The processor 802 is configured to execute the program stored in the memory 801. When the program is executed, it is specifically configured to implement the processing method of the chorus music bullet screen provided in any one of the above embodiments.

[0194] Another embodiment of the present application provides a computer storage medium for storing a computer program. When the computer program is executed by a processor, it is used to implement the processing method of the chorus music bullet screen provided in any one of the above embodiments.

[0195] Computer storage media include both permanent and non-permanent, removable and non-removable media and can be implemented by any method or technology for information storage. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transitory media that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media such as modulated data signals and carrier waves.

[0196] Those skilled in the art may further realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of this application.

[0197] The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use this application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application will not be limited to these embodiments shown herein, but rather is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for processing chorus music bullet screen, characterized in that: include: When music bullet screen is triggered, request bullet screen data associated with the currently playing content of the on-demand video; Creating a plurality of music bullet screens using bullet screen data associated with the currently playing content of the on-demand video; Rendering each of the music bullet screens to display each of the music bullet screens on the playback interface of the current on-demand video; When any one of the music bullet screens is clicked, the remaining music bullet screens except the clicked one are controlled to be initialized; The current audio playback time deviation is calculated by using the current playback time point of the current on-demand video and the audio start time point stored in the clicked music barrage; The audio file stored in the clicked music barrage will be jumped and played according to the current audio playback time deviation.

2. The method according to claim 1, characterized in that: When triggering the music bullet screen, before requesting the bullet screen data associated with the currently playing content of the on-demand video, it also includes: Real-time acquisition of text comments on the playback interface of the current on-demand video; Performing big data analysis on the text of each of the text bullet comments to determine each keyword; If the determined keywords meet the preset conditions, the music barrage is triggered.

3. The method according to claim 1, characterized in that When the music bullet screen is triggered, the bullet screen data associated with the currently playing content of the on-demand video is requested, including: When the music barrage is triggered, the start time of the currently playing content of the on-demand video and the identifier of the on-demand video are uploaded to the server, so as to request the server to find the media asset corresponding to the on-demand video according to the identifier of the on-demand video, and to find and feedback the barrage data associated with the start time of the music of the currently playing content of the on-demand video from the media asset corresponding to the on-demand video.

4. The method according to claim 1, characterized in that: The step of creating a plurality of music bullet screens by using bullet screen data associated with the currently played content of the on-demand video includes: Build a monitoring management object and a container; Create a music bullet screen object for each audio file in the bullet screen data associated with the currently playing content of the on-demand video; Assigning a storage attribute to the music barrage object to store the barrage data and the identifier of the music barrage, and assigning a display attribute to the music barrage object to render and display the music barrage; wherein the barrage data includes an audio file, an audio duration, and an audio start time point; The monitoring management object is called to register a monitoring notification for the music barrage object, and the music barrage object is stored in the container.

5. The method according to claim 4, characterized in that When any one of the music bullet screens is clicked, the remaining music bullet screens except the clicked music bullet screen are controlled to be initialized, including: When any of the music bullet screens is clicked, the monitoring management object is called to send a play notification to each of the music bullet screens that has registered for monitoring notification; wherein the play notification includes the identifier of the clicked music bullet screen; By using each of the music bullet screens, the identifier stored in the music bullet screen is compared with the identifier in the received playback notification; If the identifier stored in the system is inconsistent with the identifier in the received play notification, the state restoration method is executed.

6. The method according to claim 1, characterized in that When any one of the music bullet screens is clicked, the remaining music bullet screens except the clicked music bullet screen are controlled to be initialized, including: Traversing each of the music bullet screens, and comparing the identifiers of the traversed music bullet screens with the identifier of the clicked music bullet screen; If the identifier of the traversed music barrage is inconsistent with the identifier of the clicked music barrage, a state restoration method is executed on the traversed music barrage to initialize the clicked music barrage.

7. The method according to claim 1, characterized in that The audio file stored in the clicked music bullet screen is jumped and played according to the current audio playing time deviation, including: In response to the user's chorus adjustment operation of the clicked music barrage, stop playing the audio file of the music barrage and the on-demand video, and jump to the chorus recording page of the playing song of the currently playing content of the on-demand video; Collecting the chorus recording audio of the users in real time; When the user finishes the chorus recording, the audio file of the chorus recording audio is saved as the corresponding barrage data of the current playing content of the on-demand video; Exit the chorus recording page and resume playing the audio file of the music barrage and the on-demand video.

8. A device for processing chorus music bullet screen, characterized in that: include: A data request unit, used to request the bullet screen data associated with the currently playing content of the on-demand video when the music bullet screen is triggered; A bullet screen creation unit, configured to create a plurality of music bullet screens using bullet screen data associated with the currently played content of the on-demand video; A bullet screen rendering unit, used to render each of the music bullet screens, so as to display each of the music bullet screens on the playback interface of the current on-demand video; An initialization unit, used for controlling the initialization of the remaining music bullet screens except the clicked music bullet screen when any one of the music bullet screens is clicked; A deviation calculation unit, used to calculate the current audio playback time deviation by using the current playback time point of the current on-demand video and the audio start time point stored in the clicked music barrage; The audio playback unit is used to jump and play the audio file stored in the clicked music barrage according to the current audio playback time deviation.

9. An electronic device, characterized in that: include: Memory and processor; Wherein, the memory is used to store programs; The processor is used to execute the program, and when the program is executed, it is specifically used to implement the method for processing chorus music barrage as described in any one of claims 1 to 7.

10. A computer storage medium, characterized in that: Used to store a computer program, which, when executed by a processor, is used to implement the method for processing chorus music barrage as described in any one of claims 1 to 7.

Images