An online singing and microphone passing interaction method, device and medium

Abstract

The application discloses an online singing and microphone passing interaction method and device and a medium, relates to the technical field of communication, and is applied to a lead singer client in an online singing room and comprises the following steps: if a currently sung song meets preset microphone passing conditions, a microphone passing button is displayed on a local preset screen area; if it is monitored that the microphone passing button is clicked, a chorus invitation request is sent to each audience client in the online singing room; a communication connection establishment request sent by a microphone receiving client is responded to, so that a point-to-point link is established with the microphone receiving client; a first audio stream uploaded by the microphone receiving client through the point-to-point link is acquired, and the first audio stream and a second audio stream locally acquired are merged to obtain a chorus audio stream; and the chorus audio stream is uploaded to a content distribution network, so that non-microphone receiving clients in the audience clients acquire the chorus audio stream from the content distribution network through a content distribution network link and play the chorus audio stream. The application can realize microphone passing interaction between singers and audiences in the online singing room.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and in particular to an online singing microphone interaction method, device, and medium. Background Technology

[0002] In offline concerts, performers often point their microphones towards the audience while singing, inviting them to sing along and interact, thus enhancing the concert atmosphere. Currently, most singing and live-streaming apps lack the feature of allowing performers to pass the microphone to the audience in online karaoke rooms.

[0003] In summary, how to achieve microphone-passing interaction between the lead singer and the audience in online karaoke rooms, thereby enhancing the singing atmosphere and activity level in online karaoke rooms, is a problem that needs to be solved. Summary of the Invention

[0004] In view of this, the purpose of this invention is to provide an online singing microphone-passing interaction method, device, and medium, which enables microphone-passing interaction between the lead singer and the audience in an online karaoke room, thereby enhancing the singing atmosphere and activity level within the online karaoke room. The specific solution is as follows:

[0005] Firstly, this application discloses an online singing microphone-passing interaction method, applied to the lead singer client in an online karaoke room, including:

[0006] If the current song meets the preset microphone passing conditions, the microphone passing button will be displayed on the local preset screen area;

[0007] If the microphone button is clicked, a sing-along invitation request is sent to each viewer client in the online karaoke room.

[0008] Responding to the communication connection establishment request sent by the microphone receiving client, a point-to-point link is established with the microphone receiving client; the microphone receiving client is the client in the audience client that responds to the chorus invitation request;

[0009] The first audio stream uploaded by the microphone client through the peer-to-peer link is obtained, and the first audio stream and the local second audio stream are merged to obtain the chorus audio stream;

[0010] The chorus audio stream is uploaded to a content delivery network (CDN) so that the non-microphone client in the audience client can obtain and play the chorus audio stream from the CDN via the CDN link.

[0011] Optionally, the online singing microphone-passing interaction method further includes:

[0012] The accompaniment information of the currently sung song is obtained in advance through the background accompaniment service; the accompaniment information includes accompaniment duration, lyric segmentation information, chorus start position and chorus end position;

[0013] Accordingly, if the currently sung song meets the preset microphone-passing conditions, then displaying a microphone-passing button on the local preset screen area includes:

[0014] If the time interval between the timestamp corresponding to the real-time performance progress of the current song and the timestamp corresponding to the start position of the chorus meets the preset time interval, then the microphone pass button will be displayed on the local preset screen area.

[0015] Optionally, after establishing a peer-to-peer link with the microphone-receiving client, the method further includes:

[0016] If the timestamp corresponding to the real-time performance progress of the current song matches the timestamp corresponding to the end position of the chorus, then the current round of chorus ends.

[0017] Alternatively, a microphone handover end button can be displayed on the preset screen area. If the microphone handover end button is clicked, the current round of chorus will end.

[0018] Optionally, after responding to the communication connection establishment request sent by the microphone client, the method further includes:

[0019] Collect the user avatars of all the microphone-receiving clients and the first prompt message used to prompt the microphone-receiving clients to join the current round of chorus;

[0020] The user's avatar and the first prompt message from the microphone client are sent to the first preset public screen area and the second preset public screen area for display, respectively.

[0021] Optionally, the online singing microphone-passing interaction method further includes:

[0022] Real-time monitoring of the display area occupied by all user avatars received in the first preset public screen area;

[0023] If the current display area is larger than the area of ​​the first preset public screen area, then control all currently received user avatars to slide and display as a whole along a preset direction on the first preset public screen area.

[0024] Optionally, the online singing microphone-passing interaction method further includes:

[0025] If it is detected that none of the audience clients respond to the chorus invitation request within the preset time range, information indicating that no one is currently participating in the live chat and that this round of chorus invitations has ended will be displayed on the third public screen area.

[0026] Optionally, if the microphone button is detected to be clicked, a sing-along invitation request is sent to each viewer client in the online karaoke room, including:

[0027] If the microphone button is clicked within the preset button display time, a duet invitation request is sent to each viewer client in the online karaoke room.

[0028] If the microphone button is not clicked within the specified display time, the microphone button will be hidden.

[0029] Secondly, this application discloses an online singing microphone-passing interaction method, applied to a microphone-receiving client in an online karaoke room, including:

[0030] Get and respond to the chorus invitation request sent by the lead singer's client;

[0031] A communication connection establishment request is sent to the lead vocalist client to establish a point-to-point link with the lead vocalist client;

[0032] The local first audio stream is uploaded to the lead singer client via the peer-to-peer link, so that the lead singer client can merge its own recorded second audio stream with the first audio stream to obtain a chorus audio stream, and upload the chorus audio stream to the content delivery network, so that the non-microphone client in the audience client can obtain the chorus audio stream from the content delivery network and play it via the content delivery network link.

[0033] Optionally, obtaining and responding to the chorus invitation request sent by the lead singer client includes:

[0034] Long polling of the instant messaging component is performed to obtain the signaling message carrying the chorus invitation request sent by the lead singer client through the instant messaging component;

[0035] Based on the signaling message, a chorus join button is generated in a local preset screen area, and the chorus invitation request is responded to based on the user's click operation on the chorus join button.

[0036] Optionally, after responding to the chorus invitation request based on the user's click on the chorus join button, the method further includes:

[0037] The public chat area displays the user avatars of all the microphone-receiving clients and a second prompt message to encourage the microphone-receiving clients to join the current round of singing.

[0038] Change the "Join Chorus" button on the preset screen area to a "Quit Chorus" button.

[0039] If the click of the chorus exit button is detected, the user's avatar will be deleted from the public screen area and a third prompt message will be displayed to indicate that the user is exiting the current round of chorus.

[0040] Optionally, the online singing microphone-passing interaction method further includes:

[0041] After the current round of chorus ends, the current link is switched from the peer-to-peer link to the content delivery network link, and the current audio stream uploaded by the lead singer's client is obtained from the content delivery network based on the content delivery network link.

[0042] Thirdly, this application discloses an electronic device, including:

[0043] Memory, used to store computer programs;

[0044] A processor is configured to execute the computer program to implement the steps of the aforementioned disclosed online singing and microphone-passing interactive method.

[0045] Fourthly, this application discloses a computer-readable storage medium for storing a computer program; wherein, when the computer program is executed by a processor, it implements the steps of the aforementioned disclosed online singing and microphone-passing interactive method.

[0046] As can be seen, the online singing microphone passing interaction method in this application is applied to the lead singer client in an online karaoke room. If the currently sung song meets the preset microphone passing conditions, a microphone passing button is displayed on a local preset screen area. If the microphone passing button is detected to be clicked, a chorus invitation request is sent to each audience client in the online karaoke room. A communication connection establishment request is sent by the microphone receiving client to establish a point-to-point link with the microphone receiving client. The microphone receiving client is the audience client that responds to the chorus invitation request. The first audio stream uploaded by the microphone receiving client through the point-to-point link is obtained, and the first audio stream and the local second audio stream are merged to obtain a chorus audio stream. The chorus audio stream is uploaded to a content delivery network so that non-microphone receiving clients in the audience clients can obtain the chorus audio stream from the content delivery network and play it through the content delivery network link. Therefore, when the current song meets the preset microphone-passing conditions, a microphone-passing button will be displayed on the local preset screen area of ​​the lead singer's client. If the lead singer clicks this button, a chorus invitation request will be sent to each audience client in the online karaoke room, and a communication connection establishment request will be responded to by the microphone-receiving client to establish a point-to-point link with the microphone-receiving client. The microphone-receiving client is the audience client that responds to the chorus invitation request; that is, after responding to the chorus invitation request, the microphone-receiving client will actively initiate a communication connection establishment request to establish a point-to-point link with the lead singer's client. In this way, the lead singer's client will obtain the first audio stream uploaded by the microphone-receiving client through this point-to-point link, merge the first audio stream with the local second audio stream to obtain the chorus audio stream, and then upload the chorus audio stream to the content delivery network (CDN) so that non-microphone-receiving clients in the audience can obtain the chorus audio stream from the CDN and play it through the CDN link. In other words, the microphone-receiving client and the lead singer client directly connect via a peer-to-peer link to exchange audio stream data, achieving low-latency chorus performances for both participants. Other non-microphone-receiving clients continue to retrieve the chorus audio stream from the content delivery network (CDN) via a CDN link, ensuring low-cost distribution and controlling bandwidth costs for non-microphone-receiving users. This solution enables microphone-passing interaction between the lead singer and audience in online karaoke rooms, thereby enhancing the singing atmosphere and activity level. Attached Figure Description

[0047] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0048] Figure 1A schematic diagram of the system framework applicable to the online singing microphone-passing interaction scheme disclosed in this application;

[0049] Figure 2 This application discloses a flowchart of an online singing microphone-passing interactive method.

[0050] Figure 3 This is a flowchart of an audio stream transmission method disclosed in this application;

[0051] Figure 4 This application discloses a flowchart of a specific online singing microphone-passing interaction method;

[0052] Figure 5 This application discloses a flowchart of an online singing microphone-passing interaction process;

[0053] Figure 6 This application discloses another specific online singing microphone-passing interaction method flowchart;

[0054] Figure 7 This application discloses a flowchart of the microphone delivery signaling transmission process.

[0055] Figure 8 This is a schematic diagram of the link switching before and after a microphone receiving client is received, as disclosed in this application.

[0056] Figure 9 This is a schematic diagram of the structure of an online singing microphone-passing interactive device disclosed in this application;

[0057] Figure 10 This is a schematic diagram of another online singing microphone-passing interactive device disclosed in this application;

[0058] Figure 11 This is a structural diagram of an electronic device disclosed in this application. Detailed Implementation

[0059] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0060] In offline concerts, singers often point their microphones towards the audience to invite them to sing along and interact, thus enhancing the concert atmosphere. Currently available singing and live-streaming software lacks a microphone-passing interaction feature for online karaoke rooms. Therefore, this application discloses an online singing microphone-passing interaction method, device, and medium, enabling microphone-passing interaction between the lead singer and the audience in online karaoke rooms, thereby improving the singing atmosphere and activity level within the online karaoke room.

[0061] The system framework used in the online singing and microphone-passing interactive solution of this application can be found in [reference needed]. Figure 1 As shown, it may specifically include microphone client 001, lead singer client 002, content delivery network 003, and non-microphone client 004.

[0062] In this context, both the microphone-receiving client 001 and the non-microphone-receiving client 004 are audience user clients within the online karaoke room. After the microphone-receiving client 001 joins the lead singer client 002's live song duet, the microphone-receiving client 001 and the lead singer client 002 establish a P2P (Peer-to-Peer) direct connection via RTC (Real-time Communications) technology. Once the connection is successful, a low-latency point-to-point data synchronization channel is established between the lead singer client 02 and the microphone-receiving client 001. The two parties exchange audio stream data through this P2P channel, and the lead singer client 002 merges its locally generated audio stream with the audio stream from the microphone-receiving client 001 to obtain the duet audio stream. This duet audio stream is then uploaded to a content delivery network (CDN). The content delivery network (CDN) 003 distributes the audio, and the non-microphone client 004 pulls the chorus audio stream from the content delivery network 003, thus completing the recording and listening process of the entire chorus, and realizing the microphone interaction between the lead singer and the audience in the online karaoke room.

[0063] In specific embodiments, the aforementioned client can be a mobile client, a computer client, or a tablet client, etc., as long as the corresponding terminal device can be used to install the online karaoke application. An online karaoke room refers to a room created by a singer in live streaming or music software. For example, this solution can be applied to the online karaoke room scenario in the WeSing app.

[0064] See Figure 2 As shown in the figure, this application discloses an online singing microphone-passing interaction method, applied to the lead singer client in an online karaoke room. The method includes:

[0065] Step S11: If the current song meets the preset microphone passing conditions, then display the microphone passing button on the local preset screen area.

[0066] In this embodiment, when the current song meets the preset microphone-passing conditions, a microphone-passing button will be displayed on the local preset screen area of ​​the lead singer's client. This embodiment does not limit the interface display form of the microphone-passing button; for example, it can be an icon with a microphone, text, or a combination of both. Users can also customize the icon color and text format according to their preferences, including language and font.

[0067] Step S12: If the microphone button is detected to be clicked, a sing-along invitation request is sent to each viewer client in the online karaoke room.

[0068] In this embodiment, if the microphone-passing button is clicked, it indicates that the lead singer intends to initiate a microphone-passing interaction, and therefore a duet invitation request is sent to all audience clients in the online karaoke room. That is, at this time, all audience clients in the online karaoke room except the lead singer's client will receive a duet invitation request.

[0069] Step S13: Respond to the communication connection establishment request sent by the microphone receiving client to establish a point-to-point link with the microphone receiving client; the microphone receiving client is the client in the audience client that responds to the chorus invitation request.

[0070] In this embodiment, in response to the communication connection establishment request sent by the microphone receiving client, a point-to-point (P2P) link is established with the microphone receiving client. The microphone receiving client refers to the client among the audience clients that responds to the chorus invitation request. It can be understood that after receiving the chorus invitation request, all audience members can decide whether to join the chorus according to their personal wishes. If they decide to join the chorus, they will respond to the chorus invitation request through their local client. Furthermore, after responding to the chorus invitation request, the microphone receiving client will actively initiate a communication connection establishment request to the lead singer client to establish a point-to-point link with the lead singer client. In this process, the microphone receiving client specifically uses RTC technology to establish a P2P direct connection with the lead singer client. After the connection is successful, a point-to-point low-latency data synchronization channel is established between the lead singer client and the microphone receiving client. Under wireless network conditions, the latency of this channel is generally around 200ms, which meets the low latency requirements of the chorus.

[0071] Furthermore, after responding to the communication connection establishment request sent by the microphone-receiving client, the process further includes: collecting the user avatars of all the microphone-receiving clients and a first prompt message to prompt the microphone-receiving client to join the current round of chorus; and sending the user avatars of the microphone-receiving clients and the first prompt message to the first preset public screen area and the second preset public screen area for display. It can be understood that this embodiment also includes a public screen area for displaying the user avatars of those joining the chorus and the prompt message indicating that a particular user has joined the chorus. Specifically, it involves collecting the user avatars of all the microphone-receiving clients and the first prompt message to prompt the microphone-receiving clients to join the current round of chorus; and sending the user avatars of the microphone-receiving clients and the first prompt message to the first preset public screen area and the second preset public screen area for display. It should be noted that the first preset public screen area is specifically the stage area, which is used to display the user avatars of all microphone-receiving clients. As long as a microphone-receiving client responds to the chorus invitation request, its avatar will appear in the stage area. The stage area background is pre-set with a stage atmosphere rendering animation style. This embodiment does not limit the form of this style. For example, spotlights, ribbon animations, etc. can appear. The second preset public screen area is specifically the chat window area, which is used to prompt microphone-receiving clients to join this round of chorus.

[0072] In a specific implementation, the method further includes: real-time monitoring of the display area occupied by all user avatars received in the first preset public screen area; if the current display area is larger than the area of ​​the first preset public screen area, then controlling all currently received user avatars to slide and display as a whole along a preset direction in the first preset public screen area. In this embodiment, since the area of ​​the first preset public screen area is fixed and related to the screen size, if too many users join the current round of singing, the user avatars will fill the entire stage area, resulting in a poor user experience. Therefore, this embodiment will monitor in real-time the display area occupied by all currently received user avatars in the first preset public screen area and compare the occupied display area with the area of ​​the first preset public screen area. If the current display area is larger than the area of ​​the first preset public screen area, then controlling all currently received user avatars to slide and display as a whole along a preset direction, such as the left or right direction, in the first preset public screen area. Therefore, when the stage area is almost full of user avatars, the user avatars can be controlled to slide across the stage area in the left and right directions.

[0073] It is important to note that the above method also includes: if it is detected that none of the audience clients have responded to the chorus invitation request within a preset time range, then information indicating that no one has participated in the live chat and the current round of chorus invitations has ended is displayed on the third public screen area. That is, after the lead singer sends a chorus invitation to all viewers in the online karaoke room, if no viewer joins the chorus within the preset time range, information indicating that no one has participated in the live chat and the current round of chorus invitations has ended is displayed on the third public screen area. In a specific scenario, after the lead singer sends the chorus invitation, their microphone remains on. If the lead singer finds that no viewers are participating in the chorus, they can verbally encourage everyone to participate. If no viewers participate within the preset time range, i.e., if it is detected that none of the audience clients have responded to the chorus invitation request within the preset time range, then information indicating that no one has participated in the live chat and the current round of chorus invitations has ended is displayed on the third public screen area. In addition, the lead singer's client will also send a message prompting the lead singer to continue singing. The preset time range can be a pre-set fixed duration or the time when the current round of chorus is about to end.

[0074] Step S14: Obtain the first audio stream uploaded by the microphone receiving client through the peer-to-peer link, and merge the first audio stream and the local second audio stream to obtain the chorus audio stream.

[0075] In this embodiment, after a point-to-point link is established between the lead singer client and the microphone receiver client, all microphone receiver clients will automatically turn on their microphones. The lead singer client will then obtain the first audio stream uploaded by the microphone receiver clients through the point-to-point link, and mix the first audio stream with the local second audio stream to obtain the chorus audio stream.

[0076] Step S15: Upload the chorus audio stream to the content delivery network so that the non-microphone client in the audience client can obtain the chorus audio stream from the content delivery network and play it through the content delivery network link.

[0077] In this embodiment, the lead vocal client uploads the chorus audio stream to the content delivery network (CDN), so that the non-microphone-connected client in the audience can obtain the chorus audio stream from the CDN and play it via the CDN link. Specifically, this process is as follows: Figure 3 As shown, the lead vocal client first uploads the chorus audio stream to the RTC backend, and then the RTC backend pushes the chorus audio stream to the CDN service platform for distribution. The CDN service platform will quickly push the chorus audio stream to various acceleration nodes across the country, so that other non-microphone clients can pull the chorus audio stream from the CDN node closest to them and play it to hear the chorus effect.

[0078] In other words, the microphone-receiving client and the lead singer's client directly connect via a peer-to-peer link to exchange audio stream data, achieving low-latency chorus performances for both participants. Other non-microphone-receiving clients continue to pull the chorus audio stream from the content delivery network (CDN) via a CDN link, ensuring low-cost distribution and controlling bandwidth costs for non-microphone-receiving users. This solution enables microphone-passing interaction between the lead singer and audience in online karaoke rooms, thereby enhancing the singing atmosphere and activity level.

[0079] As can be seen, the online singing microphone passing interaction method in this application is applied to the lead singer client in an online karaoke room. If the currently sung song meets the preset microphone passing conditions, a microphone passing button is displayed on a local preset screen area. If the microphone passing button is detected to be clicked, a chorus invitation request is sent to each audience client in the online karaoke room. A communication connection establishment request is sent by the microphone receiving client to establish a point-to-point link with the microphone receiving client. The microphone receiving client is the audience client that responds to the chorus invitation request. The first audio stream uploaded by the microphone receiving client through the point-to-point link is obtained, and the first audio stream and the local second audio stream are merged to obtain a chorus audio stream. The chorus audio stream is uploaded to a content delivery network so that non-microphone receiving clients in the audience clients can obtain the chorus audio stream from the content delivery network and play it through the content delivery network link. Therefore, when the current song meets the preset microphone-passing conditions, a microphone-passing button will be displayed on the local preset screen area of ​​the lead singer's client. If the lead singer clicks this button, a chorus invitation request will be sent to each audience client in the online karaoke room, and a communication connection establishment request will be responded to by the microphone-receiving client to establish a point-to-point link with the microphone-receiving client. The microphone-receiving client is the audience client that responds to the chorus invitation request; that is, after responding to the chorus invitation request, the microphone-receiving client will actively initiate a communication connection establishment request to establish a point-to-point link with the lead singer's client. In this way, the lead singer's client will obtain the first audio stream uploaded by the microphone-receiving client through this point-to-point link, merge the first audio stream with the local second audio stream to obtain the chorus audio stream, and then upload the chorus audio stream to the content delivery network (CDN) so that non-microphone-receiving clients in the audience can obtain the chorus audio stream from the CDN and play it through the CDN link. In other words, the microphone-receiving client and the lead singer's client directly connect via a peer-to-peer link to exchange audio stream data, achieving low-latency chorus performances for both participants. Other non-microphone-receiving clients continue to pull the chorus audio stream from the content delivery network (CDN) via a CDN link, ensuring low-cost distribution and controlling bandwidth costs for non-microphone-receiving users. This solution enables microphone-passing interaction between the lead singer and audience in online karaoke rooms, thereby enhancing the singing atmosphere and activity level.

[0080] See Figure 4 and Figure 5 As shown in the illustration, this application discloses a specific online singing microphone-passing interaction method. Compared to the previous embodiment, this embodiment further explains and optimizes the technical solution. Specifically, it includes:

[0081] Step S21: Obtain the accompaniment information of the currently sung song in advance through the background accompaniment service; the accompaniment information includes accompaniment duration, lyric segment information, chorus start position and chorus end position.

[0082] In this embodiment, before singing, the lead singer client will first obtain the accompaniment information of the song to be sung through the background accompaniment service. The accompaniment information includes, but is not limited to, accompaniment duration, lyric segment information, chorus start position and chorus end position.

[0083] Step S22: If the time interval between the timestamp corresponding to the real-time singing progress of the current song and the timestamp corresponding to the start position of the chorus meets the preset time interval, then the microphone pass button is displayed on the local preset screen area.

[0084] In this embodiment, the preset microphone-passing condition can be that the lead singer is about to sing the chorus of the currently performed song. Therefore, when the time interval between the timestamp corresponding to the real-time performance progress of the currently performed song and the timestamp corresponding to the start position of the chorus meets the preset time interval, the microphone-passing button is displayed on the local preset screen area. The aforementioned preset time interval can be set to 3 seconds, that is, the microphone-passing button appears 3 seconds before the end of the phrase preceding the chorus of each song, giving the lead singer advance notice.

[0085] In addition, the preset microphone passing conditions can also add certain restrictions on the number of people. For example, the microphone passing button will only be displayed when the total number of people in the karaoke room exceeds 5.

[0086] Step S23: If the microphone button is clicked within the preset button display time, a sing-along invitation request is sent to each viewer client in the online karaoke room; if the microphone button is not clicked within the button display time, the microphone button is hidden.

[0087] In this embodiment, the microphone pass button is not always displayed in the local preset screen area; a button display time is preset, for example, it can be set to 4 seconds. Therefore, if a click on the microphone pass button is detected within 4 seconds, a sing-along invitation request is sent to each viewer client in the online karaoke room. If no click behavior is detected after 4 seconds, the microphone pass button is hidden.

[0088] Step S24: Respond to the communication connection establishment request sent by the microphone receiving client to establish a point-to-point link with the microphone receiving client; the microphone receiving client is the client in the audience client that responds to the chorus invitation request.

[0089] In this embodiment, the lead vocal client and the microphone receiver client establish a point-to-point link so that after the duet, the specific ways to end the current round of the duet are as follows:

[0090] In one specific implementation, if the timestamp corresponding to the real-time performance progress of the current song matches the timestamp corresponding to the end of the chorus, then the current round of chorus ends. That is, when the chorus is finished, the current round of chorus automatically ends, returning to the process of the lead singer performing solo, until the next chorus triggers a new round of microphone invitations, and finally until the entire song is finished.

[0091] In another specific implementation, a microphone handover end button is displayed on a preset local screen area. If the microphone handover end button is clicked, the current round of the chorus ends. It is understood that after the receiving microphone client joins the chorus, the microphone handover button on the lead singer's client will switch to a microphone handover end button, and if the microphone handover end button is clicked, the current round of the chorus ends.

[0092] In other words, there are two ways to end the microphone interaction: one is that the current round of singing will automatically end when the chorus is finished; the other is that the lead singer will actively end the current round of singing.

[0093] Step S25: Obtain the first audio stream uploaded by the microphone receiving client through the peer-to-peer link, and merge the first audio stream and the local second audio stream to obtain the chorus audio stream.

[0094] Step S26: Upload the chorus audio stream to the content delivery network so that the non-microphone client in the audience client can obtain the chorus audio stream from the content delivery network and play it through the content delivery network link.

[0095] For more detailed processing of steps S25 and S26, please refer to the relevant content disclosed in the foregoing embodiments, which will not be repeated here.

[0096] As can be seen, in this embodiment, before the performance, the lead singer's client obtains the accompaniment information of the song to be sung through the background accompaniment service. This accompaniment information includes, but is not limited to, accompaniment duration, lyric segmentation, chorus start position, and chorus end position. When the lead singer is about to sing the chorus, a microphone-passing button is displayed on a preset local screen area. This button is not always displayed; a pre-set display time is used. If the button is not clicked within this time, it is hidden. During the chorus, there are two ways to end the microphone-passing interaction: one is that the chorus ends automatically, and the other is that the lead singer actively ends the chorus. This solution enables microphone-passing interaction between the lead singer and the audience in the online karaoke room, thereby enhancing the singing atmosphere and activity level.

[0097] See Figure 6 As shown in the figure, this application discloses an online singing microphone-passing interaction method, applied to a microphone-receiving client in an online karaoke room. The method includes:

[0098] Step S31: Obtain and respond to the chorus invitation request sent by the lead singer client.

[0099] In this embodiment, after the lead singer client sends a duet invitation request, the microphone receiver client obtains and responds to the duet invitation request.

[0100] In a specific implementation, the above-mentioned acquisition and response to the chorus invitation request sent by the lead singer client includes: performing long polling on the instant messaging component to obtain a signaling message carrying the chorus invitation request sent by the lead singer client through the instant messaging component; generating a chorus join button in a local preset screen area based on the signaling message; and responding to the chorus invitation request based on the user's click operation on the chorus join button. Figure 7 As described above, when the lead singer's client detects through the accompaniment information that the lead singer is about to sing the chorus, it requests the background IM (Instant Messaging) signaling service to initiate a chorus invitation request. The IM signaling service converts the chorus invitation request into a microphone-passing signal and broadcasts it to the audience users in the room through the IM component. The audience client will perform long polling of the IM component to obtain the signaling message carrying the chorus invitation request sent by the lead singer's client through the IM component. Then, based on the signaling message, it generates a chorus join button in a preset area of ​​the local screen and responds to the chorus invitation request based on the user's click on the chorus join button.

[0101] Furthermore, after responding to the chorus invitation request based on the user's click on the "Join" button, the method further includes: displaying the avatars of all currently receiving microphone clients and a second prompt message to prompt the receiving microphone clients to join the current chorus on the public screen area; changing the "Join" button on the local preset screen area to a "Quit" button; and if the "Quit" button is detected to be clicked, deleting the user's own avatar on the public screen area and displaying a third prompt message to prompt the user to quit the current chorus. In this embodiment, the public screen area displays the avatars of all currently receiving microphone clients and the second prompt message to prompt the receiving microphone clients to join the current chorus. When the "Join" button on a receiving microphone client is clicked, the "Join" button on the local preset screen area is changed to a "Quit" button. Therefore, if a receiving microphone user clicks the "Quit" button, they quit the current chorus, and their own avatar is deleted from the public screen area, along with the third prompt message to prompt them to quit the current chorus.

[0102] Step S32: Send a communication connection establishment request to the lead vocal client to establish a point-to-point link with the lead vocal client.

[0103] In this embodiment, the microphone receiving client actively initiates a communication connection establishment request to the lead singer client in order to establish a point-to-point link with the lead singer client. In this way, the microphone receiving client can directly connect and communicate with the lead singer client through the point-to-point link, thereby achieving low-latency duet between the two participants in the duet.

[0104] Step S33: Upload the local first audio stream to the lead singer client via the peer-to-peer link, so that the lead singer client can merge its own recorded second audio stream with the first audio stream to obtain a chorus audio stream, and upload the chorus audio stream to the content delivery network, so that the non-microphone client in the audience client can obtain the chorus audio stream from the content delivery network and play it via the content delivery network link.

[0105] In this embodiment, the client receiving the microphone uploads its local first audio stream. The lead singer then merges this first audio stream with its own recorded second audio stream to obtain a chorus audio stream, which is then uploaded to the content delivery network (CDN). Non-microphone clients in the audience can then retrieve and play the chorus audio stream from the CDN via the CDN link. In other words, non-microphone clients continue to retrieve the chorus audio stream from the CDN via the CDN link, ensuring low-cost distribution and controlling the bandwidth costs for non-microphone users.

[0106] In addition, the above method also includes: after the end of this round of chorus, switching the current link from the peer-to-peer link to a content delivery network (CDN) link, and obtaining the current audio stream uploaded by the lead singer client from the CDN based on the CDN link. It can be understood that after the end of this round of chorus, the receiving client switches the current link from the peer-to-peer link to the CDN link; that is, the peer-to-peer link between the receiving client and the lead singer client is disconnected, and the connection is switched back to the CDN link. At this time, like other non-receiving clients, it obtains the current audio stream uploaded by the lead singer client from the CDN based on the CDN link. It should be noted that if the round of chorus ends automatically after the chorus or is actively ended by the lead singer client, the current audio stream uploaded by the lead singer client is the lead singer's own audio stream; if the receiving client actively leaves the chorus, the current audio stream uploaded by the lead singer client is the chorus audio stream of the lead singer and other receiving users.

[0107] See Figure 8 As shown, Figure 8 This is a schematic diagram illustrating the link switching process before and after a microphone receiving client is received, as disclosed in this application. Before accepting the microphone invitation, both the receiving user and other audience members (i.e., non-receiving users) pull the audio stream uploaded by the lead singer from the CDN. After successfully accepting the invitation, the receiving user switches from the CDN link to a P2P link with the lead singer, exchanging data through a direct point-to-point connection to achieve extremely low latency. This allows the lead singer and the receiving user to achieve a near real-time chorus interaction experience. Simultaneously, the lead singer uploads the chorus audio stream to the CDN, and non-receiving users continue to pull the chorus audio stream through the CDN channel, ensuring low-cost distribution. After the receiving user finishes singing, the client switches back to the CDN link to continue pulling the audio stream uploaded by the lead singer from the CDN.

[0108] As can be seen, the online singing microphone-passing interaction method in this application is applied to the microphone-receiving client in an online karaoke room. It receives and responds to a duet invitation request sent by the lead singer client; sends a communication connection establishment request to the lead singer client to establish a point-to-point link; and uploads a local first audio stream to the lead singer client via the point-to-point link. The lead singer client then merges its own recorded second audio stream with the first audio stream to obtain a duet audio stream, and uploads the duet audio stream to a content delivery network (CDN). This allows non-microphone-receiving clients in the audience client to obtain and play the duet audio stream from the CDN via the CDN link. Therefore, after receiving and responding to the duet invitation request sent by the lead singer client, the microphone-receiving client actively initiates a communication connection establishment request to the lead singer client to establish a point-to-point link. In this way, the microphone-receiving client can directly connect and communicate with the lead singer client through this point-to-point link, thereby achieving low-latency duet between the two participants. Specifically, the client receiving the microphone uploads its local first audio stream. The lead singer then merges this with their own recorded second audio stream to create a chorus audio stream, which is then uploaded to the content delivery network (CDN). Non-microphone receiving clients in the audience can then retrieve and play the chorus audio stream from the CDN via the CDN link. In other words, non-microphone receiving clients continue to retrieve the chorus audio stream from the CDN, ensuring low-cost distribution and controlling bandwidth costs for non-microphone receiving clients. This solution enables microphone interaction between the lead singer and audience in online karaoke rooms, thereby enhancing the singing atmosphere and activity level.

[0109] See Figure 9 As shown in the figure, this application discloses an online singing microphone-passing interactive device, applied to the lead singer client in an online karaoke room. The device includes:

[0110] Microphone handover button display module 01 is used to display a microphone handover button on a local preset screen area if the currently sung song meets the preset microphone handover conditions;

[0111] The chorus invitation module 02 is used to send a chorus invitation request to each viewer client in the online karaoke room if the microphone button is detected to be clicked.

[0112] The point-to-point link establishment module 03 is used to respond to the communication connection establishment request sent by the microphone receiving client in order to establish a point-to-point link with the microphone receiving client; the microphone receiving client is the client in the audience client that responds to the chorus invitation request;

[0113] Audio stream merging module 04 is used to obtain the first audio stream uploaded by the microphone receiving client through the point-to-point link, and merge the first audio stream and the local second audio stream to obtain a chorus audio stream;

[0114] The audio stream upload module 05 is used to upload the chorus audio stream to the content delivery network, so that the non-microphone client in the audience client can obtain the chorus audio stream from the content delivery network and play it through the content delivery network link.

[0115] As can be seen, the online singing microphone passing interaction method in this application is applied to the lead singer client in an online karaoke room. If the currently sung song meets the preset microphone passing conditions, a microphone passing button is displayed on a local preset screen area. If the microphone passing button is detected to be clicked, a chorus invitation request is sent to each audience client in the online karaoke room. A communication connection establishment request is sent by the microphone receiving client to establish a point-to-point link with the microphone receiving client. The microphone receiving client is the audience client that responds to the chorus invitation request. The first audio stream uploaded by the microphone receiving client through the point-to-point link is obtained, and the first audio stream and the local second audio stream are merged to obtain a chorus audio stream. The chorus audio stream is uploaded to a content delivery network so that non-microphone receiving clients in the audience clients can obtain the chorus audio stream from the content delivery network and play it through the content delivery network link. Therefore, when the current song meets the preset microphone-passing conditions, a microphone-passing button will be displayed on the local preset screen area of ​​the lead singer's client. If the lead singer clicks this button, a chorus invitation request will be sent to each audience client in the online karaoke room, and a communication connection establishment request will be responded to by the microphone-receiving client to establish a point-to-point link with the microphone-receiving client. The microphone-receiving client is the audience client that responds to the chorus invitation request; that is, after responding to the chorus invitation request, the microphone-receiving client will actively initiate a communication connection establishment request to establish a point-to-point link with the lead singer's client. In this way, the lead singer's client will obtain the first audio stream uploaded by the microphone-receiving client through this point-to-point link, merge the first audio stream with the local second audio stream to obtain the chorus audio stream, and then upload the chorus audio stream to the content delivery network (CDN) so that non-microphone-receiving clients in the audience can obtain the chorus audio stream from the CDN and play it through the CDN link. In other words, the microphone-receiving client and the lead singer client directly connect via a peer-to-peer link to exchange audio stream data, achieving low-latency chorus performances for both participants. Other non-microphone-receiving clients continue to retrieve the chorus audio stream from the content delivery network (CDN) via a CDN link, ensuring low-cost distribution and controlling bandwidth costs for non-microphone-receiving users. This solution enables microphone-passing interaction between the lead singer and audience in online karaoke rooms, thereby enhancing the singing atmosphere and activity level.

[0116] In some specific embodiments, the device further includes:

[0117] The accompaniment information retrieval unit is used to obtain the accompaniment information of the currently sung song in advance through the background accompaniment service; the accompaniment information includes accompaniment duration, lyric segmentation information, chorus start position and chorus end position;

[0118] Correspondingly, the microphone handover button display module 01 is specifically used to display the microphone handover button on a local preset screen area when the time interval between the timestamp corresponding to the real-time singing progress of the current song and the timestamp corresponding to the start position of the chorus meets the preset time interval.

[0119] In some specific embodiments, the device further includes:

[0120] The first ending unit is used to end the current round of chorus if the timestamp corresponding to the real-time singing progress of the current song is consistent with the timestamp corresponding to the end position of the chorus.

[0121] In some specific embodiments, the device further includes:

[0122] The second termination unit is used to display a microphone termination button on the preset screen area. If the microphone termination button is detected to be clicked, the current round of chorus ends.

[0123] In some specific embodiments, the device further includes:

[0124] The acquisition unit is used to acquire the user avatars of all the microphone-receiving clients and the first prompt information for prompting the microphone-receiving clients to join the current round of chorus;

[0125] The first display unit is used to send the user avatar of the microphone client and the first prompt information to the first preset public screen area and the second preset public screen area for display, respectively.

[0126] In some specific embodiments, the device further includes:

[0127] The avatar area monitoring unit is used to monitor in real time the display area occupied by all the user avatars received in the first preset public screen area.

[0128] The sliding display unit is used to control all currently received user avatars to slide and display along a preset direction on the first preset public screen area if the current display area is larger than the area of ​​the first preset public screen area.

[0129] In some specific embodiments, the device further includes:

[0130] The request monitoring unit is used to display information on the third public screen area indicating that no one is currently participating in the live chat and that the current round of chorus invitations has ended if it detects that none of the audience clients have responded to the chorus invitation request within a preset time range.

[0131] In some specific embodiments, the chorus invitation module 02 specifically includes:

[0132] An invitation request sending unit is used to send a chorus invitation request to each viewer client in the online karaoke room if the microphone button is clicked within a preset button display time.

[0133] A button hiding unit is used to hide the microphone button if it is detected that the microphone button has not been clicked during the button display time.

[0134] See Figure 10 As shown in the figure, this application discloses an online singing microphone-passing interactive device, applied to a microphone-receiving client in an online karaoke room. The device includes:

[0135] Request and response module 11 is used to obtain and respond to chorus invitation requests sent by the lead singer client;

[0136] The connection establishment request sending module 12 is used to send a communication connection establishment request to the lead vocal client in order to establish a point-to-point link with the lead vocal client;

[0137] The audio stream upload module 13 is used to upload the local first audio stream to the lead singer client through the peer-to-peer link, so that the lead singer client can merge its own recorded second audio stream with the first audio stream to obtain a chorus audio stream, and upload the chorus audio stream to the content delivery network, so that the non-microphone client in the audience client can obtain the chorus audio stream from the content delivery network and play it through the content delivery network link.

[0138] In some specific embodiments, the request-response module 11 specifically includes:

[0139] The polling unit is used to perform long polling on the instant messaging component to obtain the signaling message carrying the chorus invitation request sent by the lead singer client through the instant messaging component.

[0140] The button generation unit is used to generate a chorus join button in a local preset screen area based on the signaling message, and to respond to the chorus invitation request based on the user's click operation on the chorus join button.

[0141] In some specific embodiments, after the request-response module 11, the system further includes:

[0142] The second display unit is used to display the user avatars of all the microphone-receiving clients and a second prompt message to prompt the microphone-receiving clients to join the current round of singing on the public screen area;

[0143] A button switching unit is used to change the "Join Chorus" button on the preset screen area to a "Join Chorus Exit" button.

[0144] The third display unit is used to delete its own user avatar on the public screen area and display a third prompt message to indicate that it is exiting the current round of chorus if the click of the chorus exit button is detected.

[0145] In some specific embodiments, the device further includes:

[0146] The link switching unit is used to switch the current link from the point-to-point link to the content delivery network link after the current round of chorus ends, and to obtain the current audio stream uploaded by the lead singer client from the content delivery network based on the content delivery network link.

[0147] Figure 11 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Specifically, it may include: at least one processor 21, at least one memory 22, a power supply 23, a communication interface 24, an input / output interface 25, and a communication bus 26. The memory 22 stores a computer program, which is loaded and executed by the processor 21 to implement the relevant steps in the online singing and microphone-passing interactive method performed by the electronic device disclosed in any of the foregoing embodiments.

[0148] In this embodiment, the power supply 23 is used to provide operating voltage for each hardware device on the electronic device 20; the communication interface 24 can create a data transmission channel between the electronic device 20 and external devices, and the communication protocol it follows can be any communication protocol applicable to the technical solution of this application, and is not specifically limited here; the input / output interface 25 is used to acquire external input data or output data to the outside world, and its specific interface type can be selected according to specific application needs, and is not specifically limited here.

[0149] The processor 21 may include one or more processing cores, such as a quad-core processor or an octa-core processor. The processor 21 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 21 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 21 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, the processor 21 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0150] In addition, the memory 22, as a carrier for resource storage, can be a read-only memory, random access memory, disk or optical disk, etc. The resources stored thereon include operating system 221, computer program 222 and data 223, etc., and the storage method can be temporary storage or permanent storage.

[0151] The operating system 221 manages and controls the various hardware devices and computer programs 222 on the electronic device 20 to enable the processor 21 to perform calculations and processing on the massive amounts of data 223 in the memory 22. The operating system can be Windows, Unix, Linux, etc. The computer program 222, in addition to including a computer program capable of performing the online singing and microphone-passing interaction method executed by the electronic device 20 as disclosed in any of the foregoing embodiments, may further include computer programs capable of performing other specific tasks. The data 223 may include data received by the electronic device from external devices, as well as data collected by its own input / output interface 25.

[0152] Furthermore, this application also discloses a computer-readable storage medium storing a computer program. When the computer program is loaded and executed by a processor, it implements the online singing and microphone-passing interaction method steps disclosed in any of the foregoing embodiments.

[0153] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section.

[0154] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0155] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0156] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0157] The above provides a detailed description of the online singing microphone interaction method, device, and storage medium provided by the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A method for interactive online singing with microphone passing, characterized in that, The lead singer client used in online karaoke rooms includes: If the current song meets the preset microphone passing conditions, a microphone passing button will be displayed on the local preset screen area; wherein, the preset microphone passing conditions are that the time interval between the timestamp corresponding to the real-time singing progress of the current song and the timestamp corresponding to the start position of the chorus meets the preset duration interval. If the microphone button is clicked, a sing-along invitation request is sent to each viewer client in the online karaoke room. Responding to the communication connection establishment request sent by the microphone receiving client, a point-to-point link is established with the microphone receiving client; the microphone receiving client is the client in the audience client that responds to the chorus invitation request; The first audio stream uploaded by the microphone client through the peer-to-peer link is obtained, and the first audio stream and the local second audio stream are merged to obtain the chorus audio stream; The chorus audio stream is uploaded to a content delivery network (CDN) so that the non-microphone client in the audience client can obtain and play the chorus audio stream from the CDN via the CDN link.

2. The online singing and microphone-passing interaction method according to claim 1, characterized in that, Also includes: The accompaniment information of the currently sung song is obtained in advance through the background accompaniment service; the accompaniment information includes accompaniment duration, lyric segment information, chorus start position and chorus end position.

3. The online singing and microphone-passing interaction method according to claim 2, characterized in that, After establishing a point-to-point link with the microphone-receiving client, the process also includes: If the timestamp corresponding to the real-time performance progress of the current song matches the timestamp corresponding to the end position of the chorus, then the current round of chorus ends. Alternatively, a microphone handover end button can be displayed on the preset screen area. If the microphone handover end button is clicked, the current round of chorus will end.

4. The online singing and microphone-passing interaction method according to claim 1, characterized in that, After responding to the communication connection establishment request sent by the microphone client, the method further includes: Collect the user avatars of all the microphone-receiving clients and the first prompt message used to prompt the microphone-receiving clients to join the current round of chorus; The user's avatar and the first prompt message from the microphone client are sent to the first preset public screen area and the second preset public screen area for display, respectively.

5. The online singing and microphone-passing interaction method according to claim 4, characterized in that, Also includes: Real-time monitoring of the display area occupied by all user avatars received in the first preset public screen area; If the current display area is larger than the area of ​​the first preset public screen area, then control all currently received user avatars to slide and display as a whole along a preset direction on the first preset public screen area.

6. The online singing and microphone-passing interactive method according to claim 1, characterized in that, Also includes: If it is detected that none of the audience clients respond to the chorus invitation request within the preset time range, information indicating that no one is currently participating in the live chat and that this round of chorus invitations has ended will be displayed on the third public screen area.

7. The online singing and microphone-passing interactive method according to any one of claims 1 to 6, characterized in that, If the microphone button is detected to be clicked, a sing-along invitation request is sent to each viewer client in the online karaoke room, including: If the microphone button is clicked within the preset button display time, a duet invitation request is sent to each viewer client in the online karaoke room. If the microphone button is not clicked within the specified display time, the microphone button will be hidden.

8. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the steps of the online singing microphone interaction method as described in any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that, Used to store a computer program; wherein, when the computer program is executed by a processor, it implements the steps of the online singing microphone interaction method as described in any one of claims 1 to 7.

Images