Karaoke method, computer equipment, readable storage medium and computer program product

By introducing artificial intelligence mode switching technology into the karaoke system, detecting and switching to the karaoke mode to simulate the subsequent progress of singing, the poor audio collection effect and howling problems in traditional karaoke are solved, and the singing effect of karaoke is improved .

CN119207346AActive Publication Date: 2024-12-27TENCENT MUSIC ENTERTAINMENT TECH (SHENZHEN) CO LTD

Patent Information

Application Number
CN202411342195.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-25
Publication Date
2024-12-27
Estimated Expiration
2044-09-25

AI Technical Summary

Technical Problem

In traditional karaoke methods, when the mobile phone is used as a microphone, the audio collection effect is poor, resulting in a decline in the quality of singing audio, and it is easy to whistle in a closed environment, affecting the effect of karaoke.

Method used

Using artificial intelligence mode switching technology, the audio processing equipment can detect the quality and howling of the singing performed by the user in real time. If the preset standards are not met, switch to the artificial intelligence mode, use artificial intelligence technology to simulate the subsequent progress of the singing, and replace the user's real Vocals, realize intelligent karaoke.

Benefits of technology

It improves the singing effect of karaoke, avoids the impact of the quality of songs on the output singing voice and karaoke effect, and provides a better audio collection and singing experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119207346A_ABST
    Figure CN119207346A_ABST
Patent Text Reader

Abstract

The invention relates to a karaoke method, computer equipment, a readable storage medium and a computer program product. The method comprises the following steps: acquiring the current-progress singing sound of a target song sung by a user, which is acquired by audio acquisition equipment in an original sound mode, as the current-sung singing sound of the target song; under the condition that the original sound mode meets a first preset switching condition, switching the audio acquisition equipment from the original sound mode to an artificial intelligence mode; and acquiring artificial intelligence singing sound obtained by simulating the singing sound of the subsequent progress of the target song sung by the user by the audio acquisition equipment in the artificial intelligence mode by using the artificial intelligence technology, and playing the artificial intelligence singing sound. By adopting the method, the original singing sound of the user or the artificial intelligence singing sound can be flexibly selected as the output singing sound of the karaoke based on the singing sound of the user in the original sound mode and the user operation, the influence of factors such as song singing quality on the output singing sound of the karaoke and the karaoke effect is avoided, and the singing effect of the karaoke is further improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a karaoke method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] Karaoke, as a common form of entertainment, allows participants to sing songs through a microphone with the accompaniment of pre-recorded music. Participants can use audio acquisition devices such as mobile phones as microphones and sing karaoke with the help of audio playback devices such as televisions.

[0003] The traditional technology of using mobile phones as microphones to sing karaoke on TV is limited by the audio collection effect of the mobile phone. If the audio collection effect of the mobile phone is not as good as that of a professional microphone, the singing effect of the audio collected by the mobile phone on the TV will be significantly reduced. At the same time, in a closed environment, if the TV volume is high, the singing audio during the actual karaoke process is prone to howling, affecting the karaoke effect.

[0004] Therefore, the traditional method has the problem that the singing effect of the singing audio is not good. Summary of the invention

[0005] Based on this, it is necessary to provide a karaoke method, device, computer equipment, computer-readable storage medium and computer program product that can improve the karaoke singing effect in response to the above technical problems.

[0006] In a first aspect, the present application provides a karaoke mode switching method, which is applied to an audio processing device, comprising:

[0007] Acquire the current progress of the singing of the target song by the user collected by the audio collection device in the original sound mode as the current singing of the target song;

[0008] In the case where the original sound mode satisfies a first preset switching condition, the audio acquisition device is switched from the original sound mode to the artificial intelligence mode; wherein the original sound mode satisfies the first preset switching condition including: the song singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user;

[0009] Acquire the artificial intelligence singing voice obtained by the audio acquisition device in the artificial intelligence mode using artificial intelligence technology to simulate the subsequent progress of the singing of the target song by the user, and play the artificial intelligence singing voice; wherein the subsequent progress is the progress after the current progress.

[0010] In one embodiment, the step of obtaining the artificial intelligence singing voice obtained by simulating the subsequent progress of the singing of the target song by the user by the audio acquisition device using artificial intelligence technology in the artificial intelligence mode includes:

[0011] In response to switching the original sound mode to the artificial intelligence mode, sending a mode switching instruction to the audio acquisition device; the mode switching instruction is used to control the audio acquisition device to send the artificial intelligence singing voice to the audio processing device;

[0012] Receive the artificial intelligence singing voice sent by the audio acquisition device, and play the artificial intelligence singing voice according to the singing progress of the target song.

[0013] In one embodiment, the method further comprises:

[0014] Obtaining the current singing voice of the user singing the target song;

[0015] Obtain a howling detection result corresponding to the current singing voice, and determine the singing quality of the current singing voice according to the howling detection result; the howling detection result is used to characterize whether there is howling in the current singing voice.

[0016] In one embodiment, the method further comprises:

[0017] Obtaining the current singing voice of the user singing the target song;

[0018] Obtain a singing score of the current singing voice, and determine the singing quality of the current singing voice according to the singing score.

[0019] In one embodiment, the method further comprises:

[0020] Acquire the singing voice of the user singing the target song at the current progress, collected by the audio collection device in the artificial intelligence mode, as the current singing voice of the target song;

[0021] In the case where the artificial intelligence mode satisfies a second preset switching condition, the artificial intelligence mode is switched to the original sound mode; wherein the artificial intelligence mode satisfies the second preset switching condition including: the song singing quality of the current singing voice is higher than or equal to the preset standard quality, or the song segment corresponding to the current singing voice is not a designated song segment in the target song, or the audio processing device responds to the second mode switching operation triggered by the user;

[0022] The current singing voice of the target song sung by the user is played, and the subsequent progress singing voice of the target song sung by the user collected by the audio collection device in the original sound mode is acquired and played.

[0023] In one of the embodiments, the audio processing device and the audio acquisition device are integrated into the same audio device.

[0024] In a second aspect, the present application further provides a karaoke method, which is applied to an audio acquisition device, and the method comprises:

[0025] In the original sound mode, the singing voice of the user singing the target song at the current progress is collected as the current singing voice of the target song;

[0026] The current singing voice is sent to an audio processing device; the audio processing device is used to switch the audio acquisition device from the original sound mode to the artificial intelligence mode when the original sound mode satisfies a first preset switching condition; wherein the original sound mode satisfies the first preset switching condition including: the singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user;

[0027] In the artificial intelligence mode, artificial intelligence technology is used to simulate the user's singing of the subsequent progress of the target song to obtain artificial intelligence singing, and the artificial intelligence singing is sent to an audio processing device for playback; the subsequent progress is the progress after the current progress.

[0028] In one embodiment, the method of using artificial intelligence technology to simulate the subsequent progress of the user singing the target song to obtain artificial intelligence singing, and sending the artificial intelligence singing to an audio processing device for playback, includes:

[0029] Determine the timestamp corresponding to the subsequent progress of the target song according to the timestamp corresponding to the current singing voice of the target song;

[0030] Using artificial intelligence technology to simulate the singing of the user after the timestamp corresponding to the subsequent progress of singing the target song to obtain the artificial intelligence singing voice;

[0031] The artificial intelligence singing voice is sent to the audio processing device for playing; the audio processing device is used to play the artificial intelligence singing voice starting from the timestamp corresponding to the subsequent progress of the target song.

[0032] In a third aspect, the present application further provides a karaoke device, which is applied to an audio processing device, comprising:

[0033] An acquisition module, used for acquiring the singing voice of the user singing the target song at the current progress, which is collected by the audio acquisition device in the original sound mode, as the current singing voice of the target song;

[0034] A switching module, configured to switch the audio acquisition device from the original sound mode to the artificial intelligence mode when the original sound mode satisfies a first preset switching condition; wherein the original sound mode satisfies the first preset switching condition including: the song singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user;

[0035] A playing module is used to obtain the artificial intelligence singing voice obtained by the audio acquisition device in the artificial intelligence mode using artificial intelligence technology to simulate the subsequent progress of the user singing the target song, and play the artificial intelligence singing voice; wherein the subsequent progress is the progress after the current progress.

[0036] In a fourth aspect, the present application further provides a computer device, wherein the computer device comprises a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the steps of the above method are implemented.

[0037] In a fifth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and the computer program implements the steps of the above method when executed by a processor.

[0038] In a sixth aspect, the present application further provides a computer program product, wherein the computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0039] The above-mentioned karaoke method, device, computer equipment, computer-readable storage medium and computer program product, in the original sound mode, collect the user's current singing voice in real time, and detect whether the original sound mode meets the preset switching conditions in combination with the current singing voice and user operation, and switch the original sound mode to the artificial intelligence mode when the original sound mode meets the preset switching conditions, so that in the artificial intelligence mode, artificial intelligence singing generated by simulating the user's singing of the target song is used to replace the user's singing voice in the subsequent progress, thereby realizing intelligent karaoke, and can flexibly select the user's original singing voice or artificial intelligence singing voice as the output voice of the karaoke based on the user's singing voice and user operation in the original sound mode, thereby avoiding the influence of factors such as song singing quality on the karaoke output voice and karaoke effect, thereby improving the karaoke singing effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 A diagram of an application environment of a karaoke method in an embodiment;

[0042] Figure 2 A schematic flow chart of a karaoke method in one embodiment;

[0043] Figure 3 A schematic diagram of a process of using AI technology to optimize the karaoke experience of a mobile phone microphone in an embodiment;

[0044] Figure 4 A structural block diagram of a karaoke device in an embodiment;

[0045] Figure 5 The figure is a diagram of the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0047] The karaoke method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown. Among them, the audio processing device 102 communicates with the audio acquisition device 104 through the network. The data storage system can store the data that the audio acquisition device 104 needs to process. The data storage system can be integrated on the audio acquisition device 104, or it can be placed on the cloud or other network servers. The audio processing device 102 obtains the current progress of the user singing the target song collected by the audio acquisition device in the original sound mode as the current singing song of the target song; the audio processing device 102 switches the audio acquisition device from the original sound mode to the artificial intelligence mode when the original sound mode meets the first preset switching condition; wherein the original sound mode meets the first preset switching condition including: the song singing quality of the current singing song is lower than the preset standard quality, or the song segment corresponding to the current singing song is the designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user; the audio processing device 102 obtains the artificial intelligence singing obtained by the audio acquisition device in the artificial intelligence mode using artificial intelligence technology to simulate the subsequent progress of the user singing the target song, and plays the artificial intelligence singing; wherein the subsequent progress is the progress after the current progress. The audio processing device 102 may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, IoT devices, and portable wearable devices. IoT devices may be smart speakers, smart TVs, smart car devices, etc. Portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc. Head-mounted devices may be virtual reality (VR) devices, augmented reality (AR) devices, smart glasses, etc. The audio acquisition device 104 may include, but is not limited to, microphones, smart phones, etc.

[0048] In an exemplary embodiment, Figure 2 As shown, a karaoke method is provided, which is described by taking the method applied to an audio processing device as an example, and includes the following steps S202 to S206. Among them:

[0049] Step S202, obtaining the current progress of the singing of the target song by the user collected by the audio collection device in the original sound mode as the current singing voice of the target song.

[0050] Among them, the audio acquisition device may refer to a hardware device used to capture sound and convert the sound into an electronic signal. In practical applications, the audio acquisition device may include but is not limited to a microphone and a mobile terminal (such as a mobile phone).

[0051] Among them, the original sound mode can refer to a mode for playing the user's real voice. In actual applications, the singing voice played by the audio processing device in the original sound mode is the user's real voice or the real voice after voice processing.

[0052] The user may refer to a singer. In practical applications, the user may include an object that sings a song through an audio acquisition device.

[0053] The target song may refer to a song sung by a user during karaoke. In actual applications, the target song may include any song in a preset song database.

[0054] Among them, the current progress may refer to the song singing progress corresponding to the current moment in the process of the user singing the target song. In actual applications, the current progress may be determined by the timestamp of the song sung by the user at the current moment.

[0055] As an example, in the original sound mode, the singing voice played by the audio processing device is the real human voice collected by the audio acquisition device. In order to ensure a good karaoke effect, the audio processing device can obtain the singing voice of the user singing the target song at the current progress collected by the audio acquisition device in the original sound mode as the current singing voice of the target song in the original sound mode. The audio processing device can determine whether to play the current singing voice based on the singing quality, song clip and user operation corresponding to the current singing voice.

[0056] Step S204, when the original sound mode satisfies the first preset switching condition, the audio acquisition device is switched from the original sound mode to the artificial intelligence mode; the original sound mode satisfies the first preset switching condition including: the singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user.

[0057] Among them, the first preset switching condition may refer to information used to determine whether to switch the original sound mode to the artificial intelligence mode. In actual applications, the first preset switching condition may include but is not limited to the singing quality of the current singing voice being lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user.

[0058] Among them, the artificial intelligence mode may refer to a mode that uses artificial intelligence technology to simulate the user's singing voice to replace the user's real voice and play it. In practical applications, the artificial intelligence mode can be used as an AI mode.

[0059] As an example, the audio processing device combines the singing quality, song clip and user operation corresponding to the current singing voice of the target song sung by the user in the original sound mode, and determines in real time whether the original sound mode meets the first preset switching condition. When the original sound mode meets the first preset switching condition, the audio acquisition device is switched from the original sound mode to the artificial intelligence mode. In the artificial intelligence mode, the audio processing device can use artificial intelligence technology to simulate the user's singing voice to replace the user's real human voice and play it. In actual applications, if the singing quality of the current singing voice is lower than the preset standard quality, it means that playing the current singing voice will affect the karaoke effect, and the audio processing device can determine that the original sound mode meets the first preset switching condition; the user can also specify a song clip in the target song, and if the song clip corresponding to the current singing voice is the specified song clip in the target song, the audio processing device can determine that the original sound mode meets the first preset switching condition; the user can also control the audio processing device to perform the first mode switching operation. When the audio processing device responds to the first mode switching operation triggered by the user, the audio processing device can determine that the original sound mode meets the first preset switching condition. In actual applications, when the original sound mode does not meet the first preset switching condition, the audio processing device does not need to switch the audio acquisition device from the original sound mode to the artificial intelligence mode. The audio acquisition device is still in the original sound mode, and the audio processing device can play the current singing voice captured by the audio acquisition device.

[0060] Step S206, obtaining the artificial intelligence singing voice obtained by the audio acquisition device using artificial intelligence technology in the artificial intelligence mode to simulate the subsequent progress of the user singing the target song, and playing the artificial intelligence singing voice.

[0061] Among them, the subsequent progress can refer to the progress after the current progress. In actual applications, the current progress can be determined by the timestamp of the song sung by the user at the current moment, and the subsequent progress can be determined by the timestamp after the timestamp corresponding to the current progress.

[0062] Among them, artificial intelligence singing can refer to the singing generated by using artificial intelligence technology to simulate the user singing the target song. In actual applications, the timbre of the artificial intelligence singing can be the same as the timbre of the user.

[0063] As an example, in artificial intelligence mode, the audio acquisition device can use artificial intelligence technology to simulate the user's singing of the subsequent progress of the target song to obtain artificial intelligence singing. The artificial intelligence mode uses artificial intelligence technology to simulate the user's singing to replace the user's real voice and play it, so the audio processing device can play the artificial intelligence singing. At this time, the content played by the audio processing device may include the artificial intelligence singing and the accompaniment audio corresponding to the artificial intelligence singing in the target song.

[0064] In the above-mentioned Karaoke method, in the original sound mode, the user's current singing voice is collected in real time, and combined with the current singing voice and user operation, it is detected whether the original sound mode meets the preset switching conditions, and when the original sound mode meets the preset switching conditions, the original sound mode is switched to the artificial intelligence mode, so that in the artificial intelligence mode, artificial intelligence is used to simulate the user's singing of the target song and the artificial intelligence singing voice generated to replace the user's singing voice in the subsequent progress, thereby realizing intelligent Karaoke. Based on the user's singing voice in the original sound mode and the user's operation, the user's original singing voice or artificial intelligence singing voice can be flexibly selected as the output voice of the Karaoke, thereby avoiding the influence of factors such as the quality of song singing on the output voice of the Karaoke and the Karaoke effect, thereby improving the singing effect of the Karaoke.

[0065] In an exemplary embodiment, obtaining an artificial intelligence singing voice obtained by using artificial intelligence technology in an audio acquisition device in an artificial intelligence mode to simulate the subsequent progress of a user singing a target song includes: in response to switching the original sound mode to the artificial intelligence mode, sending a mode switching instruction to the audio acquisition device; the mode switching instruction is used to control the audio acquisition device to send the artificial intelligence singing voice to the audio processing device; receiving the artificial intelligence singing voice sent by the audio acquisition device, and playing the artificial intelligence singing voice according to the singing progress of the target song.

[0066] Among them, the mode switching instruction may refer to information used to control the audio acquisition device to send artificial intelligence singing to the audio processing device.

[0067] As an example, in response to switching the original sound mode to the artificial intelligence mode, the audio processing device can send a mode switching instruction to the audio acquisition device. The audio acquisition device receives the mode switching instruction, and the audio acquisition device can send the artificial intelligence singing voice obtained by real-time reasoning using artificial intelligence technology to the audio processing device. The audio processing device receives the artificial intelligence singing voice sent by the audio acquisition device and plays the artificial intelligence singing voice according to the singing progress. It is understandable that the audio acquisition device can generate artificial intelligence singing voices for the entire target song and / or artificial intelligence singing voices for specific segments of the target song in real time based on the real human voice of the user collected in real time and / or the real human voice of the user collected in advance. In actual application, if the current karaoke mode is the original sound mode, the user can click the "artificial intelligence mode button" / "mode switching button" to trigger the mode switching operation, and the audio processing device can switch the current mode (original sound mode) to the artificial intelligence mode; if the current karaoke mode is the artificial intelligence mode, the user can click the "original sound mode button" / "mode switching button" to trigger the mode switching operation, and the audio processing device can switch the current mode (artificial intelligence mode) to the original sound mode.

[0068] In an exemplary embodiment, the above method also includes: obtaining the current singing voice of the target song sung by the user; obtaining the howling detection result corresponding to the current singing voice, and determining the singing quality of the current singing voice based on the howling detection result; the howling detection result is used to characterize whether there is howling in the current singing voice.

[0069] Among them, the howling detection result may refer to information used to characterize whether there is howling in the current singing voice. In practical applications, howling may refer to the phenomenon that occurs when the sound in the sound reinforcement system is captured again by the microphone and amplified in an infinite loop.

[0070] As an example, the song singing quality helps to distinguish and judge the part that needs to be automatically switched to the karaoke mode during the user's singing of the target song. Howling can affect the song singing quality. In order to obtain accurate song singing quality, the audio processing device can obtain the current singing voice of the user singing the target song, and then analyze the current singing voice according to the preset howling detection method, determine the howling detection result corresponding to the current singing voice, and determine the song singing quality of the current singing voice based on the howling detection result. For example: if the howling detection result corresponding to the current singing voice indicates that there is howling in the current singing voice, the audio processing device can determine that the song singing quality of the current singing voice at this time is lower than the preset standard quality, and then determine that the original sound mode meets the first preset switching condition at this time, and the audio processing device needs to switch to the karaoke mode; if the howling detection result corresponding to the current singing voice indicates that there is no howling in the current singing voice, the audio processing device can determine that the song singing quality of the current singing voice at this time is higher than or equal to the preset standard quality, and the audio processing device does not need to switch to the karaoke mode, that is, the audio processing device is still in the original sound mode at this time.

[0071] In this embodiment, by obtaining the howling detection result corresponding to the current singing voice and determining the singing quality of the song based on the howling detection result, it is possible to accurately analyze whether there is howling in the current singing voice and obtain accurate song singing quality, so as to facilitate the subsequent accurate judgment of whether to switch the original sound mode to the artificial intelligence mode based on the singing quality of the song, realize accurate switching of the K song mode, avoid the impact of the song singing quality on the K song effect, and improve the K song singing effect.

[0072] In an exemplary embodiment, the above method also includes: obtaining the user's current singing voice of the target song; obtaining the singing score of the current singing voice, and determining the singing quality of the song of the current singing voice based on the singing score.

[0073] Among them, the singing score may refer to information that characterizes the singing performance of the user in singing the target song. In practical applications, the singing score may be obtained by processing the current singing voice with a scoring model.

[0074] As an example, the singing score can also affect the singing quality of the song. The audio processing device can obtain the current singing voice of the user singing the target song, and then input the current singing voice into the pre-trained scoring model to determine the singing score of the current singing voice, and determine the singing quality of the current singing voice based on the singing score. For example: the audio processing device can obtain the singing score of each sentence (such as the current sentence or the current singing voice) in the process of the user singing the target song in real time through the scoring model. When the singing score is lower than the preset singing score threshold, the audio processing device can determine that the singing quality of the current singing voice is lower than the preset standard quality, and then determine that the original sound mode meets the first preset switching condition, and the audio playback device needs to switch to the karaoke mode; when the singing score is higher than or equal to the preset singing score threshold, the audio playback device can determine that the singing quality of the current singing voice is higher than or equal to the preset standard quality, and the audio processing device does not need to switch to the karaoke mode, that is, the audio processing device is still in the original sound mode at this time.

[0075] In this embodiment, by obtaining the singing score corresponding to the current singing voice and determining the singing quality of the song based on the singing score, the singing score of the current singing voice can be accurately analyzed to obtain the accurate singing quality of the song, so as to facilitate the subsequent accurate judgment of whether to switch to the K song mode based on the singing quality of the song, avoid the song singing quality affecting the K song effect, and improve the K song singing effect.

[0076] In an exemplary embodiment, the above method also includes: obtaining the current progress singing voice of the user singing the target song collected by the audio acquisition device in the artificial intelligence mode as the current singing voice of the target song; when the artificial intelligence mode meets the second preset switching condition, switching the artificial intelligence mode to the original sound mode; wherein the artificial intelligence mode meets the second preset switching condition including: the song singing quality of the current singing voice is higher than or equal to the preset standard quality, or the song segment corresponding to the current singing voice is not the designated song segment in the target song, or the audio processing device responds to the second mode switching operation triggered by the user; playing the current singing voice of the user singing the target song, and obtaining and playing the subsequent progress singing voice of the user singing the target song collected by the audio acquisition device in the original sound mode.

[0077] Among them, the second preset switching condition may refer to information used to determine whether to switch the artificial intelligence mode to the original sound mode. In actual applications, the second preset switching condition may include but is not limited to the singing quality of the current singing voice being higher than or equal to the preset standard quality, or the song segment corresponding to the current singing voice is not the designated song segment in the target song, or the audio processing device responds to the second mode switching operation triggered by the user.

[0078] As an example, in the artificial intelligence mode, the singing played by the audio processing device is an artificial intelligence singing that uses artificial intelligence technology to simulate the user's singing of the target song. In order to ensure a good karaoke effect, the audio processing device can obtain the current progress singing of the user singing the target song collected by the audio acquisition device in the artificial intelligence mode as the current singing singing of the target song in the artificial intelligence mode. The audio processing device can combine the singing quality corresponding to the current singing singing, song clips and user operations to determine whether to play the real human voice of the user singing the target song collected by the audio acquisition device.

[0079] In the artificial intelligence mode, the audio processing device combines the singing quality, song clips and user operations corresponding to the current singing voice of the user singing the target song, and determines in real time whether the artificial intelligence mode meets the second preset switching condition. When the artificial intelligence mode meets the second preset switching condition, the audio processing device can switch the audio acquisition device from the artificial intelligence mode to the original sound mode. In the original sound mode, the audio processing device can play the real human voice of the user singing the target song collected by the audio acquisition device. In actual applications, if the singing quality of the current singing voice is higher than or equal to the preset standard quality, it means that playing the current singing voice will not affect the karaoke effect, and the audio processing device can determine that the artificial intelligence mode meets the second preset switching condition; the user can also specify a song clip in the target song, if the song clip corresponding to the current singing voice is not the specified song clip in the target song, the audio processing device can determine that the artificial intelligence mode meets the second preset switching condition; the user can also control the audio processing device to perform the second mode switching operation. When the audio processing device responds to the second mode switching operation triggered by the user, the audio processing device can determine that the artificial intelligence mode meets the second preset switching condition. In actual applications, when the artificial intelligence mode does not meet the second preset switching condition, the audio processing device does not need to switch the audio acquisition device from the artificial intelligence mode to the original sound mode. The audio acquisition device is still in the artificial intelligence mode, and the audio processing device can play the current singing voice captured by the audio acquisition device.

[0080] In the original acoustic mode, the audio capture device can capture the real vocals of the user singing the target song as the current singing voice in the original acoustic mode, and the audio processing device can play the current singing voice at this time. The audio processing device can also play the subsequent progress singing voice of the user singing the target song captured by the audio capture device in the original acoustic mode. At this time, the content played by the audio processing device may include the real vocals of the user in the original acoustic mode (such as the current singing voice in the original acoustic mode captured by the audio capture device) and the accompaniment audio corresponding to the real vocals in the target song.

[0081] In an exemplary embodiment, the audio processing device and the audio acquisition device may also be integrated into the same audio device. The specific limitations of the karaoke method using the audio device may refer to the limitations on the karaoke method above and will not be repeated here.

[0082] In an exemplary embodiment, a karaoke method is provided, which is described by taking the method applied to an audio acquisition device as an example, and includes the following steps:

[0083] In the original sound mode, the user's singing voice at the current progress of the target song is collected as the current singing voice of the target song.

[0084] Among them, the original sound mode can refer to a mode for playing the user's real voice. In actual applications, the singing voice played by the audio processing device in the original sound mode is the user's real voice or the real voice after voice processing.

[0085] The user may refer to a singer. In practical applications, the user may include an object that sings a song through an audio acquisition device.

[0086] The target song may refer to a song sung by a user during karaoke. In actual applications, the target song may include any song in a preset song database.

[0087] Among them, the current progress may refer to the song singing progress corresponding to the current moment in the process of the user singing the target song. In actual applications, the current progress may be determined by the timestamp of the song sung by the user at the current moment.

[0088] As an example, in the original sound mode, the audio capture device can capture the current progress of the user singing the target song as the current singing voice of the target song. The audio capture device can send the current singing voice to the audio processing device, so that the audio processing device can determine whether to play the current singing voice based on the singing quality corresponding to the current singing voice, the song clip and the operation performed by the user.

[0089] The current singing voice is sent to an audio processing device; the audio processing device is used to switch the audio acquisition device from the original sound mode to the artificial intelligence mode when the original sound mode meets the first preset switching condition; wherein the original sound mode meets the first preset switching condition including: the singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user.

[0090] Among them, the first preset switching condition may refer to information used to determine whether to switch the original sound mode to the artificial intelligence mode. In actual applications, the first preset switching condition may include but is not limited to the singing quality of the current singing voice being lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user.

[0091] Among them, the artificial intelligence mode may refer to a mode that uses artificial intelligence technology to simulate the user's singing voice to replace the user's real voice and play it. In practical applications, the artificial intelligence mode can be used as an AI mode.

[0092] As an example, the audio acquisition device can send the current singing voice to the audio processing device. The audio processing device determines in real time whether the original sound mode meets the first preset switching condition through the singing quality, song clip and user operation corresponding to the current singing voice of the target song sung by the user. When the original sound mode meets the first preset switching condition, the audio processing device can switch the audio acquisition device from the original sound mode to the artificial intelligence mode. In the artificial intelligence mode, the audio processing device can use artificial intelligence technology to simulate the user's singing voice to replace the user's real human voice and play it. In actual applications, if the singing quality of the current singing voice is lower than the preset standard quality, it means that playing the current singing voice will affect the karaoke effect, and the audio processing device can determine that the original sound mode meets the first preset switching condition; the user can also specify a song clip in the target song, and if the song clip corresponding to the current singing voice is the specified song clip in the target song, the audio processing device can determine that the original sound mode meets the first preset switching condition; the user can also control the audio processing device to perform the first mode switching operation. When the audio processing device responds to the first mode switching operation triggered by the user, the audio processing device can determine that the original sound mode meets the first preset switching condition. In actual applications, when the original sound mode does not meet the first preset switching condition, the audio processing device does not need to switch the audio acquisition device from the original sound mode to the artificial intelligence mode. The audio acquisition device is still in the original sound mode, and the audio processing device can play the current singing voice captured by the audio acquisition device.

[0093] In the artificial intelligence mode, artificial intelligence technology is used to simulate the user's singing of the subsequent progress of the target song to obtain artificial intelligence singing, and the artificial intelligence singing is sent to the audio processing device for playback.

[0094] Among them, the subsequent progress can refer to the progress after the current progress. In actual applications, the current progress can be determined by the timestamp of the song sung by the user at the current moment, and the subsequent progress can be determined by the timestamp after the timestamp corresponding to the current progress.

[0095] Among them, artificial intelligence singing can refer to the singing generated by using artificial intelligence technology to simulate the user singing the target song. In actual applications, the timbre of the artificial intelligence singing can be the same as the timbre of the user.

[0096] As an example, in artificial intelligence mode, the audio acquisition device can use artificial intelligence technology to simulate the user's singing of the subsequent progress of the target song to obtain artificial intelligence singing. The artificial intelligence mode uses artificial intelligence technology to simulate the user's singing to replace the user's real voice and play it, so the audio processing device can play the artificial intelligence singing. At this time, the content played by the audio processing device may include the artificial intelligence singing and the accompaniment audio corresponding to the artificial intelligence singing in the target song.

[0097] In the above-mentioned Karaoke method, in the original sound mode, the user's current singing voice is collected in real time, and the audio processing equipment is used in combination with the current singing voice and the user's operation to detect whether the original sound mode meets the preset switching conditions, and when the original sound mode meets the preset switching conditions, the original sound mode is switched to the artificial intelligence mode, so that in the artificial intelligence mode, artificial intelligence is used to simulate the user's singing of the target song and the artificial intelligence singing voice generated to replace the user's singing voice in the subsequent progress, thereby realizing intelligent Karaoke. Based on the user's singing voice in the original sound mode and the user's operation, the user's original singing voice or artificial intelligence singing voice can be flexibly selected as the output voice of the Karaoke, thereby avoiding the influence of factors such as the quality of song singing on the output voice of the Karaoke and the Karaoke effect, thereby improving the singing effect of the Karaoke.

[0098] In an exemplary embodiment, artificial intelligence technology is used to simulate the singing of a user at a subsequent progress of a target song to obtain artificial intelligence singing, and the artificial intelligence singing is sent to an audio processing device for playback, including: determining a timestamp corresponding to a subsequent progress of the target song based on a timestamp corresponding to a current singing voice of the target song; using artificial intelligence technology to simulate the singing of a user after a timestamp corresponding to a subsequent progress of the target song to obtain artificial intelligence singing; sending the artificial intelligence singing to an audio processing device for playback; the audio processing device is used to play the artificial intelligence singing starting from a timestamp corresponding to a subsequent progress of the target song.

[0099] Among them, the timestamp corresponding to the current singing voice may refer to information representing the position of the song segment sung by the user at the current moment in the process of the user singing the target song in the target song.

[0100] The timestamp corresponding to the subsequent progress of the target song may refer to information representing the position of the song segment corresponding to the subsequent progress of the target song in the target song.

[0101] As an example, the audio acquisition device may first obtain the timestamp corresponding to the current singing voice of the target song, and then determine the timestamp corresponding to the subsequent progress of the target song according to the timestamp corresponding to the current singing voice of the target song. After that, the server may use artificial intelligence technology to simulate the singing voice of the user after the timestamp corresponding to the subsequent progress of the target song to obtain the artificial intelligence singing voice, and send the artificial intelligence singing voice to the audio processing device for playback, so that the audio processing device can start playing the artificial intelligence singing voice from the timestamp corresponding to the subsequent progress of the target song. For example, the timestamp of the song segment corresponding to the current singing voice of the target song can be expressed as 1 minute and 10 seconds, and the audio acquisition device can determine the timestamp of the song segment corresponding to the subsequent progress of the target song according to the timestamp, such as 1 minute and 15 seconds, and then the audio acquisition device can use artificial intelligence technology to simulate the singing voice of the user after the timestamp corresponding to the subsequent progress of the target song to obtain the artificial intelligence singing voice, and send the artificial intelligence singing voice (and the timestamp of the song segment corresponding to the subsequent progress of the target song) to the audio processing device, and the audio processing device can start playing the artificial intelligence singing voice from the timestamp corresponding to the subsequent progress of the target song.

[0102] In this embodiment, by determining the timestamp corresponding to the current singing voice and the timestamp corresponding to the subsequent progress of the target song, the audio processing device can accurately start playing the artificial intelligence singing voice from the timestamp corresponding to the subsequent progress of the target song, thereby avoiding overlap or excessive gap between the user's real voice and the artificial intelligence singing voice due to mode switching during the karaoke process, thereby improving the naturalness of the karaoke and optimizing the karaoke singing effect.

[0103] In some embodiments, the TV-side karaoke application can set the AI ​​voice switching mode (such as automatic switching mode): (1) During the user's singing of the target song, when the singing score is lower than the preset singing score threshold, the next sentence automatically switches to AI voice (i.e., switches to artificial intelligence mode), and automatically switches back to the original sound mode after the singing score is higher than or equal to the preset singing score threshold; (2) In the target segment (such as the chorus part), the original sound mode is switched to AI voice mode (i.e., artificial intelligence mode). The mobile phone-side karaoke application can set the segment mode: During the user's singing of the target song, detect whether there is howling in the current singing voice. When howling occurs, the mobile phone can turn off the voice collection, and the TV as an audio processing device can switch to artificial intelligence mode and can switch back to the original sound mode at any time.

[0104] As an example, Figure 3As shown, a flow chart of using AI technology to optimize the karaoke experience of mobile phone microphone is provided. The mobile phone and TV can be connected to the same local area network and establish a UDP communication connection. The mobile phone mic hardware receives the human voice, which passes through the hardware driver layer and the Android Audio Framework layer to the mobile phone karaoke application. The mobile phone karaoke application undergoes a series of human voice processing, including howling suppression and sound effect compensation, and is sent to the karaoke sound receiving end (such as karaoke sound receiver) on the TV side through the local area network UDP. The karaoke sound receiving end hands the sound to the Mic Service middleware, and the MicService writes the sound data to the system process and sends it to the HAL driver for final output. In the specific implementation, after the user starts singing the target song using the mobile phone microphone, the mobile phone artificial intelligence reasoning (AI reasoning) module is started, and the AI ​​human voice or the AI ​​human voice of the whole song or the fragment AI human voice is inferred in real time according to the automatic switching mode or the fragment mode. In the specific implementation, the TV side can also complete the switching of AI human voice, that is, after switching to the AI ​​human voice mode, it no longer receives the human voice on the mobile phone side, and directly uses the AI ​​human voice generated by the TV side to replace the original singing voice.

[0105] For the automatic switching mode, when the K song application on the TV detects that the singing score of the current sentence is too low, it sends a mode switching instruction to the K song application on the mobile phone, requesting to switch to AI mode (i.e., switch to artificial intelligence mode). After receiving the mode switching instruction, the K song application on the mobile phone turns off the vocal collection and vocal processing functions, switches to AI reasoning mode (such as artificial intelligence mode), and obtains AI vocal data (such as artificial intelligence singing) generated by artificial intelligence and corresponding to the singing progress according to the timestamp of the next sentence (such as singing progress), and sends it to the TV. The TV can play the artificial intelligence singing and the corresponding accompaniment audio. When the K song application on the TV detects that the singing score of the current singing voice has returned to normal (such as higher than or equal to the preset singing score threshold), the TV sends a mode switching instruction to the mobile phone application again, requesting to switch to the original sound mode. After receiving the mode switching instruction, the K song application on the mobile phone restores the original sound mode, re-enables the vocal collection and vocal processing functions, and sends the processed current singing voice (such as the current singing voice) to the TV.

[0106] For the segment mode, when the TV-side karaoke application plays a specified segment (such as a specified song segment in the target song), it sends a mode switching instruction to the mobile-side application to switch to AI mode (such as artificial intelligence mode). After the specified segment is played, it sends a mode switching instruction to switch back to the original sound mode. It can be understood that the mobile-side application can also be provided with a mode switching switch. When the user experiences howling or a low singing score, the user can trigger the mode switching operation by operating the mobile phone, thereby manually switching to AI mode (such as artificial intelligence mode). When there is no howling in the current singing or the singing score returns to normal (such as higher than or equal to the preset singing score threshold), the user can trigger the mode switching operation by operating the mobile phone, thereby manually switching to the original sound mode.

[0107] In this embodiment, AI technology is used to generate AI voice in real time on the mobile phone. When the AI ​​mode is turned on, the voice collection function is turned off, and the AI ​​voice is used instead of the original voice to be sent to the TV. The playback logic of the TV remains unchanged, and AI technology can be used to infer the AI ​​voice in real time. Based on the real-time singing situation, it is intelligent to switch between the original voice and the AI ​​voice, ultimately achieving the purpose of using AI technology to optimize the karaoke experience of the mobile phone microphone.

[0108] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0109] Based on the same inventive concept, the embodiment of the present application also provides a karaoke device for implementing the karaoke method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more karaoke device embodiments provided below can refer to the limitations on the karaoke method above, and will not be repeated here.

[0110] In an exemplary embodiment, Figure 4 As shown, a karaoke device is provided, which is applied to an audio processing device, including: an acquisition module 402, a switching module 404 and a playing module 406, wherein:

[0111] The acquisition module 402 is used to acquire the current progress of the singing of the target song by the user collected by the audio collection device in the original sound mode as the current singing of the target song.

[0112] The switching module 404 is used to switch the audio acquisition device from the original sound mode to the artificial intelligence mode when the original sound mode satisfies the first preset switching condition; wherein the original sound mode satisfies the first preset switching condition including: the singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user.

[0113] The playing module 406 is used to obtain the artificial intelligence singing voice obtained by the audio acquisition device in the artificial intelligence mode using artificial intelligence technology to simulate the subsequent progress of the user singing the target song, and play the artificial intelligence singing voice; wherein the subsequent progress is the progress after the current progress.

[0114] In one of the exemplary embodiments, the acquisition module 402 is further specifically used to send a mode switching instruction to the audio acquisition device in response to switching the original sound mode to the artificial intelligence mode; the mode switching instruction is used to control the audio acquisition device to send the artificial intelligence singing to the audio processing device; receive the artificial intelligence singing sent by the audio acquisition device, and play the artificial intelligence singing according to the singing progress of the target song.

[0115] In one of the exemplary embodiments, the above-mentioned device also includes a howling detection module, which is specifically used to obtain the current singing voice of the target song sung by the user; obtain the howling detection result corresponding to the current singing voice, and determine the singing quality of the current singing voice based on the howling detection result; the howling detection result is used to characterize whether there is howling in the current singing voice.

[0116] In one of the exemplary embodiments, the above-mentioned device also includes a scoring module, which is specifically used to obtain the current singing voice of the target song sung by the user; obtain the singing score of the current singing voice, and determine the singing quality of the song of the current singing voice based on the singing score.

[0117] In one of the exemplary embodiments, the above-mentioned device also includes a second switching module, which is specifically used to obtain the current progress singing voice of the user singing the target song collected by the audio acquisition device in the artificial intelligence mode as the current singing voice of the target song; when the artificial intelligence mode meets the second preset switching condition, the artificial intelligence mode is switched to the original sound mode; wherein the artificial intelligence mode meets the second preset switching condition including: the song singing quality of the current singing voice is higher than or equal to the preset standard quality, or the song segment corresponding to the current singing voice is not the designated song segment in the target song, or the audio processing device responds to the second mode switching operation triggered by the user; plays the current singing voice of the user singing the target song, and obtains and plays the subsequent progress singing voice of the user singing the target song collected by the audio acquisition device in the original sound mode.

[0118] In one of the exemplary embodiments, the apparatus further includes an integration module, which is specifically used to integrate the audio processing device and the audio acquisition device into the same audio device.

[0119] Each module in the karaoke device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0120] In an exemplary embodiment, a karaoke device is provided, which is applied to an audio acquisition device, and includes: an acquisition module, a determination module, and a sending module, wherein:

[0121] The collection module is used to collect the current progress of the user singing the target song as the current singing voice of the target song in the original sound mode.

[0122] A determination module is used to send the current singing voice to an audio processing device; the audio processing device is used to switch the audio acquisition device from the original sound mode to the artificial intelligence mode when the original sound mode satisfies a first preset switching condition; wherein the original sound mode satisfies the first preset switching condition including: the singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user.

[0123] The sending module is used to use artificial intelligence technology to simulate the user's singing of the subsequent progress of the target song in the artificial intelligence mode to obtain artificial intelligence singing, and send the artificial intelligence singing to the audio processing device for playback; the subsequent progress is the progress after the current progress.

[0124] In one of the exemplary embodiments, the above-mentioned sending module is specifically used to determine the timestamp corresponding to the subsequent progress of the target song based on the timestamp corresponding to the current singing of the target song; use artificial intelligence technology to simulate the singing of the user after the timestamp corresponding to the subsequent progress of the target song to obtain the artificial intelligence singing; send the artificial intelligence singing to the audio processing device for playback; the audio processing device is used to play the artificial intelligence singing from the timestamp corresponding to the subsequent progress of the target song.

[0125] Each module in the karaoke device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0126] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 5As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a karaoke method is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0127] Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0128] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

[0129] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0130] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0131] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0132] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0133] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0134] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A karaoke method, characterized in that: Applied to an audio processing device, the method comprises: Acquire the current progress of the singing of the target song by the user collected by the audio collection device in the original sound mode as the current singing of the target song; In the case where the original sound mode satisfies a first preset switching condition, the audio acquisition device is switched from the original sound mode to the artificial intelligence mode; wherein the original sound mode satisfies the first preset switching condition including: the song singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user; Acquire the artificial intelligence singing voice obtained by the audio acquisition device in the artificial intelligence mode using artificial intelligence technology to simulate the subsequent progress of the singing of the target song by the user, and play the artificial intelligence singing voice; wherein the subsequent progress is the progress after the current progress.

2. The method according to claim 1, characterized in that The step of obtaining the artificial intelligence singing voice obtained by simulating the subsequent progress of the singing voice of the user singing the target song in the artificial intelligence mode by using artificial intelligence technology by the audio acquisition device includes: In response to switching the original sound mode to the artificial intelligence mode, sending a mode switching instruction to the audio acquisition device; the mode switching instruction is used to control the audio acquisition device to send the artificial intelligence singing voice to the audio processing device; Receive the artificial intelligence singing sent by the audio acquisition device.

3. The method according to claim 1, characterized in that The method further comprises: Obtaining the current singing voice of the user singing the target song; Obtain a howling detection result corresponding to the current singing voice, and determine the singing quality of the current singing voice according to the howling detection result; the howling detection result is used to characterize whether there is howling in the current singing voice.

4. The method according to claim 1, characterized in that: The method further comprises: Obtaining the current singing voice of the user singing the target song; Obtain a singing score of the current singing voice, and determine the singing quality of the current singing voice according to the singing score.

5. The method according to claim 1, characterized in that The method further comprises: Acquire the singing voice of the user singing the target song at the current progress, collected by the audio collection device in the artificial intelligence mode, as the current singing voice of the target song; In the case where the artificial intelligence mode satisfies a second preset switching condition, the artificial intelligence mode is switched to the original sound mode; wherein the artificial intelligence mode satisfies the second preset switching condition including: the song singing quality of the current singing voice is higher than or equal to the preset standard quality, or the song segment corresponding to the current singing voice is not a designated song segment in the target song, or the audio processing device responds to the second mode switching operation triggered by the user; The current singing voice of the target song sung by the user is played, and the subsequent progress singing voice of the target song sung by the user collected by the audio collection device in the original sound mode is acquired and played.

6. The method according to claim 1, characterized in that The audio processing device and the audio acquisition device are integrated into the same audio device.

7. A karaoke method, characterized in that: Applied to an audio acquisition device, the method comprises: In the original sound mode, the singing voice of the user singing the target song at the current progress is collected as the current singing voice of the target song; The current singing voice is sent to an audio processing device; the audio processing device is used to switch the audio acquisition device from the original sound mode to the artificial intelligence mode when the original sound mode satisfies a first preset switching condition; wherein the original sound mode satisfies the first preset switching condition including: the singing quality of the current singing voice is lower than the preset standard quality, or the song segment corresponding to the current singing voice is a designated song segment in the target song, or the audio processing device responds to the first mode switching operation triggered by the user; In the artificial intelligence mode, artificial intelligence technology is used to simulate the user's singing of the subsequent progress of the target song to obtain artificial intelligence singing, and the artificial intelligence singing is sent to an audio processing device for playback; the subsequent progress is the progress after the current progress.

8. The method according to claim 7, characterized in that The method of using artificial intelligence technology to simulate the subsequent progress of the user singing the target song to obtain artificial intelligence singing, and sending the artificial intelligence singing to an audio processing device for playback, includes: Determine the timestamp corresponding to the subsequent progress of the target song according to the timestamp corresponding to the current singing voice of the target song; Using artificial intelligence technology to simulate the singing of the user after the timestamp corresponding to the subsequent progress of singing the target song to obtain the artificial intelligence singing voice; The artificial intelligence singing voice is sent to the audio processing device for playing; the audio processing device is used to play the artificial intelligence singing voice starting from the timestamp corresponding to the subsequent progress of the target song.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

11. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

Citation Information

Patent Citations

  • Anti-howling wireless chorus method, storage medium, control device and karaoke device

    CN109862474A

  • Method and system for intelligently adjusting sound effects

    CN109905806A

  • Singing synthesis method and device

    CN111354332A

  • Music playing method and device, computer equipment and computer readable storage medium

    CN117827142A

  • Microphone and audio system

    CN206993333U

Cited By

  • Entertainment platform audio and video configuration method, system and equipment

    CN120825605A