Microphone sound effect control method, computer device and computer storage medium

Abstract

Embodiments of the present application disclose a microphone sound effect control method, a computer device and a computer storage medium. Embodiments of the present application include that the computer device can acquire a sound effect list sent by a microphone, and display the sound effect list to enable a user to select a target sound effect of interest, and then the computer device sends sound effect selection operation information of the user to the microphone, so that the microphone determines that the user selects the target sound effect according to the sound effect selection operation information, and then processes the target sound effect. Therefore, the computer device does not need to adapt to the configuration requirements of SDKs of various microphone manufacturers, but only needs to acquire sound effect lists provided by various microphones and display the sound effect lists to the user to enable the user to select, and then processes the target sound effect selected by the user, thereby reducing the workload of developers in writing codes, and enabling the computer device to adapt to microphones provided by various microphone manufacturers.

Description

Technical Field

[0001] This application relates to the field of audio processing, specifically to a microphone sound effect control method, a computer device, and a computer storage medium. Background Technology

[0002] Karaoke software can be installed on smart TVs. Users connect a microphone to the smart TV and select the song they want to play in the software. The smart TV then plays the selected song or its accompaniment. Simultaneously, the user sings along with the song or accompaniment. The user's voice is captured by the microphone and sent to the smart TV, which then synthesizes the user's voice and the accompaniment and outputs the result.

[0003] Microphone manufacturers provide Software Development Kits (SDKs) for users to configure microphone sound effects, allowing for personalized and diverse karaoke experiences. However, different microphone manufacturers offer different SDKs based on their own configuration requirements. This necessitates developers writing separate karaoke software codes to ensure compatibility with each manufacturer's SDK, significantly increasing workload and workload. Summary of the Invention

[0004] This application provides a microphone sound effect control method, a computer device, and a computer storage medium for audio processing based on the microphone sound effects of various microphone manufacturers.

[0005] A first aspect of this application provides a microphone sound effect control method, the method being applied to a computer device, the method comprising:

[0006] Establish a connection with the microphone and obtain a list of sound effects sent by the microphone. The list of sound effects is used to record multiple sound effects and the sound effect information of each sound effect.

[0007] The interface displays the sound effect list, and the sound effect list displays the various sound effects and the sound effect information for each sound effect;

[0008] The system receives a user's selection of a target sound effect from the sound effect list, where the target sound effect is any one of the various sound effects.

[0009] The microphone sends user sound effect selection operation information, which indicates that the user has selected the target sound effect, so that the microphone determines that the user has selected the target sound effect based on the sound effect selection operation information, and processes the target sound effect based on the sound effect information of the target sound effect.

[0010] A second aspect of this application provides a computer device including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the method of the first aspect described above.

[0011] A third aspect of this application provides a computer storage medium storing instructions that, when executed on a computer, cause the computer to perform the method described in the first aspect.

[0012] A fourth aspect of this application provides a computer program product that, when run on a computer device, causes the computer device to perform the method described in the first aspect.

[0013] As can be seen from the above technical solutions, the embodiments of this application have the following advantages:

[0014] The computer device can obtain a list of sound effects transmitted by the microphone and display it to the user for selection of the desired sound effect. The computer device then sends the user's sound effect selection information to the microphone, which determines the selected sound effect and processes it accordingly. Therefore, the computer device does not need to adapt to the configuration requirements of various microphone manufacturers' SDKs; it only needs to obtain the sound effect list provided by each microphone and display it to the user for selection, and then the microphone processes the selected sound effect. This reduces the workload of developers and allows the computer device to be compatible with microphones from various manufacturers. Attached Figure Description

[0015] Figure 1 This is a schematic diagram of the network framework in an embodiment of this application;

[0016] Figure 2 This is a flowchart illustrating the microphone sound effect control method in an embodiment of this application;

[0017] Figure 3 This is another flowchart illustrating the microphone sound effect control method in this application embodiment;

[0018] Figure 4 This is a schematic diagram of the structure of the AudioCompat component of a computer device in an embodiment of this application;

[0019] Figure 5 This is a schematic diagram of a sound effect settings interface displayed on a computer device in an embodiment of this application.

[0020] Figure 6 This is a schematic diagram of the data processing flow performed by the structure based on the AudioCompat component in the embodiments of this application;

[0021] Figure 7 This is a schematic diagram of a computer device in an embodiment of this application. Detailed Implementation

[0022] This application provides a microphone sound effect control method, a computer device, and a computer storage medium for audio processing based on the microphone sound effects of various microphone manufacturers.

[0023] Please see Figure 1 The network framework in this embodiment includes:

[0024] A microphone and computer equipment, which establish a communication connection between the two;

[0025] The computer equipment can be a smart TV, in-vehicle infotainment system, smart fitness mirror, or other computer device capable of providing human-computer interaction, data processing, and audio playback functions. The microphone can establish a communication connection with the computer equipment via a wired or wireless connection. Wired connections can be made using cables; wireless connections can be established using various wireless technology standards such as Bluetooth, Wi-Fi (IEEE 802.11), Infrared (IrDA), and ZigBee (IEEE 802.15.4).

[0026] For example, if a computer device provides a USB interface and is equipped with a USB receiver, and the microphone's USB receiver can be plugged into the USB interface, then the microphone and the computer device can interact with each other based on a wireless communication protocol. Data sent by the microphone to the computer device will be transmitted to the computer device by the USB receiver, and data sent by the computer device to the microphone will also be transmitted to the microphone by the USB receiver.

[0027] Users can use computer equipment and microphones to perform karaoke. The user selects a song to play on the computer equipment, which then plays the selected song or its accompaniment. The user sings along with the song or accompaniment, and the microphone captures the user's voice, which is then sent to the computer equipment. The computer equipment then synthesizes the user's voice and the accompaniment and outputs the result.

[0028] The following is combined Figure 1 The network framework described herein is used to describe the microphone sound effect control method in the embodiments of this application:

[0029] Please see Figure 2 One embodiment of the microphone sound effect control method in this application includes:

[0030] 201. Establish a connection with the microphone and obtain a list of sound effects sent by the microphone. The list of sound effects is used to record multiple sound effects and the sound effect information of each sound effect.

[0031] The method of this embodiment can be applied to the aforementioned computer device. The computer device can obtain a list of sound effects transmitted by the microphone based on a communication connection with the microphone. This list of sound effects records various sound effects and the sound effect information for each sound effect. This sound effect information can be any information about the sound effect, such as the name, type, microphone manufacturer, etc.

[0032] 202. Display the sound effect list on the interface, and display the various sound effects and sound effect information for each sound effect in the sound effect list;

[0033] After obtaining the sound effect list, the computer device can display the sound effect list on the interface, and display various sound effects and sound effect information for each sound effect, so that users can understand the specific information of various sound effects and make a selection.

[0034] 203. Receive the user's selection operation for a target sound effect from the sound effect list, wherein the target sound effect is any one of the multiple sound effects;

[0035] After displaying various sound effects and their specific information, users can select the sound effect they are interested in on the interface. The computer device can then receive the user's selection and confirm that the user has chosen the desired sound effect.

[0036] 204. Send the user's sound effect selection operation information to the microphone, so that the microphone determines that the user has selected the target sound effect according to the sound effect selection operation information, and processes the target sound effect according to the sound effect information of the target sound effect;

[0037] After the computer device determines that the user has selected a target sound effect, it sends the user's sound effect selection operation information to the microphone. This sound effect selection operation information indicates which sound effect in the sound effect list the user has selected. The microphone then determines that the user has selected the target sound effect based on this sound effect selection operation information, and processes the target sound effect according to the sound effect information of the target sound effect.

[0038] Specifically, the microphone can process the vocal audio data it captures based on its built-in processing program, according to the user's selected target sound effect, so that the user's singing can be presented according to the target sound effect. For example, if the user selects a concert sound effect, their singing will be processed to have a concert sound effect.

[0039] In this embodiment, the computer device can obtain a list of sound effects transmitted by the microphone and display it for the user to select the target sound effect they are interested in. The computer device then sends the user's sound effect selection information to the microphone, which determines that the user has selected the target sound effect based on this information and processes it. Therefore, the computer device does not need to adapt to the configuration requirements of various microphone manufacturers' SDKs; it only needs to obtain the sound effect lists provided by various microphones and display them to the user for selection, and then the microphone processes the selected target sound effect. This reduces the workload of developers in writing code and allows the computer device to be compatible with microphones provided by various manufacturers.

[0040] The following will be discussed in the preceding text. Figure 2 Based on the illustrated embodiments, embodiments of this application will be described in further detail. Please refer to [link to relevant documentation]. Figure 3 Another embodiment of the microphone sound effect control method in this application includes:

[0041] 301. Establish a connection with the microphone and obtain a list of sound effects sent by the microphone, wherein the list of sound effects is used to record multiple sound effects and sound effect information for each sound effect;

[0042] In this embodiment, the computer device can install karaoke software, which can be pre-configured with an AudioCompat component. This AudioCompat component is an instance class that includes an interface layer (ApiInterface), a proxy layer (ApiInterfaceProxy), and a server layer (ApiInterfaceProxyService). The interface layer (ApiInterface) is used to define the interface functions between the proxy layer and the server layer.

[0043] like Figure 4As shown, the computer device's operating system has the Karaoke app (karaoke software) installed. This operating system can be Android, iOS, Linux, etc. The karaoke software is configured with the AudioCompat component, which includes the interface layer ApiInterface, the interface proxy ApiInterfaceProxy, and the interface server ApiInterfaceProxyService. For example, when the operating system is Android, the proxy and server can interact based on the AIDL language. Furthermore, the server's functionality can be divided into two parts: AudioReceiver and AudioOutput. The AudioReceiver is responsible for receiving the human voice PCM (Pulse Code Modulation) data collected by the microphone, and the AudioOutput is responsible for outputting the accompaniment PCM data.

[0044] AIDL, or Android Interface Definition Language, is used by Android to expose service interfaces so that other processes can also access the services provided by this process. It defines the services that this process can provide to other processes, that is, it defines some methods that other processes can call through RPC (Remote Procedure Call) to obtain services.

[0045] Therefore, after the karaoke software is installed, the computer device can load the AudioCompat component and establish a connection between the server in the AudioCompat component and the microphone, and call the server to receive the list of sound effects sent by the microphone.

[0046] 302. Display the sound effect list on the interface, and display the various sound effects and sound effect information for each sound effect in the sound effect list;

[0047] like Figure 5 As shown, the computer device can display a sound effects settings interface, showing various sound effects and their corresponding information, such as the sound effect name. The sound effect name can be named according to its type, indicating the type of sound effect, such as TV sound effect, theater sound effect, concert sound effect, or recording studio sound effect, etc. In addition to displaying the sound effect name, other information can also be shown, such as the characteristics of the sound effect, its applicable scenarios, and other feature-related information, to help users identify and make informed choices.

[0048] In this embodiment, the sound effect list may further include an extended sound effect field for each sound effect. This extended sound effect field can be any field set by the microphone manufacturer to describe the sound effect. For example, the field value of the extended sound effect field may include a sound effect image link, which contains a display image corresponding to the sound effect. Therefore, when displaying various sound effects in the sound effect list, in addition to displaying the name of the sound effect, the display image corresponding to the sound effect can also be displayed based on the sound effect image link, making it easier for users to select the sound effect they are interested in based on the sound effect image.

[0049] 303. Receive the user's selection operation for a target sound effect from the sound effect list, wherein the target sound effect is any one of the multiple sound effects;

[0050] After displaying multiple sound effects, users can click to select a target sound effect in the sound effect settings interface. The computer device will then determine the target sound effect selected by the user based on the user's selection.

[0051] Specifically, the computer device can call the agent in the AudioCompat component to receive the user's selection operation of the target sound effect in the sound effect list, and then the agent sends the user's sound effect selection operation information to the server in the AudioCompat component, that is, the agent notifies the server that the user has selected the target sound effect.

[0052] 304. Send the user's sound effect selection operation information to the microphone, so that the microphone determines that the user has selected the target sound effect according to the sound effect selection operation information, and processes the target sound effect according to the sound effect information of the target sound effect;

[0053] After receiving the user's sound effect selection information, the proxy end calls the interface function between the proxy end and the server end defined in the interface layer of the AudioCompat component to send the user's sound effect selection information to the server end. Then, the server end calls the user's sound effect selection information to send the user's sound effect selection information to the microphone end, so that the microphone end can determine the target sound effect selected by the user based on the sound effect selection information, and then process the target sound effect based on the sound effect information of the target sound effect.

[0054] The sound effect selection operation information indicates the target sound effect selected by the user. Specifically, the sound effect selection operation information can describe which row and column of the sound effect the user selected, or it can directly describe the name of the sound effect selected by the user. The microphone can then determine the sound effect selected by the user based on the content described in the sound effect selection operation information.

[0055] 305. Use the AudioCompat component to output the synthesized backing vocals data;

[0056] In this embodiment, the computer device further includes a data processing layer connected to the interface layer in the AudioCompat component for processing audio data. For example, ... Figure 4 As shown, the data processing layer includes various data processing operations such as decoder, save, pitch, and score, which can perform the above processing on audio data sent by the interface layer or audio data sent to the interface layer.

[0057] When processing the target audio effect, the AudioCompat component can be used to output the backing vocal synthesis data. Specifically, the steps for the AudioCompat component to output the backing vocal synthesis data include: the server receives the microphone and processes the collected vocal audio data according to the target audio effect to obtain the audio effect data; the proxy sends the song's backing vocal data to the server based on the interface functions defined in the interface layer between the proxy and the server; the server synthesizes the backing vocal data and the audio effect data to obtain the backing vocal synthesis data, and outputs it.

[0058] Specifically, such as Figure 4 As shown, the server includes an AudioReceiver module and an AudioOutput module. The AudioReceiver module is used to receive the audio effect data obtained by the microphone processing the collected human voice audio data according to the target audio effect; the AudioOutput module is used to output the accompaniment human voice synthesis data to the system driver.

[0059] For example, Figure 6 For based on Figure 4 The data processing flow executed by the AudioCompat component shown is as follows: the microphone collects human voice audio data, processes the human voice audio data according to the target sound effect selected by the user, and obtains sound effect data. The proxy then sends the accompaniment data of the song to the server based on the interface function between the proxy and the server defined in the interface layer. The server then synthesizes the sound effect data and the accompaniment data of the song to obtain the accompaniment human voice synthesis data.

[0060] The microphone processes the collected human voice audio data to obtain sound effect data based on the target sound effect. There are several methods for this. One method is through chip processing within the microphone's USB hardware dongle. Besides the microphone processing the human voice audio data according to the target sound effect, the microphone manufacturer can also process the data in the driver layer or hardware adaptation layer (HAL) software of the system software. This system can be an operating system such as Android or iOS.

[0061] The HAL (Hardware Adapter Layer) is present in modern operating systems such as Android, Windows, iOS, and Firefox. The HAL can encapsulate hardware operations and provide a unified Application Programming Interface (API) to the Framework Layer.

[0062] The microphone sound effect control method in the embodiments of this application has been described above. The computer device in the embodiments of this application is described below. One embodiment of the computer device in this application includes:

[0063] A connection unit is used to establish a connection with a microphone and obtain a list of sound effects sent by the microphone. The list of sound effects is used to record multiple sound effects and sound effect information for each sound effect.

[0064] The display unit is used to display the sound effect list on the interface, and to display the various sound effects and sound effect information of each sound effect in the sound effect list;

[0065] A receiving unit is configured to receive a user's selection operation for a target sound effect in the sound effect list, wherein the target sound effect is any one of the multiple sound effects;

[0066] The transmitting unit is used to transmit user sound effect selection operation information to the microphone. The sound effect selection operation information indicates that the user has selected the target sound effect, so that the microphone determines that the user has selected the target sound effect based on the sound effect selection operation information, and processes the target sound effect based on the sound effect information of the target sound effect.

[0067] In a preferred embodiment of this example, the connection unit is specifically used to load the AudioCompat component, which includes an interface layer, a proxy end of the implementation layer, and a server end of the implementation layer; establish a connection between the server end and the microphone, and call the server end to receive the sound effect list sent by the microphone.

[0068] In a preferred embodiment of this example, the interface layer is used to define the interface functions between the proxy and the server.

[0069] The receiving unit is specifically used to call the agent to receive the user's selection operation of the target sound effect in the sound effect list;

[0070] The sending unit is specifically used to call the proxy to send the user's sound effect selection operation information to the server based on the interface function defined in the interface layer between the proxy and the server; and to call the server to send the user's sound effect selection operation information to the microphone.

[0071] In a preferred embodiment of this invention, the computer device further includes a data processing layer;

[0072] The steps for the AudioCompat component to output the synthesized backing vocal data include:

[0073] The server receives sound effect data obtained by processing the collected human voice audio data according to the target sound effect from the microphone;

[0074] The proxy sends the accompaniment data of the song to the server based on the interface function between the proxy and the server defined in the interface layer;

[0075] The server synthesizes the sound effect data and the accompaniment data to obtain the synthesized vocal data for the accompaniment, and then outputs it.

[0076] In a preferred embodiment of this example, the server includes an AudioReceiver module and an AudioOutput module. The AudioReceiver module is used to receive sound effect data obtained by the microphone processing the collected human voice audio data according to the target sound effect.

[0077] The AudioOutput module is used to output the synthesized vocal data for the accompaniment.

[0078] In a preferred embodiment of this example, the sending unit is specifically used to call the agent to send the user's sound effect selection operation information to the server based on the Android Interface Definition Language (AIDL).

[0079] In a preferred embodiment of this example, the sound effect list further includes a sound effect extension field for each sound effect, and the field value of the sound effect extension field includes a sound effect image link;

[0080] The display unit is specifically used to display the sound effect name of each sound effect in the sound effect list, and to display the corresponding display image of the sound effect according to the sound effect image link.

[0081] In a preferred embodiment of this invention, the microphone processes the target sound effect based on the sound effect information of the target sound effect at the driver layer or hardware adaptation layer (HAL) of the system software; or, the microphone processes the target sound effect based on the sound effect information of the target sound effect using a USB hardware dongle.

[0082] The computer device in the embodiments of this application is described below. Please refer to [link / reference]. Figure 7 One embodiment of the computer device in this application includes:

[0083] The computer device 700 may include one or more central processing units (CPUs) 701 and a memory 705, in which one or more applications or data are stored.

[0084] The memory 705 can be volatile or persistent storage. The program stored in the memory 705 can include one or more modules, each module including a series of instruction operations on the computer device. Furthermore, the central processing unit 701 can be configured to communicate with the memory 705 and execute the series of instruction operations stored in the memory 705 on the computer device 700.

[0085] The computer device 700 may also include one or more power supplies 702, one or more wired or wireless network interfaces 703, one or more input / output interfaces 704, and / or one or more operating systems, such as Windows Server™, MacOSX™, Unix™, Linux™, FreeBSD™, etc.

[0086] The central processing unit 701 can perform the aforementioned... Figures 1 to 2 The specific operations performed by the computer device in the illustrated embodiment will not be described in detail here.

[0087] This application also provides a computer storage medium, one embodiment of which includes: the computer storage medium storing instructions, which, when executed on a computer, cause the computer to perform the aforementioned... Figures 1 to 2 The operations performed by the computer device in the illustrated embodiment.

[0088] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0089] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between apparatuses or units through some interfaces, and may be electrical, mechanical, or other forms.

[0090] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0091] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0092] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A microphone sound effect control method, characterized in that, The method is applied to a computer device, and the method includes: Establish a connection with the microphone and obtain a list of sound effects sent by the microphone. The list of sound effects is used to record multiple sound effects and the sound effect information of each sound effect. The interface displays the sound effect list, and the sound effect list displays the various sound effects and the sound effect information for each sound effect; The system receives a user's selection of a target sound effect from the sound effect list, where the target sound effect is any one of the various sound effects. The microphone sends user sound effect selection operation information, which indicates that the user has selected the target sound effect, so that the microphone determines that the user has selected the target sound effect based on the sound effect selection operation information, and processes the target sound effect based on the sound effect information of the target sound effect; The sound effect list also includes an extended sound effect field for each sound effect, and the field value of the extended sound effect field includes a sound effect image link; The display of the various sound effects and sound effect information for each sound effect in the sound effect list includes: The sound effect list displays the name of each sound effect, and displays the corresponding image based on the sound effect image link.

2. The method according to claim 1, characterized in that, The process of establishing a connection with the microphone and obtaining a list of sound effects transmitted by the microphone includes: Load the AudioCompat component, which includes an interface layer, a proxy for the implementation layer, and a server for the implementation layer. Establish a connection between the server and the microphone, and call the server to receive the list of sound effects sent by the microphone.

3. The method according to claim 2, characterized in that, The interface layer is used to define the interface functions between the proxy and the server. The process of receiving a user's selection of a target sound effect from the sound effect list includes: The agent is invoked to receive the user's selection of the target sound effect from the sound effect list; Sending the user's sound effect selection information to the microphone includes: Based on the interface functions defined in the interface layer between the proxy and the server, the proxy is called to send the user's sound effect selection operation information to the server; The server is invoked to send the user's sound effect selection information to the microphone.

4. The method according to claim 3, characterized in that, The computer device also includes a data processing layer; The steps for the AudioCompat component to output the synthesized backing vocal data include: The server receives sound effect data obtained by processing the collected human voice audio data according to the target sound effect from the microphone; The proxy sends the accompaniment data of the song to the server based on the interface function between the proxy and the server defined in the interface layer; The server synthesizes the sound effect data and the accompaniment data to obtain the synthesized vocal data for the accompaniment, and then outputs it.

5. The method according to claim 4, characterized in that, The server includes an AudioReceiver module and an AudioOutput module. The AudioReceiver module is used to receive sound effect data obtained by the microphone processing the collected human voice audio data according to the target sound effect. The AudioOutput module is used to output the synthesized vocal data for the accompaniment.

6. The method according to claim 3, characterized in that, The step of sending the user's sound effect selection information from the proxy to the server includes: The proxy client sends the user's sound effect selection information to the server based on the Android Interface Definition Language (AIDL).

7. The method according to claim 1, characterized in that, The microphone processes the target sound effect based on the sound effect information of the target sound effect at the driver layer or hardware adaptation layer (HAL) of the system software; or, the microphone processes the target sound effect based on the sound effect information of the target sound effect using a USB hardware dongle.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the method as described in any one of claims 1 to 7.

9. A computer storage medium, characterized in that, The computer storage medium stores instructions that, when executed on the computer, cause the computer to perform the method as described in any one of claims 1 to 7.

Images