Wireless playing musical instrument sound box and intelligent sound effect adjusting method and system

Abstract

The invention discloses a wireless playing musical instrument sound box and an intelligent sound effect adjusting method and system. The sound box comprises a sound box body, and the sound box body comprises a neck hanging part and sound box parts arranged at the two ends of the neck hanging part; a loudspeaker module, a main control board, a wireless transceiving module and a power supply module are arranged in the sound box part; the power supply module is electrically connected with the main control board, the loudspeaker module and the wireless transceiver module, and the loudspeaker module and the wireless transceiver module are respectively and electrically connected with the main control board; the main control board is in communication connection with an external playing musical instrument through the wireless transceiver module and is used for acquiring an audio signal of the external playing musical instrument, performing timbre and sound effect processing on the audio signal and outputting the audio signal to the loudspeaker module so as to drive the loudspeaker module to play the audio signal. The problems of high delay, poor sound effect and the like during playing of an existing musical instrument can be solved.

Description

Technical Field

[0001] The present invention relates to the field of musical instrument electronic devices, and in particular to a wireless performance musical instrument speaker, an intelligent sound effect adjustment method and system. Background Art

[0002] Traditional musical instrument speakers such as guitars are inconvenient to move due to their large volume and need to be used at a fixed specific position. At the same time, their tone adjustment relies on physical buttons and cannot switch multiple sound effects in real time. At the same time, existing musical instrument speakers generally use Bluetooth to connect to musical instruments, resulting in problems such as high latency and large sound quality loss, and it is difficult to be applicable to professional performance scenarios, bringing a bad user experience to users. Summary of the Invention

[0003] In order to overcome the deficiencies of the prior art, one of the purposes of the present invention is to provide a wireless performance musical instrument speaker to solve the problems of high latency and large sound quality loss in existing performance speakers, which lead to a poor user experience.

[0004] Another purpose of the present invention is to provide an intelligent sound effect method for a wireless performance musical instrument speaker to solve the problems of high latency and large sound quality loss in existing performance speakers, resulting in a poor performance experience.

[0005] The third purpose of the present invention is to provide an intelligent sound effect system for a wireless performance musical instrument speaker to solve the problems of high latency and large sound quality loss in existing performance speakers, resulting in a poor performance experience.

[0006] The first purpose of the present invention is achieved by adopting the following technical solution:

[0007] A wireless performance musical instrument speaker, the wireless performance musical instrument speaker includes a speaker body, and the speaker body includes a neck hanging part and sound parts provided at both ends of the neck hanging part;

[0008] The sound part is provided with a speaker module, a main control board, a wireless transceiver module and a power supply module; the power supply module is electrically connected to the main control board, the speaker module and the wireless transceiver module, and the speaker module and the wireless transceiver module are respectively electrically connected to the main control board;

[0009] The main control board is communicatively connected to an external performance musical instrument through the wireless transceiver module, and is configured to obtain an audio signal of the external performance musical instrument, perform sound effect processing on the audio signal, and then output the audio signal to the speaker module to drive the speaker module to play the audio signal.

[0010] Further, the audio unit includes a housing; the housing includes a base and a cover plate mounted on the base, and a cavity is formed between the base and the cover plate; the speaker module includes a first speaker module and a second speaker module; a first speaker module, a main control board, and a wireless transceiver module are provided in the cavity of one audio unit, and a second speaker module and a power supply module are provided in the cavity of the other audio unit; the main control board is electrically connected to the first speaker module and the wireless transceiver module;

[0011] Corresponding wires are provided in the neckband portion; by mounting the two audio units at both ends of the neckband portion, the power supply module is electrically connected to the main control board and the wireless transceiver module through the corresponding wires; the main control board is electrically connected to the second speaker module through the corresponding wires.

[0012] Further, a power supply installation groove and a first speaker module installation groove are provided in the base of one audio unit, the power supply module is provided in the power supply installation groove, and the second speaker module is provided in the second speaker module installation groove; a main control board installation groove and a second speaker module installation groove are provided in the base of the other audio unit, the main control board is provided in the main control board installation groove, and the second speaker module is provided in the second speaker module installation groove; the wireless transceiver module is provided above the main control board; sound outlet holes are provided on the audio unit, and the sound outlet holes correspond to the speaker modules in the cavity;

[0013] Both the first speaker module and the second speaker module include a full-frequency speaker and a passive diaphragm speaker; both the first speaker module installation groove and the second speaker module installation groove include a full-frequency speaker installation groove and a passive diaphragm speaker installation groove, the full-frequency speaker of the first speaker module is provided in the corresponding full-frequency speaker installation groove, the passive diaphragm speaker is provided in the corresponding passive diaphragm speaker installation groove, the full-frequency speaker of the second speaker module is provided in the corresponding full-frequency speaker installation groove, and the passive diaphragm speaker is provided in the corresponding passive diaphragm speaker installation groove;

[0014] A touch panel and physical buttons are further installed on the housing of the audio unit provided with the main control board, and the touch panel and the physical buttons are respectively electrically connected to the main control board.

[0015] Further, the two audio units are detachably connected to both ends of the neckband portion, first connection ports are provided on both end faces of the neckband portion, and second connection ports are provided on the end faces of the audio units connected to the neckband portion; when the two audio units are respectively installed and in contact with both ends of the neckband portion, the first connection port is electrically connected to the second connection port;

[0016] The neckband portion and the sound units at both ends of the neckband portion form a U-shaped structure, and the housing of the neckband portion is a shape memory alloy skeleton, and a silica gel coating layer is provided outside the shape memory alloy skeleton; the housing of the sound unit is made of carbon fiber composite material, aluminum alloy, ABS and PC materials.

[0017] Further, the main control board includes an audio processing unit; the audio processing unit includes a DSP module, an FPGA module and a radio frequency modulation module;

[0018] One end of the radio frequency modulation module is communicatively connected to the wireless transceiver of the external musical instrument through the wireless transceiver module, and the other end is electrically connected to the FPGA module, and is configured to obtain the radio frequency signal of the wireless transceiver through the wireless transceiver module, decode the radio frequency signal, perform analog-to-digital conversion into a digital audio signal, and send the digital audio signal to the FPGA module for caching;

[0019] The FPGA module is also electrically connected to the DSP module, and is configured to sequentially send the cached digital audio signals to the DSP module according to the reception timing;

[0020] The DSP module is electrically connected to the speaker module, and is configured to match the IR cabinet head file from the system according to the type of the external musical instrument and the preset sound effect configuration parameters, and use a convolutional neural network model to load the corresponding IR cabinet head file for the audio signal to perform timbre simulation on the corresponding digital audio signal, and perform spatial sound effect processing on the corresponding digital audio signal according to the HRTF algorithm, and send the processed corresponding digital audio signal to the speaker module for playback; performing spatial sound effect processing on the audio signal includes simulating the audio signal into stereo or simulating the audio signal into surround sound.

[0021] Further, the main control board further includes a Bluetooth communication module; the audio processing unit is also communicatively connected to an external terminal APP through the Bluetooth communication module, and is configured to obtain the sound effect configuration parameters sent by the external terminal APP through the Bluetooth communication module, and further update the preset sound effect configuration parameters according to the sound effect configuration parameters; and synchronously upload the generated audio signal to the external terminal APP through the Bluetooth communication module for display;

[0022] The main control board further includes a zero-crossing detection module, and the zero-crossing detection module is disposed between the radio frequency modulation module and the FPGA module, and is configured to filter the corresponding digital audio signal;

[0023] A sensor is also provided inside the audio unit; the sensor includes a six-axis IMU sensor, a pressure sensor, and a distance sensor; the main control board further includes an MCU module, and the MCU module is electrically connected to the six-axis IMU sensor, the pressure sensor, and the distance sensor; the MCU module is configured to obtain the user's head movement data based on the monitoring data of the six-axis IMU sensor, obtain the fitting degree level between the device and the user's neck according to the monitoring data of the pressure sensor, and obtain the distance between the device and the user's ear according to the monitoring data of the distance sensor; the MCU module is electrically connected to the DSP module and is configured to provide the DSP module with the user's head movement data, the fitting degree level between the device and the user's neck, and the distance between the device and the user's head, so that the DSP module can adaptively adjust the parameters of the HRTF algorithm according to the user's head movement data to further adjust the spatial sound effect rendering effect, adaptively adjust the EQ compensation parameters according to the fitting degree level between the device and the user's neck, and adaptively adjust the audio output mode according to the distance between the device and the user's ear.

[0024] Further, the DSP module is further configured to perform dynamic frequency division on the corresponding digital audio signal to obtain multiple segmented frequency division signals, and respectively load the corresponding IR cabinet head file for each segmented frequency division signal by using a convolutional neural network model to perform timbre simulation on each segmented frequency division signal, and perform spatial sound effect processing on each segmented frequency division signal according to the HRTF algorithm, and then merge the multiple segmented frequency division signals and send them to the speaker module.

[0025] The second object of the present invention is achieved by the following technical solution:

[0026] An intelligent sound effect adjustment method for a wireless performance instrument speaker, which is applied to a wireless performance instrument speaker adopted in the first object of the present invention, and the intelligent sound effect adjustment method includes:

[0027] Audio acquisition step: acquiring an audio signal played by an external instrument, decoding and performing analog-to-digital conversion on the audio signal to obtain a digital audio signal, and caching the digital audio signal according to the reception timing.

[0028] Audio processing step: first obtaining an IR cabinet head file from the system according to the instrument type of the external instrument and preset sound effect configuration parameters, and sequentially loading the IR cabinet head file for each digital audio signal by using a convolutional neural network model to perform timbre simulation on the corresponding digital audio signal; then performing spatial sound effect simulation on the digital audio signal with timbre simulation according to the HRTF algorithm.

[0029] Playback step: sending the digital audio signal obtained after spatial sound effect simulation to the speaker module of the wireless performance instrument speaker for synchronous playback.

[0030] Further, it further includes:

[0031] Parameter configuration steps: Obtain the tone configuration parameters sent by the external terminal APP, and then update the preset sound effect configuration parameters according to the tone configuration parameters;

[0032] Data synchronization steps: Upload the digital audio signal simulated by the spatial sound effect to the external terminal APP;

[0033] The specific audio processing steps include: First, obtain the IR cabinet head file from the system according to the instrument type of the external instrument and the preset sound effect configuration parameters, and perform dynamic frequency division on the corresponding digital audio signal to obtain multiple frequency division signals; Then, load the IR cabinet head file for each frequency division signal according to the convolutional neural network model to simulate the tone of each frequency division signal; Finally, perform spatial sound effect simulation on each frequency division signal after tone simulation according to the HRTF algorithm.

[0034] The third object of the present invention is achieved by adopting the following technical solution:

[0035] An intelligent sound effect adjustment system for a wireless performance instrument speaker, the intelligent sound system includes a wireless performance instrument speaker, a wireless transceiver and an external terminal APP as adopted in the first object of the present invention; wherein, the wireless transceiver module of the wireless performance instrument speaker is communicatively connected to the wireless transceiver, and the wireless transceiver is electrically connected to the external performance instrument; the wireless performance instrument speaker is communicatively connected to the external terminal APP through Bluetooth.

[0036] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0037] The present invention adopts a neck-worn wireless performance instrument speaker, which is convenient to wear and carry; at the same time, the present invention also uses wireless signals to realize data communication between the speaker and the instrument, reducing the delay of signal transmission, having good sound quality, and being more suitable for professional performance scenarios; at the same time, intelligent sound effect adjustment is performed on the collected audio signal, making the played audio more three-dimensional and surround-sounding, providing the user with an immersive performance experience and improving the usage experience. Description of the Drawings

[0038] Figure 1 It is a schematic diagram of the overall structure of a wireless performance instrument speaker provided by the present invention;

[0039] Figure 2 is Figure 1 a side view of the wireless performance instrument speaker in

[0040] Figure 3 is Figure 1 a schematic diagram of the internal structure of the wireless performance instrument speaker in

[0041] Figure 4It is a module diagram of the intelligent sound effect system of a wireless performance instrument speaker provided by the present invention.

[0042] In the figure: 1. Neck-hanging part; 2. First speaker part; 3. Second speaker part; 4. Sound outlet hole; 51. Full-range speaker; 52. Passive diaphragm speaker; 511. Full-range speaker mounting groove; 521. Passive diaphragm speaker mounting groove; 6. Power supply module; 61. Power supply module mounting groove; 7. Physical button; 71. Button mounting groove; 8. Main control board; 81. Main control board mounting groove. Detailed implementation manners

[0043] Next, in combination with the accompanying drawings and specific implementation manners, the present invention will be further described. It should be noted that, on the premise of no conflict, the following described embodiments or technical features can be arbitrarily combined with each other to form new embodiments.

[0044] Embodiment 1

[0045] Based on the defects existing in the existing speakers for musical instrument performance, the present invention provides a wireless performance instrument speaker. By combining wireless audio transmission technology and digital sound effect processing technology and adopting a neck-hanging design, this speaker can provide a more portable musical instrument performance experience for users, giving users a better use experience. At the same time, it also combines the wireless control of the intelligent terminal APP to realize the diversity of tone adjustment and meet the diverse needs of users.

[0046] Specifically, as Figures 1 - 3 shown, the present invention provides a preferred embodiment, a wireless performance instrument speaker, including a speaker body. Among them, the speaker body includes a neck-hanging part 1 and speaker parts provided at both ends of the neck-hanging part 1.

[0047] More specifically, the neck-hanging part 1 and the two speaker parts form a U-shaped structure, which is convenient for users to hang on the neck for use. The present invention adopts a neck-hanging design, which is convenient to wear. At the same time, the speaker of the present invention adopts a lightweight structure design, bringing a more comfortable wearing feeling to users. Specifically, the shell of the neck-hanging part 1 is a memory alloy skeleton, and a silica gel coating layer is provided outside the memory alloy skeleton; the shell of the speaker part is made of carbon fiber composite material, aluminum alloy and ABS+PC material, and adopts an ergonomic structure design, with the characteristic of comfortable wearing.

[0048] Furthermore, a speaker module, a main control board 8, a wireless transceiver module, and a power supply module 6 are provided inside the sound section. Among them, the power supply module 6 is electrically connected to the main control board 8, the wireless transceiver module, and the speaker module, and is used to provide a power supply for the main control board 8, the wireless transceiver module, and the speaker module. The power supply module 6 in the present invention is used to provide power for the entire wireless musical instrument speaker. Specifically, the power supply module 6 includes a battery pack, and the battery pack is implemented by a lithium polymer battery pack. The power supply module 6 can support fast charging and reverse power supply at the same time. For example, when the wireless transceiver needs to be charged, it can be electrically connected to the wireless transceiver to charge the wireless transceiver.

[0049] In addition, the power supply module 6 not only includes a battery pack, but also includes a power management chip, which is used to realize the charging and discharging of the battery pack through the power management chip, so as to optimize the power consumption of the battery pack, thereby extending the battery life of the battery pack. Specifically, the present invention can support a continuous battery life of 8 hours, meeting the battery life requirements for musical instrument performances in most scenarios.

[0050] More preferably, a charging and discharging input / output port is also provided on the housing of the sound section, which is used to charge the battery pack in the power supply module 6 and discharge the battery pack.

[0051] Furthermore, the speaker module and the wireless transceiver module are respectively electrically connected to the main control board 8. Specifically, the main control board 8 is communicatively connected to an external musical instrument through the wireless transceiver module, and is used to obtain the audio signal of the external musical instrument, perform sound effect processing on the audio signal, and then output the audio signal to the speaker module to drive the speaker module to play the audio signal. In actual use, by connecting a wireless transceiver used in conjunction with the wireless transceiver module to an external musical instrument, in this way, by connecting the wireless transceiver module to the wireless transceiver, the connection between the main control board 8 and the external musical instrument is realized, and the acquisition of the audio signal of the external musical instrument is realized. More specifically, the wireless transceiver in this embodiment adopts a wireless transmission scheme with a 6.5 mm interface, and based on a 2.4 GHz proprietary protocol, it realizes ultra-low latency audio transmission. By adopting a customized radio frequency protocol, low-latency audio transmission can be provided to ensure the stable sound quality of the external musical instrument.

[0052] More preferably, the sound section includes a housing, and the housing includes a base and a cover plate mounted on the base. A cavity is formed between the base and the cover plate for accommodating each module inside the sound section. Specifically, the speaker module includes a first speaker module and a second speaker module, which are respectively arranged in two sound sections.

[0053] More specifically, the two sound sections in this embodiment are respectively denoted as the first sound section 2 and the second sound section 3, which are respectively arranged at the left and right ends of the hanging neck part 1 and form a U-shaped structure with the hanging neck part 1. As Figure 2As shown, the first sound unit 2 is provided with a first speaker module, a main control board 8, and a wireless transceiver module. The cavity of the second sound unit 3 is provided with a second speaker module and a power supply module 6. By evenly distributing each module in the two sound units, the weights of the two sound units can be ensured to be uniform, making the wearing more comfortable.

[0054] More preferably, the main control board 8 provided in the first sound unit 2 is electrically connected to the first speaker module and the wireless transceiver module. At the same time, a wire is provided inside the neckband 1 to electrically connect the main control board 8 provided in the first sound unit 2 to the second speaker module and the power supply module 6 provided in the second sound unit 3. At the same time, the power supply module 6 provided in the second sound unit 3 is also electrically connected to the second speaker module.

[0055] More preferably, the neckband 1 and the sound unit in this embodiment are also connected in a detachable manner, which further facilitates the user to wear, such as by magnetic attraction, plug-in, etc. When the neckband 1 and the sound unit are detachable, connection ports that can be matched and connected are provided on the end faces where the neckband 1 and the sound unit are in contact. Specifically, first connection ports are respectively provided on the two end faces of the neckband 1, and a second connection port is provided on the end face where the sound unit is connected to the neckband 1. When the two sound units are respectively installed and in contact with the two ends of the neckband 1, the first connection port and the second connection port are electrically connected to realize the electrical connection between the various modules in the sound unit.

[0056] More preferably, a power supply module installation groove 61 and a first speaker module installation groove are provided in the base of the first sound unit 2. The power supply module 6 is provided in the power supply module installation groove 61, and the second speaker module is provided in the first speaker module installation groove. A main control board installation groove 81 and a second speaker module installation groove are provided in the base of the second sound unit 3. The main control board 8 is provided in the main control board installation groove 81, and the second speaker module is provided in the second speaker module installation groove. The wireless transceiver module is provided above the main control board 8.

[0057] In addition, sound output holes 4 are provided on both the first sound unit 2 and the second sound unit 3, and the sound output holes 4 correspond to the speaker modules in the cavity to ensure that sound can spread naturally and improve the user's auditory experience.

[0058] Furthermore, both the first speaker module and the second speaker module include a full-frequency speaker 51 and a passive diaphragm speaker 52. The first speaker module installation groove and the second speaker module installation groove both include a full-frequency speaker installation groove 511 and a passive diaphragm speaker installation groove 521. The full-frequency speaker 51 of the first speaker module is provided in the corresponding full-frequency speaker installation groove 511, and the passive diaphragm speaker 52 is provided in the corresponding passive diaphragm speaker installation groove 521. The full-frequency speaker 51 of the second speaker module is provided in the corresponding full-frequency speaker installation groove 511, and the passive diaphragm speaker 52 is provided in the corresponding passive diaphragm speaker installation groove 521.

[0059] Inside each audio unit, a full-range speaker 51 and a passive diaphragm speaker 52 are provided. The full-range speaker 51 and the passive diaphragm speaker 52 are designed with a front-to-back spacing, optimizing the transmission of sound effects and making the sound quality more rich and three-dimensional. This front-to-back staggered speaker layout can optimize the directivity, layering and surround sense of sound. For example, a full-range speaker 51 is placed in the front to face the ears, improving clarity and enhancing the performance of vocals and melody lines; then a passive diaphragm speaker 52 (Passive Radiator) is equipped behind the full-range speaker 51 unit to optimize the bass response.

[0060] The speaker module generates a 3D sound field effect by setting four small speaker speakers, and can also use the VBAP (Vector-Based Amplitude Panning) method to calculate the optimal speaker gain.

[0061] Preferably, the main control board 8 includes an audio processing unit. Among them, the audio processing unit includes a DSP (Digital Signal Processing) module, an FPGA (Field Programmable Gate Array) module and a radio frequency modulation module.

[0062] Specifically, the radio frequency modulation module is electrically connected to the wireless transceiver module and electrically connected to the FPGA module through the I2S interface. The radio frequency modulation module is used to receive the radio frequency signal sent by the external playing instrument through the wireless transceiver through the transceiver module, demodulate it into a digital audio signal (such as a PCM stream), and transmit the demodulated digital audio signal to the FPGA module through the I2S interface.

[0063] The FPGA module is used to cache the received digital audio signal and sequentially send the digital audio signal to the DSP module in frames according to the reception timing. The FPGA module caches the audio signal through a double-buffering technique to ensure data non-loss; at the same time, it sequentially sends the digital audio signal to the DSP module in frames according to the reception timing to ensure data synchronization.

[0064] The DSP module is used to match the IR (impulse responses) cabinet head file according to the instrument type and the preset sound effect configuration parameters, and load the IR cabinet head file for the corresponding digital audio signal based on the convolutional neural network model to generate the corresponding impulse response; finally, perform spatial sound effect rendering on the corresponding digital audio signal through the HRTF (Head Related Transfer Function) algorithm and output it to the speaker module for playback. Among them, the spatial sound effect rendering includes stereo rendering and surround sound rendering.

[0065] Among them, the preset sound effect configuration parameters include: basic parameters (gain, EQ (Equalizer)), effects parameters (reverb, delay), and algorithm parameters (IR file, HRTF coefficient). These preset sound effect configuration parameters can be associated and called through preset modes (such as "Jazz Mode") and the types of musical instruments played.

[0066] In addition, IR cabinet head simulation refers to the impulse response file of the corresponding musical instrument (such as "Fender cabinet").

[0067] By setting the DSP module in the present invention, the timbre of the digital audio signal can be reconstructed through the convolution algorithm according to the IR cabinet head file, the sense of space can be changed by adjusting the value of the reverb time register, EQ regulation can be achieved, and frequency band equalization can be achieved by modifying the FIR filter coefficient. The simulation of the timbre and sound effects of the digital audio signal is realized through the DSP module to ensure better playback effects and bring users an immersive playing experience.

[0068] The present invention can also update the budget sound effect configuration parameters. Specifically, the configuration instructions are sent to the DSP module of the main control board 8 through Bluetooth by an external terminal APP, and the DSP module writes the sound effect configuration parameters in the configuration instructions into the DSP register through the SPI interface to realize dynamic adjustment of the algorithm coefficients.

[0069] Furthermore, in the present invention, a variety of different IR cabinet head files are stored in the system in advance, so as to match the corresponding IR cabinet head file according to the configured sound effect parameters of the user, so as to perform corresponding sound effect processing on the audio signal. Specifically, the IR cabinet head files include, for example, classic cabinet head files (Marshall, Fender, Mesa Boogie), studio microphone simulation cabinet head files (SM57, U87), and spatial reverb cabinet head files (room, stage, reverb hall), etc. By storing the above IR cabinet head files in the wireless musical instrument speaker in advance, the corresponding IR cabinet head file stored in the system can be called through the DSP module for reverb convolution processing, so as to superimpose the effects parameters to realize the sound effect simulation processing of the audio signal.

[0070] Furthermore, the present invention can also achieve customized sound effects for different musical instruments, such as supporting the sound effect adaptation of instruments like guitars and basses. Specifically, it can be achieved through the frequency response curve and dynamic processing parameters. For example, each instrument is associated with an independent frequency response curve (EQ parameter) and dynamic processing curve (compression / limiting parameter). For instance, the bass mode defaults to boosting the low-frequency band of 60 - 120 Hz. In this way, users can customize the curve or select a preset mode (such as "Jazz Bass" or "Metal Guitar") through the external terminal APP, and then perform IR cabinet head model training. Among them, IR cabinet head model training is to collect the impulse responses of instrument speakers of different brands (such as Fender for guitars and Ampeg for basses), and generate high-fidelity tone simulation files, that is, IR cabinet head files, through the GAN model.

[0071] In this way, the DSP module can synchronously load the corresponding IR cabinet head model according to the current instrument type to obtain the corresponding IR cabinet head file, and then generate a digital audio signal according to the IR cabinet head file for processing to obtain the frequency response curve and dynamic processing parameters, realizing end-to-end tone customization output.

[0072] More specifically, when performing cabinet head simulation on the audio signal in this embodiment, the digital audio signal is first dynamically divided into multiple divided-frequency signals. Among them, the divided-frequency signals include low-frequency band signals, mid-frequency band signals, and high-frequency band signals. Among them, the frequency range of the low-frequency band signal is 0 - 200 Hz, the frequency range of the mid-frequency band signal is 200 Hz - 2 kHz, and the frequency range of the high-frequency band signal is above 2 kHz. That is: after the DSP module processes the timbre and spatial sound effects of each divided-frequency signal respectively, the multiple divided-frequency signals are merged and then output to the speaker module.

[0073] Among them, when the DSP module loads the corresponding IR impulse response for each divided-frequency signal according to the selected IR cabinet head file, it is implemented using the following formula:

[0074]

[0075] In the formula: h(t) is the IR model; E i is the i-th effect (such as distortion, delay, trained based on convolutional neural network (CNN), imitating the frequency response curve of a real sound effect processor); t is time; x(t) is the input audio signal; n is the sampling point index.

[0076] The DSP module is also used to perform spatial sound effect processing on each divided-frequency signal after timbre processing through the HRTF algorithm. Among them, the HRTF algorithm refers to the head-related transfer function algorithm, which can simulate each divided-frequency signal to obtain the effect of stereo or surround sound. The formula of the HRTF algorithm is specifically as follows:

[0077]

[0078] Wherein: H j (t) is the HRTF function; m is the number of channels. For example, the number of channels for stereo is 2 channels, and the number of channels for surround sound is 5 channels.

[0079] Specifically, the DSP module separately processes each divided-frequency signal to simulate the perception difference of the ears for sounds in different directions, and then superimposes and synthesizes the processed divided-frequency signals into a full-band signal to ensure frequency response continuity before outputting to the speaker module. The perception difference of the ears for sounds in different directions is simulated by corresponding processing of audio signals in different frequency bands. Specifically, for example, for low-frequency band signals.

[0080] In addition, the spatial sound effect modes in this embodiment include stereo mode and surround sound mode. For example, for the stereo mode: based on the dual-channel HRTF algorithm, the sound image positioning of the left and right speakers is optimized (such as the guitar sound is left-biased and the human voice is centered). For the surround sound mode: on the basis of stereo, an environmental reverberation and sound field diffusion algorithm is added to simulate the multi-channel surround effect (such as the sense of space in a concert hall).

[0081] In addition, the switching of this mode is also obtained from the preset sound effect configuration parameters, and can be specifically implemented through the external terminal APP or the physical button 7, and the default setting is the stereo mode.

[0082] More preferably, when the music is VR / AR music, the Ambisonics algorithm can also be used to replace the HRTF algorithm to achieve more complex spatial sound effect simulation.

[0083] Furthermore, the main control board 8 of this embodiment further includes a Bluetooth communication module. The audio processing unit is also communicatively connected to the mobile terminal AP through the Bluetooth communication module to realize data interaction with the user. Specifically, the user can adjust the sound effect configuration parameters through the mobile terminal APP, such as mode selection, EQ adjustment, IR cabinet head file, reverb / delay, accompaniment volume and other parameter configurations. Once the user updates the sound effect configuration parameters through the mobile terminal APP, the FPGA module will update the preset sound effect configuration parameters, so that the DSP module processes the timbre of the audio signal according to the updated preset sound effect configuration parameters to achieve seamless switching of the timbre. Specifically, the mobile terminal APP transmits the sound effect configuration parameters set by the user to the FPGA module through the JSON protocol, so that the FPGA module can update the sound effect configuration parameters in the system in real time.

[0084] At the same time, the DSP module is also used to synchronize the audio signal to the mobile terminal APP through the Bluetooth module to display the real-time spectrum of the audio signal.

[0085] In addition, the intelligent terminal APP can also be connected to the functions of voice control and gesture recognition, so that users can adjust the sound effect configuration parameters by voice or gesture.

[0086] Preferably, the main control board 8 further includes a zero-crossing detection module, which is used to perform zero-crossing detection on the input digital audio signal to filter the signal and prevent signal mutation. Specifically, the zero-crossing detection module is arranged between the radio frequency adjustment module and the FPGA module. By filtering the signal, the instantaneous noise generated by signal mutation (such as musical instrument plugging and unplugging, mode switching) can be eliminated, and the stability of the output sound quality can be improved. Among them, the zero-crossing detection module in this embodiment can be implemented by a hardware circuit, such as a Zero-Crossing Detector circuit, or can be implemented by a software algorithm, such as identifying the zero-crossing moment by calculating the symbol change of adjacent sampling points.

[0087] Further, a touch panel and physical buttons 7 are also provided on the housing of the first sound unit 2. The touch panel and the physical buttons 7 are electrically connected to the main control board 8 respectively. A button installation groove 71 is also provided in the second sound unit 2 for installing the physical buttons 7. By providing physical buttons 7 and a touch panel, etc., it is used to quickly switch the sound effect mode, adjust the volume and parameters. For example, short pressing can switch the tone preset, volume, etc. This method is applicable in the case of no mobile phone APP, and users can still operate the device independently. That is, in the present invention, the mobile terminal APP is connected to the speaker through Bluetooth, and the remote configuration parameter adjustment can be realized through the mobile terminal APP. At the same time, the configuration parameter adjustment can also be realized through the buttons on the speaker, providing multiple ways of configuration parameter adjustment, which is convenient for users to use; for example, at the hardware end, quick switching can be realized through the keyboard, and precise adjustment can be realized through the APP end to adapt to different needs of users.

[0088] More preferably, a sensor is also provided in the sound unit. Among them, the sensor includes a six-axis IMU sensor, a pressure sensor and a distance sensor. The main control board 8 further includes an MCU module, and the MCU module is electrically connected to the six-axis IMU sensor, the pressure sensor and the distance sensor. Among them, the six-axis IMU sensor is used to obtain the head movement data of the user. The pressure sensor is used to obtain the pressure between the device and the user's neck, and then obtain the fitting degree level between the device and the user's neck according to the pressure. The distance sensor is used to obtain the distance between the device and the user's head. That is, the MCU module is used to obtain the head movement data of the user according to the monitoring data of the six-axis IMU sensor, obtain the fitting degree level between the device and the user's neck according to the monitoring data of the pressure sensor, and obtain the distance between the device and the user's head according to the monitoring data of the distance sensor.

[0089] Further, the DSP module is connected to the MCU module through a high-speed SPI interface, and is used to dynamically adjust audio processing parameters according to the monitoring data of the above three types of sensors provided by the MCU module, so as to improve the audio output quality. That is: the DSP module is used to dynamically adjust the HRTF algorithm parameters according to the user's head movement data provided by the MCU module; adaptively adjust the EQ compensation curve according to the fitting degree level between the device and the user's neck provided by the MCU module to optimize the low-frequency response; and adaptively switch the audio output mode according to the distance between the device and the user's head (such as a close-range stereo mode / a long-range surround sound mode) to provide a better audio output effect for the user.

[0090] For example, the DSP module dynamically adjusts the parameters of the HRTF algorithm according to the user's head movement data: First, the MCU module collects the user's head movement data through a six-axis IMU sensor (sampling rate 200Hz), and then the quaternion attitude solution algorithm can be used to calculate the user's head yaw angle θ (range 0 - 360°) and pitch angle φ (range -90° - +90°) in real time.

[0091] At the same time, the DSP module has a built-in HRTF parameter database, which stores HRTF coefficient sets for 72 azimuths (each interval corresponding to 5°).

[0092] In this way, when the MCU module detects the user's head rotation through the six-axis IMU sensor, the MCU module sends the calculated user's head yaw angle and pitch angle to the DSP module, so that the DSP module can implement dynamic adjustment of the HRTF parameters according to the currently calculated user's head yaw angle and pitch angle, and the built-in HRTF parameter database. Among them, when adjusting the parameters, the HRTF coefficient of the current user's head angle (θ, φ) can be calculated by the bilinear interpolation method. At the same time, the HRTF update rate is dynamically adjusted according to the rotational angular velocity ω. For example, when the rotational angular velocity ω < 30° / s, the update frequency of the HRTF parameters is adjusted to 10Hz; when the rotational angular velocity 30° / s < ω < 90° / s, the update frequency of the HRTF parameters is adjusted to 30Hz; when the rotational angular velocity ω > 90° / s, the update frequency of the HRTF parameters is adjusted to 100Hz.

[0093] For another example, the DSP module also implements EQ compensation according to the fitting degree level between the device and the user's neck provided by the MCU module. It is set that the MCU module detects the neck contact pressure P (range 0 - 10N) according to the pressure sensor (sampling rate 50Hz) and quantifies it into a 5 - level fitting degree. Then the DSP module implements EQ compensation according to the following method. Specifically, during low - frequency compensation, a dynamic gain G = 3×log(1 + P / P0) dB is applied to the frequency band of 80Hz - 200Hz, where P0 = 2N; during Q - value adjustment, the Q - value of the second - order low - shelf filter linearly changes from 0.7 (level 1) to 1.2 (level 5). At the same time, when the fitting degree level < 2, a +6dB compensation below 100Hz is enabled.

[0094] For another example, the DSP module switches the mode according to the distance between the device and the user's head. It is set that when the distance sensor (accuracy ±1cm) detects the distance d between the device and the user's ear in real - time, the following adjustment scheme can be adopted: when d < 15cm, the mode switches to the near - field mode, and the direct - sound ratio > 80%; when 15cm ≤ d ≤ 30cm, the mode switches to the hybrid mode, and 15ms of early reflections are added; when d > 30cm: the mode switches to the surround mode, and Ambisonics 3 - order encoding is enabled. At the same time, a 500 - ms fade - in and fade - out transition is used during mode switching to avoid auditory mutations.

[0095] Embodiment 2

[0096] Based on Embodiment 1, the present invention provides an intelligent sound effect method for a wireless performance instrument speaker, as Figure 4 shown, including:

[0097] Step S1: Acquire the audio signal played by an external instrument, decode and perform analog - to - digital conversion on the audio signal to obtain a digital audio signal, and cache the digital audio signal according to the receiving timing.

[0098] Specifically, a wireless transceiver is installed on the performance instrument and matched with the wireless performance instrument speaker provided by the present invention to collect the audio signal played by the instrument through the wireless transceiver. After the audio signal is collected, it is first decoded and subjected to analog - to - digital conversion to obtain a digital audio signal.

[0099] Step S2: Obtain the IR cabinet head file from the system according to the instrument type of the external instrument and the preset sound effect configuration parameters, and sequentially load the IR cabinet head file for each digital audio signal according to the convolutional neural network model to perform timbre simulation on the corresponding digital audio signal; then perform spatial sound effect simulation on the digitally - simulated audio signal according to the HRTF algorithm.

[0100] More specifically, before processing the digital audio signal in step S2, the digital audio signal also needs to be dynamically frequency-divided to obtain multiple frequency-divided signals. Among them, the frequency-divided signals include low-frequency signals, mid-frequency signals, and high-frequency signals. When simulating the timbre of the digital audio signal in step S2, it specifically includes separately performing individual timbre simulation and spatial sound effect simulation processing on each frequency-divided signal; in step S2, according to the HRTF algorithm, performing spatial sound effect simulation on the digital audio signal with simulated timbre specifically includes: separately performing spatial sound effect simulation on each frequency-divided signal, and then merging the multiple audio signals after spatial sound effect simulation.

[0101] Step S3: Send the digital audio signal obtained after spatial sound effect simulation to the speaker module of the wireless performance instrument speaker for synchronous playback.

[0102] The present invention combines wireless transmission technology and digital processing technology to reduce signal delay, achieve synchronous playback of signals, and perform timbre and spatial sound effect simulation on signals, improve the quality of sound playback, and bring an immersive performance experience to users.

[0103] Furthermore, the present invention further includes: uploading the audio signal after spatial sound effect simulation to an external terminal APP via Bluetooth and displaying it through the external terminal APP; and obtaining the timbre configuration parameters sent by the external terminal APP, and then updating the preset sound effect configuration parameters according to the timbre configuration parameters.

[0104] By setting up a Bluetooth communication module to communicate and connect the speaker with the mobile terminal APP, the user can remotely update the configuration parameters to adapt to more performance scenarios and the requirements of more timbres and sound fields; at the same time, the collected audio signal is also synchronized to the mobile terminal APP to display the frequency response curve of the audio signal on the mobile terminal APP, so as to perform further data analysis and feedback on the audio signal, provide data support for other analyses, and also realize the storage of the audio signal.

[0105] Embodiment 3

[0106] Based on Embodiment 1, the present invention further provides another embodiment, an intelligent sound effect system for a wireless performance instrument speaker. The intelligent sound effect system includes a wireless performance instrument speaker, a wireless transceiver, and an external terminal device provided in Embodiment 1; among them, the wireless transceiver module of the wireless performance instrument speaker is communicatively connected to the wireless transceiver, and the wireless transceiver is electrically connected to the external performance instrument; the wireless performance instrument speaker is communicatively connected to the external terminal device via Bluetooth.

[0107] The above embodiments are only preferred embodiments of the present invention, and the scope of protection of the present invention cannot be limited thereby. Any non-substantive changes and substitutions made by those skilled in the art based on the present invention fall within the scope of protection required by the present invention.

Claims

1. A wireless musical instrument speaker, characterized in that, The wireless performance instrument speaker box includes a speaker box body, and the speaker box body includes a neck-hanging part and sound parts arranged at both ends of the neck-hanging part; A speaker module, a main control board, a wireless transceiver module and a power supply module are arranged in the sound part; The power supply module is electrically connected to the main control board, the speaker module and the wireless transceiver module, and the speaker module and the wireless transceiver module are respectively electrically connected to the main control board; The main control board is communicatively connected to an external performance instrument through the wireless transceiver module, and is configured to obtain an audio signal of the external performance instrument, perform sound effect processing on the audio signal, and then output the audio signal to the speaker module to drive the speaker module to play the audio signal.

2. The wireless performance instrument speaker according to claim 1, wherein The sound part includes a housing; the housing includes a base and a cover plate installed on the base, and a cavity is formed between the base and the cover plate; the speaker module includes a first speaker module and a second speaker module; A first speaker module, a main control board and a wireless transceiver module are arranged in the cavity of one of the sound parts, and a second speaker module and a power supply module are arranged in the cavity of the other sound part; the main control board is electrically connected to the first speaker module and the wireless transceiver module; Corresponding wires are arranged in the neck-hanging part; by installing the two sound parts at both ends of the neck-hanging part, the power supply module is electrically connected to the main control board and the wireless transceiver module through the corresponding wires; the main control board is electrically connected to the second speaker module through the corresponding wires.

3. The wireless performance instrument speaker according to claim 2, wherein A power supply installation slot and a first speaker module installation slot are arranged in the base of one of the sound parts, the power supply module is arranged in the power supply installation slot, and the second speaker module is arranged in the second speaker module installation slot; a main control board installation slot and a second speaker module installation slot are arranged in the base of the other sound part, the main control board is arranged in the main control board installation slot, and the second speaker module is arranged in the second speaker module installation slot; the wireless transceiver module is arranged above the main control board; sound holes are arranged on the sound part, and the sound holes correspond to the speaker module in the cavity; Both the first speaker module and the second speaker module include a full-frequency speaker and a passive diaphragm speaker; both the first speaker module installation slot and the second speaker module installation slot include a full-frequency speaker installation slot and a passive diaphragm speaker installation slot, the full-frequency speaker of the first speaker module is arranged in the corresponding full-frequency speaker installation slot, the passive diaphragm speaker is arranged in the corresponding passive diaphragm speaker installation slot, the full-frequency speaker of the second speaker module is arranged in the corresponding full-frequency speaker installation slot, and the passive diaphragm speaker is arranged in the corresponding passive diaphragm speaker installation slot; A touch panel and physical buttons are further installed on the housing of the sound part where the main control board is arranged, and the touch panel and the physical buttons are respectively electrically connected to the main control board.

4. The wireless performance instrument speaker according to claim 1, characterized in that, The two sound parts are detachably connected to both ends of the neck-hanging part, first connection ports are arranged on both end faces of the neck-hanging part, and second connection ports are arranged on the end faces of the sound parts connected to the neck-hanging part; when the two sound parts are respectively installed and in contact with both ends of the neck-hanging part, the first connection port is electrically connected to the second connection port; The neck strap portion and the sound units at both ends of the neck strap portion form a U-shaped structure, and the housing of the neck strap portion is a shape memory alloy skeleton, and a silica gel coating layer is provided outside the shape memory alloy skeleton; the housing of the sound unit is made of carbon fiber composite material, aluminum alloy, ABS and PC materials.

5. The wireless performance instrument speaker according to claim 1, characterized in that, The main control board includes an audio processing unit; the audio processing unit includes a DSP module, an FPGA module and a radio frequency modulation module; One end of the radio frequency modulation module is communicatively connected to the wireless transceiver of the external musical instrument through the wireless transceiver module, and the other end is electrically connected to the FPGA module, and is used to obtain the radio frequency signal of the wireless transceiver through the wireless transceiver module, decode the radio frequency signal, perform analog-to-digital conversion into a digital audio signal, and send the digital audio signal to the FPGA module for caching; The FPGA module is also electrically connected to the DSP module, and is used to sequentially send the cached digital audio signals to the DSP module according to the reception timing; The DSP module is electrically connected to the speaker module, and is used to match the IR cabinet header file from the system according to the type of the external musical instrument and the preset sound effect configuration parameters, and use the convolutional neural network model to load the corresponding IR cabinet header file for the audio signal to simulate the timbre of the corresponding digital audio signal, and perform spatial sound effect processing on the corresponding digital audio signal according to the HRTF algorithm, and send the processed corresponding digital audio signal to the speaker module for playback; performing spatial sound effect processing on the audio signal includes simulating the audio signal into stereo or simulating the audio signal into surround sound.

6. The wireless performance instrument speaker according to claim 5, wherein, The main control board also includes a Bluetooth communication module; the audio processing unit is also communicatively connected to the external terminal APP through the Bluetooth communication module, and is used to obtain the sound effect configuration parameters sent by the external terminal APP through the Bluetooth communication module, and further update the preset sound effect configuration parameters according to the sound effect configuration parameters; and synchronously upload the generated audio signal to the external terminal APP through the Bluetooth communication module for display; The main control board also includes a zero-crossing detection module, and the zero-crossing detection module is arranged between the radio frequency modulation module and the FPGA module, and is used to filter the corresponding digital audio signal; A sensor is also provided inside the audio section; the sensor includes a six-axis IMU sensor, a pressure sensor, and a distance sensor; the main control board further includes an MCU module, and the MCU module is electrically connected to the six-axis IMU sensor, the pressure sensor, and the distance sensor; the MCU module is configured to obtain the user's head movement data based on the monitoring data of the six-axis IMU sensor, obtain the fitting degree level between the device and the user's neck based on the monitoring data of the pressure sensor, and obtain the distance between the device and the user's ear based on the monitoring data of the distance sensor; the MCU module is electrically connected to the DSP module and is configured to provide the DSP module with the user's head movement data, the fitting degree level between the device and the user's neck, and the distance between the device and the user's ear, so that the DSP module adapts and adjusts the parameters of the HRTF algorithm according to the user's head movement data to further adjust the spatial sound effect rendering effect, adapts and adjusts the EQ compensation parameters according to the fitting degree level between the device and the user's neck, and adapts and adjusts the audio output mode according to the distance between the device and the user's ear.

7. The wireless performance instrument speaker according to claim 5, wherein The DSP module is further configured to perform dynamic frequency division on the corresponding digital audio signal to obtain multiple segments of frequency division signals, respectively load the corresponding IR cabinet head files for each segment of frequency division signal by using a convolutional neural network model to perform timbre simulation on each segment of frequency division signal, and perform spatial sound effect processing on each segment of frequency division signal according to the HRTF algorithm and then merge the multiple segments of frequency division signals and send them to the speaker module.

8. An intelligent sound effect adjustment method for a wireless performance instrument speaker, applied to a wireless performance instrument speaker as described in any one of claims 1-7, characterized in that, The intelligent sound effect adjustment method includes: Audio acquisition step: acquiring an audio signal played by an external musical instrument, decoding and performing analog-to-digital conversion on the audio signal to obtain a digital audio signal, and caching the digital audio signal according to the reception time sequence. Audio processing step: first obtaining an IR cabinet head file from the system according to the musical instrument type of the external musical instrument and the preset sound effect configuration parameters, and sequentially loading the IR cabinet head file for each digital audio signal according to the convolutional neural network model to perform timbre simulation on the corresponding digital audio signal; then performing spatial sound effect simulation on the timbre-simulated digital audio signal according to the HRTF algorithm. Playback step: sending the digital audio signal obtained after spatial sound effect simulation to the speaker module of the wireless performance musical instrument speaker for synchronous playback.

9. The intelligent sound effect adjustment method of the wireless performance instrument speaker according to claim 8, characterized in that, It further includes: Parameter configuration step: obtaining the timbre configuration parameters sent by an external terminal APP, and then updating the preset sound effect configuration parameters according to the timbre configuration parameters. Data synchronization step: uploading the digital audio signal after spatial sound effect simulation to the external terminal APP. The audio processing step specifically includes: first obtaining an IR cabinet head file from the system according to the musical instrument type of the external musical instrument and the preset sound effect configuration parameters, and performing dynamic frequency division on the corresponding digital audio signal to obtain multiple segments of frequency division signals; then respectively loading the IR cabinet head file for each segment of frequency division signal according to the convolutional neural network model to perform timbre simulation on each segment of frequency division signal; finally performing spatial sound effect simulation on each segment of frequency division signal after timbre simulation according to the HRTF algorithm.

10. An intelligent sound effect adjustment system for a wireless performance musical instrument speaker, characterized in that, The intelligent sound effect system includes a wireless performance instrument speaker, a wireless transceiver, and an external terminal APP as described in any one of claims 1-7; wherein, the wireless transceiver module of the wireless performance instrument speaker is communicatively connected to the wireless transceiver, and the wireless transceiver is electrically connected to an external performance instrument; the wireless performance instrument speaker is communicatively connected to the external terminal APP via Bluetooth.

Images