Integrated sound box system and control method therefor

Abstract

Disclosed in the present invention are an integrated sound box system and a control method therefor. The system comprises: an ultra-wideband spatial positioning subsystem, a data processing subsystem, an audio output subsystem and a sound playing subsystem, wherein the ultra-wideband spatial positioning subsystem is used for acquiring musical instrument position information and sending the musical instrument position information to the data processing subsystem; on the basis of the musical instrument position information, the data processing subsystem generates an audio control instruction corresponding to a musical instrument striking action, and sends the audio control instruction to the audio output subsystem; the audio output subsystem is used for determining, on the basis of the audio control instruction, a note audio file corresponding to the musical instrument striking action, generating an analog audio signal on the basis of the note audio file, and sending the analog audio signal to the sound playing subsystem; and the sound playing subsystem is used for performing signal amplification on the analog audio signal and converting the amplified analog audio signal into sound for playing. The present technical solution achieves the effect of reducing a receiving delay while saving on space.

Description

Integrated speaker system and control method thereof Technical Field

[0001] The present invention relates to the technical field of speaker technology, and in particular to an integrated speaker system and a control method thereof. Background Art

[0002] Electronic musical instrument technology combines traditional musical instruments with advanced electronics. It utilizes sensors, controllers, and audio processing to simulate and synthesize the audio and performance effects of various instruments. To play the synthesized audio, communication is established between speakers and the electronic instruments, allowing the synthesized audio to be played back through the speakers.

[0003] In related technologies, electronic musical instruments and speaker devices are usually connected wirelessly. In this case, the way to make the speaker device play the audio synthesized by the electronic musical instrument is usually to set a sensor between the audio device and the electronic musical instrument, and then receive the audio data sent by the electronic musical instrument based on the sensor, and process the received audio data to obtain synthesized audio, and then send the synthesized audio to the speaker device for playback.

[0004] However, based on the above method, a certain delay will be generated during the data transmission process, thereby affecting the sound effect. Summary of the Invention

[0005] The present invention provides an integrated speaker system and a control method thereof, so as to achieve the effect of reducing reception delay while saving space, thereby optimizing the sound effect of the speaker device.

[0006] According to one aspect of the present invention, an integrated speaker system is provided, which includes: an ultra-wideband spatial positioning subsystem, a data processing subsystem, an audio output subsystem and a sound playback subsystem, wherein:

[0007] The ultra-wideband spatial positioning subsystem is configured to obtain instrument position information corresponding to a simulated percussion instrument and transmit the instrument position information to the data processing subsystem; wherein the simulated percussion instrument includes at least a drumstick; the instrument position information includes at least a relative distance and an azimuth; the relative distance is the distance of the simulated percussion instrument relative to the integrated sound box system;

[0008] The data processing subsystem receives the musical instrument position information, generates an audio control instruction corresponding to the musical instrument striking action according to the musical instrument position information, and sends the audio control instruction to the audio output subsystem;

[0009] The audio output subsystem is configured to receive the audio control instruction, determine a note audio file corresponding to the instrument striking action according to the audio control instruction, generate an analog audio signal based on the note audio file, and send the analog audio signal to the sound playing subsystem;

[0010] The sound playing subsystem is used to receive the analog audio signal, amplify the analog audio signal, and convert the amplified analog audio signal into sound for playing.

[0011] According to another aspect of the present invention, a method for controlling an integrated speaker system is provided, the method comprising:

[0012] Acquiring instrument position information corresponding to a simulated percussion instrument based on an ultra-wideband spatial positioning subsystem, and transmitting the instrument position information to a data processing subsystem; wherein the simulated percussion instrument includes at least a drumstick; the instrument position information includes at least a relative distance and an azimuth; the relative distance being the distance of the simulated percussion instrument relative to the integrated sound box system;

[0013] The data processing subsystem receives the musical instrument position information, generates an audio control instruction corresponding to the musical instrument striking action according to the musical instrument position information, and sends the audio control instruction to the audio output subsystem;

[0014] The audio output subsystem receives the audio control instruction, determines a note audio file corresponding to the musical instrument striking action according to the audio control instruction, generates an analog audio signal based on the note audio file, and sends the analog audio signal to the sound playing subsystem;

[0015] The sound playing subsystem receives the analog audio signal, amplifies the analog audio signal, and converts the amplified analog audio signal into sound for playing.

[0016] According to another aspect of the present invention, an electronic device is provided, comprising:

[0017] at least one processor; and

[0018] a memory communicatively connected to the at least one processor; wherein,

[0019] The memory stores a computer program executable by the at least one processor. The computer program is executed by the at least one processor so that the at least one processor can execute the control method of the integrated speaker system according to any embodiment of the present invention.

[0020] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the control method of the integrated speaker system according to any embodiment of the present invention when executed.

[0021] An embodiment of the present invention provides an integrated speaker system, comprising: an ultra-wideband spatial positioning subsystem, a data processing subsystem, an audio output subsystem, and a sound playback subsystem, wherein the ultra-wideband spatial positioning subsystem is used to obtain instrument position information corresponding to a simulated percussion instrument and send the instrument position information to the data processing subsystem; the data processing subsystem receives the instrument position information, generates an audio control instruction corresponding to the instrument's striking action based on the instrument position information, and sends the audio control instruction to the audio output subsystem; the audio output subsystem receives the audio control instruction, determines the note audio file corresponding to the instrument's striking action based on the audio control instruction, generates an analog audio signal based on the note audio file, and sends the analog audio signal to the sound playback subsystem; the sound playback subsystem receives the analog audio signal, amplifies the analog audio signal, and converts the amplified analog audio signal into sound for playback. The technical solution provided by the embodiment of the present invention solves the problem in the related art that a certain delay is generated during data transmission, thereby affecting the sound effect, and achieves the effect of reducing the reception delay while saving space, thereby optimizing the sound effect of the speaker device.

[0022] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0024] FIG1 is a schematic structural diagram of an integrated speaker system provided according to a first embodiment of the present invention;

[0025] FIG2 is a flow chart of a control method of an integrated speaker system provided according to a second embodiment of the present invention;

[0026] FIG3 is a schematic structural diagram of an electronic device for implementing the control method of the integrated speaker system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0028] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices. Example 1

[0029] FIG1 is a schematic diagram of the structure of an integrated speaker system provided in a first embodiment of the present invention. This embodiment is applicable to situations where the integrated speaker system is used to play the audio of a simulated percussion instrument. As shown in FIG1 , the integrated speaker system 10 provided in this embodiment includes: an ultra-wideband spatial positioning subsystem 101, a data processing subsystem 102, an audio output subsystem 103, and a sound playback subsystem 104. The structural components of the integrated speaker system of this embodiment are described in detail below.

[0030] Among them, the ultra-wideband spatial positioning subsystem 101 is used to obtain the instrument position information corresponding to the simulated percussion instrument, and send the instrument position information to the data processing subsystem 102; the data processing subsystem 102 receives the instrument position information, generates an audio control instruction corresponding to the instrument striking action according to the instrument position information, and sends the audio control instruction to the audio output subsystem 103; the audio output subsystem 103 is used to receive the audio control instruction, determine the note audio file corresponding to the instrument striking action according to the audio control instruction, generate an analog audio signal based on the note audio file, and send the analog audio signal to the sound playing subsystem 104; the sound playing subsystem 104 is used to receive the analog audio signal, amplify the analog audio signal, and convert the amplified analog audio signal into sound for playback.

[0031] The ultra-wideband spatial positioning subsystem 101 can be a subsystem in the integrated speaker system 10 that establishes a wireless communication connection with the simulated percussion instrument. This subsystem can be used to obtain instrument position information corresponding to the simulated percussion instrument. A simulated percussion instrument can be understood as a device that simulates a real percussion instrument through simulation technology. The simulated percussion instrument at least includes drumsticks. It should be noted that the simulated percussion instrument may also include footsteps. In practical applications, the percussion action can be captured by swinging the drumsticks in the air and / or stomping the footsteps. This can achieve the effect of beating drum beats into the air. The instrument position information can be used to characterize the movement of the simulated percussion instrument when performing the percussion action. Optionally, the instrument position information can include at least relative distance and azimuth. The relative distance is the distance of the simulated percussion instrument from the integrated speaker system 10. The relative distance can be understood as the straight-line distance between the simulated percussion instrument and the integrated speaker system 10. The azimuth can be used to characterize the angular change of the simulated percussion instrument during the percussion action. The azimuth can include the instrument's rotation angle and / or tilt angle, etc.

[0032] In this embodiment, the simulated percussion instrument is connected to the ultra-wideband spatial positioning subsystem 101 via a wireless communication connection method. The wireless communication connection method includes an ultra-wideband wireless communication connection. Ultra-wideband (UWB) wireless communication connection is a wireless carrier communication technology that does not use a sinusoidal carrier but instead utilizes nanosecond-level non-sinusoidal narrow pulses to transmit data. Therefore, it occupies a very wide spectrum range. UWB technology has the advantages of low system complexity, low power spectrum density of transmitted signals, insensitivity to channel fading, low interception capability, and high positioning accuracy. In a specific implementation, a first UWB module can be integrated into the simulated percussion instrument, and a second UWB module can be integrated into the ultra-wideband spatial positioning subsystem 101. Furthermore, based on the first and second UWB modules, an ultra-wideband wireless communication connection can be achieved between the simulated percussion instrument and the ultra-wideband spatial positioning subsystem 101. It should be noted that the wireless communication connection between the simulated percussion instrument and the ultra-wideband spatial positioning subsystem 101 may also include Bluetooth, Radio Frequency Identification (RFID), ZigBee, and 2.4 GHz antenna.

[0033] In practical applications, simulated percussion instruments lack physical instruments and cannot be struck to produce sound. Therefore, speakers are required to produce the sounds produced by simulated percussion instruments. Generally, since the information used to determine the performance of a simulated percussion instrument during its performance is the instrument's position information, conventional speakers cannot directly process this information and can only process audio-related information. Therefore, when playing the sounds of a simulated percussion instrument using a speaker, an adapter is typically placed between the simulated percussion instrument and the speaker. During the performance of the simulated percussion instrument, the instrument's position information collected is sent to the adapter. The adapter then processes the instrument's position information to generate a synthesized audio data stream. This synthesized audio data stream is then wirelessly transmitted to the speaker, allowing the speaker to play the sound based on the synthesized audio data stream. However, this method of audio playback requires transmitting the instrument's position information to the adapter, which then wirelessly transmits the data stream to the speaker. This wireless transmission of data can result in a certain delay in receiving the data, which can affect the overall sound quality.

[0034] Based on this, in this embodiment, the ultra-wideband spatial positioning subsystem 101 and the data processing subsystem 102 are integrated into the integrated speaker system 10. During the simulation of percussion instrument performance, the instrument position information is received based on the ultra-wideband spatial positioning subsystem 101, and the instrument position information is processed based on the data processing subsystem 102 and the audio output subsystem 103 to obtain a synthesized audio data stream. Furthermore, the synthesized audio data stream can be directly transmitted to the audio output subsystem 103 via wired transmission, and the synthesized audio data stream is converted into a synthesized audio signal, and the synthesized audio signal is sent to the sound playing subsystem 104 to receive and play the synthesized audio signal based on the sound playing subsystem 104. The advantage of this arrangement is that position information acquisition and position information processing can be directly implemented in the integrated speaker system 10, and the data stream is transmitted via wired transmission, which reduces the delay caused by the data transmission process to a certain extent, thereby achieving the effect of reducing the reception delay.

[0035] Furthermore, the second UWB module integrated into the ultra-wideband spatial positioning subsystem 101 has a modular structure that includes at least three antennas. When this UWB module is independently installed in a space other than the integrated speaker system, it may occupy a relatively large area due to its structural characteristics. Furthermore, when installed independently, it may also have certain positioning requirements (e.g., requiring installation at the top of a confined space, or on a limb of a user operating a simulated percussion instrument). In other words, independently installing the UWB module in an area other than the integrated speaker system may result in a relatively large space occupation and high positioning requirements.

[0036] Based on this, in this embodiment, the UWB module is set in the ultra-wideband spatial positioning subsystem 101, that is, in the integrated speaker system 10, which achieves the effect of saving space and being easy to carry, improves the convenience of the integrated speaker system, and improves the user experience of the speaker system.

[0037] In a specific implementation, during the process of the simulated percussion instrument performing the instrument striking action, a sensor provided on the simulated percussion instrument can collect the instrument position information. Furthermore, the instrument position information can be obtained according to a preset step size by the ultra-wideband spatial positioning subsystem 101, and all the obtained instrument position information is sent to the data processing subsystem 102. Furthermore, the data processing subsystem 102 processes the received instrument position information, generates an audio control instruction corresponding to the instrument striking action, and sends the audio control instruction to the audio output subsystem 103. The preset step size can be any step size, and can optionally be 1 second, 2 seconds, or 3 seconds, etc.

[0038] Among them, the data processing subsystem 102 can be a subsystem that processes the received instrument position information to judge the instrument striking action of the simulated percussion instrument. In this embodiment, the data processing subsystem 102 can be a device located inside the integrated speaker system 10; or, it can also be an external device that establishes communication with the integrated speaker system 10. In the case where the data processing subsystem 102 is an external device that establishes communication with the integrated speaker system 10, the established communication can include wired communication and / or wireless communication. If the established communication includes both wired communication and wireless communication, custom settings can be made based on user needs so that the data processing subsystem 102 can establish a connection with the integrated speaker system 10 based on the custom communication method and perform data transmission.

[0039] The ultra-wideband spatial positioning subsystem 101 is connected to the data processing subsystem 102 via a wired or wireless transmission method. Optionally, wired transmission methods may include serial ports, integrated circuit buses (ICs), SPI buses, and CAN buses. Wireless transmission methods may include Bluetooth, radio frequency identification (RFID), ZigBee, and 2.4 GHz antennas. The instrument striking action simulates the action of a percussion instrument striking the air. The instrument striking action may correspond to the striking action of a physical percussion instrument striking the instrument. For example, assuming the physical percussion instrument is a physical drum set, the striking action corresponding to the actual striking of the physical percussion instrument may be the action of a drumstick striking the drumhead; if the simulated percussion instrument includes at least a drumstick, the instrument striking action may be the action of a drumstick striking the air. Audio control instructions may be used to instruct the determination and output of audio. The audio control instructions may include at least the musical note corresponding to the instrument striking action. Generally, when simulating a percussion instrument to perform a striking action, if it is determined that the simulated percussion instrument performs a striking action, a note corresponding to the striking action can be obtained. Furthermore, an audio control instruction can be generated based on the note to determine the audio corresponding to the note based on the audio control instruction.

[0040] In this embodiment, since the received instrument position information is the instrument position information corresponding to the simulated percussion instrument at various time points throughout the entire application process, it may include instrument position information corresponding to when the simulated percussion instrument does not perform the instrument striking action. Therefore, when the data processing subsystem 102 receives the instrument position information, it can determine whether the simulated percussion instrument performs the instrument striking action based on the instrument position information. Further, when it is determined that the simulated percussion instrument performs the instrument striking action, it can determine the note corresponding to the instrument striking action and generate an audio control instruction corresponding to the instrument striking action based on the note.

[0041] Optionally, the data processing subsystem 102 includes: a note determination module and an instruction generation module, wherein the note determination module is used to determine whether the simulated percussion instrument makes an instrument striking action based on the instrument position information, and when it is determined that the instrument striking action is made, determine the action position and action force corresponding to the instrument striking action based on the target position information corresponding to the instrument striking action, and determine the note corresponding to the instrument striking action based on the action position and action force; the instruction generation module is used to generate an audio control instruction corresponding to the instrument striking action based on the note corresponding to the instrument striking action.

[0042] Among them, the action position can be the position where the simulated percussion instrument acts when the instrument striking action ends. The action force can be the action force corresponding to the simulated percussion instrument when making the instrument striking action. Exemplarily, in the case where the simulated percussion instrument is an air drum, the action position can be the position of the drumstick when the instrument striking action ends; the action force can be the striking force of the drumstick. Those skilled in the art will understand that, when the action position and action force corresponding to the instrument striking action are determined, the note corresponding to the instrument striking action can be directly determined. Exemplarily, in the case where the simulated percussion instrument is an air drum, a note can be a drum beat. The target position information can be the instrument position information that represents the instrument striking action in the received instrument position information. In other words, the target position information can be the position information that can represent the simulated percussion instrument when making the instrument striking action.

[0043] In a specific implementation, when the data processing subsystem 102 receives instrument position information, the instrument position information can be analyzed based on the note determination module, and a polar coordinate system can be constructed with the integrated speaker system as the coordinate system origin. Subsequently, the coordinate information of the simulated percussion instrument in the polar coordinate system can be determined based on the relative distance and azimuth (including the instrument's rotation angle and / or tilt angle, etc.) in the instrument position information. Furthermore, based on the determined coordinate information, it can be determined whether the simulated percussion instrument has performed a striking action. Furthermore, if it is determined that the simulated percussion instrument has performed a striking action, target position information corresponding to the striking action can be determined from the received instrument position information. Furthermore, by constructing a polar coordinate system, the coordinate information corresponding to the simulated percussion instrument when performing the striking action can be determined based on the relative distance and azimuth in the target position information. The action position corresponding to the striking action can be determined based on this coordinate information, and the force corresponding to the striking action can be determined based on the azimuth in the target position information. Furthermore, the note corresponding to the striking action can be determined based on the action position and force. Furthermore, an audio control instruction corresponding to the musical instrument striking action may be generated based on the note corresponding to the musical instrument striking action based on the instruction generating module.

[0044] For example, in the case where the simulated percussion instrument is an air drum, the instrument position information can be analyzed based on the note determination module to determine whether the drumstick has made a striking action. If it is determined that the drumstick has made a striking action, the drum surface struck by the drumstick, the striking position on the drum surface, and the striking force of the drumstick can be determined. Furthermore, the drum beat corresponding to the playing action can be determined based on the determined drum surface, the striking position on the drum surface, and the striking force of the drumstick. Furthermore, the instruction generation module can generate an audio control instruction based on the determined drum beat.

[0045] Furthermore, the audio control instruction can be sent to the audio output subsystem 103, so that the audio output subsystem 103 can determine the note audio file corresponding to the instrument striking action based on the audio control instruction, generate an analog audio signal based on the note audio file, and send the analog audio signal to the sound playback subsystem 104.

[0046] The note audio file may be audio data containing a corresponding note. The analog audio signal may be an audio analog signal synthesized from at least one note audio file. In this embodiment, the data processing subsystem 102 and the audio output subsystem 103 are connected via a wired transmission mode.

[0047] In this embodiment, the method of determining the note audio file based on the audio output subsystem 103 may include at least one of the following: retrieving the note audio file corresponding to the instrument striking action from multiple candidate note audio files stored locally; retrieving the note audio file corresponding to the instrument striking action from the cloud; processing the audio control instruction according to a preset audio generation method, and generating a note audio file corresponding to the instrument striking action.

[0048] In this embodiment, multiple candidate note audio files can be pre-stored in the audio output subsystem 103, and associations can be established between the notes and the candidate note audio files. Furthermore, when determining a note corresponding to a musical instrument striking action, the audio output subsystem 103 can determine a candidate note audio file corresponding to the note from the multiple pre-stored candidate note audio files based on the associations between the note and the candidate note audio files, and use the candidate note audio file as the note audio file corresponding to the musical instrument striking action.

[0049] Alternatively, when a note corresponding to the musical instrument striking action is determined, an audio file retrieval request corresponding to the note can be sent to the cloud based on the audio output subsystem 103. Further, when the cloud receives the audio file retrieval request, the note audio file corresponding to the audio file retrieval request can be sent to the audio output subsystem 103.

[0050] Alternatively, upon receiving an audio control instruction, the audio control instruction may be parsed and audio generated according to a preset audio generation method. Furthermore, an audio file of musical notes corresponding to the instrument's striking action may be generated. The preset audio generation method may be any method capable of generating an audio file, and may optionally be based on a deep learning model.

[0051] Optionally, the audio output subsystem 103 includes: a data stream synthesis module and a data stream conversion module, wherein the data stream synthesis module is used to receive audio control instructions, determine the note audio file corresponding to the instrument striking action according to the audio control instructions, and synthesize the target audio data stream in real time based on the note audio file; the data stream conversion module is used to convert the target audio data stream to obtain an analog audio signal.

[0052] The target audio data stream may be a data stream composed of at least one audio.

[0053] In this embodiment, after receiving the audio control instruction, the note audio file corresponding to the instrument striking action can be determined based on the audio control instruction based on the data stream synthesis module. Then, the retrieved note audio file can be subjected to real-time audio synthesis to obtain a target audio data stream. Furthermore, the target audio data stream can be converted from a digital signal to an analog signal based on the data stream conversion module to obtain an analog audio signal. Furthermore, the analog audio signal can be sent to the sound playback subsystem 104, so that the synthesized audio file can be amplified based on the sound playback subsystem 104, and the amplified analog audio signal can be converted into sound for playback.

[0054] Based on the above technical solutions, the present invention further includes: an audio output subsystem 103, which is further configured to receive an audio data stream sent by a mobile device, convert the audio data stream into an audio signal, and send the audio signal to a sound playing subsystem 104. The sound playing subsystem 104 is configured to receive and play the audio signal.

[0055] The mobile device may be an electronic device such as a mobile phone or a tablet computer, etc. The audio data stream may be audio data sent by the mobile device and required to be played by the integrated speaker system.

[0056] In this embodiment, the audio output subsystem 103 can also receive an audio data stream sent by a mobile device and then perform signal conversion on the received audio data stream to convert the audio data stream from a digital signal to an analog signal to obtain an audio signal. The audio signal can then be sent to the sound playback subsystem 104. Furthermore, the sound playback subsystem 104 can amplify the received audio signal and convert the amplified audio signal into sound for playback.

[0057] Optionally, the sound playback subsystem 104 includes: a power amplification module and a sound playback module; wherein the power amplification module is used to amplify the analog audio signal and obtain an amplified analog audio signal; the sound playback module is used to receive the amplified analog audio signal and convert the amplified analog audio signal into sound for playback.

[0058] Among them, the sound playing subsystem 104 can be a subsystem in the integrated speaker system 10 for implementing sound playback. Optionally, the sound playing subsystem 104 includes a speaker and / or headphones. The analog audio signal obtained by the audio output subsystem 103 can be audio information in the form of an analog signal. The power amplifier module can be a module integrated with a power amplifier circuit. Those skilled in the art will understand that for a speaker system, after the analog audio signal enters the power amplifier module, the power amplifier module can amplify the low-current analog audio signal to a sufficiently large current to drive the sound playing module to play the sound.

[0059] In a specific implementation, when the sound playing subsystem 104 receives an analog audio signal, the power amplification module can be used to amplify the synthesized audio file and obtain an amplified analog audio signal. Furthermore, the sound playing module can receive the amplified analog audio signal and convert the amplified audio signal into sound for playback.

[0060] An embodiment of the present invention provides an integrated speaker system, comprising: an ultra-wideband spatial positioning subsystem, a data processing subsystem, an audio output subsystem, and a sound playback subsystem. The ultra-wideband spatial positioning subsystem is configured to obtain instrument position information corresponding to a simulated percussion instrument and send the instrument position information to the data processing subsystem; the data processing subsystem receives the instrument position information, generates an audio control instruction corresponding to the instrument's striking action based on the instrument position information, and sends the audio control instruction to the audio output subsystem; the audio output subsystem receives the audio control instruction, determines the note audio file corresponding to the instrument's striking action based on the audio control instruction, generates an analog audio signal based on the note audio file, and sends the analog audio signal to the sound playback subsystem; and the sound playback subsystem receives the analog audio signal, amplifies the analog audio signal, and converts the amplified analog audio signal into sound for playback. The technical solution provided by the embodiment of the present invention solves the problem in the related art that a certain delay is generated during data transmission, thereby affecting the sound effect. It achieves the effect of reducing the reception delay while saving space, thereby optimizing the sound effect of the speaker device. Example 2

[0061] FIG2 is a flow chart of a control method for an integrated speaker system provided in a second embodiment of the present invention. The method can be applied to the integrated speaker system provided in the above embodiment.

[0062] As shown in FIG2 , the method includes:

[0063] S210 . Acquire instrument position information corresponding to the simulated percussion instrument based on the ultra-wideband spatial positioning subsystem, and send the instrument position information to the data processing subsystem.

[0064] The simulated percussion instrument at least includes drumsticks. The instrument position information at least includes a relative distance and an azimuth angle; the relative distance is the distance between the simulated percussion instrument and the integrated sound box system.

[0065] S220 , based on the data processing subsystem receiving the instrument position information, generating an audio control instruction corresponding to the instrument striking action according to the instrument position information, and sending the audio control instruction to the audio output subsystem.

[0066] S230, based on the audio output subsystem receiving the audio control instruction, determining the note audio file corresponding to the instrument striking action according to the audio control instruction, generating an analog audio signal based on the note audio file, and sending the analog audio signal to the sound playing subsystem.

[0067] S240: Receive an analog audio signal based on the sound playing subsystem, amplify the analog audio signal, and convert the amplified analog audio signal into sound for playing.

[0068] The technical solution of the embodiment of the present invention obtains the instrument position information corresponding to the simulated percussion instrument based on the ultra-wideband spatial positioning subsystem, and sends the instrument position information to the data processing subsystem. Thereafter, the data processing subsystem receives the instrument position information, generates an audio control instruction corresponding to the instrument striking action according to the instrument position information, and sends the audio control instruction to the audio output subsystem. Thereafter, the audio output subsystem receives the audio control instruction, determines the note audio file corresponding to the instrument striking action according to the audio control instruction, generates an analog audio signal based on the note audio file, and sends the analog audio signal to the sound playback subsystem. Thereafter, the sound playback subsystem receives the analog audio signal, amplifies the analog audio signal, and converts the amplified analog audio signal into sound for playback, thereby solving the problem in the related art that a certain time delay will be generated during data transmission, thereby affecting the sound effect, and achieves the effect of reducing the receiving delay on the basis of saving space, thereby optimizing the sound effect of the speaker device.

[0069] Optionally, the data receiving subsystem includes: a note determination module and an instruction generation module, wherein:

[0070] determining, based on the note determination module and the instrument position information, whether the simulated percussion instrument performs an instrument striking action; and if it is determined that the instrument striking action is performed, determining an action position and an action force corresponding to the instrument striking action based on the target position information corresponding to the instrument striking action; and determining a note corresponding to the instrument striking action based on the action position and the action force;

[0071] An audio control instruction corresponding to the musical instrument striking action is generated based on the instruction generating module according to the musical note corresponding to the musical instrument striking action.

[0072] Optionally, the data processing subsystem is a device located inside the integrated speaker system; or, it is an external device that establishes communication with the integrated speaker system.

[0073] Optionally, when the audio output subsystem determines the note audio file corresponding to the musical instrument striking action according to the audio control instruction, it includes at least one of the following operations:

[0074] Retrieving a note audio file corresponding to the instrument striking action from a plurality of candidate note audio files stored locally;

[0075] Retrieving from the cloud an audio file of musical notes corresponding to the striking action of the musical instrument;

[0076] The audio control instruction is processed according to a preset audio generation method, and a note audio file corresponding to the instrument striking action is generated.

[0077] Optionally, the audio output subsystem includes: a data stream synthesis module and a data stream conversion module, wherein:

[0078] The data stream synthesis module receives the audio control instruction, determines the note audio file corresponding to the instrument striking action according to the audio control instruction, and synthesizes the target audio data stream in real time based on the note audio file;

[0079] The target audio data stream is subjected to signal conversion based on the data stream conversion module to obtain an analog audio signal.

[0080] Optionally, the sound playing subsystem includes: a power amplification module and a sound playing module, wherein:

[0081] Amplifying the analog audio signal based on the power amplification module to obtain the amplified analog audio signal;

[0082] The sound playing module receives the amplified analog audio signal and converts the amplified analog audio signal into sound for playing.

[0083] Optionally, the method further includes: receiving an audio data stream sent by a mobile device based on the audio output subsystem, performing signal conversion on the audio data stream to obtain an audio signal, and sending the audio signal to the sound playback subsystem;

[0084] The audio signal is received and played based on the sound playing subsystem.

[0085] Optionally, the ultra-wideband spatial positioning subsystem is connected to the data processing subsystem via a wired transmission method or a wireless transmission method.

[0086] Optionally, the simulated percussion instrument is wirelessly connected to the ultra-wideband spatial positioning subsystem; the wireless communication connection at least includes an ultra-wideband wireless communication connection.

[0087] Optionally, the sound playing subsystem includes a speaker and / or earphones. Example 3

[0088] FIG3 shows a block diagram of an electronic device 310 that can be used to implement an embodiment of the present invention. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0089] As shown in Figure 3, electronic device 310 includes at least one processor 311 and memory, such as read-only memory (ROM) 312 and random access memory (RAM) 313, communicatively connected to the at least one processor 311. The memory stores computer programs executable by the at least one processor. Processor 311 can perform various appropriate actions and processes based on the computer programs stored in ROM 312 or loaded from storage unit 318 into RAM 313. RAM 313 can also store various programs and data required for the operation of electronic device 310. Processor 311, ROM 312, and RAM 313 are interconnected via bus 314. An input / output (I / O) interface 315 is also connected to bus 314.

[0090] Multiple components in the electronic device 310 are connected to the I / O interface 315, including an input unit 316, such as a keyboard, a mouse, etc.; an output unit 317, such as various types of displays, speakers, etc.; a storage unit 318, such as a magnetic disk, an optical disk, etc.; and a communication unit 319, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 319 allows the electronic device 310 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0091] Processor 311 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Examples of processor 311 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, or microcontroller. Processor 311 executes the various methods and processes described above, such as the control method for the integrated speaker system.

[0092] In some embodiments, the integrated speaker system control method can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 318. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 310 via ROM 312 and / or communication unit 319. When the computer program is loaded into RAM 313 and executed by processor 311, one or more steps of the integrated speaker system control method described above can be performed. Alternatively, in other embodiments, processor 311 can be configured to execute the integrated speaker system control method in any other appropriate manner (e.g., via firmware).

[0093] Various embodiments of the systems and techniques described above can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0094] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0095] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device, or apparatus. A computer-readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0096] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device that has: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0097] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0098] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0099] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0100] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. An integrated speaker system, characterized in that: include: Ultra-wideband spatial positioning subsystem, data processing subsystem, audio output subsystem and sound playback subsystem, among which, The ultra-wideband spatial positioning subsystem is configured to obtain instrument position information corresponding to a simulated percussion instrument and transmit the instrument position information to the data processing subsystem; wherein the simulated percussion instrument includes at least a drumstick; the instrument position information includes at least a relative distance and an azimuth; the relative distance is the distance of the simulated percussion instrument relative to the integrated sound box system; The data processing subsystem receives the musical instrument position information, generates an audio control instruction corresponding to the musical instrument striking action according to the musical instrument position information, and sends the audio control instruction to the audio output subsystem; The audio output subsystem is configured to receive the audio control instruction, determine a note audio file corresponding to the instrument striking action according to the audio control instruction, generate an analog audio signal based on the note audio file, and send the analog audio signal to the sound playing subsystem; The sound playing subsystem is used to receive the analog audio signal, amplify the analog audio signal, and convert the amplified analog audio signal into sound for playing.

2. The integrated speaker system according to claim 1, characterized in that The data processing subsystem includes: a note determination module and an instruction generation module, wherein: The note determination module is configured to determine, based on the instrument position information, whether the simulated percussion instrument performs an instrument striking action, and if it is determined that the instrument striking action is performed, determine, based on the target position information corresponding to the instrument striking action, an action position and an action force corresponding to the instrument striking action, and determine, based on the action position and the action force, a note corresponding to the instrument striking action; The instruction generation module is used to generate an audio control instruction corresponding to the instrument striking action based on the musical note corresponding to the instrument striking action.

3. The integrated speaker system according to claim 1, characterized in that The data processing subsystem is a device located inside the integrated speaker system; or, it is an external device that establishes communication with the integrated speaker system.

4. The integrated speaker system according to claim 1, characterized in that When the audio output subsystem determines the note audio file corresponding to the musical instrument striking action according to the audio control instruction, it includes at least one of the following operations: Retrieving a note audio file corresponding to the instrument striking action from a plurality of candidate note audio files stored locally; Retrieving from the cloud an audio file of musical notes corresponding to the striking action of the musical instrument; The audio control instruction is processed according to a preset audio generation method, and a note audio file corresponding to the instrument striking action is generated.

5. The integrated speaker system according to claim 1, characterized in that: The audio output subsystem includes: a data stream synthesis module and a data stream conversion module, wherein: The data stream synthesis module is configured to receive the audio control instruction, determine the note audio file corresponding to the instrument striking action according to the audio control instruction, and synthesize the target audio data stream in real time based on the note audio file; The data stream conversion module is used to perform signal conversion on the target audio data stream to obtain an analog audio signal.

6. The integrated speaker system according to claim 1, characterized in that: The sound playing subsystem includes: a power amplification module and a sound playing module, wherein: The power amplification module is used to amplify the analog audio signal and obtain the amplified analog audio signal; The sound playing module is used to receive the amplified analog audio signal and convert the amplified analog audio signal into sound for playing.

7. The integrated speaker system according to claim 1, characterized in that: The audio output subsystem is further configured to receive an audio data stream sent by a mobile device, perform signal conversion on the audio data stream to obtain an audio signal, and send the audio signal to the sound playing subsystem; The sound playing subsystem is used to receive and play the audio signal.

8. The integrated speaker system according to claim 1, characterized in that: The ultra-wideband spatial positioning subsystem is connected to the data processing subsystem via a wired transmission mode or a wireless transmission mode.

9. The integrated speaker system according to claim 1, characterized in that: The simulated percussion instrument is wirelessly connected to the ultra-wideband spatial positioning subsystem; the wireless communication connection at least includes an ultra-wideband wireless communication connection.

10. The integrated speaker system according to claim 1, characterized in that The sound playing subsystem includes a speaker and / or earphones.

11. A control method for an integrated speaker system, characterized in that: include: Acquiring instrument position information corresponding to a simulated percussion instrument based on an ultra-wideband spatial positioning subsystem, and transmitting the instrument position information to a data processing subsystem; wherein the simulated percussion instrument includes at least a drumstick; the instrument position information includes at least a relative distance and an azimuth; the relative distance being the distance of the simulated percussion instrument relative to the integrated sound box system; The data processing subsystem receives the musical instrument position information, generates an audio control instruction corresponding to the musical instrument striking action according to the musical instrument position information, and sends the audio control instruction to the audio output subsystem; The audio output subsystem receives the audio control instruction, determines a note audio file corresponding to the musical instrument striking action according to the audio control instruction, generates an analog audio signal based on the note audio file, and sends the analog audio signal to the sound playing subsystem; The sound playing subsystem receives the analog audio signal, amplifies the analog audio signal, and converts the amplified analog audio signal into sound for playing.

Images