Pickup device, pickup system and smart home system

Abstract

The invention discloses a pickup device, a pickup system and a smart home system. The pickup device comprises an acquisition module, a signal processing module and a wireless communication module, wherein the acquisition module is used for acquiring an audio signal; the signal processing module is connected with the acquisition module and used for processing the audio signal; and the wireless communication module is connected with the signal processing module and is used for realizing wireless communication with target audio receiving equipment. The device can work independently, does not need to be directly connected with target audio receiving equipment, and performs wireless communication through the wireless communication module, so that the flexibility and portability of the pickup device are improved, the pickup coverage range is expanded, the pickup blind area is reduced, the arrangement is convenient, and voice recognition and voice control failures caused by pickup failures or pickup errors are avoided.

Description

Technical Field

[0001] This invention relates to the field of wireless communication, and in particular to a sound pickup device, a sound pickup system, and a smart home system. Background Technology

[0002] In related technologies, the sound pickup device is integrated with the target audio receiving device, so the sound pickup effect can only be good at a relatively close distance, and the flexibility and portability are low. Sound pickup function can be achieved by adding microphone arrays or far-field sound pickup technology, but it is limited by the sound pickup distance. As the voice distance increases, the voice signal weakens and the influence of noise and interference increases, causing sound pickup failure or error, ultimately leading to the failure of voice recognition and voice control. Summary of the Invention

[0003] The present invention aims to at least solve one of the technical problems existing in the prior art. To this end, one object of the present invention is to provide a sound pickup device that can operate independently without direct connection to a target audio receiving device, and communicates wirelessly via a wireless communication module. This increases the flexibility and portability of the sound pickup device, expands the sound pickup coverage, reduces blind spots, facilitates placement, and avoids sound pickup failures or errors that could lead to speech recognition and voice control failures.

[0004] The second objective of this invention is to provide a sound pickup system.

[0005] The third objective of this invention is to propose a smart home system.

[0006] To address the aforementioned problems, a first aspect of the present invention provides a sound pickup device, comprising: a acquisition module for acquiring audio signals; a signal processing module connected to the acquisition module for processing the audio signals; and a wireless communication module connected to the signal processing module for enabling wireless communication with a target audio receiving device.

[0007] According to the embodiment of the present invention, after the acquisition module acquires the audio signal, the acquisition module processes the acquired audio signal, and then the wireless communication module sends the processed audio signal to the target audio receiving device. The acquisition device can work independently without being directly connected to the target audio receiving device. Wireless communication is achieved through the wireless communication module, which increases the flexibility and portability of the acquisition device, expands the acquisition coverage, reduces blind spots, facilitates placement, and avoids acquisition failure or acquisition error that could lead to failure of speech recognition and voice control.

[0008] In some embodiments, the wireless communication module includes a first LE Audio (Low Energy Audio) module.

[0009] In some embodiments, the first LE Audio module includes a LE Auracast (Low Energy Auracast, Bluetooth Low Energy Broadcast Audio) module.

[0010] In some embodiments, the wireless communication module is also used to broadcast broadcast information containing configuration parameters of the pickup device.

[0011] In some embodiments, the configuration parameters of the pickup device include at least one of broadcast isochronous stream and broadcast isochronous group.

[0012] In some embodiments, the pickup device further includes a power supply unit, which is adapted to house a battery or be connected to a power supply to power the acquisition module, the signal processing module, and the wireless communication module.

[0013] A second aspect of the present invention provides a sound pickup system, including a plurality of sound pickup devices as described in the above embodiments.

[0014] According to the sound pickup system of the present invention, multiple sound pickup devices in the sound pickup system can work independently without being directly connected to the target audio receiving device. They can communicate wirelessly through a wireless communication module, which increases the flexibility and portability of the sound pickup devices, expands the sound pickup coverage, reduces sound pickup blind spots, facilitates placement, and avoids sound pickup failure or sound pickup errors that lead to speech recognition and voice control failures.

[0015] A third aspect of the present invention provides a smart home system, comprising: a sound pickup system as described in the above embodiments, wherein each sound pickup device of the sound pickup system includes a first wireless communication module; at least one audio receiving device, wherein the at least one audio receiving device includes a second wireless communication module; and each of the sound pickup devices and a target audio receiving device in the at least one audio receiving device transmits audio information through the first wireless communication module and the second wireless communication module.

[0016] According to the smart home system of the present invention, the sound pickup system communicates wirelessly with at least one audio receiving device and works independently without needing to be directly connected to the target audio receiving device. This expands the sound pickup coverage of the smart home system, reduces blind spots, facilitates placement, and avoids sound pickup failure or errors that could lead to failure of voice recognition and voice control.

[0017] In some embodiments, the first wireless communication module includes a first LE Audio module, and the second wireless communication module includes a second LE Audio module.

[0018] In some embodiments, the smart home system further includes: an auxiliary device, the auxiliary device including a Bluetooth module, the auxiliary device providing an interactive interface, the auxiliary device scanning broadcast information containing configuration parameters broadcast by the audio pickup device through the Bluetooth module, and configuring the configuration parameters to the target audio receiving device according to the operation instructions of the interactive interface.

[0019] In some embodiments, the audio receiving device further includes: a multi-channel audio data receiving module, configured to receive audio broadcast information sent by the pickup device after configuring the configuration parameters of the pickup device; a speech signal processing module, connected to the multi-channel audio data receiving module, configured to perform mixing and data filtering processing on the audio broadcast information, and normalization and echo cancellation processing on the filtered audio broadcast information; and a speech recognition module, connected to the speech signal processing module, configured to perform speech recognition on the processed audio broadcast information.

[0020] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0021] The above and / or additional aspects and advantages of the present invention will become apparent and readily understood from the description of the embodiments taken in conjunction with the following drawings, in which: Figure 1 This is a structural block diagram of a pickup device according to an embodiment of the present invention; Figure 2 This is a schematic diagram of a pickup device according to an embodiment of the present invention; Figure 3 This is a structural block diagram of a sound pickup system according to an embodiment of the present invention; Figure 4 This is a structural block diagram of a smart home system according to an embodiment of the present invention; Figure 5 This is a schematic diagram of a smart home system according to an embodiment of the present invention.

[0022] Figure label: Smart Home System 1000; 200 microphones; 300 audio receivers; 400 auxiliary devices; Sound pickup device 100; Acquisition module 110; signal processing module 120; wireless communication module 130; power supply unit 140; first wireless communication module 201; Bluetooth module 410; second wireless communication module 310; multi-channel audio data receiving module 320; voice signal processing module 330; voice recognition module 340. Detailed Implementation

[0023] The embodiments of the present invention are described in detail below. The embodiments described with reference to the accompanying drawings are exemplary. The embodiments of the present invention are described in detail below.

[0024] In existing technologies, as voice recognition and voice control technologies become more mature, voice-based human-computer interaction is becoming increasingly widespread. For example, smart TVs can use far-field voice pickup for TV control, and smart speakers can also perform searches and conversations via voice. However, whether it's a smart TV or a smart speaker, the voice pickup device is integrated with the TV and speaker, so the voice pickup effect is only good at relatively close distances.

[0025] To address the above problems, the first aspect of this invention provides a sound pickup device that can operate independently without direct connection to a target audio receiving device. It communicates wirelessly via a wireless communication module, increasing the flexibility and portability of the sound pickup device, expanding the sound pickup coverage, reducing blind spots, facilitating placement, and preventing sound pickup failures or errors that could lead to speech recognition and voice control failures.

[0026] like Figure 1 As shown, the pickup device 100 includes: a data acquisition module 110, a signal processing module 120, and a wireless communication module 130.

[0027] The acquisition module 110 is used to acquire audio signals; the signal processing module 120 is connected to the acquisition module 110 and is used to process audio signals; the wireless communication module 130 is connected to the signal processing module 120 and is used to realize wireless communication with the target audio receiving device.

[0028] Specifically, the target audio receiving device can be understood as an audio receiving device that wirelessly communicates with the pickup device, such as a smart TV, smart speaker, or smart refrigerator. When the pickup device 100 is working, the acquisition module 110 captures audio signals from the environment, which can be achieved through audio sensors such as microphones. The acquisition module 110 converts the acquired audio signals into electrical signals. The acquisition module can capture weak signals and simultaneously perform noise reduction to improve audio signal quality. The signal processing module 120 processes the acquired audio signals, which may include filtering, enhancement, and compression to improve sound quality, reduce data volume, and eliminate noise. The wireless communication module 130 is connected to the signal processing module 120 and wirelessly transmits the processed audio signal to the target audio receiving device, thus realizing communication between the pickup device 100 and the target audio receiving device.

[0029] According to the embodiment of the present invention, after the acquisition module acquires the audio signal, the acquisition module processes the acquired audio signal, and then the wireless communication module sends the processed audio signal to the target audio receiving device. The acquisition device can work independently without being directly connected to the target audio receiving device. Wireless communication is achieved through the wireless communication module, which increases the flexibility and portability of the acquisition device, expands the acquisition coverage, reduces blind spots, facilitates placement, and avoids acquisition failure or acquisition error that could lead to failure of speech recognition and voice control.

[0030] In some embodiments, the wireless communication module 130 includes a first LE Audio module.

[0031] Specifically, LE Audio is a new generation of Bluetooth audio technology standard based on the Bluetooth 5.2 specification. Its main feature is the new high-quality, low-power audio decoder LC3 (Low Complexity Communication Codec). This encoding combines high quality and low power consumption, with high encoding efficiency and quality, providing good audio quality at low bit rates. At the same time, LE Audio also supports multi-stream audio and broadcast audio technologies.

[0032] In some embodiments, the first LE Audio module includes the LE Auracast module.

[0033] Specifically, LE Auracast is an important component of the Bluetooth LE (Low Power) audio standard. It represents a revolutionary Bluetooth audio sharing technology. LE Auracast allows audio source devices (such as smartphones, tablets, TVs, or sound systems) to broadcast one or more audio streams to an unlimited number of Bluetooth audio receivers (such as earbuds, headphones, etc.). This broadcasting method does not require the traditional Bluetooth pairing process, making audio sharing more convenient and flexible.

[0034] In some embodiments, the wireless communication module is also used to broadcast broadcast information containing configuration parameters of the pickup device.

[0035] Specifically, the wireless communication module 130 is a device capable of wireless data transmission. It can transmit data via wireless signals, thereby enabling remote data exchange and sharing. In the microphone 100, the wireless communication module can broadcast configuration parameters, status information, and other data of the microphone 100, so that the target audio receiving device can understand the working status and performance characteristics of the microphone and perform corresponding processing. The microphone 100 typically has a variety of configuration parameters, and the settings of these parameters have a significant impact on the performance and effect of the microphone 100.

[0036] In some embodiments, the configuration parameters of the pickup device include at least one of broadcast isochronous stream and broadcast isochronous group.

[0037] Specifically, the broadcast isochronous stream and broadcast isochronous group configured in the pickup device 100 may include information such as sampling rate and data path. The broadcast isochronous stream of the pickup device 100 refers to the continuous data stream during the transmission of audio data from the pickup device 100 to the audio receiving device. This data stream is usually transmitted at a certain sampling rate and bit rate to ensure the integrity and quality of the audio data. The broadcast isochronous group of the pickup device 100 refers to organizing multiple pickup devices 100 or audio receiving devices into a group so as to receive or send audio data simultaneously. This grouping method is usually used to realize the synchronous playback or acquisition of audio data. The sampling rate of the pickup device 100 refers to the frequency at which the sound signal is sampled within a certain period of time, usually expressed in Hertz (Hz). The sampling rate directly determines the ability of the pickup device 100 to accurately record and reproduce sound information. The data path of the pickup device 100 mainly involves the acquisition, transmission and processing of sound signals.

[0038] In some embodiments, such as Figure 1 As shown, the pickup device 100 also includes a power supply unit 140.

[0039] The power supply unit 140 is adapted to house a battery or be connected to a power supply to power the acquisition module 110, the signal processing module 120 and the wireless communication module 130.

[0040] Specifically, the power supply unit 140 can be a battery slot for placing batteries or an interface for connecting to a power source. If the power supply unit 140 is a battery slot, batteries can be placed to power the acquisition module 110, the signal processing module 120, and the wireless communication module 130. In this case, the microphone 100 can be placed anywhere, increasing the flexibility and portability of the microphone 100 and expanding the microphone coverage area.

[0041] For example, the purpose of this invention is to separate the microphone and use Auracast technology to transmit audio to the recognition system. Auracast is a periodic broadcast technology based on Bluetooth Low Energy, enabling audio transmission on broadcast channels such as BIG (Broadcast Isochronous Group) and BIS (Broadcast Isochronous Stream). Based on Auracast technology, multiple microphones can be deployed in a limited space to expand the microphone coverage and reduce blind spots; furthermore, since Auracast is based on Bluetooth Low Energy (BLE) technology, the microphones can be battery-powered, making deployment very convenient.

[0042] like Figure 2 The working steps of the pickup device are explained as shown below: The microphone is used to capture audio signals from the environment and send the captured audio signals to the signal processing module; the signal processing module samples, filters, and encodes the audio signals; the Bluetooth Low Energy Auracast module is used to enable wireless communication and audio broadcasting with a TV or speaker; the battery power supply provides power to the voice pickup device, ensuring its ability to work independently.

[0043] The voice pickup device of this invention employs Auracast technology with Bluetooth Low Energy (BLE) Audio for audio broadcasting. This technology features low power consumption and can be powered by a battery, eliminating the need for an external power source and increasing the device's flexibility and portability. The voice pickup device operates independently of a television or speaker, requiring no direct connection. By pairing with a television or speaker, the device can receive and broadcast audio signals, achieving wireless transmission and reception. In a limited space, multiple voice pickup devices can be deployed to achieve sufficient coverage and reduce blind spots. The multiple devices are synchronized and coordinated using Auracast technology to ensure the stability and accuracy of audio signal transmission within the coverage area.

[0044] A second aspect of the present invention provides a sound pickup system, such as... Figure 3 As shown, the pickup system 200 includes multiple pickup devices 100.

[0045] According to the sound pickup system of the present invention, multiple sound pickup devices in the sound pickup system can work independently without being directly connected to the target audio receiving device. They can communicate wirelessly through a wireless communication module, which increases the flexibility and portability of the sound pickup devices, expands the sound pickup coverage, reduces sound pickup blind spots, facilitates placement, and avoids sound pickup failure or sound pickup errors that lead to speech recognition and voice control failures.

[0046] A third aspect of the present invention provides a smart home system, such as... Figure 4 As shown, the smart home system 1000 includes: a sound pickup system 200 and at least one audio receiving device 300.

[0047] In this system, each pickup device 100 of the pickup system 200 includes a first wireless communication module 201; at least one audio receiving device 300 includes a second wireless communication module 310; each pickup device 100 and a target audio receiving device in at least one audio receiving device 300 transmit audio information through the first wireless communication module 201 and the second wireless communication module 310.

[0048] Specifically, the sound pickup system 200 has multiple sound pickup devices 100, and each sound pickup device 100 includes a first wireless communication module 201. The first wireless communication module 201 can be understood as a wireless communication module located in the sound pickup device 100. Therefore, the sound pickup device 100 can be set at any location where it needs to be set to expand the coverage area. When the smart home system is working, the multiple sound pickup devices 100 acquire audio signals in the environment, and the first wireless communication module 201 transmits the audio signals wirelessly to the second wireless communication module 310 in the audio receiving device 300 to realize communication between the sound pickup device 100 and the target audio receiving device. The second wireless communication module 310 can be understood as a wireless communication module located in the audio receiving device 300.

[0049] According to the smart home system of the present invention, the sound pickup system communicates wirelessly with at least one audio receiving device and works independently without needing to be directly connected to the target audio receiving device. This expands the sound pickup coverage of the smart home system, reduces blind spots, facilitates placement, and avoids sound pickup failure or errors that could lead to failure of voice recognition and voice control.

[0050] In some embodiments, the first wireless communication module 201 includes a first LE Audio module, and the second wireless communication module 310 includes a second LE Audio module.

[0051] Specifically, the first wireless communication module 201 and the second wireless communication module 310 communicate wirelessly with the second LE Audio module through the first LE Audio module to ensure audio quality during wireless communication.

[0052] In some embodiments, such as Figure 4 As shown, the smart home system 1000 also includes auxiliary devices 400.

[0053] The auxiliary device 400 includes a Bluetooth module 410. The auxiliary device 400 provides an interactive interface. The auxiliary device 400 scans the broadcast information containing configuration parameters broadcast by the pickup device 100 through the Bluetooth module 410, and configures the configuration parameters to the target audio receiving device according to the operation instructions of the interactive interface.

[0054] Specifically, the auxiliary device 400 can be a mobile phone, etc. Before the smart home system 1000 starts working, the auxiliary device 400 configures the microphone 100 and the target audio receiving device. For target audio receiving devices that provide an operating interface, they can also be configured themselves. For example, a TV or stereo that provides an operating interface can be configured itself. If the target audio receiving device does not provide an operating interface, the auxiliary device 400 provides an interactive interface. When the microphone 100 and the target audio receiving device are configured, the auxiliary device 400 scans the broadcast information of the configuration parameters of the microphone 100 through the Bluetooth module 410, and then configures the configuration parameters to the target audio receiving device.

[0055] In some embodiments, such as Figure 4 As shown, the audio receiving device 300 also includes: a multi-channel audio data receiving module 320, a voice signal processing module 330, and a voice recognition module 340.

[0056] The multi-channel audio data receiving module 320 is used to receive audio broadcast information sent by the pickup device 100 after the configuration parameters of the pickup device 100 are configured; the voice signal processing module 330 is connected to the multi-channel audio data receiving module 320 and is used to perform mixing and data filtering processing on the audio broadcast information, as well as normalization and echo cancellation processing on the audio broadcast information after data filtering; the voice recognition module 340 is connected to the voice signal processing module 330 and is used to perform voice recognition on the processed audio broadcast information.

[0057] Specifically, the audio receiving device 300 is first configured with the pickup device 100. After configuration, the audio receiving device 300 receives the audio broadcast information sent by the pickup device 100 through the second wireless communication module 310. The multi-channel audio data receiving module 320 obtains the audio broadcast information received by the second wireless communication module 310 and sends the audio broadcast information to the voice signal processing module 330. The voice signal processing module 330 processes the audio broadcast information and sends the processed audio broadcast information to the voice recognition module 340. The voice recognition module 340 performs voice recognition on the audio broadcast information to obtain the corresponding operation instructions, enabling the audio receiving device 300 to perform the corresponding operation.

[0058] For example, such as Figure 5 As shown, in actual use cases, the mobile phone, as an auxiliary device, first scans the broadcast information of the microphone, and then configures the parameters of the microphone into the smart TV or smart speaker. The parameters include BIS and BIG. After the configuration is completed, the smart TV / smart speaker can receive the audio data Audio Streams collected by the microphone through BIS / BIG, and perform steps such as speech signal processing and normalized echo cancellation to obtain speech feature information, and finally perform speech recognition.

[0059] The sound pickup device of this invention is independent of the TV or speaker and does not require direct connection, providing greater flexibility and portability; it adopts Auracast technology with low-power Bluetooth LE Audio, which effectively extends battery life and enables long-term use; by arranging multiple voice pickup devices, the coverage area can be expanded and the pickup blind spot can be reduced, providing better audio pickup effect.

[0060] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example.

[0061] Although embodiments of the invention have been shown and described, those skilled in the art will understand that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.

Claims

1. A sound pickup device, characterized in that, include: The acquisition module is used to acquire audio signals; A signal processing module, connected to the acquisition module, is used to process the audio signal; A wireless communication module, connected to the signal processing module, is used to enable wireless communication with the target audio receiving device.

2. The pickup device according to claim 1, characterized in that, The wireless communication module includes a first LE Audio module.

3. The pickup device according to claim 2, characterized in that, The first LE Audio module includes the LEAuracast module.

4. The pickup device according to claims 1-3, characterized in that, The wireless communication module is also used to broadcast broadcast information containing the configuration parameters of the pickup device.

5. The pickup device according to claim 3, characterized in that, The configuration parameters of the pickup device include at least one of broadcast isochronous stream and broadcast isochronous group.

6. The pickup device according to any one of claims 1-3, characterized in that, The pickup device also includes: The power supply unit is adapted to house a battery or be connected to a power supply to power the acquisition module, the signal processing module, and the wireless communication module.

7. A sound pickup system, characterized in that, It includes multiple pickup devices as described in any one of claims 1-6.

8. A smart home system, characterized in that, include: The pickup system of claim 7, wherein each pickup device of the pickup system includes a first wireless communication module; At least one audio receiving device, wherein the at least one audio receiving device includes a second wireless communication module; Each of the pickup devices transmits audio information to the target audio receiving device in the at least one audio receiving device through the first wireless communication module and the second wireless communication module.

9. The smart home system according to claim 8, characterized in that, The first wireless communication module includes a first LE Audio module, and the second wireless communication module includes a second LE Audio module.

10. The smart home system according to claim 9, characterized in that, The smart home system also includes: An auxiliary device, including a Bluetooth module, provides an interactive interface. The auxiliary device scans broadcast information containing configuration parameters broadcast by the sound pickup device through the Bluetooth module, and configures the configuration parameters to the target audio receiving device according to the operation instructions of the interactive interface.

11. The smart home system according to claim 10, characterized in that, The audio receiving device also includes: A multi-channel audio data receiving module is used to receive audio broadcast information sent by the pickup device after the configuration parameters of the pickup device are configured. The voice signal processing module is connected to the multi-channel audio data receiving module and is used to perform mixing and data filtering on the audio broadcast information, as well as normalization and echo cancellation on the filtered audio broadcast information. A speech recognition module, connected to the speech signal processing module, is used to perform speech recognition on the processed audio broadcast information.

Images