Intelligent glasses with recording function

Abstract

The utility model relates to the field of wearable equipment, and provides intelligent glasses with a recording function, comprising a first pickup module used for acquiring a first audio signal; the first communication module is used for receiving a second audio signal acquired by the second pickup module and transmitted by the wireless communication equipment; the noise reduction processing module is used for receiving the first audio signal and the second audio signal, and performing noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced audio signal; and the signal conversion module is used for acquiring the noise-reduced audio signal and converting the noise-reduced audio signal into a sound signal. The environment audio is acquired through the second pickup module on the external mobile device, so that the number of pickup modules on the intelligent glasses is reduced, and the weight and the size of the intelligent glasses are reduced; and the mobile equipment is far away from the intelligent glasses, so that the environment audio collected by the second pickup module on the mobile equipment is more suitable for reducing the noise of the voice audio.

Description

Technical Field

[0001] This application relates to the field of wearable devices, and more particularly to a smart glasses with recording function. Background Technology

[0002] Smart glasses are typically worn on the head, close to the vocal and auditory organs, and their recording function is increasingly popular. To reduce the impact of environmental noise on sound pickup, at least two microphones in different locations are usually installed on the smart glasses to collect two audio signals. Due to the direction and characteristics of noise signal propagation, the noise signals collected by the two microphones often differ. Subtracting the second audio signal from the first can cancel out most of the noise components, resulting in a cleaner voice signal. However, installing multiple microphones not only increases the weight of the smart glasses but also occupies internal space, affecting the layout of other functional components and increasing the overall size of the glasses, thus impacting the user's wearing experience. Summary of the Invention

[0003] The main purpose of this application is to provide a smart glasses with recording function, aiming to reduce the size and weight of the smart glasses with recording function, thereby improving the wearing experience.

[0004] In a first aspect, this application provides smart glasses with recording function, the smart glasses comprising:

[0005] The first pickup module is used to acquire the first audio signal;

[0006] A first communication module is configured to connect to a wireless communication device and receive a second audio signal transmitted by the wireless communication device and acquired by a second pickup module.

[0007] A noise reduction processing module is used to receive the first audio signal and the second audio signal, and to perform noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced frequency signal corresponding to the first audio signal;

[0008] A signal conversion module is used to acquire the noise-reduced frequency signal and convert the noise-reduced frequency signal into an audio signal.

[0009] In some embodiments, the smart glasses further include a storage module for acquiring and storing the sound signal output by the signal processing module.

[0010] In some embodiments, the first communication module is any one of a Bluetooth module, a WIFI module, a ZigBee module, and a Thread module. The smart glasses connect to the wireless communication device through the first communication module and receive the second audio signal obtained by the second pickup module on the wireless communication device.

[0011] In some embodiments, the first communication module is further configured to send an audio signal acquisition instruction to the wireless communication device when it receives a recording instruction from the smart glasses.

[0012] In some embodiments, the first sound pickup module is disposed in at least one of the frame and temple of the smart glasses.

[0013] In some embodiments, the first audio signal is an audio signal containing a speech signal and a noise signal, the second audio signal is an audio signal containing a noise signal, or both the first audio signal and the second audio signal are audio signals containing a speech signal and a noise signal.

[0014] In some embodiments, the noise reduction processing module is used to perform a difference operation on the first audio signal and the second audio signal to obtain the noise-reduced audio signal.

[0015] In some embodiments, the smart glasses with recording function further include a voiceprint recognition module, which is used to identify the collected sound information based on preset voiceprint information when human voice information is recognized, and to collect a first audio signal when the identification result matches a preset object.

[0016] In some embodiments, the sound signal is used to transmit to a wireless communication device, which is any one of a mobile phone, tablet, smartwatch, smart bracelet, or smart ring.

[0017] Secondly, embodiments of this application also provide smart glasses with recording function, the smart glasses comprising:

[0018] The first pickup module is used to acquire the first audio signal;

[0019] A first communication module is configured to connect to a wireless communication device and to send the first audio signal and receive a sound signal transmitted from the wireless communication device.

[0020] The wireless communication device includes a second microphone module, a second communication module, a noise reduction processing module, and a signal conversion module. The second microphone module is used to acquire a second audio signal, the second communication module is used to receive a first audio signal sent by the first communication module, the noise reduction processing module is used to perform noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced frequency signal corresponding to the first audio signal, and the signal conversion module is used to acquire the noise-reduced frequency signal and convert the noise-reduced frequency signal into the sound signal.

[0021] The smart glasses with recording function provided in this application include a first sound pickup module for acquiring a first audio signal; a first communication module for connecting to a wireless communication device and receiving a second audio signal acquired by a second sound pickup module transmitted by the wireless communication device; a noise reduction processing module for receiving the first audio signal and the second audio signal, and performing noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced frequency signal corresponding to the first audio signal; and a signal conversion module for acquiring the noise-reduced frequency signal and converting the noise-reduced frequency signal into a sound signal. Since the second audio signal used for noise reduction processing is ambient audio collected by the second sound pickup module on an external wireless communication device, the number of sound pickup modules on the smart glasses is reduced, thereby reducing the weight and size of the smart glasses. Furthermore, since the wireless communication device itself is relatively far from the smart glasses, the ambient audio collected by the second sound pickup module on the wireless communication device is more suitable for noise reduction processing of voice audio. Attached Figure Description

[0022] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 A schematic block diagram of a smart glasses with recording function provided in this application embodiment;

[0024] Figure 2 A schematic block diagram illustrating the structure of smart glasses with recording function interacting with a wireless communication device, as provided in this application embodiment;

[0025] Figure 3 A schematic block diagram illustrating the structure of a smart glasses with recording function interacting with a remote communication device, as provided in this application embodiment;

[0026] Figure 4 A schematic block diagram of a smart glasses with recording function provided in an embodiment of this application;

[0027] Figure 5 This is a schematic block diagram of a smart glasses with recording function provided in another embodiment of this application. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0029] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0030] This application provides a smart glasses with recording function.

[0031] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0032] Please refer to Figure 1-2 , Figure 1 A schematic block diagram of a smart glasses with recording function provided in this application embodiment; Figure 2 This is a schematic block diagram illustrating the structure of smart glasses with recording function interacting with a wireless communication device, as provided in an embodiment of this application.

[0033] like Figure 1 , 2 As shown, the smart glasses include:

[0034] The first pickup module is used to acquire the first audio signal;

[0035] A first communication module is configured to connect to a wireless communication device and receive a second audio signal transmitted by the wireless communication device and acquired by a second pickup module.

[0036] A noise reduction processing module is used to receive the first audio signal and the second audio signal, and to perform noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced frequency signal corresponding to the first audio signal;

[0037] A signal conversion module is used to acquire the noise-reduced frequency signal and convert the noise-reduced frequency signal into an audio signal.

[0038] Specifically, this application utilizes the principle of Differential Microphone Array (DMA) to achieve sound pickup and noise reduction. That is, when two pickup modules (microphones) are placed at a certain distance, they respond differently to sounds coming from different directions. Since both smart glasses and wireless communication devices have pickup modules, when they are not far apart, the amplitude of the voice signals they collect is roughly the same. However, for noise signals, due to their propagation direction and characteristics, the noise signals collected by the two microphones often differ. Therefore, in this application, by subtracting the second audio signal collected by the second microphone from the first audio signal collected by the first microphone, noise components are eliminated or reduced through adaptive filtering or differential operations. The noise-reduced audio signal is then processed to obtain a clean voice signal.

[0039] Furthermore, in this application, the first audio signal can be an audio signal containing both speech and noise signals, and the second audio signal can be an audio signal containing noise signals; of course, both the first and second audio signals can also be audio signals containing both speech and noise signals.

[0040] Among them, the voice signal can be the audio signal corresponding to the sound of the user speaking while wearing smart glasses, and the noise signal can be the environmental noise in the environment where the smart glasses are located, such as wind noise, conversations of other people in the environment, etc.

[0041] In related technologies, noise signals are typically collected by additional microphones on smart glasses, which increases the weight and size of the smart glasses. Furthermore, because the microphones used to collect noise signals are close to the first microphone module used to collect speech signals, the noise signals and speech signals are not significantly different, resulting in poor noise reduction.

[0042] In practical applications, smart glasses are usually connected to wireless communication devices such as mobile phones, for example via Bluetooth. Therefore, ambient audio can be acquired through the microphone built into the mobile phone or other wireless communication device, thereby reducing the size and weight of the smart glasses and increasing the significance of the difference between the acquired ambient audio and speech audio, thus improving the noise reduction effect.

[0043] Of course, it is not limited to this. Wireless communication devices can also be tablets, smartwatches, smart bracelets, smart rings, and other electronic devices that can realize wireless communication connection and data transmission functions, without any limitation.

[0044] For example, the sound signal obtained by the smart glasses provided in this application embodiment can be used with other mobile devices or stored locally as recorded audio. Please refer to... Figure 3 , Figure 3 This is a schematic block diagram illustrating the structure of a smart glasses with recording function interacting with a remote communication device, as provided in an embodiment of this application.

[0045] In some embodiments, the smart glasses further include a remote communication module, the second communication module being used to acquire the audio signal output by the signal conversion module and transmit the audio signal to a remote communication device.

[0046] like Figure 3 As shown, the audio signal output by the signal conversion module can be used for voice calls. The remote communication module then outputs the audio signal to a remote communication device, enabling voice calls between the smart glasses and the remote communication device. Because the smart glasses are worn close to the throat and ear, users can make voice calls without holding the device, thus improving the convenience of voice calls.

[0047] As is understandable, voice calls between smart glasses and remote communication devices include, but are not limited to, voice messages, voice calls, video calls, and online conferences. Smart glasses and remote communication devices can send and receive signals through communication networks such as base stations and mobile switching centers, which will not be elaborated upon here.

[0048] Please refer to Figure 4 , Figure 4 This is a schematic block diagram of a smart glasses with recording function provided in an embodiment of this application.

[0049] In some embodiments, the smart glasses further include a storage module for acquiring and storing the sound signal output by the signal processing module.

[0050] like Figure 4 As shown, smart glasses can also directly store the noise-reduced audio signal into the storage module, thereby enabling the recording function of smart glasses. For example, smart glasses can be used to record audio and record audio while shooting videos.

[0051] Of course, it's not limited to this. Figure 3 , 4The embodiments can also be combined to store the audio signal while making a call, thereby recording the content of the call on the smart glasses, which will not be elaborated here.

[0052] In some implementations, the first communication module is any one of a Bluetooth module, a WIFI module, a ZigBee module, and a Thread module. The smart glasses connect to the wireless communication device through the first communication module and receive the second audio signal obtained by the second pickup module on the wireless communication device.

[0053] Optionally, the first communication module is selected from any one of Bluetooth module, WIFI module, ZigBee module, and Thread module.

[0054] For example, due to Bluetooth's advantages in low latency, low power consumption, and stability in audio transmission, and its ability to transmit and decode multiple audio formats, smart glasses and mobile devices can be connected via Bluetooth modules, such as through Bluetooth Low Energy (BLE) technology.

[0055] In some embodiments, the first communication module shown is further configured to send an audio signal acquisition instruction to the wireless communication device when it receives a recording instruction from the smart glasses.

[0056] For example, when the smart glasses receive a recording instruction, they control the first communication module to send an audio signal acquisition instruction to the wireless communication device; when the wireless communication device receives the audio signal acquisition instruction from the smart glasses, it collects environmental audio information and sends it to the smart glasses, thus avoiding the leakage of user privacy and avoiding uninterrupted audio transmission between the mobile device and the smart glasses, thereby reducing the information transmission cost between the mobile device and the smart glasses.

[0057] In some embodiments, the first communication module shown is further configured to send an audio signal acquisition instruction to the mobile device after the voiceprint recognition module has completed identity verification of the collected voice information.

[0058] Specifically, the smart glasses also include a voiceprint recognition module. When a human voice is detected, the voiceprint recognition module can identify the identity of the collected sound information based on the preset voiceprint information. When the identity recognition result matches the preset object, it collects environmental audio information and sends it to the smart glasses.

[0059] In some embodiments, the first microphone module is disposed in at least one of the frame or temple of the smart glasses.

[0060] For example, to avoid the first microphone module on the smart glasses obstructing the user's view, the first microphone module should be placed anywhere on the frame or temple of the smart glasses.

[0061] For example, in order to improve the quality of the collected voice audio, the first pickup module is set on the side of the frame or temple of the smart glasses that is close to the face. The first pickup module can collect audio information obtained through air conduction or bone conduction.

[0062] For example, the first microphone module can be installed in a microphone module mounting position with a sound inlet, preventing the first microphone module from being exposed on the surface of the smart glasses. A mesh cover can also be installed at the sound inlet to prevent foreign objects from entering the microphone module mounting position and affecting the microphone module's sound pickup.

[0063] In some implementations, the noise reduction processing module is used to perform a difference operation on the first audio signal and the second audio signal to obtain the noise-reduced audio signal.

[0064] For example, since the ambient noise in the second audio signal is generally in the far field, the loudness of the ambient noise in the first audio signal collected by the smart glasses and the second audio signal collected by the wireless communication device is basically the same. However, the smart glasses are closer to the human vocal organs, while the wireless communication device is farther away from the vocal organs. Therefore, the human voice in the second audio signal will be significantly softer than the human voice in the first audio signal. Thus, the noise reduction processing module can perform difference calculations to eliminate the ambient noise in the first audio signal using the second audio signal, thereby obtaining a noise-reduced audio signal.

[0065] In some implementations, the noise reduction processing module includes a digital signal processor or a field-programmable gate array.

[0066] For example, noise reduction of the first audio signal is implemented using a digital signal processor (DSP) or a field-programmable gate array (FPGA). A DSP can process audio signals in real time for efficient noise reduction, while an FPGA can process multiple signal streams simultaneously, making it suitable for real-time noise reduction systems.

[0067] The smart glasses with recording function provided in this application include a first sound pickup module for acquiring a first audio signal; a first communication module for connecting to a wireless communication device and receiving a second audio signal acquired by a second sound pickup module transmitted by the wireless communication device; a noise reduction processing module for receiving the first audio signal and the second audio signal, and performing noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced frequency signal corresponding to the first audio signal; and a signal conversion module for acquiring the noise-reduced frequency signal and converting the noise-reduced frequency signal into a sound signal. Since the second audio signal used for noise reduction processing is ambient audio collected by the second sound pickup module on an external wireless communication device, the number of sound pickup modules on the smart glasses is reduced, thereby reducing the weight and size of the smart glasses. Furthermore, since the wireless communication device itself is relatively far from the smart glasses, the ambient audio collected by the second sound pickup module on the wireless communication device is more suitable for noise reduction processing of voice audio.

[0068] Please refer to Figure 5 , Figure 5 This is a schematic block diagram of a smart glasses with recording function provided in another embodiment of this application.

[0069] like Figure 5 As shown, this application also provides smart glasses with recording function, the smart glasses comprising:

[0070] The first pickup module is used to acquire the first audio signal;

[0071] A first communication module is configured to connect to a wireless communication device and to send the first audio signal and receive a sound signal transmitted from the wireless communication device.

[0072] The wireless communication device includes a second microphone module, a second communication module, a noise reduction processing module, and a signal conversion module. The second microphone module is used to acquire a second audio signal, the second communication module is used to receive a first audio signal sent by the first communication module, the noise reduction processing module is used to perform noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced frequency signal corresponding to the first audio signal, and the signal conversion module is used to acquire the noise-reduced frequency signal and convert the noise-reduced frequency signal into the sound signal.

[0073] For example, the wireless communication device can acquire a first audio signal collected by the first pickup module of the smart glasses, and a second audio signal collected by its own second pickup module. The device then uses its noise reduction processing module to perform noise reduction processing on the first audio signal based on the second audio signal to obtain a noise-reduced frequency signal. The first communication module can be any one of a Bluetooth module, a Wi-Fi module, a ZigBee module, or a Thread module. The wireless communication device converts the noise-reduced frequency signal into an audio signal, which can be transmitted to the smart glasses or stored in the device's storage module as needed.

[0074] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the smart glasses with recording function described above can be referred to the corresponding process in the foregoing embodiments, and will not be repeated here.

[0075] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of the application. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0076] It should also be understood that the term "and / or" as used in this specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, herein, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0077] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments. The above descriptions are merely specific implementations of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A pair of smart glasses with recording function, characterized in that, The smart glasses include: The first pickup module is used to acquire the first audio signal; A first communication module is configured to connect to a wireless communication device and receive a second audio signal transmitted by the wireless communication device and acquired by a second pickup module. A noise reduction processing module is used to receive the first audio signal and the second audio signal, and to perform noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced frequency signal corresponding to the first audio signal; A signal conversion module is used to acquire the noise-reduced frequency signal and convert the noise-reduced frequency signal into an audio signal.

2. The smart glasses with recording function according to claim 1, characterized in that, The smart glasses also include a storage module, which is used to acquire and store the sound signal output by the signal conversion module.

3. The smart glasses with recording function according to claim 1, characterized in that, The first communication module is any one of Bluetooth module, WIFI module, ZigBee module, and Thread module. The smart glasses connect to the wireless communication device through the first communication module and receive the second audio signal obtained by the second pickup module on the wireless communication device.

4. The smart glasses with recording function according to claim 1, characterized in that, The first communication module is also used to send an audio signal acquisition instruction to the wireless communication device when it receives the recording instruction from the smart glasses.

5. The smart glasses with recording function according to claim 1, characterized in that, The first sound pickup module is disposed in at least one of the frame and temple of the smart glasses.

6. The smart glasses with recording function according to claim 1, characterized in that, The first audio signal is an audio signal containing speech signals and noise signals, the second audio signal is an audio signal containing noise signals, or both the first audio signal and the second audio signal are audio signals containing speech signals and noise signals.

7. The smart glasses with recording function according to claim 1, characterized in that, The noise reduction processing module is used to perform a difference operation on the first audio signal and the second audio signal to obtain the noise-reduced audio signal.

8. The smart glasses with recording function according to claim 1, characterized in that, The smart glasses with recording function also include a voiceprint recognition module. The voiceprint recognition module is used to identify the identity of the collected sound information based on preset voiceprint information when human voice information is detected. When the identity recognition result matches the preset object, the first audio signal is collected.

9. The smart glasses with recording function according to claim 1, characterized in that, The wireless communication device is any one of a mobile phone, tablet, smartwatch, smart bracelet, or smart ring.

10. A pair of smart glasses with recording function, characterized in that, The smart glasses include: The first pickup module is used to acquire the first audio signal; A first communication module is configured to connect to a wireless communication device and to send the first audio signal and receive a sound signal transmitted from the wireless communication device. The wireless communication device includes a second microphone module, a second communication module, a noise reduction processing module, and a signal conversion module. The second microphone module is used to acquire a second audio signal, the second communication module is used to receive a first audio signal sent by the first communication module, the noise reduction processing module is used to perform noise reduction processing on the first audio signal according to the second audio signal to obtain a noise-reduced frequency signal corresponding to the first audio signal, and the signal conversion module is used to acquire the noise-reduced frequency signal and convert the noise-reduced frequency signal into the sound signal.

Images