An audio camera system and smart glasses

Abstract

This application provides an audio camera system and smart glasses. The smart glasses include a frame and two temples hinged to the ends of the frame. The audio camera system includes a housing and a clamping structure for detachably mounting the housing to the temples. An image acquisition device is disposed at one end of the housing near the frame. A first microphone for acquiring ambient sound and a second microphone for acquiring human voice are disposed on the housing. A speaker is disposed near the wearer's ear, and the speaker is used to output an audio signal to the wearer that has removed ambient noise. A main control unit connected to the image acquisition device, the first microphone, the second microphone, and the speaker is disposed inside the housing. This application uses dual microphones to acquire human voice and ambient sound separately, which can reduce interference from ambient noise. The microphones can be disassembled and replaced as needed, thus improving the user experience.

Description

Technical Field

[0001] This application belongs to the field of audio processing technology, specifically relating to an audio camera system and smart glasses. Background Technology

[0002] Smart glasses are intelligent devices that integrate technologies such as optical display, image acquisition, and wireless communication. Wearers can use voice commands, touch operations, or gestures to control the smart glasses to perform operations such as real-time display of navigation information, capture high-definition images, make voice calls, and translate languages, significantly improving the wearer's information acquisition efficiency and meeting the wearer's multi-dimensional information acquisition needs.

[0003] However, most existing smart glasses adopt an integrated design, and the fixed audio components are difficult to adjust the position or disassemble and replace according to the wearer's needs. Replacing the whole thing would bring additional costs. At the same time, traditional smart glasses are only equipped with a single microphone, which makes it difficult to distinguish human voices from environmental noise in some noisy environments. Their audio output cannot optimize environmental noise, making sound playback susceptible to external interference and unable to guarantee the accuracy of voice interaction in complex environments. Utility Model Content

[0004] This application provides an audio camera system and smart glasses, which use dual microphones to collect human voice and ambient sound respectively, reducing interference from environmental noise. The system can be disassembled and replaced as needed, effectively improving the user experience.

[0005] To address the aforementioned technical problems, this application provides an audio camera system for use in smart glasses, the smart glasses including a frame and two temples hinged to the ends of the frame; The audio camera system includes a housing and a clamping structure for detachably mounting the housing to the temple; An image acquisition device is provided at one end of the housing near the frame. The housing is provided with a first microphone for acquiring ambient sound and a second microphone for acquiring human voice. A speaker is provided at the position of the housing near the wearer's ear. The speaker is used to output an audio signal to the wearer to remove ambient noise. The housing contains a main control unit that is connected to the image acquisition device, the first microphone, the second microphone, and the speaker.

[0006] As a further improvement of this application, the housing is provided with a control button for waking up the image acquisition device to take pictures, and the control button is connected to the main control unit.

[0007] As a further improvement of this application, an ambient light sensor is also provided at one end of the housing near the lens frame. The ambient light sensor is connected to the main control unit to detect the light intensity of the current shooting environment.

[0008] As a further improvement of this application, a power supply unit is provided inside the housing, and a charging interface connected to the power supply unit is provided on the housing.

[0009] As a further improvement of this application, a communication unit is provided inside the housing, and the communication unit includes at least a Bluetooth module and a WIFI module.

[0010] As a further improvement to this application, the clamping structure is used to detachably mount the housing to the side of the temple closest to the wearer.

[0011] As a further improvement of this application, the clamping structure includes at least two spring clips disposed on the housing; Alternatively, the clamping structure may include a connecting buckle disposed on the housing; Alternatively, the clamping structure may include a permanent magnet disposed on the housing and a magnetic adsorption body disposed on the temple that can magnetically attract the permanent magnet.

[0012] As a further improvement of this application, a graphene heat sink is provided inside the housing.

[0013] As a further improvement to this application, the housing is made of at least one lightweight material selected from plastic, aluminum alloy, and carbon fiber composite material.

[0014] As a further improvement to this application, this application provides a smart glasses, wherein the audio camera system described in any of the above claims is detachably mounted on the temples of the smart glasses.

[0015] Compared with existing technologies, the audio camera system and smart glasses provided in this application sample environmental noise through a first microphone and collect human voice through a second microphone. The speaker is placed close to the wearer's ear, thereby directionally transmitting the noise-reduced audio signal to the wearer's ear. This avoids spatial attenuation and the superposition of environmental noise when playing audio aloud, ensuring that the wearer can still clearly receive the audio signal in high-noise environments. The clamping structure enables a detachable connection between the audio camera system and the temples of the smart glasses, making it easy for the wearer to disassemble and replace the glasses as needed, reducing costs while improving the user experience. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this utility model or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this utility model. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a functional block diagram of an audio camera system provided in an embodiment of this application.

[0018] Figure 2 This is a schematic diagram of the structure of smart glasses provided in an embodiment of this application.

[0019] Explanation of reference numerals in the attached figures: 1-Frame; 2-Temperature; 10-House; 11-Clamping structure; 12-Image acquisition device; 13-First microphone; 14-Second microphone; 15-Speaker. Detailed Implementation

[0020] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings and specific examples. It should be understood that the specific embodiments described herein are merely illustrative of the embodiments of this application and are not intended to limit the embodiments of this application.

[0021] In the description of the embodiments of this application, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified. All directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of this application are only used to explain the relative positional relationships and movement of the components in a specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0022] To make the description of this disclosure more detailed and complete, illustrative descriptions of implementation methods and specific embodiments of the present application are provided below; however, this is not the only form of implementing or utilizing the specific embodiments of the present application. The implementation methods cover features of multiple specific embodiments and methods and steps for constructing and operating these specific embodiments, as well as their order. However, other specific embodiments may also be used to achieve the same or equivalent functions and step sequences.

[0023] In the embodiments of this application, terms such as "exemplary," "in some embodiments," and "in another embodiment" are used to indicate that something is an example, illustration, or description. Any embodiment or design described as "exemplary" in the embodiments of this application should not be construed as being better or more advantageous than other embodiments or designs. Specifically, the term "exemplary" is used to present concepts in a concrete manner.

[0024] The embodiments of this application can acquire and process relevant data based on artificial intelligence technology. Artificial intelligence (AI) refers to the theories, methods, technologies, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to obtain optimal results.

[0025] Smart glasses are intelligent devices that integrate technologies such as optical display, image acquisition, and wireless communication. Wearers can use voice commands, touch operations, or gestures to control the smart glasses to perform operations such as real-time display of navigation information, capture high-definition images, make voice calls, and translate languages, significantly improving the wearer's information acquisition efficiency and meeting the wearer's multi-dimensional information acquisition needs.

[0026] However, most existing smart glasses adopt an integrated design, and the fixed audio components are difficult to adjust the position or disassemble and replace according to the wearer's needs. Replacing the whole thing would bring additional costs. At the same time, traditional smart glasses are only equipped with a single microphone, which makes it difficult to distinguish human voices from environmental noise in some noisy environments. Their audio output cannot optimize environmental noise, making sound playback susceptible to external interference and unable to guarantee the accuracy of voice interaction in complex environments.

[0027] In a specific application scenario, such as a student attending an all-English foreign teacher class, the classroom is filled with the sounds of turning pages and hushed discussions. The foreign teacher usually speaks quickly, and when using technical terms, the student may not be able to accurately understand what the teacher is saying. Due to the language barrier, the student may choose to wear smart glasses for real-time voice translation. While traditional smart glasses can achieve real-time translation, most of them use a single microphone for sound pickup. The presence of environmental noise will affect the accurate reception and translation of speech. Their audio output cannot optimize for environmental noise or provide targeted output to the user, thus reducing the user experience.

[0028] For the above issues, please refer to Figures 1-2 This application provides an audio camera system and smart glasses, which use dual microphones to collect human voice and ambient sound respectively, reducing interference from environmental noise, and can be disassembled and replaced as needed, effectively improving the user experience.

[0029] In this embodiment, the aforementioned audio camera system is preferably applied to smart glasses. Smart glasses typically include a frame 1 and two temples 2 hinged to the ends of the frame 1. Please refer to... Figure 2 This is a schematic diagram of the structure of the smart glasses provided in this application embodiment. The audio camera system provided in this application embodiment includes a housing 10 and a clamping structure 11 for detachably installing the housing 10 onto the temple 2. The clamping structure 11 realizes the detachable connection between the audio camera system and the temple 2 of the smart glasses, thereby facilitating the wearer to disassemble and replace it as needed.

[0030] Furthermore, in this embodiment of the application, an image acquisition device 12 is provided on the side of the housing 10 near the frame 1. Preferably, the image acquisition device 12 is provided on the side near the frame 1 to facilitate shooting and recording functions according to the wearer's needs. The image acquisition device 12 can be set in the form of a camera. Of course, other settings that can achieve image acquisition are also feasible, and this embodiment of the application does not impose further restrictions on them.

[0031] As an optional implementation, this application embodiment provides a first microphone 13 for acquiring ambient sound and a second microphone 14 for acquiring human voice on the housing 10, a speaker 15 is provided on the housing 10 near the wearer's ear, and a main control unit is provided inside the housing 10 that is connected to the image acquisition device 12, the first microphone 13, the second microphone 14 and the speaker 15 via wired or wireless means.

[0032] In this embodiment, the ambient sound of the wearer's current environment is acquired through the first microphone 13, and the current human voice is acquired through the second microphone 14. The human voice can be the voice made by the wearer or the voice made by other people talking to the wearer. The main control unit is connected to the first microphone 13 and the second microphone 14 and can receive the ambient sound and human voice acquired by the first microphone 13 and the second microphone 14.

[0033] Furthermore, the main control unit uses AEC (Acoustic Echo Cancellation) and ANR (Active Noise Reduction) technologies to remove echoes and most environmental noise from the sound. The audio signal with echoes and environmental noise removed is amplified and output through speaker 15 to ensure the clarity of the output audio signal. It can also use ASR (Automatic Speech Recognition) and TTS (Text-to-Speech) technologies to achieve real-time speech translation and audio output, ensuring that the accurately translated audio signal is directed to the wearer's ear.

[0034] It should be noted that the aforementioned AEC (echo cancellation algorithm), ANR (active noise reduction), ASR (automatic speech recognition), and TTS (text-to-speech) technologies are all very mature and conventional techniques in the field of audio recognition. The embodiments of this application directly apply these technologies by constructing a hardware structure (housing 10, a first microphone 13, a second microphone 14 and a speaker 15 disposed on the housing 10, and a main control unit disposed inside the housing 10). Therefore, no improvements have been made to these algorithms themselves, but only to the adaptive application of existing algorithms in the hardware structure. Those skilled in the art should understand this.

[0035] As an optional implementation, the main control unit provided in this application embodiment can be configured as a common control chip such as MCU (Microcontroller Unit), FPGA (Field-Programmable Gate Array), or PLC (Programmable Logic Controller). The specific processing steps of the main control unit to achieve environmental noise cancellation and directional audio output based on the above-mentioned AEC (echo cancellation algorithm), ANR (active noise reduction), ASR (automatic speech recognition), and TTS (text-to-speech) technologies are all conventional technical means in this field, and this application embodiment will not elaborate on them.

[0036] This embodiment of the application samples ambient noise using a first microphone 13 and collects human voice using a second microphone 14. The speaker 15 is positioned close to the wearer's ear, thereby directionally transmitting the noise-reduced audio signal to the wearer's ear. This avoids spatial attenuation and the superposition of ambient noise during external playback, ensuring that the wearer can still clearly receive the audio signal in high-noise environments. The clamping structure 11 enables a detachable connection between the audio camera system and the temples of the smart glasses, facilitating disassembly and replacement by the wearer as needed, reducing costs while improving user flexibility.

[0037] Furthermore, in this embodiment of the application, a control button (not shown in the figure) for waking up the image acquisition device 12 to take pictures is provided on the housing 10. The control button is connected to the main control unit, so that the image acquisition device 12 is in a sleep state by default and can be woken up by the control button when needed, thereby reducing power consumption.

[0038] As an optional implementation, this embodiment of the application also provides an ambient light sensor (not shown in the figure) at one end of the housing 10 near the lens frame 1. The ambient light sensor is set close to the image acquisition device 12 and connected to the main control unit. The ambient light sensor detects the light intensity of the current shooting environment and provides light data reference for the image acquisition device 12 to take pictures. This allows the main control unit to adjust the exposure parameters of the image acquisition device 12 according to the current light intensity, effectively avoiding the problem of overexposure causing the image to be washed out or underexposure causing the loss of details in the dark areas.

[0039] As for how the main control unit adjusts the exposure parameters of the image acquisition device 12 according to the current light intensity, this is common knowledge in image processing algorithms, and this application embodiment will not elaborate on this further.

[0040] Of course, the control button can also be set to wake up the image acquisition device 12 and the ambient light sensor at the same time, so as to avoid the ambient light sensor from detecting the light intensity of the current shooting environment in real time and causing power consumption.

[0041] Optionally, in this embodiment of the application, a power supply unit is also provided inside the housing 10, and a charging interface connected to the power supply unit is provided on the housing 10, so that the wearer can charge in a timely manner.

[0042] Furthermore, in this embodiment of the application, a communication unit is also provided inside the housing 10. The communication unit includes at least a Bluetooth module and a WIFI module, thereby realizing information interaction between the audio camera system and other smart devices. For example, the communication connection between the audio camera system and the smart terminal is realized through Bluetooth pairing, thereby transmitting relevant data such as the video recorded by the image acquisition device 12 to the mobile phone.

[0043] In one specific embodiment, the audio camera system can transmit data to a smart terminal via RTSP (Real-Time Streaming Protocol) or RTP (Real-Time Transport Protocol). Of course, other transmission methods are also feasible, and this application embodiment does not impose further limitations on them.

[0044] Preferably, in this embodiment of the application, the housing 10 is detachably mounted on the side surface of the temple 2 closest to the wearer by means of the clamping structure 11, thereby facilitating the speaker 15 to contact the wearer's ear and realize the directional output of the audio signal.

[0045] Furthermore, the clamping structure 11 provided in this application embodiment includes at least two spring clips disposed on the housing 10. Since the spring clips are elastic, the audio camera system can be clamped on the temples 2 of different models and thicknesses, thus improving applicability.

[0046] Optionally, the clamping structure 11 can be configured as a connecting buckle, or a detachable connection between the smart glasses and the housing 10 can be achieved by magnetic adsorption. In this case, a permanent magnet can be provided on the housing 10, and a magnetic adsorption body that can magnetically attract the permanent magnet can be provided on the temple 2. Of course, other configurations that can achieve a detachable connection between the housing 10 and the temple 2 are also feasible. This application embodiment does not further limit the specific form of the clamping structure 11.

[0047] As an optional implementation, since the housing 10 is equipped with a power supply unit and a main control unit, this embodiment of the application also provides a graphene heat sink that can achieve heat dissipation inside the housing 10, so as to avoid the surface temperature of the housing 10 being too high and causing a bad experience for the wearer.

[0048] Furthermore, in this embodiment of the application, the shell 10 is made of lightweight material to avoid the overall structure being too heavy and affecting the user's wearing experience.

[0049] For example, the housing 10 can be made of lightweight materials such as plastic, aluminum alloy, or carbon fiber composite material. Of course, it is also feasible to make it of other lightweight materials. This application embodiment does not impose too many restrictions on this.

[0050] In an optional embodiment, a bone conduction vibration unit (not shown in the figure) can also be provided on the side of the housing 10 closer to the wearer. In this way, after the main control unit outputs the noise-reduced audio signal, it can select the speaker 15 or the bone conduction vibration unit for output as needed. Since the bone conduction vibration unit transmits the audio signal directly to the wearer through mechanical vibration, it can achieve accurate audio signal output even in environments with very high noise. Of course, the wearer's voice can also be acquired through the bone conduction vibration unit, reducing the dependence on the second microphone 14. The above is only an optional implementation method and is not intended to further limit the embodiments of this application.

[0051] Understandably, please refer to Figure 1 The above is a functional block diagram of the audio camera system provided in the embodiments of this application. The main control unit provided in the embodiments of this application and the above-mentioned image acquisition device 12, first microphone 13, second microphone 14, speaker 15, main control unit, ambient light sensor, power supply unit, communication unit and bone conduction vibration unit can be connected by wire or by wireless means. All of the above connection methods are feasible and should be known by those skilled in the art.

[0052] Based on the above-described audio camera system, this application embodiment also provides a smart glasses, on which the above-described audio camera system is detachably mounted on the temples.

[0053] For further details regarding the smart glasses implementation technology provided in the above embodiments, please refer to the description in the audio camera system in the above embodiments, which will not be repeated here.

[0054] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For system-type embodiments, since they are basically similar to method embodiments, the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0055] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated units can be implemented in hardware or as software functional units. The above are merely implementation methods of the embodiments of this application and do not limit the patent scope of the embodiments of this application. Any equivalent structural or procedural transformations made based on the description and drawings of the embodiments of this application, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of the embodiments of this application.

[0056] The above embodiments are merely exemplary implementations used to illustrate the principles of the embodiments of this application; however, the embodiments of this application are not limited thereto. For those skilled in the art, various modifications and improvements can be made without departing from the spirit and essence of the embodiments of this application, and these modifications and improvements are also considered to be within the protection scope of the embodiments of this application.

Claims

1. An audio camera system for use in smart glasses, the smart glasses comprising a frame and two temples hinged to the ends of the frame, characterized in that: The audio camera system includes a housing and a clamping structure for detachably mounting the housing to the temple; An image acquisition device is provided at one end of the housing near the frame. The housing is provided with a first microphone for acquiring ambient sound and a second microphone for acquiring human voice. A speaker is provided at the position of the housing near the wearer's ear. The speaker is used to output an audio signal to the wearer to remove ambient noise. The housing contains a main control unit that is connected to the image acquisition device, the first microphone, the second microphone, and the speaker.

2. The audio camera system as claimed in claim 1, characterized in that, The housing is equipped with a control button for waking up the image acquisition device to take pictures, and the control button is connected to the main control unit.

3. The audio camera system as described in claim 1, characterized in that, An ambient light sensor is also provided at one end of the housing near the lens frame. The ambient light sensor is connected to the main control unit and is used to detect the light intensity of the current shooting environment.

4. The audio camera system as claimed in claim 1, characterized in that, A power supply unit is provided inside the housing, and a charging interface connected to the power supply unit is provided on the housing.

5. The audio camera system as claimed in claim 1, characterized in that, The housing is equipped with a communication unit, which includes at least a Bluetooth module and a WIFI module.

6. The audio camera system as claimed in claim 1, characterized in that, The clamping structure is used to detachably mount the housing to the side of the temple closest to the wearer.

7. The audio camera system as claimed in claim 6, characterized in that, The clamping structure includes at least two spring clips disposed on the housing; Alternatively, the clamping structure may include a connecting buckle disposed on the housing; Alternatively, the clamping structure may include a permanent magnet disposed on the housing and a magnetic adsorption body disposed on the temple that can magnetically attract the permanent magnet.

8. The audio camera system as claimed in claim 1, characterized in that, The housing is equipped with graphene heat sinks.

9. The audio camera system as claimed in claim 1, characterized in that, The shell is made of at least one lightweight material selected from plastic, aluminum alloy, and carbon fiber composite materials.

10. A type of smart glasses, characterized in that, The smart glasses are detachably mounted on the temples with an audio camera system as described in any one of claims 1-9.

Images