Audio and video integrated binaural recording sound scene acquisition wearable device

Abstract

The invention relates to the technical field of audio and video processing and recording, and discloses an audio and video integrated binaural recording sound scene acquisition wearable device which comprises glasses, the glasses comprise a glasses frame and two glasses legs, the tail of each glasses leg is connected with a binaural recording module through a wire, and video recording modules are installed in installation grooves respectively. An audio and video integrated module is installed in the glasses leg on one side of the glasses frame, a power supply module is installed in the glasses leg on the other side of the glasses frame, the binaural recording module and the video recording module are integrated on the wearable glasses, audio and video signals are processed in a unified mode through the audio and video integrated module, and synchronous collection and processing of audios and videos can be achieved; according to the invention, details of sound and pictures are accurately captured, so that the collected sound scene data has high integrity and authenticity, in addition, the sound collector is ensured to be stably close to the external ear, the binaural effect of the human ear is simulated, and high-quality audio information is efficiently collected.

Description

Technical Field

[0001] The present invention relates to the technical field of audio and video processing and recording, and in particular to a wearable device for binaural recording and soundscape acquisition that integrates audio and video. Background Art

[0002] The core research of the concept of "soundscape" focuses on people, sound, and the environment. Over more than half a century, it has spanned multiple disciplines, including anthropology, acoustics, ecology, art, culture, and communications. Wearable devices for soundscape capture integrate binaural recording, a simplified immersive sound capture function, into video capture. This ensures audio and video synchronization, improves the efficiency of soundscape capture, and enhances the audio and video capture effects of researchers in field surveys, artistic collection, and work creation, filling a gap in related wearable devices. Existing wearable devices for soundscape capture come in various forms. Common ones are head-mounted devices. Some only have audio capture functions. They use high-sensitivity microphone arrays worn on the head to collect ambient sound for environmental noise monitoring and audio recording. For example, in urban noise pollution research, researchers wear such devices to record sound conditions in different areas. Some wearable devices also integrate simple camera functions, mostly in the form of a combination of action cameras and simple head-mounted devices. They are mainly used to record outdoor activities, such as outdoor sports enthusiasts using them to record video footage of cycling and mountain climbing. However, the audio capture is often relatively simple and it is difficult to accurately simulate the binaural effect of the human ear.

[0003] However, existing devices often design audio and video capture functions independently, making it difficult to synchronize audio and video information during actual use. For example, when recording an outdoor concert, the audio device may record clear music, but the video device may capture images out of sync with the audio, resulting in a misalignment between the sound and the image. Furthermore, due to the lack of a unified processing mechanism, the quality of the captured audio and video is difficult to match, making it impossible to fully and accurately restore the soundscape of the scene. This is a serious problem for users who rely on soundscape recordings for research, creation, or other purposes.

[0004] Furthermore, most existing wearable devices for soundscape capture have significant shortcomings in audio collection. For one thing, they fail to simulate the binaural effect of the human ear. The human ear receives sound through both ears, and can determine the direction and distance of a sound based on factors such as the time difference and intensity difference between the two ears, thereby creating an auditory experience with a sense of space. However, many existing devices use only a single microphone or a simple combination of microphones, and the sound they capture lacks this sense of space, resulting in a monotonous and flat sound.

[0005] Therefore, it is necessary to provide a wearable device for collecting the soundscape of binaural recording with integrated audio and video to solve the above problems. Summary of the Invention

[0006] The purpose of the present invention is to provide a technical solution to solve the problems in the prior art mentioned in the above background technology.

[0007] To achieve the above purpose, the present invention adopts the following technical solutions:

[0008] A wearable device for collecting the soundscape of binaural recording with integrated audio and video, including wearable glasses, the glasses include a frame and two temple arms, mounting grooves are respectively opened on both sides of the frame, the two temple arms are respectively hinged to both sides of the frame, the tail of the temple arm is connected with a binaural recording module through a wire, and a video recording module is respectively installed in the mounting grooves;

[0009] An audio-video integration module is installed inside the temple arm on one side of the frame, and a power supply module is installed inside the temple arm on the other side of the frame;

[0010] The video recording module is electrically connected to the signal receiving end of the audio-video integration module through a wire, and the video recording module provides the recorded video signal for the audio-video integration module. The binaural recording module is electrically connected to the signal receiving end of the audio-video integration module through a wire, and the binaural recording module provides the received sound signal for the audio-video integration module. The power supply module is electrically connected to the power supply end of the audio-video integration module through a wire, and the audio-video integration module supplies power to the power supply ends of the video recording module and the binaural recording module through wires respectively.

[0011] Preferably, the temple arm includes an inner shell and an outer shell, the outer side of the inner shell is fixedly installed with the outer shell, and a cavity is formed inside after the inner shell and the outer shell are installed. The cavity provides the space required for the installation of wires, the audio-video integration module and the power supply module respectively.

[0012] Preferably, a wire groove is opened in the upper frame body of the frame, and the wire groove provides a receiving space for the wire connecting the power supply module and the audio-video integration module and the wire connecting the video recording module and the audio-video integration module.

[0013] Preferably, the binaural recording module includes a sound collector, an elastic rod and a clamping ball, the elastic rod is arc-shaped, and both ends of the elastic rod are respectively fixedly connected with the sound collector and the clamping ball;

[0014] After wearing, the sound collector is placed on one side of the outer ear, the clamping ball is located on the back of the outer ear, and the elastic rod winds around the side wall of the outer ear.

[0015] Preferably, the sound collector includes a housing and a microphone. The shape of the housing is the same as that of the ball clip. A hole for sound collection is provided on the outer side wall of the housing. A microphone is installed inside the housing, and the sound collection end of the microphone is placed inside the hole. The microphone is electrically connected to the audio-video integration module through a wire.

[0016] Preferably, the video recording module includes a micro camera. The outer side of the installation groove penetrates through both sides of the spectacle frame and is of an open structure. The lens of the micro camera is placed outside the installation groove.

[0017] Preferably, the audio-video integration module includes an audio signal processing circuit. The audio signal processing circuit includes a preamplifier, a filter, an analog-to-digital converter, and a digital signal processor. The signal output end of the microphone is electrically connected to the signal receiving end of the preamplifier. The signal output end of the preamplifier is electrically connected to the signal receiving end of the filter. The signal output end of the filter is electrically connected to the receiving end of the analog-to-digital converter. The analog-to-digital converter is electrically connected to the signal receiving end of the digital signal processor.

[0018] Preferably, the audio-video integration module includes a video signal processing circuit. The video signal processing circuit includes an interface circuit, a video amplifier, an image signal processor, and a video encoder. The interface circuit is electrically connected to the signal output end of the micro camera through a wire. The receiving end of the video amplifier is electrically connected to the output end of the interface circuit. The output end of the video amplifier is electrically connected to the signal receiving end of the image signal processor. The image signal processor is electrically connected to the signal receiving end of the video encoder.

[0019] Preferably, the audio-video integration module includes a main control circuit. The main control circuit includes a microcontroller, a storage unit, and a communication interface circuit. The microcontroller is electrically connected to the signal output end of the digital signal processor and the signal output end of the video encoder respectively. The storage unit receives and stores the recording data sent by the digital signal processor and the video data sent by the video encoder through the microcontroller. The communication interface circuit includes a wireless transmission module and a wired transmission module. The wireless transmission module and the wired transmission module communicate with external communication devices by controlling the recording data signal and video data stored in the storage unit through the microcontroller.

[0020] Preferably, the audio-video integration module includes a power management circuit. The power pipeline circuit includes a battery charging management module and a voltage conversion module. The power supply module is charged through the battery charging management module. The voltage conversion module converts the power supply module into different voltage values required by the main control circuit, the video signal processing circuit, the audio signal processing circuit, the microphone, and the micro camera for power supply.

[0021] Technical effects and advantages of the present invention: A wearable device for binaural recording soundscape acquisition integrating audio and video proposed by the present invention has the following advantages compared with the prior art:

[0022] 1. By integrating the binaural recording module and the video recording module on the wearable glasses and uniformly processing the audio and video signals by the audio-video integration module, the present invention effectively solves the problems of separated audio and video acquisition functions and poor coordination of existing soundscape acquisition devices. In practical applications, it can realize synchronous acquisition and processing of audio and video, accurately capture the details of sound and picture, making the collected soundscape materials highly complete and authentic, providing high-quality materials for scientific researchers to conduct environmental research, artists to create, etc., and helping to more deeply understand and restore the real soundscape environment.

[0023] 2. The present invention adopts a unique design of elastic rod, clamping ball and sound collector in the binaural recording module, bringing significant improvements. The arc design of the elastic rod can be adaptively adjusted according to the outer ear shape and size of different users, ensuring that the sound collector stably approaches the outer ear, simulating the binaural effect of the human ear, and collecting sounds with a sense of space and realism. Moreover, the cooperation of the clamping ball and the elastic rod not only improves the accuracy of sound collection, but also enhances the comfort and stability of wearing. In actual use, users do not need to worry about the influence of ear characteristics on the sound collection effect, and can wear the device comfortably for a long time to collect soundscapes. For example, in outdoor activities, meeting records and other scenarios, high-quality audio information can be efficiently collected. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a schematic structural diagram of the glasses in Embodiment 1 of the present invention;

[0025] Figure 2 is a schematic structural diagram of the spectacle frame in Embodiment 1 of the present invention;

[0026] Figure 3 is a schematic structural diagram of the temple in Embodiment 1 of the present invention;

[0027] Figure 4 is a system block diagram of the binaural recording module, video recording module and audio-video integration module in Embodiment 2 of the present invention;

[0028] Figure 5 [[ID=2⑧]]is a system block diagram of the audio-video integration module in Embodiment 2 of the present invention.

[0029] In the figure:

[0030] 1. Spectacle frame; 11. Wire groove; 12. Installation groove;

[0031] 2. Temple; 21. Inner shell; 22. Outer shell;

[0032] 3. Binaural recording module; 31. Sound collector; 32. Elastic rod; 33. Ball clip;

[0033] 4. Video recording module;

[0034] 5. Audio-video integration module. Specific implementation mode

[0035] The subject matter described herein will now be discussed with reference to exemplary embodiments. It should be understood that discussing these embodiments is only to enable those skilled in the art to better understand and thus implement the subject matter described herein. Without departing from the scope of protection of the content of this specification, changes can be made to the functions and arrangements of the elements discussed. Each example can omit, substitute, or add various processes or components as needed. In addition, the features described in some examples can also be combined in other examples.

[0036] Embodiment 1

[0037] The invention provides, as shown in Figures 1 to 3 a binaural recording soundscape acquisition wearable device with audio-video integration, including wearable glasses. The glasses include a frame 1 and two temple arms 2. Installation grooves 12 are respectively formed on both sides of the frame 1. The two temple arms 2 are respectively hinged to both sides of the frame 1, so that the glasses can be flexibly opened and closed, facilitating wearing and storage. The tail of the temple arm 2 is connected with a binaural recording module 3 through a wire. Video recording modules 4 are respectively installed in the installation grooves 12, integrating the functions of recording and video recording on the glasses, and facilitating the user to perform soundscape acquisition when wearing;

[0038] An audio-video integration module 5 is installed inside the temple arm 2 on one side of the frame 1, and a power supply module is installed inside the temple arm 2 on the other side of the frame 1. Specifically, the temple arm 2 includes an inner shell 21 and an outer shell 22. The outer side of the inner shell 21 is fixedly installed with the outer shell 22. After the inner shell 21 and the outer shell 22 are installed, the interior is set as a cavity, and the cavity provides space for installing the wire, the audio-video integration module 5, and the power supply module respectively. A wire groove 11 is formed in the upper frame body of the frame 1, and the wire groove 11 provides a space for accommodating the wire connecting the power supply module and the audio-video integration module 5 and the wire connecting the video recording module 4 and the audio-video integration module 5.

[0039] Among them, the binaural recording module 3 includes a sound collector 31, an elastic rod 32, and a clamping ball 33. The elastic rod 32 is arc-shaped, and both ends of the elastic rod 32 are fixedly connected to the sound collector 31 and the clamping ball 33 respectively. After wearing, the sound collector 31 is placed on one side of the outer ear, the clamping ball 33 is located on the back of the outer ear, and the elastic rod 32 is wound around the side wall of the outer ear. The elastic force of the elastic rod 32 is used to stably close the sound collector 31 to the outer ear, enabling better collection of external sounds. It can be adaptively adjusted according to the shapes and sizes of the outer ears of different users to ensure that the relative position between the sound collector 31 and the outer ear is appropriate, improving the quality and accuracy of sound collection. At the same time, the cooperation between the clamping ball 33 and the elastic rod 32 makes the wearing more comfortable and stable.

[0040] Embodiment 2

[0041] As Figure 4 and Figure 5 As shown, the video recording module 4 is electrically connected to the signal receiving end of the audio-video integration module 5 through a wire, and the video recording module 4 provides the recorded video signal for the audio-video integration module 5. The binaural recording module 3 is electrically connected to the signal receiving end of the audio-video integration module 5 through a wire, and the binaural recording module 3 provides the received sound signal for the audio-video integration module 5. The power supply module is electrically connected to the power supply end of the audio-video integration module 5 through a wire, and the audio-video integration module 5 supplies power to the power supply ends of the video recording module 4 and the binaural recording module 3 through wires. The video recording module 4 transmits the recorded video signal to the audio-video integration module 5 through a wire, and the binaural recording module 3 also transmits the collected sound signal to the audio-video integration module 5 through a wire. The power supply module provides power support for the audio-video integration module 5, the video recording module 4, and the binaural recording module 3, realizing the signal transmission and supply between the modules.

[0042] As some embodiments of the present invention, the sound collector 31 includes a housing and a microphone. The shape of the housing is the same as that of the clamping ball 33. A hole for receiving sound is provided on the outer side wall of the housing. A microphone is installed inside the housing, and the sound receiving end of the microphone is placed inside the hole. The microphone is electrically connected to the audio-video integration module 5 through a wire. The hole on the outer side of the housing is used to let external sounds enter, and the sound receiving end of the microphone is placed inside the hole to convert the sound signal into an electrical signal and transmit it to the audio-video integration module 5 for subsequent processing.

[0043] The audio-video integration module 5 includes an audio signal processing circuit. The audio signal processing circuit includes a preamplifier, a filter, an analog-to-digital converter, and a digital signal processor. The signal output terminal of the microphone is electrically connected to the signal receiving terminal of the preamplifier. The signal output terminal of the preamplifier is electrically connected to the signal receiving terminal of the filter. The signal output terminal of the filter is electrically connected to the receiving terminal of the analog-to-digital converter. The analog-to-digital converter is electrically connected to the signal receiving terminal of the digital signal processor. The preamplifier amplifies the weak electrical signal output by the microphone. The filter is used to filter out noise and interference in the signal to improve the signal quality. The analog-to-digital converter converts the analog audio signal into a digital signal, facilitating digital signal processing operations such as audio encoding, noise reduction, and enhancement by the digital signal processor, optimizing and digitizing the original audio signal collected by the microphone, and providing high-quality audio data for subsequent operations such as storage, transmission, and playback.

[0044] As some embodiments of the present invention, the video recording module 4 includes a micro camera. The outside of the installation groove 12 penetrates through both sides of the spectacle frame 1 and has an open structure. The lens of the micro camera is placed outside the installation groove 12. The audio-video integration module 5 includes a video signal processing circuit. The video signal processing circuit includes an interface circuit, a video amplifier, an image signal processor, and a video encoder. The interface circuit is electrically connected to the signal output terminal of the micro camera through a wire. The receiving terminal of the video amplifier is electrically connected to the output terminal of the interface circuit. The output terminal of the video amplifier is electrically connected to the signal receiving terminal of the image signal processor by a wire. The image signal processor is electrically connected to the signal receiving terminal of the video encoder.

[0045] The micro camera captures a video image, transmits the video signal to the video amplifier through the interface circuit for amplification, and the image signal processor processes the amplified video signal, such as color correction, contrast adjustment, image noise reduction, etc. Finally, the video encoder encodes and compresses the processed video signal for transmission to meet the requirements of soundscape acquisition for video quality and data processing.

[0046] It should be noted that the audio-video integration module 5 includes a main control circuit. The main control circuit includes a microcontroller, a storage unit, and a communication interface circuit. The microcontroller is electrically connected to the signal output terminals of the digital signal processor and the video encoder respectively. The storage unit receives and stores the recording data sent by the digital signal processor and the video data sent by the video encoder through the microcontroller. The communication interface circuit includes a wireless transmission module and a wired transmission module. The wireless transmission module and the wired transmission module communicate with external communication devices by controlling the recording data signal and video data stored in the storage unit through the microcontroller.

[0047] The microcontroller receives the audio data processed by the digital signal processor and the video data processed by the video encoder, and stores them in the storage unit. At the same time, the microcontroller controls the wireless transmission module and the wired transmission module through the communication interface circuit, communicates and connects the audio and video data in the storage unit with external communication devices, realizes the transmission and sharing of data, coordinates the work between various circuit modules, realizes the storage, management of audio and video data and communication with the outside world, and ensures that the device can perform operations such as audio and video acquisition, storage and transmission according to the user's needs.

[0048] Specifically, the audio-video integration module 5 includes a power management circuit. The power pipeline circuit includes a battery charging management module and a voltage conversion module. The power supply module is charged through the battery charging management module. The battery charging management module is responsible for the charging management of the power supply module to ensure that the battery can be charged safely and efficiently. The voltage conversion module converts the power supply module into different voltage values required by the main control circuit, the video signal processing circuit, the audio signal processing circuit, the microphone, and the micro camera for power supply. The voltage conversion module converts the voltage provided by the power supply module into different voltage values required by the main control circuit, the video signal processing circuit, the audio signal processing circuit, the microphone, the micro camera, etc., to meet the working voltage requirements of each module.

[0049] The embodiments of the present invention have been described above, but the present invention is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present invention, those of ordinary skill in the art can also make many forms, all of which fall within the protection scope of the present invention.

Claims

1. An integrated audio-video binaural recording soundscape acquisition wearable device, including wearable glasses, characterized in that, The glasses include a frame (1) and two temple arms (2). Installation grooves (12) are respectively formed on both sides of the frame (1). The two temple arms (2) are respectively hinged to both sides of the frame (1). The tail of the temple arm (2) is connected with a binaural recording module (3) through a wire. Video recording modules (4) are respectively installed in the installation grooves (12). An audio-video integration module (5) is installed inside the temple arm (2) on one side of the frame (1), and a power supply module is installed inside the temple arm (2) on the other side of the frame (1). The video recording module (4) is electrically connected to the signal receiving end of the audio-video integration module (5) through a wire, and the video recording module (4) provides the recorded video signal for the audio-video integration module (5). The binaural recording module (3) is electrically connected to the signal receiving end of the audio-video integration module (5) through a wire, and the binaural recording module (3) provides the received sound signal for the audio-video integration module (5). The power supply module is electrically connected to the power supply end of the audio-video integration module (5) through a wire, and the audio-video integration module (5) supplies power to the power supply ends of the video recording module (4) and the binaural recording module (3) through wires respectively.

2. The binaural recording soundscape acquisition wearable device with integrated audio and video according to claim 1, wherein The temple arm (2) includes an inner shell (21) and an outer shell (22). The outer side of the inner shell (21) is fixedly installed with the outer shell (22). After the inner shell (21) and the outer shell (22) are installed, the interior is set as a cavity, and the cavity provides the space required for the installation of wires, the audio-video integration module (5) and the power supply module respectively.

3. The binaural recording soundscape acquisition wearable device with integrated audio and video according to claim 2, characterized in that, A wire groove (11) is formed in the upper frame body of the frame (1), and the wire groove (11) provides a receiving space for the wire connecting the power supply module and the audio-video integration module (5) and the wire connecting the video recording module (4) and the audio-video integration module (5).

4. The binaural recording soundscape acquisition wearable device for audio-video integration according to claim 1, characterized in that The binaural recording module (3) includes a sound collector (31), an elastic rod (32) and a clamping ball (33). The elastic rod (32) is arc-shaped, and both ends of the elastic rod (32) are respectively fixedly connected with the sound collector (31) and the clamping ball (33). After wearing, the sound collector (31) is placed on one side of the outer ear, the clamping ball (33) is located on the back of the outer ear, and the elastic rod (32) winds around the side wall of the outer ear.

5. The integrated audio-video binaural recording soundscape acquisition wearable device according to claim 4, characterized in that, The sound collector (31) includes a housing and a microphone. The shape of the housing is the same as that of the clamping ball (33). Sound holes for receiving sound are formed on the outer side wall of the housing. A microphone is installed inside the housing, and the sound receiving end of the microphone is placed inside the sound holes. The microphone is electrically connected to the audio-video integration module (5) through a wire.

6. The integrated audio-video binaural recording soundscape acquisition wearable device according to claim 5, characterized in that, The video recording module (4) includes a micro camera. The outer side of the installation groove (12) penetrates through both sides of the frame (1) and is of an open structure, and the lens of the micro camera is placed on the outer side of the installation groove (12).

7. The integrated audio-video binaural recording soundscape acquisition wearable device according to claim 6, characterized in that, The audio-video integration module (5) includes an audio signal processing circuit, and the audio signal processing circuit includes a preamplifier, a filter, an analog-to-digital converter, and a digital signal processor. The signal output end of the microphone is electrically connected to the signal receiving end of the preamplifier. The signal output end of the preamplifier is electrically connected to the signal receiving end of the filter. The signal output end of the filter is electrically connected to the receiving end of the analog-to-digital converter. The analog-to-digital converter is electrically connected to the signal receiving end of the digital signal processor.

8. The integrated audio-video binaural recording soundscape acquisition wearable device according to claim 7, characterized in that, The audio-video integration module (5) includes a video signal processing circuit, and the video signal processing circuit includes an interface circuit, a video amplifier, an image signal processor, and a video encoder. The interface circuit is electrically connected to the signal output end of the micro camera through a wire. The receiving end of the video amplifier is electrically connected to the output end of the interface circuit. The output end of the video amplifier is electrically connected to the signal receiving end of the image signal processor by wire. The image signal processor is electrically connected to the signal receiving end of the video encoder.

9. An integrated audio-video binaural recording soundscape acquisition wearable device according to claim 8, characterized in that, The audio-video integration module (5) includes a main control circuit, and the main control circuit includes a microcontroller, a storage unit, and a communication interface circuit. The microcontroller is electrically connected to the signal output end of the digital signal processor and the signal output end of the video encoder respectively. The storage unit receives the recording data sent by the digital signal processor and the video data sent by the video encoder through the microcontroller and stores them. The communication interface circuit includes a wireless transmission module and a wired transmission module. The wireless transmission module and the wired transmission module communicate with external communication devices by controlling the recording data signal and video data stored in the storage unit through the microcontroller.

10. The integrated audio-video binaural recording soundscape acquisition wearable device according to claim 9, characterized in that, The audio-video integration module (5) includes a power management circuit, and the power pipeline circuit includes a battery charging management module and a voltage conversion module. The power supply module is charged through the battery charging management module. The voltage conversion module converts the power supply module into different voltage values required by the main control circuit, the video signal processing circuit, the audio signal processing circuit, the microphone, and the micro camera for power supply.

Images