Acousto-optic output device and audio and video synchronization error detection system

Abstract

The utility model relates to an acousto-optic output device and an audio and video synchronization error detection system, and relates to the field of monitoring video processing. Wherein the acousto-optic output device comprises a controller, a timer, a light output component, a sound output component, a signal input component and a power supply; the power supply is used for supplying power to the controller, the timer, the light output component, the sound output component and the signal input component; the timer is used for periodically outputting pulse signals; the signal input component is used for inputting the period of a pulse signal; and the controller is used for controlling the light output part to periodically output light signals of different colors by using the pulse signals and controlling the sound output part to output sound signals while the light signals of the different colors are output. According to the invention, the optical signal and the sound signal with the time error of 0 can be periodically output at the same moment, and a data basis is provided for detecting the time delay of sound and images in a video.

Description

Technical Field

[0001] This application relates to the field of surveillance video processing technology, and in particular to an audio-visual output device and an audio-visual synchronization error detection system. Background Technology

[0002] Security monitoring systems are widely used in daily life. They generally consist of cameras, switches, fiber optic networks, back-end monitoring system software, storage devices, etc., and are used to collect video and audio from the monitored area.

[0003] Some security monitoring systems utilize cameras with integrated audio acquisition capabilities to capture both audio and video. In other locations (such as airport verification counters, check-in counters, security checkpoints, and baggage claim areas), to obtain clearer human voice audio, separate microphones and cameras are used to capture audio and video separately, which are then packaged into a single file for storage or playback. Due to the different methods of video and audio acquisition, encoding, and transmission, synchronization errors inevitably occur between video and audio data acquired at the same location and time. Audio-video synchronization error is a crucial performance indicator for security monitoring systems. How to accurately detect this error is the problem this application aims to solve. Utility Model Content

[0004] Embodiments of this application provide an audio-visual output device and an audio-visual synchronization error detection system, which can accurately detect the delay between images and audio in a video.

[0005] In a first aspect, embodiments of this application provide an audio-visual output device, comprising: a controller, a timer, a light output component, a sound output component, a signal input component, and a power supply; the power supply is used to supply power to the controller, the timer, the light output component, the sound output component, and the signal input component; the timer is used to periodically output pulse signals; the signal input component is used to input the period of the pulse signals; the controller is used to control the light output component to periodically output light signals of different colors using the pulse signals and to control the sound output component to output sound signals simultaneously with the output of light signals of different colors.

[0006] Secondly, embodiments of this application provide an audio-visual synchronization error detection system, comprising: a surveillance camera, a processor, and an audio-visual output device as described in the first aspect; the audio-visual output device is used to periodically and simultaneously output light signals and sound signals; the surveillance camera is used to acquire video of the light signals and the sound signals; the processor is used to process the video to determine the delay between the image and the sound in the video.

[0007] By applying the technical solution of this application, optical signals and sound signals with zero time error between them can be output periodically at the same time, providing a data basis for detecting the delay of sound and image in video.

[0008] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0009] The accompanying drawings are provided for a better understanding of this solution and do not constitute a limitation of this application. Wherein:

[0010] Figure 1 This is a schematic diagram of the structure of one embodiment of the audio-visual output device of this application;

[0011] Figure 2 This is a schematic diagram of another embodiment of the audio-visual output device of this application;

[0012] Figure 3 This is a schematic diagram of the audio / video synchronization error detection system of this application;

[0013] Figure 4 This is a schematic diagram of an application scenario of the audio and video synchronization error detection system of this application. Detailed Implementation

[0014] It should be noted that the following detailed descriptions are exemplary and intended to provide further explanation of this application. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains.

[0015] It should be noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the exemplary embodiments according to this application. As used herein, the singular form is intended to include the plural form as well, unless the context clearly indicates otherwise. Furthermore, it should be understood that when the terms "comprising" and / or "including" are used in this specification, they indicate the presence of features, steps, operations, devices, components, and / or combinations thereof.

[0016] Where there is no conflict, the embodiments and features described in this application may be combined with each other.

[0017] To make the technical solutions and advantages of this application clearer, the following description, in conjunction with the accompanying drawings and specific embodiments, will provide a more detailed explanation of this application.

[0018] Figure 1 A schematic diagram of one embodiment of the audio-visual output device of this application is shown. Figure 1 The audio-visual output device 100 shown may include a controller 101, a timer 102, a light output component 103, a sound output component 104, a signal input component 105, and a power supply 106.

[0019] The power supply 106 is used to supply power to the controller 101, the timer 102, the light output component 103, the sound output component 104, and the signal input component 105.

[0020] The timer 102 is used to periodically output pulse signals. The timer here can be an independent timer chip, such as NE555 or EC340E, or it can be a timer integrated into the controller 101 or PWM (pulse width modulation).

[0021] The signal input component 105 is used to input the period of the pulse signal. Here, the signal input component 105 can be composed of a touch capacitive keyboard, a membrane matrix keyboard, etc. By inputting or modifying the period of the pulse signal through the keyboard, the signal is sent to the controller 101 to modify its internal embedded program, which then outputs a single-cycle pulse signal or a periodic pulse signal that matches the input period.

[0022] The controller 101 is used to control the light output component 103 to periodically output light signals of different colors using the pulse signal, and to control the sound output component 104 to output sound signals simultaneously with the output of light signals of different colors. In this embodiment, the controller 101 can be implemented by a microcontroller, ARM processor, FPGA chip, etc. The controller 101 can output a single-cycle pulse control signal or a periodic pulse control signal through a timer or PWM (pulse width modulation) to control the light output component 103 and the sound output component 104 to generate visible light signals and sound signals at the same time (the rising edge or falling edge of the pulse signal), so that the generation time error of the visible light signal and the sound signal is 0.

[0023] The light output component 103 can be composed of light-emitting diodes, transistors, resistors, capacitors, etc. When it receives a single-cycle pulse control signal or a periodic pulse control signal output by the controller 101, it causes the light-emitting diode to light up, either continuously emitting light or periodically emitting light of different colors.

[0024] The sound output component 104 may consist of a buzzer, a speaker, a transistor, a resistor, a capacitor, etc. When the sound output component 104 receives a single-cycle pulse control signal or a periodic pulse control signal from the timer output, it turns on the buzzer to emit continuous or periodic sound.

[0025] The audio-visual output device provided in the above embodiments of this application can periodically output light signals and sound signals with zero time error between them at the same time, eliminating the error in the generation of visible light signals and audio signals, and providing a data basis for detecting the delay of sound and images in video.

[0026] See Figure 2 This illustrates a structural schematic diagram of another embodiment of the audio-visual output device according to this application. Figure 2 As shown, the audio-visual output device 200 in this embodiment may include: a controller 201, a timer 202, a light output component 203, a sound output component 204, a signal input component 205, an ambient light detection and light adjustment component 206, a display component 207, a charging port 208, a switch 209, and a power supply 210.

[0027] The power supply 210 provides power to the controller 201, timer 202, light output component 203, sound output component 204, signal input component 205, ambient light detection and light adjustment component 206, and display component 207. Specifically, the power supply 210 can be a battery, and the charging port 208 provides a charging interface for the battery. The charging port 208 can use an independent charging control chip, with external resistors, capacitors, etc., forming a circuit, such as the commonly available TP4056 or MCP73831T. The switch 209 controls whether the power supply 210 provides power.

[0028] The ambient light detection and adjustment component 106 can be composed of circuits such as a photoelectric sensor, an operational amplifier, and a constant current driver chip. It detects the ambient light intensity and adjusts the drive current of the light output component 103 according to the ambient light intensity value, causing the intensity of the visible light output by the light output component 103 to increase or decrease accordingly, ultimately forming a clear contrast with the ambient light, which facilitates improved accuracy in subsequent image processing. The photoelectric sensor can be a commercially available digital photoelectric sensor such as TSL2561 or VEML7700, or a commercially available analog photoelectric sensor such as TEMT6000X01 or LTR-329ALS-01. The operational amplifier can be a commercially available OPA2340 or LM2904, and the constant current driver chip can be a commercially available TPS92512 or LT3922. If a digital photoelectric sensor is selected, the ambient light intensity value output by the digital photoelectric sensor is sent to the controller 201. When the controller 201 determines that the ambient light intensity exceeds 50 lux, it calculates the PWM duty cycle that the constant current drive chip needs to increase. For example, if the current duty cycle of the constant current drive chip is 50%, it is increased to 60-65%. Then, the current after PWM modulation by the constant current drive chip is output to the light output component 203, which increases the light intensity emitted by the light output component 203. However, the power consumption will also increase, resulting in a shorter battery power supply time for the power supply 210. If an analog photoelectric sensor is selected, the voltage signal output by the analog photoelectric sensor is sent to the operational amplifier, which amplifies the voltage signal to an appropriate level and then sends it to the controller 201. The controller 201 uses its integrated A / D converter to convert the voltage signal to obtain the ambient light intensity value. When the ambient light intensity exceeds 50 lux, the controller 201 calculates the PWM duty cycle that the constant current drive chip needs to increase. For example, if the current duty cycle of the constant current drive chip is 50%, it is increased to 60-65%. Then, the current modulated by the constant current drive chip is output to the light output component 203, which increases the light intensity emitted by the light output component 203. However, the power consumption will also increase, resulting in a shorter battery power supply time for the power supply 210.

[0029] Display component 207 is used to display the period during the periodic input of the pulse signal. Specifically, display component 207 may be composed of a liquid crystal display screen, which displays the data input by signal input component 205 when the pulse signal period is input or modified by signal input component 205. This makes it more convenient for the user to input or modify the period.

[0030] In some optional implementations of this embodiment, the aforementioned audio-visual output device may further include a housing for encapsulating the aforementioned components. Specifically, the housing may be a small cuboid for easy portability, thus facilitating the processing of video captured by outdoor surveillance cameras.

[0031] In some optional implementations of this embodiment, the light output component 203 and the sound output component 204 may be located on the same side of the cuboid housing. When detecting a camera with an integrated microphone, the visible light signal and the sound signal propagate in the same direction, which can reduce sound reflection and facilitate direct propagation towards the microphone.

[0032] In some optional implementations of this embodiment, the sound output component 203 outputs a single-frequency sound signal. This facilitates the quick visual identification of the start time of the audio waveform during subsequent testing.

[0033] The audio-visual output device provided in the above embodiments of this application can periodically output light and sound signals with zero time error between them at the same time using pulse signals. At the same time, the period of the pulse signals can be adjusted, making it easier to control the pulse signals.

[0034] Figure 3 A schematic diagram of one embodiment of the audio / video synchronization error detection system of this application is shown. Figure 3 As shown, the audio-visual synchronization error detection system of this embodiment may include: a surveillance camera 301, an audio-visual output device 302, and a processor 303. The audio-visual output device 302 is used to periodically and simultaneously output light and sound signals. Here, simultaneous output can be understood as the time error between the light and sound signals being zero. The surveillance camera 301 is used to acquire video of the light and sound signals. The processor 303 is used to process the video to determine the delay between the image and sound in the video.

[0035] Specifically, the sound and light output device 302 can be any device that can simultaneously and periodically output sound signals and light signals, wherein the sound signal can be sound with a volume greater than a preset threshold, and the light signal can be any visible light.

[0036] The surveillance camera 301 can be any camera capable of capturing images and sound, such as an infrared camera. The surveillance camera 301 can send the captured video to the processor 303 via the communication port.

[0037] The processor 303 can receive video sent by the monitoring camera 301 through the communication port, analyze and process the video, determine the time when the light signal appears and the time when the sound signal appears, and thus determine the delay between the image and audio in the video.

[0038] Specifically, processor 303 may integrate a chip containing program code that executes the following steps:

[0039] 1) Perform frame-by-frame analysis on the target video to determine the multiple initial image frames when the light signals of each color appear.

[0040] 2) Determine the first time point corresponding to each initial image frame.

[0041] 3) Determine the second moment when each sound signal appears.

[0042] 4) Determine the time delay between the image and audio in the target video based on the first and second time points.

[0043] The audio-visual synchronization error detection system provided in the above embodiments of this application can simultaneously and periodically output light and sound signals through an audio-visual output device, and use a monitoring camera to collect video of the light and sound signals, and then process the video to determine the delay of the image and sound in the video, thereby improving the accuracy of detection.

[0044] Figure 4 A schematic diagram of an application scenario for the audio / video synchronization error detection system of this application is shown.

[0045] As shown in Figure 4, the application scenario may include terminal device 401, surveillance camera 402, network 403, and audio-visual output device 404. Network 403 serves as the medium for providing a communication link between terminal device 401, surveillance camera 402, and audio-visual output device 404. Network 403 may include various connection types, such as wired or wireless communication links or fiber optic cables, etc.

[0046] The surveillance camera 402 can be any type of camera, such as an infrared camera. The surveillance camera 402 can simultaneously capture image and audio data, resulting in a video that includes both images and audio.

[0047] The audio-visual output device 404 can simultaneously output visible light and sound of different colors. The surveillance camera 402 can capture the visible light and sound output by the audio-visual output device 404 and transmit the captured video to the terminal device 401 via the network 403.

[0048] Terminal device 401 can receive video via network 403 and analyze and process the video. Terminal device 401 may have a chip installed for video processing; this chip can be an existing chip.

[0049] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. An audio-visual output device, characterized in that, include: Controller, timer, optical output component, audio output component, signal input component, and power supply; The power supply is used to power the controller, the timer, the optical output component, the sound output component, and the signal input component; The timer is used to periodically output pulse signals; The signal input component is used to input the period of the pulse signal; The controller is used to control the light output component to periodically output light signals of different colors using the pulse signal, and to control the sound output component to output sound signals while outputting light signals of various colors.

2. The audio-visual output device according to claim 1, wherein, The audio-visual output device also includes a display component; The display component is used to display the period during the periodic input of the pulse signal.

3. The audio-visual output device according to claim 2, wherein, The device also includes an ambient light detection and light adjustment component, used to detect the ambient light intensity value and adjust the intensity of visible light output by the light output component according to the ambient light intensity value.

4. The audio-visual output device according to claim 3, wherein, The power source is a battery; The audio-visual output device also includes a charging port; The charging port is used to provide a charging interface for the battery.

5. The audio-visual output device according to claim 4, wherein, The audio-visual output device also includes a switch for controlling the power supply to provide power.

6. The audio-visual output device according to claim 4, wherein, The audio-visual output device further includes a housing for encapsulating the controller, the timer, the light output component, the sound output component, the signal input component, the display component, the charging port, and the power supply; The light output component, the sound output component, the signal input component, the display component, and the charging port are partially embedded in the housing, while the controller, the timer, and the power supply are disposed inside the housing.

7. The audio-visual output device according to claim 6, wherein, The light output component and the sound output component are located on the same side of the sound and light output device.

8. The audio-visual output device according to any one of claims 1-7, wherein, The sound signal is a single-frequency sound signal.

9. An audio / video synchronization error detection system, characterized in that, include: Surveillance camera, processor, and audio-visual output device as described in any one of claims 1 to 8; The audio-visual output device is used to periodically and simultaneously output optical and sound signals; The surveillance camera is used to capture video of the light signals and the sound signals. The processor is used to process the video and determine the delay between the image and sound in the video.

Images