Multifunctional intelligent video and voice monitoring system

Abstract

The invention discloses a multifunctional intelligent video voice monitoring system, which is characterized by comprising an edge calculation module, a video acquisition module, a voice interaction module and a communication and storage module, and is characterized in that the edge calculation module is used for performing AI analysis on video data, identifying violation behaviors and triggering instant voice alarm; the video acquisition module is provided with anti-shake cameras which are respectively arranged at the positions of the insulating bucket, the manipulator, the ground working principal and the multifunctional workstation and are used for real-time video acquisition; the voice interaction module is used for two-way voice communication and supporting real-time talkback between an operator and a ground principal and three-party voice talkback of a background operation monitoring center; and the communication and storage module supports WIFI, 4G network and autonomous network communication, and the communication distance is not less than 50 meters. The system is suitable for safety monitoring and management of complex environments such as electric power operation and high-altitude operation.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent monitoring, and specifically relates to a multifunctional intelligent video and voice monitoring system. Background Art

[0002] Most existing monitoring devices are installed in a fixed manner, with poor flexibility, and it is difficult to integrate real-time AI analysis and multi-role voice interaction functions. Traditional devices are easily affected by factors such as vibration and insufficient light in complex environments, resulting in unstable video quality and unable to meet the requirements of precise analysis. In addition, the communication and storage capabilities of existing devices are limited, making it difficult to support long-term operations and remote monitoring requirements. Summary of the Invention

[0003] To solve the above technical problems, a multifunctional intelligent video and voice monitoring system is provided, including: an edge computing module, a video acquisition module, a voice interaction module, a communication and storage module:

[0004] The edge computing module is used to perform AI analysis on video data, identify illegal behaviors and trigger instant voice alarms;

[0005] The video acquisition module is configured with anti-shake cameras, which are respectively set at the positions of the insulating bucket, the operator, the ground work responsible person and the multifunctional workstation for real-time video acquisition;

[0006] The voice interaction module supports two-way voice communication, and enables real-time intercom between the operator and the ground responsible person, as well as three-way voice intercom with the background operation monitoring center;

[0007] The communication and storage module supports WIFI, 4G network and autonomous network communication, and the communication distance is not less than 50 meters.

[0008] Furthermore, a safety helmet is included, and the module can be detachably installed on the safety helmet.

[0009] Furthermore, a barometer sensor, an LED fill light, dual microphones and dual speakers are included.

[0010] Furthermore, the edge computing module is equipped with an MT8768 processor, configured with 3GB RAM and 32GB storage space, and runs the Android 10 system.

[0011] Furthermore, it supports TF card extended storage with a maximum capacity of 512GB, and is equipped with a Type-C interface for data transmission and charging.

[0012] Furthermore, the communication module reserves a 4G interface to support remote monitoring without job distance restrictions.

[0013] Furthermore, the anti-shake camera adopts an electronic anti-shake algorithm to ensure stable video images and meet the requirements of AI analysis.

[0014] Furthermore, it also includes a detachable battery for the power module, with a capacity of 5000 mAh, supporting a continuous recording duration of more than 5 hours.

[0015] Furthermore, the protection level is IP66, supporting a 2-meter drop protection.

[0016] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0017] (1) The split structure supports quick disassembly and assembly. Users can flexibly configure function modules according to task requirements (for example, only install the camera or communication module). Each module uses a standardized interface and can be independently replaced in case of failure, reducing the maintenance cost by more than 50%.

[0018] (2) The dual-mode anti-shake technology reduces the video jitter amplitude by 80%. The recognition accuracy of the AI model in a stable picture is increased to 97.3% (measured data). The laser-assisted positioning shortens the target capture speed to 0.3 seconds, suitable for fast-moving scenarios such as high-altitude inspection.

[0019] (3) The multi-role voice interaction enhances the collaborative operation ability. The full-duplex communication supports multiple parties to speak simultaneously, avoiding the "grabbing the microphone" problem of traditional walkie-talkies and increasing the command efficiency by 40%. The directional voice alarm function enables the alarm information to reach the target personnel directly, reducing the misoperation rate.

[0020] (4) The high protection level and long battery life meet the requirements of industrial scenarios. The IP66 protection and 2-meter anti-drop design enable the device to adapt to extreme environments (such as heavy rain, dust, and oil stains), reducing the failure rate to less than 0.5%. The replaceable battery and intelligent power consumption management ensure continuous operation requirements, especially suitable for long-term tasks such as power repair and tunnel construction.

[0021] (5) Edge computing reduces the dependence on the cloud, and the bandwidth cost is reduced by 60%; local storage supports offline playback, meeting the use in areas without network. Reserved sensor expansion interfaces (such as temperature and humidity, gas detection) can be upgraded to an integrated security monitoring platform. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a schematic structural diagram of a multi-functional intelligent video and voice monitoring system;

[0023] Figure 2 It is a side view of a multi-functional intelligent video and voice monitoring system;

[0024] Figure 3 It is a schematic structural diagram of the intelligent module in a multi-functional intelligent video and voice monitoring system;

[0025] Among them, 1 is a safety helmet; 2 is an intelligent module; 3 is a computing module. Specific implementation manners

[0026] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments in the following description are only examples, and those skilled in the art can think of other obvious variations.

[0027] Referring to Figure 1 As shown, the present invention provides a multifunctional intelligent video and voice monitoring device, aiming to solve the problems of insufficient flexibility, poor environmental adaptability, and single function of traditional monitoring devices in industrial scenarios. The device adopts a split modular design, and the core components can be detachably integrated into the safety helmet body, taking into account portability and functionality.

[0028] The multifunctional intelligent video and voice monitoring device described above includes an intelligent module with a split structure, which can be detachably installed on the safety helmet body, and includes an edge computing module, a video acquisition module, a voice interaction module, a power supply and storage module, a supplementary lighting module, and a communication module.

[0029] As an improvement of the specific embodiment, the edge computing module included in the multifunctional intelligent video and voice monitoring device is designed as follows:

[0030] Hardware configuration: Equipped with an MT8768 octa-core processor (main frequency 2.0GHz), equipped with 3GB LPDDR4X memory and 32GB eMMC flash memory, and supports TF card expansion up to 512GB. The processor is built-in with an NPU (neural network processing unit), with a computing power of 2.4 TOPS, and can process multiple video streams in parallel.

[0031] AI algorithm integration: Develop a violation behavior recognition model based on a deep learning framework, and analyze video data in real time through a convolutional neural network (CNN) to identify scenarios such as not wearing a safety helmet, illegal operation, and out-of-bounds behavior, with an identification accuracy rate ≥ 95%. After detecting a violation behavior, the system immediately triggers a voice alarm and pushes an alarm message to the background management system through the communication module.

[0032] Localized data processing: The edge computing module directly processes the video stream, reducing the dependence on the cloud server, with a response delay of less than 200ms, meeting the requirements of real-time monitoring. At the same time, it supports local encrypted storage of video data to ensure privacy and data security.

[0033] As an improvement of the specific embodiment, the video acquisition module included in the multifunctional intelligent video and voice monitoring device has the following functions:

[0034] Anti-shake Camera: It adopts a 13-megapixel CMOS sensor and is equipped with a super-wide-angle lens of 137°, supporting 1080P@30fps high-definition video recording. The anti-shake design includes dual modes of electronic image stabilization (EIS) and optical image stabilization (OIS). It can detect the movement trajectory of the device in real time through a gyroscope sensor, and compensate for the camera shake through algorithms to ensure video stability in complex working environments (such as high-altitude operations and mechanical vibration scenarios).

[0035] Laser-assisted positioning: It is equipped with a laser emitter that can project a visible light beam to assist the camera in quickly positioning the target area. Especially in low-light or blocked environments, it can significantly improve the recognition accuracy of the shooting target.

[0036] Intelligent fill light system: It is configured with a 1.2W high-brightness LED white light, supporting automatic light sensor adjustment. When the ambient illumination is lower than 50lux, the fill light is automatically turned on to ensure video clarity at night or in enclosed spaces. The fill light angle is adjusted synchronously with the camera field of view angle to avoid overexposure or shadow interference.

[0037] As an improvement of the specific embodiment, the voice interaction module included in the multifunctional intelligent video and voice monitoring device has the following functions:

[0038] Two-way intercom function: It adopts full-duplex communication technology, supporting real-time voice interaction between the operator and the ground supervisor. The voice transmission delay ≤50ms. The microphone adopts a dual-array noise reduction design, combined with beamforming technology, effectively suppressing environmental noise (such as mechanical roars), and the voice pickup distance reaches 5 meters.

[0039] Three-party intercom interface: It reserves an interface for the background operation monitoring center to access, supporting the three-party voice conference mode. When an emergency occurs, the operation monitoring center can directly intervene in the command and coordinate multi-party collaborative handling.

[0040] Voice alarm function: It is equipped with a text-to-speech (TTS) engine, which can customize the alarm prompt content (such as "Please wear a safety helmet!" "Prohibited from operating beyond the boundary!"), and broadcast it directionally through two speakers (total power 3W). The volume can be adjusted in the range of 60-90dB to adapt to noisy industrial environments.

[0041] As an improvement of the specific embodiment, the communication and storage module included in the multifunctional intelligent video and voice monitoring device has the following functions:

[0042] Multi-mode communication network: It supports WIFI (802.11a / b / g / n / ac), 4G full network access (compatible with China Mobile / China Unicom / China Telecom), and self-organizing network communication (Mesh network). In the self-organizing network mode, the communication distance between devices ≥50 meters, supporting multi-hop relay, suitable for field operation scenarios without base station coverage.

[0043] Storage expansion ability: It has a built-in storage space of 32GB and supports expansion up to 512GB via a TF card, capable of continuously storing 1080P videos for more than 30 days (calculated based on 8 hours per day). The data interface adopts the USB 3.1 Type-C protocol with a transmission rate of 5Gbps, supporting fast export and charging.

[0044] As an improvement to the specific embodiment, the power module included in the multifunctional intelligent video and voice monitoring device has the following functions:

[0045] Detachable battery design: It uses a high-density lithium polymer battery with a capacity of 5000mAh and supports QC 3.0 fast charging technology (fully charged in 1.5 hours). Under typical workloads (video recording + AI analysis + voice communication), the battery life is ≥5 hours. The battery compartment adopts a magnetic structure, supporting hot-swap replacement to avoid interruption of operations.

[0046] Intelligent power management: The system dynamically adjusts power consumption according to the usage scenario. For example, in the standby mode, the camera and AI module are turned off, and only the communication link is maintained, extending the standby time up to 72 hours.

[0047] As an improvement to the specific embodiment, the multifunctional intelligent video and voice monitoring device adopts a high-level protection and structural design:

[0048] IP66 protection level: The shell is made of high-strength PC / ABS composite material, and the joints are waterproof and dustproof through a silicone rubber seal ring, capable of withstanding high-pressure water column flushing (nozzle diameter 12.5mm, flow rate 100L / min) and alcohol spraying for disinfection.

[0049] Drop resistance performance: Passed the 2-meter six-sided drop test (referring to the MIL-STD-810G standard). The internal components are fixed with buffer rubber pads and metal brackets to ensure no functional damage during dropping.

[0050] Ergonomic design: The total weight of the module ≤260g (including the battery), with a uniform center of gravity distribution to avoid neck fatigue when wearing a safety helmet. The camera supports ±30° pitch adjustment to adapt to different working postures.

[0051] The above shows and describes the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited by the above embodiments. What is described in the above embodiments and the specification is only the principle of the present invention. Without departing from the spirit and scope of the present invention, the present invention will have various changes and improvements, and these changes and improvements all fall within the scope of the present invention claimed. The scope of protection claimed by the present invention is defined by the appended claims and their equivalents.

Claims

1. A multi-functional intelligent video and voice monitoring system, characterized in that Including: Edge computing module, video acquisition module, voice interaction module, communication and storage module: The edge computing module is used to perform AI analysis on video data, identify illegal behaviors and trigger instant voice alarms; The video acquisition module is equipped with anti-shake cameras, which are respectively set at the positions of the insulating bucket, the operator, the ground work supervisor and the multi-functional workstation for real-time video acquisition; The voice interaction module supports two-way voice communication, and enables real-time intercom between the operator and the ground supervisor, as well as three-party voice intercom with the background operation monitoring center; The communication and storage module supports WIFI, 4G network and autonomous network communication, and the communication distance is not less than 50 meters.

2. The multifunctional intelligent video and voice monitoring system according to claim 1, characterized in that, It also includes a safety helmet, and the modules can be detachably installed on the safety helmet.

3. A multifunctional intelligent video and voice monitoring system according to claim 1, characterized in that, It also includes a barometer sensor, an LED fill light, dual microphones and dual speakers.

4. A multifunctional intelligent video and voice monitoring system according to claim 1, characterized in that, The edge computing module is equipped with an MT8768 processor, configured with 3GB RAM and 32GB storage space, and runs the Android 10 system.

5. A multifunctional intelligent video and voice monitoring system according to claim 1, characterized in that, It supports TF card extended storage with a maximum capacity of 512GB, and is equipped with a Type-C interface for data transmission and charging.

6. A multifunctional intelligent video and voice monitoring system according to claim 1, characterized in that, The communication module reserves a 4G interface and supports remote monitoring without job distance restrictions.

7. A multifunctional intelligent video and voice monitoring system according to claim 1, characterized in that The anti-shake camera adopts an electronic anti-shake algorithm to ensure stable video images and meet the requirements of AI analysis.

8. A multifunctional intelligent video and voice monitoring system according to claim 1, characterized in that, It also includes a power module with a removable battery with a capacity of 5000mAh, supporting a continuous video recording duration of more than 5 hours.

9. A multifunctional intelligent video and voice monitoring system according to claim 8, characterized in that, The protection level is IP66, supporting 2-meter drop protection.

Images