Management system and method for smart park monitoring equipment

Abstract

The invention relates to the technical field of park management, in particular to a management system and method for intelligent park monitoring equipment, and the system comprises a plurality of visual collectors and sound collectors which are arranged together, and a central control platform which is connected with the visual collectors and the sound collectors. Controlling the corresponding visual collector to adjust the directions of the visual collector and the sound collector; according to the invention, the directions of the monitoring devices are unified, the monitoring precision is improved by utilizing a mode of enriching monitoring means in a single direction, and meanwhile, the monitoring breadth is improved by synchronously dividing the sound information and the visual information, so that the tracking performance of the security and protection system is effectively improved.

Description

Technical Field

[0001] This invention relates to the field of park management technology, and in particular to a management system and method for a smart park monitoring device. Background Technology

[0002] Modern smart park security systems integrate diverse data sources, including video surveillance, IoT sensors, and drone patrols, combined with artificial intelligence and edge computing technologies, to achieve efficient and precise security protection. The system utilizes AI cameras for behavior analysis, facial recognition, and thermal imaging detection, working in conjunction with perimeter protection sensors (such as infrared beams and electronic fences) and environmental sensors (such as smoke, temperature, and humidity monitoring) to form a comprehensive sensing network. Multimodal data fusion technology aligns and integrates spatiotemporal information, improves target detection accuracy through deep learning models (such as YOLO and Transformer), and enables real-time alerts via edge computing, with complex analysis completed in the cloud.

[0003] Chinese Patent Publication No. CN109300471B discloses a method, device, and system for intelligent video surveillance of a field that integrates sound acquisition and recognition. The system collects sound data from microphones deployed at different locations within the field; preprocesses and stores the sound data; collects and stores video data from cameras deployed at different locations within the field; locates the source of sounds with amplitudes exceeding a set threshold; extracts features from sounds with amplitudes exceeding the set threshold; identifies the sounds based on the extracted features to determine if they are abnormal sounds within the field; if they are abnormal sounds, adjusts the shooting angle of the camera closest to the sound source based on the location of the abnormal sound source; acquires the video data captured by the adjusted camera; merges the abnormal sound data with the video data from the corresponding location of the abnormal sound, records and stores the data, and simultaneously issues an alarm signal.

[0004] Chinese Patent Publication No. CN115601905B discloses a smart security alarm method and system for a smart industrial park. By acquiring basic production information of each chemical enterprise within the target chemical industrial park, a security monitoring area is set. This allows for the collection of information on workers, working environments, and equipment operation at various monitoring times within each monitoring area. The system then analyzes the safety of personnel within each monitoring area to obtain a safety assessment index for each worker. This effectively addresses the limitations of current personnel security measures in chemical industrial parks, enabling timely alarms and minimizing economic losses while ensuring worker safety.

[0005] However, the above method has the following problems: 1. The inability to actively track abnormal targets leads to blind spots in the security management system. 2. The inability to distinguish regular sounds leads to frequent activation of monitoring equipment, causing blind spots in the security management system due to repeated mobilization of monitoring resources. Summary of the Invention

[0006] To address this, the present invention provides a management system and method for smart park monitoring equipment, which overcomes the problems in the prior art where the security management system cannot actively track abnormal targets, resulting in blind spots, and where the system cannot distinguish regular sounds, leading to frequent activation of monitoring equipment and further causing blind spots in the security management system.

[0007] This leads to a decrease in the tracking performance of security systems.

[0008] On one hand, the present invention provides a management system for smart park monitoring equipment, comprising: Several visual acquisition devices used to observe the monitoring direction and collect video information; A number of sound acquisition devices are set up to collect sound information in correspondence with each visual acquisition device; A central control platform connected to each visual acquisition unit and each audio acquisition unit is used to issue alarms based on the video information and the audio information. Each sound acquisition device collects sound according to the monitored direction; The central control platform controls the corresponding visual acquisition device to adjust the monitoring direction based on the sound information; The visual acquisition device responds to the change in the monitoring direction by adjusting the orientation of several visual acquisition devices within the monitoring range to the corresponding direction. The central control platform determines the monitoring direction based on the sudden sound. The monitoring range is the corresponding area that the visual acquisition device can observe at a constant resolution through the viewport.

[0009] Furthermore, the central control platform is equipped with a preset acquisition cycle to determine ambient sound and the sudden sound, wherein, for any sound, If the sound collector detects the sound repeating several times in two consecutive preset acquisition cycles, the central control platform determines that the sound is the ambient sound. If the sound is collected by a sound collector corresponding to at least two of the monitoring ranges within two consecutive preset collection cycles, the central control platform determines that the sound is the ambient sound.

[0010] Furthermore, when any sound is determined to be an ambient sound, the central control platform controls each sound collector that receives the sound to refrain from taking any action.

[0011] Furthermore, for sound collectors that receive sounds that are not identified as ambient sounds, the central control platform determines that the sound collector has picked up a sudden sound change. The central control platform controls each visual acquisition device within the monitoring range corresponding to the sound acquisition device to scan the monitoring range and confirm the source of the sudden sound. In this process, the scanning occurs within a single acquisition cycle, during which the central control platform controls the rotation of the vision acquisition device. For the vision acquisition device, during a single scan, the movement range of its viewport within the acquisition cycle at least includes the monitoring range corresponding to the scan.

[0012] Furthermore, in response to the occurrence of the sudden sound, the central control platform makes a determination based on the image within the monitoring range. If either visual acquisition device observes the sound source during two consecutive acquisition cycles, the central control platform determines that the sound source object has been detected. If either visual acquisition device fails to observe the sound source during two consecutive acquisition cycles, the central control platform determines that the sound source object has been lost.

[0013] Furthermore, in response to the discovery of the sound source object, the central control platform controls each visual display within a plurality of monitoring ranges to perform directional tracking of the sound source object; The direction tracking refers to the visual display adjusting the monitoring direction so that the sound source object is included within its viewport.

[0014] Furthermore, in response to the lost sound source object, the central control platform issues a sound source loss alarm and controls several visual displays corresponding to each adjacent monitoring range that have collected the sudden sound to perform the scanning.

[0015] Furthermore, in response to the occurrence of the sudden sound, the central control platform controls the visual acquisition devices that can observe the sound acquisition device and those that have not acquired the sudden sound to adjust the monitoring direction, and includes the visual acquisition device that has acquired the sudden sound in the corresponding viewport.

[0016] On the other hand, the present invention provides a management method for smart park monitoring equipment, including: Collect sound information and classify it into ambient sound and sudden sound. Isolate ambient sounds and determine if any sudden sound changes occur; Responding to the appearance of a sudden sound, determine the location of the sudden sound; Identify the source object of the sudden sound and trace the source object; An alarm is triggered based on the action of the sound source object.

[0017] Furthermore, the step of determining the sound information as ambient sound and sudden sound includes: Set the acquisition period and use the acquisition period as a reference for sound acquisition; Based on the acquisition cycle, several sound information with stable reproducibility frequencies are determined; Set the phase of the sound information with a stable reproduction frequency to be inverted, and eliminate it using the reproduction frequency; The response was successfully eliminated, and the sound information was determined to be ambient sound.

[0018] Compared with the prior art, the beneficial effects of the present invention are as follows: by setting up a directional sound collector and a visual collector set in the same direction as the sound collector, the direction of each monitoring device is unified, and the monitoring accuracy is improved by enriching the monitoring methods in a single direction. At the same time, by synchronously dividing sound information and visual information, the monitoring breadth is improved, thereby effectively improving the tracking performance of the security system.

[0019] Furthermore, by observing the sound reproduction, ambient sounds and sudden sounds can be distinguished. At the same time, the inverse audio corresponding to the ambient sound is generated to cancel out the interference caused by the ambient sound. This can effectively improve the reception of sudden sounds. While effectively improving the ability to identify sudden sounds from a single direction, it can also effectively avoid the problem of not being able to accurately track the location of sudden sounds due to interference from ambient sounds, thereby further improving the tracking performance of the security system.

[0020] Furthermore, by using visual tracking to determine the target corresponding to the sudden sound, the tracking performance is effectively improved. At the same time, the specific location of the sudden sound can be identified visually. This avoids interference caused by visual or sound information and uses sound and vision to verify each other, thereby further improving the tracking performance of the security system.

[0021] Furthermore, by using several monitoring devices belonging to the same tracking range to verify each other, blind spots in monitoring are eliminated. This not only effectively improves the visibility within the monitoring range, but also further enhances the tracking performance of the security system through mutual observation.

[0022] On the other hand, compared with the prior art, the present invention determines whether a sudden sound and sound source have occurred by collecting sound information and video information from a certain direction, and determines the sound source object accordingly. At the same time, by inverting the phase of the ambient sound, the influence of the ambient sound is eliminated. This effectively avoids the interference of the ambient sound on the security system and avoids misjudgment of sudden sound sources, thereby effectively improving the tracking performance of the security system. Attached Figure Description

[0023] Figure 1 This is a connection diagram of the management system for the smart park monitoring equipment of the present invention; Figure 2 This is a flowchart illustrating the sudden sound determination method according to an embodiment of the present invention; Figure 3 This is a flowchart of the management method for the smart park monitoring equipment of the present invention; Figure 4 This is a flowchart illustrating the data determination of environmental sounds and sudden sound changes in an embodiment of the present invention. Figure 5 This is a schematic diagram of data collection in data collection group A according to an embodiment of the present invention; Figure 6 This is a schematic diagram of target tracking in the management system of an embodiment of the present invention; Figure 7 This is a viewport diagram of acquisition group A and acquisition group B in an embodiment of the present invention. Detailed Implementation

[0024] To make the objectives and advantages of the present invention clearer, the present invention will be further described below with reference to embodiments; it should be understood that the specific embodiments described herein are merely for explaining the present invention and are not intended to limit the present invention.

[0025] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of the present invention and are not intended to limit the scope of protection of the present invention.

[0026] It should be noted that in the description of this invention, the terms "upper", "lower", "left", "right", "inner", "outer", etc., which indicate directions or positional relationships, are based on the directions or positional relationships shown in the accompanying drawings. This is only for the convenience of description and is not intended to indicate or imply that the device or element must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation of this invention.

[0027] Furthermore, it should be noted that, in the description of this invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0028] Please see Figure 1 As shown, it is a connection diagram of the management system of the smart park monitoring equipment of the present invention, including: Several visual acquisition devices used to observe the monitoring direction and collect video information; A number of sound acquisition devices are set up to collect sound information in correspondence with each visual acquisition device; The central control platform, connected to each visual and audio acquisition unit, is used to issue alarms based on video and audio information. Each sound acquisition device collects sound according to the monitoring direction; Based on the sound information, the central control platform controls the corresponding visual acquisition device to adjust the monitoring direction; The visual acquisition device responds to changes in the monitoring direction by adjusting the orientation of several visual acquisition devices within the monitoring range to the corresponding direction. Among them, the central control platform determines the monitoring direction based on the sudden sound; The monitoring range is the corresponding area that the visual acquisition device can observe in the viewport at constant resolution.

[0029] By using directional sound acquisition devices and visual acquisition devices positioned in the same direction as the sound acquisition devices, the direction of each monitoring device is unified. By enriching the monitoring methods in a single direction, the monitoring accuracy is improved. At the same time, by synchronously dividing sound and visual information, the monitoring breadth is increased, thereby effectively improving the tracking performance of the security system.

[0030] Please see Figure 2 As shown, this is a flowchart of the sudden sound determination method according to an embodiment of the present invention. The central control platform has a preset acquisition period to determine ambient sound and sudden sound. For any sound, If the sound collector detects the sound repeating several times in two consecutive preset collection cycles, the central control platform determines that the sound is an ambient sound. If the sound is collected by a sound collector in at least two monitoring ranges within two consecutive preset collection cycles, the central control platform determines that the sound is an ambient sound.

[0031] In implementation, the above system can be used in the following environments: Example 1: The sound acquisition device detected a sudden sound of breaking glass (abrupt sound) near the park's perimeter wall. The central control platform determined the direction to be the northeast corner of the perimeter wall using sound source localization technology.

[0032] Visual Linkage The central control platform immediately controls the visual acquisition device in the northeast direction to turn towards the sound source, and at the same time, it coordinates with the three adjacent cameras to adjust their viewing angles to form multi-angle coverage.

[0033] Multi-source verification The visual acquisition device captures images of someone climbing over a wall (video information) and fuses them with sound (the sound of metal clashing) for analysis.

[0034] The central control platform confirms the intrusion, triggers an audible and visual alarm, and pushes the coordinates to the security terminal.

[0035] Dynamic tracking The system continuously tracks the intruder's trajectory by fusing sound (footsteps) and vision (moving targets), and automatically adjusts the camera angle to keep the target within the "monitoring range".

[0036] Example 2: Abnormal sound detection The sound acquisition device near the power distribution room in the park detected a sharp electrical whistling sound (abrupt sound), and the central control platform marked the direction of the sound source as the A3 power distribution box.

[0037] Visual Focus Control the nearest 360° PTZ camera to turn towards the A3 distribution box and switch to infrared mode. Simultaneously point the two adjacent cameras at different sides of the distribution box.

[0038] Multimodal analysis The video shows smoke coming from the distribution box (visible light image), and the infrared image shows that the local temperature exceeds the threshold.

[0039] Sound spectrum analysis confirmed the presence of arc discharge characteristics.

[0040] Graded response The system identifies an electrical fire risk, automatically cuts off the corresponding circuit, starts the sprinkler system, and sends close-up images of the equipment and a voiceprint diagnostic report to the maintenance personnel.

[0041] Specifically, when any sound is determined to be an ambient sound, the central control platform controls the sound collectors that receive that sound to refrain from taking any action.

[0042] Specifically, if a sound sensor receives a sound that is not identified as ambient sound, the central control platform determines that the sound sensor has picked up a sudden sound change. The central control platform controls each visual acquisition device within the monitoring range corresponding to the sound acquisition device to scan the monitoring range and identify the source of the sudden sound. In a single acquisition cycle, the central control platform controls the rotation of the vision acquisition unit. For the vision acquisition unit, when performing a single scan, the movement range of its viewport within the acquisition cycle must at least include the monitoring range corresponding to the scan.

[0043] By observing the sound reproduction, ambient sounds and sudden sounds can be distinguished. At the same time, the inverse audio corresponding to the ambient sound is generated to cancel out the interference caused by the ambient sound. This can effectively improve the reception of sudden sounds. While effectively improving the ability to identify sudden sounds from a single direction, it can also effectively avoid the problem of not being able to accurately track the location of sudden sounds due to interference from ambient sounds, thereby further improving the tracking performance of the security system.

[0044] In practice, for Example 1, it can be operated in the following manner: Example 3: Sound acquisition and judgment Ambient sound judgment threshold: The central control platform continuously monitors the background noise (such as wind noise, insect chirping) of each sound collector, and sets the sound pressure level threshold ≤65dB (A weighted) and frequency range 20Hz-5kHz as ambient noise.

[0045] Sudden sound trigger: The sound acquisition unit S01 (located on the northeast wall) detected an impact sound of 82dB (peak frequency 3.5kHz), which exceeds the environmental threshold.

[0046] The central control platform determined that S01 was a valid sudden change sound and initiated the response process.

[0047] Visual scanning linkage Scan range: The monitoring range corresponding to S01 is a 60° horizontal viewing angle (assuming that the camera C01 is initially facing due north and the center of the viewport is 0°).

[0048] The central control platform controls C01 to perform a scan within a 2-second acquisition cycle, rotating from -30° to +30° (covering the entire 60° monitoring range).

[0049] Multi-camera collaboration: The adjacent camera C02 (initially facing 45°) synchronously adjusts its viewport to 15°-75°, forming a 30° overlap zone with C01 to ensure no blind spots.

[0050] Sound source confirmed C01 captured a human figure in the +12° direction (the target pixel ratio in the video frame is ≥5%), and the error between C01 and the sound source direction (+10°, calculated by TDOA) is <2°, confirming it as a real target.

[0051] In practice, Example 2 can be operated in the following manner: Example 4: Abnormal sound detection Environmental filtration: The normal noise level in the power distribution room is 58dB (fan operation noise), with the frequency concentrated in the range of 100Hz-1kHz.

[0052] Sudden sound trigger: The sound acquisition unit S05 detected a high-frequency howling sound of 95dB (8kHz) with a duration of >500ms, which was determined to be a characteristic of electric arc discharge.

[0053] Visual saccadics and diagnosis Scan parameters: The C05 camera (wide-angle lens) initially covers a 120° field of view (-60° to +60°), and the central control platform commands it to scan in segments within 1 second: First segment: -60° to 0° (speed 60° / s), infrared mode activated.

[0054] Second segment: From 0° to +60°, the local temperature of the A3 distribution box was found to be 120°C (normal value <50°C).

[0055] Multimodal verification: The sound energy distribution (8kHz > 40%) matches the spark flicker in the video (discharge visible at 15 frames per second) with a confidence level > 90%.

[0056] Dynamic adjustment After confirming the fault, the system controls C05 to fix the viewing angle at +35° (front of the distribution box) and adjust the optical zoom from 1x to 5x to continuously monitor the smoke area (resolution 3840×2160@30fps).

[0057] Specifically, in response to the appearance of sudden sound changes, the central control platform makes a judgment based on the images within the monitoring range. If any visual acquisition device observes a sound source during two consecutive acquisition cycles, the central control platform determines that the sound source object has been detected. If either visual acquisition device fails to observe the sound source during two consecutive acquisition cycles, the central control platform determines that the sound source object is missing.

[0058] Specifically, upon detecting a sound source, the central control platform controls the visual displays within several monitoring ranges to track the direction of the sound source. Direction tracking involves adjusting the monitoring direction of the visual display so that the sound source object is included within its viewport.

[0059] Specifically, in response to the loss of a sound source, the central control platform issues a sound source loss alarm and controls several visual displays corresponding to the adjacent monitoring ranges where the sudden sound was collected to scan.

[0060] By using visual tracking to identify the target corresponding to the sudden sound, the tracking performance is effectively improved. The system can also visually distinguish the specific location of the sudden sound, avoiding interference from visual or sound information. Furthermore, the system uses sound and vision to verify each other, thereby further improving the tracking performance of the security system.

[0061] In practice, the following operating methods apply to the above situations: Example 5: Perimeter Intrusion Warning (Sudden Sound → Visual Tracking → Loss Alarm) Phase 1: Sudden sound triggers visual saccade Time T0 (first acquisition cycle): The sound acquisition unit S01 detected a broken sound (abrupt sound) at 82dB@3.5kHz, and the central control platform marked the direction of the sound source as +10° (relative to S01).

[0062] Control the visual acquisition unit C01 (initial viewing angle 0°, monitoring range 60°) to scan from -20° to +40° within 1 second (covering ±30° of the sound source direction).

[0063] Judgment result: C01 detected a moving human figure (6% of pixels) at +12°, but it did not last for two full cycles, so the target is not confirmed at this time.

[0064] Phase 2: Continuous Periodic Verification Time T1 (Second Acquisition Cycle): C01 maintains focus at +12°, detecting that the target is still within the viewport (8% pixel ratio, moving speed 1.2m / s).

[0065] Judgment: Target detected for 2 consecutive cycles → Sound source confirmed as intruder, tracking mode activated.

[0066] Tracking motion: The C01 gimbal follows the target at a speed of 10° / s (predicted trajectory: +12°→+15°).

[0067] Link C02 (adjacent camera) to adjust the viewing angle to +10° to +50° for blind spot tracking.

[0068] Phase 3: Sound Source Loss Processing Time T2 (the sudden sound disappears): S01 did not detect any new mutated sound for 3 seconds, but C01 could still see the target (+18°).

[0069] Time T3 (Target exits monitoring range): C01 triggers a sound source loss alarm when the target is lost within two consecutive cycles (no pixel change >5% within the viewport).

[0070] Central control platform response: Mark the last known coordinates (+22°), and control C01, C02, and C03 to perform a coordinated scan of the sector area from +15° to +45° (speed 20° / s).

[0071] Activate sound acquisition device S02 (adjacent node) to enhance monitoring and eliminate false alarms (such as animal interference).

[0072] Example 6: Equipment Fault Monitoring (Multimodal Verification → Tracking → Loss Recovery) Phase 1: Arc sound triggers infrared scanning Time T0 (first acquisition cycle): The sound acquisition unit S05 detected an electric arc sound of 95dB@8kHz. The central control platform located the sound source at a direction of +35° (relative to S05).

[0073] The infrared camera C05 was controlled to scan from +20° to +50° within 0.5 seconds and found that the A3 distribution box had a local high temperature (118°C, normal <50°C).

[0074] Judgment: An anomaly was detected in a single cycle, but secondary confirmation is required.

[0075] Phase 2: Continuous Periodic Fault Confirmation Time T1 (Second Acquisition Cycle): With the C05 fixed at a viewing angle of +35°, it detected a continuous temperature rise to 125°C and captured spark flashes (5 times per second).

[0076] Judgment: Fault confirmed for 2 consecutive cycles → The source of the sound is an arc fault, start tracing.

[0077] Tracking motion: C05 switches to 5x zoom, locks the power distribution box panel (viewing angle reduced to ±5°), and transmits 4K video in real time.

[0078] Simultaneously disable the regular monitoring of the adjacent camera C04 and adjust it to +30° to +40° infrared auxiliary monitoring.

[0079] Phase 3: Sound Source Loss and Recovery Time T2 (sound suddenly stops): S05 detected a sound pressure level drop to 60dB (the fault may have stopped temporarily), but C05 still showed smoke.

[0080] Time T3 (Smoke dissipates): C05 If no abnormal temperature (<50°C) or visible light change is detected for two consecutive cycles, a sound source loss alarm will be triggered.

[0081] Central control platform response: Control C04, C05, and C06 to perform infrared + visible light dual-mode scanning from +25° to +45° (cycle 1 second / time).

[0082] Record the last abnormal location (+35°) and push it to the operation and maintenance terminal to prompt manual review.

[0083] Specifically, in response to the appearance of a sudden sound, the central control platform controls the visual acquisition devices that can observe the sound and those that have not acquired the sudden sound to adjust their monitoring direction, and includes the visual acquisition devices that have acquired the sudden sound into their corresponding viewports.

[0084] By using several monitoring devices belonging to the same tracking range to verify each other, blind spots in monitoring are eliminated. This not only effectively improves the visibility within the monitoring range, but also further enhances the tracking performance of the security system through mutual observation.

[0085] Please see Figure 3 The flowchart shown is a management method for the smart park monitoring equipment of the present invention, including: Step S1: Collect sound information and determine the sound information as ambient sound and sudden change sound; Step S2: Isolate ambient sound and determine if the sudden sound occurs; Step S3: In response to the appearance of the sudden sound, determine the location of the sudden sound; Step S4: Identify the sound source object of the sudden sound and track the sound source object; Step S5: Issue an alarm based on the action of the sound source object.

[0086] Please see Figure 4 As shown, this is a flowchart illustrating the data determination of ambient sound and sudden sound in an embodiment of the present invention. The steps for determining sound information as ambient sound and sudden sound include: Step S101: Set the acquisition period and perform sound acquisition based on the acquisition period; Step S102: Determine several sound information with stable reproducibility frequencies based on the acquisition cycle; Step S103: Set the phase of the sound information with a stable reproduction frequency to be inverted, and eliminate it using the reproduction frequency; Step S104a: Response cancellation successful; the sound information is determined to be ambient sound. or, Step S104b: If the response cancellation fails, the sound information is determined to be a sudden sound.

[0087] By collecting sound and video information from a certain direction, it is possible to determine whether a sudden sound has occurred and its source, and to identify the source of the sound. At the same time, by inverting the phase of ambient sound, the influence of ambient sound is eliminated. This effectively avoids interference from ambient sound on the security system and prevents misjudgment of sudden sound sources, thereby effectively improving the tracking performance of the security system.

[0088] Understandably, most noise in smart parks comes from sources such as electrical distribution boxes, fans, or other mechanical equipment. The noise level of such equipment generally does not exceed 65 dB. However, this also includes regular noise exceeding 65 dB, such as: The beeping sound indicating the order of equipment registration (70-90dB), etc.; To avoid the influence of sounds such as buzzing on the judgment of sudden sounds, the buzzing sound is treated as an ambient sound and eliminated by reproducing the frequency in the system.

[0089] Example 7: Perimeter Intrusion Early Warning Steps S1-S2: Sound Acquisition and Judgment S101: The acquisition cycle is set to 1 second / time, and the sound acquisition device S01 continuously acquires data across the entire frequency band from 20Hz to 20kHz.

[0090] S102: Analysis of the first 10 cycles of data determined that the recurrence frequency of background noise (wind noise) was stable at 100Hz-1kHz, and the sound pressure level was ≤65dB.

[0091] S103: Generates a reverse sound wave (180° phase difference) to cancel background noise, with a cancellation effect of >90% (remaining energy <5dB).

[0092] S104b: An uncancelled signal of 82dB@3.5kHz (sound of breaking glass) was detected in the 11th cycle and determined to be a sudden sound.

[0093] Step S3: Sudden Sound Localization The direction of the sound source was calculated to be +10° (relative to S01) using the TDOA algorithm, with an error of ±2°.

[0094] Step S4: Sound Source Object Tracking Visual verification: Cycle 1: Camera C01 scans from -20° to +40° and detects a human figure at +12° (6% of pixels).

[0095] Second cycle: The target is still at +15° (8% of pixels), confirming the sound source as an intruder.

[0096] Tracking motion: The C01 gimbal tracks the target's movement at a speed of 10° / s, and works in conjunction with the C02 to fill blind spots (view of view +10° to +50°).

[0097] Step S5: Alarm Trigger The target continues to move to +22° and then disappears. If no target is detected for two consecutive cycles, a sound source loss alarm is triggered, and adjacent cameras are activated for scanning.

[0098] Example 8: Equipment Fault Monitoring Steps S1-S2: Sound Acquisition and Judgment S101: The sound acquisition cycle is 0.5 seconds / time. The S05 sound acquisition device monitors the noise in the power distribution room.

[0099] S102: The background noise (fan) reproduction frequency is 200Hz-800Hz, and the sound pressure level is 58dB.

[0100] S103: After reverse cancellation, the remaining noise energy is <3dB (cancellation success rate 95%).

[0101] S104b: An uncancelled signal (arc howl) of 95dB@8kHz was detected, which was determined to be a sudden sound.

[0102] Step S3: Sudden Sound Localization The sound source direction is located at +35° (relative to S05), corresponding to the location of the A3 distribution box.

[0103] Step S4: Sound Source Object Tracking Visual verification: Cycle 1: Infrared camera C05 scanned from +20° to +50° and detected a local temperature of 118°C.

[0104] Second cycle: The temperature rises to 125°C and a spark is detected, confirming that the source of the sound is an arc fault.

[0105] Tracking motion: C05 switches to 5x zoom, locks onto the fault point (angle ±5°), and performs synchronous infrared monitoring.

[0106] Step S5: Alarm Trigger If the temperature exceeds the threshold for more than 10 seconds, a Level 1 electrical fire alarm will be triggered, automatically cutting off the circuit and notifying maintenance personnel.

[0107] Please see Figure 5 As shown, this is a schematic diagram of the acquisition group A in an embodiment of the present invention. For the sound acquisition device, due to the high noise level in the park, when a sudden sound occurs, if the corresponding sound source is far away, the sound acquisition device cannot acquire the corresponding sound, such as... Figure 5 As shown, the visual acquisition device has a lower range than the audio acquisition device, but a higher range. Therefore, this application defines a monitoring range to determine the object to be monitored based on the breadth of sound, and coordinates with other monitors to capture that object. Please refer to [link to relevant documentation]. Figure 6 As shown, this is a schematic diagram of target tracking in the management system of an embodiment of the present invention: For ease of explanation, the sound and visual acquisition devices, which are set up in groups, are grouped together as one acquisition group. It is easy to see from the diagram: Monitoring range 1 includes acquisition group A and acquisition group B. Monitoring range 2 includes acquisition group B and acquisition group C. Monitoring range 3 includes acquisition group A and acquisition group C. Monitoring range 4 includes acquisition group C and acquisition group D. There are overlapping areas in each monitoring range; Please refer to the following: Figure 7 As shown, this is a viewport diagram of acquisition group A and acquisition group B in an embodiment of the present invention: For acquisition group A and acquisition group B in monitoring range 1, such as Figure 7 As shown in Figure (a) of this embodiment, which is a viewport schematic diagram of acquisition group A, since the monitored object is located behind a wall, acquisition group A can know that there is a monitored object behind the wall through sound information, but cannot observe the monitored object. like Figure 7 As shown in Figure (b) of this embodiment, it is a viewport diagram of the acquisition group B in this invention. The acquisition group B can observe the monitored object based on the information from the acquisition group A.

[0108] Based on this, if the monitored object appears in the position shown in the image below, and moves in the direction of the arrow to reach the target location: The monitored object emits a sudden sound, and acquisition groups A and C, which can collect such sounds, are activated to locate the monitored object. Data acquisition group C and data acquisition group A switch to the monitored object → Data acquisition group A observes the monitored object and uploads it to the central control unit → The central control unit determines that the monitored object is within monitoring range 1 and monitoring range 3 → Based on the location of the monitored object determined by acquisition group A, acquisition groups B and C align their viewpoints with the corresponding direction of the monitored object. When the monitored object moves to the path location, the central control system determines that the monitored object has left the monitoring range (3), and the acquisition group C stops tracking it. At the same time, the acquisition group B observes the monitored object → When the monitored object moves to the target location, it is no longer under the observation of acquisition group A, while acquisition group B continues to observe the monitored object.

[0109] The above method activates the observation location by changing the breadth of sound, and causes each acquisition group within the same "monitoring range" to enter the observation state in advance. After determining the accurate location and actual direction of movement, the acquisition groups within the same "monitoring range" are controlled to enter the observation state based on whether the movement of the monitored target has left the "monitoring range", and thus continuous monitoring of the monitored object is carried out in terms of image or sound.

[0110] The technical solution of the present invention has been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will all fall within the scope of protection of the present invention.

[0111] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A management system for smart park monitoring equipment, comprising: Several visual acquisition devices used to observe the monitoring direction and collect video information; A number of sound acquisition devices are set up to collect sound information in correspondence with each visual acquisition device; A central control platform connected to each visual acquisition unit and each audio acquisition unit is used to issue alarms based on the video information and the audio information. Its features are, Each sound acquisition device collects sound according to the monitored direction; The central control platform controls the corresponding visual acquisition device to adjust the monitoring direction based on the sound information; The visual acquisition device responds to the change in the monitoring direction by adjusting the orientation of several visual acquisition devices within the monitoring range to the corresponding direction. The central control platform determines the monitoring direction based on the sudden sound. The monitoring range is the corresponding area that the visual acquisition device can observe at a constant resolution through the viewport.

2. The management system for the smart park monitoring equipment according to claim 1, characterized in that, The central control platform has a preset acquisition period to determine ambient sound and the sudden sound changes. For any given sound, If the sound collector detects the sound repeating several times in two consecutive preset acquisition cycles, the central control platform determines that the sound is the ambient sound. If the sound is collected by a sound collector corresponding to at least two of the monitoring ranges within two consecutive preset collection cycles, the central control platform determines that the sound is the ambient sound.

3. The management system for the smart park monitoring equipment according to claim 2, characterized in that, When any sound is determined to be an ambient sound, the central control platform controls each sound collector that receives the sound to refrain from taking any action.

4. The management system for the smart park monitoring equipment according to claim 3, characterized in that, If a sound is received from a sound collector that is not identified as an ambient sound, the central control platform determines that the sound collector has picked up a sudden sound change. The central control platform controls each visual acquisition device within the monitoring range corresponding to the sound acquisition device to scan the monitoring range and confirm the source of the sudden sound. In this process, the scanning occurs within a single acquisition cycle, during which the central control platform controls the rotation of the vision acquisition device. For the vision acquisition device, during a single scan, the movement range of its viewport within the acquisition cycle at least includes the monitoring range corresponding to the scan.

5. The management system for the smart park monitoring equipment according to claim 4, characterized in that, In response to the occurrence of the sudden sound, the central control platform makes a determination based on the images within the monitoring range. If either visual acquisition device observes the sound source during two consecutive acquisition cycles, the central control platform determines that the sound source object has been detected. If either visual acquisition device fails to observe the sound source during two consecutive acquisition cycles, the central control platform determines that the sound source object has been lost.

6. The management system for the smart park monitoring equipment according to claim 5, characterized in that, In response to the discovery of the sound source object, the central control platform controls each visual display within a plurality of monitoring ranges to perform directional tracking of the sound source object; The direction tracking refers to the visual display adjusting the monitoring direction so that the sound source object is included within its viewport.

7. The management system for the smart park monitoring equipment according to claim 5, characterized in that, In response to the lost sound source object, the central control platform issues a sound source loss alarm and controls several visual displays corresponding to each adjacent monitoring range that have acquired the sudden sound to perform the scanning.

8. The management system for the smart park monitoring equipment according to claim 6 or 7, characterized in that, In response to the occurrence of the sudden sound, the central control platform controls the visual acquisition devices that can observe the sound acquisition device and have not acquired the sudden sound to adjust the monitoring direction, and includes the visual acquisition device that has acquired the sudden sound into the corresponding viewport.

9. A management method for smart park monitoring equipment, characterized in that, include: Collect sound information and classify it into ambient sound and sudden sound. Isolate ambient sounds and determine if any sudden sound changes occur; Responding to the appearance of a sudden sound, determine the location of the sudden sound; Identify the source object of the sudden sound and trace the source object; An alarm is triggered based on the action of the sound source object.

10. The management method for smart park monitoring equipment according to claim 9, characterized in that, The step of determining the sound information as ambient sound and sudden change sound includes: Set the acquisition period and use the acquisition period as a reference for sound acquisition; Based on the acquisition cycle, several sound information with stable reproducibility frequencies are determined; Set the phase of the sound information with a stable reproduction frequency to be inverted, and eliminate it using the reproduction frequency; The response was successfully eliminated, and the sound information was determined to be ambient sound.

Images