Panoramic monitoring system based on digital twinning technology

Abstract

The invention discloses a panoramic monitoring system based on a digital twinning technology, and the system comprises the steps: triggering an abnormal following mechanism when an event driving unit detects a marking event through monitoring equipment; according to an exception following mechanism, the edge collaboration unit calculates a scheduling instruction; and the view angle control unit is dispatched through the dispatching instruction, and the monitoring view angle of the monitoring equipment is adjusted, so that panoramic monitoring is realized. Based on an event driving unit and an abnormity following mechanism, abnormal events are automatically identified and tracked, intelligent following and visual angle dynamic adjustment of a target are realized, and the monitoring efficiency is improved. Through an edge cooperation strategy and a visual angle control unit, seamless connection of the visual field of monitoring equipment is realized, a blind area is eliminated, continuous tracking of a marking event is ensured, and the comprehensiveness and the real-time performance of monitoring are improved. The edge cooperation unit carries out distributed calculation through the edge nodes, reduces the load of the central server, reduces the delay, and improves the real-time response capability of the system.

Description

Technical Field

[0001] The present invention relates to the technical field of panoramic monitoring, and in particular to a panoramic monitoring system based on digital twin technology. Background Art

[0002] With the rapid development of science and technology, modern monitoring systems have gradually transitioned from traditional manual monitoring modes to automated and intelligent monitoring technologies. Especially in the fields of security, transportation, industrial control, etc., real-time monitoring and intelligent processing have become indispensable technical requirements. Traditional monitoring systems usually rely on the deployment of single or multiple fixed cameras. Although they can cover a certain area, they often face problems such as limited field of view and information lag when encountering blind spots, monitoring area adjustments, and large-scale deployment. In order to solve these problems, the monitoring system has gradually introduced cameras with adjustable angles, panoramic camera equipment, and algorithm-based automatic tracking technology. However, how to effectively coordinate the cooperation between multiple devices, especially in large-scale, multi-device monitoring scenarios, to achieve panoramic seamless monitoring, has become an important direction for technological development.

[0003] In recent years, with the rapid development of artificial intelligence (AI), edge computing and digital twin technology, the intelligence level of monitoring systems has been greatly improved. Digital twin technology is a technology that uses real-time data acquisition, virtual modeling and multi-source data fusion. It can accurately digitally map the physical world, so that the monitoring system can not only obtain real-time images, but also perform predictive analysis and simulated scheduling through virtual environments. At the same time, the introduction of edge computing technology has given the monitoring system the ability to perform data preprocessing and intelligent computing on edge devices, effectively reducing system latency and improving the real-time and efficiency of data processing. In this context, intelligent panoramic monitoring systems have become an important research direction, achieving wider and more accurate monitoring coverage through event-driven dynamic scheduling, collaborative work between devices and intelligent perspective adjustment. Summary of the invention

[0004] In view of the above-mentioned problems, the present invention is proposed.

[0005] Therefore, the technical problem solved by the present invention is that the existing panoramic monitoring system has optimization problems such as slow response and incomplete monitoring.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions: a panoramic monitoring system based on digital twin technology, comprising:

[0007] Event-driven unit, view control unit, edge collaboration unit;

[0008] The event-driven unit is used to detect whether a marked event occurs in the monitoring screen;

[0009] The viewing angle control unit controls the adjustment of the viewing angle of the monitoring device;

[0010] The edge collaboration unit collaboratively generates adjustment instructions through edge nodes.

[0011] As a preferred solution of the panoramic monitoring system based on digital twin technology described in the present invention, wherein: when the event-driven unit detects a marking event through the monitoring device, an abnormality following mechanism is triggered;

[0012] According to the exception following mechanism, the edge coordination unit performs calculation of the scheduling instruction;

[0013] The viewing angle control unit is dispatched through the dispatching instruction to adjust the monitoring viewing angle of the monitoring device to achieve panoramic monitoring.

[0014] A panoramic monitoring method based on digital twin technology applied to the system, characterized by comprising:

[0015] Collect real-time monitoring information through monitoring equipment with adjustable angles;

[0016] triggering the following mechanism according to the monitoring information of the presence of the marking event;

[0017] Under the constraints of the following mechanism, edge coordination strategies are simulated through edge nodes, and scheduling instructions are generated according to the simulation results;

[0018] The monitoring angle of the monitoring device is adjusted using the scheduling instruction.

[0019] As a preferred solution of the panoramic monitoring method based on digital twin technology described in the present invention, wherein: the monitoring device with adjustable angle includes a camera with multi-axis rotation capability configured for the monitoring area;

[0020] When configuring the camera, the camera is automatically moved within the maximum rotation range to test the field of view and determine the maximum monitorable area of ​​each camera;

[0021] During the debugging process after each monitoring device is connected to the system, a two-dimensional coordinate axis is established for the panoramic area of ​​the system, and the coordinate area of ​​the field of view corresponding to each rotation angle θ is recorded;

[0022] The monitoring information includes real-time video collected by the monitoring equipment.

[0023] As a preferred solution of the panoramic monitoring method based on digital twin technology described in the present invention, wherein: the marking event includes: the deep learning algorithm is trained to enable it to identify whether an object is a prohibited item; the behavior analysis algorithm is trained to enable it to identify whether a behavior is an abnormal behavior;

[0024] The trained deep learning algorithm is used to identify objects in the video. If prohibited objects are identified, the system marks the objects.

[0025] The trained behavior analysis algorithm is used to analyze continuous video frames and identify complex behavior patterns; if abnormal behavior is detected, the system marks the behavior.

[0026] As a preferred solution of the panoramic monitoring method based on digital twin technology described in the present invention, the following mechanism includes controlling the monitoring device so that the marked event is within the monitoring range, and at the same time the monitoring screen coverage area of ​​all monitoring devices is maximized.

[0027] As a preferred solution of the panoramic monitoring method based on digital twin technology described in the present invention, wherein: the edge collaboration strategy includes, assuming that the marking event occurs in the field of view of device a, after performing simulation operation in the edge node of device a, generating an adjustment instruction;

[0028] When a marked event occurs in the field of view of K devices, a simulation operation is performed on the edge node with the largest CPU idle capacity to generate adjustment instructions;

[0029] The simulation operation includes, according to the following mechanism, simulating the monitoring field of view by taking the rotation angle of each device as an independent variable, so that the rotation angle of each monitoring device satisfies the objective function;

[0030] The objective function:

[0031]

[0032] Where i and j represent monitoring devices; A i，θi Indicates that device i is rotating at angle θ i The area corresponding to the visual field coordinate area under i ,A j ,θ i ,θ j ) represents the overlapping area of ​​the field of view between device i and device j, through the relative viewing angle θ of the devices i ,θ j , match the field of view coordinate area of ​​device i and device j, and obtain the area of ​​the overlapping part in the coordinate area; n represents the total number of devices; θ i represents the angle of device i; θ jrepresents the angle of device j;

[0033] The constraints on the objective function include:

[0034] θ min，i ≤θ i ≤θ max，i

[0035] θ min，j ≤θ j ≤θ max，j

[0036]

[0037] Among them, θ max，i Indicates the maximum rotation angle of the i-th device; θ min，i represents the minimum rotation angle of the i-th device; θ max，j Indicates the maximum rotation angle of the jth device; θ min，j BJ represents the minimum rotation angle of the jth device; r represents the coordinate position of the rth marking event; Q i，θi Indicates that device i is rotating at angle θ i The visual field coordinate area below;

[0038] After the simulation is completed, the rotation angles {θ1, θ2, ..., θ n}, as an adjustment instruction; if after the simulation is completed, it is determined that the current state satisfies the objective function and the constraint conditions, the permission to issue adjustment instructions to other devices is closed, and no adjustment instructions are issued to other devices; if after the simulation is completed, it is determined that the current state does not satisfy the objective function and the constraint conditions, the permission to issue adjustment instructions to other devices is opened;

[0039] When the target of the marking event does not exceed the maximum range of the monitoring area, a target following adjustment instruction is issued to follow and monitor the target; when the target of the marking event exceeds the maximum range of the monitoring area, the following mechanism is exited.

[0040] As a preferred solution of the panoramic monitoring method based on digital twin technology described in the present invention, wherein: the adjustment of the monitoring viewing angle includes, when the authority is opened, all monitoring devices receive the adjustment instruction;

[0041] According to the adjustment instruction, each monitoring device rotates by an angle {θ1, θ2, ..., θ n}, adjust the angle of each monitoring device i until the angle is consistent with θ i Same as above.

[0042] A computer device comprises: a memory and a processor; the memory stores a computer program, wherein: the processor implements the steps of any one of the methods of the present invention when executing the computer program.

[0043] A computer-readable storage medium stores a computer program, wherein: when the computer program is executed by a processor, the steps of any one of the methods of the present invention are implemented.

[0044] Beneficial effects of the present invention: The panoramic monitoring system based on digital twin technology provided by the present invention automatically identifies and tracks abnormal events based on event-driven units and abnormal following mechanisms, realizes intelligent tracking of targets and dynamic adjustment of viewing angles, and improves monitoring efficiency. Through edge collaboration strategies and viewing angle control units, seamless connection of the field of view of monitoring equipment is achieved, blind spots are eliminated, continuous tracking of marked events is ensured, and the comprehensiveness and real-time nature of monitoring are improved. The edge collaboration unit performs distributed computing through edge nodes, reduces the load on the central server, reduces latency, and improves the real-time response capability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0046] Figure 1 An overall framework diagram of a panoramic monitoring system based on digital twin technology provided in the first embodiment of the present invention;

[0047] Figure 2 An overall flow chart of a panoramic monitoring method based on digital twin technology provided for the first embodiment of the present invention. DETAILED DESCRIPTION

[0048] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are described in detail below in conjunction with the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary persons in the art without creative work should fall within the scope of protection of the present invention.

[0049] Example 1, reference Figure 1 , as an embodiment of the present invention, provides a panoramic monitoring system based on digital twin technology, including:

[0050] Event-driven unit, view control unit, and edge collaboration unit.

[0051] The event-driven unit is used to detect whether a marked event occurs in the monitoring screen.

[0052] The viewing angle control unit controls the adjustment of the viewing angle of the monitoring device.

[0053] The edge collaboration unit collaboratively generates adjustment instructions through edge nodes.

[0054] The specific control process is:

[0055] The event-driven unit analyzes the monitoring screen in real time through cameras, sensors or other monitoring devices. When a preset marked event (such as abnormal behavior or prohibited items) is detected, the abnormal follow-up mechanism is immediately triggered. The recognition of the marked event is based on pre-trained deep learning algorithms, such as object recognition, behavior analysis, etc. When the marked event is triggered, the system will collect data on the event, including the location of the target, movement trajectory, etc.

[0056] After the abnormal following mechanism is triggered, the system will start the multi-device collaborative tracking mechanism according to the location and movement direction of the marked event to ensure that the target event remains within the monitoring range.

[0057] According to the exception following mechanism, the edge coordination unit performs calculation of the scheduling instruction.

[0058] Furthermore, the event data is sent to the edge node through the network, and the edge coordination unit uses the optimal edge node (such as the one with the largest CPU idle capacity) to calculate the scheduling instructions. This calculation includes the tracking path prediction of the target event and the optimal viewing angle adjustment plan for each monitoring device.

[0059] After receiving the event data, the edge collaboration unit executes the scheduling algorithm to generate specific device view adjustment instructions. The algorithm simulates the movement trajectory of the target event and calculates the optimal rotation angle of each monitoring device to ensure that the marked event is always within the monitoring field of view and avoid device field of view overlap.

[0060] The viewing angle control unit is dispatched through the dispatching instruction to adjust the monitoring viewing angle of the monitoring device to achieve panoramic monitoring.

[0061] According to the dispatch instructions issued by the edge collaboration unit, the viewing angle control unit will adjust the rotation angle of each monitoring device in real time to ensure that the monitoring range of the device covers the marked event and ensure seamless connection of panoramic monitoring. The viewing angle control unit continuously receives feedback from the edge collaboration unit. When the marked event moves within the monitoring area, the device will make real-time dynamic adjustments to the viewing angle to ensure that the event switches smoothly within the monitoring field of view of different devices.

[0062] Example 2, reference Figure 2 , as an embodiment of the present invention, provides a panoramic monitoring method based on digital twin technology, including:

[0063] S1: Collect real-time monitoring information through monitoring equipment with adjustable angles.

[0064] Furthermore, cameras with multi-axis rotation capabilities are configured for the monitoring area. At the same time, edge computing nodes are configured at the monitoring equipment to perform calculations nearby to ensure rapid monitoring recognition and response.

[0065] When configuring the camera, the camera is automatically moved to the maximum rotation range to test the field of view and determine the maximum monitorable area of ​​each camera.

[0066] During the debugging process after each monitoring device is connected to the system, a two-dimensional coordinate axis is established for the panoramic area of ​​the system, and the coordinate area of ​​the field of view corresponding to each rotation angle θ is recorded.

[0067] The monitoring information includes real-time video collected by the monitoring equipment.

[0068] It should be noted that when the monitoring equipment is installed, a camera with multi-axis rotation capability is used, which can adjust the viewing angle in multiple dimensions, including horizontal, vertical, and tilt, to adapt to different monitoring needs and scenarios. After the camera is connected to the system, the system automatically mobilizes each camera for debugging operations. The camera will perform a comprehensive rotation test within the maximum range of its physical rotation capability, covering all possible monitoring angles. The system automatically controls each camera to rotate in all directions at its maximum rotation capability (for example, 360 degrees horizontally, 180 degrees vertically, etc.) to test its actual monitoring field of view coverage. During the rotation process, the system uses the image information captured by the camera to establish the monitoring area of ​​the camera at each angle, calculate and determine the maximum monitorable area of ​​each camera, and record the boundaries of the area.

[0069] To facilitate the monitoring and management of the camera's field of view, the system will establish a standard two-dimensional coordinate axis system for the monitoring scene. The coordinate axis covers the plane of the entire monitoring area, and the spatial distribution of each camera's field of view is formed by recording the corresponding relationship between the rotation angle of each camera and its monitoring range. When the camera rotates to each angle, the system will record the field of view coverage at that angle in real time and map it to the two-dimensional coordinate axis. The monitoring area of ​​each camera will be decomposed into a series of coordinate points, which constitute the maximum monitorable area of ​​the device.

[0070] S2: triggering the following mechanism according to the monitoring information of the existence of the marking event.

[0071] It is important to know that the deep learning algorithm is trained to identify whether an object is a prohibited item; the behavior analysis algorithm is trained to identify whether a behavior is abnormal. The trained deep learning algorithm identifies objects in the video, and if a prohibited object is identified, the system marks the object. These analyses are all completed at the edge node.

[0072] The trained behavior analysis algorithm is used to analyze continuous video frames and identify complex behavior patterns; if abnormal behavior is detected, the system marks the behavior.

[0073] By training deep learning algorithms to recognize specific objects (such as prohibited items), the system can automatically analyze the object categories in surveillance videos. When prohibited items are detected, the system will immediately mark them to ensure that potential threats are captured in real time. This process does not require human intervention, which greatly improves the efficiency and response speed of the monitoring system. Behavioral analysis algorithms can identify normal and abnormal behavior patterns through training on large amounts of video data. By analyzing continuous multi-frame video data, the system can detect abnormal changes in complex behaviors (such as unusual movements, intrusions, etc.). When abnormal behavior is detected, the system automatically marks it and issues an alarm to achieve a rapid response to potential risks. These algorithm models can be implemented by embedding algorithms in existing technologies. When prohibited items or abnormal behaviors are detected, the system can quickly mark and track the target to achieve fully automated processing. In this way, the system can significantly reduce the workload of manual monitoring while improving monitoring accuracy and response time.

[0074] By controlling the monitoring devices, the marked event is within the monitoring range, and at the same time, the monitoring screen coverage area of ​​all monitoring devices is maximized.

[0075] S3: Under the constraints of the following mechanism, the edge coordination strategy is simulated through the edge nodes, and a scheduling instruction is generated according to the simulation results.

[0076] Furthermore, the edge collaboration strategy includes: assuming that the marking event occurs in the field of view of device a, after performing simulation calculations in the edge node of device a, an adjustment instruction is generated. When the marking event occurs in the field of view of K devices, a simulation calculation is performed on the node with the largest CPU idle capacity among the edge nodes to generate an adjustment instruction. (By generating instructions at the edge node, a large amount of data is avoided from being gathered in the central computing unit for calculation. If all monitoring is obtained for central calculation, the amount of data processed is huge, which will lead to slow calculation speed and thus slow response.)

[0077] The simulation operation includes, according to the following mechanism, simulating the monitoring field of view by taking the rotation angle of each device as an independent variable, so that the rotation angle of each monitoring device satisfies the objective function. The objective function is to maximize the field of view that can be actually detected by the monitoring:

[0078]

[0079] Where i and j represent monitoring devices; A i，θi Indicates that device i is rotating at angle θ i The area corresponding to the visual field coordinate area under i ,A j ,θ i ,θ j ) represents the overlapping area of ​​the field of view between device i and device j, through the relative viewing angle θ of the devices i ,θ j , match the field of view coordinate area of ​​device i and device j, and obtain the area of ​​the overlapping part in the coordinate area; n represents the total number of devices; θ i represents the angle of device i; θ j represents the angle of device j.

[0080] The constraints on the objective function include:

[0081] θ min，i ≤θ i ≤θ max，i

[0082] θ min，j ≤θ j ≤θ max，j

[0083]

[0084] Among them, θ max，i Indicates the maximum rotation angle of the i-th device; θ min，i represents the minimum rotation angle of the i-th device; θ max，j Indicates the maximum rotation angle of the jth device; θ min，j BJ represents the minimum rotation angle of the jth device; r represents the coordinate position of the rth marking event; Q i，θi Indicates that device i is rotating at angle θ i The field of view coordinate area below.

[0085] After the simulation is completed, the rotation angles {θ1, θ2, ..., θ n}, as an adjustment instruction; if after the simulation is completed, it is determined that the current state satisfies the objective function and constraints, the permission to issue adjustment instructions to other devices is closed, and no adjustment instructions are issued to other devices; if after the simulation is completed, it is determined that the current state does not satisfy the objective function and constraints, then the permission to issue adjustment instructions to other devices is opened.

[0086] When the target of the marking event does not exceed the maximum range of the monitoring area, a target following adjustment instruction is issued to follow and monitor the target; when the target of the marking event exceeds the maximum range of the monitoring area, the following mechanism is exited.

[0087] It is important to mention that by performing simulation calculations on edge nodes, the best adjustment instructions are generated according to the viewing angle, position, and relative rotation angle of each monitoring device. This ensures that when a marking event occurs, multiple devices can coordinate in the shortest possible time and quickly adjust the viewing angle to achieve continuous tracking of the marking event. Using edge nodes to perform complex computing tasks effectively reduces the burden on the central server. At the same time, by selecting the edge node with the largest CPU idle capacity for simulation calculations, the computing efficiency and system response speed are further improved. This can avoid computing resource bottlenecks during peak events and ensure the efficient operation of the system in large-scale monitoring scenarios.

[0088] It is also worth mentioning that through simulation operations, the overlapping area of ​​the field of view is calculated according to the relative rotation angle and position of the device, and by optimizing the objective function, the field of view coverage between the devices is ensured to be complementary, and the overlapping parts are minimized, thereby maximizing the overall monitoring coverage of the system. This not only avoids waste of resources, but also ensures the comprehensiveness and effectiveness of monitoring. When the marked event is in the field of view of multiple devices, the system will calculate the optimal rotation angle for each device through simulation operations to ensure that the event is within the monitoring range. If the monitoring status meets the objective function and constraints, the system will stop sending adjustment instructions to other devices to avoid unnecessary adjustment operations; if the conditions are not met, the system will continue to open the adjustment permissions of other devices to ensure continuous tracking of events.

[0089] S4: Using the scheduling instruction, adjust the monitoring angle of the monitoring device.

[0090] When the permission is turned on, all monitoring devices receive the adjustment instruction.

[0091] According to the adjustment instruction, each monitoring device rotates by an angle {θ1, θ2, ..., θ n}, adjust the angle of each monitoring device i until the angle is consistent with θ i Same as above.

[0092] By controlling the rotation angles of multiple devices through dispatching instructions, the monitoring fields of each device are complementary, the overlap of viewing angles is reduced, and the monitoring coverage area is maximized. This ensures the collaborative work between all devices, effectively eliminates monitoring blind spots, and improves the overall monitoring effect of the system. By issuing instructions through the edge nodes on the devices, the monitoring devices can be quickly and accurately adjusted to the specified angle, improving the control efficiency and ensuring that the monitoring devices are always working in the best position.

[0093] The system will control the rotation angle of each device in real time until it is adjusted to the target angle position. This can avoid monitoring blind spots caused by angle deviation, while ensuring continuous tracking and monitoring of marked events to ensure that events will not be missed during the field of view adjustment process.

[0094] If the above functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0095] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in conjunction with such instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in conjunction with such instruction execution systems, devices or apparatuses.

[0096] More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk case (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be a paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering or, if necessary, processing in another suitable manner, and then stored in a computer memory.

[0097] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0098] Example 3 is an embodiment of the present invention, which provides a panoramic monitoring system based on digital twin technology. In order to verify the beneficial effects of the present invention, scientific demonstration is carried out through economic benefit calculation and simulation experiments.

[0099] The test scenario is a large indoor shopping mall, where 10 multi-axis rotating monitoring devices are deployed. Each monitoring device has real-time video acquisition function, and performs data processing through edge nodes, and finally generates dispatch instructions to achieve tracking of abnormal events and panoramic monitoring.

[0100] Before the test begins, all monitoring devices are first debugged to their maximum rotation angles, the monitoring range of each camera is tested, and a two-dimensional coordinate system is established within the system. The maximum monitoring range and rotation angle of each camera are recorded in the system and used as basic data for subsequent simulation operations. At the same time, the scene is divided into 10 different monitoring areas to ensure that each device covers the corresponding area within its maximum monitoring range.

[0101] In order to verify the system's ability to identify and track abnormal events, five abnormal behaviors (such as the appearance of prohibited items, abnormal behavior of personnel, etc.) were randomly set in different areas during the experiment. Through the pre-trained deep learning algorithm, the system can automatically identify these events and mark them. When the system detects a marked event, it triggers the abnormal follow-up mechanism and enters the event tracking mode.

[0102] When a marked event occurs, the edge coordination unit schedules multiple cameras according to their relative positions, rotation angles, overlapping monitoring areas, and CPU idleness, selects the optimal edge node for simulation calculations, and generates viewing angle adjustment instructions for monitoring devices. During the simulation, the system dynamically adjusts the rotation angle of the camera according to the movement trajectory of the marked event to ensure that the event is always within the monitoring range of at least one camera.

[0103] The system adjusts the camera angle in real time according to the dispatch instructions generated by the edge collaboration unit to ensure that the marked event is effectively tracked within its monitoring area. If the movement trajectory of the marked event exceeds the monitoring range of the current camera, the system will automatically switch to other cameras to ensure the realization of panoramic seamless monitoring.

[0104] During the entire test process, the system recorded the monitoring coverage area of ​​each camera, the number of viewing angle adjustments, the duration of abnormal event tracking, and the system resource utilization (such as CPU idle rate, etc.); as shown in Table 1.

[0105] Table 1 Data record table

[0106]

[0107] It can be seen that the present invention can realize the tracking of key features while realizing panoramic monitoring, and can effectively locate abnormal targets when scheduling monitoring information.

[0108] This system achieves efficient tracking and seamless monitoring of marked events through intelligent edge collaboration strategies, dynamic perspective adjustment and deep learning algorithms, significantly improving the system's monitoring coverage capabilities and resource utilization efficiency, and is innovative and has significant advantages.

[0109] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A panoramic monitoring system based on digital twin technology, characterized in that: include: Event-driven unit, view control unit, edge collaboration unit; The event-driven unit is used to detect whether a marked event occurs in the monitoring screen; The viewing angle control unit controls the adjustment of the viewing angle of the monitoring device; The edge collaboration unit collaboratively generates adjustment instructions through edge nodes.

2. The panoramic monitoring system based on digital twin technology according to claim 1, characterized in that: When the event-driven unit detects a marking event through a monitoring device, an abnormality following mechanism is triggered; According to the exception following mechanism, the edge coordination unit performs calculation of the scheduling instruction; The viewing angle control unit is dispatched through the dispatching instruction to adjust the monitoring viewing angle of the monitoring device to achieve panoramic monitoring.

3. A panoramic monitoring method based on digital twin technology applied to the system as claimed in any one of claims 1-2, characterized in that: include: Collect real-time monitoring information through monitoring equipment with adjustable angles; triggering the following mechanism according to the monitoring information of the presence of the marking event; Under the constraints of the following mechanism, edge coordination strategies are simulated through edge nodes, and scheduling instructions are generated according to the simulation results; The monitoring angle of the monitoring device is adjusted using the scheduling instruction.

4. The panoramic monitoring method based on digital twin technology according to claim 3, characterized in that: The monitoring device with adjustable angle includes a camera with multi-axis rotation capability configured for the monitoring area; When configuring the camera, the camera is automatically moved within the maximum rotation range to test the field of view and determine the maximum monitorable area of ​​each camera; During the debugging process after each monitoring device is connected to the system, a two-dimensional coordinate axis is established for the panoramic area of ​​the system, and the coordinate area of ​​the field of view corresponding to each rotation angle θ is recorded; The monitoring information includes real-time video collected by the monitoring equipment.

5. The panoramic monitoring method based on digital twin technology according to claim 4, characterized in that: The marking event includes: the deep learning algorithm is trained to enable it to identify whether an object is a prohibited item; the behavior analysis algorithm is trained to enable it to identify whether a behavior is an abnormal behavior; The trained deep learning algorithm is used to identify objects in the video. If prohibited objects are identified, the system marks the objects. Analyze continuous video frames and identify complex behavior patterns through the trained behavior analysis algorithm; If abnormal behavior is detected, the system will mark the behavior.

6. The panoramic monitoring method based on digital twin technology according to claim 5, characterized in that: The following mechanism includes controlling the monitoring devices so that the marked event is within the monitoring range and the monitoring screens of all monitoring devices cover the largest area.

7. The panoramic monitoring method based on digital twin technology according to claim 6, characterized in that: The edge collaboration strategy includes, assuming that the marking event occurs in the field of view of device a, generating an adjustment instruction after performing a simulation operation in the edge node of device a; When a marked event occurs in the field of view of K devices, a simulation operation is performed on the edge node with the largest CPU idle capacity to generate adjustment instructions; The simulation operation includes, according to the following mechanism, simulating the monitoring field of view by taking the rotation angle of each device as an independent variable, so that the rotation angle of each monitoring device satisfies the objective function; The objective function: Among them, i and j represent monitoring devices; Indicates that device i is rotating at angle θ i The area corresponding to the visual field coordinate area under i ,A j ,θ i ,θ j ) represents the overlapping area of ​​the field of view between device i and device j, through the relative viewing angle θ of the devices i ,θ j , match the field of view coordinate area of ​​device i and device j, and obtain the area of ​​the overlapping part in the coordinate area; n represents the total number of devices; θ i represents the angle of device i; θ j represents the angle of device j; The constraints on the objective function include: i min，i ≤θ i ≤θ max，i i min，j ≤θ j ≤θ max，j Among them, θ max，i Indicates the maximum rotation angle of the i-th device; θ min，i represents the minimum rotation angle of the i-th device; θ max，j Indicates the maximum rotation angle of the jth device; θ min，j BJ indicates the minimum rotation angle of the jth device; r Represents the coordinate position of the rth marked event; Indicates that device i is rotating at angle θ i The visual field coordinate area below; After the simulation is completed, the rotation angles {θ1, θ2, ..., θ n }, as an adjustment instruction; if after the simulation is completed, it is determined that the current state satisfies the objective function and the constraint conditions, the permission to issue adjustment instructions to other devices is closed, and no adjustment instructions are issued to other devices; if after the simulation is completed, it is determined that the current state does not satisfy the objective function and the constraint conditions, the permission to issue adjustment instructions to other devices is opened; When the target of the marking event does not exceed the maximum range of the monitoring area, a target following adjustment instruction is issued to follow and monitor the target; when the target of the marking event exceeds the maximum range of the monitoring area, the following mechanism is exited.

8. The panoramic monitoring method based on digital twin technology according to claim 7, characterized in that: The adjustment of the monitoring angle includes that when the permission is enabled, all monitoring devices receive the adjustment instruction; According to the adjustment instruction, each monitoring device rotates by an angle {θ1, θ2, ..., θ n }, adjust the angle of each monitoring device i until the angle is consistent with θ i Same as above.

9. A computer device comprising: Memory and processor; The memory stores a computer program, which is characterized in that when the processor executes the computer program, the steps of the panoramic monitoring system based on the digital twin technology are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of implementing a panoramic monitoring system based on digital twin technology are implemented.

Images