Monitoring system, method and computer device thereof
Through radar and infrared monitoring technology, it automatically detects and recognizes moving objects on the boundaries of the region, solving the problems of high physical prevention and control costs and delay in monitoring errors of high-definition cameras, and achieving the effect of automated management and reducing operational costs.
Patent Information
- Application Number
- CN202211141574.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-20
- Publication Date
- 2025-01-07
- Estimated Expiration
- 2042-09-20
AI Technical Summary
Traditional regional wall-type boundary management relies on physical prevention and control, which is costly and poorly aesthetically pleasing. Although high-definition camera monitoring reduces construction costs, it increases operating costs, and there are problems of mis-monitoring and delay prevention and control.
Radar and infrared monitoring technology are used to automatically manage regional boundaries, detect moving objects on the top of the wall through millimeter wave radar, combine infrared imaging to determine whether they are human, and output images to reduce mis-monitoring and delayed reactions.
Automatic regional boundary management is realized, reducing management costs, reducing mis-monitoring and delayed responses, and improving security and management efficiency.
Smart Images

Figure CN115567687B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of monitoring, and in particular to a monitoring system, method and computer device thereof. Background Art
[0002] Regional wall boundary management is an important part of infrastructure management. Regional boundaries are usually the perimeter of a certain area. Its main management contents include but are not limited to: management of the integrity of boundary infrastructure, continuity and integrity management of regional boundaries, intruder prevention and control and security management. This technology is widely used in: campus area wall boundary management, company area infrastructure management, residential community security management, hospital designated area management, etc.
[0003] Traditional regional wall boundary management mostly adopts physical prevention and control methods, such as increasing the wall height, installing wire mesh and broken glass on the wall, etc. The construction cost is high, the aesthetics is poor, and there is no relevant feedback and management for intrusion behavior.
[0004] With the mature application of high-definition cameras, the management of wall-type borders has gradually changed from the previous physical prevention and control to the accountability mode of high-definition camera monitoring. That is, through 24-hour border monitoring without blind spots, the status of regional boundaries is recorded in real time. The application of this technology has greatly reduced the construction cost of infrastructure, but it also has many defects.
[0005] First, it also increases the operating costs of regional management. For example, it is necessary to appoint a full-time regional wall boundary administrator to monitor the video status 24 hours a day; not only is the monitoring method prone to omissions, but there are also delays in the prevention and control of some security issues. Summary of the invention
[0006] An advantage of the present invention is to provide a monitoring system, method and computer device thereof, wherein the monitoring method can automatically manage the area boundary.
[0007] Another advantage of the present invention is to provide a monitoring system, method and computer device thereof, wherein the monitoring method can effectively reduce erroneous monitoring when managing area boundaries.
[0008] Another advantage of the present invention is to provide a monitoring system, method and computer device thereof, wherein the monitoring method can effectively solve the incoordination problem of the equipment used to execute the monitoring method.
[0009] To achieve at least one of the above advantages, the present invention provides a monitoring method, the monitoring method comprising:
[0010] Collect monitoring data formed within the predetermined range of the wall, and determine whether there is a moving object on the top of the wall based on the constraints;
[0011] When a moving object is detected on the top of the wall, the infrared characteristics of the detected moving object are collected, and it is determined whether there is a moving person on the top of the wall;
[0012] When the moving object is a moving person, capturing an image of the moving object acquired through capturing; and
[0013] An image of the moving object is output.
[0014] According to an embodiment of the present invention, monitoring data formed within a predetermined range of a wall is collected, and according to a constraint condition, it is determined whether there is a moving object on the top of the wall, including:
[0015] Taking the installation axis of the radar as the common physical system point, the relationship between the spherical coordinate system of the radar wave and the Cartesian coordinate system of the wall is established, and:
[0016] 80°≤θ≤90°;
[0017] z≤H, is the constraint condition, monitoring whether there is a moving object on the top of the wall, where
[0018] θ is the angle between the projection of the line connecting the active object and the coordinate circle point in the radar spherical coordinate system on the XY plane in the XYZ coordinate system and the X axis;
[0019] Where z is the height of the monitored object on the Z axis in the XYZ coordinate system;
[0020] Wherein H is the height of the wall on the Z axis in the XYZ coordinate system;
[0021] Among them, the coordinates of the active object detected by the radar in the XYZ coordinate system are:
[0022] Where r is the distance between the point of the spherical coordinate system where the radar is located and the active object, It is the angle between the moving object and the line connecting the coordinate points in the radar spherical coordinate system in the positive direction of the Z axis.
[0023] According to an embodiment of the present invention, a millimeter wave radar is used to determine whether there is a moving object on the top of the wall.
[0024] According to an embodiment of the present invention, the image of the moving object is captured by a camera.
[0025] According to an embodiment of the present invention, an infrared monitoring device disposed above the top of the wall is driven to rotate toward the moving object, and the infrared characteristics of the moving object are collected by the infrared monitoring device.
[0026] To achieve the above advantages, according to another aspect of the present invention, the present invention provides a monitoring system, the monitoring system comprising:
[0027] A collection module, wherein the collection module is configured to collect monitoring data formed within a predetermined range of the wall, and when a moving object is detected on the top of the wall, collect infrared characteristics of the moving object;
[0028] An analysis module, wherein the analysis module is communicatively connected to the acquisition module, wherein the acquisition module determines whether there is a moving object on the top of the wall according to the constraint conditions; and determines whether there is a moving person on the top of the wall according to the infrared characteristics of the moving object; and when there is a moving person on the top of the wall, an image of the moving object is acquired;
[0029] An output module, wherein the output module is communicatively connected to the analysis module, wherein the output module is configured to output an image of the moving object.
[0030] To achieve the above advantages, according to another aspect of the present invention, the present invention provides a computer device, one or more processors; a memory; and one or more computer programs, one or more computer programs are stored in the above-mentioned memory, and the above-mentioned one or more computer programs include instructions, when the above-mentioned instructions are executed by the above-mentioned device, the above-mentioned device executes any of the monitoring methods described above. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1 A flow chart of the monitoring method of the present invention is shown.
[0032] Figure 2 A first schematic diagram shows an example of the monitoring method according to the present invention.
[0033] Figure 3 A second schematic diagram shows an example of the monitoring method according to the present invention.
[0034] Figure 4 The structure block diagram of the monitoring system of the present invention is shown.
[0035] Figure 5 The structure block diagram of the computer device of the present invention is shown. DETAILED DESCRIPTION
[0036] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art can think of other obvious variations. The basic principles of the present invention defined in the following description can be applied to other embodiments, variations, improvements, equivalents, and other technical solutions that do not deviate from the spirit and scope of the present invention.
[0037] Those skilled in the art should understand that, in the disclosure of the present invention, the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicating the orientation or position relationship are based on the orientation or position relationship shown in the drawings, which are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation. Therefore, the above terms should not be understood as limiting the present invention.
[0038] It is to be understood that the term "one" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element may be one, while in another embodiment, the number of the element may be multiple, and the term "one" should not be understood as a limitation on the quantity.
[0039] refer to Figure 1 A monitoring method according to a preferred embodiment of the present invention will be described in detail below, wherein the monitoring method can be used to automatically manage wall-like boundary areas, thereby reducing management costs and delays of existing management methods.
[0040] Specifically, the monitoring method comprises the following steps:
[0041] S1001, collecting monitoring data formed within a predetermined range of the wall, and judging whether there is a moving object on the top of the wall according to constraint conditions.
[0042] Specifically, in step S1001, monitoring data formed within a predetermined range of the wall can be collected by radar, preferably a millimeter wave radar, to determine whether there is a moving object on the top of the wall. It can be understood that the radar can obtain monitoring data of objects in a farther area than the image acquisition device. In this way, if full-range monitoring is to be achieved in an area of the same size, the number of existing image acquisition devices installed can be effectively reduced, thereby reducing costs.
[0043] Specifically, the step S1001 includes the steps of: taking the installation axis of the radar as the common physical system point, establishing the relationship between the spherical coordinate system of the radar wave and the Cartesian coordinate system of the wall, and:
[0044] 80°≤θ≤90°;
[0045] z≤H, is the constraint condition, monitoring whether there is a moving object on the top of the wall, where
[0046] θ is the angle between the projection of the line connecting the active object and the coordinate circle point in the radar spherical coordinate system on the XY plane in the XYZ coordinate system and the X axis;
[0047] Where z is the height of the monitored object on the Z axis in the XYZ coordinate system;
[0048] Wherein H is the height of the wall on the Z axis in the XYZ coordinate system;
[0049] In addition, the coordinates of the active object detected by the radar in the XYZ coordinate system are:
[0050] Where r is the distance between the point of the spherical coordinate system where the radar is located and the active object, It is the angle between the moving object and the line connecting the coordinate points in the radar spherical coordinate system in the positive direction of the Z axis.
[0051] In this way, it is possible to effectively prevent people walking near the wall from being misjudged as wall climbers, thereby effectively preventing misjudgment.
[0052] S1002, when a moving object is detected on the top of the wall, the infrared characteristics of the detected moving object are collected, and it is determined whether there is a moving person on the top of the wall; when it is detected that there is no moving object on the top of the wall, continue with step S1001.
[0053] Preferably, in step S1002, when a moving object is detected on the top of the wall, an infrared monitoring device disposed above the top of the wall can be driven to rotate toward the moving object, and the infrared characteristics of the moving object can be collected by the infrared monitoring device to determine whether there is a moving person on the top of the wall.
[0054] S1003, when it is determined that the moving object is not a moving person, continue with step S1001; and when it is determined whether there is a moving person on the top of the wall, collect the image of the moving object obtained through collection.
[0055] S1004: output the image of the moving object.
[0056] Those skilled in the art will appreciate that the image of the moving object may be captured by a camera.
[0057] refer to Figure 2 and Figure 3 For example, take radar (24GHz, ranging range 60 meters, sensitive ranging angle ±60°), wall 800 height 5m as an example. Since the radar monitoring range is a radiation range, it is easy to cause misjudgment due to the presence of moving people under the wall. However, it can be achieved by:
[0058] θ = 90°;
[0059] z≤H is the constraint condition, monitoring whether there is a moving object on the top of the wall 800, that is:
[0060] x=0, that is, cosθ=0, that is, θ=90°
[0061] z≤5, that is Right now
[0062] It is understandable that when the millimeter-wave radar is close (within 20m) and there are pedestrians passing under the wall, the feedback signal corresponding to θ is not 90°, so The feedback signal coordinates do not satisfy the "constraint conditions", and in this case, continue with step S1001.
[0063] When the millimeter-wave radar is far away (more than 20 meters away) and a pedestrian passes under the wall, the feedback signal corresponds to an angle of θ close to 90°, and the difference between its signal coordinates and the feedback coordinates when the intruder climbs over the wall is very small. The millimeter-wave radar cannot make judgments based on angles, and there may be certain false alarms. At this time, it is necessary to use infrared monitoring devices such as infrared imagers to monitor whether there are moving people within 800 meters above the wall to further determine pedestrians and intruders. As follows Figure 3 In the above figure, the difference between point A and point B is not obvious due to the angle θ, which may cause false alarm due to signal coordinate confusion. The height of point B needs to be distinguished through infrared imaging re-inspection procedure.
[0064] The usual operation process is to set 80°≤θ≤90° according to the actual distance, and when θ is greater than the calibration value (80°), execute step S1002.
[0065] refer to Figure 4 According to another aspect of the present invention, the present invention also provides a monitoring system, wherein the monitoring system includes an acquisition module 100, an analysis module 200 and an output module 300, wherein the acquisition module is configured to collect monitoring data formed within a predetermined range of the wall, and when a moving object is detected on the top of the wall, the infrared characteristics of the moving object are collected.
[0066] The analysis module is communicatively connected to the acquisition module, wherein the acquisition module determines whether there is a moving object on the top of the wall based on constraint conditions; and determines whether there is a moving person on the top of the wall based on the infrared characteristics of the moving object; and when there is a moving person on the top of the wall, the image of the moving object is acquired.
[0067] The output module is communicatively connected to the analysis module, wherein the output module is configured to output an image of the moving object.
[0068] Figure 4 This is a schematic diagram of the structure of an embodiment of the computer device of the present application, such as Figure 4 As shown, the above-mentioned computer device may include: one or more processors; memory; and one or more computer programs.
[0069] Among them, the above-mentioned computer device can be a computer, a server, a mobile terminal (mobile phone), a cash register device, a computer, a smart screen, a drone, an intelligent connected vehicle (Intelligent Connected Vehicle; hereinafter referred to as: ICV), a smart / intelligent car or a vehicle-mounted device and other devices.
[0070] The one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the device, the device performs the following steps:
[0071] Collect monitoring data formed within the predetermined range of the wall, and determine whether there is a moving object on the top of the wall based on the constraints;
[0072] When a moving object is detected on the top of the wall, the infrared characteristics of the detected moving object are collected, and it is determined whether there is a moving person on the top of the wall;
[0073] When the moving object is a moving person, capturing an image of the moving object acquired through capturing; and
[0074] An image of the moving object is output.
[0075] Taking the installation axis of the radar as the common physical system point, the relationship between the spherical coordinate system of the radar wave and the Cartesian coordinate system of the wall is established, and:
[0076] 80°≤θ≤90°;
[0077] z≤H, is the constraint condition, monitoring whether there is a moving object on the top of the wall, where
[0078] θ is the angle between the projection of the line connecting the active object and the coordinate circle point in the radar spherical coordinate system on the XY plane in the XYZ coordinate system and the X axis;
[0079] Where z is the height of the monitored object on the Z axis in the XYZ coordinate system;
[0080] Wherein H is the height of the wall on the Z axis in the XYZ coordinate system;
[0081] Among them, the coordinates of the active object detected by the radar in the XYZ coordinate system are:
[0082]
[0083] Where r is the distance between the point of the spherical coordinate system where the radar is located and the active object, It is the angle between the moving object and the line connecting the coordinate points in the radar spherical coordinate system in the positive direction of the Z axis.
[0084] Figure 4 The computer device shown can be a terminal device or a server, or a circuit device built into the terminal device or server. The device can be used to execute the application Figure 1 The monitoring method provided by the illustrated embodiment.
[0085] like Figure 4 As shown, the computer device 900 includes a processor 910 and a memory 920. The processor 910 and the memory 920 can communicate with each other through an internal connection path to transmit control and / or data signals. The memory 920 is used to store computer programs, and the processor 910 is used to call and run the computer program from the memory 920.
[0086] The above-mentioned memory 920 can be a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or it can be an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), magnetic disk storage medium or other magnetic storage device, or it can also be any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer.
[0087] The processor 910 and the memory 920 may be combined into a processing device, or more commonly, they are independent components, and the processor 910 is used to execute the program code stored in the memory 920 to implement the above functions. In specific implementation, the memory 920 may also be integrated into the processor 910, or may be independent of the processor 910.
[0088] It should be understood that Figure 4 The computer device 900 shown can implement the present application Figure 1 The various processes of the method provided in the illustrated embodiment. The operations and / or functions of the various modules in the computer device 900 are respectively to implement the corresponding processes in the above method embodiments. For details, please refer to the present application Figure 1 To avoid repetition, the detailed description of the method embodiment is appropriately omitted here.
[0089] In addition, in order to make the functions of the computer device 900 more complete, the computer device 900 may also include one or more of a power supply 940 , an input unit 950 , and the like.
[0090] Optionally, the power supply 950 is used to provide power to various devices or circuits in the computer device.
[0091] It should be understood that Figure 3 The processor 910 in the computer device 900 shown may be a system on chip SOC, and the processor 910 may include a central processing unit (Central Processing Unit; hereinafter referred to as: CPU), and may further include other types of processors.
[0092] In summary, the various processors or processing units inside the processor 910 can work together to implement the previous method flow, and the corresponding software programs of the various processors or processing units can be stored in the memory 920.
[0093] The present application also provides a computer device, the device comprising a storage medium and a central processing unit, the storage medium may be a non-volatile storage medium, the storage medium stores a computer executable program, the central processing unit is connected to the non-volatile storage medium, and executes the computer executable program to implement the present application Figure 1 The method provided by the illustrated embodiment.
[0094] In the above embodiments, the processor involved may include, for example, a CPU, a DSP, a microcontroller or a digital signal processor, and may also include a GPU, an embedded neural network processor (Neural-network Process Units); the processor may also include necessary hardware accelerators or logic processing hardware circuits, such as ASICs, or one or more integrated circuits for controlling the execution of the program of the technical solution of the present application. In addition, the processor may have the function of operating one or more software programs, and the software programs may be stored in a storage medium.
[0095] The present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the present application. Figure 1 The method provided by the illustrated embodiment.
[0096] The present application also provides a computer program product, which includes a computer program, which, when executed on a computer, enables the computer to execute the present application. Figure 1 The method provided by the illustrated embodiment.
[0097] Those of ordinary skill in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented in a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0098] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0099] In several embodiments provided in the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory; hereinafter referred to as: ROM), random access memory (Random Access Memory; hereinafter referred to as: RAM), disk or optical disk, and other media that can store program codes.
[0100] The above is only a specific implementation of the present application. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. The protection scope of the present application should be based on the protection scope of the claims.
[0101] It should be understood by those skilled in the art that the embodiments of the present invention described above and shown in the accompanying drawings are only examples and do not limit the present invention. The advantages of the present invention have been fully and effectively achieved. The functional and structural principles of the present invention have been demonstrated and explained in the embodiments, and the embodiments of the present invention may be deformed or modified in any way without departing from the principles.
[0102] It should be understood by those skilled in the art that the embodiments of the present invention described above and shown in the accompanying drawings are only examples and do not limit the present invention. The advantages of the present invention have been fully and effectively achieved. The functional and structural principles of the present invention have been demonstrated and explained in the embodiments, and the embodiments of the present invention may be deformed or modified in any way without departing from the principles.
Claims
1. A monitoring method, characterized in that: The monitoring method comprises: Collect monitoring data formed within the predetermined range of the wall, and determine whether there is an active object on the top of the wall based on the constraints; When a moving object is detected on the top of the wall, the infrared characteristics of the moving object are collected, and it is determined whether there is a moving person on the top of the wall; When the moving object is a moving person, capturing an image of the moving person acquired through capturing; and Outputting the image of the moving person; collecting monitoring data formed within a predetermined range of the wall, and judging whether there is a moving object on the top of the wall according to the constraint conditions, including: Taking the installation axis of the radar as the common physical system point, the relationship between the spherical coordinate system of the radar wave and the Cartesian coordinate system of the wall is established, and: 80°≤θ≤90°; z≤H, is the constraint condition, monitoring whether there is an active object on the top of the wall, where θ is the angle between the projection of the line connecting the active object and the coordinate circle point in the radar spherical coordinate system on the XY plane in the XYZ coordinate system and the X axis; Where z is the height of the monitored object on the Z axis in the XYZ coordinate system; Wherein H is the height of the wall on the Z axis in the XYZ coordinate system; The coordinates of the active object detected by the radar in the XYZ coordinate system are: x=r*sinφ*cosθ y=r*sinφ*sinθ z=r*cosφ, where r is the distance between the point in the spherical coordinate system where the radar is located and the active object, and φ is the angle between the active object and the line connecting the coordinate point in the spherical coordinate system of the radar in the positive direction of the Z axis; When the constraint condition is not met, the monitoring continues, and when the constraint condition is met, a moving object is detected on the top of the wall.
2. The monitoring method according to claim 1, characterized in that: Millimeter-wave radar is used to determine whether there are any moving objects on the top of the wall.
3. The monitoring method according to claim 1, characterized in that: The image of the moving object is collected by a camera.
4. The monitoring method according to claim 1, characterized in that: The infrared monitoring device disposed above the top of the wall is driven to rotate toward the moving object, and the infrared characteristics of the moving object are collected by the infrared monitoring device.
5. A monitoring system, characterized in that: The monitoring system comprises: A collection module, wherein the collection module is configured to collect monitoring data formed within a predetermined range of the wall, and when a moving object is detected on the top of the wall, collect infrared characteristics of the moving object; An analysis module, wherein the analysis module is communicatively connected to the acquisition module, wherein the acquisition module determines whether there is an active object on the top of the wall according to the constraint conditions; and determines whether there is a moving person on the top of the wall according to the infrared characteristics of the active object; and when there is a moving person on the top of the wall, an image of the moving person is acquired; an output module, wherein the output module is communicatively connected to the analysis module, wherein the output module is configured to output an image of the moving object; and the analysis module is configured to: Taking the installation axis of the radar as the common physical system point, the relationship between the spherical coordinate system of the radar wave and the Cartesian coordinate system of the wall is established, and: 80°≤θ≤90°; z≤H, is the constraint condition, monitoring whether there is an active object on the top of the wall, where θ is the angle between the projection of the line connecting the active object and the coordinate circle point in the radar spherical coordinate system on the XY plane in the XYZ coordinate system and the X axis; Where z is the height of the monitored object on the Z axis in the XYZ coordinate system; Wherein H is the height of the wall on the Z axis in the XYZ coordinate system; The coordinates of the moving person detected by the radar in the XYZ coordinate system are: x=r*sinφ*cosθ y=r*sinφ*sinθ z=r*cosφ, where r is the distance between the point in the spherical coordinate system where the radar is located and the active object, and φ is the angle between the active object and the line connecting the coordinate point in the spherical coordinate system of the radar in the positive direction of the Z axis; When the constraint condition is not met, the monitoring continues, and when the constraint condition is met, a moving object is detected on the top of the wall.
6. A computer device, characterized in that: include: one or more processors; Memory; And one or more computer programs, one or more computer programs are stored in the above-mentioned memory, and the one or more computer programs include instructions. When the above-mentioned instructions are executed by the above-mentioned device, the above-mentioned device executes the monitoring method as described in any one of claims 1-4.
Citation Information
Patent Citations
Dangerous behavior monitoring method and device and electronic equipment
CN110598596A
Radar location system and method
US20220283279A1