Yukou Management System

By integrating data association and rule engine modules in the Yukou management system, using image analysis in the camera to identify the characteristics of people entering and leaving the camera, it solves the problem of high pressure and omissions in human eye recognition in Yukou management, and realizes efficient Yukou control and Save costs.

CN113158713BActive Publication Date: 2024-12-27XIAN TIANHE DEFENCE TECH
View PDF 22 Cites 0 Cited by

Patent Information

Application Number
CN202011141343.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-22
Publication Date
2024-12-27
Estimated Expiration
2040-10-22

AI Technical Summary

Technical Problem

In the management of Yukou, video surveillance in multiple Yukou relies on human eye recognition to cause great pressure on technicians, which are prone to omissions and untimely processing.

Method used

A Yukou management system was designed, including data association module and rule engine module. By performing image analysis in the camera, the characteristic information of entry and exit personnel is identified and generated entry and exit records are reduced, and the network bandwidth requirements are suitable for signal poor or no optical cable connection. Enter the scene, real-time processing and record generation.

Benefits of technology

It improves the efficiency of Yukou control, saves labor costs, and ensures efficient handling of emergencies.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113158713B_ABST
    Figure CN113158713B_ABST
Patent Text Reader

Abstract

The present application discloses a valley entrance management system, which belongs to the valley entrance security field. The system includes a data association module and a rule engine module; the data association module obtains the camera identification and personnel characteristic information sent by the camera, and obtains the camera attribute information corresponding to the camera identification, and the personnel characteristic information is obtained by analyzing the collected valley entrance image by the camera; the rule engine module generates a record of people entering and leaving the valley entrance according to the valley entrance management rules based on the camera attribute information and personnel characteristic information. The present application places the image analysis function in front of the camera, and performs attribute recognition of people entering and leaving the valley entrance on the front-end camera. In this way, when no one enters and leaves the valley entrance, the camera does not need to transmit the image to the background system, thereby reducing the bandwidth requirements for the transmission network. In addition, the system can process the personnel characteristic information collected by the camera in real time, and automatically generate a record of people entering and leaving the valley entrance, which helps to improve the efficiency of valley entrance management and control.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of valley entrance security, and in particular to a valley entrance management system. Background Art

[0002] Yukou is the only way to the valley, so it is crucial to manage it effectively.

[0003] In the related art, a video surveillance system is used to achieve valley entrance management. Specifically, a video surveillance system is set up at the valley entrance, and the technicians manage and count the people entering and leaving the valley entrance by watching the captured video.

[0004] However, there are often a large number of valley entrances, and relying on technical personnel to use their eyes to identify people entering and leaving the valley entrances will not only cause great pressure on the technical personnel, but also easily lead to problems such as omissions and untimely processing. Summary of the invention

[0005] This application provides a valley entrance management system that can improve valley entrance management efficiency. The technical solution is as follows:

[0006] In a first aspect, a valley entrance management system is provided, the system comprising: a data association module and a rule engine module;

[0007] The data association module is used to obtain the camera identification and personnel feature information sent by the camera, and obtain the camera attribute information corresponding to the camera identification, wherein the personnel feature information is obtained by analyzing the collected valley entrance image by the camera;

[0008] The rule engine module is used to generate a record of people entering and leaving the valley entrance according to the valley entrance management rules based on the camera attribute information and the personnel feature information.

[0009] In this application, on the one hand, the image analysis function is pre-installed in the camera, and the attributes of people entering and leaving the valley entrance are identified by the front-end camera. In this way, when no one enters or leaves the valley entrance, that is, when the camera does not extract the characteristic information of the person from the captured valley entrance image, the camera does not need to transmit the image to the valley entrance management system in the background, thereby reducing the bandwidth requirements for the transmission network, and can be better applied to the scene where the valley entrance network signal is poor or there is no optical cable access. On the other hand, the valley entrance management system can process the characteristic information of the person collected by the camera in real time, and automatically generate a record of people entering and leaving the valley entrance, which helps to improve the efficiency of valley entrance management and control and save labor costs.

[0010] Optionally, the personnel feature information includes personnel type and personnel attributes, the personnel type is obtained after performing face detection and face recognition on the valley entrance image, and the personnel attributes are obtained after performing pedestrian attribute recognition on the valley entrance image;

[0011] The camera attribute information includes one or more of the camera name, the camera's IP (Internet Protocol) address, the camera's location, the type of entrance to which the camera belongs, the entry and exit requirements of the entrance to which the camera belongs, and the jurisdiction area to which the camera belongs.

[0012] Optionally, the system further includes a message transmission module, the message transmission module communicates based on a publish-subscribe mode, and the message transmission module is used to:

[0013] receiving a first message published by the camera, wherein the subject of the first message is a first subject, and the payload of the first message includes the camera identifier and the personnel feature information;

[0014] The payload of the first message is sent to the data association module subscribed to the first topic.

[0015] Optionally, the message transmission module is specifically used to:

[0016] If the camera identifier is the same as the designated camera identifier, it is determined that the camera authentication is successful, and the designated camera identifier is used to identify a camera with legality;

[0017] When the camera authentication is successful, the payload of the first message is sent to the data association module subscribed to the first topic.

[0018] Optionally, the system further comprises a message middleware, and the message middleware communicates based on a publish-subscribe mode;

[0019] The data association module is used to publish a second message to the message middleware, the subject of the second message is a second subject, and the payload of the second message includes the camera attribute information and the personnel feature information;

[0020] The message middleware is used to send the payload of the second message to the rule engine module subscribed to the second topic.

[0021] Optionally, the record of people entering and leaving the valley entrance is a normal record of entering and leaving the valley entrance or an alarm record of entering and leaving the valley entrance;

[0022] There are multiple valley entrance management rules, and each of the multiple valley entrance management rules includes a condition and a conclusion. The conclusion of some of the multiple valley entrance management rules is to generate normal valley entrance and exit records, and the conclusion of another part of the valley entrance management rules is to generate valley entrance and exit alarm records, and the valley entrance and exit alarm records include alarm types.

[0023] Optionally, the system further includes a business module, and the business module is used to:

[0024] In the case where the rule engine module generates the valley entrance and exit alarm record, a work order is generated according to the camera attribute information and the alarm type, and the work order is used to instruct the handling of illegal behaviors that do not meet the valley entrance and exit requirements.

[0025] Optionally, the system further includes a message middleware, which communicates based on a publish-subscribe model;

[0026] The rule engine module is used to publish a third message to the message middleware, the subject of the third message is a third topic, and the payload of the third message includes the record of people entering and leaving the valley entrance;

[0027] The message middleware is used to send the payload of the third message to the business module that subscribes to the third topic.

[0028] Optionally, the valley entrance and exit alarm record also includes the violation time and the alarm level, and the business module is further used to:

[0029] Obtain multiple historical valley entrance and exit alarm records;

[0030] According to one or more of the alarm type, violation time, and alarm level, the plurality of historical valley entrance and exit alarm records are statistically displayed on an electronic map.

[0031] Optionally, the system further includes a message push module;

[0032] The business module is used to set the processing status of the valley entrance and exit alarm record to unfinished;

[0033] The message push module is used to send the work order to a terminal used by a person who handles the violation;

[0034] The business module is used to set the processing status of the valley entrance and exit alarm record to completion when receiving a processing completion instruction for the work order.

[0035] In a second aspect, a computer device is provided, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the operations performed by each module in the above-mentioned valley entrance management system.

[0036] In a third aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the operations performed by each module in the above-mentioned valley entrance management system are implemented.

[0037] In a fourth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the operations performed by the various modules in the above-mentioned valley entrance management system.

[0038] It can be understood that the beneficial effects of the second, third and fourth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0040] Figure 1 It is a structural diagram of a valley entrance management system provided by an embodiment of the present application;

[0041] Figure 2 It is a structural diagram of another valley entrance management system provided in an embodiment of the present application;

[0042] Figure 3 is a schematic diagram of a Rete network provided in an embodiment of the present application;

[0043] Figure 4 This is a schematic diagram of a user authority authentication process provided by an embodiment of the present application;

[0044] Figure 5 It is a schematic diagram of the working process of a valley entrance management system provided by an embodiment of the present application;

[0045] Figure 6 It is a workflow diagram of a valley entrance management system provided by an embodiment of the present application;

[0046] Figure 7 It is a structural diagram of a computer device provided in an embodiment of the present application.

[0047] Reference numerals:

[0048] 11: Data association module, 12: Rule engine module, 13: Message transmission module, 14: Message middleware, 15: Database, 16: Persistence module, 17: Business module, 18: Feature extraction module, 19: File module. DETAILED DESCRIPTION

[0049] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0050] It should be understood that the "multiple" mentioned in this application refers to two or more. In the description of this application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate the clear description of the technical solution of this application, the words "first" and "second" are used to distinguish between the same items or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not limit them to be different.

[0051] Before explaining the embodiments of the present application in detail, the application scenarios of the embodiments of the present application are first described.

[0052] As the only way to the valley, how to effectively manage the valley entrance, realize the statistics of people entering and leaving the valley entrance of scenic spots and the real-time alarm of illegal intrusions at key valley entrances is the main problem that needs to be solved at present.

[0053] To this end, an embodiment of the present application provides a valley entrance management system that can process the personnel characteristic information collected by the camera in real time and generate a record of people entering and leaving the valley entrance. This can achieve intelligent management of the valley entrance, thereby facilitating efficient supervision of people entering and leaving the valley entrance and ensuring efficient handling of emergencies.

[0054] The valley entrance management system provided in the embodiment of the present application is explained in detail below.

[0055] The Yukou management system can be a server or a server cluster composed of multiple servers. The Yukou management system can include multiple modules. If the Yukou management system is a server, all modules in the Yukou management system are located in the same server. If the Yukou management system is a server cluster composed of multiple servers, for any one of the multiple modules in the Yukou management system, this module can be located in a server alone, or this module can be located in the same server with other modules.

[0056] Figure 1 Schematic diagram of a valley entrance management system provided by an embodiment of the present application. Figure 1 The valley entrance management system may include a data association module 11 and a rule engine module 12.

[0057] The data association module 11 is explained below:

[0058] The data association module 11 can obtain the camera identification and personnel feature information sent by the camera, and then obtain the camera attribute information corresponding to the camera identification.

[0059] The camera can communicate with the valley entrance management system through a wired network or a wireless network. After the camera obtains the camera identification and the personnel characteristic information, the camera identification and the personnel characteristic information can be uploaded to the valley entrance management system through a wired network or a wireless network.

[0060] The camera identifier is used to uniquely identify the camera. For example, the camera identifier may be the camera's UUID (Universally Unique Identifier), MAC (Media Access Control) address, or factory serial number, etc., which is not limited to the embodiments of the present application.

[0061] The personnel characteristic information is obtained by analyzing the collected valley entrance image by the camera. The personnel characteristic information may include personnel type and personnel attributes. Personnel type may represent the identity of the personnel, for example, personnel type may include staff, whitelist personnel, blacklist personnel, unknown personnel, etc. Personnel attributes may include gender, age range, hair, clothes, pants, whether wearing a hat, whether wearing glasses, whether carrying a backpack, whether holding suspicious items, etc.

[0062] The person type is obtained after the camera performs face detection and face recognition on the valley entrance image. Specifically, the camera can first perform face detection on the valley entrance image to obtain a face detection frame, and then perform face recognition on the face detection frame to obtain the person type to which the face in the face detection frame belongs.

[0063] When the camera performs face detection on the valley entrance image, the MTCNN (Multi-task convolutional neural network) can be used to perform face detection on the valley entrance image to obtain a face detection frame. Of course, the camera can also perform face detection on the valley entrance image in other ways, and the embodiment of the present application does not limit this to the only way.

[0064] When the camera performs face recognition on the face detection frame, the FaceNet network can be used to extract the facial features in the face detection frame, and the extracted facial features can be matched with the facial features of each of the multiple designated persons, and then the type of the successfully matched designated person can be used as the type of person to whom the face in the face detection frame belongs. Of course, the camera can also perform face recognition on the face detection frame in other ways, and the embodiments of the present application do not make the sole limitation on this. The multiple designated persons are all people whose types are known in advance, and the camera can pre-store the facial features and types of each of the multiple designated persons.

[0065] Optionally, the facial features and type of each of the multiple designated persons may be sent to the camera by the valley management system. Figure 2 , the Yukou management system may further include a file module 19 and a feature extraction module 18. The file module 19 may store the facial image and type of each of the multiple designated persons. The feature extraction module 18 may obtain the facial image and type of each of the multiple designated persons from the file module 19, and then extract the facial features in the facial image of each designated person as the facial features of the designated person, for example, the facial features in the facial image of each designated person may be extracted through a FaceNet network. Afterwards, the feature extraction module 18 may send the facial features and type of each of the multiple designated persons to the camera.

[0066] For one possible approach, see Figure 2 The valley entrance management system may further include a message transmission module 13, and the feature extraction module 18 may send the facial features and types of each of the multiple designated persons to the camera through the message transmission module 13.

[0067] The message transmission module 13 communicates based on the Pub / Sub mode. The message transmitted in the Pub / Sub mode includes two parts: a topic and a payload. The message published by the publisher may include a topic and a payload. After the subscriber subscribes to a topic, the subscriber will receive the message payload of the topic. The format of the message transmitted in the Pub / Sub mode may be a JSON (JavaScript Object Notation) format, etc.

[0068] The message transmission module 13 may include a message middleware. The message middleware may receive a message published by a certain module, the message including a subject and a payload. The message middleware may send the payload of the message to other modules subscribing to the subject.

[0069] For example, the message transmission module 13 may be an EMQ X server, and the EMQ X server may include MQTT (Message Queuing Telemetry Transport) message middleware, which is a lightweight message component.

[0070] The camera may subscribe to the fourth topic in the message transmission module 13 in advance. In this case, the feature extraction module 18 may publish a fourth message to the message transmission module 13, the subject of the fourth message is the fourth topic, and the payload of the fourth message includes the facial features and type of each of the multiple designated persons. The message transmission module 13 may send the payload of the fourth message to the camera subscribed to the fourth topic.

[0071] The person attribute is obtained by the camera after performing pedestrian attribute recognition on the valley entrance image. For example, the camera can recognize the attributes of the person in the valley entrance image through the DeepMAR network. Of course, the camera can also perform pedestrian attribute recognition on the valley entrance image in other ways, and the embodiments of the present application are not limited to this.

[0072] It is worth noting that the personnel characteristic information may include not only personnel type and personnel attributes, but also other information such as personnel entry and exit time. The camera may use the shooting time of the valley entrance image as the personnel entry and exit time.

[0073] The camera can capture the entrance to the valley, and can also capture people entering and leaving the valley. The frequency of the camera capturing images can be set according to specific needs. For example, the camera can capture an image of the valley entrance every 10 seconds. Every time the camera captures an image of the valley entrance, it can analyze the image to obtain the characteristic information of the people, and upload the characteristic information of the people and the camera identification to the valley entrance management system.

[0074] Optionally, the camera may include a front-end detection unit, an image processing unit, a communication processing unit, a power management unit and a pan / tilt unit. The front-end detection unit is a high-definition camera that can capture images of the valley entrance; the image processing unit has a built-in image processing board that can analyze the captured valley entrance images to obtain personnel feature information; the communication processing unit is responsible for transmitting the valley entrance images captured by the high-definition camera to the image processing unit for analysis and processing, and uploading the camera identification and personnel feature information obtained by the image processing unit to the valley entrance management system. The power management unit supplies power to the camera. The pan / tilt unit is responsible for realizing the operation and positioning of the camera according to the instructions issued by the valley entrance management system.

[0075] Furthermore, the camera can not only upload the camera identification and the personal characteristic information to the valley entrance management system, but also, when extracting the personal characteristic information from a valley entrance image, encode the valley entrance image (including but not limited to Base64 encoding, etc.), obtain the encoded data, and upload the encoded data to the valley entrance management system.

[0076] In the embodiment of the present application, the image analysis function is pre-installed in the camera, and the front-end camera recognizes the attributes of people entering and leaving the valley entrance. In this way, when no one enters or leaves the valley entrance, that is, when the camera does not extract the characteristic information of the person from the captured valley entrance image, the camera does not need to transmit the image to the valley entrance management system in the background, thereby reducing the bandwidth requirements for the transmission network, and can be better applied to the scene where the valley entrance network signal is poor or there is no optical cable access.

[0077] In a possible manner, the camera may send the camera identification, the personnel feature information and the coded data to the data association module 11 through the message transmission module 13 .

[0078] The data association module 11 may pre-subscribe to the first topic in the message transmission module 13. In this case, the camera may publish a first message to the message transmission module 13, the subject of the first message is the first topic, and the payload of the first message includes the camera identifier, the personnel feature information, and the coded data. The message transmission module 13 may send the payload of the first message to the data association module 11 that subscribes to the first topic.

[0079] Furthermore, before the message transmission module 13 sends the payload of the first message to the data association module 11 subscribed to the first topic, the camera authentication may be performed first. If the camera authentication is successful, the message transmission module 13 may send the payload of the first message to the data association module 11 subscribed to the first topic; if the camera authentication fails, the operation is terminated directly.

[0080] Specifically, the message transmission module 13 may determine that the camera authentication is successful when the camera identifier in the payload of the first message is the same as the designated camera identifier; and determine that the camera authentication fails when the camera identifier in the payload of the first message is different from the designated camera identifier.

[0081] The designated camera ID can be preset. The designated camera ID is used to identify the legal camera.

[0082] Alternatively, see Figure 2The valley entrance management system may further include a database 15. The database 15 may be a database such as PostgreSQL or MySQL, which is not limited in the present embodiment. The message transmission module 13 may obtain a designated camera identifier from the database 15.

[0083] As an example, a camera attribute table may be stored in the database 15. The camera attribute table may include configuration data about the camera, such as a camera identifier and its corresponding camera attribute information. The message transmission module 13 may obtain the camera identifier in the camera attribute table in the database 15 as the designated camera identifier.

[0084] When the camera identifier in the payload of the first message is the same as the specified camera identifier, it indicates that the camera identified by the camera identifier is legitimate. At this time, the message transmission module 13 can determine that the first message is reliable, and thus can send the payload of the first message to the data association module 11 subscribed to the first topic.

[0085] The camera attribute information may include one or more of the camera name, the camera IP address, the camera location (including but not limited to longitude and latitude, etc.), the type of valley entrance to which the camera belongs (including but not limited to scenic valley entrance, key valley entrance, etc.), the entry and exit requirements of the valley entrance to which the camera belongs (including but not limited to restricted entry and exit time periods, etc.), the jurisdiction area to which the camera belongs (including but not limited to cities, counties, towns, villages, etc.), etc. Optionally, the data association module 11 may obtain the camera attribute information corresponding to the camera identifier from the camera attribute table in the database 15.

[0086] Further, if the payload of the first message includes coded data obtained by encoding the Yukou image, the data association module 11 may first decode the coded data to obtain the Yukou image, and then store the Yukou image to obtain the storage address of the Yukou image. Optionally, the data association module 11 may store the Yukou image in the file module 19 to obtain the storage address of the Yukou image in the file module 19.

[0087] After the data association module 11 obtains the storage address of the camera attribute information, the personnel feature information and the valley entrance image, it can send the camera attribute information, the personnel feature information and the valley entrance image storage address to the rule engine module 12 for further processing.

[0088] Also, see Figure 2 , the valley entrance management system may also include a persistence module 16. The persistence module 16 may be implemented by a MyBatis framework, and of course, may also be implemented by other frameworks, which is not limited in the present embodiment of the application.

[0089] The data association module 11 can send the camera attribute information, the personnel characteristic information and the storage address of the valley entrance image to the persistence module 16. The persistence module 16 can implement the persistent storage of the camera attribute information, the personnel characteristic information and the storage address of the valley entrance image, which is convenient for later big data statistics. Optionally, the persistence module 16 can save the camera attribute information, the personnel characteristic information and the storage address of the valley entrance image to the valley entrance entry and exit record table in the database 15.

[0090] For one possible scenario, see Figure 2 The valley entrance management system may further include a message middleware 14, and the data association module 11 may send the camera attribute information, the personnel feature information and the storage address of the valley entrance image to the rule engine module 12 and the persistence module 16 through the message middleware 14.

[0091] The message middleware 14 communicates based on the publish-subscribe model. For example, the message middleware 14 may be a Kafka message middleware, etc. The Kafka message middleware is a high-performance message component with advantages such as high throughput, load balancing, and dynamic expansion.

[0092] The rule engine module 12 and the persistence module 16 can both subscribe to the second topic in the message middleware 14 in advance. In this case, the data association module 11 can publish the second message to the message middleware 14, the subject of the second message is the second topic, and the payload of the second message includes the camera attribute information, the personnel feature information and the storage address of the valley image. The message middleware 14 can send the payload of the second message to the rule engine module 12 and the persistence module 16 that subscribe to the second topic.

[0093] In the embodiment of the present application, the message transmission module 13 and the message middleware 14 can be used for data forwarding, so that the modules can be decoupled from each other, thereby reducing the complexity of the entire system and achieving rapid response during peak requests.

[0094] The rule engine module 12 is explained below:

[0095] The rule engine module 12 can generate a record of people entering and leaving the valley entrance according to the valley entrance management rules based on the camera attribute information and the person feature information.

[0096] The valley entrance management rules may be pre-set and may be stored in the database 15. The number of the valley entrance management rules may be one or more. Each valley entrance management rule includes a condition and a conclusion. When there is only one valley entrance management rule, the conclusion in the valley entrance management rule may be to generate a valley entrance entry and exit alarm record. When there are multiple valley entrance management rules, the conclusion in some of the multiple valley entrance management rules is to generate a valley entrance entry and exit normal record, and the conclusion in another part of the valley entrance management rules is to generate a valley entrance and exit alarm record. Valley entrance entry and exit normal record and valley entrance and exit alarm record are both valley entrance and exit personnel records.

[0097] Among them, the normal record of valley entrance and exit and the alarm record of valley entrance and exit can both include the camera attribute information and the characteristic information of the person. In addition, the alarm record of valley entrance and exit can also include the alarm type, alarm level (including but not limited to prompt, minor, important, urgent, etc.), violation time, etc., and the violation time is the time when the person enters and exits.

[0098] After the rule engine module 12 obtains the camera attribute information and the personnel characteristic information, it can read one or more valley entrance management rules from the database 15. If the camera attribute information and the personnel characteristic information meet the conditions in a valley entrance management rule, the rule engine module 12 generates a valley entrance and exit personnel record according to the conclusion in the valley entrance management rule.

[0099] In a possible implementation, the process of the rule engine module 12 generating the valley entrance and exit personnel records according to the valley entrance management rules can be implemented through the Rete network. The Rete network includes multiple rules, each rule includes a condition and a conclusion, and when there is a fact that meets the condition, the corresponding conclusion is activated.

[0100] In the embodiment of the present application, a Rete network can be constructed according to a preset valley management rule. The rules in the Rete network are valley management rules. The conditions of each of the multiple rules in the Rete network are different, and the conclusions of each rule can be the same or different.

[0101] As an example, see Figure 3 , Rete network is divided into alpha network and beta network.

[0102] The alpha network is used to filter the facts input into the Rete network (in the embodiment of the present application, it refers to the camera attribute information and personnel feature information), find the set that meets each pattern in the rule (in the embodiment of the present application, it refers to the valley management rule), and generate alpha memory (that is, the set of facts that meet this pattern). The alpha network includes a root node (root), a type node (type node), an alpha node, and an alpha memory. The root node is a virtual node and is the entrance to the Rete network. The type node stores various types of facts, and each fact enters the alpha node from the corresponding type node. The alpha node stores various attributes of the type, and each fact enters the alpha memory from the corresponding alpha node according to its attributes.

[0103] There are two types of nodes in the beta network, namely the join node and the beta memory. The join node contains two input ports, which input two fact sets that need to be matched respectively. The join node can merge the fact sets input from the two input ports and transmit them to the next node. The beta memory is used to store the fact sets obtained by the join node.

[0104] In an optional embodiment, if Figure 3 As shown, the root node of the Rete network may include three type nodes: "personnel type", "restricted access time period" and "holding suspicious objects". "Personnel type" may include three alpha nodes: "blacklist personnel", "whitelist personnel" and "unknown personnel", "restricted access time period" may include an alpha node "24 hours to 6 hours", and "holding suspicious objects" may include an alpha node "axe / knife".

[0105] The Rete network includes five rules. The condition of the first rule is that the personnel type is a whitelist personnel, and the conclusion is to generate a normal entry and exit record of the valley entrance. The condition of the second rule is that the personnel type is a blacklist personnel, and the conclusion is to generate a valley entrance and exit alarm record. The alarm type in this valley entrance and exit alarm record can be a blacklist personnel entry and exit alarm, and the alarm level can be secondary. The condition of the third rule is that the personnel type is a blacklist personnel, the personnel entry and exit time is within the restricted entry and exit time period, and the personnel feature information includes an axe or a knife. The conclusion is to generate a valley entrance and exit alarm record. The alarm type in this valley entrance and exit alarm record can be a blacklist personnel holding a suspicious object in the restricted entry and exit time period. The alarm level can be emergency. The condition of the fourth rule is that the personnel type is an unknown person and the personnel entry and exit time is within the restricted entry and exit time period. The conclusion is to generate a valley entrance and exit alarm record. The alarm type in this valley entrance and exit alarm record can be an unknown person in the restricted entry and exit time period. The alarm level can be important. The condition of the fifth rule is that the person type is an unknown person and the person characteristic information includes an axe or a knife. The conclusion is to generate a valley entrance and exit alarm record. The alarm type in this valley entrance and exit alarm record can be an unknown person holding a suspicious object entering and exiting the alarm, and the alarm level can be important.

[0106] In some embodiments, the valley entrance management rules may be configured by a user, and the user may configure the valley entrance management rules on a visual user interface.

[0107] In this case, the user can first log in to the valley entrance management system, and then configure the valley entrance management rules, such as the configuration of the valley entrance management rules according to "personnel type", "restricted entry and exit time period", "holding suspicious objects", etc. After the valley entrance management system obtains the configured valley entrance management rules, it writes the configured valley entrance management rules into the database 15. If the rule engine module 12 obtains the camera attribute information and the personnel feature information, it can read the valley entrance management rules from the database 15 and generate valley entrance and exit personnel records accordingly.

[0108] Further, see Figure 2 The valley entrance management system may also include a business module 17.

[0109] After the rule engine module 12 obtains the record of people entering and exiting the valley entrance, it can send the record of people entering and exiting the valley entrance and the storage address of the valley entrance image to the business module 17 for further processing by the business module 17. In addition, the rule engine module 12 can also save the record of people entering and exiting the valley entrance and the storage address of the valley entrance image in the database 15.

[0110] In one possible case, the rule engine module 12 can send the valley entrance and exit personnel record and the storage address of the valley entrance image to the business module 17 and the persistence module 16 through the message middleware 14. The persistence module 16 can store the valley entrance and exit personnel record and the storage address of the valley entrance image in the database 15.

[0111] Specifically, both the business module 17 and the persistence module 16 can subscribe to the third topic in the message middleware 14 in advance. In this case, the rule engine module 12 can publish the third message to the message middleware 14, the subject of the third message is the third topic, and the payload of the third message includes the storage address of the entry and exit personnel record of the valley entrance and the image of the valley entrance. The message middleware 14 can send the payload of the third message to the business module 17 and the persistence module 16 that subscribe to the third topic.

[0112] The following is an explanation of the business module 17:

[0113] The business module 17 can be developed based on the Java programming language and the Spring Boot framework, and of course can also be developed based on other programming languages ​​and frameworks, which is not limited in the embodiments of the present application.

[0114] The business module 17 has functions such as work order management, alarm management, statistical analysis, business configuration, and system management.

[0115] The work order management function of business module 17 means that when business module 17 obtains the valley entrance and exit alarm record, it can generate a work order based on the camera attribute information and the alarm type in the valley entrance and exit alarm record. The work order is used to instruct the handling of violations that do not meet the valley entrance and exit requirements.

[0116] After the business module 17 obtains the valley entrance and exit alarm record, it can query the personnel attribute table to determine the personnel who can handle the illegal behavior reflected in the valley entrance and exit alarm record, and then generate a work order according to the work order template. The work order may include illegal behavior information (including but not limited to camera name, valley entrance type, alarm type, etc.) and processing personnel information (including but not limited to processing department, processing personnel name, etc.). For example, the work order can be the work order shown in Table 1 below.

[0117] Table 1

[0118] Camera Name Valley type Alarm Type Processing Department Name of person handling the case Camera 1 Scenic spot Yukou Blacklist personnel entry and exit alarm A large team Zhang San

[0119] In the embodiment of the present application, only the work order is explained by taking the above Table 1 as an example, and the above Table 1 does not constitute a limitation on the embodiment of the present application.

[0120] The personnel attribute table may include information on violations and their corresponding processing personnel. Optionally, for different violations occurring at different valley entrances, the processing personnel under the corresponding processing department may be responsible for handling them. For example, if a blacklisted person enters and exits the scenic valley entrance monitored by camera 1, Zhang San from the first team may be responsible for handling it. If a blacklisted person enters and exits the key valley entrance monitored by camera 2, Li Si from the first team may be responsible for handling it. If an unknown person enters and exits the key valley entrance monitored by camera 3 during the restricted entry and exit time period, Wang Wu from the second team may be responsible for handling it.

[0121] The personnel attribute table can be stored in the database 15. After the business module 17 obtains the valley entrance and exit alarm record, it can obtain the corresponding processing personnel information from the personnel attribute table in the database 15 according to the violation information in the valley entrance and exit alarm record, and then generate a work order according to the configured work order template. In addition, the business module 17 can also save the work order to the work order business table in the database 15.

[0122] In some embodiments, the personnel attribute table can be configured by the user, and the user can configure the personnel attribute table on the visual user interface, so as to realize the management of the processing departments and personnel. Specifically, it can realize the operations of adding and deleting the processing departments and realizing the configuration of the superior departments and sub-departments, and it can also realize the operations of entering, deleting and modifying the processing personnel.

[0123] Further, after the business module 17 generates the work order, the work order can also be automatically issued. Specifically, the valley entrance management system can also include a message push module. The business module 17 can send the work order to the message push module, and the message push module can send the work order to the terminal used by the person handling the violation.

[0124] In one possible manner, the work order may also include personnel contact information (including but not limited to telephone number, instant messaging account, etc.), and the message push module may send the work order to the terminal according to the personnel contact information.

[0125] In another possible manner, when the message push module obtains the work order, it can obtain the corresponding personnel contact information according to the processing personnel information in the work order, and then send the work order to the terminal according to the personnel contact information.

[0126] According to the different contact information of the personnel obtained, the message push module can send the work order to the terminal in different ways.

[0127] For example, if the contact information of the person obtained by the message push module is a phone number, the work order can be sent to the terminal via text message. Specifically, Twilio's SDK (Software Development Kit) can be integrated and the API (Application Program Interface) can be called to implement the sending of text messages.

[0128] For another example, if the contact information of the personnel obtained by the message push module is an instant messaging account, the work order can be sent to the terminal through application message push, and the API opened by the application developer can be called to implement the application message push. In this case, the terminal can integrate the SDK of this application developer and implement one-to-one message push by binding the terminal's device token and the instant messaging account.

[0129] Furthermore, the business module 17 can also track the alarm processing. Specifically, before issuing the work order, the business module 17 can first set the processing status of the valley entrance and exit alarm record to unfinished, and then send the work order to the terminal through the message push module. Afterwards, if the business module 17 receives a processing completion instruction for the work order, the processing status of the valley entrance and exit alarm record can be set to completed.

[0130] The processing completion instruction is used to indicate that the processing of the violation reflected in the work order has been completed. The processing completion instruction can be triggered by the processing personnel after the violation is processed. The processing personnel can trigger it through operations such as click operations, voice operations, gesture operations, and somatosensory operations. This embodiment of the application does not make a sole limitation on this.

[0131] The alarm management function of the business module 17 means that the business module 17 can obtain the valley entrance image according to the storage address of the valley entrance image, and save the valley entrance image and the valley entrance and exit alarm record correspondingly into the alarm business table in the database 15.

[0132] When the business module 17 obtains the valley-mouth image according to the storage address of the valley-mouth image, it can obtain the valley-mouth image from the file module 19 according to the storage address of the valley-mouth image.

[0133] The business module 17 can also query the historical valley entrance and exit alarm records and their corresponding valley entrance images in the database 15, and specifically support users to realize accurate or fuzzy query of the historical valley entrance and exit alarm records and their corresponding valley entrance images according to the alarm type, violation time, alarm level, camera location, etc.

[0134] The statistical analysis function of the business module 17 means that the business module 17 can obtain multiple historical valley entrance and exit alarm records and their corresponding valley entrance images, and statistically display the multiple historical valley entrance and exit alarm records and their corresponding valley entrance images on the electronic map according to one or more of the alarm type, violation time, and alarm level.

[0135] The business module 17 can statistically display multiple historical valley entrance and exit alarm records and their corresponding valley entrance images in the electronic map according to multiple dimensions to provide intuitive and graphical statistical analysis results. The multiple dimensions can include but are not limited to time dimension and space dimension. The time dimension can include year, month, day, and the space dimension can include alarm level, alarm type, camera location, etc.

[0136] For example, the business module 17 can embed an electronic map in the visual user interface to display the camera location and the number of historical valley entrance and exit alarm records (i.e., the number of violations) corresponding to each camera location in real time, and can also display the number of alarm levels. In this way, the technicians can quickly grasp the alarm details based on this interface.

[0137] The above-mentioned visual user interface can be displayed on a terminal, which can be a desktop computer, a laptop computer, a mobile phone, or other mobile devices. The terminal and the valley entrance management system can communicate through a wired network or a wireless network. For example, a WebSocket connection can be established between the terminal and the valley entrance management system for communication.

[0138] The business configuration function in the business module 17 means that the business module 17 can realize the configuration of the above-mentioned camera attribute table, valley management rules, work order template, personnel attribute table, etc., and realize the storage of the face image and type of the designated person in the file module 19. For example, the business module 17 can configure the camera attribute table to realize the operations of adding and deleting cameras, and realize the operations of adding, deleting, modifying and associating the jurisdiction area with the camera.

[0139] In some embodiments, the above-mentioned camera attribute table, valley management rules, work order templates, personnel attribute table and other configuration data can be stored in the database 15. Optionally, the interaction between the database 15 and other modules in the valley management system can be implemented based on the Mybatis framework.

[0140] The system management functions of the business module 17 include user authority authentication and system log management.

[0141] In some embodiments, the configuration of the above-mentioned camera attribute table, valley management rules, work order template, personnel attribute table, face image and type of designated personnel, etc. can be configured by the user when logging into the valley management system and having corresponding authority. Therefore, the business module 17 needs to perform user authority authentication.

[0142] User rights authentication can include user management and role management. User management can realize user registration, login, information modification and logout. Role management can configure operation permissions and manage user rights by assigning different roles to users.

[0143] Optionally, user authority authentication can be developed based on the Apache Shiro framework, and of course can also be developed based on other frameworks, which is not limited in the embodiments of the present application.

[0144] As an example, see Figure 4 , the process of user authority authentication is as follows:

[0145] 1. The system administrator logs in to the Yukou management system, creates a user name, and assigns a password and role to the user.

[0146] 2. The Yukou management system uses an encryption algorithm (including but not limited to the Sha256Hash algorithm) to encrypt the password and store it in the database 15.

[0147] 3. Enter the user name and password when logging in.

[0148] 4. The Yukou management system uses the encryption algorithm to encrypt the password input by the user to obtain encrypted data, and reads the encrypted password stored in the database 15, and compares the two to determine whether the password input by the user is successfully verified.

[0149] 5. If the password verification is successful, the Yukou management system uses JWT (Json web token) technology to generate a token for the user. JWT technology can effectively avoid CSRF (Cross-site request forgery) attacks, and the token itself contains all the information required for identity authentication, which can greatly reduce processing pressure.

[0150] 6. When a user requests to access the API in the Yukou management system, the Yukou management system parses the token carried in the request to obtain the user information, and then obtains the role associated with the user information.

[0151] 7. The Yukou management system determines whether the user has API access rights based on the role; if so, the request result is returned; if not, the request is rejected.

[0152] Among them, system log management mainly records the operation behaviors that occur after the user logs into the system. The recordable information includes: operation user name, login IP address, login MAC address, operation time, operation function, operation method, etc.

[0153] In the embodiment of the present application, the valley entrance management system can realize the entry and exit control of the valley entrance, can realize the attribute identification of the people entering and exiting the valley entrance, real-time alarm of illegal entry and exit, automatic dispatch of work orders and visualization of the valley entrance and exit alarm records, which helps to improve the efficiency of valley entrance management and save labor costs.

[0154] For ease of understanding, the following Figure 5 The overall working process of the valley entrance management system is described. Figure 5 The overall working process of the valley management system is as follows:

[0155] The user logs in to the valley entrance management system to configure the camera attribute table, valley entrance management rules, work order template, personnel attribute table, etc., and this configuration data is written into the database 15. After the valley entrance management system obtains the personnel feature information in the valley entrance image collected by the camera, it reads the configuration data from the database 15 to generate a valley entrance and exit personnel record. If the valley entrance and exit personnel record is a valley entrance and exit normal record, the valley entrance management system writes the valley entrance and exit personnel record into the normal business table in the database 15; if the valley entrance and exit personnel record is a valley entrance and exit alarm record, the valley entrance management system writes the valley entrance and exit personnel record into the alarm business table in the database 15, and reads the work order template from the database 15, automatically generates a work order through the work order template, and issues the work order by means of message push, and then writes the work order into the work order business table in the database 15. In addition, the valley entrance management system statistically displays multiple historical valley entrance and exit alarm records in an electronic map.

[0156] Combine the following Figure 6 For the above Figure 5 The working process shown is described in detail, see Figure 6 , the working process may include the following steps 601-614.

[0157] Step 601: The feature extraction module 18 obtains the facial image and type of the designated person from the file module 19, then extracts the facial features in the facial image of the designated person to obtain a facial feature library, and synchronizes the facial feature library to the camera.

[0158] Step 602: The camera captures an image of the valley entrance.

[0159] Step 603: The camera analyzes the valley entrance image according to the facial feature library to obtain personal feature information.

[0160] Step 604 : the camera generates a first message, and publishes the first message to the message transmission module 13 .

[0161] The subject of the first message is the first topic, and the payload of the first message includes the camera identification, personnel feature information and coding data, and the coding data is obtained by encoding the valley entrance image by the camera.

[0162] Step 605: The message transmission module 13 performs camera authentication according to the camera identifier in the payload of the first message.

[0163] If the camera authentication succeeds, the message transmission module 13 sends the payload of the first message to the data association module 11 subscribed to the first topic. If the camera authentication fails, the operation ends.

[0164] Step 606: the data association module 11 obtains the camera attribute information from the database 15 according to the camera identifier in the payload of the first message.

[0165] The data association module 11 can also decode the coded data in the first message to obtain a valley-mouth image, store the valley-mouth image in the file module 19, and obtain a storage address of the valley-mouth image.

[0166] Step 607 : the data association module 11 generates a second message, and publishes the second message to the message middleware 14 .

[0167] The subject of the second message is the second subject, and the payload of the second message is the camera attribute information, the personnel feature information and the storage address of the valley entrance image.

[0168] The message middleware 14 sends the payload of the second message to the persistence module 16 and the rule engine module 12 that subscribe to the second topic.

[0169] Step 608 : The persistence module 16 stores the camera attribute information and the person feature information in the database 15 .

[0170] The persistence module 16 may also store the storage address of the valley entrance image in the database 15 .

[0171] Step 609 : the rule engine module 12 generates a record of people entering and leaving the valley entrance according to the camera attribute information and the person feature information and the valley entrance management rules, generates a third message, and publishes the third message to the message middleware 14 .

[0172] The subject of the third message is the third topic, and the payload of the third message is the storage address of the records of people entering and leaving the valley entrance and the image of the valley entrance.

[0173] Step 610: The message middleware 14 sends the payload of the third message to the business module 17 that subscribes to the third topic.

[0174] Step 611 : if the valley entrance and exit personnel record in the payload of the third message is a valley entrance and exit alarm record, the service module 17 stores the valley entrance and exit alarm record in the alarm service table in the database 15 .

[0175] Furthermore, the business module 17 can also obtain the valley entrance image from the file module 19 according to the storage address of the valley entrance image, and store the valley entrance image and the valley entrance entry and exit alarm record in the alarm business table in the database 15 in correspondence.

[0176] Step 612: The business module 17 statistically displays multiple historical valley entrance and exit alarm records on an electronic map.

[0177] Step 613: The business module 17 generates a work order according to the valley entrance and exit alarm record, and calls the message push module to distribute the work order.

[0178] Step 614 : the business module 17 saves the work order into the work order business table of the database 15 .

[0179] In the embodiment of the present application, on the one hand, the image analysis function is pre-installed in the camera, and the front-end camera performs attribute recognition of people entering and leaving the valley entrance. In this way, when no one enters or leaves the valley entrance, that is, when the camera does not extract the characteristic information of the person from the captured valley entrance image, the camera does not need to transmit the image to the valley entrance management system in the background, thereby reducing the bandwidth requirements for the transmission network, and can be better applied to the scene where the valley entrance network signal is poor or there is no optical cable access. On the other hand, the valley entrance management system can process the characteristic information of the person collected by the camera in real time, and automatically generate a record of the people entering and leaving the valley entrance, which helps to improve the efficiency of valley entrance management and control and save labor costs.

[0180] Figure 7 Schematic diagram of the structure of a computer device provided in an embodiment of the present application. The above-mentioned valley entrance management system can be implemented by a computer device 7. Figure 7 As shown, the computer device 7 includes: a processor 70, a memory 71, and a computer program 72 stored in the memory 71 and executable on the processor 70. When the processor 70 executes the computer program 72, the operations performed by each module in the Yukou management system in the above-mentioned embodiment are implemented.

[0181] The computer device 7 may be a general-purpose computer device or a special-purpose computer device. In a specific implementation, the computer device 7 may be a server, or may be a server cluster composed of multiple servers. Those skilled in the art will appreciate that Figure 7It is only an example of the computer device 7 and does not constitute a limitation on the computer device 7. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components, such as input and output devices, network access devices, etc.

[0182] The processor 70 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0183] In some embodiments, the memory 71 may be an internal storage unit of the computer device 7, such as a hard disk or memory of the computer device 7. In other embodiments, the memory 71 may also be an external storage device of the computer device 7, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device 7. Further, the memory 71 may also include both an internal storage unit and an external storage device of the computer device 7. The memory 71 is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as program codes of computer programs. The memory 71 may also be used to temporarily store data that has been output or is to be output.

[0184] In some embodiments, a computer-readable storage medium is further provided, in which a computer program is stored, and when the computer program is executed by a processor, the operations performed by each module in the valley entrance management system in the above-mentioned embodiment are implemented. For example, the computer-readable storage medium may be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0185] It is worth noting that the computer-readable storage medium mentioned in the present application may be a non-volatile storage medium, in other words, a non-transitory storage medium.

[0186] It should be understood that all or part of the steps to implement the above embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions can be stored in the above-mentioned computer readable storage medium.

[0187] That is, in some embodiments, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute the operations performed by the various modules in the Yukou management system in the above-mentioned embodiments.

[0188] The above are optional embodiments provided for the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A valley entrance management system, characterized in that: The system comprises: a data association module and a rule engine module; The data association module is used to obtain the camera identification and personnel feature information sent by the camera, and obtain the camera attribute information corresponding to the camera identification, wherein the personnel feature information is obtained by analyzing the collected valley entrance image by the camera; The rule engine module is used to generate a record of people entering and leaving the valley entrance according to the valley entrance management rules through the Rete network based on the camera attribute information and the personnel feature information; Wherein, the Rete network is divided into an alpha network and a beta network; The alpha network is used to filter the facts input into the Rete network, which refers to the camera attribute information and personnel feature information, find out the set that meets each pattern in the valley management rule, and generate alpha memory, which refers to the set of facts that meet the pattern. The alpha network includes a root node, a type node, an alpha node and an alpha memory. The root node is a virtual node and is the entrance to the Rete network; the type node stores various types of facts, and each fact enters the alpha node from the corresponding type node; the alpha node stores various attributes of the type, and each fact enters the alpha memory from the corresponding alpha node according to its attributes; The beta network has two types of nodes, namely, a connection node and a beta memory. The connection node includes two input ports, and the two input ports respectively input two fact sets that need to be matched. The connection node merges the fact sets input from the two input ports and transmits them to the next node; the beta memory is used to store the fact sets obtained by the connection node; The root node of the Rete network includes three type nodes: personnel type, restricted access time period, and suspicious objects in possession. The personnel type includes three alpha nodes: blacklist personnel, whitelist personnel, and unknown personnel. The restricted access time period includes an alpha node from 24:00 to 6:00, and the suspicious objects in possession include an alpha node: axe / knife. The Rete network includes five rules. The condition of the first rule is that the type of personnel is a whitelist personnel, and the conclusion is to generate a normal entry and exit record of the valley entrance; the condition of the second rule is that the type of personnel is a blacklist personnel, and the conclusion is to generate a valley entrance and exit alarm record, and the alarm type in the valley entrance and exit alarm record is a blacklist personnel entry and exit alarm, and the alarm level is secondary; the condition of the third rule is that the type of personnel is a blacklist personnel, the personnel entry and exit time is within the restricted entry and exit time period, and the personnel feature information includes an axe or a knife, and the conclusion is to generate a valley entrance and exit alarm record, and the alarm type in the valley entrance and exit alarm record is a blacklist personnel An alarm is issued for entering or exiting a person with suspicious objects during the restricted entry and exit time period, and the alarm level is emergency; the condition of the fourth rule is that the person type is an unknown person and the person's entry and exit time is within the restricted entry and exit time period, and the conclusion is to generate a valley entrance and exit alarm record, and the alarm type in the valley entrance and exit alarm record is an alarm for entering or exiting an unknown person during the restricted entry and exit time period, and the alarm level is important; the condition of the fifth rule is that the person type is an unknown person and the person's characteristic information includes an axe or a knife, and the conclusion is to generate a valley entrance and exit alarm record, and the alarm type in the valley entrance and exit alarm record is an alarm for entering or exiting an unknown person with suspicious objects, and the alarm level is important.

2. The system according to claim 1, characterized in that The personnel characteristic information includes personnel type and personnel attributes, wherein the personnel type is obtained by performing face detection and face recognition on the valley entrance image, and the personnel attributes are obtained by performing pedestrian attribute recognition on the valley entrance image; The camera attribute information includes one or more of the camera name, the camera's Internet Protocol IP address, the camera's location, the type of entrance to which the camera belongs, the entry and exit requirements of the entrance to which the camera belongs, and the jurisdiction area to which the camera belongs.

3. The system according to claim 1 or 2, characterized in that: The system further includes a message transmission module, which communicates based on a publish-subscribe mode and is used to: receiving a first message published by the camera, wherein the subject of the first message is a first subject, and the payload of the first message includes the camera identifier and the person feature information; The payload of the first message is sent to the data association module subscribed to the first topic.

4. The system according to claim 3, characterized in that The message transmission module is specifically used for: If the camera identifier is the same as the designated camera identifier, it is determined that the camera authentication is successful, and the designated camera identifier is used to identify a camera with legality; When the camera authentication is successful, the payload of the first message is sent to the data association module subscribed to the first topic.

5. The system according to claim 1 or 2, characterized in that: The system also includes a message middleware, which communicates based on a publish-subscribe model; The data association module is used to publish a second message to the message middleware, the subject of the second message is a second subject, and the payload of the second message includes the camera attribute information and the personnel feature information; The message middleware is used to send the payload of the second message to the rule engine module subscribed to the second topic.

6. The system according to claim 1 or 2, characterized in that: The records of people entering and leaving the valley entrance are normal records of people entering and leaving the valley entrance or alarm records of people entering and leaving the valley entrance; There are multiple valley entrance management rules, and each of the multiple valley entrance management rules includes a condition and a conclusion. The conclusion of some of the multiple valley entrance management rules is to generate normal valley entrance and exit records, and the conclusion of another part of the valley entrance management rules is to generate valley entrance and exit alarm records, and the valley entrance and exit alarm records include alarm types.

7. The system according to claim 6, characterized in that The system further comprises a business module, wherein the business module is used for: In the case where the rule engine module generates the valley entrance and exit alarm record, a work order is generated according to the camera attribute information and the alarm type, and the work order is used to instruct the handling of illegal behaviors that do not meet the valley entrance and exit requirements.

8. The system according to claim 7, characterized in that The system also includes a message middleware, which communicates based on a publish-subscribe model; The rule engine module is used to publish a third message to the message middleware, the subject of the third message is a third topic, and the payload of the third message includes the record of people entering and leaving the valley entrance; The message middleware is used to send the payload of the third message to the business module that subscribes to the third topic.

9. The system according to claim 8, characterized in that The valley entrance and exit alarm record also includes the violation time and the alarm level, and the business module is also used to: Obtain multiple historical valley entrance and exit alarm records; According to one or more of the alarm type, violation time, and alarm level, the plurality of historical valley entrance and exit alarm records are statistically displayed on an electronic map.

10. The system according to any one of claims 7 to 9, characterized in that: The system also includes a message push module; The business module is used to set the processing status of the valley entrance and exit alarm record to unfinished; The message push module is used to send the work order to a terminal used by a person who handles the violation; The business module is used to set the processing status of the valley entrance and exit alarm record to completion when receiving a processing completion instruction for the work order.

Citation Information

Patent Citations

  • Personnel security management system and method in mining areas

    CN103049949A

  • Traceable video monitoring system for intelligent storage

    CN104581088A

  • Alarming system and method for preventing juveniles from driving cars

    CN105550666A

  • Intelligent monitoring system with identification function

    CN106657897A

  • Community personnel file intelligent management method

    CN108052925A