Group visitor management method and system based on video monitoring equipment
Acquisition and evaluation of visitor images through video surveillance equipment solves the problems of high hardware costs and complex operations in group visitor management, and realizes efficient identity verification and convenient management without perception.
Patent Information
- Application Number
- CN202510652859.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-20
- Publication Date
- 2025-08-26
AI Technical Summary
In the prior art, the group visitor management system needs to be equipped with additional hardware equipment, resulting in high construction costs and visitors need to actively cooperate, making it impossible to efficiently achieve identity verification.
Use video surveillance equipment to obtain guest images, select clear images through multi-dimensional quality evaluation model for comparison, realizing unsensed registration and verification, and the system does not require new hardware.
It reduces system deployment and operation and maintenance costs, simplifies operational processes, improves work efficiency, and optimizes visitor experience and management convenience.
Smart Images
Figure CN120547302A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent monitoring, and in particular to a group visitor management method, system, computer equipment and storage medium based on video monitoring equipment. Background Art
[0002] The existing regulatory industry is under great pressure to supervise the safety of visitors. Because visitors are frequent and their identities are complex, there may be potential safety hazards. Group visitor management is extremely important.
[0003] In the existing technology, an integrated ID card reader, camera and printer are used to batch enter group visitors. At the same time, it is linked with the access control system to use the equipment to automatically verify the ID cards and photos of people. However, this method requires additional configuration of dedicated hardware equipment, resulting in high system construction costs. It also requires the active cooperation of visitors to actually complete the access process. Summary of the Invention
[0004] Based on this, it is necessary to provide a group visitor management method, system, computer equipment and storage medium based on video surveillance equipment to address the above technical problems.
[0005] In a first aspect, an embodiment of the present invention provides a group visitor management method based on a video surveillance device, the method comprising:
[0006] In the group visitor registration process, according to the visitor registration task information, the first visitor image of the video surveillance device at the corresponding point of the supervision site is obtained;
[0007] Determine whether the first visitor image exists in the visitor database; if not, add the corresponding visitor to the registration and add the first visitor image to the visitor database;
[0008] In the group visitor verification process, based on the visitor verification task information, a second visitor image is obtained from the video surveillance equipment at the corresponding point in the supervision site;
[0009] The second visitor image is compared with each of the first visitor images in the visitor database, and if the comparison is successful, the verification status of the corresponding visitor is modified.
[0010] In some embodiments, obtaining a first visitor image from a video surveillance device at a corresponding point in the supervision site includes:
[0011] Acquire multiple visitor snapshot images captured by the video surveillance device, and calculate the quality score of each visitor snapshot image;
[0012] The visitor snapshot images are sorted according to the quality scores, and the image with the highest quality score is selected as the first visitor image.
[0013] In some embodiments, calculating the quality score of each of the visitor captured images includes:
[0014] Establishing a multi-dimensional quality assessment model, the multi-dimensional quality assessment model includes evaluation indicators corresponding to at least multiple dimensions of clarity, lighting conditions, face angle, resolution, and integrity, and weights corresponding to each evaluation indicator;
[0015] A plurality of evaluation indicators of the visitor-captured image are obtained, and a quality score of the visitor-captured image is calculated using the multi-dimensional quality evaluation model.
[0016] In some embodiments, calculating the quality score of each visitor captured image further includes:
[0017] Comparing the plurality of evaluation indicators of the visitor captured image with corresponding indicator thresholds;
[0018] If the values are lower than the corresponding index threshold, the visitor captured images are filtered; if the values are higher than the corresponding index threshold, the multi-dimensional quality assessment model is used to calculate the quality scores of the visitor captured images.
[0019] In some embodiments, during the group visitor registration process, the method further includes:
[0020] Creating a visitor group record for the group visitor and generating a unique visitor group code;
[0021] If the first visitor image exists in the visitor database, the visitor group code is added to the corresponding visitor.
[0022] In some embodiments, during the group visitor verification process, the method further includes:
[0023] Determine the visitor group code corresponding to the visitor based on the visitor verification task information;
[0024] Determining, according to the visitor group code, a visitor image set corresponding to the group of visitors in the visitor database;
[0025] It is determined whether the first visitor image exists in the visitor image set.
[0026] In some embodiments, after the group visitor verification process, the method further includes:
[0027] A movement trajectory of each visitor is generated according to the third visitor image of each video surveillance device in the supervision place.
[0028] In a second aspect, an embodiment of the present invention provides a group visitor management system based on a video surveillance device, the system comprising:
[0029] Business layer module, used to obtain visitor registration task information and visitor verification task information;
[0030] The data stream processing module is used to obtain the first visitor image of the video surveillance equipment at the corresponding point of the supervision place according to the visitor registration task information, determine whether the first visitor image exists in the visitor library, and if not, add the visitor corresponding to the registration and add the first visitor image to the visitor library; according to the visitor verification task information, obtain the second visitor image of the video surveillance equipment at the corresponding point of the supervision place, compare the second visitor image with each of the first visitor images in the visitor library, and if the comparison is successful, modify the verification status of the corresponding visitor.
[0031] In a third aspect, an embodiment of the present invention provides a computer device comprising a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the method described in the first aspect are implemented.
[0032] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the method described in the first aspect are implemented.
[0033] Compared with the existing technology, the above-mentioned method, system, computer equipment and storage medium, in the group visitor registration process, obtains the first visitor image of the video surveillance equipment at the corresponding point of the supervision place according to the visitor registration task information; determines whether the first visitor image exists in the visitor library, and if not, adds the corresponding visitor for registration, and adds the first visitor image to the visitor library; in the group visitor verification process, obtains the second visitor image of the video surveillance equipment at the corresponding point of the supervision place according to the visitor verification task information; compares the second visitor image with each of the first visitor images in the visitor library, and if the comparison is successful, modifies the verification status of the corresponding visitor. This technical solution does not require any new hardware equipment, and while reducing the system deployment and operation and maintenance costs, it greatly simplifies the operation process and significantly improves the overall work efficiency. At the same time, by realizing the imperceptible registration and verification of visitors, it effectively optimizes the visitor experience and enhances the humanity and convenience of management. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 is a schematic structural diagram of a computer device in one embodiment;
[0035] Figure 2 A schematic diagram of a framework of a group visitor management system based on video surveillance equipment in one embodiment;
[0036] Figure 3 1 is a flow chart of a group visitor management method based on video surveillance equipment in one embodiment;
[0037] Figure 4 2 is a flow chart of a method for obtaining a first visitor image in one embodiment;
[0038] Figure 5 Schematic diagram of a flow chart of a method for adding a visitor group code in one embodiment;
[0039] Figure 6 Schematic diagram of a specific process of a visitor verification method in one embodiment. DETAILED DESCRIPTION
[0040] To more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly describes the drawings required for describing the embodiments. Obviously, the drawings described below are merely examples or embodiments of the present invention. Those skilled in the art can apply the present invention to other similar scenarios based on these drawings without inventive effort. Unless otherwise apparent from the context or otherwise noted, the same reference numerals in the figures represent the same structure or operation.
[0041] As used herein and in the claims, unless the context clearly indicates otherwise, the terms "a," "an," "an," and / or "the" are not intended to refer to the singular but may include the plural. Generally speaking, the terms "comprises" and "include" only indicate the inclusion of the steps and elements specifically identified, and these steps and elements do not constitute an exclusive list. A method or apparatus may also include other steps or elements.
[0042] Although the present invention makes various references to certain modules in the apparatus according to embodiments of the present invention, any number of different modules can be used and run on a computing device and / or processor. The modules are only illustrative, and different aspects of the apparatus and method can use different modules.
[0043] It should be understood that when a unit or module is described as being "connected" or "coupled" to other units, modules, or blocks, it can refer to being directly connected or coupled, or communicating with other units, modules, or blocks, or there can be intervening units, modules, or blocks, unless the context clearly indicates otherwise. As used herein, the term "and / or" may include any and all combinations of one or more of the associated listed items.
[0044] The group visitor management method based on video surveillance equipment provided in this application can be applied to Figure 1 In the computer equipment shown. Figure 1As shown, the computer device may include a processor 102 and a memory 104 for storing data, wherein the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA. During the group visitor registration process, the processor obtains a first visitor image from the video surveillance device at the corresponding point in the supervision site based on the visitor registration task information; determines whether the first visitor image exists in the visitor database; if not, adds the corresponding visitor to the registration and adds the first visitor image to the visitor database; during the group visitor verification process, the processor obtains a second visitor image from the video surveillance device at the corresponding point in the supervision site based on the visitor verification task information; compares the second visitor image with each first visitor image in the visitor database; and if the comparison is successful, modifies the verification status of the corresponding visitor.
[0045] The computer device may further include a transmission device 106 and an input / output device 108 for communication functions. Figure 1 The structure shown is only for illustration and does not limit the structure of the above-mentioned computer device. For example, the computer device may also include Figure 1 More or fewer components than shown, or with Figure 1 Different configurations shown.
[0046] like Figure 2 As shown, an embodiment of the present invention provides a group visitor management system based on video surveillance equipment, which may not belong to the above-mentioned computing and equipment. The system includes: a business layer module, which is used to obtain visitor registration task information and visitor verification task information; a data stream processing module, which is used to obtain a first visitor image of the video surveillance equipment at the corresponding point of the supervision site according to the visitor registration task information, and determine whether the first visitor image exists in the visitor library. If not, add the corresponding visitor to the registration, and add the first visitor image to the visitor library; according to the visitor verification task information, obtain a second visitor image of the video surveillance equipment at the corresponding point of the supervision site, and compare the second visitor image with each of the first visitor images in the visitor library. If the comparison is successful, modify the verification status of the corresponding visitor.
[0047] In some embodiments, the system further includes a redis cache for caching visitor registration task information and visitor verification task information.
[0048] In some embodiments, the system also includes an Elastic Search search engine for searching visitor information, where the visitor information includes visitor images and movement trajectories.
[0049] like Figure 3 As shown, the embodiment of the present invention provides a group visitor management method based on video surveillance equipment, which is applied to Figure 2 The system in the example is used to illustrate the following steps:
[0050] S302: In the group visitor registration process, according to the visitor registration task information, a first visitor image of the video surveillance device at the corresponding point of the supervision site is obtained.
[0051] The visitor registration task information saves the location of the video surveillance equipment registered this time, the comparison threshold and other related parameters.
[0052] The video stream parsing module will parse the video streams output by various video surveillance devices on site, output visitor snapshots and corresponding facial feature information, and push this data to Kafka for use by the subsequent data processing module.
[0053] S304: Determine whether the first visitor image exists in the visitor database. If not, add the corresponding visitor for registration and add the first visitor image to the visitor database.
[0054] In addition, the first visitor image is filled with business attributes and saved to the Elastic Search search engine.
[0055] Specifically, the first visitor image is compared with the visitor images in the visitor database to determine whether it exists or not. Supervisors can query the visitor database and Elastic Search search engine through the business layer module to obtain a visitor list or visitor information.
[0056] In places with stricter supervision, the visitor's identity information can be quickly queried and compared based on the visitor's first visitor image through the public security interface and facial 1:1 recognition technology, and the visitor's real identity information can be added, thereby implementing the requirement that visitor registration must be verified by person and ID.
[0057] S306: In the group visitor verification process, according to the visitor verification task information, a second visitor image is obtained from the video surveillance device at the corresponding point of the supervision site.
[0058] The system saves the verification task information and the list of visitors requiring verification into the Redis cache. Simultaneously, the video stream parsing module begins parsing the video stream output by the task-associated video surveillance device, outputting visitor snapshots and facial feature information to Kafka.
[0059] S308: Compare the second visitor image with each of the first visitor images in the visitor database. If the comparison is successful, modify the verification status of the corresponding visitor.
[0060] At the same time, the second visitor image is saved in the Elastic Search search engine so that supervisors can query the verification details.
[0061] In addition, the visitor verification interface queries the verification status of visitors in the visitor database through polling, lights up the visitor's registration photo, and shows the supervisor a dynamic verification process.
[0062] When the supervisor completes the visitor verification process, they can assess the verification results for the group. For visitors who fail to be verified, supervisors can take the following measures: If the supervisor knows the visitor's whereabouts, they can manually verify the visitor and mark their whereabouts; if the visitor fails to properly cooperate with verification and data collection, they can voice prompt the visitor to re-collect and complete the verification process; if the visitor is truly absent from the site, they can issue an alert, place surveillance on the visitor, and use the system's spatiotemporal search function to query the visitor's most recent location.
[0063] Based on the above steps S302-S308, in the group visitor registration process, according to the visitor registration task information, obtain the first visitor image of the video surveillance equipment at the corresponding point of the supervision site; determine whether the first visitor image exists in the visitor library, if not, add the corresponding visitor for registration, and add the first visitor image to the visitor library; in the group visitor verification process, according to the visitor verification task information, obtain the second visitor image of the video surveillance equipment at the corresponding point of the supervision site; compare the second visitor image with each of the first visitor images in the visitor library, if the comparison is successful, modify the verification status of the corresponding visitor. This technical solution does not require any new hardware equipment, and while reducing the system deployment and operation and maintenance costs, it greatly simplifies the operation process and significantly improves the overall work efficiency. At the same time, by realizing the imperceptible registration and verification of visitors, it effectively optimizes the visitor experience and enhances the humanization and convenience of management.
[0064] During group visitor registration or verification, capturing the clearest, most reliable visitor snapshots as both the primary and secondary visitor images is crucial to ensuring the smooth flow of the registration and verification process. If the captured visitor snapshot is blurry or shows the visitor's profile, it won't match the image in the visitor database during registration. In this case, the snapshot will be registered as a new visitor in the visitor database, and subsequent calls to the public security interface will inevitably fail to retrieve the visitor's identity information. If this snapshot is used as the secondary visitor image during verification, it's likely that no verification snapshot will match the secondary visitor image, resulting in a verification error.
[0065] In order to solve the above technical problems, Figure 4As shown, the method of obtaining the first visitor image of the video surveillance device at the corresponding point of the supervision place includes the following steps:
[0066] S402: Acquire multiple visitor snapshot images captured by the video surveillance device, and calculate the quality score of each visitor snapshot image.
[0067] To ensure the reliability of the first visitor image, a multi-dimensional quality assessment model was established. The main dimensions are shown in Table 1:
[0068] Table 1
[0069]
[0070] First, visitor-captured images are filtered based on the evaluation metrics and corresponding thresholds in Table 1. Specifically, multiple evaluation metrics for visitor-captured images are compared with the corresponding thresholds. If the metrics are below the thresholds, the images are filtered. If the metrics are above the thresholds, the quality scores of the visitor-captured images are calculated using a multi-dimensional quality assessment model.
[0071] For example, when the face occlusion rate of a visitor's captured image is ≤15%, the visitor's captured image is filtered.
[0072] The multi-dimensional quality assessment model also includes weights corresponding to each evaluation indicator. For example, the weight of image sharpness is 40%, the weight of yaw and pitch angles is 30%, the weight of brightness uniformity is 20%, and the weight of face occlusion rate is 10%.
[0073] In an exemplary embodiment, the multi-dimensional quality assessment model is:
[0074] total_score = 0.4*sharpness + 0.3*angle_score + 0.2*illumination_score + 0.1*occlusion_score;
[0075] Among them, total_score represents the quality score, sharpness represents the image sharpness, angle_score represents the yaw angle and pitch angle, illumination_score represents the brightness uniformity, and occlusion_score represents the face occlusion rate.
[0076] Due to the differences in geography, equipment, and deployment at the time of system operation, evaluation indicators must be adjusted based on the actual operating conditions of the site. Therefore, before the system is officially launched, the evaluation indicators and weights can be continuously adjusted and optimized according to the conditions of the site to achieve the maximum effect during system operation.
[0077] S404: Sort the visitor snapshot images according to the quality scores, and select the image with the highest quality score as the first visitor image.
[0078] It should be noted that the second visitor image is also obtained using the above method.
[0079] In this embodiment, high-quality images are preferentially selected as the first and second visitor images. This method avoids facial comparison failures caused by blur, occlusion, or angle deviation, and improves the accuracy and stability of visitor registration, verification, and identity verification.
[0080] In some embodiments, during the group visitor registration process, such as Figure 5 As shown, the method further includes:
[0081] S502: creating a visitor group record for the group visitor and generating a unique visitor group code;
[0082] S504: If the first visitor image exists in the visitor database, add the visitor group code for the corresponding visitor.
[0083] During the group visitor registration process, due to the characteristics of supervised locations, it's impossible to register two groups of visitors simultaneously. Therefore, when a supervisor activates the visitor registration button, the system automatically creates a visitor group record and generates a unique visitor group code. Subsequent visitors identified will automatically be assigned to that group. For groups of visitors already registered as a visitor group, if further subdivision into smaller groups is required, administrators can manually reassign visitors through the backend management system to form multiple new groups.
[0084] In some embodiments, during the group visitor verification process, such as Figure 6 As shown, the method further includes:
[0085] S602: Determine the visitor group code corresponding to the visitor based on the visitor verification task information;
[0086] S604: Determine, according to the visitor group code, a visitor image set corresponding to the group visitor in the visitor database;
[0087] S606: Determine whether the first visitor image exists in the visitor image set.
[0088] The system utilizes a distributed event bus architecture for group visitor verification. When the data stream processing module identifies a visitor as a member of the visitor database, it publishes a verification event (including visitor information, time, and location) to a message queue. The core processing engine consumes these events in real time from the message queue and performs multi-level verification logic. First, the Redis cache acts as a filter to quickly determine whether the visitor belongs to a specific group based on the visitor group code. Then, a hierarchical comparison is performed to confirm the presence of the visitor in the group's visitor image set.
[0089] In some embodiments, after the group visitor verification process, the method further includes:
[0090] A movement trajectory of each visitor is generated according to the third visitor image of each video surveillance device in the supervision place.
[0091] After the group visitor verification is completed and enters the archiving stage, if the group visitor has completed all the verification work normally, the system will archive the visitor's data and combine it with the third visitor image of each video surveillance device in the supervision site to generate the visitor's complete movement trajectory, which is convenient for subsequent supervisors to trace it.
[0092] When some visitors are delayed in verification, the system implements an intelligent exception handling strategy. It automatically extends the validity period for that group (with a default 30-minute window) and uses spatial positioning technology to track the presence of unverified visitors in real time. For abnormal situations where verification has not been completed for a long time, the system activates a three-level early warning mechanism: first, the visitor's last location is highlighted on an electronic map, then relevant surveillance video footage is automatically retrieved for manual review, and finally, an audible and visual alarm system is triggered to guide on-site handling, enabling rapid detection and intervention of abnormal individuals. This ensures efficient and accurate visitor management while significantly improving the response speed and handling capabilities of regulatory sites to abnormal situations.
[0093] It should be understood that, although the various steps in the above flow chart are shown in sequence as indicated by the arrows, these steps are not necessarily performed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be performed in other orders. Moreover, at least a portion of the steps in the above flow chart may include multiple steps or multiple stages, and these steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily to be performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of steps or stages in other steps.
[0094] In one embodiment, the present invention provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of any of the above-mentioned group visitor management method embodiments based on video surveillance equipment are implemented.
[0095] Those skilled in the art will appreciate that all or part of the processes in the above-described method embodiments can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the above-described method embodiments. Any reference to memory, storage, database, or other media used in the embodiments provided herein may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).
[0096] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0097] The above embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present invention. It should be noted that a person skilled in the art could make various modifications and improvements without departing from the spirit of the present application, all of which fall within the scope of protection of the present application. Therefore, the scope of protection of the present patent application shall be determined by the appended claims.
Claims
1. A group visitor management method based on video surveillance equipment, characterized in that: The method comprises: In the group visitor registration process, according to the visitor registration task information, the first visitor image of the video surveillance device at the corresponding point of the supervision site is obtained; Determine whether the first visitor image exists in the visitor database; if not, add the corresponding visitor to the registration and add the first visitor image to the visitor database; In the group visitor verification process, based on the visitor verification task information, a second visitor image is obtained from the video surveillance equipment at the corresponding point in the supervision site; The second visitor image is compared with each of the first visitor images in the visitor database, and if the comparison is successful, the verification status of the corresponding visitor is modified.
2. The method according to claim 1, characterized in that The step of obtaining a first visitor image from a video surveillance device at a corresponding point in the supervision place includes: Acquire multiple visitor snapshot images captured by the video surveillance device, and calculate the quality score of each visitor snapshot image; The visitor snapshot images are sorted according to the quality scores, and the image with the highest quality score is selected as the first visitor image.
3. The method according to claim 2, characterized in that Calculating the quality score of each visitor captured image includes: Establishing a multi-dimensional quality assessment model, the multi-dimensional quality assessment model includes evaluation indicators corresponding to at least multiple dimensions of clarity, lighting conditions, face angle, resolution, and integrity, and weights corresponding to each evaluation indicator; A plurality of evaluation indicators of the visitor-captured image are obtained, and a quality score of the visitor-captured image is calculated using the multi-dimensional quality evaluation model.
4. The method according to claim 3, characterized in that Calculating the quality score of each visitor's captured image also includes: Comparing the plurality of evaluation indicators of the visitor captured image with corresponding indicator thresholds; If the values are lower than the corresponding index threshold, the visitor captured images are filtered; if the values are higher than the corresponding index threshold, the multi-dimensional quality assessment model is used to calculate the quality scores of the visitor captured images.
5. The method according to claim 1, wherein In the group visitor registration process, the method further includes: Creating a visitor group record for the group visitor and generating a unique visitor group code; If the first visitor image exists in the visitor database, the visitor group code is added to the corresponding visitor.
6. The method according to claim 5, characterized in that In the group visitor verification process, the method further includes: Determine the visitor group code of the corresponding visitor according to the visitor verification task information; Determining, according to the visitor group code, a visitor image set corresponding to the group of visitors in the visitor database; It is determined whether the first visitor image exists in the visitor image set.
7. The method according to claim 1, characterized in that After the group visitor verification process, the method further includes: A movement trajectory of each visitor is generated according to the third visitor image of each video surveillance device in the supervision place.
8. A group visitor management system based on video surveillance equipment, characterized in that: The system comprises: Business layer module, used to obtain visitor registration task information and visitor verification task information; The data stream processing module is used to obtain the first visitor image of the video surveillance equipment at the corresponding point of the supervision place according to the visitor registration task information, determine whether the first visitor image exists in the visitor library, and if not, add the visitor corresponding to the registration and add the first visitor image to the visitor library; according to the visitor verification task information, obtain the second visitor image of the video surveillance equipment at the corresponding point of the supervision place, compare the second visitor image with each of the first visitor images in the visitor library, and if the comparison is successful, modify the verification status of the corresponding visitor.
9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.