Security inspection operation recording method, device, electronic device and computer readable medium

The camera recognizes the face information of the security check operator and automatically associates the security check operation records, solving the problems of cumbersome identity authentication and incorrect information association in the existing technology, and achieving efficient security check operation records and audit tracking.

CN114386019BActive Publication Date: 2025-04-08NUCTECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202011138711.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-22
Publication Date
2025-04-08
Estimated Expiration
2040-10-22

AI Technical Summary

Technical Problem

The identity authentication mode of existing security operators is complicated, which can easily lead to incorrect information correlation and affect the efficiency of audit and tracking.

Method used

By obtaining security inspection operation recording instructions, sending shooting requests to the camera, receiving and identifying the target face image, obtaining target operator information, and correlating the face image, operator information and security inspection operation record data to generate target security inspection operation records.

Benefits of technology

Without logging in or changing jobs, each security check operation can accurately correspond to an operator's identity, improve the correctness of information correlation, simplify security check operation procedures, and meet the needs of auditing and post-tracking.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114386019B_ABST
    Figure CN114386019B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a method, device, electronic device and computer-readable medium for recording security inspection operations. The method comprises: obtaining a security inspection operation recording instruction, wherein the security inspection operation recording instruction comprises security inspection operation recording data; sending a shooting request to a camera according to the security inspection operation recording instruction; receiving a target face image sent by the camera in response to the shooting request; identifying the target face image to obtain target operator information; associating the target face image, the target operator information and the security inspection operation recording data to obtain a target security inspection operation record. The method, device, electronic device and computer-readable medium for recording security inspection operations involved in the present disclosure can save the operator's login and logout operations during the shift change process, improve the correctness of the associated recording information of the security inspection operation that cannot be guaranteed in the related technology to a certain extent, and simplify the security inspection operation process.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent security inspection technology, and in particular to a security inspection operation recording method, device, electronic device and computer-readable medium. Background Art

[0002] At present, for most security inspection consoles, operators need to log in to the corresponding operating software through identity authentication before they can perform subsequent security inspection operations. In the actual security inspection business process, different security inspection operators need to be arranged to rotate and change positions. In this process, the operator who is leaving the post needs to log out of his current login, and the new operator will log in to the operating software with his own identity. If some security inspection consoles are cancelled and enter the rest stage due to entering a period of time with less business pressure or for any reason, the current operator still needs to log out when leaving the post. After the business pressure increases, the security inspection console will be restored and activated, and the same operator will need to log in to the operating software again when he takes office. Its purpose is to track all security inspection operations authorized by the operator identity and clarify the operator identity corresponding to each operation, so as to facilitate auditing, post-event tracking, investigation and accountability, scene reconstruction, etc.

[0003] However, in the actual implementation of the above operator authentication mode, the cumbersome login and logout operations may cause errors in the operator information bound to the security operation information due to forgetfulness and other reasons, and the high accuracy of the information association cannot be guaranteed.

[0004] Therefore, a new security inspection operation recording method, device, electronic device and computer-readable medium are needed.

[0005] The above information disclosed in this background section is only for enhancement of understanding of the background of the present disclosure and therefore it may include information that does not constitute the relevant technology that is already known to one of ordinary skill in the art. Summary of the invention

[0006] In view of this, the embodiments of the present disclosure provide a security inspection operation recording method, device, electronic device and computer-readable medium, which can eliminate the operator's login and logout operations during the shift change process, to a certain extent improve the accuracy of the associated record information of the security inspection operation that cannot be guaranteed in the related technology and simplify the security inspection operation process.

[0007] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present disclosure.

[0008] According to one aspect of the present disclosure, a security inspection operation recording method is proposed, which includes: obtaining a security inspection operation recording instruction, wherein the security inspection operation recording instruction includes security inspection operation recording data; sending a shooting request to a camera according to the security inspection operation recording instruction; receiving a target facial image sent by the camera in response to the shooting request; identifying the target facial image to obtain target operator information; and associating the target facial image, the target operator information and the security inspection operation recording data to obtain a target security inspection operation record.

[0009] In an exemplary embodiment of the present disclosure, the camera is arranged on the operation screen.

[0010] In an exemplary embodiment of the present disclosure, the method also includes: when receiving the target facial image sent by the camera in response to the shooting request fails, sending the shooting request to a surveillance camera within a preset range; receiving the target surveillance video sent by the surveillance camera in response to the shooting request; performing frame extraction on the target surveillance video according to the sending time of the security inspection operation record instruction, and obtaining a target video frame as the target facial image.

[0011] In an exemplary embodiment of the present disclosure, identifying the target facial image and obtaining the target operator information includes: determining a target facial sub-library according to the security inspection operation record instruction; performing facial recognition and comparison on the target facial image in the target facial sub-library to obtain the target operator information.

[0012] In an exemplary embodiment of the present disclosure, the method further includes: when face recognition and comparison of the target face image in the target face sub-library fail, sending the target face image to an unknown face library; generating a recognition request based on the target face image in the unknown face library and sending it to an administrator.

[0013] In an exemplary embodiment of the present disclosure, the method also includes: obtaining facial images in the target face sub-library that have not been successfully matched within a preset time range; generating a personnel position status confirmation request based on the facial images that have not been successfully matched and sending it to an administrator; receiving feedback information from the administrator in response to the personnel position status request; and processing the facial images that have not been successfully matched in the target face sub-library based on the feedback information.

[0014] In an exemplary embodiment of the present disclosure, the method further includes: obtaining an audit request or a tracing request; determining a target security inspection operation record according to the audit request or the tracing request;

[0015] The target operator information is determined according to the target security inspection operation record.

[0016] According to one aspect of the present disclosure, a security inspection operation recording device is proposed, which includes: an instruction acquisition module, configured to acquire a security inspection operation recording instruction, wherein the security inspection operation recording instruction includes security inspection operation recording data; a shooting request module, configured to send a shooting request to a camera according to the security inspection operation recording instruction; an image receiving module, configured to receive a target face image sent by the camera in response to the shooting request; a face recognition module, configured to recognize the target face image and obtain target operator information; and an association record module, configured to associate the target face image, the target operator information and the security inspection operation record data to obtain a target security inspection operation record.

[0017] According to one aspect of the present disclosure, an electronic device is proposed, which includes: one or more processors; a storage device for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the method described above.

[0018] According to one aspect of the present disclosure, a computer-readable medium is provided, on which a computer program is stored. When the program is executed by a processor, the method described above is implemented.

[0019] According to the security inspection operation recording method, device, electronic device and computer-readable medium provided by some embodiments of the present disclosure, the target facial image of the security inspection operator can be obtained by linking the camera according to the security inspection operation recording instruction. The target operator information is obtained by identifying the target facial image. The security inspection operation record data can be accurately bound to the operator corresponding to the target operator information. In this way, without the need to log in or change positions, each security inspection operation can be accurately corresponded to the identity of an operator. While avoiding a series of problems caused by logging in and out, the same purpose and effect as obtaining and associating identity information through logging in is achieved, meeting the needs of auditing and post-investigation, and ensuring the accuracy of associated information.

[0020] It is to be understood that the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The above and other objects, features and advantages of the present disclosure will become more apparent by describing in detail its exemplary embodiments with reference to the accompanying drawings. The accompanying drawings described below are only some embodiments of the present disclosure, and it is clear to a person skilled in the art that other accompanying drawings can be obtained from these accompanying drawings without creative work.

[0022] Figure 1The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0023] Figure 2 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0024] Figure 3 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0025] Figure 4 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0026] Figure 5 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0027] Figure 6 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0028] Figure 7 The present invention is a block diagram of a security inspection operation recording device according to an exemplary embodiment.

[0029] Figure 8 A schematic diagram of the structure of an electronic device suitable for implementing the embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0030] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted.

[0031] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring the various aspects of the present disclosure.

[0032] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0033] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0034] It should be understood that although the terms first, second, third, etc. may be used herein to describe various components, these components should not be limited by these terms. These terms are used to distinguish one component from another component. Therefore, the first component discussed below can be referred to as the second component without departing from the teachings of the disclosed concepts. As used herein, the term "and / or" includes any one of the associated listed items and all combinations of one or more.

[0035] Those skilled in the art will appreciate that the drawings are merely schematic diagrams of example embodiments, and the modules or processes in the drawings are not necessarily necessary for implementing the present disclosure, and therefore cannot be used to limit the protection scope of the present disclosure.

[0036] In the security inspection operation record scenario in the related technology, for some security inspection operation stations, the process of changing positions will directly affect the operation of business processes. For example, the software of the package opening station of the package opening station requires the package opening operator who is off duty to log out of the current login, and then the package opening operator who is on duty to enter the user name and password to log in. This process of changing positions invisibly affects the normal business process, resulting in the inability to handle the package opening tasks in the process of changing positions in a timely manner, so that potential dangerous goods cannot be effectively intercepted for package opening inspection.

[0037] At the same time, due to the meaning and needs of the business itself, the utilization rate of some operation desks is low, and the relevant on-site security inspection operators rotate frequently, so the operation of switching the login user every time the shift changes is too cumbersome and easy to be forgotten. In the current actual security inspection process, some security inspection operators at some operation desks find it difficult or unaccustomed to performing the shift-related operations on the software interface of the operation desk during the shift scheduling process.

[0038] At the same time, since the username and password used for login are likely to be shared, or the identity used for login is not the identity of the operator currently operating, or the operating software that has been logged in and is in the logged-in state has never been logged in and logged out, when the operator completes an important security check operation, if the audit is only based on the logged-in identity information and the security check operation, it is difficult to ensure the correctness of the information association.

[0039] At the same time, there are also many inconveniences in using ID cards, employee cards (various RFID cards) and other methods of swiping or inserting cards for identity authentication when logging in. In addition to the same problems as the username and password login method mentioned above, the card is also easy to lose. If an important ID card or other identification document is used as a login card, there is also a risk of ID document loss and information leakage. Furthermore, any job change process that requires clear logout and login operations, such as login methods using biometric recognition such as fingerprints and faces, has the same problems and risks as the username and password login method mentioned above.

[0040] Currently, there is no technical solution to address the above-mentioned defects.

[0041] In view of the defects in the related art, the present application proposes a security operation recording method, device, electronic device and computer-readable medium, which can eliminate the operator's login and logout operations during the shift change process, to a certain extent improve the accuracy of the associated record information of the security operation that cannot be guaranteed in the related technology and simplify the security operation process.

[0042] Figure 1 1 is a flowchart of a method for recording security inspection operations according to an exemplary embodiment. The method for recording security inspection operations provided by the embodiment of the present disclosure can be executed by any electronic device with computing and processing capabilities, such as a user terminal and / or a server. In the following embodiments, the method is illustrated by taking the server executing the method as an example, but the present disclosure is not limited thereto. The method for recording security inspection operations provided by the embodiment of the present disclosure may include steps S102 to S110.

[0043] like Figure 1 As shown, in step S102, a security inspection operation record instruction is obtained, and the security inspection operation record instruction includes security inspection operation record data.

[0044] In the embodiments of the present disclosure, the security inspection operation record instruction may be manually issued by the security inspector when performing the security inspection operation, or may be generated and issued by the system when receiving a new security inspection operation record request. The present disclosure does not make any special limitation to this. The security inspection operation record data includes specific security inspection operation content. Security inspection operation: The form includes but is not limited to, (1) clicking a button on the operation interface, (2) using a button on the operating device, (3) voice interaction, (4) no actual physical operation triggered by a change in business status. For example, in the baggage inspection business, when the baggage inspection operator comes to the console screen to perform baggage collection, the security inspection operation record data may be relevant information about baggage collection; when the baggage inspection operator submits the baggage inspection conclusion, the security inspection operation record data may be relevant information about the baggage inspection conclusion.

[0045] In step S104, a shooting request is sent to the camera according to the security inspection operation record instruction.

[0046] In the disclosed embodiment, the security check operation record instruction may include a security check station identification. Among them, a shooting request may be sent to the camera bound to the security check station identification. The security check station identification is the identification code of the security check station bound to the device that processes the current security check operation record. The device that processes the current security check operation record may be, for example, the execution subject of the security check operation record method of the present application. For example, in the security check scenario of baggage inspection, the security check station identification of the security check station where the security check operator is located is bound to the device equipped with the security check station. When the security check operator generates a security check operation record instruction according to the execution subject of the security check operation record method of the present application (i.e., the device equipped with the security check station), a shooting instruction may be sent to the camera bound to the current security check station.

[0047] In an exemplary embodiment, the camera may be set on the operation screen. The operation screen may be the display screen of the execution body of the security inspection operation recording method of the present application. The camera involved in this step may also be an external camera set in other positions, including but not limited to a webcam and a USB camera. For example, a camera clamped above the screen, a camera on the side of the screen, a camera placed on the security inspection console where the screen is located, and a camera with a base or a support seat. The camera may also have a face tracking and capturing function, and adjust the camera's shooting angle according to the position of the face to capture the front face photo of the security inspection operator as much as possible. At the same time, multiple cameras can also be used to form a group of cameras, or multiple groups of cameras to capture the operator's face, and the system selects the face with the best shooting and recognition effect as the additional operation information for storage.

[0048] In step S106, the target face image sent by the camera in response to the shooting request is received.

[0049] In an embodiment of the present disclosure, for example, in a security inspection scenario of unpacking a package for inspection, the security operator may face the camera according to the prompt of the execution subject of the security inspection operation recording method of the present application (such as the prompt information on the device screen) so that the camera can capture the target facial image.

[0050] The camera can obtain the target face image through the captured image. The captured image means that the camera finds the face in the video stream through the universal features and contour recognition of the face, takes a picture, outputs a frame of image mainly containing the face, and stores and uploads it in a universal image format.

[0051] In step S108, the target face image is recognized to obtain target operator information.

[0052] In the embodiment of the present disclosure, for example, the target face image can be compared with the image library that records the face information of the security inspection operator to obtain the target operator information that has been successfully compared. The target operator information can include, for example, the name, work number, etc. of the operator.

[0053] In an exemplary embodiment, when face recognition and comparison of a target face image in a target face sub-library fails, the target face image is sent to an unknown face library; a recognition request is generated based on the target face image in the unknown face library and sent to an administrator.

[0054] In step S110, the target face image, target operator information and security inspection operation record data are associated to obtain the target security inspection operation record.

[0055] According to the security inspection operation recording method provided in the embodiment of the present disclosure, the target facial image of the security inspection operator can be obtained by communicating with the camera according to the security inspection operation recording instruction. The target operator information is obtained by identifying the target facial image. The security inspection operation record data can be accurately bound to the operator corresponding to the target operator information. In this way, without the need to log in or change positions, each security inspection operation can be accurately corresponded to the identity of an operator. While avoiding a series of problems caused by logging in and out, the same purpose and effect as obtaining and associating identity information through logging in is achieved, meeting the needs of auditing and post-investigation, and ensuring the accuracy of associated information.

[0056] It should be clearly understood that the present disclosure describes how to form and use specific examples, but the principles of the present disclosure are not limited to any details of these examples. On the contrary, based on the teachings of the contents disclosed in the present disclosure, these principles can be applied to many other embodiments.

[0057] Figure 2 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0058] like Figure 2 As shown, the security inspection operation recording method of the embodiment of the present disclosure may further include the following steps.

[0059] In step S202, when the target face image sent by the receiving camera in response to the shooting request fails, the shooting request is sent to the surveillance camera within a preset range.

[0060] In the embodiment of the present disclosure, the surveillance camera within the preset range may be within a certain range of the location of the execution subject of the embodiment of the present disclosure. The surveillance camera within the preset range may be bound to the execution subject of the embodiment of the present disclosure in advance as a backup camera to serve as the surveillance camera within the preset range of the execution subject of the embodiment of the present disclosure. The surveillance camera may be, for example, a camera device deployed by the environmental monitoring system.

[0061] In step S204, the target surveillance video sent by the surveillance camera in response to the shooting request is received.

[0062] In step S206, frame extraction is performed on the target surveillance video according to the sending time of the security inspection operation record instruction to obtain a target video frame as a target face image.

[0063] In the embodiment of the present invention, when a camera fails, by linking the monitoring cameras within a preset range, a target facial image including the operator's facial information can be obtained, thereby improving the reliability of data operation records.

[0064] In an exemplary embodiment, a quality assessment based on pattern recognition may be performed on the target face image obtained in step S104 to obtain a quality assessment score. When the quality assessment score is lower than a quality assessment score threshold, the target face image may be sent to an administrator. Optionally, a shooting request may be sent to a surveillance camera within a preset range and the above steps S204 to S206 may be performed.

[0065] Figure 3 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0066] like Figure 3 As shown, the security inspection operation recording method of the embodiment of the present disclosure may include the following steps.

[0067] In step S302, when the operator A performs a security inspection operation on the security inspection operation console N, he obtains a security inspection operation record instruction, and the security inspection operation record instruction includes security inspection operation record data.

[0068] In step S304, a shooting request is sent to the camera according to the security inspection operation record instruction.

[0069] In step S306, the target face image sent by the camera in response to the shooting request is received.

[0070] In step S308, the target face image is associated with the security inspection operation record data.

[0071] In step S310, the target face sub-library to which the security inspection operation station N belongs is determined according to the security inspection operation record instruction.

[0072] In the disclosed embodiment, since the security inspection operators can be divided according to the security inspection points, security inspection stations, and teams, the face database of the security inspectors can be divided into multiple face sub-databases in advance. The target face sub-database is the face sub-database to which the security inspection console N belongs after the division. For all security inspection operators using the security inspection console, their frontal face photos are entered, which can be photos similar to ID photos. As identity registration information equivalent to the user name and password, it is used as the benchmark face feature information in the face recognition function to be compared with other input information.

[0073] In step S312, face recognition and comparison are performed on the target face image in the target face sub-library.

[0074] In step S314, if the comparison in step S312 is successful, the obtained target operator information is associated with the security inspection operation record data.

[0075] In step S316, if the comparison in step S312 fails, the target face image is subjected to face recognition and comparison with the total face database.

[0076] In the disclosed embodiment, the total face database may be a database including the face information of all security inspection operators.

[0077] In step S318, if the comparison in step S316 is successful, the obtained target operator information is associated with the security inspection operation record data.

[0078] In step S320, if the comparison in step S316 fails, the target face image is sent to the unknown face library.

[0079] In step S322, a recognition request is generated based on the target face image in the unknown face database and sent to the administrator.

[0080] In this embodiment, when performing face recognition and comparison, the target face image is first compared with the target face sub-library belonging to the security inspection console N, so that the size of the face library for priority comparison becomes controllable, reducing the requirements for computing power and storage space, and improving the speed of face recognition and comparison.

[0081] Figure 4 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0082] like Figure 4 As shown, the system face library may include a target face sub-library and an unknown face library. The period of regular analysis may be determined according to actual conditions. The security inspection operation recording method of the embodiment of the present disclosure may include the following steps.

[0083] In step S402, facial images that have not been successfully matched within a preset time range in the target face sub-library are obtained.

[0084] In the embodiment of the present disclosure, the preset time range may be, for example, 7 days, 30 days, etc., and the comparison in the present disclosure is not particularly limited. For example, if there is a face image in the target face sub-library that has not been successfully matched within 30 days, the operator corresponding to the face image may have resigned.

[0085] In step S404, a personnel position status confirmation request is generated based on the facial image that has not been successfully matched and sent to the administrator.

[0086] In step S406, feedback information from the administrator in response to the personnel position status request is received.

[0087] In step S408, the face images in the target face sub-library that have not been successfully matched within a preset time range are processed according to the feedback information.

[0088] In the disclosed embodiment, if the feedback information is resignation, the facial image that has not been successfully matched is deleted.

[0089] In this embodiment, by updating the position status of facial images in the target face sub-library that have not been successfully matched within a preset time range, the target face sub-library can be cleaned up, avoiding the computing power consumption of facial matching of facial images of operators who have left the company, and further improving the efficiency of facial recognition.

[0090] In step S410, a recognition request is generated based on the target face image in the unknown face database and sent to an administrator.

[0091] In step S412, the recognition feedback information sent by the administrator in response to the recognition request is received.

[0092] In step S414, if the recognition feedback information is confirmed as a security inspection operator, the operator identity information of the target face image is re-entered.

[0093] In step S416, if the recognition feedback information is confirmed to be not a security operator, the target face image is deleted.

[0094] In this embodiment, by identifying the target facial image in the unknown face library, identification feedback information is obtained, and based on the identification feedback information, images that are not security operators are deleted, and the operator identity information is re-entered for facial images confirmed as security operators. The operator's facial data can be screened and updated, which helps to improve the efficiency and accuracy of face recognition.

[0095] Figure 5 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0096] like Figure 5 As shown, the security inspection operation recording method of the embodiment of the present disclosure may include the following steps.

[0097] In step S502, an audit request or a tracing request is obtained.

[0098] In step S504, the target security inspection operation record is determined according to the audit request or the tracing request.

[0099] In step S506, target operator information is determined according to the target security inspection operation record.

[0100] In this embodiment, the target operator information of each target security inspection operation record can be accurately located according to the audit request or the tracing request. The security inspection operation can be associated and bound with the identity of the operator who performs the security inspection operation without affecting the normal operation of the security inspection business and without the need for the security inspection operator to perform additional identity verification, so that all security inspection operations can be audited, traced and held accountable.

[0101] Figure 6 The present invention is a flowchart of a method for recording security inspection operations according to an exemplary embodiment.

[0102] like Figure 6 As shown, this embodiment can be applied to remote centralized image recognition services. In remote centralized image recognition services, the system can also support user login functions to meet the needs of owners to log in using the "user name / password" method, which is different from the face capture and recognition solution (for example Figure 1 , Figure 2 , Figure 3 , Figure 4 and Figure 5 The security inspection operation recording method of the disclosed embodiment may include the following steps.

[0103] In step S602, a security check operation record instruction is obtained, where the security check operation record instruction includes security check operation record data.

[0104] In step S604, a shooting request is sent to the camera according to the security inspection operation record instruction.

[0105] In step S606, the target face image sent by the camera in response to the shooting request is received.

[0106] In step S608, the target face image is recognized.

[0107] In step S610, if the comparison in step S608 is successful, the identified identity information is determined as the target operator information.

[0108] In step S612, if the identification in step S608 fails, the current logged-in user information is obtained and used as the target operator information.

[0109] In step S614, the target face image, target operator information and security inspection operation record data are associated to obtain the target security inspection operation record.

[0110] In this embodiment, by adopting the double verification of the logged-in user and the real-time face photo, for the target face image captured during the security check operation that can be recognized by the system and has a sufficiently high recognition similarity, it is considered that the target face image has matching and reliable identity information (target operator information) in the system, and the identity information associated with the security check operation record data can be used as the target operator information matched with the target face image. Otherwise, the system will use the information of the currently logged-in user as the identity information associated with the security check operation for subsequent audits.

[0111] The security inspection operation recording method provided by the above-mentioned embodiment of the present application can solve the problems caused by the low utilization rate of security inspection operation stations mainly at inspection stations (package inspection stations), frequent rotation of on-site security inspectors, and cumbersome and easy-to-forget operations of switching logged-in users when changing shifts. Security inspection operators mainly consisting of inspectors (package inspectors) do not need to perform any additional operations, which optimizes the security inspection process mainly consisting of inspections. In addition, compared with the solution that operations can only be performed after confirming the login identity through methods such as username / password and face recognition, the background comparison and identification, quality assessment, and information association are all automatically completed by the system, which will not affect the on-site operations of security inspectors and help to ensure on-site work efficiency.

[0112] It is helpful for reconstructing the real-time working scene of security inspection afterwards, and can supervise and review the work of security inspection operators. As an important basis for performance appraisal, it is possible to choose to let operators know this appraisal method clearly to urge and motivate operators to complete their work better.

[0113] Those skilled in the art will appreciate that all or part of the steps for implementing the above embodiments are implemented as a computer program executed by a CPU. When the computer program is executed by the CPU, the above functions defined by the above method provided by the present disclosure are performed. The program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0114] In addition, it should be noted that the above figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0115] The following are embodiments of the device disclosed herein, which can be used to execute the method embodiments disclosed herein. For details not disclosed in the device embodiments disclosed herein, please refer to the method embodiments disclosed herein.

[0116] Figure 7 The security inspection operation recording device 70 provided in the embodiment of the present disclosure may include: an instruction acquisition module 702 , a shooting request module 704 , an image receiving module 706 , a face recognition module 708 and an association recording module 710 .

[0117] The instruction acquisition module 702 may be configured to acquire a security inspection operation record instruction, where the security inspection operation record instruction includes security inspection operation record data.

[0118] The shooting request module 704 may be configured to send a shooting request to the camera according to the security inspection operation record instruction.

[0119] The image receiving module 706 may be configured to receive a target face image sent by the camera in response to a capture request.

[0120] The face recognition module 708 can be configured to recognize the target face image and obtain the target operator information.

[0121] The associated record module 710 may be configured to associate the target facial image, the target operator information and the security inspection operation record data to obtain the target security inspection operation record.

[0122] In an exemplary embodiment, the security inspection operation recording device 70 may further include an alternative shooting request module, a video receiving module, and a frame extraction module. The alternative shooting request module may be configured to send a shooting request to a surveillance camera within a preset range when the target face image sent by the camera in response to the shooting request fails to be received. The video receiving module may be configured to receive the target surveillance video sent by the surveillance camera in response to the shooting request. The frame extraction module may be configured to perform frame extraction on the target surveillance video according to the sending time of the security inspection operation recording instruction, and obtain the target video frame as the target face image.

[0123] In an exemplary embodiment, the face recognition module 708 may include a face sub-library unit and a face recognition unit. The face sub-library unit may be configured to determine a target face sub-library according to the security inspection operation record instruction. The face recognition unit may be configured to perform face recognition and comparison on the target face image in the target face sub-library to obtain target operator information.

[0124] In an exemplary embodiment, the security inspection operation recording device 70 may further include an unknown face unit and a recognition request unit. The unknown face unit may be configured to send the target face image to the unknown face library when face recognition and comparison of the target face image in the target face sub-library fails. The recognition request unit may be configured to generate a recognition request based on the target face image in the unknown face library and send it to the administrator.

[0125] In an exemplary embodiment, the security inspection operation recording device 70 may further include an image screening module, a status request module, a feedback receiving module, and a screening image processing module. The image screening module may be configured to obtain facial images in the target face sub-library that have not been successfully matched within a preset time range. The status request module may be configured to generate a personnel position status confirmation request based on the facial images that have not been successfully matched and send it to the administrator. The feedback receiving module may be configured to receive feedback information from the administrator in response to the personnel position status request. The screening image processing module may be configured to process the facial images in the target face sub-library that have not been successfully matched according to the feedback information.

[0126] In an exemplary embodiment, the security inspection operation recording device 70 may further include a request receiving module, a record determining module, and an operator determining module. The request receiving module may be configured to obtain an audit request or a tracing request. The record determining module may be configured to determine a target security inspection operation record according to the audit request or the tracing request. The operator determining module may be configured to determine target operator information according to the target security inspection operation record.

[0127] According to the security inspection operation recording device provided in the embodiment of the present disclosure, it communicates with the camera according to the security inspection operation recording instruction, and can link the camera to obtain the target facial image of the security inspection operator. By identifying the target facial image, the target operator information is obtained. The security inspection operation record data can be accurately bound to the operator corresponding to the target operator information. In this way, without the need to log in or change positions, each security inspection operation can be accurately corresponded to the identity of an operator. While avoiding a series of problems caused by logging in and out, the same purpose and effect as obtaining and associating identity information through logging in is achieved, meeting the needs of auditing and post-investigation, and ensuring the accuracy of associated information.

[0128] Figure 8 FIG. 1 shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiment of the present disclosure. It should be noted that: Figure 8 The electronic device 800 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0129] like Figure 8 As shown, electronic device 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage part 808 into a random access memory (RAM) 803. In RAM 803, various programs and data required for system operation are also stored. CPU 801, ROM 802 and RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to bus 804.

[0130] The following components are connected to the I / O interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a LAN card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 810 as needed, so that a computer program read therefrom is installed into the storage section 808 as needed.

[0131] In particular, according to an embodiment of the present disclosure, the process described below with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 809, and / or installed from a removable medium 811. When the computer program is executed by a central processing unit (CPU) 801, various functions defined in the system of the present application are executed.

[0132] It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with at least one wire, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0133] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of the code, and the above-mentioned module, program segment or a part of the code contains at least one executable instruction for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0134] The modules and / or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, and the modules and / or units described may also be set in a processor. The names of these modules and / or units do not, in some cases, constitute limitations on the modules themselves.

[0135] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being installed in the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the following embodiment. For example, the electronic device may implement the following method. Figure 1 or Figure 2 or Figure 3 or Figure 4 or Figure 5 or Figure 6 The steps shown.

[0136] It should be noted that, although several modules of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules and / or units described above can be concretized in one module. Conversely, the features and functions of one module and / or unit described above can be further divided into being concretized by multiple modules and / or units.

[0137] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0138] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0139] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A security inspection operation recording method, characterized in that: include: Obtaining a security inspection operation record instruction, wherein the security inspection operation record instruction includes security inspection operation record data; Sending a shooting request to the camera according to the security inspection operation record instruction; Receiving a target face image sent by the camera in response to the shooting request; Recognize the target face image to obtain target operator information; Associating the target face image, the target operator information and the security inspection operation record data to obtain the target security inspection operation record; When receiving the target face image sent by the camera in response to the shooting request fails, sending the shooting request to a surveillance camera within a preset range; Receiving the target surveillance video sent by the surveillance camera in response to the shooting request; Frames of the target surveillance video are extracted according to the sending time of the security inspection operation record instruction to obtain a target video frame as the target face image.

2. The method according to claim 1, characterized in that The camera is arranged on the operation screen.

3. The method according to claim 1, characterized in that Recognizing the target face image and obtaining the target operator information includes: Determine the target face sub-library according to the security inspection operation record instruction; The target face image is subjected to face recognition and comparison in the target face sub-library to obtain the target operator information.

4. The method according to claim 3, characterized in that Also includes: When face recognition and comparison of the target face image in the target face sub-library fails, sending the target face image to the unknown face library; A recognition request is generated according to the target face image in the unknown face database and sent to an administrator.

5. The method according to claim 3, characterized in that Also includes: Acquire facial images in the target face sub-library that have not been successfully matched within a preset time range; Generate a personnel position status confirmation request based on the unmatched facial image and send it to the administrator; receiving feedback information from the administrator in response to the personnel position status request; The face images in the target face sub-library that have not been successfully matched are processed according to the feedback information.

6. The method according to claim 1, characterized in that Also includes: Obtaining audit requests or tracing requests; Determining target security inspection operation records according to the audit request or the tracing request; The target operator information is determined according to the target security inspection operation record.

7. A security inspection operation recording device, characterized in that: include: An instruction acquisition module is configured to acquire a security inspection operation record instruction, wherein the security inspection operation record instruction includes security inspection operation record data; A shooting request module, configured to send a shooting request to the camera according to the security inspection operation record instruction; An image receiving module, configured to receive a target face image sent by the camera in response to the shooting request; A face recognition module, configured to recognize the target face image and obtain target operator information; an association record module, configured to associate the target face image, the target operator information and the security inspection operation record data to obtain a target security inspection operation record; an alternative shooting request module, configured to send the shooting request to a surveillance camera within a preset range when receiving a target face image sent by the camera in response to the shooting request fails; A video receiving module, configured to receive a target surveillance video sent by the surveillance camera in response to the shooting request; The frame extraction module is configured to extract frames from the target surveillance video according to the sending time of the security inspection operation record instruction, and obtain a target video frame as the target face image.

8. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 6.

9. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Citation Information

Patent Citations

  • Operation and maintenance safety auditing method and system

    CN106330919A