System and method for binding security check channel passenger and portable luggage person and bag

Abstract

The invention relates to the technical field of airport security check, in particular to a system and method for binding security check channel passengers and hand-held luggage. Comprising a passenger identification device, a video acquisition device, video analysis equipment and a security inspection machine interface control system, according to the method, an existing security check channel and an existing security check basket returning system in an airport do not need to be transformed, passenger identification is completed after verification of passengers and before the passengers are queued to prepare for arrangement of luggage, the whole person and bag binding process is non-inductive, and meanwhile person and bag binding of the passengers and hand-held luggage (whether the luggage is placed in a storage basket or not) of the passengers is compatible; the method has the advantages that the business process is kept consistent, the engineering implementation difficulty is low, the implementation cost of the passenger and packet binding function is low, the over-detection efficiency is kept, and the passenger service quality is maintained. Besides, through videos of algorithm analysis and marking, the whole process of passenger and luggage / storage basket over-inspection is visually displayed by adopting a passenger identification number and a luggage identification number, and a retrieval label of the information is attached, so that the efficiency of reverse inspection and tracing of the passenger and the handheld luggage is greatly improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of airport security technology, in particular to a system and method for binding passengers and hand luggage in a security channel. BACKGROUND

[0002] After the airport passenger is verified by security, he / she needs to put the hand luggage directly or in a basket for security check. Without the function of binding the passenger and the luggage, if it is necessary to trace or recheck the passenger and the luggage information, only the passenger's luggage video during a certain period of time can be retrieved based on the passenger verification time as the baseline, and the passenger and the luggage are matched based on the video, and the corresponding luggage check picture is further matched to realize the binding of the passenger, the luggage and the judgment result, which consumes a lot of time and manpower. Therefore, it is an urgent need for the airport to automatically realize the function of binding the passenger and the luggage during the security check. The current mainstream binding scheme of the passenger and the luggage in the airport mainly relies on face recognition technology and baskets with RFID chips / barcodes / digital codes. Specifically, face recognition devices and algorithms are configured at the passenger's luggage arrangement position of the security basket system, and boarding pass or certificate recognition devices are used to assist in collecting passenger information, and the basket information used by the passenger at each arrangement position is identified through the barcode / RFID / code reading device at each arrangement position, so as to realize the binding of the passenger information and the basket information used at the arrangement position. The implementation of this binding scheme of the passenger and the luggage mainly relying on face recognition will not only affect the recognition rate due to algorithm deviation (due to race, gender and age), environmental interference (light and angle) and individual factors (obstructions and changes in appearance), but also needs the support of the security information system and the investment of considerable hardware, which is high in construction / reconstruction cost of the security basket system. At the same time, since the binding of the luggage and the passenger information relies on the basket, all the hand luggage of the passenger needs to be put into the basket for security check, and since the operation of identifying the passenger and the basket is needed during the process of arranging each basket, it is inevitable to reduce the security check efficiency in the security channel.

[0003] Therefore, the present application provides a system and method for binding the passenger and the hand luggage in the security channel. SUMMARY

[0004] (I) Technical problems solved

[0005] The present application aims to provide a system and method for binding the passenger and the hand luggage in the security channel to solve the problems in the background.

[0006] (II) Technical solutions

[0007] To achieve the above-mentioned purpose, the present application provides the following technical solutions:

[0008] A system for binding passenger and hand luggage in security channel, including passenger identification device, video acquisition device, video analysis equipment, security machine interface control system;

[0009] The passenger identification device is arranged in front of the security basket system, and passenger identification is performed to generate a passenger identification number.

[0010] The video acquisition device is arranged at a suitable position of the security channel, or uses the installed security camera, and the visual angle can cover passenger identification, passenger luggage arrangement, and luggage / basket conveying / pushing to the entrance of the security equipment, to provide clear and continuous video stream for the video analysis equipment.

[0011] The video analysis equipment marks and tracks the passenger in the video stream by the passenger identification number, and analyzes the passenger's body movements in arranging and placing luggage, generates a luggage / basket identification number by the passenger identification number + luggage number, marks the luggage identification number in the video stream, and continuously tracks the movement and position of the luggage / basket by features and trajectories.

[0012] The security machine interface control system sends the luggage identification number to the security equipment through the security machine interface control system before the luggage / basket enters the security equipment, and the security equipment generates and saves the inspection picture according to the luggage identification number.

[0013] Further, the specific arrangement of the passenger identification device is to add a boarding pass / certificate identification device at a suitable position before the passenger passes the verification and enters the security basket system, to identify the passenger by the boarding pass / certificate, obtain the passenger certificate number or boarding pass information to generate the passenger identification number. The passenger identity information can also be obtained through the security information system interface. If this interface is used, the passenger identification device does not need to be installed.

[0014] Further, the specific arrangement of the video acquisition device is to add one or more cameras at a suitable position of the security channel (or use the installed security camera), and the visual angle can cover passenger identification, passenger luggage arrangement, and luggage / basket conveying / pushing to the entrance of the security equipment, to provide clear and continuous video stream for the video analysis.

[0015] Further, the specific arrangement of the video analysis equipment is to mark and track the passenger in the video stream by the passenger identification number, and ensure that the tracking of the passenger will not be affected by the changes in features such as taking off clothes and hat; analyze and identify the passenger's body movements in arranging and placing luggage (whether placed in the basket or not), generate a luggage / basket identification number by the passenger identification number + luggage number, mark the luggage identification number, and continuously track the movement and position of the luggage / basket by features and trajectories (whether power conveying or manual pushing).

[0016] Further, the security check machine interface control system is specifically configured in the following manner: through a video stream, tracking of the luggage / basket until entering the security check equipment, sending of the luggage identification number to the security check equipment through the security check machine interface control system, generation of a check picture by the latter according to the luggage identification number, and saving;

[0017] Further, by marking and identifying the features of the staff in the security check channel, the error of binding people and bags caused by the staff assisting the passenger in arranging the luggage is eliminated.

[0018] Further, the video analyzed and realizing marking of the passenger and the luggage / basket is stored in real time and a retrieval tag is generated, so as to facilitate later anti-inquiry and tracing.

[0019] A system for binding of passengers and hand-luggage in a security check channel,

[0020] The system comprises a unit for identifying a passenger and a luggage basket, a unit for continuously tracking the identified target, and a unit for analyzing the interaction behavior between the tracked targets to determine a correlation event, comprising the following steps:

[0021] S0: obtaining identity information of a passenger

[0022] S1: collecting a video stream of a security check channel area in real time;

[0023] S2: based on the video stream, identifying and continuously tracking a passenger and a luggage / basket in the video through a computer vision algorithm;

[0024] S3: analyzing the interaction behavior between the tracked passenger and the luggage / basket;

[0025] S4: when a preset specific interaction behavior is analyzed, it is determined that there is a correlation between the passenger and the luggage / basket, and binding data is generated.

[0026] Further, in step S2, the staff and the passenger are also identified and distinguished, and the interference of the staff behavior is excluded in subsequent analysis.

[0027] Further, in step S3, the specific interaction behavior includes an action of the passenger putting luggage into the basket or directly putting the luggage on the security check basket system.

[0028] Further, after step S2, steps S0 and S4 are further included: step S0: obtaining identity information of a passenger, and binding the identity information with the corresponding passenger tracked in step S2; in step S4, the generated binding data includes the identity information of the passenger; in step S0, the identity information of the passenger is triggered and obtained through an action of scanning a boarding pass or a certificate, or the identity information of the passenger is obtained through an interface of a security check information system.

[0029] Further, it further comprises an image acquisition module for acquiring real-time video data of the security channel, wherein the image acquisition module is one or more network cameras;

[0030] The data processing module comprises a target detection and tracking unit for identifying and tracking passengers and luggage / basket in the video;

[0031] The behavior analysis unit is configured to analyze the interaction behavior between the tracked targets;

[0032] The data management module is configured to generate and output the binding relationship between the passenger and the luggage / basket according to the interaction behavior.

[0033] Compared with the prior art, the present application has the following advantages:

[0034] The present method proposes a passenger tracking and hand luggage (whether placed in the basket or not) tracking and a passenger-luggage binding implementation method and system through video stream. Specifically, an identification device of a boarding pass / certificate is added at a proper position before the passenger passes through the verification and enters the security return basket system, and a camera (or an installed security camera) is added at a proper position of the security channel, the passenger is identified through the boarding pass / certificate, the passenger certificate number or boarding pass information (flight+date+seat+departure station+check-in sequence number) is obtained to generate a passenger identification number, and the passenger in the video stream is named and marked by the passenger identification number, and then the passenger trajectory is tracked in the video stream and the passenger's action of arranging and placing luggage (whether placed in the basket or not) is identified, the passenger identification number + luggage number is used to generate a luggage / basket identification number, the luggage identification number is used to mark and track the movement and position of the luggage / basket (whether powered or manually pushed), and before the luggage / basket enters the security device, the luggage identification number is sent to the security device, and the security device generates a security picture according to the luggage identification number and saves it.

[0035] The present method does not need to modify the existing security channel and security return basket system of the airport, the passenger identification is completed after the passenger verification and before the passenger queues to arrange luggage, the whole process of passenger-luggage binding is completely unnoticeable, and the passenger-luggage binding is compatible with the passenger-luggage binding of the hand luggage directly or placed in the basket, has the advantages of keeping the business process consistent, small engineering implementation difficulty, low passenger-luggage binding function implementation cost, maintaining the security efficiency, maintaining the passenger service quality, etc. In addition, through the algorithm analysis and marked video, the passenger identification number and the luggage identification number are used to intuitively display the whole process of the passenger and the luggage / basket security, and the search label of the above information is attached, which greatly improves the efficiency of the passenger and the hand luggage reverse search and trace. BRIEF DESCRIPTION OF DRAWINGS

[0036] Figure 1A passenger and hand luggage bag binding method and system for security channel Figure 1 ;

[0037] Figure 1 In the figure, 1-passenger identification device; 2-video acquisition device; 3-video analysis equipment; 4-security return basket system; 5-security equipment.

[0038] Figure 2 A passenger and hand luggage bag binding method and system for security channel Figure 2 . DETAILED DESCRIPTION

[0039] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0040] Embodiment 1

[0041] A system for binding passengers and hand luggage bags in a security channel includes a passenger identification device, a video acquisition device, a video analysis equipment, and a security machine interface control system.

[0042] The passenger identification device is arranged in front of the security return basket system to identify passengers and generate passenger identification numbers.

[0043] The video acquisition device is arranged at a suitable position of the security channel, or uses an installed security camera, whose angle of view can cover passenger identification, passenger luggage arrangement, and luggage / basket conveying / pushing to the entrance of the security equipment, to provide clear and continuous video stream for the video analysis equipment.

[0044] The video analysis equipment names and marks the passenger in the video stream with the passenger identification number, tracks the passenger trajectory, and analyzes and identifies the passenger's body movements in arranging and placing luggage. The luggage / basket identification number is generated by the passenger identification number + luggage number, and the luggage identification number is marked in the video stream and continuously tracked by features and trajectory to track the movement and position of the luggage / basket.

[0045] The security machine interface control system sends the luggage identification number to the security equipment through the security machine interface control system before the luggage / basket enters the security equipment, and the latter generates and saves the inspection picture according to the luggage identification number.

[0046] The specific setting mode of the passenger identification device 1 is to add a boarding pass / certificate identification device at a proper position before the passenger passes through the verification to enter the security basket system, identify the passenger through the boarding pass / certificate, obtain the passenger certificate number or boarding pass information to generate a passenger identification number;

[0047] The specific setting mode of the video acquisition device 2 is to add one or more cameras at a proper position of the security channel (or use the installed security camera), and the angle of view can cover the passenger identification, passenger luggage arrangement, and luggage / storage basket conveying / pushing to the entrance of the security device, to provide clear and continuous video stream for video analysis;

[0048] The specific setting mode of the video analysis device 3 is to mark and track the passenger by the passenger identification number through the video stream, and ensure that the change of the passenger's characteristics such as undressing and taking off the hat will not affect the tracking of the passenger; analyze and identify the passenger's arrangement and placement of luggage body movements (whether placed in the storage basket or not), generate a luggage / storage basket identification number by the passenger identification number + luggage number, mark and continuously track the movement and position of the luggage / storage basket by the luggage identification number (whether powered conveying or manual pushing);

[0049] The specific setting mode of the security machine interface control system 4 is to track the luggage / storage basket through the video stream until it enters the security device, send the luggage identification number to the security device through the security machine interface control system, and generate the security check picture and save it according to the luggage identification number by the security device;

[0050] By calibrating and identifying the characteristics of the staff in the security channel, the error of binding the luggage and the bag caused by the staff assisting the passenger in arranging the luggage can be eliminated;

[0051] The video after the video analysis and the marking of the passenger and the luggage / storage basket is stored and a search tag is generated in real time, which is convenient for the later recheck and trace.

[0052] The method proposes a passenger tracking and hand luggage (whether placed in the basket or not) tracking and people bag binding implementation method and system through video stream. The specific implementation is to add a boarding pass / certificate identification device at a proper position before the passenger passes through the verification to enter the security back basket system, and to add one or more cameras at a proper position of the security channel (or use the installed security camera), identify the passenger through the boarding pass / certificate, obtain the passenger certificate number or boarding pass information (flight + date + seat + departure station + check-in sequence number) to generate a passenger identification number, and name and mark the passenger in the video stream with the passenger identification number, and then track the trajectory of each passenger in the video stream and analyze and identify the passenger's luggage arrangement and placement body movements (whether placed in the basket or not), generate a luggage / basket identification number using the passenger identification number + luggage number, mark the luggage identification number, and track the movement and position of the luggage / basket (whether powered or manually pushed) through features and trajectories. Before the luggage / basket enters the security device, the luggage identification number is sent to the security device, and the latter generates a security picture according to the luggage identification number and saves it.

[0053] Embodiment 2

[0054] A system for passenger and hand luggage people bag binding in a security channel,

[0055] The system comprises a unit for identifying passengers and luggage / baskets, a unit for continuously tracking the identified targets, and a unit for analyzing the interaction behavior between the tracked targets to determine the associated events, including the following steps:

[0056] S0: Obtain the identity information of the passenger

[0057] S1: Real-time collection of video stream of security channel area;

[0058] S2: Based on the video stream, identify and continuously track the passengers and luggage / baskets in the video through computer vision algorithm; In step S2, the staff and passengers are also identified and distinguished, and the interference of staff behavior is excluded in subsequent analysis; After step S2, step S0 is also included: obtaining the identity information of the passenger, and binding the identity information with the corresponding passenger tracked in step S2; In step S4, the generated binding data contains the identity information of the passenger; In step S0, the passenger identity information is triggered and obtained through the action of scanning the boarding pass or certificate;

[0059] S3: Analyze the interaction behavior between the tracked passengers and luggage / baskets; In step S3, the specific interaction behavior includes the action of the passenger placing the luggage in the basket or directly placing the luggage on the security back basket system;

[0060] S4: when a preset specific interaction behavior is analyzed, it is determined that there is an association between the passenger and the luggage / basket, and binding data is generated;

[0061] The method does not need to modify the existing security channel and security basket system of the airport, the passenger identification is completed before the passenger verification and queuing to prepare for luggage arrangement, the whole process of the person-bag binding is completely unnoticeable, and the person-bag binding of the passenger hand luggage directly or placed in the basket is compatible, has the advantages of keeping the business process consistent, small engineering implementation difficulty, low realization cost of person-bag binding function, maintaining the efficiency of inspection, maintaining the quality of passenger service, etc. In addition, through the algorithm analysis and marked video, the passenger identification number and the luggage identification number are used to intuitively display the whole process of the passenger and the luggage / basket inspection, and the search label with the above information is attached, which greatly improves the efficiency of the passenger and the hand luggage reverse search and traceability.

[0062] Embodiment 3

[0063] On the basis of embodiment 2, further comprising: a video acquisition module for acquiring real-time video data of the security channel, and the image acquisition module is one or more network cameras;

[0064] The data processing module comprises: a target detection and tracking unit for identifying and tracking passengers and luggage / baskets in the video;

[0065] The behavior analysis unit is configured to analyze the interaction behavior between the tracked targets;

[0066] The data management module is configured to generate and output the binding relationship between the passenger and the luggage / basket according to the interaction behavior.

[0067] Finally, it should be noted that the above content is only used to illustrate the technical solutions of the present application, and is not a limitation on the protection scope of the present application. Simple modifications or equivalent replacements of the technical solutions of the present application made by those skilled in the art do not deviate from the essence and scope of the technical solutions of the present application.

Claims

1. A system for binding passengers and carry-on baggage in security checkpoints, characterized in that: It includes a passenger identification device (1), a video acquisition device (2), a video analysis device (3), and a security inspection machine interface control system (4); The passenger identification device (1) is set in front of the security check basket system to identify passengers and generate a passenger identification number; The video acquisition device (2) is set in a suitable position in the security check channel, or the security camera that has been installed can be used. Its field of view can cover passenger identification, passenger luggage sorting, luggage / storage basket transportation / pushing to the security equipment entrance, providing a clear and continuous video stream for the video analysis device (3). The video analysis device (3) names and marks passengers in the video stream with passenger identification number, tracks passenger trajectory and analyzes and identifies passengers’ body movements of arranging and placing luggage. It generates luggage / storage basket identification number by using passenger identification number + luggage number, marks the luggage / storage basket in the video stream with luggage identification number and continuously tracks the movement and position of luggage / storage basket through features and trajectory. Before the luggage / storage basket enters the security inspection equipment, the security inspection machine interface control system (4) sends the luggage identification number to the security inspection equipment through the security inspection machine interface control system (4), and the latter generates and saves the inspection image according to the luggage identification number.

2. The system for binding passengers and carry-on baggage in security checkpoints according to claim 1, characterized in that: The specific setup of the passenger identification device (1) is as follows: a boarding pass / document identification device is added at an appropriate position before the passenger passes through the verification and enters the security check return bin system. The passenger is identified by the boarding pass / document and the passenger's document number or boarding pass information is obtained to generate a passenger identification number.

3. The system for binding passengers and carry-on baggage in security checkpoints according to claim 1, characterized in that: The specific setup of the video acquisition device (2) is as follows: add one or more cameras (or use existing security cameras) at appropriate locations in the security checkpoint. The camera's field of view can cover passenger identification, passenger luggage handling, and luggage / storage basket delivery / pushing to the security checkpoint entrance, providing a clear and continuous video stream for video analysis.

4. A system for binding passengers and carry-on baggage in security checkpoints according to claim 1, characterized in that: The specific setup of the video analysis device (3) is as follows: the passenger identification number is used to mark and track the passenger through the video stream, and the passenger's queuing, undressing, hat removal and other characteristic changes will not affect the tracking of the passenger; the passenger's body movements of sorting and placing luggage (whether or not it is placed in the storage basket) are analyzed and identified, and the luggage / storage basket identification number is generated by using the passenger identification number + luggage number. The luggage identification number is used to mark and continuously track the movement and position of the luggage / storage basket through features and trajectories (whether it is powered delivery or manual pushing).

5. A system for binding passengers and carry-on baggage in security checkpoints according to claim 1, characterized in that: The specific setting method of the security inspection machine interface control system (4) is as follows: through the video stream, the luggage / storage basket is tracked until it enters the security inspection equipment. The luggage identification number is sent to the security inspection equipment through the security inspection machine interface control system, and the latter generates and saves the inspection image according to the luggage identification number.

6. A system for binding passengers and carry-on baggage in security checkpoints according to claim 1, characterized in that: By identifying and characterizing the features of staff in the security checkpoint, errors in binding people and bags that may occur when security staff assist passengers in organizing their luggage can be eliminated. Videos that have been analyzed and marked with passengers and luggage / storage baskets are stored in real time and retrieval tags are generated to facilitate subsequent reverse lookup and traceability.

7. A method for using a system for binding passengers and carry-on baggage at security checkpoints according to any one of claims 1-6, characterized in that: It includes units for identifying passengers and luggage / storage baskets; units for continuously tracking identified targets; and units for analyzing interactions between tracked targets to determine related events, including the following steps: S0: Obtain passenger identity information S1: Real-time acquisition of video streams from the security checkpoint area; S2: Based on the video stream, identify and continuously track passengers and luggage / storage baskets in the video using computer vision algorithms; S3: Analyze the interaction between the tracked passenger and their luggage / storage basket; S4: When a preset specific interaction behavior is analyzed, it is determined that there is a relationship between the passenger and the luggage / storage basket, and binding data is generated.

8. A method for binding passengers and carry-on baggage in a security checkpoint according to claim 7, characterized in that: In step S3, the specific interactive behavior includes the action of the passenger placing luggage into the storage basket or directly placing luggage on the security check return basket system.

9. A method for binding passengers and carry-on baggage in a security checkpoint according to claim 7, characterized in that: After step S2, step S0 is also included: obtaining the passenger's identity information and binding the identity information with the corresponding passenger tracked in step S2; in step S4, the generated binding data includes the passenger's identity information; in step S0, the passenger's identity information is triggered and obtained by the passenger scanning the boarding pass or document, or the passenger's identity information can be obtained through the security check information system interface.

10. A method for binding passengers and carry-on baggage in a security checkpoint according to claim 7, characterized in that: It also includes: an image acquisition module for acquiring real-time video data of the security checkpoint, wherein the image acquisition module is one or more network cameras; The data processing module includes: a target detection and tracking unit, used to identify and track passengers and luggage / storage baskets in the video; The behavior analysis unit is used to analyze the interaction behavior between the tracked targets. The data management module is used to generate and output the binding relationship between passengers and luggage / storage baskets based on the interaction behavior.

Images