Visitor management system and visitor management method

Abstract

To accurately determine whether or not a ticket of a type corresponding to person attributes of an entrant has been properly presented by the entrant so that an attendant can accurately confirm whether or not there are no irregularities in the admission.SOLUTION: An admission control system includes: a reader 13 that reads ticket information recorded on a ticket medium 6 in the possession of an entrant; cameras 2 and 3 that take photographs of the entrant; a control unit 4 that determines the consistency between the ticket information acquired by the reader and the person attributes of the entrant acquired by the image taken by the camera after confirming the presence of the entrant entering a gate within a predetermined time after the ticket information is read, and generates a management screen that includes information on the determination result; and a display 16 that displays the management screen generated by the control unit. In particular, the control unit generates the number of persons per ticket type and the number of persons per person attribute included in the ticket information as information on the determination result, and also generates inconsistency information to that effect if the ticket information and the person attributes are inconsistent as information on the determination result.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an attendee management system and an attendee management method for permitting admission of an attendee based on ticket information presented by the attendee. [Background technology]

[0002] When using public transportation such as airplanes or trains, or when entering facilities such as theme parks, users present pre-purchased tickets at the entrance gate (including boarding gates and ticket barriers) to check whether or not they are visitors who have paid the official fare. However, there are cases where visitors enter in groups of more people than the number of tickets presented by the visitor, known as tailgating, and thus avoid paying the fare. In addition, inexperienced visitors may perform incorrect operations, resulting in unauthorized entry. However, there are limits to the ability of staff to visually check and respond to such unauthorized entry. Therefore, various technologies for preventing unauthorized entry have been proposed.

[0003] A known technology for preventing such fraudulent entry involves photographing visitors with a camera, counting the number of visitors, reading authentication tags carried by the visitors with a reader, counting the number of authentication tags, and comparing the number of visitors with the number of authentication tags to determine fraudulent entry (tailgating) (see Patent Document 1). Another known technology involves photographing visitors with a camera, counting the number of visitors, authenticating the visitors using IC cards carried by the visitors or facial recognition, obtaining the number of authentications, and comparing the number of visitors with the number of authentications to determine fraudulent entry (see Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2015-011597 [Patent Document 2] Japanese Patent Application Laid-Open No. 2008-134729 Summary of the Invention [Problem to be solved by the invention]

[0005] Now, tickets are classified according to the personal attributes of visitors (adult, child, infant, etc.), and the price paid varies depending on the type. For this reason, there are cases where visitors enter illegally using a ticket of a type that does not match the visitors' personal attributes. Therefore, it is necessary to check not only whether the number of visitors and the number of tickets match, but also whether the number of visitors for each personal attribute and the number of tickets for each type of ticket match. However, conventional technology simply compares the number of visitors with the number of tickets, and has the problem of not being able to check for fraud related to ticket types that correspond to the visitors' personal attributes.

[0006] Therefore, the main object of the present invention is to provide an attendee management system and attendee management method that can accurately determine whether an attendee has properly presented a ticket type that corresponds to the attendee's personal attributes, allowing attendants to accurately check whether there is any fraudulent entry. [Means for solving the problem]

[0007] The visitor management system of the present invention manages the visitor's information based on the ticket information presented by the visitor. Gate device An admission control system that allows the passage of The gate device has a pair of left and right main bodies with openable and closable doors on the exit side, and an internal gate passage is formed between them, and the internal gate passage allows multiple entrants to enter at the same time, a reader that reads the ticket information of one or more visitors from a ticket medium carried by the visitor near the entrance of the facility; The passage inside the gate a camera for capturing images of one or more visitors entering the facility; The passage inside the gate Acquire the photographed image of the visitor entering the The passage inside the gate and tracking entrants entering the gate, recognizing their personal attributes, and determining whether there is a consistency between the number of people for each ticket type included in the ticket information and the number of people for each personal attribute staying within the gate acquired by the camera; A management screen that notifies staff of information regarding the status of visitors who have entered the passageway within the gateand a display that displays the management screen generated by the information processing device, wherein the information processing device generates the management screen within a predetermined time from the reader reading the ticket information. The passage inside the gate Determine whether or not there is an entrant entering the If it is determined that a visitor will enter the passage within the gate within the predetermined time, it performs a determination regarding the consistency based on the photographed image of the visitor, and if the ticket information and the person attributes do not match, it generates the management screen including an error message indicating an inconsistency in the ticket information or a visitor is tailgating, and if it is determined that no visitor will enter the passage within the gate within the predetermined time, it performs a process of clearing the ticket information of the read visitor, and generates the management screen notifying that the clearing process has been executed. The composition is as follows.

[0008] The visitor management method of the present invention also includes the step of: Gate device An visitor management method in which a process related to permission to pass through is executed by an information processing device, The gate device has a pair of left and right main bodies with openable and closable doors on the exit side, and an internal gate passage is formed between them, and the internal gate passage allows multiple entrants to enter at the same time, and acquires the ticket information of one or more visitors read by a reader from a ticket medium carried by the visitor near the entrance of the facility, and within a predetermined time from the reading of the ticket information by the reader. The passage inside the gate Determine whether or not there is an entrant entering the If it is determined that an entrant enters the passageway within the gate within the predetermined time, Acquire photographic images of one or more visitors entering the facility, The passage inside the gate The photographed image of the visitor entering the The passage inside the gate The system tracks visitors entering the venue and recognizes their personal attributes, and compares the number of visitors for each ticket type included in the ticket information with the information acquired by the camera. The passage inside the gate The consistency of the number of visitors staying at each location is determined based on their personal attributes. A management screen that notifies staff of information regarding the status of visitors who have entered the passageway within the gate and display the management screen. and if the ticket information and the person attributes do not match, generating the management screen including an error message indicating the inconsistency of the ticket information or the fact that the attendee is tailgating; If it is determined that no entrant will enter the gate within the predetermined time, the ticket information of the entrant that has been read is cleared, and the management screen that notifies the entrant that the clearing process has been executed is generated. The composition is as follows. [Effects of the Invention]

[0009] According to the present invention, As a management screen for informing staff of information regarding the status of an entrant who has entered the passageway inside the gate within a predetermined time from the reading of the ticket information, a management screen including an error message generated based on a determination regarding the consistency between the ticket information and the person's attributes, or a management screen generated when a ticket information clearing process is executed, is displayed on the display. This allows the attendant to accurately determine whether or not the attendee has properly presented a ticket of a type that corresponds to the attendee's personal attributes. Accurately assess the status of visitors It can be confirmed. [Brief explanation of the drawings]

[0010] [Figure 1] Overall configuration of the visitor management system according to this embodiment [Figure 2]An explanatory diagram showing an overview of a gate device 1, an upper camera 2, and a side camera 3. [Figure 3] A block diagram showing the schematic configuration of a gate device 1 and a control device 4. [Figure 4] FIG. 10 is an explanatory diagram showing a management screen displayed on the attendant display 16 of the gate device 1. [Figure 5] An explanatory diagram showing a specific example of a normal state [Figure 6] An explanatory diagram showing a specific example of an error state related to people counting [Figure 7] An explanatory diagram showing a specific example of an error state related to people counting [Figure 8] An explanatory diagram showing a specific example of an error state related to people counting [Figure 9] An explanatory diagram showing a specific example of an error state regarding an inconsistency between ticket type and person attributes. [Figure 10] An explanatory diagram showing a specific example of an error state regarding an inconsistency between ticket type and person attributes. [Figure 11] 1 is a flowchart showing the procedure of processing performed by the processor 33 of the control device 4. [Figure 12] 1 is a flowchart showing the procedure of processing performed by the processor 33 of the control device 4. DETAILED DESCRIPTION OF THE INVENTION

[0011] The first invention made to solve the above problem is a method for determining the number of visitors based on ticket information presented by the visitors. Gate device An admission control system that allows the passage of The gate device has a pair of left and right main bodies with openable and closable doors on the exit side, and an internal gate passage is formed between them, and the internal gate passage allows multiple entrants to enter at the same time, a reader that reads the ticket information of one or more visitors from a ticket medium carried by the visitor near the entrance of the facility; The passage inside the gate a camera for capturing images of one or more visitors entering the facility; The passage inside the gate Acquire the photographed image of the visitor entering the The passage inside the gateand tracking entrants entering the gate, recognizing their personal attributes, and determining whether there is a consistency between the number of people for each ticket type included in the ticket information and the number of people for each personal attribute staying within the gate acquired by the camera; A management screen that notifies staff of information regarding the status of visitors who have entered the passageway within the gate and a display that displays the management screen generated by the information processing device, wherein the information processing device generates the management screen within a predetermined time from the reader reading the ticket information. The passage inside the gate Determine whether or not there is an entrant entering the If it is determined that a visitor will enter the passage within the gate within the predetermined time, it performs a determination regarding the consistency based on the photographed image of the visitor, and if the ticket information and the person attributes do not match, it generates the management screen including an error message indicating an inconsistency in the ticket information or a visitor is tailgating, and if it is determined that no visitor will enter the passage within the gate within the predetermined time, it performs a process of clearing the ticket information of the read visitor, and generates the management screen notifying that the clearing process has been executed. The composition is as follows.

[0012] According to this, As a management screen for informing staff of information regarding the status of an entrant who has entered the passageway inside the gate within a predetermined time from the reading of the ticket information, a management screen including an error message generated based on a determination regarding the consistency between the ticket information and the person's attributes, or a management screen generated when a ticket information clearing process is executed, is displayed on the display. This allows the attendant to accurately determine whether or not the attendee has properly presented a ticket of a type that corresponds to the attendee's personal attributes. Accurately assess the status of visitors It can be confirmed.

[0013] In a second invention, the information processing device generates, as information relating to the determination result, the number of people for each ticket type and the number of people for each personal attribute included in the ticket information.

[0014] This allows staff to check the details of any unauthorized entry.

[0017] Also, Third In the invention, the information processing device generates information indicating that the state includes at least one of a child and an infant as information relating to the determination result.

[0018] This allows visitors to notify staff that they are accompanied by a child or infant.

[0019] Also, Fourth The invention is configured such that the information processing device detects an infant being held by an adult based on the image captured by the camera, and generates information indicating that the infant is being held as information related to the determination result.

[0020] This allows the attendant to be notified that there is a small child being held by an adult.

[0021] Also, Fifth In the invention, the information processing device is configured to generate the management screen having a playback button for instructing playback of images captured by the camera.

[0022] This allows staff to instantly check the actual situation of visitors using images captured by the camera.

[0023] Also, Sixth The invention is a method for determining the number of visitors based on the ticket information presented by the visitors. Gate device An visitor management method in which a process related to permission to pass through is executed by an information processing device, The gate device has a pair of left and right main bodies with openable and closable doors on the exit side, and an internal gate passage is formed between them, and the internal gate passage allows multiple entrants to enter at the same time, and acquires the ticket information of one or more visitors read by a reader from a ticket medium carried by the visitor near the entrance of the facility, and within a predetermined time from the reading of the ticket information by the reader. The passage inside the gate Determine whether or not there is an entrant entering the If it is determined that an entrant enters the passageway within the gate within the predetermined time, Acquire photographic images of one or more visitors entering the facility, The passage inside the gate The photographed image of the visitor entering the The passage inside the gate The system tracks visitors entering the venue and recognizes their personal attributes, and compares the number of visitors for each ticket type included in the ticket information with the information acquired by the camera. The passage inside the gate The consistency of the number of visitors staying at each location is determined based on their personal attributes. A management screen that notifies staff of information regarding the status of visitors who have entered the passageway within the gate and display the management screen. and if the ticket information and the person attributes do not match, generating the management screen including an error message indicating the inconsistency of the ticket information or the fact that the attendee is tailgating; If it is determined that no entrant will enter the gate within the predetermined time, the ticket information of the entrant that has been read is cleared, and the management screen that notifies the entrant that the clearing process has been executed is generated. The composition is as follows.

[0024] According to this, as in the first invention, it is possible to accurately determine whether or not a visitor has properly presented a ticket of a type corresponding to the person's personal attributes, and the attendant can Accurately assess the status of visitors It can be confirmed.

[0025] Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[0026] FIG. 1 is a diagram showing the overall configuration of an attendee management system according to this embodiment.

[0027] This visitor management system allows passengers (entrants) to board (enter) at an airport boarding gate (entrance gate) based on the ticket (boarding pass) presented by the passenger (entrant), and is equipped with a gate device 1, an upward camera 2 (first camera), a side camera 3 (second camera), a control device 4 (information processing device), an attendant terminal 5 (terminal device), and a ticket medium 6.

[0028] The gate device 1 is a so-called ticket gate and is installed to restrict entry to the boarding passage leading to the aircraft. The gate device 1 verifies the tickets presented by passengers, i.e., checks the authority of users to board the aircraft.

[0029] The upper camera 2 and the side camera 3 are installed near the gate device 1. The upper camera 2 photographs passengers passing through the gate device 1 from above. The side camera 3 photographs passengers passing through the gate device 1 from the side.

[0030] The control device 4 performs processing related to visitor management. This control device 4 can communicate with the gate device 1, the upper camera 2, the side camera 3, and the staff terminal 5 via a communication path such as an on-site network installed in the airport. The control device 4 can also communicate with the upper system device 7 via a communication path such as an on-site network.

[0031] The host system device 7 constitutes a host system (airport management system) to which this visitor management system is attached, and manages passenger ticket information and provides the passenger ticket information to the control device 4.

[0032] The attendant terminal 5 is carried by the attendant and is configured as a tablet terminal, a smartphone, etc. This attendant terminal 5 displays a management screen related to the status of the gate device 1, the status of passengers passing through the gate device 1, etc.

[0033] The ticket medium 6 is carried by the passenger and records the passenger's ticket information. Specifically, it may be an IC card or smartphone equipped with an IC chip that stores the ticket information, a piece of paper on which a two-dimensional barcode is drawn, or a smartphone that displays a two-dimensional barcode on its screen. The passenger's ticket information recorded on the ticket medium 6 is provided to the control device 4 via the gate device 1.

[0034] In this embodiment, a system targeting airport boarding gates will be described, but the present invention is not limited to airport boarding gates. The system may also target entrance gates (ticket gates) that restrict entry to boarding areas of vehicles (such as platforms at train stations) at facilities (such as train stations, bus terminals, and boarding points) for other public transportation (such as railways, buses, and ships). Furthermore, in addition to those that restrict entry to boarding areas for transportation, the system may also target entrance gates installed in other facilities, such as gates that restrict entry to theme parks.

[0035] In this embodiment, a control device 4 (PC) is provided to perform processes related to visitor management, but this control device 4 may be installed in a facility (such as an airport) where the gate device 1 is installed, or may be configured as a cloud computer (information processing device). In this case, the gate device 1, upper camera 2, and side camera 3 may be configured to communicate with the cloud computer via a wide area network (such as the Internet).

[0036] Next, a description will be given of the gate device 1, the upper camera 2, and the side camera 3. Fig. 2 is an explanatory diagram showing an overview of the gate device 1, the upper camera 2, and the side camera 3.

[0037] The gate device 1 has a pair of left and right main bodies 11, with an in-gate passage 12 formed between them. Multiple people can enter this in-gate passage 12 at the same time. In this embodiment, passengers are generally required to pass through the in-gate passage 12 one at a time, but if an adult is accompanied by a child or infant, two people are allowed to pass through at the same time. Therefore, although the upper limit of the number of people who can pass through the in-gate passage 12 at the same time is two, two adults are not allowed to pass through at the same time.

[0038] A reader 13 is provided on the entrance side of the main body 11. This reader 13 reads ticket information from the ticket medium 6 carried by the passenger. In this embodiment, the reader 13 has the functions of both an IC card reader and a two-dimensional barcode reader, and operates as an IC card reader when a passenger holds an IC card over the reader, and as a two-dimensional barcode reader when a passenger holds a two-dimensional barcode over the reader.

[0039] In addition, a photoelectric sensor 14 (optical passage sensor) is provided on the entrance side of the main body 11. Based on the detection result of this photoelectric sensor 14, it is possible to accurately detect that a person (object) has entered the internal gate passage 12. Furthermore, by providing multiple photoelectric sensors 14 above and below, it is possible to determine whether the height of the person entering the internal gate passage 12 is higher or lower than a predetermined value, thereby making it possible to determine whether the person entering the internal gate passage 12 is an adult or a child.

[0040] A passenger display 15 is provided on the entrance side of the main body 11. This passenger display 15 can be viewed by passengers. This passenger display 15 displays a guidance screen that notifies passengers of information such as the flight number and destination currently being announced.

[0041] An attendant display 16 is provided on the exit side of the main body 11. This attendant display 16 can be viewed by an attendant. This attendant display 16 displays a management screen that notifies the attendant of information such as the status of the gate device 1 and the status of passengers passing through the gate device 1.

[0042] A door 17 (flap door) that can be opened and closed is provided on the exit side of the main body 11. If the ticket presented by the passenger is not fraudulent and the user is allowed to pass, the door 17 opens and the user can pass through the in-gate passage 12. If the ticket presented by the passenger is fraudulent and the user's passage is restricted, the door 17 remains closed and the user is unable to pass through the in-gate passage 12 and is forced to turn back.

[0043] An upper camera 2 is provided above the main body 11. This upper camera 2 is an omnidirectional camera that captures the gate passage 12 and its surroundings from above. The image captured by this upper camera 2 captures a person's head, and by detecting the head from the captured image using image recognition technology, it is possible to accurately detect a person who has entered the gate passage 12. For example, it is possible to detect without fail even when multiple people are lined up side by side or when multiple people's bodies are closely spaced vertically. It is also possible to detect parents and children, such as an adult carrying a small child on their back.

[0044] Additionally, a side camera 3 is provided above the main body 11. This side camera 3 is a wide-angle camera that photographs the gate passage 12 and its surroundings from the side. An infant being held in someone's arms is captured in the image captured by this side camera 3, and image recognition technology can be used to accurately detect an infant being held in someone's arms.

[0045] Next, a description will be given of the schematic configuration of the gate device 1 and the control device 4. Fig. 3 is a block diagram showing the schematic configuration of the gate device 1 and the control device 4.

[0046] The gate device 1 includes a reader 13, a photoelectric sensor 14, a passenger display 15, an attendant display 16, a door 17, a drive unit 18, a communication unit 21, a memory 22, and a processor 23.

[0047] The drive unit 18 drives the door 17 to open or close in response to an opening or closing command from the processor 23 .

[0048] The communication unit 21 communicates with the control device 4. Specifically, it transmits passenger ticket information acquired from the ticket medium 6 by the reader 13 and detection information from the photoelectric sensor 14 to the control device 4. It also receives display information for the passenger display 15 and the attendant display 16 and control information for the doors 17 from the control device 4.

[0049] The memory 22 stores a program executed by the processor 23 .

[0050] The processor 23 performs various processes by executing programs stored in the memory 22. In this embodiment, the processor 23 controls the passenger display 15 and the attendant display 16 to display various screens. The processor 23 also controls the reader 13 to acquire ticket information from the ticket medium 6.

[0051] The gate device 1 may be provided with a speaker to output voice guidance and warnings to passengers and staff.

[0052] The control device 4 includes a communication unit 31 , a memory 32 , and a processor 33 .

[0053] The communication unit 31 communicates with the gate device 1, the upper camera 2, the side camera 3, and the attendant terminal 5. Specifically, it receives images captured by the upper camera 2 and the side camera 3. It also receives ticket information read by the reader 13 of the gate device 1 from the gate device 1. It also transmits display information on the passenger display 15 and the attendant display 16 of the gate device 1 to the gate device 1.

[0054] The memory 32 stores programs executed by the processor 33. It also accumulates boarding passenger information acquired from the host system device 7. This boarding passenger information is ticket information of passengers scheduled to board a flight departing from a target boarding gate. It also accumulates photographed images received from the upper camera 2 and the side camera 3.

[0055] Before boarding guidance begins at the boarding gate, ticket information of passengers scheduled to board the flight in question may be acquired from the host system device 7 and stored in the memory 32.

[0056] The processor 33 performs various processes by executing programs stored in the memory 32. In this embodiment, the processor 33 performs each process of ticket tallying, person tracking, target person detection, dwarf detection, infant detection, person tallying, consistency determination, boarding permission determination (entry permission determination), gate control, and staff notification.

[0057] In the ticket counting process, the number of tickets read, i.e., the number (total number) of tickets presented by passengers, is counted based on the ticket information obtained from the ticket medium 6 by reading it with the reader 13. In addition, the number of people (breakdown) for each ticket type is obtained based on the ticket type included in the ticket information.

[0058] Here, passengers are issued different types of tickets according to their personal attributes. In this embodiment, three types of personal attributes and ticket types are set: adult, child, and infant. An infant is, for example, a person under the age of three, and does not need to pay a fare. A child is, for example, a person over the age of three who is less than 120 cm tall, and pays a child fare. An adult is a person who does not fall into the category of either an infant or a child, and pays an adult fare.

[0059] In the person tracking process, people are detected from the images captured by the upper camera 2, and the people are tracked, and position information of each person at each time is output as person tracking information.

[0060] In the target person detection process, based on the person tracking information acquired in the person tracking process and the detection results of the photoelectric sensor 14, it is determined whether or not the target person, i.e., the person who has entered the gate passage 12, is among the people being tracked.

[0061] The dwarf detection process detects dwarfs (children), i.e., people who are walking independently and whose height is shorter than a predetermined value (e.g., 120 cm). Specifically, based on the detection results of the photoelectric sensor 14, it is determined whether the height of the person entering the internal gate passage 12 is shorter than a predetermined value. The person's height is also estimated based on images captured by the upper camera 2 and the side camera 3. The determination result and the estimation result regarding the person's height are then integrated to determine whether the person entering the internal gate passage 12 is an adult or a dwarf. Note that while the dwarf detection process here is an example in which the detected height is compared with a predetermined value, a classifier that has been trained by deep learning to classify two classes, dwarfs and non-dwarfs, can also be used in the dwarf detection process. During the dwarf detection process, the classifier calculates the likelihood (probability) of a detected person image as a dwarf and the likelihood of a person other than a dwarf, and by comparing the two likelihoods, it is possible to determine whether the person is a dwarf or a person other than a dwarf.

[0062] In the infant detection process, an infant being held by an adult is detected based on the image captured by the side camera 3, and infant detection information is output. This infant detection process focuses on an infant holder (infant carrier) such as a baby sling to detect an infant being held. There are also cases where an adult holds an infant in their arms without using an infant holder, and this type of held infant is also detected. Note that infant holders include those that hold an infant facing forward, those that hold an infant facing backward, and those that hold an infant sideways. Furthermore, even when an infant holder is not being used, the infant may be in an upright position or lying on its side.

[0063] In addition, since the head of an infant being carried on someone's back can be detected from the image captured by upper camera 2, it can be detected as a person by person tracking processing based on the image captured by upper camera 2. Furthermore, by combining this with entry information (entry of one adult) from photoelectric sensor 14, the accuracy of detecting an infant being carried on someone's back can be improved. In this case, the person is not counted as an infant, so a mismatch occurs between the ticket type and person attributes, resulting in an error state. However, an attendant visually checks the person and, if there are no problems, allows them to pass.

[0064] In the person counting process, the number of people being tracked inside the gate is counted based on the person tracking information acquired in the person tracking process, that is, the number (total number) of people in the gate passage 12 among the people being tracked using the images captured by the upper camera 2. In addition, in the infant detection process, if an infant being held is detected in the images captured by the side camera 3, the number of infants is added to the number of people being tracked inside the gate to calculate the number of people remaining inside the gate. In addition, in the child detection process, if a child is detected, the number of children is subtracted from the number of people being tracked inside the gate to obtain the number of adults. In this way, it is possible to obtain the total number of people remaining inside the gate and its breakdown, that is, the number of people by person attribute (adults, children, infants).

[0065] The consistency determination process compares the number of tickets read in the ticket counting process with the number of people inside the gate obtained in the person counting process to determine whether they match. Specifically, if the number of tickets read and the number of people inside the gate match in both total number and breakdown, the two are determined to match. In other words, if the number of people for each ticket type (adult, child, infant) and the number of people for each person attribute (adult, child, infant) match, the two are determined to match. Furthermore, if the number of people inside the gate is greater than the number of tickets read, it is determined that the person is tailgating.

[0066] In the boarding permission determination process, if the number of tickets read matches the number of people inside the gate in the consistency determination process, the ticket information presented by the passenger is compared with the ticket information of the passenger being guided to board, and a decision is made as to whether or not to permit boarding (ticket gate processing). The ticket information of the passenger being guided to board is obtained from the upper system device 7.

[0067] In the gate control process, the opening and closing of the door 17 is controlled according to the determination result of the boarding permission determination process. That is, if boarding is permitted, the door 17 opens, and if boarding is not permitted, the door 17 remains closed.

[0068] In the attendant notification process, information relating to the determination result of the consistency determination process is notified to the attendant. In this embodiment, a management screen including information relating to the determination result of the consistency determination process is generated, and the management screen is displayed on the attendant display 16 of the gate device 1. Furthermore, in response to an instruction from the attendant, images captured by the upper camera 2 and the side camera 3 are displayed on the attendant display 16. Note that audio relating to the determination result of the consistency determination process may be output from a speaker provided in the gate device 1.

[0069] Furthermore, in the staff notification process, a management screen similar to the management screen displayed on the staff display 16 of the gate apparatus 1 is displayed on the staff terminal 5. This staff terminal 5 may be configured to display the same management screen as the management screen displayed on the staff display 16 of the gate apparatus 1, or may be configured to display information about multiple gate apparatuses 1 installed at the boarding gate together on one screen.

[0070] Next, a description will be given of the management screen displayed on the attendant display 16 of the gate apparatus 1. Fig. 4 is an explanatory diagram showing the management screen displayed on the attendant display 16.

[0071] The management screen is provided with a read ticket count display section 41 and a gate count display section 42. The read ticket count display section 41 displays the number of tickets read for each ticket type (adult, child, infant). The gate count display section 42 displays the number of people staying within the gate for each person attribute (adult, child, infant).

[0072] This management screen also has the words "visual confirmation" 44 and a playback button 45. Operating the playback button 45 transitions to a playback screen (not shown). On this playback screen, the captured image including the target person is played back. The captured image can be displayed as a video.

[0073] Furthermore, if an error occurs, that is, if the consistency determination process determines that the number of tickets read does not match the number of people inside the gate, an error message 43 is displayed. This error message 43 varies depending on the nature of the inconsistency.

[0074] Furthermore, in the event of an error, the words "visual check" 44 are highlighted. Specifically, the words "visual check" 44 change to a predetermined color (e.g., red). This urges the attendant to visually check the status of the person passing through the gate.

[0075] In the event of an error, an alert mark 46 is displayed on the management screen. This allows the staff to be quickly notified that there is a discrepancy between the number of tickets read and the number of people inside the gate, i.e., that a passenger is attempting to board illegally.

[0076] Next, specific examples of normal and error states will be described. Fig. 5 is an explanatory diagram showing a specific example of a normal state. Figs. 6, 7, and 8 are explanatory diagrams showing specific examples of error states related to people counting. Figs. 9 and 10 are explanatory diagrams showing specific examples of error states related to inconsistencies between ticket types and person attributes. Here, (A-1), (A-2), (A-3), and (A-4) in each diagram show the number of tickets read and the total number and breakdown of people inside the gate. Also, (B-1), (B-2), (B-3), and (B-4) in each diagram show the management screen displayed on the attendant display 16.

[0077] The examples shown in Figure 5 are normal cases, and there is no inconsistency in either the total number or the breakdown between the number of tickets read and the number of people inside the gate. In other words, the total number of tickets read matches the total number of people inside the gate, and furthermore, the number of tickets read by each ticket type matches the number of people inside the gate by each person attribute.

[0078] The examples shown in Figures 6, 7, and 8 are cases of errors in people counting, where there is a discrepancy between the total number of tickets read and the total number of people inside the gate. In other words, the total number of tickets read does not match the total number of people inside the gate.

[0079] In particular, the examples shown in Figures 6 and 7 are for cases where the total number of people inside the gate is greater than the total number of tickets read, i.e., cases of tailgating. In this case, the management screen displays an error message of "tailgating" as inconsistency information. Furthermore, if a baby being carried is detected, the management screen displays an error message of "tailgating with baby in arms" as inconsistency information, as shown in Figures 6(B-3) and 7(B-3).

[0080] 8 shows an example in which the total number of people staying within the gate is less than the total number of tickets read. In this case, an error message "Ticket mismatch" is displayed on the management screen as inconsistency information.

[0081] The examples shown in Figures 9 and 10 are cases where the error is related to a mismatch between ticket type and person attributes. There is no mismatch in the total number of tickets read and the number of people inside the gate, but there is a mismatch in the breakdown. In other words, the number of tickets read by ticket type does not match the number of people inside the gate by person attribute. In this case, the error message "Ticket mismatch" is displayed on the management screen as mismatch information.

[0082] Furthermore, if the passenger does not present the appropriate type of ticket according to their personal attributes, especially if tickets for all people entering the gate passage 12 are not presented, an error state will occur in which the total number of people staying within the gate is greater than the total number of tickets read, as shown in the examples in Figures 6 and 7.

[0083] Furthermore, if person tracking using images captured by the upper camera 2 fails, or if infant detection using images captured by the side camera 3 fails, the number of people inside the gate will be less than the actual number, resulting in an error state where the total number of people inside the gate is less than the total number of tickets read, as shown in the examples of Fig. 8. In particular, the example shown in Fig. 8(A-1) is a case where person tracking of a child has failed, and the example shown in Fig. 8(A-2) is a case where infant detection has failed.

[0084] Furthermore, in the case of an infant being carried on someone's back, the person is detected as an adult by person tracking using the image captured by the upper camera 2, and so a swap between the adult and the infant occurs, as in the example shown in FIG. 9(A-1). Furthermore, if a child is being carried by an adult, a swap between the child and the infant occurs, as in the example shown in FIG. 9(A-2). Furthermore, if child detection using the detection results of the photoelectric sensor 14 fails, a swap between the adult and the child occurs, as in the examples shown in FIGS. 9(A-3), (A-4), and 10. Note that, as mentioned above, by combining the tracking information from the image captured by the upper camera 2 and the approach information from the photoelectric sensor 14, the piggyback state can be accurately detected, and therefore, the presence or absence of a swap can be determined taking the piggyback state into consideration.

[0085] 4 to 10 are displayed on the attendant display 16 of the gate device 1, and similar management screens are also displayed on the display of the attendant terminal 5.

[0086] Next, a description will be given of the procedure of the process performed by the processor 33 of the control device 4. Figures 11 and 12 are flowcharts showing the procedure of the process performed by the processor 33 of the control device 4.

[0087] When a passenger holds the ticket medium 6 over the reader 13 at the gate device 1, the processor 33 of the control device 4 obtains the ticket information read from the ticket medium 6 by the reader 13 from the gate device 1 (Yes in ST101), and then determines whether a person (object) has entered the gate passage 12 based on the detection result of the photoelectric sensor 14 (ST102).

[0088] If no person has entered the gate passage 12 (No in ST102), it is determined whether a predetermined time has elapsed since the ticket was read (ST103).

[0089] If a predetermined time has passed since the ticket was read (Yes in ST103), that is, if the passenger holds up the ticket medium 6 but turns back without entering the gate passage 12, a read clear process is executed (ST104). In this read clear process, the ticket information is erased. Also, a management screen is displayed on the attendant display 16 to notify the attendant that the read clear process has been executed. Also, control is performed to close the door 17.

[0090] On the other hand, if the predetermined time has not passed since the ticket was read (No in ST103), the process returns to ST102.

[0091] If a person has entered the gate internal passage 12 (Yes in ST102), then person tracking information is acquired based on the image captured by the upper camera 2 (ST105). Then, based on the person tracking information, it is determined whether or not the person being tracked is a target person, i.e., a person who has entered the gate internal passage 12 (ST106).

[0092] If there is no target person (No in ST106), the process proceeds to ST103.

[0093] On the other hand, if a target person is present (Yes in ST106), it is then determined whether or not there is a dwarf among the target people (ST107).

[0094] If there is a dwarf among the target persons (Yes in ST107), it is next determined whether or not there is a dwarf ticket among the target tickets, that is, the tickets currently being processed (ST108).

[0095] If there is no child ticket among the target tickets (No in ST108), the ticket type and person attributes do not match, so ticket mismatch processing is executed (ST117). In this ticket mismatch processing, an error status management screen is displayed on the attendant display 16. Also, control is performed to close the door 17.

[0096] On the other hand, if there are no dwarfs among the target people (No in ST107) or if there are dwarf tickets among the target tickets (Yes in ST108), the number of people being tracked who are in the gate passage 12 (number of people being tracked inside the gate) is counted (ST109). Then, it is determined whether the number of tickets read is equal to or greater than the number of people being tracked inside the gate (ST110).

[0097] Here, if the number of read tickets is not equal to or greater than the number of people to be tracked inside the gate (No in ST110), that is, if there are more people in the gate passage 12 than the number of tickets read, a tailgating notification process is executed (ST118). In this tailgating notification process, a management screen is displayed on the attendant display 16 to notify the attendant that a tailgating has been detected. Also, control is performed to close the door 17.

[0098] On the other hand, if the number of read tickets is equal to or greater than the number of people to be tracked within the gate (Yes in ST110), then the system acquires child detection information (ST111), and determines whether or not there is a child among the target people based on the child detection information (ST112).

[0099] If there are no small children among the target people (No in ST112), it is then determined whether the number of read tickets matches the number of people being tracked inside the gate (ST113).

[0100] If the number of tickets read does not match the number of people being tracked inside the gate (No in ST112), a process to check for a shortage of people is executed (ST119). In this process, a management screen is displayed on the attendant display 16 to notify the attendant that a shortage of people has been detected. In addition, control is exercised to close the door 17.

[0101] On the other hand, if the number of read tickets matches the number of people being tracked inside the gate (Yes in ST113), the passage process is executed (ST120). In this passage process, control is performed to open the door 17.

[0102] If an infant is present among the target persons (Yes in ST112), it is then determined whether or not there is an infant ticket among the target tickets (ST114).

[0103] If there is no child ticket among the target tickets (No in ST114), the ticket mismatch process is executed (ST117). In this ticket mismatch process, an error status management screen is displayed on the attendant display 16. Also, the door 17 is controlled to close.

[0104] On the other hand, if there is an infant ticket among the read tickets (Yes in ST114), the number of people staying within the gate is calculated by adding the number of infants being carried to the number of people being tracked within the gate (ST115).It is then determined whether the number of read tickets matches the number of people staying within the gate (ST116).

[0105] If the number of tickets read does not match the number of people staying within the gate (No in ST116), tailgating processing is executed. In this tailgating processing, a management screen is displayed on the attendant display 16 to notify the attendant that tailgating has been detected. Also, control is performed to close the door 17.

[0106] On the other hand, if the number of read tickets matches the number of people staying inside the gate (Yes in ST116), the passage process is executed (ST120), in which control is exercised to open the door 17.

[0107] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0108] The attendee management system and attendee management method of the present invention have the effect of accurately determining whether an attendee has properly presented a ticket type that corresponds to the attendee's personal attributes, allowing staff to accurately confirm whether there is any fraudulent entry, and are useful as an attendee management system and attendee management method that permits entry of an attendee based on the ticket information presented by the attendee. [Explanation of symbols]

[0109] 1 Gate device 2. Upward camera 3 Side Camera 4. Control device (information processing device) 5. Staff terminal 6 Ticket media 7. Upper system device 11 Main unit 12 Passage inside the gate 13 Leader 14 Photoelectric Sensor 15 Passenger Display 16. Staff display 41 Read ticket number display 42 Number of people staying within the gate 45 Play button 46 Alert Mark

Claims

1. An attendee management system that allows an attendee to pass through a gate device based on ticket information presented by the attendee, The gate device has a pair of left and right main bodies with openable and closable doors on the exit side, with an internal gate passage formed between them, and the internal gate passage allows multiple entrants to enter at the same time, a reader that reads the ticket information of one or more visitors from a ticket medium carried by the visitor near the entrance of the gate device; a camera for capturing images of one or more visitors entering the passageway within the gate; an information processing device that acquires the captured image of a spectator entering the passage within the gate, tracks the spectator entering the passage within the gate, recognizes the spectator's personal attributes, determines the consistency between the number of people for each ticket type included in the ticket information and the number of spectators for each personal attribute staying within the gate acquired by the camera, and generates a management screen that notifies an attendant of information regarding the status of the spectator who has entered the passage within the gate; a display that displays the management screen generated by the information processing device, The information processing device includes: determining whether or not an entrant will enter the passageway within the gate within a predetermined time from the time the reader reads the ticket information; If it is determined that a visitor will enter the passageway within the gate within the predetermined time, a determination is made regarding the consistency based on the photographed image of the visitor, and if the ticket information and the person attributes do not match, the management screen is generated, including an error message indicating an inconsistency in the ticket information or that the visitor is tailgating; When it is determined that no entrants will enter the passageway within the gate within the specified time, the entrant management system performs a clearing process on the ticket information of the entrant that has been read, and generates the management screen to notify that the clearing process has been carried out.

2. The information processing device includes: The attendee management system according to claim 1, wherein the information relating to the judgment result includes the number of attendees for each ticket type included in the ticket information and the number of attendees for each of the personal attributes.

3. The information processing device includes:

2. The visitor management system according to claim 1, wherein the information relating to the determination result is information indicating that the person is in a state of being accompanied by at least one of a child and an infant.

4. The information processing device includes: Detecting a child being held by an adult based on an image captured by the camera; 2. The visitor management system according to claim 1, wherein information indicating that a child is being held is generated as information relating to the determination result.

5. The information processing device includes:

2. The visitor management system according to claim 1, wherein the management screen is generated having a playback button for instructing playback of the image captured by the camera.

6. An attendee management method in which an information processing device executes a process related to allowing an attendee to pass through a gate device based on ticket information presented by the attendee, comprising: The gate device has a pair of left and right main bodies with openable and closable doors on the exit side, with an internal gate passage formed between them, and the internal gate passage allows multiple entrants to enter at the same time, acquiring the ticket information of one or more visitors read by a reader from a ticket medium carried by the visitor near the entrance of the gate device; determining whether or not an entrant will enter the passageway within the gate within a predetermined time from the time the reader reads the ticket information; When it is determined that there is an entrant entering the passage within the gate within the predetermined time, photographed images of one or more entrants entering the passage within the gate are acquired by a camera; tracking the entrant entering the passage within the gate based on the photographed image of the entrant entering the passage within the gate and recognizing the personal attributes of the entrant; a determination is made as to the consistency between the number of people for each ticket type included in the ticket information and the number of people for each personal attribute of entrants staying in the passage within the gate obtained by the camera, a management screen is generated to notify an attendant of information regarding the status of entrants who have entered the passage within the gate, and the management screen is displayed on a display; If the ticket information and the person attributes do not match, the management screen is generated, including an error message indicating the inconsistency of the ticket information or the attendee being accompanied by another attendee; An attendee management method characterized in that, when it is determined that no attendees will enter the gate within the specified time, the ticket information of the read attendee is cleared and the management screen is generated to notify that the clearing process has been carried out.

Images