Admission control system and admission control method

Abstract

To accurately determine whether or not a ticket of a type corresponding to person attributes of an entrant has been properly presented by the entrant so that an attendant can accurately confirm whether or not there are no irregularities in the admission.SOLUTION: An admission control system includes: a reader 13 that reads ticket information recorded on a ticket medium 6 in the possession of an entrant; cameras 2 and 3 that take photographs of the entrant; a control unit 4 that determines the consistency between the ticket information acquired by the reader and the person attributes of the entrant acquired by the image taken by the camera after confirming the presence of the entrant entering a gate within a predetermined time after the ticket information is read, and generates a management screen that includes information on the determination result; and a display 16 that displays the management screen generated by the control unit. In particular, the control unit generates the number of persons per ticket type and the number of persons per person attribute included in the ticket information as information on the determination result, and also generates inconsistency information to that effect if the ticket information and the person attributes are inconsistent as information on the determination result.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an attendee management system and an attendee management method for permitting admission of an attendee based on ticket information presented by the attendee. [Background technology]

[0002] When using public transport such as airplanes or trains, or when entering a facility such as a theme park, a user presents a ticket purchased in advance at the entrance gate (including boarding gates and ticket barriers) to check whether the visitor has paid the regular fare. However, there are cases where a visitor avoids paying the fare by entering in a line with more people than the number of tickets presented by the visitor, known as tailgating. In addition, an inexperienced visitor may perform an incorrect operation, resulting in an illegal entry. However, there is a limit to how much an attendant can visually check and respond to such illegal entries. For this reason, various technologies for preventing illegal entries have been proposed.

[0003] As a technology for preventing such illegal entry, a technology is known in the past that photographs visitors with a camera, counts the number of visitors, reads the authentication tags carried by the visitors with a reader, counts the number of authentication tags, and judges illegal entry (tailgating) by comparing the number of visitors with the number of authentication tags (see Patent Document 1). Also known is a technology that photographs visitors with a camera, counts the number of visitors, and authenticates the visitors using IC cards carried by the visitors or face recognition, obtains the number of authentications, and compares the number of visitors with the number of authentications to judge illegal entry (see Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-011597 A [Patent Document 2] JP 2008-134729 A Summary of the Invention [Problem to be solved by the invention]

[0005] Now, tickets are classified according to the personal attributes of visitors (adult, child, infant, etc.), and the fee paid varies depending on the type. For this reason, there are cases where visitors illegally enter an event using a ticket of a type different from the visitors' personal attributes. Therefore, it is necessary to check not only whether the number of visitors and the number of tickets match, but also whether the number of visitors for each personal attribute and the number of tickets for each type match. However, conventional technology simply compares the number of visitors with the number of tickets, and there is a problem in that it is not possible to check for fraudulent activity related to ticket types that correspond to the visitors' personal attributes.

[0006] Therefore, the main objective of the present invention is to provide an attendee management system and an attendee management method that can accurately determine whether an attendee has properly presented a ticket type corresponding to the attendee's personal attributes, allowing attendants to accurately check whether there is any fraudulent entry. [Means for solving the problem]

[0007] The attendee management system of the present invention is an attendee management system that allows an attendee to pass through a gate based on ticket information presented by the attendee, and comprises a reader that reads the ticket information of one or more attendees from a ticket medium held by the attendee near the entrance to the gate, a camera that acquires photographed images of one or more attendees entering the gate, an information processing device that acquires the photographed images of the attendees entering the gate, tracks the attendees entering the gate and recognizes their personal attributes, makes a determination regarding the consistency between the number of people for each ticket type contained in the ticket information and the number of attendees for each personal attribute staying within the gate acquired by the camera, and generates a management screen containing information regarding the determination results, and a display that displays the management screen generated by the information processing device, and the information processing device is configured to determine whether or not an attendee will enter the gate within a predetermined time from the reader reading the ticket information, and, depending on whether or not an attendee will enter the gate within the predetermined time, make a determination regarding the consistency based on the photographed images of the attendees or perform a clear process of the ticket information of the read attendee.

[0008] Furthermore, the attendee management method of the present invention is an attendee management method in which an information processing device executes processing related to allowing an attendee to pass through a gate based on ticket information presented by the attendee, and comprises the steps of: obtaining the ticket information of one or more attendees read by a reader from a ticket medium held by the attendee near the entrance to the gate; determining whether or not an attendee will enter the gate within a predetermined time from the reader reading the ticket information; if it is determined that there is an attendee entering the gate, obtaining photographic images of the one or more attendees entering the gate by a camera; tracking the attendees entering the gate using the photographic images of the attendees entering the gate and recognizing the personal attributes of the attendees; determining whether there is an attendee entering the gate based on the photographic images of the attendees entering the gate and recognizing the personal attributes of the attendees; Effect of the Invention

[0009] According to the present invention, after determining whether or not any entrants will enter the gate within a predetermined time from reading the ticket information, a determination is made as to the consistency between the number of people for each ticket type contained in the ticket information and the number of people for each personal attribute of entrants staying within the gate captured by a camera, a management screen containing information on the determination results is generated, and the management screen is displayed on a display. This makes it possible to accurately determine whether or not the entrant has properly presented a ticket type corresponding to the entrant's personal attributes, and allows staff to accurately check whether or not there has been any fraudulent entry. [Brief description of the drawings]

[0010] [Figure 1] Overall configuration of the visitor management system according to the present embodiment. [Diagram 2] FIG. 1 is an explanatory diagram showing an overview of a gate device 1, an upper camera 2, and a side camera 3. [Diagram 3] A block diagram showing the schematic configuration of a gate device 1 and a control device 4. [Figure 4] FIG. 1 is an explanatory diagram showing a management screen displayed on the attendant display 16 of the gate device 1. [Diagram 5] An explanatory diagram showing a specific example of a normal state [Figure 6] FIG. 11 is an explanatory diagram showing a specific example of an error state regarding people counting. [Figure 7] FIG. 11 is an explanatory diagram showing a specific example of an error state regarding people counting. [Figure 8] FIG. 11 is an explanatory diagram showing a specific example of an error state regarding people counting. [Figure 9] FIG. 13 is an explanatory diagram showing a specific example of an error state regarding an inconsistency between a ticket type and a person attribute. [Figure 10] FIG. 13 is an explanatory diagram showing a specific example of an error state regarding an inconsistency between a ticket type and a person attribute. [Figure 11] FIG. 1 is a flow chart showing the procedure of processing performed by the processor 33 of the control device 4. [Figure 12] FIG. 1 is a flow chart showing the procedure of processing performed by the processor 33 of the control device 4. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The first invention made to solve the above-mentioned problems is an attendee management system that allows an attendee to pass through a gate based on ticket information presented by the attendee, comprising: a reader that reads the ticket information of one or more attendees from a ticket medium held by the attendee near the entrance to the gate; a camera that acquires photographed images of one or more attendees entering the gate; an information processing device that acquires the photographed images of the attendees entering the gate, tracks the attendees entering the gate and recognizes their personal attributes, makes a determination regarding the consistency between the number of people for each ticket type contained in the ticket information and the number of attendees for each personal attribute staying within the gate acquired by the camera, and generates a management screen including information regarding the determination results; and a display that displays the management screen generated by the information processing device, wherein the information processing device is configured to determine whether or not an attendee will enter the gate within a predetermined time from the reader reading the ticket information, and, depending on whether or not an attendee will enter the gate within the predetermined time, make a determination regarding the consistency based on the photographed images of the attendees or perform a clear process of the ticket information of the read attendee.

[0012] According to this system, the system determines whether or not any visitors will enter the gate within a specified time from reading the ticket information, then determines whether the number of people for each ticket type included in the ticket information matches the number of people for each personal attribute of the visitors staying within the gate captured by the camera, generates a management screen including information on the determination results, and displays the management screen on the display. This allows an accurate determination of whether or not the visitor has properly presented a ticket type that corresponds to the person's personal attributes, allowing staff to accurately check whether there is any fraudulent entry.

[0013] In a second aspect of the present invention, the information processing device generates, as information relating to the determination result, the number of people for each ticket type and the number of people for each personal attribute included in the ticket information.

[0014] This allows staff to check the details of any unauthorized entry.

[0015] In a third aspect of the present invention, the information processing device is configured to generate, as information on the determination result, inconsistency information indicating that the ticket information and the person attribute do not match.

[0016] This allows staff to immediately confirm that the ticket presented by the visitor does not match the visitor's personal attributes.

[0017] In addition, in a fourth aspect of the present invention, the information processing device generates, as information on the determination result, information indicating that the person is in a tailgating state including at least one of a child and an infant.

[0018] This allows visitors to inform staff that they are accompanied by a child or infant.

[0019] In addition, in a fifth invention, the information processing device is configured to detect a young child being held by an adult based on an image captured by the camera, and generate information indicating that the young child is being held as information related to the determination result.

[0020] This allows passengers to be notified that there is a small child being held by an adult.

[0021] In a sixth aspect of the present invention, the information processing device generates the management screen having a playback button for instructing playback of an image captured by the camera.

[0022] This allows staff to instantly check the actual situation of visitors using images captured by the camera.

[0023] Further, a seventh invention is an entrant management method in which an information processing device executes a process related to allowing an entrant to pass through a gate based on ticket information presented by the entrant, the method comprising the steps of: obtaining the ticket information of one or more entrants read by a reader from a ticket medium held by the entrant near the entrance to the gate; determining whether or not an entrant will enter the gate within a predetermined time from the reader reading the ticket information; if it is determined that there is an entrant entering the gate, obtaining photographic images of the one or more entrants entering the gate by a camera; tracking the entrant entering the gate using the photographic images of the entrants entering the gate and recognizing the personal attributes of the entrants; determining whether there is an entrant entering the gate based on the photographic images of the entrants entering the gate; determining whether there is an entrant entering the gate based on the photographic images of the entrants entering the gate;

[0024] As with the first invention, this allows for accurate determination of whether or not a entrant has properly presented a ticket type corresponding to the entrant's personal attributes, allowing staff to accurately check whether there has been any fraudulent entry.

[0025] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0026] FIG. 1 is a diagram showing the overall configuration of an attendee management system according to this embodiment.

[0027] This visitor management system allows passengers (entrants) to board (enter) based on the ticket (boarding pass) presented by the passenger (entrant) at the airport boarding gate (entrance gate), and is equipped with a gate device 1, an upward camera 2 (first camera), a side camera 3 (second camera), a control device 4 (information processing device), an attendant terminal 5 (terminal device), and a ticket medium 6.

[0028] The gate device 1 is a so-called ticket gate and is installed to restrict entry to the boarding passage leading to the aircraft. The gate device 1 verifies the tickets presented by passengers, that is, checks the authority of users to board the aircraft.

[0029] The upper camera 2 and the side camera 3 are installed near the gate device 1. The upper camera 2 photographs passengers passing through the gate device 1 from above. The side camera 3 photographs passengers passing through the gate device 1 from the side.

[0030] The control device 4 performs processes related to visitor management. This control device 4 can communicate with the gate device 1, the upper camera 2, the side camera 3, and the staff terminal 5 via a communication path such as an on-site network installed in the airport. The control device 4 can also communicate with a higher-level system device 7 via a communication path such as an on-site network.

[0031] The host system device 7 constitutes a host system (airport management system) to which this visitor management system is attached, and manages passenger ticket information and provides the passenger ticket information to the control device 4.

[0032] The attendant terminal 5 is carried by an attendant and is configured with a tablet terminal, a smartphone, etc. On this attendant terminal 5, a management screen related to the status of the gate device 1, the status of passengers passing through the gate device 1, etc. is displayed.

[0033] The ticket medium 6 is carried by the passenger and records the passenger's ticket information. Specifically, it is an IC card or a smartphone equipped with an IC chip storing the ticket information, a piece of paper on which a two-dimensional barcode is drawn, or a smartphone displaying a two-dimensional barcode on its screen. The passenger's ticket information recorded on the ticket medium 6 is provided to the control device 4 via the gate device 1.

[0034] In this embodiment, a system targeting boarding gates at airports will be described, but the present invention is not limited to boarding gates at airports. The system may also target entrance gates (ticket gates) that restrict entry to boarding areas of vehicles (platforms at railway stations, etc.) at facilities (railroad stations, bus terminals, boarding points, etc.) of other public transportation facilities (railroads, buses, ships, etc.). Furthermore, in addition to those that restrict entry to boarding areas of transportation facilities, the system may also target entrance gates installed in other facilities, such as gates that restrict entry to theme parks.

[0035] In this embodiment, a control device 4 (PC) is provided to perform processes related to visitor management, but this control device 4 may be installed in a facility (such as an airport) where the gate device 1 is installed, or may be configured as a cloud computer (information processing device). In this case, the gate device 1, the upper camera 2, and the side camera 3 may be configured to communicate with the cloud computer via a wide area network (such as the Internet).

[0036] Next, a description will be given of the gate device 1, the upper camera 2, and the side camera 3. Fig. 2 is an explanatory diagram showing an overview of the gate device 1, the upper camera 2, and the side camera 3.

[0037] The gate device 1 has a pair of left and right main bodies 11, with an internal gate passage 12 formed between them. A plurality of people can enter this internal gate passage 12 at the same time. In this embodiment, in principle, passengers pass through the internal gate passage 12 one at a time, and when an adult is accompanied by a child or infant, two people are allowed to pass through at the same time. Therefore, although the upper limit of the number of people who can pass through the internal gate passage 12 at the same time is two, two adults are not allowed to pass through at the same time.

[0038] A reader 13 is provided on the entrance side of the main body 11. This reader 13 reads ticket information from the ticket medium 6 carried by the passenger. In this embodiment, the reader 13 has the functions of both an IC card reader and a two-dimensional barcode reader, and operates as an IC card reader when a passenger holds an IC card over the reader, and operates as a two-dimensional barcode reader when a passenger holds a two-dimensional barcode over the reader.

[0039] In addition, a photoelectric sensor 14 (optical passage sensor) is provided on the entrance side of the main body 11. Based on the detection result of this photoelectric sensor 14, it is possible to accurately detect that a person (object) has entered the internal-gate passage 12. In addition, by providing multiple photoelectric sensors 14 above and below, it is possible to determine whether the height of the person who has entered the internal-gate passage 12 is higher or lower than a predetermined value, and thus it is possible to determine whether the person who has entered the internal-gate passage 12 is an adult or a dwarf.

[0040] In addition, a passenger display 15 is provided on the entrance side of the main body 11. This passenger display 15 can be viewed by passengers. This passenger display 15 displays a guidance screen that notifies passengers of information such as the flight number and destination currently being announced.

[0041] An attendant display 16 is provided on the exit side of the main body 11. This attendant display 16 can be viewed by an attendant. This attendant display 16 displays a management screen that notifies the attendant of information such as the status of the gate device 1 and the status of passengers passing through the gate device 1.

[0042] A door 17 (flap door) that can be opened and closed is provided on the exit side of the main body 11. If the ticket presented by the passenger is not fraudulent and the user is allowed to pass, the door 17 opens and the user can pass through the intra-gate passage 12. If the ticket presented by the passenger is fraudulent and the user's passage is restricted, the door 17 remains closed and the user is unable to pass through the intra-gate passage 12 and is forced to turn back.

[0043] An upper camera 2 is provided above the main body 11. This upper camera 2 is an omnidirectional camera that captures the gate passage 12 and its surroundings from above. The image captured by this upper camera 2 captures a person's head, and by detecting the head from the captured image using image recognition technology, it is possible to accurately detect a person who has entered the gate passage 12. For example, it is possible to detect without fail even when multiple people are lined up side by side or when multiple people's bodies are closely pressed together vertically. It is also possible to detect parents and children who are carried on the back of an adult.

[0044] In addition, a side camera 3 is provided above the main body 11. This side camera 3 is a wide-angle camera that photographs the inner-gate passage 12 and its surroundings from the side. An infant being held is captured in the image captured by this side camera 3, and an infant being held can be detected with high accuracy using image recognition technology.

[0045] Next, a description will be given of the schematic configuration of the gate device 1 and the control device 4. Fig. 3 is a block diagram showing the schematic configuration of the gate device 1 and the control device 4.

[0046] The gate device 1 includes a reader 13, a photoelectric sensor 14, a passenger display 15, an attendant display 16, a door 17, a drive unit 18, a communication unit 21, a memory 22, and a processor 23.

[0047] The drive unit 18 drives the door 17 to open or close in response to an opening or closing command from the processor 23 .

[0048] The communication unit 21 communicates with the control device 4. Specifically, the communication unit 21 transmits passenger ticket information acquired from the ticket medium 6 by the reader 13 and detection information from the photoelectric sensor 14 to the control device 4. In addition, the communication unit 21 receives display information of the passenger display 15 and the attendant display 16 and control information for the door 17 from the control device 4.

[0049] The memory 22 stores a program executed by the processor 23 .

[0050] The processor 23 performs various processes by executing the programs stored in the memory 22. In this embodiment, the processor 23 controls the passenger display 15 and the attendant display 16 to display various screens. The processor 23 also controls the reader 13 to obtain ticket information from the ticket medium 6.

[0051] The gate device 1 may be provided with a speaker to output voice guidance and warnings to passengers and staff.

[0052] The control device 4 includes a communication unit 31 , a memory 32 , and a processor 33 .

[0053] The communication unit 31 communicates with the gate device 1, the upper camera 2, the side camera 3, and the attendant terminal 5. Specifically, it receives captured images from the upper camera 2 and the side camera 3. It also receives ticket information read by the reader 13 of the gate device 1 from the gate device 1. It also transmits display information of the passenger display 15 and the attendant display 16 of the gate device 1 to the gate device 1.

[0054] The memory 32 stores a program executed by the processor 33. It also accumulates boarding passenger information acquired from the upper system device 7. This boarding passenger information is ticket information of passengers who are scheduled to board a flight departing from a target boarding gate. It also accumulates captured images received from the upper camera 2 and the side camera 3.

[0055] Before boarding guidance begins at the boarding gate, ticket information of passengers scheduled to board the flight in question may be acquired from the host system device 7 and stored in the memory 32 .

[0056] The processor 33 performs various processes by executing the programs stored in the memory 32. In this embodiment, the processor 33 performs each process of ticket tallying, person tracking, target person detection, dwarf detection, infant detection, person tallying, consistency determination, boarding permission determination (entry permission determination), gate control, and staff notification.

[0057] In the ticket tallying process, the number of tickets read, i.e., the number (total number) of tickets presented by passengers, is counted based on the ticket information obtained from the ticket medium 6 by reading with the reader 13. In addition, the number of people (breakdown) for each ticket type is obtained based on the ticket type included in the ticket information.

[0058] Here, passengers are issued different types of tickets according to their personal attributes. In this embodiment, three personal attributes and ticket types are set: adult, child, and infant. An infant is, for example, a person under the age of three, and does not need to pay a fare. A child is, for example, a person over the age of three and less than 120 cm tall, and pays the child fare. An adult is a person who does not fall under the category of either an infant or a child, and pays the adult fare.

[0059] In the person tracking process, people are detected from the image captured by the upper camera 2, the people are tracked, and position information of each person at each time is output as person tracking information.

[0060] In the target person detection process, based on the person tracking information acquired in the person tracking process and the detection results of the photoelectric sensor 14, it is determined whether or not the target person, i.e., a person who has entered the gate passage 12, is among the people being tracked.

[0061] In the dwarf detection process, a dwarf (child), that is, a person who is walking by himself and whose height is shorter than a predetermined value (for example, 120 cm), is detected. Specifically, based on the detection result of the photoelectric sensor 14, it is determined whether the height of the person who entered the inner gate passage 12 is shorter than a predetermined value. In addition, based on the images captured by the upper camera 2 and the side camera 3, the height of the person is estimated. Then, the determination result and the estimation result regarding the person's height are integrated to determine whether the person who entered the inner gate passage 12 is an adult or a dwarf. Note that, as the dwarf detection process, an example in which the detected height is compared with a predetermined value has been given here, but in the dwarf detection process, a classifier that has been trained in advance into two classes, dwarf and other than dwarf, by deep learning can be used. In the dwarf detection process, the classifier calculates the likelihood (probability) of the detected person image as a dwarf and the likelihood of other than a dwarf, and compares the two likelihoods to determine whether the person is a dwarf or other than a dwarf.

[0062] In the infant detection process, an infant being held, i.e., an infant being held by an adult, is detected based on the image captured by the side camera 3, and infant detection information is output. In this infant detection process, an infant being held is detected by focusing on an infant holder (infant carrier) such as a baby sling. There are also cases where an adult holds an infant in their arms without using an infant holder, and such an infant being held is also detected. There are infant holders that hold an infant facing forward, backward, or sideways. Even when an infant holder is not being used, the infant may be in an upright position or lying on its side.

[0063] In addition, since the head of an infant being carried on someone's back can be detected from the image captured by upper camera 2, the infant can be detected as a person by person tracking processing based on the image captured by upper camera 2. Furthermore, by combining this with the entry information (entry of one adult) from photoelectric sensor 14, the accuracy of detection of an infant being carried on someone's back can be improved. In this case, the infant is not counted as an infant, so a mismatch occurs between the ticket type and person attributes, resulting in an error state, but an attendant visually checks the ticket and, if there are no problems, performs an operation to allow passage.

[0064] In the person counting process, the number of people being tracked within the gate is counted based on the person tracking information acquired in the person tracking process, that is, the number (total number) of people in the passageway 12 within the gate among the people being tracked using the image captured by the upper camera 2. In addition, in the infant detection process, if an infant being held is detected from the image captured by the side camera 3, the number of infants is added to the number of people being tracked within the gate to calculate the number of people remaining within the gate. In addition, in the child detection process, if a child is detected, the number of children is subtracted from the number of people being tracked within the gate to obtain the number of adults. In this way, the total number of people remaining within the gate and its breakdown, that is, the number of people by person attribute (adults, children, infants) can be obtained.

[0065] In the consistency determination process, the number of tickets read in the ticket counting process is compared with the number of people within the gate obtained in the person counting process to determine whether the two match. Specifically, if the number of tickets read and the number of people within the gate match in both total number and breakdown, the two are determined to match. In other words, if the number of people for each ticket type (adult, child, infant) and the number of people for each person attribute (adult, child, infant) match, the two are determined to match. Also, if the number of people within the gate is greater than the number of tickets read, it is determined that the people are tailgating.

[0066] In the boarding permission determination process, if the number of tickets read and the number of people in the gate are consistent in the consistency determination process, the ticket information presented by the passenger is compared with the ticket information of the passenger being guided to board to determine whether or not to permit boarding (ticket gate process). Note that the ticket information of the passenger being guided to board is obtained from the upper system device 7.

[0067] In the gate control process, the opening and closing of the door 17 is controlled according to the result of the boarding permission determination process. That is, if boarding is permitted, the door 17 opens, and if boarding is not permitted, the door 17 remains closed.

[0068] In the attendant notification process, information relating to the determination result in the consistency determination process is notified to the attendant. In this embodiment, a management screen including information relating to the determination result in the consistency determination process is generated, and the management screen is displayed on the attendant display 16 of the gate device 1. Also, in response to an instruction from the attendant, images captured by the upper camera 2 and the side camera 3 are displayed on the attendant display 16. Note that audio relating to the determination result in the consistency determination process may be output from a speaker provided in the gate device 1.

[0069] Furthermore, in the staff notification process, a management screen similar to the management screen displayed on the staff display 16 of the gate apparatus 1 is displayed on the staff terminal 5. This staff terminal 5 may display the same management screen as the management screen displayed on the staff display 16 of the gate apparatus 1, or may display information related to a plurality of gate apparatuses 1 installed at the boarding gate together on one screen.

[0070] Next, there will be described a management screen displayed on the attendant display 16 of the gate apparatus 1. FIG.

[0071] The management screen is provided with a read ticket number display section 41 and a gate number of people display section 42. The read ticket number display section 41 displays the number of tickets read for each ticket type (adult, child, infant). The gate number of people display section 42 displays the number of people staying within the gate for each person attribute (adult, child, infant).

[0072] This management screen also has the words "visual confirmation" 44 and a playback button 45. Operating the playback button 45 transitions to a playback screen (not shown). On this playback screen, the captured image including the target person is played back. The captured image can be displayed as a video.

[0073] Furthermore, if an error occurs, that is, if the consistency determination process determines that the number of read tickets and the number of people inside the gate do not match, an error message 43 is displayed. This error message 43 differs depending on the type of the inconsistency.

[0074] In addition, in the case of an error, the word "visual check" 44 is highlighted. Specifically, the word "visual check" 44 changes to a predetermined color (e.g., red). This makes it possible to prompt the staff member to visually check the status of the person passing through the gate.

[0075] In the event of an error, an alert mark 46 is displayed on the management screen. This allows a staff member to be quickly notified that there is a discrepancy between the number of tickets read and the number of people inside the gate, i.e., that a passenger is attempting to board illegally.

[0076] Next, specific examples of normal and error states will be described. Fig. 5 is an explanatory diagram showing a specific example of a normal state. Figs. 6, 7, and 8 are explanatory diagrams showing specific examples of error states related to people counting. Figs. 9 and 10 are explanatory diagrams showing specific examples of error states related to inconsistencies between ticket types and person attributes. Here, (A-1), (A-2), (A-3), and (A-4) in each figure show the number of tickets read and the total number and details of people staying within the gate. Also, (B-1), (B-2), (B-3), and (B-4) in each figure show the management screen displayed on the attendant display 16.

[0077] Each example shown in Fig. 5 is a normal case, and there is no inconsistency in both the total number and the breakdown of the number of tickets read and the number of people in the gate. In other words, the total number of tickets read matches the total number of people in the gate, and further, the number of tickets read by each ticket type matches the number of people in the gate by each person attribute.

[0078] The examples shown in Figures 6, 7, and 8 are cases of errors in people counting, where there is a mismatch between the number of tickets read and the total number of people in the gate. In other words, the total number of tickets read does not match the total number of people in the gate.

[0079] In particular, the examples shown in Figures 6 and 7 are for cases where the total number of people inside the gate is greater than the total number of tickets read, i.e., cases of tailgating. In this case, the management screen displays an error message of "tailgating" as inconsistency information. Furthermore, if a child being carried is detected, the management screen displays an error message of "tailgating with child being carried" as inconsistency information, as shown in Figures 6 (B-3) and 7 (B-3).

[0080] 8 shows an example in which the total number of people staying within the gate is less than the total number of tickets read. In this case, an error message "Ticket inconsistency" is displayed on the management screen as inconsistency information.

[0081] The examples shown in Figures 9 and 10 are cases where the error is related to a mismatch between ticket type and person attributes, and while there is no mismatch in the total number between the number of tickets read and the number of people inside the gate, there is a mismatch in the breakdown. In other words, the number of tickets read by ticket type does not match the number of people inside the gate by person attribute. In this case, the management screen displays the error message "Ticket mismatch" as the mismatch information.

[0082] Furthermore, if a ticket type corresponding to the passenger's personal attributes is not properly presented, particularly if tickets for all persons entering the gate passage 12 are not presented, an error state will occur in which the total number of people within the gate is greater than the total number of tickets read, as shown in the examples in Figures 6 and 7.

[0083] Furthermore, if person tracking using images captured by upper camera 2 fails, or if child detection using images captured by side camera 3 fails, the number of people inside the gate will be less than the actual number, resulting in an error state in which the total number of people inside the gate is less than the total number of tickets read, as in the examples shown in Fig. 8. In particular, the example shown in Fig. 8(A-1) is a case where child person tracking has failed, and the example shown in Fig. 8(A-2) is a case where child detection has failed.

[0084] In addition, in the case of a child being carried on someone's back, the child is detected as an adult by person tracking using the image captured by the upper camera 2, and so an exchange between the adult and the child occurs, as in the example shown in FIG. 9(A-1). In addition, when a child is carried by an adult, an exchange between the child and the child occurs, as in the example shown in FIG. 9(A-2). In addition, when child detection using the detection result of the photoelectric sensor 14 fails, an exchange between the adult and the child occurs, as in the examples shown in FIG. 9(A-3), (A-4), and FIG. 10. As described above, the piggyback state can be detected with high accuracy by combining the tracking information from the image captured by the upper camera 2 and the entry information from the photoelectric sensor 14, so it is possible to determine whether or not a change has occurred, taking the piggyback state into consideration.

[0085] 4 to 10 are displayed on the attendant display 16 of the gate device 1, and similar management screens are also displayed on the display of the attendant terminal 5. In FIG.

[0086] Next, a description will be given of the procedure of the process performed by the processor 33 of the control device 4. Fig. 11 and Fig. 12 are flow charts showing the procedure of the process performed by the processor 33 of the control device 4.

[0087] When a passenger holds the ticket medium 6 over the reader 13 at the gate device 1, the processor 33 of the control device 4 obtains the ticket information read from the ticket medium 6 by the reader 13 from the gate device 1 (Yes in ST101), and then determines whether a person (object) has entered the gate passage 12 based on the detection result of the photoelectric sensor 14 (ST102).

[0088] If no person has entered the inner-gate passage 12 (No in ST102), it is determined whether a predetermined time has elapsed since the ticket was read (ST103).

[0089] Here, if a predetermined time has passed since the ticket was read (Yes in ST103), that is, if the passenger holds up the ticket medium 6 but turns back without entering the gate passage 12, a read clear process is executed (ST104). In this read clear process, the ticket information is erased. Also, a management screen is displayed on the attendant display 16 to notify the attendant that the read clear process has been executed. Also, control is performed to close the door 17.

[0090] On the other hand, if the predetermined time has not passed since the ticket was read (No in ST103), the process returns to ST102.

[0091] If a person has entered the gate internal passage 12 (Yes in ST102), then person tracking information is acquired based on the image captured by the upper camera 2 (ST105). Then, based on the person tracking information, it is determined whether or not the person being tracked is a target person, i.e., a person who has entered the gate internal passage 12 (ST106).

[0092] If the target person does not exist (No in ST106), the process proceeds to ST103.

[0093] On the other hand, if a target person is present (Yes in ST106), then it is determined whether or not there is a dwarf among the target people (ST107).

[0094] If there is a dwarf among the target persons (Yes in ST107), then it is determined whether or not there is a dwarf ticket among the target tickets, that is, the tickets currently being processed (ST108).

[0095] If there is no child ticket among the target tickets (No in ST108), the ticket type and person attributes do not match, so a ticket inconsistency process is executed (ST117). In this ticket inconsistency process, a management screen in an error state is displayed on the attendant display 16. Also, control is performed to close the door 17.

[0096] On the other hand, if there is no dwarf among the target people (No in ST107) or if there is a dwarf ticket among the target tickets (Yes in ST108), then the number of people being tracked who are in passage 12 inside the gate (number of people being tracked inside the gate) is counted (ST109). Then, it is determined whether the number of tickets read is equal to or greater than the number of people being tracked inside the gate (ST110).

[0097] Here, if the number of read tickets is not equal to or greater than the number of people to be tracked within the gate (No in ST110), that is, if there are more people in the gate passage 12 than the number of tickets read, then a tailgating notification process is executed (ST118). In this tailgating notification process, a management screen is displayed on the attendant display 16 to notify the attendant that tailgating has been detected. Also, control is performed to close the door 17.

[0098] On the other hand, if the number of read tickets is equal to or greater than the number of people being tracked within the gate (Yes in ST110), then child detection information is acquired (ST111). Then, based on the child detection information, it is determined whether or not there is a child among the target people (ST112).

[0099] If there are no small children among the target persons (No in ST112), it is then determined whether the number of read tickets matches the number of people being tracked within the gate (ST113).

[0100] If the number of tickets read does not match the number of people being tracked inside the gate (No in ST112), a process to check whether there are enough people is executed (ST119). In this process, a management screen is displayed on the attendant display 16 to notify the attendant that there is a shortage of people. In addition, the gate 17 is controlled to close.

[0101] On the other hand, if the number of read tickets matches the number of people being tracked inside the gate (Yes in ST113), a passing process is executed (ST120). In this passing process, control is performed to open the door 17.

[0102] If a child is present among the target persons (Yes in ST112), it is then determined whether or not there is a child ticket among the target tickets (ST114).

[0103] If there is no child ticket among the target tickets (No in ST114), a ticket mismatch process is executed (ST117). In this ticket mismatch process, a management screen showing an error state is displayed on the attendant display 16. Also, control is performed to close the door 17.

[0104] On the other hand, if the read tickets include an infant ticket (Yes in ST114), the number of people within the gate is calculated by adding the number of infants being carried to the number of people being tracked within the gate (ST115). Then, it is determined whether the number of read tickets matches the number of people within the gate (ST116).

[0105] If the number of tickets read does not match the number of people inside the gate (No in ST116), tailgating processing is executed. In this tailgating processing, a management screen is displayed on the attendant display 16 to notify the attendant that tailgating has been detected. Also, control is performed to close the door 17.

[0106] On the other hand, if the number of read tickets matches the number of people inside the gate (Yes in ST116), a passing process is executed (ST120). In this passing process, control is performed to open the door 17.

[0107] As described above, the embodiments have been described as examples of the technology disclosed in this application. However, the technology in this disclosure is not limited to these, and can be applied to embodiments in which modifications, substitutions, additions, omissions, etc. are made. In addition, it is also possible to combine the components described in the above embodiments to create new embodiments. [Industrial Applicability]

[0108] The attendee management system and attendee management method of the present invention have the effect of accurately determining whether an attendee has properly presented a ticket type that corresponds to the attendee's personal attributes, allowing staff to accurately check whether there is any fraudulent entry, and are useful as an attendee management system and attendee management method that permits entry of an attendee based on the ticket information presented by the attendee. [Explanation of symbols]

[0109] 1 Gate device 2 Upward Camera 3 Side Camera 4. Control device (information processing device) 5. Staff terminal 6 Ticket media 7. Host system device 11 Main unit 12 Passage inside the gate 13 Leader 14 Photoelectric Sensor 15 Passenger Display 16 Staff Display 41 Number of tickets read display unit 42 Number of people staying within the gate 45 Play button 46 Alert Mark

Claims

1. An visitor management system that allows a visitor to pass through a gate based on ticket information presented by the visitor, a reader for reading the ticket information of one or more visitors from a ticket medium carried by the visitor near the entrance of the gate; A camera for capturing images of one or more visitors entering the gate; an information processing device that acquires the captured image of a visitor entering the gate, tracks the visitor entering the gate, recognizes the personal attributes of the visitor, determines whether the number of people for each ticket type included in the ticket information matches the number of people for each personal attribute of the visitor staying within the gate acquired by the camera, and generates a management screen including information related to the determination results; a display that displays the management screen generated by the information processing device; The information processing device includes: determining whether or not an entrant will enter the gate within a predetermined time from when the reader reads the ticket information; An attendee management system characterized by performing a determination regarding the consistency based on the photographed image of the attendee or a clearing process of the ticket information of the read attendee depending on whether or not an attendee enters the gate within the specified time.

2. The information processing device includes: The attendee management system according to claim 1, characterized in that the information regarding the judgment result is generated by generating the number of attendees for each ticket type included in the ticket information and the number of attendees for each of the personal attributes.

3. The information processing device includes:

2. The attendee management system according to claim 1, wherein, if there is a mismatch between the ticket information and the person attributes, inconsistency information to that effect is generated as information regarding the determination result.

4. The information processing device includes:

2. The visitor management system according to claim 1, wherein the information regarding the determination result is information indicating that the person is in a tailgating state including at least one of a child and an infant.

5. The information processing device includes: Detecting a child being held by an adult based on an image captured by the camera; 2. The visitor management system according to claim 1, wherein information indicating that a small child is being held is generated as information regarding the determination result.

6. The information processing device includes:

2. The visitor management system according to claim 1, further comprising: a playback button for instructing playback of images captured by the camera.

7. An attendee management method in which an information processing device executes a process for permitting an attendee to pass through a gate based on ticket information presented by the attendee, comprising: acquiring the ticket information of one or more visitors read by a reader from a ticket medium carried by the visitor near the entrance of the gate; determining whether or not an entrant will enter the gate within a predetermined time from when the reader reads the ticket information; When it is determined that there is an entrant entering the gate, a photographed image of one or more entrants entering the gate is acquired by a camera; Tracking the entrant entering the gate based on the captured image of the entrant entering the gate and recognizing personal attributes of the entrant; A determination is made as to the consistency between the number of people for each ticket type included in the ticket information and the number of people for each personal attribute of the visitors staying within the gate acquired by the camera; generating a management screen including information related to the determination result, and displaying the management screen on a display; The attendee management method is characterized in that, when it is determined that no attendee is entering the gate, a process of clearing the ticket information of the read attendee is executed.

Images