Traffic control device

The traffic control device addresses the issue of conventional ticket gates failing to detect users in low positions by using a camera and processor to analyze user posture and height sensors to ensure accurate adult detection.

JP7664880B2Active Publication Date: 2025-04-18KK TOSHIBA
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2022065218
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-04-11
Publication Date
2025-04-18
Estimated Expiration
2042-04-11

AI Technical Summary

Technical Problem

Conventional automatic ticket gates rely on height measurement sensors to determine if a user is an adult, but they fail to detect users who intentionally pass through in a low height position.

Method used

A traffic control device equipped with a camera that captures images of users passing through the passageway, a processor that determines the attitude and posture of the user based on the images, and height sensors to detect the user's height, ensuring accurate detection of adult users.

Benefits of technology

The device effectively detects users passing through in a constant or normal posture, preventing fraudulent use of child tickets by ensuring accurate height measurement and posture analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007664880000001
    Figure 0007664880000001
  • Figure 0007664880000002
    Figure 0007664880000002
  • Figure 0007664880000003
    Figure 0007664880000003
Patent Text Reader

Abstract

To provide a passage controller that can detect a passage status of a person.SOLUTION: According to an embodiment, a passage controller has an interface and a processor. The interface acquires a captured image from a camera that captures an image of a captured area including a passageway. The processor determines the posture of a passer-by passing through the passageway based on an image of the passer-by extracted from the captured image captured by the camera.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] FIELD An embodiment of the present invention relates to a traffic control device. [Background technology]

[0002] An automatic ticket gate device as a passage control device installed at each station of a transportation facility such as a railway is equipped with a height measurement sensor for determining whether or not a user passing through the ticket gate passage is an adult. When detecting the height of a user using a height measurement sensor, it is considered to increase the accuracy of determining whether or not the user is an adult by installing multiple height measurement sensors in the passage.

[0003] However, conventional automated ticket gates use height measurement sensors to determine the height of users, assuming that the users will walk through the passage in a natural posture. Therefore, if a user intentionally walks through the passage in a short posture, the conventional automated ticket gates cannot detect the user as an adult. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2013-69090 A Summary of the Invention [Problem to be solved by the invention]

[0005] In order to solve the above problems, an object of the present invention is to provide a traffic control device capable of detecting the passing state of people. [Means for solving the problem]

[0006] According to an embodiment, the passage control device includes an interface and a processor. The interface acquires a captured image from a camera that captures an image of a capture area including a passage. The processor determines a posture of a pedestrian passing through the passage based on an image of the pedestrian extracted from the captured image captured by the camera. The processor calculates posture features of the pedestrian from images captured by the camera each time the pedestrian passes through a specified number of detection positions, and if the change in the posture features of the pedestrian after passing through a specified number of detection positions is within an acceptable range, it determines that the pedestrian has passed through the passage in a constant posture, and if the change in the posture features of the pedestrian after passing through a specified number of detection positions exceeds the acceptable range, it determines that the pedestrian has passed through the passage while changing his / her posture. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a ticket gate system including a ticket gate as a passage control device according to an embodiment. [Diagram 2] FIG. 2 is a side view showing an example of the external appearance of a ticket gate as a passage control device according to an embodiment, on the passage side. [Diagram 3] FIG. 3 is a diagram showing an example of setting a detection position by a height sensor serving as a height measurement sensor installed in a ticket gate as a passage control device according to the embodiment. [Figure 4] FIG. 4 is a block diagram showing an example of the configuration of a control system in a ticket gate as a passage control device according to the embodiment. [Diagram 5] FIG. 5 is a flowchart for explaining an example of the operation of a ticket examination process (passage control process) by a ticket examiner serving as a passage control device according to the embodiment. [Figure 6] FIG. 6 is a diagram for explaining examples of postures of a user when passing through a passage of a ticket gate as a passage control device according to an embodiment. [Figure 7] FIG. 7 is a diagram for explaining examples of postures of a user when passing through a passage of a ticket gate as a passage control device according to an embodiment. [Figure 8] FIG. 8 is a flowchart for explaining a processing example as a first operation example of a posture determination process in a ticket gate as a passage control device according to the embodiment. [Figure 9] FIG. 9 is a diagram for illustrating a second operation example of the attitude determination process in a ticket gate as a passage control device according to an embodiment. [Figure 10]FIG. 10 is a flowchart for explaining a processing example as a second operation example of the attitude determination processing in a ticket gate as a passage control device according to the embodiment. [Figure 11] FIG. 11 is a diagram for explaining a specific example of the attitude determination process according to the second operation example in the ticket gate as the passage control device according to the embodiment. [Figure 12] FIG. 12 is a diagram for explaining a specific example of the attitude determination process according to the second operation example in the ticket gate as the passage control device according to the embodiment. [Figure 13] FIG. 13 is a flowchart for explaining a processing example as a third operation example of the attitude determination processing in a ticket gate as a passage control device according to the embodiment. [Figure 14] FIG. 14 is a diagram for explaining the attitude determination process of the third operation example by the ticket gate as the passage control device according to the embodiment. [Figure 15] FIG. 15 is a diagram for explaining the attitude determination process of the third operation example by the ticket gate as the passage control device according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, embodiments will be described with reference to the drawings. FIG. 1 is a diagram showing an outline of the overall configuration of a ticket gate system 1 including a ticket gate 13 as a passage control device according to an embodiment. The ticket gate system 1 is a system that connects ticket gates 13 installed at the ticket gates of each station. In the configuration example shown in Fig. 1, the ticket gate system 1 includes a server 11, a monitoring panel 12, and ticket gates 13. For example, the server 11 is connected to the monitoring panel 12 installed for each monitored object such as a ticket gate or a station. A plurality of ticket gates 13 installed at the ticket gates of each station are connected to the monitoring panel 12 of each station.

[0009] The server 11 is connected to the monitoring panel 12 via a network. The server 11 supplies the monitoring panel 12 with information to be provided to each ticket gate 13. The server 11 may also obtain, via the monitoring panel 12, information indicating the operating status of each ticket gate 13, information indicating the results of the ticket gate processing at each ticket gate 13, and the like.

[0010] The monitoring panel 12 is connected to the server 11 and to a plurality of ticket gates 13. The monitoring panel 12 is connected to, for example, the ticket gates 13 installed at the ticket gates to be monitored. The monitoring panel 12 includes an operation panel having a display unit and an operation unit. The monitoring panel 12 monitors the operation status of each connected ticket gate 13, and displays information indicating the status of each ticket gate 13 on the display unit. The monitoring panel 12 also remotely supplies operation instructions to each ticket gate 13 by an attendant operating the operation unit. For example, the monitoring panel 12 sets the operation mode of each ticket gate 13 according to the attendant's operation instructions. The monitoring panel 12 also has a function of distributing information supplied from the server 11 to each ticket gate 13.

[0011] Each ticket gate 13 is an example of a passage control device. Each ticket gate 13 is installed at the ticket gate of each station, and executes ticket gate processing (entrance processing and exit processing) at the ticket gate. The server 11, the monitoring panel 12, and the ticket gate 13 constitute a ticket gate system that realizes ticket gate processing at the ticket gate of a station or the like. The ticket gate 13 switches operation modes in response to instructions from the monitoring panel 12, and executes ticket gate processing using information from the monitoring panel 12.

[0012] In the following description, the ticket gate 13 as a passage control device according to this embodiment performs ticket gate processing based on a contactless IC card held by a user (passenger). However, the ticket medium (hereinafter simply referred to as a ticket) that the ticket gate 13 processes as a ticket may be any medium on which information that can be read by the ticket gate 13 is recorded.

[0013] For example, the ticket medium may be a magnetic recording medium (magnetic ticket) in which information is recorded in a magnetic recording portion, a recording medium (code ticket) that records (prints or displays) coded information such as a two-dimensional code, a contactless IC card that transmits and receives information via contactless communication, a mobile terminal such as a mobile phone that has functions similar to a contactless IC card, or a mobile terminal that displays coded information such as a two-dimensional code.

[0014] Next, the configuration of the ticket gate 13 as the passage control device according to the embodiment will be described. FIG. 2 is a side view that shows a schematic configuration example of a ticket gate 13 as a passage control device according to the embodiment. For example, two ticket gates 13 form one ticket gate (entry or exit) passage in a set. The ticket gates 13 may be used as dedicated entry or exit machines that can pass through the ticket gate passage in only one direction, or as dual-purpose machines that can pass through the ticket gate passage in both directions. For example, the ticket gates 13 are set in advance as either dedicated entry machines, dedicated exit machines, or dual-purpose machines.

[0015] In the configuration example shown in Fig. 2, the ticket gate 13 has a housing 30 that forms an entrance or exit passage. The housing that forms the ticket gate 13 is provided with a ticket processing unit (passenger ticket processing unit) 32 that performs ticket processing such as reading information from a ticket held by a user. A reading unit (communication unit) of the ticket processing unit 32, through which the user presents the ticket, is provided at one end (the end on the entrance side) of the top surface of the housing 30 that forms the ticket gate 13. The ticket processing unit 32 reads information recorded on an IC card that the user presents to the reading unit as a ticket.

[0016] For example, the ticket processing unit 32 includes a card reader / writer that reads information from an IC card presented by a user as a passenger ticket to a specified reading unit. The ticket processing unit 32 may also include a device that processes media other than IC cards used as passenger tickets. For example, the ticket processing unit 32 may be configured to include a magnetic ticket processing unit that processes magnetic tickets having ticket information recorded in a magnetic recording unit. The ticket processing unit 32 may also be configured to include a code reader that reads code information from a medium on which code information as passenger ticket information is printed.

[0017] A display unit 33 for providing guidance to users or staff is provided on the top surface of the housing forming the ticket gate 13. The display unit 33 is, for example, configured with a liquid crystal display device. The display unit 33 displays a guidance screen that informs users passing through the passage of the results of the ticket gate processing. The display unit 33 may be provided in a position where the user can confirm the displayed content. The display unit 33 is not limited to being set at the end of the top surface of the housing on the exit side, and may be provided, for example, in the center of the top surface of the housing or adjacent to the reading unit of the ticket processing unit 32 on the top surface of the housing.

[0018] Doors 34, 35 that can be opened and closed to permit or deny passage of a pedestrian are provided at both ends of the side surface of the case 30 that forms the ticket gate 13 on the passage side. In the configuration example shown in Fig. 2, if the direction of arrow a is the direction of travel to the exit, door 34 is provided at the end of the passage on the exit (entrance) side and prevents a user from passing through the passage. Door 35 is provided at the end of the passage on the entrance (entrance) side and prevents a user from entering the passage.

[0019] A plurality of passage detection sensors (human detection sensors) 36 are provided on the side of the housing 30 forming the ticket gate 13. The passage detection sensors 36 are composed of reflective detection sensors or transmissive detection sensors. The output signal from the passage detection sensors 36 is either "light" or "dark." The passage detection sensors 36 detect whether or not a person is present at a predetermined detection position. The ticket gate 13 detects the presence or absence of a person at each detection position in the passage using the plurality of passage detection sensors 36. As a result, the ticket gate 13 is configured to determine the position of a user passing through the passage based on the detection results of the plurality of passage detection sensors 36.

[0020] Furthermore, the ticket checker 13 is provided with a proximity sensor 37 on the side facing the passage entrance direction on the side where the reading unit of the ticket processing unit 32 is provided (the entrance side of the passage). The proximity sensor 37 detects a person approaching the ticket checker 13. The ticket checker 13 detects a person approaching the passage with the proximity sensor 37, and enables the person to smoothly undergo ticket checking processing. For example, the proximity sensor 37 may detect a person in a position where he or she can present an IC card as a passenger ticket to the reading unit of the ticket processing unit 32. In this case, the ticket checker 13 may control the ticket processing unit 32 to be operable according to the detection result of the proximity sensor 37.

[0021] In addition, in an operation mode in which passengers pass through the passage in both directions, the ticket gate 13 controls the passage direction of the passenger (the ticket gate direction) by controlling the opening and closing of the door 35 in response to the detection result of the approach sensor 37. In addition, the ticket gate 13 may be configured to control switching between a power saving mode in which power consumption is reduced by turning off the display unit 33, etc., and a normal operation mode (an operation mode in which ticket gate processing is performed) in response to the detection result of the approach sensor 37.

[0022] The ticket gate 13 may also be provided with a passage guidance display unit on the side facing the passage entrance direction on the side (the entrance side of the passage) where the reading unit of the ticket processing unit 32 is provided. For example, the ticket gate 13 may be configured to display on the passage guidance display unit whether or not entry into the passage to the ticket gate is possible.

[0023] A plurality of height sensors (height measurement sensors) 38 are installed in the housing 30 forming the ticket gate 13. The height sensors 38 detect the height of a person. The height sensors 38 are installed at a plurality of locations on the housing 30 in order to detect the height of a person at a plurality of locations in the passage. In the example shown in FIG. 2, the height sensors 38 are installed in a sensor cover provided on the upper surface of the housing. The height sensors 38 are configured, for example, with reflective detection sensors. The height sensors 38 may be any sensors that detect whether or not a person is at or above a predetermined height at which the person is determined to be an adult.

[0024] FIG. 3 is a diagram showing an example of setting the detection position of the height sensor 38 installed in the ticket gate 13. As shown in FIG. In the example shown in Fig. 3, the height sensor 38 detects whether or not a person is present at the detection position indicated by the arrow b in Fig. 3. That is, the height sensor 38 outputs a signal indicating that a person has been detected if the person passing through the passage is taller than the arrow a. On the other hand, the height sensor 38 does not detect a person passing through the passage if the person is shorter than the arrow b.

[0025] 3 is set to a height at which it is determined whether or not a person passing through the passage formed by the ticket gate 13 is an adult. Therefore, when the height sensor 38 detects a person, the ticket gate 13 determines that the person passing through the passage is an adult. When the height sensor 38 does not detect a person in the passage, the ticket gate 13 determines that the person is not an adult.

[0026] In the configuration example shown in FIG. 2, the ticket gate 13 is provided with a camera 39. The camera 39 captures an image of a person passing through the passage of the ticket gate 13. The camera 39 is provided so as to capture an image of the entire body of one user using the ticket gate 13 at multiple points. The camera 39 may be provided in the housing 30, or may be provided at a position separate from the housing 30. The camera 39 does not have to be provided in the ticket gate 13. For example, the camera 39 may be a surveillance camera provided at a station to monitor the ticket gate or users of the ticket gate 13.

[0027] Next, the configuration of a control system in the ticket gate 13 serving as the passage control device according to this embodiment will be described. FIG. 4 is a block diagram showing an example of the configuration of a control system in the ticket gate 13 serving as a passage control device according to this embodiment. In the example configuration shown in Figure 4, the ticket gate 13 has a processor 41, a ROM 42, a RAM 43, a memory unit 44, a communication unit 45, a clock 46, a door control unit 47, a speaker 48, a ticket processing unit 32, a display unit 33, a passage detection sensor 36, an approach sensor 37, a height sensor 38, a camera 39, a camera interface 49, etc.

[0028] The processor 41, the ROM 42, and the RAM 43 function as a control unit that controls the entire ticket gate 13. The processor 41 is, for example, a calculation unit such as a CPU. The processor 41 realizes various processing functions by executing a program stored in the ROM 42 or the storage unit 44. For example, the processor 41 executes a ticket gate processing program stored in the ROM 42 or the storage unit 44 for performing a ticket gate processing described later.

[0029] The ROM 42 is a non-volatile memory. The ROM 42 functions as a program memory that stores programs executed by the processor 41. The ROM 42 stores the programs executed by the processor 41, control data, and the like.

[0030] The RAM 43 is a memory that temporarily holds data. The RAM 43 functions as a working memory. The RAM 43 loads programs and holds data being processed by the processor 41. The RAM 43 also functions as a buffer memory that temporarily holds communication data and the like.

[0031] The storage unit 44 is a memory that stores data. The storage unit 44 includes a rewritable non-volatile memory such as an HDD or SSD. The storage unit 44 stores information such as fare information used in ticket gate processing. The storage unit 44 may also store programs executed by the processor 41, control information, and the like.

[0032] The communication unit 45 is a communication interface for communicating with the monitoring panel 12. The communication unit 45 may be an interface for wired communication with the monitoring panel 12, or may be an interface for wireless communication. The communication unit 45 transmits information indicating an operating state to the monitoring panel 12, and receives control instructions such as an operating mode from the monitoring panel 12.

[0033] The clock 46 measures time. The processor 41 obtains the elapsed time based on the time measured by the clock 46. The clock 46 may be a timer that measures the elapsed time from a time instructed by the processor 41. The speaker 48 outputs a sound. For example, the speaker 48 outputs a sound such as an alarm when the user is not allowed to pass through.

[0034] The ticket processing unit 32 processes the ticket medium presented by the user. In this embodiment, the ticket processing unit 32 is configured with a card reader / writer that performs contactless communication with a contactless IC card (or a mobile terminal device with the same function as a contactless IC card) as the ticket medium. The ticket processing unit 32 may also include a mechanism for processing a magnetic ticket as the ticket medium.

[0035] The ticket processing unit 32 communicates with a contactless IC card as a ticket medium held over the reading unit (predetermined reading range) and acquires information recorded on the IC card. When the ticket processing unit 32 allows a user who holds an IC card over the reading unit to pass, it writes information indicating the result of ticket gate processing, etc., to the held IC card.

[0036] The display unit 33 is a display that displays guidance to users passing through the ticket gate. The display unit 33 is installed, for example, near the exit side or near the center of the main body of the ticket gate 13 so that it is easy for users passing through the ticket gate to see. The display contents such as guidance displayed on the display unit 33 are controlled by the processor 41.

[0037] The door control unit 47 includes a door opening / closing mechanism that opens and closes the doors 34 and 35. The door control unit 47 controls the passage of users by opening and closing the doors 34 and 35. For example, the door control unit 47 closes the door 34 to prevent passage through a passage formed by the ticket gate 13 at the ticket gate.

[0038] The passage detection sensor (human detection sensor) 36 is a sensor that detects the presence or absence of a person (or object). As shown in Fig. 2, the passage detection sensor 36 is installed on the side of the ticket gate 13 so that a number of predetermined positions in the passage are detection positions, and outputs a detection signal indicating the presence or absence of a person at each position to the processor 41. Based on the detection result of the passage detection sensor 36, the processor 41 can detect the position of a person in the passage and whether or not a person is passing through the passage.

[0039] The approach sensor 37 detects a person approaching the ticket gate 13. The approach sensor 37 is provided on the entrance side of the housing of the ticket gate 13, and outputs a detection signal indicating the presence or absence of a person near the entrance of the ticket gate 13 to the processor 41.

[0040] The passage detection sensor 36 and the approach sensor 37 are sensors that detect the position of a person (user) using the ticket gate 13. In the example shown in Fig. 2, the processor 41 monitors whether the user is in area A, area B, area C, or the passage control area.

[0041] Area A is an area in front of the passage formed by ticket gate 13. When approach sensor 37 is turned on (when approach sensor 37 detects a person), processor 41 determines that the user is present in area A. Area B is an area on the entrance side of the passage. When the passage detection sensor 36a is turned on, the processor 41 determines that the user has entered the passage (area B).

[0042] Area C is the area following area B, and is the area through which a user moving in the direction of arrow a passes after area B. When passage detection sensor 36b turns on, processor 41 determines that the user has moved from area B to area C. The passage controlled area is the area following area C, and is the area through which a user moving in the direction of arrow a passes after area C. When passage detection sensor 36c turns on, processor 41 determines that the user has moved from area C to the passage controlled area.

[0043] The height sensor 38 is an example of a sensor that measures the height of a person. The height sensor 38 detects whether or not the height of a person is equal to or greater than a predetermined height (height considered to be an adult). For example, the height sensor 38 is a reflective sensor with a detection position set as shown in FIG. 3, and detects the presence or absence of a person at the predetermined height. The height sensor 38 outputs an ON signal when it detects a person at the detection position set to the predetermined height that is determined to be an adult. When the processor 41 receives an ON signal from the height sensor 38, it determines that a person who is determined to be an adult and is equal to or greater than the predetermined height is present.

[0044] The height measurement sensor is not limited to the height sensor 38 configured as shown in Fig. 2 and Fig. 3. The height sensor 38 as a height measurement sensor may be one that acquires a signal that can determine whether or not the height (body height) of a user at a predetermined position in the passage is equal to or greater than a predetermined height. For example, the height sensor 38 may be a height measurement sensor that detects the height of a user from one side, or may be one that detects the height of a user using a measuring device other than a reflective sensor. The height sensor 38 may be replaced with a height measurement sensor that uses a three-dimensional sensor or the like, or may be replaced with one that measures the height from an image captured by a camera (height measurement sensor).

[0045] The camera 39 captures images at a predetermined cycle (frame rate). For example, the camera 39 is set to capture an area including the areas A, B, and C shown in FIG. 2. The camera 39 may also be driven to capture the areas A, B, and C as the capture areas in response to the movement of the user. For example, the processor 41 may be set to capture the area A during standby and while the approach sensor 37 detects the user, capture the area B while the passage detection sensors 36a and 36b detect that the user is in the area B, and capture the area C while the passage detection sensors 36b and 36c detect that the user is in the area C.

[0046] The camera 39 is installed so as to capture the whole body or a part of the user who uses the ticket gate 13. The camera 39 is to capture the part of the user that is the target of posture determination in the posture determination process described later. For example, when a posture determination process is performed to determine the posture of the user based on the movement of the whole body, the camera 39 is set to capture an image of a range including the whole body of the user in front of the passage of the ticket gate 13 and in the passage. When a posture determination process is performed to determine the posture of the user based on the movement of the upper body of the user, the camera 39 is set to capture an image of a range including the upper body of the user in front of the passage of the ticket gate 13 and in the passage. When a posture determination process is performed to determine the posture of the user based on the movement of the part above the knees, the camera 39 captures an image of a range above the knees of the user in front of the passage of the ticket gate 13 and in the passage.

[0047] The camera 39 is connected to the camera interface 49. The camera 39 may be installed separately from the ticket gate 13. When the camera 39 is installed separately from the ticket gate 13, the processor 41 is configured to acquire an image captured by the camera 39 via the camera interface 49. The camera 39 does not have to be provided for one ticket gate 13, and one camera 39 may be provided for a plurality of ticket gates 13. In this case, the camera interface 49 may acquire an image captured by the camera 39 of an area including the passage of the ticket gate 13 via a network.

[0048] Next, a ticket examination process (passage control process) performed by the ticket examiner 13 as the passage control device according to the embodiment will be described. FIG. 5 is a flowchart for explaining the ticket examination process by the ticket examiner 13 as the passage control device according to the embodiment. During standby, processor 41 of ticket gate 13 detects the approach of a user to the passageway based on the detection result of approach sensor 37. Processor 41 also detects the entry of a user into the passageway based on the detection result of passage detection sensor .

[0049] When the processor 41 detects a user approaching (or entering) the passage (ST1, YES), it executes a posture determination process, a height determination process, and a ticket reading process (ST2, 3, 4). Note that the posture determination process, the height determination process, and the ticket reading process are not limited to the order shown in Fig. 5, and may be executed in any order. Also, some or all of the posture determination process, the height determination process, and the ticket reading process may be executed in parallel.

[0050] The posture determination process is a process for determining the posture of a user when passing through a passage. The processor 41 executes the posture determination process for determining the posture of the user based on an image captured by the camera 39 (ST2). The posture determination process in the ticket gate 13 as a passage control device is a process for determining whether the user intentionally changes his / her posture (whether the user passes through the passage in the correct posture) when the height sensor 38 detects the height. The posture determination process will be described in detail later.

[0051] The height determination process is a process for determining the height of a user passing through a passage. The processor 41 executes the height determination process for determining the height of a user present at a predetermined position in the passage based on the detection result of the height sensor 38 (ST3). The height determination process in the ticket gate 13 as a passage control device is a process for determining whether or not the height of the user is equal to or greater than the height of an adult based on whether or not the user is detected by the height sensor 38, the detection position of which is set to a height that determines an adult.

[0052] The ticket reading process is a process of reading ticket information from a ticket medium presented (held) by a user. The processor 41 executes a ticket reading process in which the ticket processing unit 32 reads ticket information from the ticket medium presented by the user (ST4). For example, the ticket processing unit 32 reads ticket information recorded on an IC card serving as a ticket medium that the user holds over the reading unit. The ticket processing unit 32 may also be configured to read ticket information recorded on a magnetic ticket serving as a ticket medium presented by the user. The ticket processing unit 32 may also be configured to read code information in which the ticket information displayed on the ticket medium presented by the user is encoded.

[0053] When processor 41 reads the ticket information from the ticket medium (ticket) presented by the user, it determines whether or not the ticket presented by the user is a child's ticket based on the read ticket information (ST5).

[0054] If the ticket presented by the user is not a child's ticket (ST5, NO), processor 41 determines that the user is an adult and determines whether the adult is permitted to pass based on the ticket information of the ticket (ST13). If the ticket information of the ticket presented by the user permits passage of adults (ST14, YES), processor 41 notifies the user that passage is permitted by displaying a notice of permission on display unit 33 (ST15) and opens door 34 (ST16). As a result, processor 41 allows the user to pass.

[0055] If the ticket presented by the user is a child's ticket (ST5, YES), processor 41 determines whether the height (stature) of the user is determined to be not an adult (a child) by height determination (ST6). For example, processor 41 determines whether the height (stature) of the user is equal to or greater than a predetermined height based on whether the user is detected by height sensor 38.

[0056] If the height is an adult, i.e., if the height sensor 38 detects the user (ST6, NO), the processor 41 proceeds to ST13 and performs a passage determination as an adult based on the ticket information read from the ticket medium presented by the user.

[0057] Also, if the height is not that of an adult, that is, if the user is not detected by the height sensor 38 (ST6, YES), the processor 41 judges whether or not the user was in a posture (bad posture) that prevented the height from being measured correctly when the user passed through a predetermined position in the passage (when passing the detection position of the height sensor) (ST7). Here, bad posture refers to a posture that prevents the height from being measured by the height sensor 38 as a height measurement sensor (a posture that prevents the height from being measured correctly). In other words, the processor 41 detects, as bad posture, that the user is passing through the passage in a posture that prevents the height (height) from being detected correctly by the height sensor 38.

[0058] 6 and 7 are diagrams for explaining the posture of a user when passing through the passage of ticket gate 13. FIG. The height sensor 38 is installed so as to detect a person who is at least a certain height that is determined to be an adult, as shown in Fig. 4. Therefore, when an adult user of at least the certain height passes through the passage while standing upright and facing forward, the height sensor 38 detects the user, as shown in Fig. 6. However, if an adult user of at least the certain height passes through the passage with a lowered posture (lowered height), the height sensor 38 cannot detect the user, as shown in Fig. 7. Therefore, when a user who presents a child's ticket is not detected by the height sensor 38, the processor 41 detects a user who is trying to pass through in a posture that will not be detected as an adult by determining whether or not the user has poor posture.

[0059] If it is determined that the user passed through the passage in a posture that allows the height to be measured correctly (normal posture) (ST7, NO), the processor 41 proceeds to ST13 and performs a passage determination for the child based on the ticket information (ticket information of the child's ticket) read from the ticket medium presented by the user.

[0060] For example, if a user determined to have a normal posture is allowed to pass, the processor 41 encourages the user to pass by opening the door 34 and displaying a notice indicating that the user is allowed to pass on the display unit 33. However, if the user determined to have a normal posture is a child, the processor 41 may leave the door 34 open to protect the user even if the user is not allowed to pass. This allows a user (a user determined to be a child) who is confirmed to have a normal posture (no intentional changes in posture) to pass through based on the pass determination based on the ticket information.

[0061] When it is determined that the user is not in a position that allows height to be measured correctly (ST7, YES), the processor 41 saves an image including an image of the user captured by the camera 39 (ST8). For example, the processor 41 stores images captured by the camera 39 when the user passes through the passage in a memory such as the RAM 43 or the storage unit 44. When the processor 41 saves an image of the user, it transmits the image stored in the memory together with information indicating that the user was in a position that allows height to be measured to the server 11 via the monitoring panel 12. In this way, the processor 41 saves the image of the user who is determined not to be in a position that allows height to be measured correctly in the server 11, which is a higher-level device.

[0062] Furthermore, the processor 41 may store in the storage unit 44 an image of a user who is determined to be in an unsuitable posture for measuring height correctly. The image stored in the server 11 or the storage unit 44 may be used as evidence that the posture has been determined to be unsuitable. For example, the image stored in the server 11 or the storage unit 44 may be disclosed to the user.

[0063] When the server 11 or the monitoring panel 12 receives information from the ticket gate 13 that the posture is not allowed, the server 11 or the monitoring panel 12 may display information indicating the ticket gate 13 that the user has determined to be in an unallowable posture on the display unit of the monitoring panel 12. This allows the staff member monitoring the operation of the ticket gate 13 on the monitoring panel 12 to be notified that there is a user who is not allowed to pass due to his / her posture.

[0064] Furthermore, if the user is in a posture that does not allow the height to be measured correctly (ST7, YES), the processor 41 outputs an alarm sound from the speaker 48 (ST9) and guides the user to pass through again in the correct posture (ST10). For example, the processor 41 displays, as guidance, a guidance screen on the display unit 33 instructing the user to pass through again in the correct posture. The processor 41 may also display, as guidance, a guidance screen on the display unit 33 instructing the user to go to the attendant's window. Furthermore, the processor 41 may guide the user to pass through a specific ticket gate 13.

[0065] Furthermore, if the user is in a posture that does not allow the height to be measured correctly (ST7, YES), the processor 41 closes the door 34 to prevent the user from passing through (ST11). However, if the processor 41 determines that the ticket is for a child, it may assume that the user is actually a child and leave the door 34 open to ensure the safety of the user (child). Whether or not to close the door when posture is poor is set in each ticket gate 13. For example, it may be possible to set the opening and closing control of the door when posture is poor in each ticket gate 13 from the monitoring panel 12, etc.

[0066] As described above, the ticket gate as a passage control device according to the embodiment controls the passage of a user based on the results of the posture determination process, the height determination process, and the ticket reading process. If the ticket medium presented by the user is a child's ticket, the ticket gate will not allow the user to pass through the passage if the posture determination process determines that the user is in a posture that makes it impossible to measure the height using the height sensor. As a result, the passage control device of the embodiment can determine whether a user is passing through an aisle in a posture that allows the user to measure whether they are the same height (stature) as an adult, and can prevent fraudulent use of a child's ticket by passing through an aisle in a posture that intentionally makes the user appear shorter.

[0067] Next, a posture determination process in the ticket gate 13 as the passage control device according to the embodiment will be described. The posture determination process is a process for determining whether or not a user is intentionally assuming an unnatural posture at a predetermined position in the passageway. The posture determination process estimates the posture of the user and determines whether or not the posture is normal based on changes in the estimated posture.

[0068] The ticket gate 13 can apply a known process for estimating a person's skeleton points from an image using deep learning as the posture estimation. For example, the processor 41 of the ticket gate 13 estimates the posture of the user from the image of the user captured by the camera 39 using a method such as OpenPose (see https: / / arxiv.org / abs / 1812.08008). The ticket gate 13 may also estimate the posture using other methods for obtaining a skeleton.

[0069] The processor 41 of the ticket gate 13 as a passage control device according to the embodiment executes a posture determination process using posture estimation for each user who uses the ticket gate 13 as a passage control device. This allows the processor 41 to execute a ticket gate process (passage control process) using the result of the posture determination process as described above. The processor 41 can also execute several operation examples as the posture determination process. In this embodiment, three operation examples will be described as operation examples of the posture determination process.

[0070] First, a first operation example of the attitude determination process in the ticket gate 13 as the passage control device according to the embodiment will be described. In the first operation example, the ticket checker 13 judges whether or not the posture of the user when passing through an area on the entrance side of the passage (for example, area B shown in FIG. 2) is such that the height can be correctly determined.

[0071] For example, the ticket gate 13 detects that a user has entered the passageway using the passage detection sensor 36a, and starts a posture determination process for the user. When the ticket gate 13 starts the posture determination process, it extracts an image of the user from the image captured by the camera 39, and calculates a feature amount indicating the user's posture. The ticket gate 13 also stores a reference value serving as a standard for posture determination in the memory unit 44. The ticket gate 13 compares the feature amount indicating the user's posture calculated from the image captured by the camera 39 with the reference value, thereby determining whether the posture of the user is one for which the height can be correctly determined.

[0072] FIG. 8 is a flowchart for explaining a processing example as a first operation example of the attitude determination processing in the ticket gate 13 as the passage control device according to the embodiment. The processor 41 of the ticket gate 13 detects the approach of a user using the approach sensor 37. The processor 41 detects the user detected by the approach sensor 37 using the passage detection sensor 36a. When the passage detection sensor 36a detects the user, the processor 41 determines that the user has passed through a predetermined position (ST21). According to the example shown in Fig. 2, the processor 41 determines that the user has passed through a predetermined position when the user enters area B.

[0073] Processor 41 may detect the timing when the passenger ticket medium is presented to ticket processing unit 32 as the timing when the passenger passes the predetermined position. For example, processor 41 may detect that the user has passed the predetermined position when ticket processing unit 32 detects an IC card presented by the user, or when the user inserts a ticket such as a magnetic ticket into the ticket processing unit. Furthermore, processor 41 may detect that the user has passed the predetermined position from an image captured by camera 39.

[0074] When the processor 41 detects that a user has passed through a predetermined position, the processor 41 acquires an image (passing image) including the user captured by the camera 39 through the camera interface 49. The processor 41 extracts an image of the user from the images captured by the camera 39, and calculates a feature amount (posture feature amount) for determining the posture of the user from the image of the user (ST22). For example, the processor 41 performs posture estimation to estimate the feature points (skeleton points) of a person's skeleton for the image of the user.

[0075] When estimating skeleton points, the processor 41 calculates the width of both shoulders, the relative angle between the shoulders and waist, the ratio between the shoulders and waist, the waist joint during movement, the swing range of the shoulder joint and waist, the angles of the elbow joint and the knee joint, etc. as features included in the posture feature of the user. The processor 41 may also calculate the feature space distribution of the skeleton feature points as the feature. The feature for determining the posture may be any one that can detect poor posture, and may be a combination of multiple index values.

[0076] Furthermore, the processor 41 calculates a feature amount indicating the posture of the user from the skeleton points obtained by posture estimation. For example, the processor 41 calculates an angle formed by one or more joints from the skeleton points as the feature amount. Specifically, the processor 41 may identify both shoulders of the upper body from the captured image, extract shoulder joints from the skeleton points of both shoulders of the upper body, and calculate the angle of the shoulder joint as the feature amount. The processor 41 may also identify the waist from the captured image, extract waist joints from the skeleton points of the waist, and calculate the angle of the waist joint as the feature amount.

[0077] The processor 41 may also identify the shoulders and waist from the captured image, extract the shoulder joints from the skeleton points of the shoulders, extract the waist joints from the skeleton points of the waist, and calculate the angle between the shoulder joints and the waist joints as the feature amount. The processor 41 may also identify the user's knees and waist from the captured image, extract the knee joints of both knees from the skeleton points of the knees, extract the waist joints of the waist from the skeleton points of the waist, and calculate the angle between the knee joints and the waist joints as the feature amount. The processor 41 may also calculate a ratio calculated from the distance between the joints of the skeleton as the posture feature amount. The processor 41 may also calculate a feature space distribution calculated from the coordinate values ​​of the skeleton points as the feature amount.

[0078] The feature amount calculated by the processor 41 as the posture feature amount is set in advance from the feature amounts described above. The feature amount calculated as the posture feature amount may be one or more. The feature amount calculated as the posture feature amount may be set according to the installation environment of the camera 39 or the shooting range that the camera 39 can shoot. For example, in an environment where it is difficult for the camera 39 to shoot the lower body of a user passing through a passageway, a feature amount that can be obtained from an image of the upper body of the user may be set as the posture feature amount.

[0079] When the processor 41 calculates a posture feature amount indicating the posture of the user from the passing image, it compares the calculated posture feature amount of the user with a posture reference value (criterion) for posture judgment assuming a posture (normal posture) in which the height sensor 38 can correctly measure the height (ST23). In the first operation example, the ticket gate 13 stores a posture reference value for judging that the posture is normal assuming a normal posture in the storage unit 44. The posture reference value is set according to the feature amount used as the posture feature amount. In addition, when multiple feature amounts are used as the posture feature amount, the posture reference value may be set to multiple reference values ​​corresponding to each feature amount.

[0080] The posture reference value may be calculated by calculating posture feature values ​​from image data of people with normal postures collected from a public database, etc., and creating a posture reference value for a normal posture and an allowable range for the posture reference value from the distribution of the posture feature values. The posture reference value may be calculated from a plurality of posture feature values ​​calculated from images captured by the camera 39 when a plurality of subjects pass through the passage at the ticket gate 13 with normal postures.

[0081] If the posture feature amount of the user calculated from the passing image captured by the camera 39 is within an allowable range (reference range) based on the posture reference value (ST24, YES), the processor 41 determines that the user has a normal posture ("no problem") (ST25). If the posture feature amount of the user exceeds the reference range for the posture reference value (ST24, NO), the processor 41 determines that the user has an abnormal posture ("cannot determine whether the user is an adult or not") (ST26). The processor 41 stores the posture determination result for the user in the RAM 43 or the like, and ends the posture determination process.

[0082] As described above, according to the first operation example, the ticket gate as a passage control device compares a preset posture reference value for determining posture with a posture feature amount calculated from an image of a user passing through a passage captured by a camera. If the calculated posture feature amount is within a predetermined allowable range for the posture reference value, the ticket gate determines that the user has a normal posture, and if the calculated posture feature amount is not within a predetermined reference range for the posture reference value, the ticket gate determines that the user has a poor posture (a posture that makes it impossible to measure the height).

[0083] This allows the ticket gate as a passage control device to which the posture determination process of the first operation example is applied to determine whether or not a user has passed through a passage in a normal posture. The ticket gate can determine whether or not a user passing through a passage is in a state in which the height of the user can be measured normally by the height sensor, and can detect when a user who has presented a child's ticket or the like attempts to pass through a passage in an unnatural posture.

[0084] Next, a second operation example of the attitude determination process in the ticket gate 13 as the passage control device according to the embodiment will be described. 9, the ticket gate 13 according to the second operation example tracks a user in an area just before the user enters the passageway, and creates a posture reference value for the user based on posture feature values ​​calculated from an image of the user in the area just before the passageway (e.g., area A). When the user enters the passageway, the ticket gate 13 according to the second operation example uses the posture reference value for the user to determine the user's posture through posture determination processing as described in the first operation example.

[0085] FIG. 10 is a flowchart for explaining a processing example as a second operation example of the attitude determination processing in the ticket gate 13 as the passage control device according to the embodiment. In the ticket gate 13, the approach sensor 37 detects a user who has entered area A shown in Fig. 2, which is set in front of the passage. When the approach sensor 37 detects a user, the processor 41 detects the user as a new passerby (user) (ST31). When the processor 41 detects a new passerby, it starts tracking the user (ST32).

[0086] For example, processor 41 detects that a user has moved from area A to area B based on detection signals from approach sensor 37 and passage detection sensor 36a. That is, processor 41 determines that a user is present in the area before the aisle (area A) when approach sensor 37 is on, and detects that the user has entered the aisle (area B) from the area before the aisle (area A) when approach sensor 37 is off and passage detection sensor 36a is on. Processor 41 may detect that a user has moved from area A to area B based on an image of the user extracted from an image captured by camera 39.

[0087] The processor 41 generates a posture reference value for determining a posture change for the user while the user is in the area in front of the passage. After starting tracking of the user, the processor 41 monitors the user's entry into the passage to detect that the user has moved from the area in front of the passage into the passage (ST33).

[0088] If the user has not entered the passage (ST33, NO), processor 41 calculates a posture feature amount indicating the posture of the user from the image of the user extracted from the image captured by camera 39 (ST34). For example, processor 41 calculates a posture feature amount indicating the posture of the user from the image of the user extracted from the image captured by camera 39 by posture estimation as described above.

[0089] When the processor 41 calculates the posture characteristic amount of the user standing in front of the passage, the processor 41 updates the posture reference value for the user based on the calculated posture characteristic amount (ST35). For example, the processor 41 secures a storage area in the storage unit 44 for storing the posture reference value for the user standing in front of the passage, and updates the posture reference value for the user stored in the storage unit 44 based on the posture characteristic amount of the user calculated from the image captured by the camera 39 at a predetermined frame rate.

[0090] That is, while the user is present in the area in front of the passageway, processor 41 repeatedly calculates the posture characteristic parameters of the user from the image captured by camera 39 and updates the posture reference value for the user based on the calculated posture characteristic parameters.

[0091] When the user enters the passage (ST33, YES), the processor 41 ends tracking of the user (ST36) and ends creation of the posture reference value for the user who entered the passage. Note that when the user exits the area in front of the passage without moving into the passage (for example, when the tracking target is no longer detected by the approach sensor 37 and the passage detection sensor 36a), the processor 41 may end tracking of the user and discard the posture reference value for the user.

[0092] When the processor 41 ends tracking of the user as the user enters the passage, the processor 41 executes a posture determination process for the user using the posture reference value for the user stored in the storage unit 44 (ST37). For example, the processor 41 executes the posture determination process as described in the first operation example. As a result, in the second operation example, the processor 41 can execute a posture determination process for determining whether the posture of the user who entered the passage is normal or poor, using a posture reference value created based on posture feature amounts calculated from an image of the user himself / herself.

[0093] 11 and 12 are diagrams for explaining an example of the posture determination process according to the second operation example. Fig. 11 shows a state where a user P1 enters the passage from the area in front of the passage without changing his / her posture, and Fig. 12 shows a state where a user P2 enters the passage from the area in front of the passage by changing his / her posture.

[0094] 11, user P1 enters the passage in the same posture as in the area before the passage. Therefore, there is little change between the posture reference value for user P1 based on the posture feature amount calculated from the image of user P1 in the area before the passage and the posture feature amount calculated from the image of user P1 when he / she enters the passage.

[0095] 12, user P2 has a different posture in the passage than in the area before the passage. Therefore, the ticket gate 13 has a large change in posture reference value for user P2 based on posture feature values ​​calculated from an image of user P2 in the area before the passage and posture feature values ​​calculated from an image of user P2 who has entered the passage.

[0096] That is, in the second operation example, the ticket gate 13 creates a posture reference value for the user each time the user approaches the passage. Therefore, the ticket gate to which the posture determination process of the second operation example is applied determines that the posture of the user is normal if there is no change in posture as shown in Fig. 11 before and after entering the passage, and determines that the posture of the user is poor if there is a change in posture as shown in Fig. 12.

[0097] As described above, a ticket gate as a passage control device that applies the posture determination processing of the second operation example can create a posture reference value for each user based on posture features calculated from images taken before the user passes through a specified position (e.g., the entrance to an aisle), and can create a posture reference value that reflects the personal characteristics of each user, such as their body type and walking posture, and can accurately detect posture changes for each user.

[0098] Next, a third operation example of the attitude determination process in the ticket gate 13 as the passage control device according to the embodiment will be described. The ticket gate 13 according to the third operation example sets a plurality of passing positions through which a user passes when passing through a passage, and judges the user's posture based on the amount of change in posture feature of the user at each passing position. That is, in the third operation example, without using a preset posture reference value, it is judged based on the posture change of the user at a specific passing position whether the user passed through the passage with a normal posture (posture change within an acceptable range) or with a large change in posture (posture change exceeding an acceptable range).

[0099] FIG. 13 is a flowchart for explaining a processing example as a third operation example of the attitude determination processing in the ticket gate 13 as the passage control device according to the embodiment. It is assumed that a plurality of passing positions (predetermined positions) are set for the ticket gate 13 which performs the posture determination process of the third operation example. For example, the ticket gate 13 calculates posture feature values ​​indicating postures of one user in each of areas A, B, and C shown in Fig. 2. In this case, the processor 41 calculates posture feature values ​​of the user in each area each time the approach sensor 37, the passage detection sensor 36a, and the passage detection sensor 36b detect the user.

[0100] That is, when the processor 41 of the ticket gate 13 detects a user at a predetermined passing position (detection position) (ST51), it acquires a photographed image including an image of the user present in an area including the detection position from the camera 39. The processor 41 calculates a posture feature amount indicating the posture of the user from an image of the user extracted from the photographed image acquired from the camera 39 (ST52). Here, the processor 41 stores the posture feature amount calculated from the image captured by the camera 39 at each detection position in a memory such as the RAM 52 or the storage unit 44.

[0101] Furthermore, the processor 41 repeatedly executes the processes of ST51 to ST52 until it detects that the user has passed all the passing positions. If the user has not passed all the passing positions (ST53, NO), the processor 41 calculates a posture feature amount indicating the posture of the user from an image captured by the camera 39 each time it detects that the user has passed the next passing position, and stores the calculated posture feature amount in a memory such as the RAM 42 in association with the detection position. For example, the processor 41 detects the up-down relationship, left-right relationship, and forward-backward swaying range of specific parts of the user (e.g., head, shoulders, hands, etc.), and angles of specific joints (e.g., shoulders, hips, both shoulders, elbows, etc.) as posture feature amounts at each detection position. These posture feature amounts at each detection position may be feature amounts that can determine whether a user passing through the passage has intentionally changed his / her posture.

[0102] When the user has passed all the passage positions (ST53, YES), processor 41 calculates the amount of change between posture feature amounts at each detection position from the posture feature amounts at each detection position stored in memory (ST54). For example, processor 41 detects the amount of change in posture feature amounts, such as the up-down relationship, left-right relationship, front-back sway range of specific parts of the user (e.g., head, shoulders, hands, etc.), and angle of specific joints (e.g., shoulders, hips, both shoulders, elbows, etc.), by calculating the amount of change between posture feature amounts at adjacent detection positions. With such an amount of change, it can be detected that the user has intentionally changed his / her posture while passing through the passage.

[0103] After calculating the amount of change in posture feature amount at each detection position, the processor 41 judges whether or not the calculated amount of change in posture feature amount at each detection position is within an allowable range (criterion range) that is a criterion for judging whether or not the posture is normal (ST55). For example, the judgment criterion range is stored in advance in the storage unit 44. The judgment criterion range may be created from publicly available data that indicates an index for detecting posture change. For example, when the user passes through all predetermined detection positions (for example, the center of a ticket gate), the processor 41 compares the amount of change in posture feature amount extracted from an image of the user passing through each detection position with the judgment criterion range to judge whether or not the posture of the user who passed each detection position has changed significantly beyond the allowable range.

[0104] If the calculated change in posture feature amount is within the judgment criteria range (ST55, YES), processor 41 judges that the user passed through the passage in a normal posture ("no problem") (ST56). If the calculated change in posture feature amount exceeds the judgment criteria range (ST55, NO), processor 41 judges that the user passed through the passage in a posture that does not allow normal height judgment ("cannot judge whether the user is an adult or not") (ST57). Processor 41 stores the posture judgment result for the user in a memory such as RAM 43, and ends the posture judgment process.

[0105] 14 and 15 are diagrams for explaining the posture determination process of the third operation example by the ticket gate 13. In FIG. Fig. 14 shows a user P3 passing through the passage from the area before the passage without changing his / her posture, while Fig. 15 shows a user P4 who entered the passage from the area before the passage and passed through the passage while changing his / her posture.

[0106] 14, user P3 passes through the passage in a posture similar to that in the area in front of the passage. Therefore, there is little change in posture feature values ​​calculated from images of user P3 in the area in front of the passage, the area near the entrance to the passage (area B), and the area near the center of the passage (area C).

[0107] In contrast, in the example shown in Fig. 15, user P4 enters the passage in a different posture from the area in front of the passage, and after entering the passage, passes near the center of the passage in a posture similar to that of the area in front of the passage. Therefore, the posture feature amount calculated from the images of user P4 in the area in front of the passage, the area near the entrance to the passage (area B), and the area near the center of the passage (area C) has a large change. In the example shown in Fig. 15, the knee joint angle of user P4 has changed significantly compared to before entering the passage. These posture changes are calculated as the change amount of posture feature amount.

[0108] As shown in Fig. 14, user P3, who maintains a constant posture from the front of the passage through the passage and after passing through the passage, can be determined to have passed through the passage in a normal posture, because the change in posture feature falls within the judgment criterion range. Also, as shown in Fig. 15, user P4, who changes his posture significantly while passing through the passage, can be determined to have not passed through the passage in a normal posture (passed through the passage in a posture that does not allow for correct height measurement), because the change in posture feature exceeds the judgment criterion range.

[0109] As described above, the ticket gate as a passage control device to which the posture determination process of the third operation example is applied calculates posture feature amounts at each of a plurality of predetermined detection positions from images of a user passing through each of the detection positions, and can detect posture changes of the user while passing through the passage based on the amount of change in posture feature amount at each detection position. This makes it possible to accurately detect users who intentionally change their posture to pass through the passage, and to detect users whose posture makes it impossible to measure their height (stature) correctly.

[0110] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. The following is an appended summary of the contents of the claims as originally filed. [1] In a traffic control device for controlling passage through a passage, an interface for acquiring a photographed image from a camera that captures an image of a photographed area including the passage; a processor for determining a posture of a pedestrian passing through the passage based on an image of the pedestrian extracted from an image captured by the camera; A traffic control device having the same. [2] In a traffic control device for controlling passage through a passage, a height measurement sensor that detects the height of a person passing through the passage; an interface for acquiring a photographed image from a camera that captures an image of a photographed area including the passage; a processor that determines a posture of a pedestrian passing through the passage based on an image of the pedestrian extracted from a captured image acquired by the interface, and controls the passage of the pedestrian based on a height detection result by the height measurement sensor and a determination result of the posture of the pedestrian. [3] The processor, calculating a posture feature amount indicating a posture of the pedestrian from an image captured by the camera when the pedestrian passes a predetermined position in the passage; If the posture feature amount is within an allowable range with respect to the posture reference value, it is determined that the passerby has passed through the passage in a posture that allows the height measurement sensor to measure the passerby's height, If the posture feature value exceeds an allowable range with respect to a posture reference value, it is determined that the pedestrian has passed through the passage in a posture that makes it impossible to measure the pedestrian's height by the height measurement sensor. [2] A traffic control device as described in the above. [4] The processor creates a posture reference value for the pedestrian based on an image of the pedestrian in an area in front of the passage extracted from an image captured by the camera. A traffic control device as described in [3]. [5] The processor, calculating posture feature amounts of the pedestrian from images captured by a camera each time the pedestrian passes through a plurality of predetermined detection positions; When a change amount of the posture feature amount of the pedestrian who has passed through a plurality of detection positions is within an allowable range, it is determined that the pedestrian has passed through the passage in a constant posture; If a change in posture feature amount of the pedestrian who passed through a plurality of detection positions exceeds an allowable range, it is determined that the pedestrian passed through the passage while changing his / her posture. [2] A traffic control device as described in the above. [6] The processor estimates skeleton points of the passerby from the captured image, and calculates feature information obtained from the skeleton points of the passerby as posture feature amounts. A traffic control device described in any one of [2] to [5]. [7] The processor estimates the joints of the pedestrian as skeleton points of the pedestrian, and calculates a ratio calculated from a distance between the joints of the pedestrian as a posture feature. [6] A traffic control device as described in the above. [8] The processor calculates a feature space distribution calculated from coordinate values ​​of skeleton points of the passerby as a posture feature. [6] A traffic control device as described in the above. [9] Further, a ticket processing unit is provided for reading information recorded on the ticket medium, the processor, when the ticket medium read by the ticket processing unit and presented by the pedestrian is a child's ticket, does not allow the pedestrian to pass through the passage if the pedestrian's posture makes it impossible to measure the pedestrian's height by the height measurement sensor; [2] A traffic control device as described in the above.

[10] The height measurement sensor is a sensor that detects whether or not the height of the person passing through the passage is equal to or greater than a predetermined height. [2] A traffic control device as described in the above.

[11] Further, a door provided on the exit side of the passage; A door control unit that controls opening and closing of the door, the processor closes the door by the door control unit when the posture of the passerby is such that the height measurement sensor cannot accurately measure the height of the passerby. [2] A traffic control device as described in the above.

[12] Further, the image sensor has a memory for storing the image. the processor stores in the memory an image of the posture of the passerby when the posture of the passerby is such that the height of the passerby cannot be accurately measured by the height measurement sensor; [2] A traffic control device as described in the above.

[13] Further, a display for displaying guidance is provided, the processor displays on the display a guidance screen that guides the pedestrian to pass through another passage when the pedestrian's posture is such that the height measurement sensor cannot accurately measure the pedestrian's height. [2] A traffic control device as described in the above.

[14] Further, a display for displaying guidance is provided, the processor displays, on the display, a guide for correcting a posture when passing through the passage when the posture of the passerby is such that the height measurement sensor cannot accurately measure the height of the passerby. [2] A traffic control device as described in the above.

[15] Further, the device has a speaker for outputting sound, the processor outputs an alarm through the speaker when the posture of the passerby is such that the height of the passerby cannot be accurately measured by the height measurement sensor. [2] A traffic control device as described in the above. [Explanation of symbols]

[0111] 1...ticket gate system, 11...server, 12...monitoring panel, 13...ticket gate (passage control device), 32...ticket processing unit, 33...display unit, 34, 35...door, 36 (36a, 36b, 36c, 36d, 36e, 36f)...passage detection sensor, 37...approach sensor, 38 (38a, 38b, 38c, 38d)...height sensor (height measurement sensor), 39...camera, 41...processor, 42...ROM, 43...RAM (memory), 44...storage unit (memory), 45...communication unit, 46...clock, 47...door control unit, 48...speaker, 49...camera interface (interface).

Claims

1. In a traffic control device for controlling passage through a passage, a height measurement sensor that detects the height of a person passing through the passage; an interface for acquiring a photographed image from a camera that captures an image of a photographed area including the passage; a processor that determines a posture of a pedestrian passing through the passage based on an image of the pedestrian extracted from the photographed image acquired by the interface, and controls the passage of the pedestrian based on a height detection result by the height measurement sensor and a determination result of the posture of the pedestrian, The processor, calculating a posture feature amount indicating a posture of the pedestrian from an image captured by a camera each time the pedestrian passes through a plurality of predetermined detection positions; When a change amount of the posture feature amount of the pedestrian who has passed through a plurality of detection positions is within an allowable range, it is determined that the pedestrian has passed through the passage in a constant posture; If a change in posture feature amount of the pedestrian who passed through a plurality of detection positions exceeds an allowable range, it is determined that the pedestrian passed through the passage while changing his / her posture. Traffic control device.

2. The processor estimates skeleton points of the passerby from the captured image, and calculates feature information obtained from the skeleton points of the passerby as posture feature amounts. The traffic control device according to claim 1 .

3. The processor estimates the joints of the pedestrian as skeleton points of the pedestrian, and calculates a ratio calculated from a distance between the joints of the pedestrian as a posture feature. The traffic control device according to claim 2 .

4. The processor calculates a feature space distribution calculated from coordinate values ​​of skeleton points of the passerby as a posture feature. The traffic control device according to claim 2 .

5. Further, a ticket processing unit is provided for reading information recorded on the ticket medium, the processor, when the ticket medium read by the ticket processing unit and presented by the pedestrian is a child's ticket, does not allow the pedestrian to pass through the passage if the pedestrian's posture makes it impossible to measure the pedestrian's height by the height measurement sensor; The traffic control device according to claim 1 .

6. The height measurement sensor is a sensor that detects whether or not the height of the person passing through the passage is equal to or greater than a predetermined height. The traffic control device according to claim 1 .

7. Further, a door provided on the exit side of the passage; A door control unit that controls opening and closing of the door, the processor closes the door by the door control unit when the posture of the passerby is such that the height measurement sensor cannot accurately measure the height of the passerby. The traffic control device according to claim 1 .

8. Further, the image sensor has a memory for storing the image. the processor stores in the memory an image of the posture of the passerby when the posture of the passerby is such that the height of the passerby cannot be accurately measured by the height measurement sensor; The traffic control device according to claim 1 .

9. Further, a display for displaying guidance is provided, the processor displays on the display a guidance screen that guides the pedestrian to pass through another passage when the pedestrian's posture is such that the height measurement sensor cannot accurately measure the pedestrian's height. The traffic control device according to claim 1 .

10. Further, a display for displaying guidance is provided, the processor displays, on the display, a guide for correcting a posture when passing through the passage when the posture of the passerby is such that the height measurement sensor cannot accurately measure the height of the passerby. The traffic control device according to claim 1 .

11. Further, the device has a speaker for outputting sound, the processor outputs an alarm through the speaker when the posture of the passerby is such that the height of the passerby cannot be accurately measured by the height measurement sensor. The traffic control device according to claim 1 .

Citation Information

Patent Citations

  • Gate device

    JP2009205495A

  • Passage control device

    JP2010033390A

  • Automatic ticket examination machine

    JP2012242884A

  • Automatic ticket gate device

    JP2013069090A

  • Pose estimation device, pose estimation method and program

    JP2015167008A