A passenger route identification device, a passenger route identification method, and a program.

Abstract

Identify the actual travel routes taken by users of public transportation. [Solution] The passenger route identification device of the embodiment acquires user identification information, which is the identification information of a user entering or exiting from a ticket gate installed at a station of a transportation company, and registers a combination of date and time information, entry station information or exit station information, and user identification information as a single detailed information in the storage unit. It also acquires face image data, which is data of the face of a user riding the transportation company, and identifies the user identification information corresponding to the acquired face image data based on correspondence information that has been pre-associated between user identification information and face image data for each user, and registers a combination of date and time information, transportation company information used, and the identified user identification information as a single detailed information in the storage unit. When user identification information of a user exiting from a ticket gate is acquired, the actual passenger route is identified for that user using the entry station information, transportation company information, and exit station information based on multiple single detailed information.

Description

Technical Field

[0001] Embodiments of the present invention relate to a boarding route identification device, a boarding route identification method, and a program.

Background Art

[0002] In recent years, in transportation facilities (such as railways), the development of a technology that uses face recognition technology to identify the entry station and the exit station from the face information of users captured by the camera of the ticket gate at the time of entry and exit, calculates the fare, and performs the fare deduction process has been underway.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above-mentioned conventional technology, although the entry station and the exit station of the user can be identified, there is a problem that when multiple usage routes are conceivable, the actual boarding route, which is the route actually used, cannot be identified.

[0005] Therefore, an object of embodiments of the present invention is to provide a boarding route identification device, a boarding route identification method, and a program that can identify the actual boarding route of a user of a transportation facility.

Means for Solving the Problems

[0006] The passenger route identification device of the embodiment includes a processing unit that acquires user identification information, which is the identification information of a user entering or exiting a station of a transportation company, and registers a combination of date and time information, entry station information or exit station information, and the user identification information as a single detailed information item in the storage unit, acquires face image data, which is data of the face of a user riding the transportation company, identifies the user identification information corresponding to the acquired face image data based on correspondence information that has been pre-associated between user identification information and face image data for each user, and registers a combination of date and time information, transportation company information used, and the identified user identification information as a single detailed information item in the storage unit, and when the user identification information of a user exiting from the ticket gate is acquired, the processing unit identifies the actual passenger route for that user using the entry station information, transportation company information used, and exit station information based on a plurality of single detailed information items stored in the storage unit. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is an overall diagram of the fare collection system according to the embodiment. [Figure 2] Figure 2 is a functional configuration diagram of the single-item detail server according to the embodiment. [Figure 3] Figure 3 is a functional configuration diagram of the fare information server in the embodiment. [Figure 4] Figure 4 shows an example of the item details data for one embodiment. [Figure 5] Figure 5 is a flowchart showing the processing performed by the item detail server in the embodiment. [Figure 6] Figure 6 is a flowchart showing the processing performed by the fare information server in the embodiment. [Modes for carrying out the invention]

[0008] The following describes embodiments of the passenger route identification device, passenger route identification method, and program of the present invention with reference to the attached drawings. In the following embodiments, the railway is used as an example of the mode of transportation. Railway users are also simply referred to as "users." Users are also referred to as passengers.

[0009] Figure 1 is an overall configuration diagram of the fare collection system S according to the embodiment. The fare collection system S comprises a server room 2 owned by the railway operator 1, stations / railways 3, and an external system 9. Note that the connecting lines between the two configurations in Figure 1 indicate the main communication connection relationships, and there may be cases where two configurations not connected by connecting lines are also connected in a communication manner.

[0010] External system 9 includes a credit information server 91. The credit information server 91 is a computer that manages information about credit card users, such as name, date of birth, gender, address, telephone number, employer, occupation, purpose of credit card use, email address, application date, approval date, expiration date, available credit limit, password, and transaction history, and also performs credit card payment processing.

[0011] Station / railway 3 is equipped with a railway camera 7 and a ticket gate camera 8. The train camera 7 is a camera installed inside a train. The train camera 7 periodically (for example, every minute) takes pictures of the inside of the train and transmits the captured images to the face information server 4.

[0012] The ticket gate camera 8 is a camera installed in the ticket gate. For example, each time a user passes through the ticket gate, the ticket gate camera 8 takes a picture of the user and their surroundings and transmits the captured image to the face information server 4.

[0013] In addition to the train station cameras 7 and ticket gate cameras 8, station cameras may also be installed on train platforms and other locations, and images of the platforms may be transmitted to the facial information server 4.

[0014] Server room 2 includes a face information server 4, a single transaction details server 5 (part of the boarding route identification device), and a fare information server 6 (part of the boarding route identification device).

[0015] The face information server 4 is, for example, a computer with the same hardware configuration as the single transaction details server 5 and the fare information server 6. The face information server 4 receives captured images from cameras inside the railway 7, ticket gate cameras 8, and other on-premises cameras, and stores the captured images together with the capture date and time, camera identification information, etc. Further, the face information server 4 extracts face image data from the captured images and transmits it to the single transaction details server 5.

[0016] Next, the single transaction details server 5 will be described. FIG. 2 is a functional configuration diagram of the single transaction details server 5 of the embodiment. The single transaction details server 5 is a computer and includes a storage unit 51, an input unit 52, an output unit 53, a communication unit 54, and a processing unit 55.

[0017] The storage unit 51 is a storage device such as a HDD (Hard Disk Drive) or SSD (Solid State Drive), and stores various information. The storage unit 51 stores, for example, a single transaction details information DB 511.

[0018] The single transaction details information DB 511 stores single transaction details information. The single transaction details information is, for example, a combination of date and time information regarding the user, entry station information or exit station information, and user identification information. Further, the single transaction details information is, among other things, for example, a combination of date and time information regarding the user, railway usage information (the route used, the type of railway used (such as whether it is an express train or not), etc.), and user identification information specified based on face image data. That is, every time a user is captured by the cameras inside the railway 7, ticket gate cameras 8, and other on-premises cameras, the processing unit 55 accumulates the single transaction details information in the single transaction details information DB 511. The details of the single transaction details information will be described later.

[0019] <00​​​ The output unit 53 is a means for outputting various types of information, such as a display device like a liquid crystal display (LCD), or an audio output device such as a speaker.

[0021] The communication unit 54 is a communication interface for communicating with external devices (for example, the face information server 4, the fare information server 6, etc.).

[0022] The processing unit 55 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The CPU comprehensively controls the operation of the single-item details server 5. The ROM is a storage medium for storing various programs and data. The RAM is a storage medium for temporarily storing various programs and rewriting various data. Then, the CPU executes the programs stored in the ROM, the storage unit 51, etc. using the RAM as a work area (working area).

[0023] The processing unit 55 executes various arithmetic processes. For example, the processing unit 55 acquires user identification information, which is the identification information of users entering or leaving through the ticket gate provided at a railway station, and registers the combination of date and time information, entry station information or exit station information, and user identification information as single-item details information in the single-item details information DB511 of the storage unit 51.

[0024] In that case, for example, the processing unit 55 acquires face image data, which is data of a face photographed of a user entering or leaving through the ticket gate, from the face information server 4, specifies the user identification information corresponding to the acquired face image data based on the corresponding information, and registers the combination of date and time information, entry station information or exit station information, and the specified user identification information as single-item details information in the single-item details information DB511 of the storage unit 51.

[0025] In other words, the user identification information when a user enters or exits through a ticket gate may be user identification information identified from facial image data and corresponding information extracted from images captured by the ticket gate camera 8, or it may be user identification information read by the ticket gate from an IC card used for railway travel (e.g., PASMO®).

[0026] Furthermore, the processing unit 55 acquires face image data (face image data extracted from images taken by the in-railway camera 7), which is data of the faces of passengers riding in the railway vehicle. Based on correspondence information that has been pre-associated for each passenger with passenger identification information and face image data, the processing unit 55 identifies the passenger identification information corresponding to the acquired face image data and registers the date and time information, the railway information used, and the identified passenger identification information as a single detailed record in the single detailed record information DB 511 of the storage unit 51.

[0027] Furthermore, for example, when the processing unit 55 acquires facial image data of a passenger on a train, it acquires facial image data when the doors of the train are closed.

[0028] Next, the fare information server 6 will be described. Figure 3 is a functional configuration diagram of the fare information server 6 in this embodiment. The fare information server 6 is a computer and comprises a storage unit 61, an input unit 62, an output unit 63, a communication unit 64, and a processing unit 65.

[0029] The memory unit 61 is a storage device such as an HDD or SSD, and stores various types of information. For example, the memory unit 61 stores the fare information DB 611.

[0030] The fare information DB611 stores fare information. This fare information includes, for example, individual user details (details below), actual travel route, fare information, and credit card payment information.

[0031] The input unit 62 is an input device that receives user operations to the fare information server 6, and is, for example, a keyboard, mouse, touch panel, etc.

[0032] The output unit 63 is a means for outputting various types of information, such as a display device (like a liquid crystal display (LCD)) or an audio output device (like a speaker).

[0033] The communication unit 64 is a communication interface for communicating with external devices (for example, the face information server 4, the individual details server 5, etc.).

[0034] The processing unit 65 includes, for example, a CPU, ROM, and RAM. The CPU comprehensively controls the operation of the fare information server 6. ROM is a storage medium for storing various programs and data. RAM is a storage medium for temporarily storing various programs and for rewriting various data. The CPU then uses RAM as a work area to execute programs stored in the ROM, storage unit 61, etc.

[0035] The processing unit 65 performs various calculations. For example, based on the single-item data obtained from the processing unit 55 of the single-item server 5, the processing unit 65 identifies the actual travel route for the user using the entry station information, railway usage information, and exit station information. Specifically, it is as follows:

[0036] First, when the processing unit 55 of the single-entry details server 5 obtains user identification information of a user exiting from the ticket gate, it refers to the single-entry details information DB 511 of the storage unit 51, extracts single-entry details information regarding the user's entry, single-entry details information regarding the railway used, and single-entry details information regarding the exit, and creates single-entry details data.

[0037] Here, Figure 4 shows an example of the detailed data for one transaction according to the embodiment. The detailed data for one transaction includes, from left to right, a serial number, passenger ID (Identifier), processing date (date and time information), entry station information, currency section (railway information used), exit station information, and other items.

[0038] Each line in the individual item data represents individual item information. The first line of the transaction details indicates that this user (passenger) entered Station A at the specified date and time.

[0039] The details in the second and third lines indicate, respectively, that this user was on platform 4 of Station A, in car number 10 of the XX line, at the time in question. The details in the fourth line indicate that this user exited at Station B at the specified date and time.

[0040] Then, the processing unit 55 of the single-transaction details server 5 sends the created single-transaction details data to the fare information server 6. The processing unit 65 of the fare information server 6 then uses the received single-transaction details data to identify the actual travel route for the user, using the entry station information, railway usage information, and exit station information. Subsequently, the processing unit 65 calculates the railway fare based on the actual travel route and, in cooperation with the credit information server 91, executes the fare deduction process.

[0041] Figure 5 is a flowchart showing the processing by the item detail server 5 in the embodiment. In step S11, the processing unit 55 determines whether or not it has acquired face image data from the face information server 4. If Yes, it proceeds to step S12; otherwise, it returns to step S11.

[0042] In step S12, the processing unit 55 registers the individual detail information (a combination of "date and time information, entry station information or exit station information, and user identification information" or "date and time information, railway information used, and user identification information") corresponding to the face image data acquired in step S11 in the individual detail information DB 511.

[0043] Next, in step S13, the processing unit 55 determines whether the single item details registered in step S12 are from the time of departure. If yes, proceed to step S14; otherwise, return to step S11.

[0044] In step S14, the processing unit 55 refers to the single-item detail information DB 511 of the storage unit 51, extracts single-item detail information regarding entry, single-item detail information regarding railway usage, and single-item detail information regarding exit for the user, and creates single-item detail data (Figure 4).

[0045] Next, in step S15, the processing unit 55 transmits the single-item detail data created in step S14 to the fare information server 6.

[0046] Figure 6 is a flowchart showing the processing by the fare information server 6 in the embodiment. The processing unit 65 determines whether or not it has obtained one item detail data from the item detail server 5. If yes, it proceeds to step S22; otherwise, it returns to step S21.

[0047] In step S22, the processing unit 65 identifies the actual travel route for the user based on the single-item details data received in step S21, using the entry station information, railway usage information, and exit station information.

[0048] Next, in step S23, the processing unit 65 calculates the railway fare based on the actual travel route identified in step S22.

[0049] Next, in step S24, the processing unit 65, in cooperation with the credit information server 91, executes a fare deduction process based on the fare calculated in step S23.

[0050] Thus, according to the fare collection system S of this embodiment, facial information and fare collection methods such as credit cards are registered in advance for railway users, and the actual route taken by the user can be identified by using railway usage information based on facial image data, which is data of the user's face captured while on the railway vehicle, in addition to entry station information and exit station information.

[0051] For example, with conventional technology, when identifying a user's entry and exit stations from captured facial image data, it was not possible to determine whether or not the user used an express train on that section of the line. Therefore, for example, even if a user without an express ticket boarded an express train, the express fare could not be included in the fare, potentially allowing fare evasion (so-called fare rubbing). According to this embodiment, by using railway usage information, such fare evasion can be prevented.

[0052] Furthermore, by identifying the actual travel route, the correct fare can be calculated and the fare deduction process can be executed.

[0053] Furthermore, if entry and exit station information is also identified based on facial image data, users will be able to use the railway without inserting or tapping their tickets or IC cards at the ticket gates, thus improving convenience.

[0054] Furthermore, when acquiring facial image data of passengers on trains in order to obtain information about the railways used, the probability that a passenger actually used that particular railway can be further improved by acquiring facial image data when the train doors are closed.

[0055] Furthermore, if a train has different types of seats, such as unreserved seats, reserved seats, and Green Cars, the type of train car a passenger is riding in can be easily identified by using facial image data, which is data of the passenger's face captured while they are on board. Therefore, this identification can be reflected in fare calculations.

[0056] Furthermore, when creating entry and exit details for users passing through ticket gates, if, for example, sensors can determine the user's body size when they pass through the gate, that information may also be included in the details. This would improve the likelihood of resolving any doubts that may arise later regarding the user's actions by using that information.

[0057] While embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications are permitted without departing from the spirit of the invention. These embodiments and their variations are included within the scope and spirit of the invention, as well as within the scope of the claims and their equivalents.

[0058] Furthermore, the programs executed in the face information server 4, the item details server 5, the fare information server 6, etc., of this embodiment can be provided as installable or executable files recorded on a recording medium readable by a computer device, such as a CD (Compact Disc)-ROM (Read Only Memory), a flexible disk (FD), a CD-R (Recordable), or a DVD (Digital Versatile Disk). Alternatively, these programs may be provided or distributed via a network such as the Internet. [Explanation of Symbols]

[0059] 1...Railway operator, 2...Server room, 3...Station / railway, 4...Facial information server, 5...Individual transaction details server, 6...Fare information server, 7...In-railway camera, 8...Ticket gate camera, 9...External system, 51...Storage unit, 52...Input unit, 53...Output unit, 54...Communication unit, 55...Processing unit, 61...Storage unit, 62...Input unit, 63...Output unit, 64...Communication unit, 65...Processing unit, 511...Individual transaction details database, 611...Fare information database, S...Fare collection system

Claims

1. The system acquires user identification information, which is the identification information of users entering or exiting a transportation station through a ticket gate, and registers a combination of date and time information, entry station information or exit station information, and the aforementioned user identification information as a single detailed record in the storage unit. The system acquires facial image data, which is data of the faces of users riding the aforementioned transportation, and identifies the user identification information corresponding to the acquired facial image data based on correspondence information that has been pre-associated for each user with user identification information. The system then registers the date and time information, the transportation information used, and the identified user identification information as a single detailed record in the storage unit. A boarding route identification device comprising a processing unit that, when user identification information of a user exiting from the ticket gate is obtained, identifies the actual boarding route for the user based on a plurality of single-item details stored in the storage unit, using the entry station information, the transportation information used, and the exit station information.

2. The boarding route identification device according to claim 1, wherein the processing unit calculates the fare for the transportation based on the actual boarding route and performs the fare deduction process.

3. The boarding route identification device according to claim 1, wherein the processing unit acquires face image data which is data of the face of a user entering or exiting the ticket gate, identifies the user identification information corresponding to the acquired face image data based on the correspondence information, and registers the combination of date and time information, entry station information or exit station information, and the identified user identification information as a single detailed information in the storage unit.

4. The passenger route identification device according to claim 1, wherein the processing unit acquires the facial image data of a passenger riding in the transportation vehicle when the doors of the transportation vehicle are closed.

5. The processing unit, The system acquires user identification information, which is the identification information of users entering or exiting a transportation station through a ticket gate, and registers a combination of date and time information, entry station information or exit station information, and the aforementioned user identification information as a single detailed record in the storage unit. The system acquires facial image data, which is data of the faces of users riding the aforementioned transportation, and identifies the user identification information corresponding to the acquired facial image data based on correspondence information that has been pre-associated for each user with user identification information. The system then registers the date and time information, the transportation information used, and the identified user identification information as a single detailed record in the storage unit. A method for identifying a boarding route, which, when user identification information of a user exiting from the ticket gate is obtained, identifies the actual boarding route for the user based on a plurality of single-item details stored in the storage unit, using the entry station information, the transportation information used, and the exit station information.

6. Computers, The system acquires user identification information, which is the identification information of users entering or exiting a transportation station through a ticket gate, and registers a combination of date and time information, entry station information or exit station information, and the aforementioned user identification information as a single detailed record in the storage unit. The system acquires facial image data, which is data of the faces of users riding the aforementioned transportation, and identifies the user identification information corresponding to the acquired facial image data based on correspondence information that has been pre-associated for each user with user identification information. The system then registers the date and time information, the transportation information used, and the identified user identification information as a single detailed record in the storage unit. A program to function as a processing unit that, when user identification information of a user exiting from the ticket gate is obtained, identifies the actual travel route for that user based on a plurality of single-item details stored in the storage unit, using the entry station information, the transportation information used, and the exit station information.

Images