Server device, control method for server device, and program

Abstract

We provide server equipment that contributes to the promotion of sales of transportation tickets and similar items. [Solution] The server device comprises an acquisition means, an authentication means, and a provision means. The acquisition means acquires image data captured by a camera from a vehicle equipped with a camera. The authentication means authenticates and identifies passengers who intend to board the vehicle. The provision means provides the acquired image data to the identified passenger. The server device may further include a storage means that stores the biometric information of multiple ticket purchasers in association with ticket information related to the purchased ticket. The authentication means may acquire the biometric information of a person to be authenticated who intends to board the vehicle, and identify the person to be authenticated from among multiple ticket purchasers by performing a matching process using the acquired biometric information and multiple stored biometric information.

Description

Technical Field

[0006] , , ,

[0007] , ,

[0001] The present invention relates to a server device, a control method for the server device, and a program.

Background Art

[0002] There is a technology in which a user who has purchased a ticket for entering an event venue or the like is given a privilege by undergoing face authentication (see, for example, paragraphs

[0076] to

[0078] of Patent Document 1).

Prior Art Documents

Patent Documents

[0003] ​​​​​​​​​​​​​​​​​​​​​​​​​​​​A second aspect of the present invention provides a control method for a server device, comprising: an acquisition step of acquiring image data captured by a camera from a vehicle equipped with a camera; an authentication step of authenticating and identifying a passenger who intends to board the vehicle; and a provision step of providing the acquired image data to the identified passenger.

[0008] According to a third aspect of the present invention, a computer mounted on a server device is provided with a program to perform the following: an acquisition process for acquiring image data captured by a camera from a vehicle equipped with a camera; an authentication process for authenticating and identifying a passenger who intends to board the vehicle; and a provision process for providing the acquired image data to the identified passenger. [Effects of the Invention]

[0009] According to each aspect of the present invention, a server device, a control method for the server device, and a program are provided that contribute to the promotion of sales of tickets for means of transport, etc. However, the effects of the present invention are not limited to those described above. The present invention may produce other effects in lieu of or in conjunction with the effects described above. [Brief explanation of the drawing]

[0010] [Figure 1] Figure 1 is a diagram illustrating the outline of one embodiment. [Figure 2] Figure 2 is a flowchart illustrating the operation overview of one embodiment. [Figure 3] Figure 3 shows an example of a schematic configuration of an information processing system according to the embodiment of this disclosure. [Figure 4] Figure 4 is a diagram illustrating the operation of an information processing system according to an embodiment of this disclosure. [Figure 5] Figure 5 is a diagram illustrating the operation of an information processing system according to an embodiment of this disclosure. [Figure 6] Figure 6 shows an example of the processing configuration of a server device according to the present disclosure. [Figure 7]Figure 7 shows an example of a user management database according to an embodiment of this disclosure. [Figure 8] Figure 8 is a flowchart showing an example of the operation of the authentication unit according to the present disclosure. [Figure 9] Figure 9 is a flowchart showing an example of the operation of the service control unit according to the present disclosure. [Figure 10] Figure 10 shows an example of the processing configuration of an authentication terminal according to an embodiment of this disclosure. [Figure 11] Figure 11 is a sequence diagram showing an example of the operation of an information processing system according to the embodiment of this disclosure. [Figure 12] Figure 12 shows an example of the hardware configuration of the server device related to this disclosure. [Modes for carrying out the invention]

[0011] First, an overview of one embodiment will be described. The reference numerals in the drawings attached to this overview are provided for convenience as examples to aid understanding, and this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. The connecting lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows schematically indicate the flow of the main signal (data) and do not exclude bidirectional flow. In this specification and in the drawings, elements that can be similarly described are given the same reference numerals to avoid redundant explanation.

[0012] A server device 100 according to one embodiment includes an acquisition means 101, an authentication means 102, and a providing means 103 (see Figure 1). The acquisition means 101 acquires image data captured by a camera from a vehicle equipped with a camera (step S1 in Figure 2). The authentication means 102 authenticates and identifies a passenger who intends to board the vehicle (passenger identification; step S2). The providing means 103 provides the acquired image data to the identified passenger (step S3).

[0013] The server device 100 provides the image data obtained from cameras installed on vehicles such as trains, ships, and airplanes to the passengers of the vehicle. For example, the server device 100 identifies the passengers of the vehicle through biometric authentication or the like. The server device 100 provides the identified passengers with the image data obtained from the above cameras. By installing the cameras for acquiring the image data at locations where ordinary passengers cannot take pictures of landscapes or the like, the server device 100 can provide attractive image data (for example, spectacular photos taken from an airplane in flight) for the passengers of the vehicle (ticket purchasers of the vehicle). As a result, users are motivated to use the vehicle, and the sale of tickets for the vehicle is promoted.

[0014] Specific embodiments will be described in more detail below with reference to the drawings.

[0015] [First Embodiment] The first embodiment will be described in more detail with reference to the drawings.

[0016] The information processing system according to the first embodiment realizes a service that provides images (still images, moving images) obtained from a vehicle (means of transportation) operated by a transportation agency such as a train, an airplane, a ship, or a bus to users of the vehicle. For example, for a passenger on an airplane, an image (an image taken by the airplane in flight) obtained from a camera attached to the tip (nose) of the airplane is provided.

[0017] [Configuration of the System] FIG. 3 is a diagram showing an example of the schematic configuration of the information processing system according to the embodiment disclosed in the present application. As shown in FIG. 3, the information processing system includes a server device 10 and an authentication terminal 20.

[0018] Server device 10 is a server managed and operated by a transportation company. Server device 10 is a device that sells tickets for transportation and authenticates ticket purchasers. In the first embodiment, we will describe a case in which server device 10 sells tickets for an aircraft and authenticates passengers for that aircraft. Furthermore, server device 10 is also a device that realizes the image provision service described above.

[0019] The server device 10 may be installed inside a transportation facility building, or it may be installed on a network (on the cloud).

[0020] The authentication terminal 20 is a device that serves as an interface for authenticating the person to be authenticated. For example, the authentication terminal 20 is installed at the entrance of a boarding gate. As shown in Figure 3, in the first embodiment, a gate-type authentication terminal 20 will be used as an example for explanation.

[0021] However, the authentication terminal 20 is not limited to gate-type terminals; it may also be a tablet-type or signage-type terminal. Alternatively, the authentication terminal 20 may be a kiosk terminal. The authentication terminal 20 can be any device equipped with a camera. It is sufficient that a terminal or device that matches the transportation company's policies and the type of vehicle is installed as the authentication terminal 20.

[0022] As shown in Figure 3, the aircraft 30 is equipped with a camera 31 at its nose. The aircraft 30 can also connect to the internet via satellite communication or the like. Furthermore, the aircraft 30 provides Wi-Fi (Wireless Fidelity) connectivity services to passengers on board.

[0023] Users operate the terminal 40 to input information into the server device 10 or to retrieve information from the server device 10.

[0024] The devices shown in Figure 3 are interconnected. Specifically, the server device 10, authentication terminal 20, aircraft 30, and terminal 40 are connected by wired or wireless communication means and are configured to communicate with each other.

[0025] Figure 3 is illustrative and not intended to limit the configuration of the information processing system disclosed in this application. For example, the information processing system may include multiple server devices 10. Load balancing and redundancy may be achieved by the multiple server devices 10. Also, although Figure 3 shows one aircraft 30, in reality, the information processing system may include multiple aircraft 30 (vehicles).

[0026] [General operation] Next, we will describe the general operation of the information processing system according to the first embodiment.

[0027] <Purchase Tickets> The user purchases a ticket to board aircraft 30. For example, the user operates terminal 40 to access a ticket sales website provided by server device 10. The user purchases a ticket (airline ticket) on the ticket sales website.

[0028] Server device 10 obtains the name, gender, date of birth, address, biometric information, telephone number, email address, etc., of ticket purchasers on the ticket sales website. Server device 10 associates the obtained user information with the information of the tickets sold to those users (ticket information; for example, flight number, departure airport, arrival airport, departure date, departure time, etc.) and stores it in the user management database. Details of the user management database will be described later.

[0029] Examples of biometric information include data (feature quantities) calculated from individual physical characteristics such as face, fingerprints, voiceprints, veins, retina, and iris patterns. Alternatively, the user's biometric information may be image data such as a face image or fingerprint image. The user's biometric information only needs to include information about the user's physical characteristics. In the first embodiment, the biometric information is a person's face image or feature quantities generated from a face image.

[0030] <Boarding the aircraft> The user (passenger) boards the aircraft 30 by passing through the authentication terminal 20. When the authentication terminal 20 detects the person to be authenticated, it acquires the person's biometric information (e.g., facial image). The authentication terminal 20 sends an "authentication request" containing the acquired biometric information and terminal ID to the server device 10 (see Figure 4).

[0031] The terminal ID is an ID used to identify the authentication terminal 20. The terminal ID can be the MAC (Media Access Control) address or IP (Internet Protocol) address of the authentication terminal 20.

[0032] The server device 10 performs biometric authentication using the biometric information included in the authentication request and the biometric information stored in the user management database. The server device 10 identifies the person to be authenticated (the person attempting to pass through the authentication terminal 20) through a matching process (authentication process) using the biometric information.

[0033] Furthermore, the server device 10 identifies the authentication terminal 20 that sent the authentication request based on the terminal ID included in the authentication request. The server device 10 also identifies the boarding gate where the authentication terminal 20 is located based on the terminal ID.

[0034] The server device 10 determines that authentication is successful if the identified person to be authenticated has a valid ticket to board the aircraft 30 parked beyond the boarding gate. If the person to be authenticated does not have a valid ticket, the server device 10 determines that authentication has failed.

[0035] The server device 10 notifies the authentication terminal 20 of the authentication result (authentication successful, authentication failed). The server device 10 also updates the status of the authenticated person, who is determined to have successfully authenticated, to "boarded".

[0036] The authentication terminal 20 performs processing according to the authentication result. For example, if authentication success is notified, the authentication terminal 20 opens the gate and allows the authenticated person to pass through the gate. If authentication failure is notified, the authentication terminal 20 closes the gate and refuses the authenticated person to pass through the gate.

[0037] <Image provision service> When the aircraft 30 departs from the airport, it transmits image data obtained from the camera 31 (image data obtained during flight) to the server device 10. The aircraft 30 transmits image data to the server device 10 periodically or at predetermined intervals. More specifically, the aircraft 30 transmits an "image data notification" containing the aircraft ID and image data to the server device 10 (see Figure 5).

[0038] The aircraft ID is an identifier used to identify aircraft 30. The aircraft ID can use the MAC (Media Access Control) address or IP (Internet Protocol) address of aircraft 30.

[0039] Upon receiving the image data notification, the server device 10 identifies the aircraft 30 that sent the image data notification using the aircraft ID included in the notification. The server device 10 searches the user management database and extracts the passengers of the identified aircraft 30.

[0040] The server device 10 sends the image data included in the image data notification to the terminal 40 held by the extracted passenger. For example, the server device 10 sends the image data to the email address of the extracted passenger.

[0041] The terminal 40 that receives the image data displays or stores the received image data.

[0042] Next, we will describe the details of each device included in the information processing system according to the first embodiment.

[0043] [Server equipment] Figure 6 shows an example of the processing configuration (processing module) of the server device 10 according to the embodiment disclosed herein. Referring to Figure 6, the server device 10 comprises a communication control unit 201, a ticket sales control unit 202, an authentication unit 203, a service control unit 204, and a storage unit 205.

[0044] The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the authentication terminal 20. The communication control unit 201 also transmits data to the authentication terminal 20. The communication control unit 201 passes the data received from other devices to other processing modules. The communication control unit 201 transmits the data obtained from other processing modules to other devices. In this way, other processing modules send and receive data with other devices via the communication control unit 201. The communication control unit 201 has the function of a receiving unit that receives data from other devices and the function of a transmitting unit that transmits data to other devices.

[0045] The ticket sales control unit 202 is a means for controlling the sale of tickets for the aircraft 30 (vehicle).

[0046] When a user operates terminal 40 and accesses the ticket sales website, the ticket sales control unit 202 sells a ticket to the user. When the ticket sales control unit 202 sells a ticket, it generates ticket information (for example, information including flight number, departure airport, arrival airport, departure date, departure time, etc.).

[0047] Furthermore, when selling tickets, the ticket sales control unit 202 acquires information about the ticket purchaser. For example, the ticket sales control unit 202 acquires the ticket purchaser's name, gender, date of birth, address, biometric information (facial image), telephone number, email address, etc.

[0048] Upon obtaining information about the ticket purchaser, the ticket sales control unit 202 generates a user ID to identify the ticket purchaser. The ticket sales control unit 202 also generates feature vectors from the facial image obtained from the user.

[0049] Since existing technologies can be used for the feature generation process by the ticket sales control unit 202, a detailed explanation will be omitted. For example, the ticket sales control unit 202 extracts the eyes, nose, mouth, etc., from a face image as feature points. Then, the ticket sales control unit 202 calculates the position of each feature point and the distance between each feature point as feature quantities (generating a feature vector consisting of multiple feature quantities).

[0050] The ticket sales control unit 202 stores user ID, name, gender, biometric information (features), telephone number, email address, ticket information, etc., in the user management database (see Figure 7). Note that the user management database shown in Figure 7 is an example and is not intended to limit the items to be stored. For example, a "facial image" may be registered in the user management database as biometric information.

[0051] The ticket sales control unit 202 issues the generated user ID to the terminal 40 as needed. The terminal 40 stores the acquired user ID.

[0052] Please note that detailed explanations regarding the sale of tickets (airline tickets) will be omitted. This is because details regarding the sale of tickets, etc., are outside the scope of the disclosures made in this application.

[0053] The authentication unit 203 is a means for authenticating the person to be authenticated. The authentication unit 203 authenticates and identifies passengers who intend to board the aircraft 30 (vehicle). The authentication unit 203 processes authentication requests received from the authentication terminal 20.

[0054] The authentication unit 203 obtains the biometric information of the person to be authenticated who intends to board the aircraft 30 (vehicle) from the authentication terminal 20, and performs a matching process using the obtained biometric information and multiple biometric information stored in the user management database. By performing the matching process, the authentication unit 203 identifies the person to be authenticated from among multiple ticket purchasers and authenticates the identified person based on the ticket information of the identified person. The authentication unit 203 notifies the authentication result to the authentication terminal 20. Furthermore, if the authentication unit 203 successfully authenticates the identified person, it sets the status of the identified person to "boarded" (onboard).

[0055] Figure 8 is a flowchart showing an example of the operation of the authentication unit 203 according to the embodiment disclosed herein. The operation of the authentication unit 203 will be explained with reference to Figure 8.

[0056] Upon receiving an authentication request, the authentication unit 203 performs a matching process using the biometric information contained in the authentication request and the biometric information stored in the user management database (step S101).

[0057] The authentication unit 203 generates feature quantities from the facial image included in the authentication request.

[0058] The authentication unit 203 performs a matching process using the generated feature vectors and multiple feature vectors stored in the user management database. Specifically, the authentication unit 203 sets the generated feature vectors as the matching side and the multiple feature vectors registered in the user management database as the registration side, and performs a one-to-many matching (where N is a positive integer, and the same applies hereafter).

[0059] More specifically, the authentication unit 203 calculates the similarity between the feature quantities to be matched and each of the multiple feature quantities on the registration side. This similarity can be calculated using methods such as the chi-squared distance or the Euclidean distance. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

[0060] The authentication unit 203 determines that the matching process has failed if, among the multiple features registered in the user management database, there is no feature whose similarity to the feature to be matched is equal to or greater than a predetermined value.

[0061] The authentication unit 203 determines that the matching process is successful if, among the multiple features registered in the user management database, there is a feature whose similarity to the feature to be matched is equal to or greater than a predetermined value. If the matching process is successful, the user (ticket purchaser) corresponding to the entry with the feature that has the highest similarity is identified as the person to be authenticated.

[0062] If the matching process fails (step S102, No branch), the authentication unit 203 sets the authentication result to authentication failure (step S103).

[0063] If the matching process is successful (step S102, Yes branch), the authentication unit 203 determines whether the person to be authenticated identified by the matching process has a valid ticket (ticket determination; step S104).

[0064] First, the authentication unit 203 identifies the boarding gate where the authentication terminal 20, the source of the authentication request, is located, based on the terminal ID included in the authentication request. The authentication unit 203 then obtains the flight number corresponding to the flight of the aircraft 30 parked beyond the identified boarding gate.

[0065] Furthermore, transportation personnel will set flight information for aircraft 30 on the server device 10. Specifically, the personnel will set the flight schedule for each boarding gate on the server device 10. The personnel will set the boarding gate number and flight schedule (departure time, flight number, etc.) on the server device 10.

[0066] The authentication unit 203 refers to information set by the person in charge of the transportation service and obtains the flight number of the aircraft 30 parked beyond the boarding gate where the authentication terminal 20 that the person to be authenticated is about to pass through is located.

[0067] Subsequently, the authentication unit 203 determines whether the flight number obtained from the user's ticket information identified through the matching process matches the flight number corresponding to the flight of the aircraft 30 parked beyond the boarding gate where the authentication terminal 20 is installed.

[0068] If the two flight numbers match, the authentication unit 203 determines that the person being authenticated has a valid ticket. If the two flight numbers do not match, the authentication unit 203 determines that the person being authenticated does not have a valid ticket.

[0069] If the person being authenticated does not have a valid ticket (step S105, No branch), the authentication unit 203 sets the authentication result to authentication failure (step S103).

[0070] If the person being authenticated has a valid ticket (step S105, Yes branch), the authentication unit 203 sets the authentication result to authentication successful (step S106).

[0071] Furthermore, the authentication unit 203 updates the status of the authenticated person (passenger) identified through the matching process to "boarded".

[0072] The authentication unit 203 transmits the authentication result (authentication successful, authentication failed) to the authentication terminal 20 (step S107). If authentication is successful, the authentication unit 203 transmits an affirmative response to the authentication terminal 20. If authentication fails, the authentication unit 203 transmits a negative response to the authentication terminal 20.

[0073] Each entry in the user management database is deleted at predetermined times. For example, when aircraft 30 arrives at its destination airport, the entry of the user who purchased a ticket for aircraft 30 is deleted. For example, the ticket sales control unit 202 can obtain information about aircraft 30 that has arrived at its destination airport (e.g., flight number) from the person in charge and delete the entry corresponding to the obtained information.

[0074] The service control unit 204 is a means for performing control related to the image provision service provided to the user.

[0075] The service control unit 204 functions as an acquisition means, acquiring image data captured by a camera from a vehicle (aircraft 30) equipped with a camera. The service control unit 204 also functions as a provision means, providing the acquired image data to the passengers of the vehicle. The service control unit 204 acquires image data from a camera 31 attached to the front of the aircraft 30 (vehicle) while the vehicle is in motion.

[0076] Figure 9 is a flowchart showing an example of the operation of the service control unit 204 according to the embodiment disclosed herein. The operation of the service control unit 204 will be described with reference to Figure 9.

[0077] The service control unit 204 receives an image data notification from the aircraft 30 (step S201).

[0078] Upon receiving an image data notification, the service control unit 204 extracts the passengers on board the aircraft 30 that sent the image data notification from the user management database (step S202).

[0079] Specifically, the service control unit 204 identifies the flight number of aircraft 30 based on the aircraft ID included in the image data notification. For example, the service control unit 204 refers to table information that stores the correspondence between flights (flight numbers) and aircraft IDs, and obtains the flight number corresponding to the acquired aircraft ID. This table information is pre-configured in the server device 10 by the transportation company's personnel or other relevant parties.

[0080] Upon obtaining the flight number, the service control unit 204 searches the user management database using the obtained flight number as a key and extracts the corresponding entry. Furthermore, the service control unit 204 extracts entries from the extracted entries in which the status field is set to "Boarded" (passengers on aircraft 30).

[0081] The service control unit 204 sends the image data included in the image data notification to the contacts (email addresses that the terminal 40 can receive) listed in at least one of the extracted entries (step S203). The service control unit 204 also sends the image data captured by the camera 31 installed on the aircraft 30 to the passengers on board the aircraft 30 that is the source of the image data notification.

[0082] In this manner, the service control unit 204 provides image data obtained from the aircraft 30 to ticket purchasers (passengers on the aircraft 30) who are determined to have successfully authenticated after processing the authentication request received from the authentication terminal 20. More specifically, the service control unit 204 sends the obtained image data to the contact information (email address) of the ticket purchaser who is determined to have successfully authenticated.

[0083] The storage unit 205 is a means for storing information necessary for the operation of the server device 10. The storage unit 205 uses a user management database to store the biometric information of multiple ticket purchasers who have purchased tickets for a ride, associating it with the ticket information related to those tickets. Furthermore, the storage unit 205 stores the biometric information, ticket information, and contact information of each of the multiple ticket purchasers, associating them with each other.

[0084] [Authentication device] Figure 10 is a diagram showing an example of the processing configuration (processing module) of an authentication terminal 20 according to the embodiment disclosed herein. Referring to Figure 10, the authentication terminal 20 comprises a communication control unit 301, a biometric information acquisition unit 302, an authentication request unit 303, and a storage unit 304.

[0085] The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the server device 10. The communication control unit 301 also transmits data to the server device 10. The communication control unit 301 passes the data received from other devices to other processing modules. The communication control unit 301 transmits the data acquired from other processing modules to other devices. In this way, other processing modules send and receive data with other devices via the communication control unit 301. The communication control unit 301 has the function of a receiving unit that receives data from other devices and the function of a transmitting unit that transmits data to other devices.

[0086] The biometric information acquisition unit 302 is a means for controlling the camera and acquiring the biometric information (e.g., facial image) of the person being authenticated. The biometric information acquisition unit 302 periodically or at predetermined intervals images the area in front of the device. The biometric information acquisition unit 302 determines whether or not a facial image is included in the acquired image, and if a facial image is included, it extracts the facial image from the acquired image data.

[0087] The biometric information acquisition unit 302 hands over the extracted facial image to the authentication request unit 303.

[0088] The authentication request unit 303 is a means of requesting authentication of the person to be authenticated from the server device 10. The authentication request unit 303 sends an authentication request to the server device 10 that includes the biometric information obtained from the biometric information acquisition unit 302 and the terminal ID. The terminal ID is pre-set on the authentication terminal 20.

[0089] The authentication request unit 303 receives the authentication result (authentication successful, authentication failed) from the server device 10.

[0090] If a negative response (authentication failure) is received, the authentication request unit 303 closes the gate and refuses passage to the person being authenticated.

[0091] If an affirmative response (successful authentication) is received, the authentication request unit 303 opens the gate and allows the person to pass through.

[0092] The memory unit 304 stores information necessary for the operation of the authentication terminal 20.

[0093] [aircraft] The configuration of the aircraft 30 is obvious to those skilled in the art, so a detailed explanation is omitted. The aircraft 30 is equipped with a camera 31 at the front of the fuselage or elsewhere. The aircraft 30 only needs to transmit the image data obtained from the camera 31 and an image data notification including the aircraft ID to the server device 10.

[0094] [Terminal] Examples of terminal 40 include mobile devices such as smartphones, mobile phones, game consoles, and tablets, as well as computers (personal computers, laptops). Terminal 40 can be any device or equipment as long as it can receive user input and communicate with the server device 10, etc. Furthermore, the configuration of terminal 40 is obvious to those skilled in the art, so a detailed explanation is omitted.

[0095] [System operation] Next, the operation of the information processing system according to the first embodiment will be described.

[0096] Figure 11 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment disclosed herein. The operation of the information processing system according to the embodiment disclosed herein will be explained with reference to Figure 11.

[0097] When the authentication terminal 20 detects a person to be authenticated, it sends an authentication request including the biometric information of the person to be authenticated to the server device 10 (step S01).

[0098] The server device 10 performs authentication processing using the biometric information of the person to be authenticated and the biometric information stored in the user management database (step S02).

[0099] The server device 10 sends the authentication result to the authentication terminal 20 (step S03).

[0100] The aircraft 30 transmits an image data notification containing image data to the server device 10 (step S11).

[0101] The server device 10 transmits the received image data to the passenger (terminal 40) on board the aircraft 30 (step S12).

[0102] Next, a modified example of the first embodiment will be described.

[0103] <Example 1> In the above embodiment, the case in which the server device 10 transmits image data to each passenger on board the aircraft 30 was described. However, the server device 10 may transmit image data to a passenger on board the aircraft 30 in response to a request from that passenger.

[0104] For example, the service control unit 204 of the server device 10 stores the image data received from the aircraft 30 in association with the flight number of the aircraft 30.

[0105] Users who wish to obtain image data operate terminal 40 to acquire biometric information (e.g., facial image). The user takes a so-called selfie. Terminal 40 sends an "image data provision request" containing the acquired facial image to server device 10.

[0106] The service control unit 204 performs a matching process using the biometric information included in the image data provision request and the biometric information stored in the user management database to identify the person who wishes to receive the image data.

[0107] If the status of the identified service provider is "boarded," the service control unit 204 transmits all or part of the stored image data to the service provider. The service control unit 204 obtains the flight number from the ticket information of the identified service provider and transmits the image data (image data received and stored from the aircraft 30) corresponding to the obtained flight number to the service provider's terminal 40.

[0108] The service control unit 204 does not send image data to the terminal 40 of the identified service requestor if the status of the requestor is other than "boarded" or if there is no corresponding entry.

[0109] In this manner, the service control unit 204 stores image data acquired from the aircraft 30 and, in response to requests from passengers of the aircraft 30, provides all or part of the stored image data to the passengers of the aircraft 30. More specifically, the service control unit 204 acquires the biometric information of the passenger requesting the image data and performs a matching process using the acquired biometric information and multiple biometric information stored in the user management database. By performing the matching process, the service control unit 204 identifies the passenger requesting the image data, and if the identified passenger is on board (currently on board), it provides all or part of the stored image data to the passenger requesting the image data.

[0110] <Modification 2> In the above embodiment, the server device 10 was described as determining whether or not a user is on board the aircraft 30 based on an authentication request received from the authentication terminal 20. However, the server device 10 may also detect users on board the aircraft 30 using image data acquired from a camera (a different camera from camera 31; not shown in Figure 3, etc.) installed on the doors of the aircraft 30.

[0111] For example, the authentication unit 203 acquires image data from a camera installed on the passenger cabin door of the aircraft 30, which is positioned to photograph passengers boarding the aircraft. The authentication unit 203 attempts to extract biometric information (facial image) from the acquired image data.

[0112] Once a facial image is extracted, the authentication unit 203 performs a matching process using the extracted facial image and the biometric information stored in the user management database. The authentication unit 203 sets the status of the user identified through the matching process to "boarded".

[0113] As described above, the server device 10 according to the first embodiment provides passengers of the aircraft 30 with image data obtained from a camera 31 installed on the aircraft 30. Because the camera 31 is installed at the front of the aircraft 30, passengers can acquire scenery and other images that they would not normally be able to photograph, so the server device 10 can provide attractive image data to passengers (ticket purchasers for the aircraft 30). As a result, users will be motivated to use the aircraft 30, and the sale of airline tickets will be promoted. In this way, the server device 10 contributes to improving customer satisfaction by transportation companies.

[0114] Next, we will describe the hardware of each device that makes up the information processing system. Figure 12 shows an example of the hardware configuration of server device 10.

[0115] The server device 10 can be configured using an information processing device (a so-called computer), and has the configuration illustrated in Figure 12. For example, the server device 10 includes a processor 311, memory 312, input / output interface 313, and communication interface 314, etc. The components of the processor 311, etc., are connected by an internal bus or the like and are configured to communicate with each other.

[0116] However, the configuration shown in Figure 12 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and it may not have to have an input / output interface 313 if necessary. Also, the number of processors 311 etc. included in the server device 10 is not limited to the example in Figure 12; for example, multiple processors 311 may be included in the server device 10.

[0117] The processor 311 is a programmable device such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or DSP (Digital Signal Processor). Alternatively, the processor 311 may be a device such as an FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit). The processor 311 executes various programs, including an operating system (OS).

[0118] Memory 312 includes RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc. Memory 312 stores the OS program, application programs, and various data.

[0119] The input / output interface 313 is an interface for a display device or input device (not shown). The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user input such as a keyboard, mouse, or touch panel.

[0120] The communication interface 314 is a circuit, module, etc., that communicates with other devices. For example, the communication interface 314 includes a NIC (Network Interface Card), etc.

[0121] The functions of the server device 10 are realized by various processing modules. These processing modules are realized, for example, by the processor 311 executing a program stored in memory 312. The program can also be recorded on a computer-readable storage medium. The storage medium can be a non-transitory material such as semiconductor memory, hard disk, magnetic recording medium, or optical recording medium. In other words, the present invention can also be embodied as a computer program product. Furthermore, the program can be downloaded via a network or updated using the storage medium on which the program is stored. Moreover, the processing module may be realized by a semiconductor chip.

[0122] Furthermore, the authentication terminal 20, etc., can also be configured using an information processing device, similar to the server device 10, and its basic hardware configuration is no different from that of the server device 10, so a detailed explanation will be omitted.

[0123] The server device 10 is equipped with a computer, and its functions can be realized by having the computer execute a program. Furthermore, the server device 10 executes a control method for the server device 10 using this program.

[0124] [Differentiation] The configuration and operation of the information processing system described in the above embodiment are illustrative examples and are not intended to limit the system configuration.

[0125] In the above embodiment, the configuration and operation of the information processing system were described using an aircraft 30 as an example of a vehicle. However, the information processing system may be applied to vehicles other than the aircraft 30. For example, the camera 31 may be installed on a vehicle such as a train, ship, or bus.

[0126] The above embodiment describes a case where the camera 31 is mounted on the front of the aircraft 30. However, the camera 31 may be mounted in other locations. For example, the camera 31 may be mounted on the tail or bottom of the aircraft. Alternatively, multiple cameras 31 may be mounted on the aircraft 30.

[0127] A dedicated application for acquiring image data may be installed on the user's terminal 40. The terminal 40 and the server device 10 may send and receive image data via the installed application. For example, when a passenger boards the aircraft 30, they launch the application. The application sends a user ID obtained from the server device 10 to the server device 10. The service control unit 204 of the server device 10 identifies the user (passenger) based on the received user ID. If the status of the identified user is "boarded", the service control unit 204 sends image data to the running application.

[0128] The server device 10 may obtain from the user whether or not they wish to receive the image provision service when selling tickets. The service control unit 204 may transmit image data to passengers of the aircraft 30 who wish to receive the image provision service.

[0129] The server device 10 may store image data received from the aircraft 30 and select image data to provide to passengers from the stored image data. For example, the service control unit 204 may select image data that would receive good ratings when posted on a social networking service (SNS) or image data that symbolizes the flight path of the aircraft 30 and send it to passengers. For example, the service control unit 204 may use a learning model obtained by machine learning to select image data to provide to users from among multiple image data.

[0130] Alternatively, the service control unit 204 may select image data to provide to each passenger according to each passenger's attribute information (e.g., gender, age). For example, the service control unit 204 may select image data for men in their 20s and image data for women in their 60s.

[0131] The aircraft 30 may transmit image data (video) captured by the camera 31 to the server device 10 in real time. In this case, the server device 10 may provide the acquired image data to passengers (terminals 40) in real time. For example, the server device 10 may distribute the acquired image data to terminals 40 carried by each passenger.

[0132] Alternatively, the user may save any image data (video) they wish to save from the image data (video) distributed from the server device 10. Specifically, the terminal 40 stores the image data acquired from the server device 10 in response to the user's operation.

[0133] The server device 10 may transmit image data acquired from the aircraft 30 to a device such as a tablet installed inside the aircraft 30.

[0134] In the above embodiment, the case in which the person to be authenticated is authenticated using an authentication terminal 20 equipped with a gate was described. However, the person to be authenticated may also be authenticated by so-called gateless authentication. In this case, staff members wait near the vehicle, and the authentication result of the person to be authenticated is notified to the staff. If the authentication result of the person to be authenticated is an authentication failure, the staff refuses the person to board the vehicle.

[0135] The above embodiment describes a case where the user purchases a ticket in advance to ride the vehicle. However, a ticket may not be required to ride the vehicle. In this case, the user accesses the server device 10 and creates an account. The server device 10 stores the user's name, biometric information, and account information (e.g., credit card information) in the account. The server device 10 determines when a passenger boards and alights by matching the biometric information of the authenticated person acquired by a camera installed on the vehicle with the biometric information registered in the account. The server device 10 can then settle the fare using the credit card information registered in the account when the passenger alights.

[0136] In the above embodiment, the case in which the server device 10 identifies the person to be authenticated by a matching process using biometric information was described. However, the server device 10 may identify the person to be authenticated by other methods. For example, the server device 10 may identify the person to be authenticated by obtaining a user ID from the person to be authenticated. For example, the server device 10 may identify the person to be authenticated by obtaining a user ID issued to the user when the user boards a vehicle. In this case, the user may present a 2D barcode converted from the user ID issued by the server device 10 to the authentication terminal 20, input the user ID into the authentication terminal 20, or have the authentication terminal 20 read a card containing the user ID.

[0137] In the above embodiment, the case in which the user management database is configured inside the server device 10 was described, but the database may be built on an external database server or the like. In other words, some functions of the server device 10 may be implemented in another device. More specifically, it is sufficient that the "authentication unit (authentication means)" and "service control unit (service control means)" described above are implemented in any device included in the system.

[0138] The form of data transmission and reception between each device (e.g., server device 10, authentication terminal 20, etc.) is not particularly limited, but the data transmitted and received between these devices may be encrypted. Since biometric information and the like are transmitted and received between these devices, it is desirable that encrypted data be transmitted and received in order to properly protect this information.

[0139] In the flowcharts (sequence diagrams) used in the above description, multiple processes (processes) are shown in order, but the execution order of the processes performed in the embodiment is not limited to the order in which they are shown. In the embodiment, the order of the illustrated processes can be changed to the extent that it does not impair the content, for example, by executing each process in parallel.

[0140] The embodiments described above are explained in detail to facilitate understanding of the disclosure, and it is not intended that all the configurations described above are necessary. Furthermore, when multiple embodiments are described, each embodiment may be used individually or in combination. For example, it is possible to replace parts of the configuration of one embodiment with those of another embodiment, or to add configurations from other embodiments to the configuration of one embodiment. In addition, it is possible to add, delete, or replace parts of the configuration of one embodiment with those of another.

[0141] As described above, the industrial applicability of the present invention is clear, and it is particularly suitable for information processing systems that provide image data services to users riding in vehicles.

[0142] Some or all of the above embodiments may also be described as follows, but are not limited to the following:

[0143] [Note 1] An acquisition means for acquiring image data captured by a camera from a vehicle equipped with a camera, Authentication means for authenticating and identifying passengers who intend to board the aforementioned vehicle, A means for providing the acquired image data to the identified passenger, A server device equipped with the following features.

[0144] [Note 2] The system further includes a storage means for storing the biometric information of each of the multiple ticket purchasers who purchased tickets for the aforementioned vehicle, in association with the ticket information related to the purchased tickets. The authentication means is a server device as described in Appendix 1, which obtains biometric information of a person to be authenticated who intends to board the vehicle from an authentication terminal, performs a matching process using the obtained biometric information and the stored multiple biometric information to identify the person to be authenticated from among the multiple ticket purchasers, authenticates the identified person to be authenticated based on the ticket information of the identified person to be authenticated, and notifies the authentication terminal of the authentication result.

[0145] [Note 3] The aforementioned means is a server device as described in Appendix 2, which provides the acquired image data to ticket purchasers who have been determined to have successfully authenticated.

[0146] [Note 4] The storage means stores the biometric information, ticket information, and contact information of each of the multiple ticket purchasers. The aforementioned means is a server device as described in Appendix 3, which transmits the acquired image data to the contact information of the ticket purchaser whose authentication has been determined to be successful.

[0147] [Note 5] The acquisition means stores the image data acquired from the vehicle, The providing means is a server device as described in Appendix 1, which provides all or part of the stored image data to passengers of the vehicle in response to a request from a passenger of the vehicle.

[0148] [Note 6] The system further includes a storage means for storing the biometric information of each of the multiple ticket purchasers who purchased tickets for the aforementioned vehicle, in association with the ticket information related to the purchased tickets. The authentication means obtains the biometric information of the person to be authenticated who intends to board the vehicle from the authentication terminal, performs a matching process using the obtained biometric information and the stored multiple biometric information to identify the person to be authenticated from among the multiple ticket purchasers, authenticates the identified person to be authenticated based on the ticket information of the identified person to be authenticated, and if the authentication of the identified person to be authenticated is successful, sets the status of the identified person to "boarded". The server device described in Appendix 5, wherein the providing means acquires biometric information of a passenger requesting the provision of the image data, performs a matching process using the acquired biometric information and the stored multiple biometric information to identify the passenger requesting the provision of the image data, and, if the identified passenger is already on board, provides all or part of the stored image data to the passenger requesting the provision of the image data.

[0149] [Note 7] The acquisition means is a server device according to any one of the appendices 1 to 6, which acquires the image data from the camera attached to the front of the vehicle while the vehicle is in motion.

[0150] [Note 8] An acquisition step of acquiring image data captured by a camera from a vehicle equipped with a camera, An authentication process for authenticating and identifying passengers who intend to board the aforementioned vehicle, A provision step of providing the acquired image data to the identified passenger, A control method for a server device, comprising the following features.

[0151] [Note 9] The system further includes a memory process that associates the biometric information of each of the multiple ticket purchasers who purchased tickets for the aforementioned vehicle with the ticket information related to the purchased tickets. The authentication step involves obtaining biometric information of a person to be authenticated who intends to board the vehicle from an authentication terminal, performing a matching process using the obtained biometric information and the stored multiple biometric information to identify the person to be authenticated from among the multiple ticket purchasers, authenticating the identified person to be authenticated based on the ticket information of the identified person to be authenticated, and notifying the authentication result to the authentication terminal, as described in Appendix 8, for the server device control method.

[0152] [Note 10] The aforementioned provision process is a control method for the server device described in Appendix 9, which provides the acquired image data to the ticket purchaser whose authentication has been determined to be successful.

[0153] [Note 11] The memory step stores the biometric information, ticket information, and contact information of each of the multiple ticket purchasers. The aforementioned provision step is a control method for the server device described in Appendix 10, which transmits the acquired image data to the contact information of the ticket purchaser whose authentication has been determined to be successful.

[0154] [Note 12] The acquisition process involves accumulating the image data acquired from the vehicle, The method for controlling the server device described in Appendix 8, wherein the provision step is to provide all or part of the stored image data to the passengers of the vehicle in response to a request from the passengers of the vehicle.

[0155] [Note 13] The system further includes a memory process that associates the biometric information of each of the multiple ticket purchasers who purchased tickets for the aforementioned vehicle with the ticket information related to the purchased tickets. The authentication process involves obtaining biometric information of a person intending to board the vehicle from an authentication terminal, performing a matching process using the obtained biometric information and the stored multiple biometric information to identify the person to be authenticated from among the multiple ticket purchasers, authenticating the identified person based on the ticket information of the identified person, and, upon successful authentication of the identified person, setting the status of the identified person to "boarded". The method for controlling a server device as described in Appendix 12, wherein the provision step involves acquiring biometric information of a passenger requesting the provision of image data, performing a matching process using the acquired biometric information and the stored multiple biometric information to identify the passenger requesting the provision of image data, and, if the identified passenger is on board, providing all or part of the stored image data to the passenger requesting the provision of image data.

[0156] [Note 14] The acquisition step is a control method for a server device according to any one of the appendices 8 to 13, which involves acquiring the image data from a camera attached to the front of the vehicle while the vehicle is in motion.

[0157] [Note 15] The computer installed in the server device An acquisition process for acquiring image data captured by a camera from a vehicle equipped with a camera, Authentication process for authenticating and identifying passengers who intend to board the aforementioned vehicle, The acquired image data is provided to the identified passenger; A program to execute.

[0158] [Note 16] Further memory processing is performed to associate the biometric information of each of the multiple ticket purchasers who purchased tickets for the aforementioned vehicle with the ticket information related to the purchased tickets. The authentication process is a program as described in Appendix 15, which obtains biometric information of a person to be authenticated who intends to board the vehicle from an authentication terminal, performs a matching process using the obtained biometric information and the stored multiple biometric information to identify the person to be authenticated from among the multiple ticket purchasers, authenticates the identified person to be authenticated based on the ticket information of the identified person to be authenticated, and notifies the authentication result to the authentication terminal.

[0159] [Note 17] The aforementioned provision process is the program described in Appendix 16, which provides the acquired image data to the ticket purchaser who has been determined to have successfully authenticated the ticket.

[0160] [Note 18] The memory processing stores the biometric information, ticket information, and contact information of each of the multiple ticket purchasers. The aforementioned provision process is the program described in Appendix 17, which transmits the acquired image data to the contact information of the ticket purchaser whose authentication has been determined to be successful.

[0161] [Note 19] The acquisition process involves accumulating the image data acquired from the vehicle, The provision process is the program described in Appendix 15, which provides all or part of the stored image data to a passenger of the vehicle in response to a request from the passenger of the vehicle.

[0162] [Note 20] Further memory processing is performed to associate the biometric information of each of the multiple ticket purchasers who purchased tickets for the aforementioned vehicle with the ticket information related to the purchased tickets. The authentication process involves obtaining biometric information of the person to be authenticated who intends to board the vehicle from the authentication terminal, performing a matching process using the obtained biometric information and the stored multiple biometric information to identify the person to be authenticated from among the multiple ticket purchasers, authenticating the identified person based on the ticket information of the identified person, and if the authentication of the identified person is successful, setting the status of the identified person to "boarded". The program described in Appendix 19 provides the following processing: it obtains the biometric information of a passenger requesting the provision of the image data, performs a matching process using the obtained biometric information and the stored multiple biometric information to identify the passenger requesting the provision of the image data, and if the identified passenger is already on board, it provides all or part of the stored image data to the passenger requesting the provision of the image data.

[0163] [Note 21] The acquisition process is a program according to any one of the appendices 15 to 20, which acquires the image data from the camera attached to the front of the vehicle while the vehicle is moving.

[0164] Furthermore, some or all of the configurations described in Appendices 2 to 7, which are subordinate to Appendice 1 above, may also be subordinate to Appendices 8 and 15 in the same way as those described in Appendices 2 to 7. Moreover, not limited to Appendices 1, 8 and 15, some or all of the configurations described as appendices may also be subordinate to various hardware, software, various recording means for recording software, or systems, without departing from the embodiments described above.

[0165] Furthermore, each disclosure of the above-mentioned prior art documents cited herein is incorporated herein by reference. Although embodiments of the present invention have been described above, the present invention is not limited to these embodiments. It will be understood by those skilled in the art that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. That is, the present invention naturally includes the entire disclosure, including the claims, and various modifications and alterations that can be made by those skilled in the art in accordance with the technical idea. [Explanation of Symbols]

[0166] 10 Server devices 20 Authentication terminals 30 aircraft 31 Camera 40 devices 100 Server Devices 101 Acquisition method 102 Authentication methods 103 Means of provision 201 Communication Control Unit 202 Ticket Sales Control Unit 203 Certification Department 204 Service Control Unit 205 Storage section 301 Communication Control Unit 302 Biological Information Acquisition Unit 303 Authentication Request Section 304 Storage section 311 Processors 312 memory 313 Input / Output Interfaces 314 Communication Interface

Claims

1. An acquisition means for acquiring image data captured by a camera from a vehicle equipped with a camera, Authentication means for authenticating and identifying passengers who intend to board the aforementioned vehicle, A means for providing the acquired image data to the identified passenger, A server device equipped with the following features.

2. The system further includes a storage means for storing the biometric information of each of the multiple ticket purchasers who purchased tickets for the aforementioned vehicle, in association with the ticket information related to the purchased tickets. The server device according to claim 1, wherein the authentication means obtains biometric information of a person to be authenticated who intends to board the vehicle from an authentication terminal, performs a matching process using the obtained biometric information and the stored multiple biometric information to identify the person to be authenticated from among the multiple ticket purchasers, authenticates the identified person to be authenticated based on the ticket information of the identified person to be authenticated, and notifies the authentication result to the authentication terminal.

3. The server device according to claim 2, wherein the providing means provides the acquired image data to a ticket purchaser who has been determined to have successfully authenticated the ticket.

4. The storage means stores the biometric information, ticket information, and contact information of each of the multiple ticket purchasers. The server device according to claim 3, wherein the providing means transmits the acquired image data to the contact information of the ticket purchaser whose authentication has been determined to be successful.

5. The acquisition means stores the image data acquired from the vehicle, The server device according to claim 1, wherein the providing means provides all or part of the stored image data to a passenger of the vehicle in response to a request from the passenger of the vehicle.

6. The system further includes a storage means for storing the biometric information of each of the multiple ticket purchasers who purchased tickets for the aforementioned vehicle, in association with the ticket information related to the purchased tickets. The authentication means obtains the biometric information of the person to be authenticated who intends to board the vehicle from the authentication terminal, performs a matching process using the obtained biometric information and the stored multiple biometric information to identify the person to be authenticated from among the multiple ticket purchasers, authenticates the identified person to be authenticated based on the ticket information of the identified person to be authenticated, and if the authentication of the identified person to be authenticated is successful, sets the status of the identified person to "boarded". The server device according to claim 5, wherein the providing means acquires biometric information of a passenger requesting the provision of the image data, performs a matching process using the acquired biometric information and the stored plurality of biometric information to identify the passenger requesting the provision of the image data, and if the identified passenger is on board, provides all or part of the stored image data to the passenger requesting the provision of the image data.

7. The server device according to any one of claims 1 to 6, wherein the acquisition means acquires the image data while the vehicle is moving from the camera attached to the front of the vehicle.

8. An acquisition step of acquiring image data captured by a camera from a vehicle equipped with a camera, An authentication process for authenticating and identifying passengers who intend to board the aforementioned vehicle, A provision step of providing the acquired image data to the identified passenger, A control method for a server device, comprising the following features.

9. The computer installed in the server device An acquisition process for acquiring image data captured by a camera from a vehicle equipped with a camera, Authentication process for authenticating and identifying passengers who intend to board the aforementioned vehicle, The acquired image data is provided to the identified passenger; A program to execute.

Images