Information processing device and information processing method

Abstract

To improve the accuracy of face authentication.SOLUTION: An information processor includes a controller which performs: acquiring user identification information that is identification information of a user of a vehicle and an authentication face image that is an image of the face of the user for authentication; acquiring vehicle identification information that is identification information of the vehicle, the identification information associated with the user identification information; acquiring information on an attribute of the vehicle associated with the vehicle identification information; and generating a processed authentication face image by processing the authentication face image according to the information on the attribute of the vehicle.SELECTED DRAWING: Figure 11

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and an information processing method.

Background Art

[0002] It is known to perform face authentication processing by previously storing, as registration information, image data of the face of an operator permitted to enter a security area (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] An object of the present disclosure is to improve the accuracy of face authentication.

Means for Solving the Problems

[0005] One aspect of the present disclosure is acquiring user identification information, which is identification information of a user of a vehicle, and an authentication face image, which is an image of the face of the user for authentication; acquiring vehicle identification information, which is identification information of the vehicle and is associated with the user identification information; acquiring information regarding an attribute of the vehicle associated with the vehicle identification information; generating a processed authentication face image by processing the authentication face image according to the information regarding the attribute of the vehicle; and an information processing apparatus including a control unit that executes the above.

[0006] One aspect of the present disclosure is a computer that The process involves obtaining user identification information, which is the identification information of the vehicle user, and an authentication facial image, which is an image of the user's face used for authentication. To obtain vehicle identification information, which is the identification information of the vehicle and is associated with the user identification information, To obtain information regarding the attributes of the vehicle associated with the vehicle identification information, The process involves generating a processed authentication facial image by processing the authentication facial image according to information regarding the attributes of the vehicle, This is an information processing method that performs the following:

[0007] One aspect of this disclosure is, This involves obtaining a user face image, which is an image generated by photographing a user inside the vehicle with a camera placed outside the vehicle, and To obtain vehicle identification information, which is the identification information of the aforementioned vehicle, At the time of authentication, the user identification information, which is the user identification information associated with the vehicle identification information, Obtaining a processed authentication face image which is an image of the user's face associated with the user identification information, and which has been processed to reflect the attributes of the vehicle identified from the vehicle identification information; The user's authentication is performed by comparing the user's facial image with the processed authentication facial image. If the user authentication is successful, the process associated with the user will be executed. This is an information processing device equipped with a control unit that performs the following actions.

[0008] Other aspects of this disclosure include an information processing method in which a computer performs information processing in the above-mentioned information processing apparatus, a program for causing a computer to perform information processing in the above-mentioned information processing apparatus, and a storage medium that stores this program non-temporarily. [Effects of the Invention]

[0009] According to the present disclosure, the accuracy of face authentication can be improved.

Brief Description of the Drawings

[0010] [Figure 1] It is a diagram showing a schematic configuration of a system according to an embodiment. [Figure 2] It is a diagram showing an overview of the processing of a system according to an embodiment. [Figure 3] It is a block diagram schematically showing an example of the hardware configuration of each of a center server, a user-side server, an association management server, a vehicle ID server, and a settlement server that constitute a system according to an embodiment. [Figure 4] It is a block diagram schematically showing an example of the hardware configuration of each of a user terminal and an in-vehicle terminal according to the present embodiment. [Figure 5] It is a diagram schematically showing an example of the software configuration of a center server according to an embodiment. [Figure 6] It is a diagram showing an example of the table configuration of a user information DB, an authentication face image DB, a processed authentication face image DB, and a vehicle attribute DB according to an embodiment. [[ID=2A]] [Figure 7] It is a diagram schematically showing an example of the software configuration of a user-side server according to an embodiment. [Figure 8] It is a diagram schematically showing an example of the software configuration of an in-vehicle device according to an embodiment. [Figure 9] It is a diagram schematically showing an example of the software configuration of a user terminal according to an embodiment. [Figure 10] It is a flowchart of user registration processing in a center server according to an embodiment. [Figure 11] It is a flowchart of the processed authentication face image providing process in a center server according to an embodiment. [Figure 12] It is a flowchart of face authentication processing in a user-side server according to an embodiment. [Figure 13] It is a diagram showing an example of the table configuration of a processed authentication face image DB according to an embodiment. [Figure 14]It is a flowchart of a process for providing a processed authentication face image in a center server according to an embodiment.

Embodiments for Carrying Out the Invention

[0011] According to a face authentication system, even if the subject is away from the system, if it is possible to photograph the subject's face with a camera, the subject can be authenticated. Therefore, according to face authentication, the subject can be authenticated simply and at an early stage. However, the conventional face authentication system has the following problems.

[0012] That is, in recent years, with the progress of machine learning technology, the scenes where face authentication can be performed have increased. Also, for example, in scenes such as drive-throughs, it is recommended to authenticate the subject while remaining in the vehicle. Such scenes are increasing, and as a result, the need for face authentication is increasing. Therefore, it is assumed that the subject in the vehicle is photographed from outside the vehicle, and the subject is authenticated based on the obtained face image. It is assumed that the system is configured to perform face authentication by comparing the pre-obtained authentication face image and the face image obtained at the time of authentication. In this case, basically, the authentication face image is obtained by photographing the subject at an arbitrary timing when not in the vehicle (for example, the subject photographs himself / herself with a mobile terminal). On the other hand, in the face image obtained at the time of authentication, for example, members constituting the vehicle such as the front glass and side glass are reflected. In one example, by photographing the subject through the front glass, in the obtained face image, the subject's face may appear in a different color than the actual one due to the influence of the color of the front glass. As a result, the appearance of the subject in the face image obtained at the time of authentication and the appearance of the subject in the authentication face image may deviate greatly, and there is a possibility that face authentication may not be correctly established. The present disclosure solves such a problem.

[0013] Therefore, an information processing device, which is one aspect of the present disclosure, includes a control unit that performs the following actions: acquiring user identification information, which is identification information of a vehicle user, and an authentication face image, which is an image of the user's face for authentication; acquiring vehicle identification information, which is identification information of the vehicle associated with the user identification information; acquiring information regarding the vehicle's attributes associated with the vehicle identification information; and generating a processed authentication face image by processing the authentication face image according to the information regarding the vehicle's attributes.

[0014] A vehicle user is a user associated with a vehicle. The user may also be the owner of the vehicle. User identification information is information that can identify a user, and may include, for example, information about a pre-assigned user ID. Alternatively, user identification information may include information about the driver's license number. Authentication facial image is an image of the user's face taken in advance. Authentication facial image may include, for example, an image of the user's face taken by the user using a camera attached to the user's device. User identification information and authentication facial image may be registered in advance. Vehicle identification information is information that can identify a vehicle, and may include, for example, information about the vehicle identification number or the vehicle registration number (license plate number). Vehicle identification information may be registered in advance in association with user identification information. Vehicle identification information may also include information about the vehicle type or name.

[0015] Vehicle attribute information is information associated with vehicle identification information, and includes, for example, information about the vehicle's height, size, windshield color, side window color, wiper position, sun visor position, or A-pillar (the pillar on either side of the windshield). Here, vehicle attributes refer to components that may affect the image when a user inside the vehicle is photographed from outside the vehicle. For example, when photographing a user's face inside the vehicle from outside, the image will be taken through the windshield or side windows. If these windows are colored, it will affect the image of the user's face. Depending on the color of these windows, facial recognition may not be performed correctly. Also, because the position from the ground to the user's face changes depending on the vehicle's height and size, the angle of the user's face may change when photographing the user's face from outside the vehicle. Furthermore, wipers, sun visors, and A-pillars may overlap with the user's face in the photograph. Therefore, these attributes can also affect the image of the user's face.

[0016] Therefore, the control unit processes the authentication face image according to information about the vehicle's attributes. For example, if information about the color of the windshield is obtained as information about the vehicle's attributes, the windshield color is reflected in the authentication face image to generate a processed authentication face image. By generating a processed authentication face image in this way, it is possible to suppress a large discrepancy between how the user appears in the processed authentication face image and how the user appears in the image taken from outside the vehicle during authentication. Thus, the accuracy of face recognition can be improved.

[0017] Embodiments of this disclosure will be described below with reference to the drawings. The configurations of the following embodiments are illustrative, and this disclosure is not limited to the configurations of these embodiments.

[0018] <First Embodiment> Figure 1 is a diagram showing the schematic configuration of System 1 according to an embodiment. In the example of Figure 1, System 1 includes an in-vehicle device 100 mounted on a vehicle 10, a user terminal 20 owned by the user of the vehicle 10, a central server 30, a user-side server 40, a linking management server 50, a vehicle ID server 60, and a payment server 70. A camera 400 that photographs the inside of the vehicle 10 from outside the vehicle 10 is connected to the user-side server 40.

[0019] The in-vehicle device 100, user terminal 20, central server 30, user-side server 40, linking management server 50, vehicle ID server 60, and payment server 70 are interconnected by network N1. Network N1 is, for example, a global public communication network such as the Internet, and may also be a WAN (Wide Area Network) or other communication network. Network N1 may also include a telephone communication network such as a mobile phone network, or a wireless communication network such as Wi-Fi (registered trademark). Figure 1 shows one vehicle 10 and one user terminal 20 as an example, but there may be multiple such vehicles. Furthermore, short-range wireless communication may be possible between the in-vehicle device 100 and the user-side server 40 or camera 400.

[0020] The in-vehicle device 100 is a device that provides information about the vehicle 10 to the user server 40. The user terminal 20 is a terminal that can provide a user's facial image. The center server 30 is a server that generates and provides authentication facial images to the user server 40. The user server 40 is a server that performs facial authentication. The linking management server 50 is a server that manages the linking of the vehicle 10 and the user. The vehicle ID server 60 is a server that manages information about the vehicle 10. The payment server 70 is a server that performs payments.

[0021] Figure 2 is a diagram showing an overview of the processing of System 1 according to the embodiment. P1 to P5 are processes involving the central server 30, and U1 to U5 are processes involving the user server 40. In P1, the user registers with the central server 30 using the user terminal 20. The user requests user registration from the central server 30 via the user terminal 20. At this time, a face image linked to the user ID is sent to the central server 30. This face image will be referred to as the authentication face image below. The authentication face image is, for example, an image of the user's face taken with the user terminal 20. However, it is not limited to this, and the authentication face image may be an image of the user's face taken in the past and stored on the user terminal 20 or an external server. The user ID may be, for example, a number assigned by a common numbering system for identifying individuals in each country (e.g., My Number, Social Security Number, or Citizen Identity Number) or a driver's license number. The user ID is an example of user identification information. Furthermore, during user registration, payment-related information is transmitted from the user terminal 20 to the central server 30, linked to the user ID. This payment-related information is necessary for the user to use the payment service and includes, for example, credit card numbers or bank account numbers.

[0022] In P2, the central server 30 acquires and stores the user ID, authentication facial image, and payment information from the user terminal 20. In P3, the central server 30 requests the linking management server 50 to send the vehicle ID associated with the user ID. The linking management server 50 performs a search using the user ID and extracts the vehicle ID associated with the user ID. Then, the central server 30 retrieves the vehicle ID associated with the user ID from the linking management server 50. The vehicle ID is a number unique to the vehicle 10, for example, the chassis number or the number displayed on the vehicle registration number plate (license plate). This number will be referred to as the vehicle ID below. Also called both license plates. Vehicle ID is an example of vehicle identification information.

[0023] In P4, the center server 30 requests the vehicle ID server 60 to send vehicle information associated with the vehicle ID. The vehicle ID server 60 performs a search using the vehicle ID and extracts the vehicle information associated with the vehicle ID. The center server 30 then retrieves the vehicle information associated with the vehicle ID from the vehicle ID server 60. The vehicle information includes information that can identify the vehicle, such as the vehicle type, vehicle name, chassis number, or the number on the vehicle registration plate (vehicle number). The vehicle information may also include information that can identify the vehicle's height, size, windshield color, side window color, wiper position, sun visor position, or A-pillar (the pillar on either side of the windshield). Furthermore, the vehicle information may include information about the owner of vehicle 10.

[0024] In P5, the center server 30 obtains the attributes of vehicle 10 from the vehicle information acquired from the vehicle ID server and processes the authentication face image to reflect those attributes. The center server 30 then generates and stores the processed authentication face image. For example, the color of the windshield is obtained as an attribute of vehicle 10 from the vehicle information, and this windshield color is reflected in the authentication face image to generate the processed authentication face image. The processed authentication face image may also be generated using publicly known techniques. In this way, the center server 30 stores the processed authentication face image, ready for use in facial authentication when a user uses vehicle 10.

[0025] In addition, in U1, the user server 40 acquires the vehicle ID and the user's facial image. The user's facial image is obtained by the camera 400 taking an external photograph of the vehicle 10. The facial image acquired in this way will also be referred to as the user's facial image below. The vehicle ID may also be acquired from the in-vehicle device 100 via communication. As another example, if the vehicle ID corresponds to the vehicle number, the vehicle number may be acquired by analyzing the image of the vehicle 10 taken by the camera 400.

[0026] In U2, the user server 40 queries the linking management server 50 to see if a linking relationship exists that corresponds to the vehicle ID. At this time, the query may also be to see if a valid linking relationship exists at the target date and time. The target date and time may be the date and time at the time of the query (which may be the present), or it may be a past date and time. A valid link is, for example, a link between a vehicle ID and a user ID that is within its expiration date. If a valid link exists, the user ID linked to the vehicle ID is sent from the linking management server 50 to the user server 40.

[0027] In U3, if a valid linking relationship exists, the user server 40 requests the central server 30 to send a processed authentication face image corresponding to the user ID. The central server 30 sends the processed authentication face image corresponding to the user ID to the user server 40. At this time, the central server 30 also sends information about the various permissions associated with the user ID to the user server 40. These permissions are, for example, permissions related to payment services registered by the user. However, the permissions are not limited to these; for example, they could be permissions related to administrative services.

[0028] In U4, the user server 40 performs facial recognition by comparing the user's face image captured by the camera 400 with a processed authentication face image. Publicly known facial recognition technologies can be used here. The method of facial recognition is not limited. Furthermore, image processing may be performed using any analysis process (pattern matching, edge extraction, etc.). Additionally, a pre-trained machine learning model may be used for image processing.

[0029] In U5, if authentication is successful, the user server 40 executes the user's privileges. The user server 40 requests payment from the payment server 70. For example, it can be used for payments at drive-thru restaurants, payments for parking fees, or payments for toll road fees.

[0030] The processed authentication facial image may be stored in either the center server 30 or the user server 40. Furthermore, the processing in the center server 30 from P2 to P5 can be executed at any time before the processing in the user server 40 of U4 is executed. The center server 30 may also execute the processing from P2 to P5 immediately following the processing of P1. Additionally, the center server 30 may periodically refer to the linked management server 50 and generate a processed authentication facial image for each corresponding vehicle type. For example, if a single user owns multiple vehicles 10, a processed authentication facial image may be generated and stored for each vehicle 10.

[0031] Furthermore, the attributes of the vehicle 10 that are reflected when generating the processed authentication face image may be the color of the windshield or side windows, the position and shape of the wipers, sun visors, A-pillars, or front seats, or the vehicle height. Any component that affects face recognition can be used as an attribute of the vehicle 10. The processed authentication face image can then be generated by reflecting these attributes. For example, the center server 30 may process the authentication face image to add wipers, sun visors, A-pillars, or front seats to generate the processed authentication face image.

[0032] Next, Figure 3 is a block diagram schematically showing an example of the hardware configuration of the center server 30, user server 40, association management server 50, vehicle ID server 60, and payment server 70 that constitute System 1 according to this embodiment.

[0033] The center server 30 is configured as a computer having a control unit 31, a storage unit 32, and a communication module 33. The center server 30 can be configured as a computer having a processor (CPU, GPU, etc.), main memory (RAM, ROM, etc.), and auxiliary storage (EPROM, hard disk drive, removable media, etc.). The auxiliary storage stores the operating system (OS), various programs, various tables, etc., and by executing the programs stored therein, various functions (software modules) that match a predetermined purpose, as described later, can be realized. However, some or all of the modules may be realized as hardware modules by hardware circuits such as ASICs and FPGAs.

[0034] The control unit 31 is a computing unit that realizes various functions of the center server 30 by executing a predetermined program. The control unit 31 can be implemented by a hardware processor such as a CPU. The control unit 31 may also be configured to include RAM, ROM (Read Only Memory), cache memory, etc.

[0035] The memory unit 32 is a means for storing information and is composed of storage media such as RAM, magnetic disks, and flash memory. The memory unit 32 stores programs executed by the control unit 31, data used by those programs, and other similar information. In addition, various types of information are stored in the memory unit 32. Details will be described later.

[0036] The communication module 33 is a communication interface for connecting the center server 30 to a network. The communication module 33 may be configured to include, for example, a network interface board, a wireless communication interface for wireless communication, etc. The center server 30 can communicate data with other computers (for example, other server devices or each user terminal 20) via the communication module 33.

[0037] The specific hardware configuration of the center server 30 can be modified as appropriate, with components being omitted, replaced, and added depending on the embodiment. For example, the control unit 31 may include multiple hardware processors. These hardware processors may consist of microprocessors, FPGAs, GPUs, etc. The center server 30 may also be composed of multiple computers. In this case, the hardware configurations of each computer may or may not be identical.

[0038] The user-side server 40 is configured as a computer having a control unit 41, a storage unit 42, and a communication module 43. The user-side server 40 can be configured as a computer having a processor (CPU, GPU, etc.), main memory (RAM, ROM, etc.), and auxiliary storage (EPROM, hard disk drive, removable media, etc.). The auxiliary storage contains an operating system (OS), various programs, various tables, etc., and by executing the programs stored there, various functions (software modules) that match a predetermined purpose, as described later, can be realized. However, some or all of the modules may be realized as hardware modules by hardware circuits such as ASICs and FPGAs. The control unit 41, storage unit 42, and communication module 43 of the user-side server 40 have the same configuration as the control unit 31, storage unit 32, and communication module 33 of the center server 30, so their description is omitted. A camera 400 is connected to the user-side server 40, and this camera 400 is controlled by the control unit 41. The camera 400 is pre-positioned in a location that can photograph the driver of a stopped vehicle 10. Camera 400 uses, for example, a CCD (Charge Coupled Device) image sensor or CM Using an image sensor such as an OS (Complementary Metal Oxide Semiconductor) image sensor It is a device that takes pictures.

[0039] The linking management server 50, the vehicle ID server 60, and the payment server 70 can also be configured as computers similar to the center server 30. The linking management server 50 is a device that provides information regarding the linking of vehicle IDs and user IDs, the timestamp of this linking, and the expiration date of this linking via the network N1. Therefore, the linking management server 50 stores linked information regarding vehicle IDs, user IDs, timestamps, and expiration dates. The timestamp is, for example, the date and time when the linking of user IDs and vehicle IDs was performed. The expiration date is the expiration date of the linking of user IDs and vehicle IDs. The linking management server 50 is managed by a neutral business operator or administrative agency, separate from the administrator of the center server 30 and the administrator of the user-side server 40. The information stored in the linking management server 50 may be provided by the user via the user terminal 20, or by the center server 30.

[0040] The vehicle ID server 60 is a device that provides information about the vehicle number, vehicle type, and owner of vehicle 10, which are associated with the vehicle ID, via the network N1. Therefore, the vehicle ID server 60 stores information about the vehicle ID, vehicle number, vehicle type, and owner of vehicle 10, which are associated with each other. The vehicle ID server 60 is managed by a business or administrative agency that is neutral to the administrator of the center server 30 and the administrator of the user server 40. The vehicle ID server 60 may be a server managed by, for example, the administrative agency that issues license plates. When a user registers vehicle 10, a license plate is issued, and its number (vehicle number), vehicle type, and owner information may be stored in the vehicle ID server 60.

[0041] The payment server 70 is a device that processes payments based on payment requests. The payment server 70 is managed, for example, by a credit card company. As another example, the payment server 70 may be a server that manages electronic money or points, or a server that manages bank deposits. The payment server 70 stores payment information. This payment information includes, for example, user I This may include information linking D to a credit card number.

[0042] Next, Figure 4 is a block diagram schematically showing an example of the hardware configuration of the user terminal 20 and the in-vehicle device 100 according to this embodiment.

[0043] The user terminal 20 is a small computer such as a smartphone, mobile phone, tablet, personal information terminal, wearable computer (smartwatch, etc.), or personal computer (PC). The user terminal 20 is composed of a control unit 21, a storage unit 22, a communication module 23, an input / output device 24, and a camera 25.

[0044] The user terminal 20 can be configured as a computer having a processor (CPU, GPU, etc.), main memory (RAM, ROM, etc.), and auxiliary storage (EPROM, hard disk drive, removable media, etc.), similar to the center server 30. However, some or all of the functions (software modules) may be implemented as hardware modules by hardware circuits such as ASICs and FPGAs.

[0045] The control unit 21, storage unit 22, and communication module 23 of the user terminal 20 have the same configuration as the control unit 31, storage unit 32, and communication module 33 of the center server 30, so their explanation will be omitted.

[0046] The input / output device 24 is a means of receiving input operations performed by the user and presenting information to the user. Specifically, the input / output device 24 includes devices for input such as a mouse and keyboard, and devices for output such as a display and speaker. The input / output device 24 may be integrally configured with, for example, a touch panel display. The camera 25 is a device that takes images using an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

[0047] Furthermore, the specific hardware configuration of the user terminal 20 can be modified as appropriate, depending on the embodiment, by omitting, substituting, or adding components, similar to the central server 30.

[0048] Next, the in-vehicle device 100 is a computer such as an ECU (Electronic Control Unit), DCM (Data Communication Module), head unit, or navigation system mounted on the vehicle 10. The in-vehicle device 100 is composed of a control unit 11, a storage unit 12, a communication module 13, and an input / output device 14. The control unit 11, storage unit 12, communication module 13, and input / output device 14 of the in-vehicle device 100 are the same as the control unit 21, storage unit 22, communication module 23, and input / output device 24 of the user terminal 20, so their description will be omitted.

[0049] Figure 5 is a schematic diagram showing an example of the software configuration of the center server 30 according to the embodiment. The control unit 31 is composed of software modules including a user information acquisition unit 311, a linked information acquisition unit 312, a vehicle information acquisition unit 313, a face image processing unit 314, and a face image provision unit 315. Each software module may be implemented by the control unit 31 (CPU) executing a program stored in the storage unit 32. The information processing performed by the user information acquisition unit 311, linked information acquisition unit 312, vehicle information acquisition unit 313, face image processing unit 314, and face image provision unit 315 described below is synonymous with the information processing performed by the control unit 31.

[0050] The storage unit 32 of the center server 30 contains a user information database 321 (hereinafter referred to as user information DB321), an authentication face image database 322 (hereinafter referred to as authentication face image DB321), and The database stores a user information DB321, an authentication face image DB322, an authentication face image DB323 (hereinafter referred to as the processed authentication face image DB323), and a vehicle attribute database 324 (hereinafter referred to as the vehicle attribute DB324). The user information DB321, authentication face image DB322, processed authentication face image DB323, and vehicle attribute DB324 are constructed by a database management system (DBMS) program executed by the processor managing the data stored in the auxiliary storage device. These databases are, for example, relational databases. Figure 6 shows an example of the table configuration of the user information DB321, authentication face image DB322, processed authentication face image DB323, and vehicle attribute DB324 according to the embodiment. Details will be described later.

[0051] The user information acquisition unit 311 is configured to receive user information and authentication facial images transmitted from the user terminal 20 and to store the user information and authentication facial images in the user information DB 321 and authentication facial image DB 322, respectively. As shown in Figure 6, the user information DB 321 stores the user ID, the user's name, the user's contact information, and information related to payment services. The user information is linked to the user ID. The user ID may be, for example, the number on a driver's license. The user's contact information may include the user's address, telephone number, SNS account, email address, etc. Information related to payment services is information linking the user to a payment service and includes information related to the payment method the user desires at the time of payment (for example, credit card number). The user information is pre-registered by the user with the center server 30 via the user terminal 20. Also, as shown in Figure 6, the authentication facial image DB 322 stores authentication facial images linked to the user ID. The authentication facial image is a facial image of the user transmitted from the user terminal 20 along with user information, and is, for example, a facial image taken by the user themselves using the camera 25 of the user terminal 20. The user information acquisition unit 311 associates the authentication facial image received from the user terminal 20 with the user ID and stores it in the authentication facial image DB 322. As another example, the authentication facial image DB 322 may also store information about the location where the authentication facial image is stored.

[0052] The association information acquisition unit 312 requests the association management server 50 to perform a search using the user ID. The association management server 50 then returns to the center server 30 information regarding the vehicle ID, timestamp, and expiration date associated with the user ID (hereinafter also referred to as association information). The association management server 50 may periodically update the association between the user ID and the vehicle ID. The association information acquisition unit 312 stores the association information acquired from the association management server 50 in the storage unit 32.

[0053] The vehicle information acquisition unit 313 requests the vehicle ID server 60 to perform a search using the vehicle ID. This vehicle ID is the vehicle ID obtained from the association management server 50. The vehicle ID server 60 then returns to the center server 30 information regarding the vehicle number, vehicle type, and owner of vehicle 10, all of which are associated with the vehicle ID. The vehicle type is classified in a way that allows the attributes of vehicle 10 to be determined. The information regarding the owner of vehicle 10 includes, for example, the user ID or name.

[0054] The facial image processing unit 314 processes the facial image acquired from the user terminal 20 according to the attributes of the vehicle 10 (hereinafter also referred to as vehicle attributes) to generate a processed authentication facial image. As shown in Figure 6, the vehicle attribute DB 324 stores, for example, the relationship between vehicle type and vehicle attributes. The facial image processing unit 314 extracts the vehicle attributes corresponding to the vehicle type acquired from the vehicle ID server 60 from the vehicle attribute DB 324. Then, it generates a processed authentication facial image by reflecting the vehicle attributes on the authentication facial image acquired from the user terminal 20. For example, in the vehicle attribute DB 324, the vehicle attribute corresponding to the vehicle type is the windshield of the vehicle 10. If a color is stored, the face image processing unit 314 generates a processed authentication face image by reflecting the color of the vehicle 10's windshield to the authentication face image. That is, it generates a processed authentication face image that corresponds to an image of the user's face taken from outside the vehicle 10. The face image processing unit 314 associates the generated processed authentication face image with the vehicle ID and user ID and stores it in the processed authentication face image DB 323. As shown in Figure 6, the processed authentication face image DB 323 stores the relationship between the user ID, vehicle ID, and processed authentication face image. As another example, the processed authentication face image DB 323 may also store information about the location where the processed authentication face image is stored.

[0055] The facial image provision unit 315 provides processed authentication facial images in response to a request from the user server 40. The request from the user server 40 includes information about the vehicle ID, and the facial image provision unit 315 extracts the processed authentication facial image DB 323 corresponding to the vehicle ID and sends it to the user server 40.

[0056] Figure 7 is a schematic diagram showing an example of the software configuration of the user-side server 40 according to the embodiment. The control unit 41 is configured with software modules including a face image acquisition unit 411, a vehicle information acquisition unit 412, a user ID acquisition unit 413, an authentication information acquisition unit 414, and an execution unit 415. Each software module may be implemented by the control unit 41 (CPU) executing a program stored in the storage unit 42. The information processing performed by the face image acquisition unit 411, the vehicle information acquisition unit 412, the user ID acquisition unit 413, the authentication information acquisition unit 414, and the execution unit 415 described below is synonymous with the information processing performed by the control unit 41.

[0057] The face image acquisition unit 411 acquires images captured by the camera 400 when the vehicle 10 is located at a predetermined position. The camera 400 is pre-positioned to capture the driver of the vehicle 10. The face image acquisition unit 411 constantly monitors the images captured by the camera 400, for example, and detects when the vehicle 10 approaches the predetermined position through image analysis. It then acquires the user's image captured at that time as a user face image.

[0058] The vehicle information acquisition unit 412 acquires information about the vehicle 10 located at a predetermined location. In this case, for example, the camera 400 may be equipped with a wireless communication function, and wireless communication may be performed between the camera 400 and the vehicle 10 to acquire information about the vehicle 10 (for example, the vehicle number). Alternatively, as another example, the vehicle number may be read by analyzing the image of the vehicle 10 taken by the camera 400.

[0059] The user ID acquisition unit 413 requests the linking management server 50 to perform a search using the vehicle ID. At this time, the user ID acquisition unit 413 queries the linking management server 50 to see if a valid linking relationship corresponding to the vehicle ID exists at the target date and time. If a valid linking relationship corresponding to the vehicle ID exists at the target date and time, the linking management server 50 returns the user ID associated with the vehicle ID to the user server 40. The user ID acquisition unit 413 stores the user ID obtained from the linking management server 50 in the storage unit 42.

[0060] The authentication information acquisition unit 414 requests the central server 30 to perform a search using the user ID. The central server 30 returns to the user server 40 information regarding various permissions associated with the user ID and a processed authentication facial image. The various permissions include, for example, information regarding payment services associated with the user ID.

[0061] The execution unit 415 requests payment from the payment server 70 if facial recognition is successful and authorization is valid. The execution unit 415 performs facial recognition by comparing the processed authentication facial image obtained from the center server 30 with the user facial image obtained from the camera 400. The execution unit 415 selects the payment server 70 based on information regarding various permissions associated with the user ID.

[0062] Figure 8 is a schematic diagram showing an example of the software configuration of the in-vehicle device 100 according to this embodiment. In this embodiment, the control unit 11 of the in-vehicle device 100 is configured to have a software module for the vehicle ID transmission unit 111. The software module may be realized by the control unit 11 (CPU) executing a program stored in the storage unit 12. The information processing performed by the vehicle ID transmission unit 111 described below is synonymous with the information processing performed by the control unit 11.

[0063] The vehicle ID transmission unit 111 transmits the vehicle ID stored in the storage unit 12 to the user server 40 or camera 400 in response to a request from the user server 40 or camera 400. However, if the vehicle information acquisition unit 412 of the user server 40 reads and acquires the vehicle number, the vehicle ID transmission unit 111 can be omitted.

[0064] Figure 9 is a schematic diagram showing an example of the software configuration of a user terminal 20 according to the embodiment. The control unit 21 of the user terminal 20 is configured to have software modules for an imaging unit 211 and a user information transmission unit 212. Each software module may be implemented by the control unit 21 (CPU) executing a program stored in the storage unit 22. The information processing performed by the imaging unit 211 and the user information transmission unit 212 described below is synonymous with the information processing performed by the control unit 21.

[0065] The imaging unit 211 uses camera 25 to photograph the user. The imaging unit 211 takes a photograph when the user provides a predetermined input to input / output device 24. At this time, the user adjusts the angle of camera 25 so that their face is photographed.

[0066] The user information transmission unit 212 transmits to the center server 30 the user information entered by the user via the input / output device 24 and the user face image captured by the imaging unit 211.

[0067] Next, the user registration process in the central server 30 will be described. Figure 10 is a flowchart of the user registration process in the central server 30 according to the embodiment. The process shown in Figure 10 is executed at predetermined intervals in the central server 30. Although the process shown in Figure 10 is executed by each software module of the control unit 31, the following flowchart will be described assuming that the control unit 31 executes the process.

[0068] In step S101, the control unit 31 determines whether or not it has received a user registration request from the user terminal 20. The user terminal 20 may have an application program installed that enables user registration. When the user uses this application program to make predetermined inputs and takes a photo of their face, a user registration request is sent from the user terminal 20 to the center server 30. Alternatively, as another example, the user terminal 20 may access a web page that enables user registration, and when the user makes predetermined inputs on that web page or uploads an authentication face image, a user registration request is sent from the user terminal 20 to the center server 30. If the determination in step S101 is positive, the process proceeds to step S102; if the determination is negative, the routine is terminated.

[0069] In step S102, the control unit 31 acquires user information and authentication facial image. User information and authentication facial image are transmitted from the user terminal 20 to the center server 30 along with the user registration request, so the control unit 31 acquires this user information and authentication facial image. User information includes user ID. Then, in step S103, control Unit 31 performs user registration processing, stores user information in user information DB321, and stores authentication facial images linked to user IDs in authentication facial image DB322.

[0070] Next, the process of providing processed authentication facial images in the center server 30 will be described. Figure 11 is a flowchart of the process of providing processed authentication facial images in the center server 30 according to the embodiment. The process shown in Figure 11 is executed in the center server 30 at predetermined intervals. Although the process shown in Figure 11 is executed by each software module of the control unit 31, the following flowchart will be described assuming that the control unit 31 executes the process.

[0071] In step S201, the control unit 31 determines whether or not a user ID search request has been received from the user server 40. This request includes a request to send information regarding various permissions associated with the user ID and a processed authentication face image to the user server 40. If the determination in step S201 is positive, the process proceeds to step S202; if the determination is negative, the routine terminates.

[0072] In step S202, the control unit 31 obtains linking information from the linking management server 50. The control unit 31 requests the linking management server 50 to perform a search using the user ID. This user ID is the same user ID that the control unit 31 obtained from the user server 40 in step S201. In response to this request, the linking management server 50 extracts the vehicle information associated with the user ID (information regarding the vehicle ID, timestamp, and expiration date) and sends it to the central server 30.

[0073] In step S203, the control unit 31 obtains vehicle information from the vehicle ID server 60. The control unit 31 requests the vehicle ID server 60 to perform a search using the vehicle ID. This vehicle ID is the same vehicle ID that the control unit 31 obtained from the association management server 50 in step S202. In response to this request, the vehicle ID server 60 extracts the vehicle information associated with the vehicle ID (vehicle number, vehicle type, and information regarding the owner of vehicle 10) and sends it to the center server 30.

[0074] In step S204, the control unit 31 extracts vehicle attributes from the vehicle type information. This vehicle type information is included in the vehicle information obtained from the vehicle ID server 60 in step S203. The control unit 31 extracts vehicle attributes (for example, the color of the windshield) corresponding to the vehicle type from the vehicle attribute DB 324.

[0075] In step S205, the control unit 31 retrieves an authentication face image stored in the authentication face image DB 322. The authentication face image retrieved at this time is the face image received from the user terminal 20 during user registration. The control unit 31 extracts the authentication face image from the authentication face image DB 322 that is associated with the user ID obtained in step S201.

[0076] In step S206, the control unit 31 generates a processed authentication face image according to the vehicle attributes and the authentication face image. The control unit 31 generates the processed authentication face image by reflecting the vehicle attributes in the authentication face image. For example, the control unit 31 processes the authentication face image obtained from the user so that it becomes a face image taken when the user is photographed through the windshield. Known techniques can be used for this processing. The control unit 31 associates the generated processed authentication face image with the user ID and vehicle ID and stores it in the processed authentication face image DB 323.

[0077] In step S207, the control unit 31 obtains user privileges from the user information DB 321. In this embodiment, information regarding payment services is obtained as information regarding user privileges. Then, in step S208, the control unit 31 obtains user server 40 The processed authentication facial image and information regarding the user's permissions are transmitted. The information regarding the user's permissions transmitted at this time includes, for example, information about the payment company (credit card company) registered by the user, and information about the credit card number.

[0078] In the routine shown in Figure 11, a processed authentication face image is generated triggered by a request from the user server 40. However, as another example, a processed authentication face image can also be generated following the routine shown in Figure 10. For example, after the processing in step S103, the processing in steps S202 to S206 may be executed to store the processed authentication face image in the processed authentication face image DB 323. Then, if a positive determination is made in step S201, the processed authentication face image stored in the processed authentication face image DB 323, which is associated with the user ID, may be read, and then the processing in steps S207 and S208 may be executed.

[0079] Next, the facial recognition process on the user server 40 will be described. Figure 12 is a flowchart of the facial recognition process on the user server 40 according to this embodiment. The process shown in Figure 12 is executed on the user server 40 at predetermined intervals. Although the process shown in Figure 12 is executed by each software module of the control unit 41, the following flowchart will be described assuming that the control unit 41 executes the process.

[0080] In step S301, the control unit 41 determines whether or not the vehicle 10 is located at a predetermined position. The predetermined position is, for example, the position where a customer orders or receives goods at a drive-through. The predetermined position is not limited to the position where the vehicle 10 stops, but may also be a position that the vehicle 10 passes while driving. The predetermined position is also a position from which the camera 400 can capture the face of the driver of the vehicle 10. If the determination in step S301 is positive, the process proceeds to step S302; if the determination is negative, the routine is terminated.

[0081] In step S302, the control unit 41 acquires a user face image by photographing the driver of the vehicle 10 with the camera 400. The control unit 41 stores the acquired user face image in the storage unit 42. In step S303, the control unit 41 acquires a vehicle ID from the vehicle 10. For example, the vehicle ID may be transmitted from the in-vehicle device 100 to the camera 400 using short-range wireless communication. As another example, the license plate of the vehicle 10 may be photographed with the camera 400 and the vehicle number may be acquired by image analysis.

[0082] In step S304, the control unit 41 obtains the user ID corresponding to the vehicle ID from the linking management server 50. At this time, the control unit 41 queries the linking management server 50 to see if a valid linking relationship corresponding to the vehicle ID exists at the target date and time. In this case, the control unit 41 sends information regarding the vehicle ID and the target date and time to the linking management server 50. For example, if a user has not registered a user ID, there is no valid linking relationship corresponding to the vehicle ID. Therefore, the linking management server 50 determines whether or not a user ID corresponding to the vehicle ID exists. Also, for example, there may be cases where an expiration date is set for the linking between the vehicle ID and the user ID. In this case, if the expiration date of the linking between the vehicle ID and the user ID has passed, there is no valid linking relationship corresponding to the vehicle ID. Therefore, the linking management server 50 determines whether or not the linking between the vehicle ID and the user ID is within its expiration date. Also, for example, if a valid linking relationship between the vehicle ID and the user ID is required at a specific date and time, the timestamp is used to determine whether or not a valid linking relationship between the vehicle ID and the user ID existed at that specific date and time. If a valid linking relationship between the vehicle ID and user ID exists at the target date and time, the linking management server 50 sends the user ID to the user server 40. On the other hand, if a valid linking relationship between the vehicle ID and user ID does not exist at the target date and time, the linking management server 50 sends information to that effect to the user server 40. In this case, the control unit 41 sends the vehicle ID corresponding to Unable to retrieve user ID.

[0083] In step S305, the control unit 41 determines whether or not it was able to obtain the user ID in step S304. If the determination in step S305 is positive, the process proceeds to step S306; if the determination is negative, the routine terminates. If the determination in step S305 is negative, the user may be notified that payment cannot be made. In this case, the user server 40 may be configured to display this information on signage or to play an audio message through a speaker.

[0084] In step S306, the control unit 41 obtains the processed authentication facial image and information regarding various permissions from the central server 30. At this time, the control unit 41 sends a request to the central server 30 to search by user ID. In response to this request, the central server 30 sends the processed authentication facial image and information regarding various permissions to the user server 40. The control unit 41 then receives the processed authentication facial image and information regarding the user's various permissions from the central server 30.

[0085] In step S307, the control unit 41 performs facial recognition by comparing the user face image acquired in step S302 with the processed authentication face image acquired in step S306. Known techniques can be used for facial recognition. The facial recognition method is not particularly limited and may be determined as appropriate depending on the embodiment.

[0086] In step S308, the control unit 41 determines whether or not facial recognition was successful. If the determination in step S308 is positive, the process proceeds to step S309; ​​if the determination is negative, the routine terminates. If the determination in step S308 is negative, the user may be notified that payment cannot be made.

[0087] In step S309, the control unit 41 determines whether the user can make a payment at the payment server 70. Based on the information on various permissions obtained from the central server 30, the control unit 41 determines whether the user's permissions are valid. In this case, the control unit 41 may query the payment server 70 to determine whether the user can make a payment at the payment server 70. If the determination in step S308 is positive, the process proceeds to step S310; if the determination is negative, the routine terminates.

[0088] In step S309, the control unit 41 requests payment from the payment server 70. That is, it executes the user's authority. At this time, it sends information regarding the user ID and the amount to be paid to the payment server 70.

[0089] Thus, the processed authentication face image reflects the attributes of vehicle 10. Therefore, the discrepancy between how the user appears in the user face image obtained during authentication and how the user appears in the processed authentication face image can be minimized. Consequently, the accuracy of face recognition for users remaining in vehicle 10 can be improved.

[0090] <Second Embodiment> In this embodiment, if multiple vehicle IDs of the same vehicle type are associated with the same user ID, the already generated processed authentication face image is reused. Even if a vehicle 10 has a different vehicle ID than the vehicle 10 for which the processed authentication face image has already been generated, if the vehicle type is the same, the already generated processed authentication face image can be reused. In other words, if the vehicle type is the same, it is assumed that the attributes of the vehicle 10 will have a similar effect on the user face image, so if the vehicle type and user ID are the same, the processed authentication face image can be reused.

[0091] The face image processing unit 314 of the center server 30 generates processed authentication face images and stores them in the processed authentication face image DB 323, associating them with the user ID, vehicle ID, and vehicle type. Here, Figure 13 shows an example of the table configuration of the processed authentication face image DB 323 according to the embodiment. The processed authentication face image DB 323 stores the relationship between the user ID, vehicle ID, vehicle type, and processed authentication face image. Information regarding the vehicle type is included in the information acquired by the vehicle information acquisition unit 313 from the vehicle ID server 60.

[0092] Furthermore, before generating a processed authentication face image, the face image processing unit 314 of the center server 30 determines whether a record with the same user ID and vehicle type already exists in the processed authentication face image DB 323. If no record with the same user ID and vehicle type exists, the face image processing unit 314 of the center server 30 generates a processed authentication face image based on the vehicle attributes. On the other hand, if a record with the same user ID and vehicle type exists, the face image processing unit 314 extracts the processed authentication face image stored in the record with the same user ID and vehicle type. It then stores this image in the processed authentication face image DB 323, linked to the user ID, vehicle ID, and vehicle type. In this way, if a processed authentication face image has already been generated for a vehicle 10 with the same user ID and vehicle type, the processed authentication face image is reused without generating a new processed authentication face image for that vehicle 10.

[0093] Next, the process of providing processed authentication facial images in the center server 30 will be described. Figure 14 is a flowchart of the process of providing processed authentication facial images in the center server 30 according to the embodiment. The process shown in Figure 14 is executed at predetermined intervals in the center server 30. Although the process shown in Figure 14 is executed by each software module of the control unit 31, the following flowchart will be described assuming that the control unit 31 executes the process. Steps in which the same process as in Figure 11 is executed are denoted by the same reference numerals and their explanation is omitted.

[0094] In the routine shown in Figure 14, once the processing in step S204 is complete, the process proceeds to step S401. In step S401, the control unit 31 determines whether or not the same vehicle model is registered in the processed authentication face image DB 323 for the user ID obtained in step S201. That is, the control unit 31 determines whether or not there is a record in the processed authentication face image DB 323 with the same user ID and vehicle model. If the determination in step S401 is positive, the process proceeds to step S205; if the determination is negative, the process proceeds to step S402.

[0095] In step S402, the control unit 31 reuses the processed authentication face image. At this time, the control unit 31 extracts the processed authentication face image from records with the same user ID and vehicle type. The control unit 31 associates the extracted processed authentication face image with the user ID, vehicle ID, and vehicle type, and stores it in the processed authentication face image DB 323. As another example, information regarding the location where the extracted processed authentication face image is stored may also be associated with the user ID, vehicle ID, and vehicle type, and stored in the processed authentication face image DB 323.

[0096] In this way, by reusing the processed facial images for authentication, the load on the central server 30 can be reduced.

[0097] <Other Embodiments> The embodiments described above are merely examples, and this disclosure may be modified as appropriate without departing from its essence. The processes and means described in this disclosure can be freely combined and implemented as long as no technical inconsistencies arise. Furthermore, a process described as being performed by one device may be divided and performed by multiple devices. Alternatively, different... The processes described as being performed by multiple devices may be performed by a single device. In a computer system, the hardware configuration (server configuration) used to implement each function can be flexibly changed.

[0098] For example, one server may have the functions of two or more of the following servers: the central server 30, the user server 40, the linking management server 50, the vehicle ID server 60, and the payment server 70. For example, the central server 30 and the user server 40 may be on the same server. Similarly, the central server 30 and the linking management server 50 or the vehicle ID server 60 may be on the same server.

[0099] Furthermore, the processed authentication facial image generated by the central server 30 may be sent from the central server 30 to the user server 40 and stored in the storage unit 42 of the user server 40 before the user server 40 requests a search using the user ID.

[0100] Alternatively, the processed authentication face image may be generated by the control unit 41 of the user-side server 40. In this case, a request is sent to the center server 30 to send the authentication face image used during user registration, which is necessary for generating the processed authentication face image. At this time, information regarding at least one of the user ID and vehicle ID is sent to the center server 30. In addition, information regarding the user's various permissions and information regarding the attributes of the vehicle 10 are also obtained from the center server 30 along with the authentication face image. Note that the information regarding the attributes of the vehicle 10 may be obtained directly by the control unit 41 from the vehicle ID server 60. The control unit 41 generates the processed authentication face image based on the authentication face image received from the center server 30 and the vehicle attributes.

[0101] Furthermore, the control unit 31 of the center server 30 may periodically access the linked management server 50 and generate processed authentication facial images for each vehicle type corresponding to the user ID. This allows for handling situations such as when a user changes vehicles 10 or when a user purchases additional vehicles 10.

[0102] In the above embodiment, a payment request is made to the payment server 70 when facial recognition is successful. However, the user server 40 can execute various user privileges, not limited to payments.

[0103] Furthermore, when generating the processed authentication face image, the height at which the camera 400 is positioned may be taken into account. Since the angle of the user's face changes depending on the height at which the camera 400 is positioned, the authentication face image may be processed to appear, for example, as if the user is facing forward. Alternatively, the vehicle height may be used as an attribute of the vehicle 10. In this case, the processed authentication face image may be generated so that the angle of the face changes according to the vehicle height.

[0104] The present disclosure can also be realized by supplying a computer program implementing the functions described in the embodiments above to a computer, and having one or more processors in the computer read and execute the program. Such a computer program may be provided to the computer by a non-temporary computer-readable storage medium that can be connected to the computer's system bus, or it may be provided to the computer via a network. Non-temporary computer-readable storage mediums include, for example, any type of disk such as magnetic disks (floppy disks, hard disk drives (HDDs), etc.), optical disks (CD-ROMs, DVDs, Blu-ray discs, etc.), read-only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic cards, flash memory, optical cards, and any type of medium suitable for storing electronic instructions. [Explanation of symbols]

[0105] 1 System 10 vehicles 20 User Terminals 30 Center Server 31 Control Unit 32 Storage section 40. User-side server 41 Control Unit 42 Storage section 50 Linked Management Server 60 Vehicle ID Server 70 Payment Server 100 Onboard equipment 400 Cameras

Claims

1. The process involves obtaining user identification information, which is the identification information of the vehicle user, and an authentication facial image, which is an image of the user's face used for authentication. To obtain vehicle identification information, which is the identification information of the vehicle and is associated with the user identification information, To obtain information regarding the attributes of the vehicle associated with the vehicle identification information, The process involves generating a processed authentication facial image by processing the authentication facial image according to information regarding the attributes of the vehicle, An information processing device equipped with a control unit that performs the following.

2. The control unit stores the processed authentication facial image in the storage unit so that it can be used for facial recognition when the user uses the vehicle. The information processing apparatus according to claim 1.

3. The control unit acquires the user identification information and the authentication facial image from the user's terminal. The information processing apparatus according to claim 1.

4. The control unit, in response to a request to transmit the processed authentication face image corresponding to the user identification information, transmits the processed authentication face image corresponding to the user identification information. The information processing apparatus according to claim 1.

5. The control unit, in response to a request to transmit the processed authentication face image corresponding to the user identification information, generates the processed authentication face image. The information processing apparatus according to claim 1.

6. The control unit, in response to obtaining the user identification information and the authentication face image from the user's terminal, generates the processed authentication face image. The information processing apparatus according to claim 1.

7. The control unit generates the processed authentication face image by reflecting the color of the vehicle's glass. The information processing apparatus according to claim 1.

8. The control unit generates the processed authentication face image by processing the authentication face image as an image taken through the glass of the vehicle, according to information regarding the vehicle's attributes. The information processing apparatus according to claim 1.

9. The control unit, To obtain information regarding the vehicle type associated with the aforementioned vehicle identification information, In response to the generation of the processed authentication facial image, the processed authentication facial image is stored in the storage unit in association with the user identification information and the vehicle type information. In response to obtaining the vehicle information, if a first processed authentication face image in which the user identification information and vehicle information associated with the processed authentication face image are identical is not stored in the storage unit, the processed authentication face image is generated. In response to obtaining information regarding the vehicle type, if the first processed authentication face image is stored in the storage unit, instead of generating the processed authentication face image, One processed authentication facial image is associated with the vehicle information and the user identification information, The information processing apparatus according to claim 1, further performing the following:

10. Computers The process involves obtaining user identification information, which is the identification information of the vehicle user, and an authentication facial image, which is an image of the user's face used for authentication. To obtain vehicle identification information, which is the identification information of the vehicle and is associated with the user identification information, To obtain information regarding the attributes of the vehicle associated with the vehicle identification information, The process involves generating a processed authentication facial image by processing the authentication facial image according to information regarding the attributes of the vehicle, An information processing method that performs the following.

11. The computer stores the processed authentication facial image in its storage unit so that it can be used for facial recognition when the user uses the vehicle. The information processing method according to claim 10.

12. The computer obtains the user identification information and the authentication facial image from the user's terminal. The information processing method according to claim 10.

13. The computer, in response to a request to transmit the processed authentication facial image corresponding to the user identification information, transmits the processed authentication facial image corresponding to the user identification information. The information processing method according to claim 10.

14. The computer generates the processed authentication face image in response to a request to transmit the processed authentication face image corresponding to the user identification information. The information processing method according to claim 10.

15. The computer, in response to obtaining the user identification information and the authentication facial image from the user's terminal, generates the processed authentication facial image. The information processing method according to claim 10.

16. The computer generates the processed authentication facial image by reflecting the color of the vehicle's glass. The information processing method according to claim 10.

17. The computer generates the processed authentication face image by processing the authentication face image as an image taken through the vehicle's glass, according to information regarding the vehicle's attributes. The information processing method according to claim 10.

18. The aforementioned computer, To obtain information regarding the vehicle type associated with the aforementioned vehicle identification information, In response to the generation of the processed authentication facial image, the processed authentication facial image is stored in the storage unit in association with the user identification information and the vehicle type information. In response to obtaining the information regarding the vehicle type, the first processed authentication face image is obtained in which the user identification information and the information regarding the vehicle type associated with the processed authentication face image are the same. If no image is stored in the storage unit, the processed authentication face image is generated. In response to obtaining information regarding the vehicle model, if the first processed authentication face image is stored in the storage unit, instead of generating the processed authentication face image, the first processed authentication face image is associated with the information regarding the vehicle model and the user identification information. The information processing method according to claim 10, further performing the above.

19. This involves obtaining a user face image, which is an image generated by photographing a user inside the vehicle with a camera placed outside the vehicle, and To obtain vehicle identification information, which is the identification information of the aforementioned vehicle, At the time of authentication, the user identification information, which is the user identification information associated with the vehicle identification information, Obtaining a processed authentication face image which is an image of the user's face associated with the user identification information, and which has been processed to reflect the attributes of the vehicle identified from the vehicle identification information; The user's authentication is performed by comparing the user's facial image with the processed authentication facial image. If the user authentication is successful, the process associated with the user will be executed. An information processing device equipped with a control unit that performs the following.

20. The control unit, The request to transmit the processed authentication face image is associated with the user identification information and sent to the server that generates the processed authentication face image. The processed authentication facial image is obtained from the aforementioned server. The information processing apparatus according to claim 19.

Images