Authentication device, vehicle, authentication method, and program

Abstract

Provided are an authentication device, a vehicle, an authentication method, and a recording medium which are capable of maintaining excellent authentication accuracy even in a situation where brightness and the direction of light change greatly.　This authentication device comprises: a sensing means for sensing the face of a user in an image captured by a camera installed inside a vehicle; a detection means for detecting a movement of the face; an adjustment means for adjusting the image capturing environment when the movement of the face is equal to or less than a predetermined threshold for a certain period of time; and an authentication means for performing biometric authentication after adjusting the image capturing environment.

Description

Authentication device, vehicle, authentication method, and recording medium

[0001] The present invention relates to an authentication device, a vehicle, an authentication method, and a recording medium.

[0002] Patent Literature 1 discloses a matching device that can improve matching accuracy and reduce the overall processing time required for matching. The matching device described in this document includes a motion detection processing unit that detects whether or not a subject included in acquired image data is moving based on the acquired image data, and a matching image data generation unit. The matching image data generation unit is described as generating matching data to be used for matching based on the acquired image data if no motion of the subject is detected, and not generating the matching image data if motion of the subject is detected.

[0003] JP 2016-71591 A

[0004] When a camera for capturing images for biometric authentication is installed in a vehicle or the like, brightness and the direction of light vary significantly depending on where the vehicle is parked, which causes the position of the vehicle and the position of the light source to change, resulting in a problem of variations in authentication accuracy.In this regard, the matching device described in Patent Document 1 is configured to generate matching data when the subject is moving, and is therefore thought to be unable to handle situations where brightness or the direction of light changes significantly.

[0005] The present disclosure aims to provide an authentication device, a vehicle, an authentication method, and a recording medium that can maintain good authentication accuracy even under conditions where the brightness or direction of light changes significantly.

[0006] According to a first aspect, there is provided an authentication device including: a detection means for detecting a user's face in an image captured by a camera installed inside a vehicle; a detection means for detecting movement of the face; an adjustment means for adjusting the imaging environment when the movement of the face is below a predetermined threshold for a certain period of time; and an authentication means for performing biometric authentication after adjusting the imaging environment.

[0007] According to a second aspect, there is provided a vehicle equipped with the above-described authentication device.

[0008] According to a third aspect, an authentication method is provided in which a user's face is detected in an image captured by a camera installed inside a vehicle, movement of the face is detected, and when the movement of the face is below a predetermined threshold for a certain period of time, the imaging environment is adjusted, and biometric authentication is performed after the imaging environment is adjusted.

[0009] According to a fourth aspect, there is provided a recording medium having recorded thereon a program that causes a computer mounted on a vehicle to execute the following processes: detecting a user's face in an image captured by a camera installed inside the vehicle; detecting the movement of the face; adjusting the shooting environment when the movement of the face is below a predetermined threshold for a certain period of time; and performing biometric authentication after adjusting the shooting environment.

[0010] According to the present disclosure, it is possible to provide an authentication device, a vehicle, an authentication method, and a recording medium that can maintain good authentication accuracy even under conditions where the brightness or direction of light changes significantly.

[0011] FIG. 1 is a diagram showing one configuration of the present disclosure. FIG. 2 is a flowchart showing the operation of the present disclosure. FIG. 3 is a diagram showing one configuration of a vehicle of the present disclosure. FIG. 4 is a diagram showing one configuration of an authentication device of the present disclosure. FIG. 5 is a flowchart showing the operation of the present disclosure. FIG. 6 is a diagram showing another configuration of a vehicle of the present disclosure. FIG. 7 is a diagram showing another configuration of the authentication device of the present disclosure. FIG. 8 is another flowchart showing the operation of the present disclosure. FIG. 9 is a diagram for explaining the operation of the present disclosure. FIG. 10 is a diagram showing another configuration of the authentication device of the present disclosure. FIG. 11 is a diagram showing the configuration of a computer constituting the authentication device of the present disclosure.

[0012] First, an overview of one embodiment of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. The reference numerals in the drawings attached to this overview are attached to each element for convenience as an example to facilitate understanding, and are not intended to limit the present disclosure to the illustrated form. Furthermore, connecting lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. A program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and, if necessary, a display device. Furthermore, this computer device is configured to be able to communicate with internal or external devices (including computers) via the communication interface, whether wired or wireless. Although ports or interfaces are present at the input / output connection points of each block in the drawings, they are not shown.

[0013] In one embodiment, the present disclosure can be realized by an authentication device 10 including a detection unit 11, a detection unit 12, an adjustment unit 13, and an authentication unit 14, as shown in FIG. 1 . More specifically, the detection unit 11 detects the face of a user in an image captured by a camera C installed inside the vehicle. The detection unit 12 detects the movement of the user's face. The adjustment unit 13 adjusts the image capturing environment when the movement of the face is equal to or less than a predetermined threshold for a certain period of time. Examples of the image capturing environment include the illuminance of the space (vehicle interior) in which the camera C is installed and the type of light source. For example, the adjustment unit 13 adjusts the image capturing environment by controlling a lamp L installed inside the vehicle. The authentication unit 14 performs biometric authentication after adjusting the image capturing environment.

[0014] The authentication device 10 configured as above operates as follows: First, the authentication device 10 detects the face of the user in an image captured by a camera C installed inside the vehicle (step S01 in FIG. 2).

[0015] Next, the authentication device 10 detects the facial movement of the user and checks whether the facial movement has been below a predetermined threshold for a certain period of time (step S02 in FIG. 2). Whether the facial movement has been below the predetermined threshold can be determined by, for example, a method known as a technique for detecting blurring of a subject.

[0016] If it is confirmed that the facial movement is equal to or less than a predetermined threshold, the authentication device 10 adjusts the photographing environment (step S03).

[0017] When the adjustment of the photographing environment is completed, the authentication device 10 performs biometric authentication (step S04).

[0018] As described above, with the operating authentication device 10, as described above, in step S02, it is confirmed that the subject is not blurred and the shooting environment is adjusted before entering the actual authentication, thereby stabilizing the authentication accuracy of the biometric authentication.

[0019] [First embodiment] Next, a first embodiment of the present disclosure in which an authentication device according to the present disclosure is mounted on a vehicle will be described. Fig. 3 is a diagram showing one configuration of a vehicle equipped with an authentication device 100 according to the present disclosure. Referring to Fig. 3, a vehicle V equipped with the authentication device 100, a camera C, and a room lamp L is shown.

[0020] The camera C is a camera arranged in the vehicle cabin for performing, for example, iris authentication or face authentication. In this embodiment, the authentication device 100 uses the camera C to acquire biometric information of a user who is in the vehicle.

[0021] The room lamp L is an interior light with a dimming function, and the brightness of the room lamp L can be freely changed based on a control signal from the authentication device 100.

[0022] 4 is a diagram showing one configuration of authentication device 100. Authentication device 100 includes a detection unit 101, a detection unit 102, an adjustment unit 103, and an authentication unit 104. Detection unit 101, detection unit 102, adjustment unit 103, and authentication unit 104 correspond to detection means 11, detection means 12, adjustment means 13, and authentication means 14, respectively.

[0023] When a user sits in the driver's seat, the detection unit 101 starts monitoring the image captured by the camera C. Then, the detection unit 101 detects the user's face in the image captured by the camera C and notifies the detection unit 102 of the position of the user's face in the image.

[0024] The detection unit 102 monitors the movement of the user's face in the image notified by the detection unit 101, and when the movement of the face is equal to or less than a predetermined threshold for a certain period of time, the detection unit 102 instructs the adjustment unit 103 to adjust the shooting environment. Furthermore, when the movement of the user's face continues to exceed the predetermined threshold, the detection unit 102 outputs a message via a speaker or a display unit (not shown) of the in-car terminal, urging the user to stay still.

[0025] When the adjustment unit 103 receives an instruction to start adjusting the image capturing environment from the detection unit 102, it starts dimming control of the room lamp L based on the image captured by the camera C. For example, if the image is dark, the adjustment unit 103 controls the room lamp L to turn on or to become brighter. Also, for example, if the image is too bright and has blown-out highlights, the adjustment unit 103 controls the room lamp L to turn off or to become darker.

[0026] If the room lamp L has a color adjustment function, the adjustment unit 103 may perform color adjustment control in addition to dimming. Upon completing the adjustment of the image capturing environment, the adjustment unit 103 notifies the authentication unit 104 that the adjustment of the image capturing environment has been completed.

[0027] The authentication unit 104 performs biometric authentication based on the notification from the adjustment unit 103. For example, the authentication unit 104 compares the iris pattern of the user registered in advance with the iris pattern captured by the camera C. If the comparison determines that the characteristics of the two iris patterns match, the authentication unit 104 determines that the authentication is successful and grants the user authority to operate the vehicle, etc.

[0028] Next, the operation of this embodiment will be described in detail with reference to the drawings. Fig. 5 is a flowchart showing the operation of the present disclosure. Referring to Fig. 5, first, when the authentication device 100 detects the user's boarding action, it activates the camera C (step S001). Next, the authentication device 100 starts detecting the user's face in the image captured by the camera C (step S002).

[0029] The authentication device 100 monitors the detected facial movement of the user, and if there is no movement (the amount of movement is equal to or less than a predetermined threshold for a certain period of time) (YES in step S003), it dims the room light L (step S004). On the other hand, if there is movement of the user's face (NO in step S003), the authentication device 100 outputs a message via a speaker or a screen display to call attention to the user to stay still (step S004).

[0030] When the dimming of the room light L is completed, the authentication device 100 performs biometric authentication (step S005).

[0031] According to this embodiment, which operates as described above, biometric authentication is initiated after confirming that the user is not moving and adjusting the brightness inside the vehicle to a level suitable for biometric authentication, thereby stabilizing the accuracy of biometric authentication.

[0032] Second Embodiment Next, a second embodiment will be described in which an electronic shade is used to adjust the shooting environment. Fig. 6 is a diagram showing another configuration of a vehicle according to the present disclosure. The difference from the first embodiment shown in Fig. 3 is that an electronic shade ES is provided on the window glass of the vehicle Va. The other configurations are the same as those in Fig. 5, so the following description will focus on the differences.

[0033] The vehicle Va is equipped with an electronic shade ES, which can be freely switched between a light-blocking state and a light-transmitting state based on a control signal from the authentication device 100a.

[0034] FIG. 7 is a diagram showing another configuration of the authentication device 100a. The difference from the first embodiment shown in FIG. 4 is that the adjustment unit 103a is connected to the electronic shade ES. When the adjustment unit 103a receives an instruction to start adjusting the image capture environment from the detection unit 102, it starts controlling the light blocking or transmission of the electronic shade ES based on the image captured by the camera C. For example, if the image is dark, the adjustment unit 103a changes the electronic shade ES to a light-transmitting state or controls it to increase its transmittance. For example, if the image is too bright and has blown-out highlights, the adjustment unit 103a changes the electronic shade ES to a light-blocking state or controls it to decrease its transmittance. Upon completing the adjustment of the image capture environment, the adjustment unit 103a notifies the authentication unit 104 that the adjustment of the image capture environment has been completed.

[0035] Next, the operation of this embodiment will be described in detail with reference to the drawings. Fig. 8 is a flowchart showing the operation of the present disclosure. The difference from the first embodiment shown in Fig. 5 is that the authentication device 100a controls the electronic shade ES when there is no facial movement of the user being monitored (step S104). The other operations are the same as those of the first embodiment, so their description will be omitted.

[0036] As explained above, the present invention can be suitably applied to a vehicle equipped with an electronic shade ES.

[0037] Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of the present disclosure. For example, the network configurations, element configurations, and data representation formats shown in the drawings are examples intended to aid in understanding the present disclosure, and are not limited to the configurations shown in these drawings.

[0038] For example, a configuration may be adopted that combines the configurations of the first and second embodiments described above and controls both the room lamp L and the electronic shade ES to adjust the shooting environment. Also, a configuration may be adopted in which, in addition to controlling the room lamp L and the electronic shade ES, the adjustment units 103 and 103a adjust the shooting parameters of the camera C. The shooting parameters of the camera C may include the angle of view, shutter speed, aperture, ISO value (ISO sensitivity), and whether or not noise reduction is enabled (see FIG. 10 , third embodiment).

[0039] (Hardware Configuration) In each embodiment of the present disclosure, each component of each device represents a functional unit block. Some or all of the components of each device are realized by an arbitrary combination of an information processing device 900 and a program, for example, as shown in FIG. 11 . FIG. 11 is a block diagram showing an example of the hardware configuration of the information processing device 900 that realizes each component of each device. The information processing device 900 includes, as an example, the following configuration: - CPU (Central Processing Unit) 901 - ROM (Read Only Memory) 902 - RAM (Random Access Memory) 903 - Program 904 loaded into RAM 903 - Storage device 905 that stores the program 904 - Drive device 907 that reads and writes to a recording medium 906 - Communication interface 908 that connects to a communication network 909 - Input / output interface 910 that inputs and outputs data - Bus 911 that connects each component

[0040] Each component of each device in each embodiment is realized by the CPU 901 acquiring and executing a program 904 that realizes the function. That is, the CPU 901 in FIG. 11 executes a motion detection program and a shooting environment adjustment program, and performs an update process for each calculation parameter stored in the RAM 903, the storage device 905, etc. The program 904 that realizes the function of each component of each device is stored in advance in, for example, the storage device 905 or the ROM 902, and is read out by the CPU 901 as needed. The program 904 may be supplied to the CPU 901 via the communication network 909, or may be stored in advance on the recording medium 906, and the drive device 907 may read out the program and supply it to the CPU 901.

[0041] There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a separate information processing device 900 and a program for each component. Furthermore, multiple components provided in each device may be realized by any combination of a single information processing device 900 and a program. In other words, each unit (processing means, function) of the authentication device shown in the first to third embodiments can be realized by a computer program that causes a processor installed in the device to execute each of the above-mentioned processes using its hardware.

[0042] In addition, some or all of the components of each device may be realized by other general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus.

[0043] Some or all of the components of each device may be realized by a combination of the above-mentioned circuits and programs.

[0044] When some or all of the components of each device are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each device is connected via a communication network.

[0045] It should be noted that the above-described embodiments are preferred embodiments of the present disclosure, and the scope of the present disclosure is not limited to only the above-described embodiments. In other words, those skilled in the art can modify or substitute the above-described embodiments to construct various modified forms without departing from the gist of the present disclosure.

[0046] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0047] [Supplementary Note 1] An authentication device comprising: a detection means for detecting a user's face in an image captured by a camera installed in a vehicle; a detection means for detecting the movement of the face; an adjustment means for adjusting the image capturing environment when the movement of the face is below a predetermined threshold for a certain period of time; and an authentication means for performing biometric authentication after adjusting the image capturing environment. [Supplementary Note 2] The authentication device of the above-mentioned authentication device is installed in a vehicle, and the adjustment unit can be configured to turn on lights in the vehicle as the image capturing environment. [Supplementary Note 3] The lights in the vehicle of the above-mentioned authentication device have a dimming function, and the adjustment means can be configured to create an environment suitable for biometric authentication using the dimming function. [Supplementary Note 4] The authentication device of the above-mentioned authentication device is installed in a vehicle, and the adjustment means can be configured to control electronic shades installed on windows of the vehicle as the image capturing environment. [Supplementary Note 5] The adjustment means of the above-mentioned authentication device can be configured to adjust the angle of view of a camera or image capturing parameters as the image capturing environment. [Supplementary Note 6] The adjustment means of the above authentication device can be configured to adjust the shooting environment when the movements of the user's face and the user's iris are each below a predetermined threshold. [Supplementary Note 7] A vehicle equipped with the above authentication device. [Supplementary Note 8] An authentication method that detects a user's face in an image captured by a camera installed in the vehicle, detects the movement of the face, adjusts the shooting environment when the movement of the face has been below a predetermined threshold for a certain period of time, and performs biometric authentication after adjusting the shooting environment. [Supplementary Note 9] A recording medium having recorded thereon a program that causes a computer installed in the vehicle to execute the following processes: detects a user's face in an image captured by a camera installed in the vehicle; detects the movement of the face; adjusts the shooting environment when the movement of the face has been below a predetermined threshold for a certain period of time; and performs biometric authentication after adjusting the shooting environment. Note that the embodiments described in each of the above supplementary notes can be combined with each other after making necessary modifications. For example, a configuration that combines the contents described in Supplementary Note 2 and the contents described in Supplementary Note 4, in which the adjustment means controls both the vehicle lights and the electronic shade, is also included in the scope of the disclosure of this specification.The embodiments of Supplementary Notes 8 and 9 can be expanded to the embodiments of Supplementary Notes 2 to 6, similarly to Supplementary Note 1.

[0048] The disclosures of the above-cited patent documents are incorporated herein by reference and may be used as the basis or part of this disclosure, as necessary. Modifications and adjustments of the embodiments and examples are possible within the scope of this disclosure (including the claims), and further based on its basic technical concept. Furthermore, various combinations and selections (including partial deletions) of various disclosed elements (including elements of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible within the scope of this disclosure. In other words, this disclosure naturally includes various modifications and alterations that would be possible by a person skilled in the art in accordance with the entire disclosure, including the claims, and the technical concept. In particular, with regard to the numerical ranges described herein, any numerical value or subrange within that range should be construed as specifically described, even if not otherwise specified. Furthermore, the disclosures of the above-cited documents, when used in part or in whole in combination with the disclosures herein as part of this disclosure, in accordance with the spirit of this disclosure, are also deemed to be included in the disclosures of this application.

[0049] REFERENCE SIGNS LIST 10, 100, 100a Authentication device 11 Detection means 12 Detection means 13 Adjustment means 14 Authentication means 101 Detection unit 102 Detection unit 103, 103a Adjustment unit 104 Authentication unit 900 Information processing device 901 CPU (Central Processing Unit) 902 ROM (Read Only Memory) 903 RAM (Random Access Memory) 904 Program 905 Storage device 906 Recording medium 907 Drive device 908 Communication interface 909 Communication network 910 Input / output interface 911 Bus C Camera ES Electronic shade L (Room) lamp V, Va Vehicle

Claims

1. A detection means that detects the user's face in images captured by a camera installed inside the vehicle, The detection means for detecting the facial movement, An adjustment means for adjusting the shooting environment when the facial movement is below a predetermined threshold for a certain period of time, An authentication means that performs biometric authentication after adjusting the aforementioned shooting environment, An authentication device equipped with the following features.

2. The aforementioned authentication device is installed inside the vehicle. The authentication device according to claim 1, wherein the adjustment unit turns on the lights inside the vehicle as the shooting environment.

3. The lights inside the aforementioned vehicle are equipped with a dimming function. The authentication device according to claim 2, wherein the adjustment means creates an environment suitable for biometric authentication by the dimming function.

4. The aforementioned authentication device is installed inside the vehicle. The authentication device according to claim 1, wherein the adjustment means controls an electronic shade installed on the window of the vehicle as the shooting environment.

5. The authentication device according to claim 1, wherein the adjustment means adjusts the camera's field of view or shooting parameters as the shooting environment.

6. The authentication device according to claim 1, wherein the adjustment means adjusts the shooting environment when the movement of the user's face and the movement of the user's iris are each below a predetermined threshold.

7. A vehicle equipped with an authentication device according to any one of claims 1 to 6.

8. The system detects the user's face in images captured by cameras installed inside the vehicle. The aforementioned facial movement is detected, If the facial movement falls below a predetermined threshold for a certain period of time, the shooting environment is adjusted. An authentication method that performs biometric authentication after adjusting the aforementioned shooting environment.

9. The process involves detecting the user's face in images captured by cameras installed inside the vehicle, The process for detecting the aforementioned facial movements, A process to adjust the shooting environment when the facial movement falls below a predetermined threshold for a certain period of time, The process of performing biometric authentication after adjusting the aforementioned shooting environment is performed. A program to be executed by the computer installed in the aforementioned vehicle.