Authentication device, vehicle, authentication method, and recording medium

Abstract

Provided are an authentication device, a vehicle, an authentication method, and a recording medium with which it is easy to ensure authentication accuracy.　The authentication device comprises: a control means for adjusting either a camera capable of capturing an image of a user reflected in a room mirror of a vehicle or the room mirror so as to make it easier to capture an image of a target user riding in the vehicle; and an authenticating means for capturing an image of the target user using the camera and performing biometric authentication. If the biometric authentication is successful, the control means returns the position or direction of the camera or the room mirror to a prescribed state.

Description

Authentication device, vehicle, authentication method, and recording medium

[0001] The present invention relates to an authentication device, a vehicle, an authentication method, and a recording medium.

[0002] Patent Document 1 discloses a space-saving and inexpensive vehicle monitoring device that is equipped with multiple functions, such as recording driving conditions and recording parking abnormalities including theft prevention measures. The authentication device described in this document is described as including a camera that is installed inside the vehicle cabin and captures the field of view outside the vehicle cabin in the direction of vehicle travel, a rotation drive means that switches the camera to a state where it can capture the inside of the vehicle cabin, and a control means that causes the camera to capture the field of view outside the vehicle cabin in the direction of vehicle travel when the vehicle is parked and the field of view outside the vehicle cabin in the direction of vehicle travel when the vehicle is being driven.

[0003] Japanese Patent Application Laid-Open No. 2008-242597

[0004] In the vehicle monitoring device of Patent Document 1, the camera for capturing images of the field of view outside the vehicle in the direction of travel is also used to capture facial images, which may result in a decrease in authentication accuracy.

[0005] The present disclosure aims to provide an authentication device, a vehicle, an authentication method, and a recording medium that make it easy to ensure authentication accuracy.

[0006] According to a first aspect, an authentication device is provided that includes a camera capable of capturing an image of a user reflected in the vehicle's rearview mirror or a control means that adjusts the rearview mirror so as to make it easier to capture an image of a target user riding in the vehicle, and an authentication means that captures an image of the target user with the camera and performs biometric authentication, and the control means returns the position or orientation of the camera or rearview mirror to a predetermined state if the biometric authentication is successful.

[0007] According to a second aspect, there is provided a vehicle equipped with the above-described authentication device.

[0008] According to a third aspect, an authentication method is provided in which a camera capable of capturing an image of a user reflected in a vehicle's rearview mirror or the rearview mirror is adjusted to make it easier to capture an image of a target user riding in the vehicle, the camera captures an image of the target user, biometric authentication is performed, and if the biometric authentication is successful, the position or orientation of the camera or rearview mirror is returned to a predetermined state.

[0009] According to a fourth aspect, there is provided a process for adjusting a camera capable of capturing an image of a user reflected in the vehicle's rearview mirror or the rearview mirror so as to make it easier to capture an image of a target user riding in the vehicle, a process for capturing an image of the target user with the camera and performing biometric authentication, a process for returning the position or orientation of the camera or rearview mirror to a predetermined state if the biometric authentication is successful, and a recording medium having recorded thereon a program to be executed by a computer installed in the vehicle.

[0010] According to the present disclosure, it is possible to provide an authentication device, a vehicle, an authentication method, and a recording medium that can easily ensure authentication accuracy.

[0011] FIG. 1 is a diagram showing one configuration of the present disclosure. FIG. 2 is a flowchart showing the operation of the present disclosure. FIG. 3 is a diagram for explaining the operation of the present disclosure. FIG. 4 is a diagram for explaining the operation of the present disclosure. FIG. 5 is a diagram for explaining another configuration of the present disclosure. FIG. 6 is a diagram showing one configuration of a vehicle of the present disclosure. FIG. 7 is a diagram showing one configuration of an authentication device of the present disclosure. FIG. 8 is a flowchart showing the operation of the present disclosure. FIG. 9 is a diagram for explaining the operation of the present disclosure. FIG. 10 is a diagram for explaining another operation of the authentication device of the present disclosure. FIG. 11 is a diagram showing the configuration of a computer constituting the authentication device of the present disclosure.

[0012] First, an overview of one embodiment of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. The reference numerals in the drawings attached to this overview are attached to each element for convenience as an example to facilitate understanding, and are not intended to limit the present disclosure to the illustrated form. Furthermore, connecting lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. A program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and, if necessary, a display device. Furthermore, this computer device is configured to be able to communicate with internal or external devices (including computers) via the communication interface, whether wired or wireless. Although ports or interfaces are present at the input / output connection points of each block in the drawings, they are not shown.

[0013] In one embodiment, the present disclosure can be realized by an authentication device 10 including a control unit 11 and an authentication unit 12, as shown in Fig. 1. More specifically, the control unit 11 adjusts a camera C capable of capturing an image of the user reflected in the vehicle's rearview mirror so as to easily capture an image of the target user riding in the vehicle. The authentication unit 12 captures an image of the target user with the camera C and performs biometric authentication. Furthermore, if the biometric authentication is successful, the control unit 11 returns the position or orientation of the camera C to a predetermined state.

[0014] The authentication device 10 configured as described above operates as follows. First, the authentication device 10 adjusts the camera C or the rearview mirror M so that it can easily capture an image of the target user riding in the vehicle (step S01 in FIG. 2). Figure 3 shows an example in which the camera C is adjusted so that it can easily capture an image of the target user riding in the vehicle, and the camera C is tilted downward so that the face and iris of the target user can be captured by the camera C through the rearview mirror M.

[0015] Next, the authentication device 10 uses the camera C to capture an image of the target user and performs biometric authentication (step S02 in FIG. 2). If the biometric authentication is successful (YES in step S03 in FIG. 2), the authentication device 10 returns the position or orientation of the camera C or the rearview mirror M to a predetermined state (step S04 in FIG. 2). FIG. 4 shows an example in which the camera C is returned to the predetermined state. In the example of FIG. 4, the camera C is returned to a state for capturing an image in the direction of travel of the vehicle.

[0016] In the example of FIG. 2, if the biometric authentication fails (NO in step S03 in FIG. 2), the function is immediately restricted (step S05 in FIG. 2), but it is also possible to perform user authentication again a certain number of times.

[0017] In the above description of the operation, the camera C was adjusted before biometric authentication was performed. However, as shown in Fig. 5, the present disclosure can be modified so that the control means 11a can adjust the orientation of the rearview mirror M instead of the camera C. In this case, before user authentication, the authentication device 10a will drive the rearview mirror M so that it is easier to capture an image of the target user in the vehicle. Then, after user authentication is completed, the authentication device 10a will return the rearview mirror M to its original position.

[0018] As described above, the authentication device 10 of the present disclosure enables user authentication using a rearview mirror. Compared to the vehicle monitoring device of Patent Document 1, the authentication device 10 has the advantage that the camera C requires less driving and the shooting conditions are less likely to change, making it possible to stabilize the white balance, etc.

[0019] [First embodiment] Next, a first embodiment in which an authentication device according to the present disclosure is mounted on a vehicle will be described. Fig. 6 is a diagram showing one configuration of a vehicle according to the present disclosure. Referring to Fig. 6, a vehicle V is shown equipped with a camera C1, a rearview mirror M, and an authentication device 100.

[0020] The camera C1 is a camera placed inside the vehicle cabin for, for example, iris authentication or face authentication, and is installed in a position where it can capture an image of the user's face and eyes by turning the rearview mirror M when the user sits in the driver's seat.

[0021] The rearview mirror M is provided with an actuator inside, and is capable of freely changing its direction based on a control signal from the authentication device 100.

[0022] 7 is a diagram showing one configuration of the authentication device 100. The authentication device 100 includes a control unit 101 and an authentication unit 102. The control unit 101 and the authentication unit 102 correspond to the control means 11 and the authentication means 12 described above.

[0023] The control unit 101 is connected to a switch S for detecting a user's boarding action and to the rearview mirror M. This switch S may be, for example, a switch installed under the driver's seat, or may also serve as a switch for detecting door closure or a touch sensor installed on the steering wheel. When the user boards the vehicle, a notification is sent from the switch S to the control unit 101. Upon receiving the notification, the control unit 101 instructs the authentication unit 102 to start user authentication. Furthermore, when the control unit 101 receives a notification from the authentication unit 102 that user authentication has been successful, the control unit 101 performs an operation to set the orientation of the rearview mirror M to a direction that allows the user to check the rear of the vehicle V. Furthermore, when the user has finished driving, the control unit 101 performs an operation to return the rearview mirror M to a direction that makes it easier to capture an image of the user boarding the vehicle V.

[0024] When the authentication unit 102 receives an instruction to start user authentication from the control unit 101, it performs user authentication. For example, if iris authentication is used as the user authentication method, the authentication unit 102 compares the iris pattern of the user registered in advance with the iris pattern captured by the camera C. If the comparison determines that the characteristics of the two iris patterns match, the authentication unit 102 determines that the authentication has been successful. If the user authentication is successful, the authentication unit 102 notifies the control unit 101 that the user authentication has been successful.

[0025] On the other hand, if it is determined that the characteristics of the two iris patterns do not match, the authentication unit 102 determines that the authentication has failed. Thereafter, the authentication unit 102 outputs an alert via a speaker or display device (not shown), and thereafter restricts functions.

[0026] Next, the operation of this embodiment will be described in detail with reference to the drawings. Fig. 8 is a flowchart showing the operation of the present disclosure. Referring to Fig. 8, first, when the authentication device 100 detects a user's boarding action (step S001), it photographs the user with the camera C1 and performs user authentication (steps S002 and S003). As a result of the user authentication, if the user authentication is successful (YES in step S003), the authentication device 100 changes the orientation of the rearview mirror M to one suitable for driving (step S004).

[0027] Here, the angle control of the rearview mirror M by the authentication device 100 will be described. FIGS. 9 and 10 are diagrams for explaining the operation of the present disclosure. FIG. 9 is a diagram schematically showing the orientation of the rearview mirror M when performing user authentication. Before starting driving, the authentication device 100 performs an operation to tilt the rearview mirror M by an angle θ1 with respect to the width direction of the vehicle V. This allows the camera C1 to capture the user's face and eyes through the rearview mirror M, making it possible to perform user authentication by biometric authentication with high accuracy.

[0028] FIG. 10 is a diagram schematically illustrating the orientation of the rearview mirror M when driving. While driving, the authentication device 100 tilts the rearview mirror M by an angle θ2 with respect to the width direction of the vehicle V. This allows the user to view the area behind the vehicle through the rearview mirror M. In a more preferred embodiment, the authentication device 100 determines the angle θ2 of the rearview mirror M based on the position of the user's eyes photographed by the camera C1 during user authentication. This makes it possible to adjust the orientation of the rearview mirror M to an optimal position for each user.

[0029] The operation of this embodiment will be described again with reference to Fig. 8. As described above, after the user authentication is successful and the orientation of the rearview mirror M is changed, the user starts driving (step S006).

[0030] Finally, when the user finishes driving, the authentication device 100 performs an operation to return the rearview mirror M to a direction (position) suitable for photographing the user while he or she is getting into the vehicle V (step S007). By doing so, it becomes possible to smoothly perform user authentication when the user gets into the vehicle V again.

[0031] On the other hand, if the user authentication fails in step S003 (NO in step S003), the authentication device 100 outputs an alert on a speaker or display device (not shown) and thereafter implements function restrictions (step S005). Note that in the example of Fig. 8, the authentication device 100 performs user authentication by photographing the user again, but the authentication device 100 may allow the user to drive under certain function restrictions, or conversely, may control the user so that the user is not allowed to operate the device at all.

[0032] As described above, according to this embodiment, it is possible to use the rearview mirror M to smoothly perform user authentication in the flow of the user's boarding actions when boarding the vehicle V.

[0033] [Second Embodiment] In the first embodiment described above, an example was given in which user authentication was performed on the user in the driver's seat, but this can be changed to a form in which user authentication is performed on other passengers in the vehicle V (second embodiment). This second embodiment can be realized with a configuration similar to that of the first embodiment, and therefore the following description will focus on differences in operation.

[0034] 11 is a diagram illustrating another operation of the authentication device 100 of the present disclosure. In the example of FIG. 11, the authentication device 100 performs an operation to tilt the rearview mirror M by an angle θ3 toward the passenger in the front passenger seat. This allows the camera C1 to capture an image of the face and eyes of the passenger in the front passenger seat through the rearview mirror M, making it possible to perform user authentication of the passenger in the front passenger seat.

[0035] For example, the authentication device 100 repeats the adjustment of the rearview mirror M and the user authentication for all users who board the vehicle V, and performs user authentication for all users. Then, when the biometric authentication of all users is successful, the authentication device 100 performs an operation to set the orientation of the rearview mirror M to an orientation that allows the rear of the vehicle V to be checked. Then, when driving is finished, the authentication device 100 performs an operation to return the rearview mirror M to an orientation that makes it easier to capture an image of the user who boards the vehicle V.

[0036] As described above, the present disclosure can be modified to a form in which authentication of multiple users who board a vehicle is performed.

[0037] Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of the present disclosure. For example, the network configurations, element configurations, and data representation formats shown in the drawings are examples intended to aid in understanding the present disclosure, and are not limited to the configurations shown in these drawings.

[0038] (Hardware Configuration) In each embodiment of the present disclosure, each component of each device represents a functional unit block. Some or all of the components of each device are realized by an arbitrary combination of an information processing device 900 and a program, for example, as shown in FIG. 12 . FIG. 12 is a block diagram showing an example of the hardware configuration of the information processing device 900 that realizes each component of each device. The information processing device 900 includes, as an example, the following configuration: - CPU (Central Processing Unit) 901 - ROM (Read Only Memory) 902 - RAM (Random Access Memory) 903 - Program 904 loaded into RAM 903 - Storage device 905 that stores the program 904 - Drive device 907 that reads and writes to a recording medium 906 - Communication interface 908 that connects to a communication network 909 - Input / output interface 910 that inputs and outputs data - Bus 911 that connects each component

[0039] Each component of each device in each embodiment is realized by the CPU 901 acquiring and executing a program 904 that realizes the function. That is, the CPU 901 in FIG. 12 executes a mirror drive program and a user authentication program, and performs an update process for each calculation parameter stored in the RAM 903, the storage device 905, etc. The program 904 that realizes the function of each component of each device is stored in the storage device 905 or the ROM 902 in advance, for example, and is read by the CPU 901 as needed. The program 904 may be supplied to the CPU 901 via the communication network 909, or may be stored in advance on the recording medium 906, and the drive device 907 may read the program and supply it to the CPU 901.

[0040] There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a separate information processing device 900 and a program for each component. Furthermore, multiple components provided in each device may be realized by any combination of a single information processing device 900 and a program. In other words, each unit (processing means, function) of the authentication device shown in the first and second embodiments can be realized by a computer program that causes a processor installed in the device to execute each of the above-mentioned processes using its hardware.

[0041] In addition, some or all of the components of each device may be realized by other general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus.

[0042] Some or all of the components of each device may be realized by a combination of the above-mentioned circuits and programs.

[0043] When some or all of the components of each device are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each device is connected via a communication network.

[0044] It should be noted that the above-described embodiments are preferred embodiments of the present disclosure, and the scope of the present disclosure is not limited to only the above-described embodiments. In other words, those skilled in the art can modify or substitute the above-described embodiments to construct various modified forms without departing from the gist of the present disclosure.

[0045] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0046] [Supplementary Note 1] An authentication device comprising: a control means for adjusting a camera capable of capturing an image of a user reflected in the vehicle's rearview mirror or the rearview mirror so as to make it easier to capture an image of a target user riding in the vehicle; and an authentication means for capturing an image of the target user with the camera and performing biometric authentication, wherein the control means returns the position or orientation of the camera or the rearview mirror to a predetermined state if the biometric authentication is successful. [Supplementary Note 2] The control means of the authentication device described above can be configured to, when driving the vehicle is finished, set the camera capable of capturing an image of the user reflected in the vehicle's rearview mirror or the rearview mirror to a position that makes it easier to capture an image of the target user riding in the vehicle. [Supplementary Note 3] The control means of the authentication device described above can be configured to orient the rearview mirror in the predetermined direction based on the position of the user's eyes in the driver's seat if the biometric authentication is successful. [Supplementary Note 4] The control means of the authentication device described above can be configured to return the camera to a state for capturing images in the direction of travel of the vehicle if the biometric authentication is successful. [Supplementary Note 5] The control means of the above authentication device can be configured to start adjusting the camera or the rearview mirror when the user boards the vehicle, and to instruct the authentication means to perform user authentication. [Supplementary Note 6] The control means and the authentication means of the above authentication device can be configured to: repeatedly adjust the camera or rearview mirror and perform the biometric authentication for multiple users boarding the vehicle; and the control means return the position or orientation of the camera or rearview mirror to a predetermined state when biometric authentication is successful for all of the users. [Supplementary Note 7] A vehicle equipped with the above authentication device. [Supplementary Note 8] An authentication method comprising: adjusting a camera or the rearview mirror that can capture an image of a user reflected in the vehicle's rearview mirror so that it can easily capture an image of a target user boarding the vehicle; photographing an image of the target user with the camera and performing biometric authentication; and returning the position or orientation of the camera or the rearview mirror to a predetermined state when the biometric authentication is successful.[Supplementary Note 9] A process for adjusting a camera or rearview mirror capable of capturing an image of a user reflected in the vehicle's rearview mirror so that it is easy to capture an image of a target user riding in the vehicle; a process for capturing an image of the target user with the camera and performing biometric authentication; a process for returning the position or orientation of the camera or rearview mirror to a predetermined state if the biometric authentication is successful; and a recording medium recording a program to be executed by a computer installed in the vehicle. Note that the embodiments described in each of the above Supplements can be combined with each other after making necessary modifications. For example, a configuration that combines the contents of Supplementary Note 2 and Supplementary Note 3, in which, upon completion of driving, the camera or rearview mirror is set in a position that makes it easy to capture an image of the target user riding in the vehicle, and the rearview mirror is turned to the predetermined position when the biometric authentication is successful, is also within the scope of the present specification. Note that the embodiments of Supplements 8 to 9 above can be expanded into the embodiments of Supplements 2 to 6, as in Supplementary Note 1.

[0047] The disclosures of the above-cited patent documents are incorporated herein by reference and may be used as the basis or part of this disclosure, as necessary. Modifications and adjustments of the embodiments and examples are possible within the scope of this disclosure (including the claims), and further based on its basic technical concept. Furthermore, various combinations and selections (including partial deletions) of various disclosed elements (including elements of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible within the scope of this disclosure. In other words, this disclosure naturally includes various modifications and alterations that would be possible by a person skilled in the art in accordance with the entire disclosure, including the claims, and the technical concept. In particular, with regard to the numerical ranges described herein, any numerical value or subrange within that range should be construed as specifically described, even if not otherwise specified. Furthermore, the disclosures of the above-cited documents, when used in part or in whole in combination with the disclosures herein as part of this disclosure, in accordance with the spirit of this disclosure, are also deemed to be included in the disclosures of this application.

[0048] REFERENCE SIGNS LIST 10, 10a Authentication device 11 Control means 12 Authentication means 100 Authentication device 101 Control unit 102 Authentication unit 900 Information processing device 901 CPU (Central Processing Unit) 902 ROM (Read Only Memory) 903 RAM (Random Access Memory) 904 Program 905 Storage device 906 Recording medium 907 Drive device 908 Communication interface 909 Communication network 910 Input / output interface 911 Bus C, C1 Camera M Room mirror V Vehicle

Claims

1. An authentication device comprising: a camera capable of capturing an image of a user reflected in a vehicle's rearview mirror; or a control means for adjusting the rearview mirror so as to make it easier to capture an image of a target user riding in the vehicle; and an authentication means for capturing an image of the target user with the camera and performing biometric authentication, wherein the control means returns the position or orientation of the camera or rearview mirror to a predetermined state if the biometric authentication is successful.

2. The authentication device of claim 1, wherein the control means, when driving of the vehicle is completed, sets a camera capable of capturing an image of the user reflected in the vehicle's rearview mirror or the rearview mirror in a position that makes it easy to capture an image of the target user riding in the vehicle.

3. An authentication device as described in claim 1 or 2, wherein the control means, if the biometric authentication is successful, directs the rearview mirror in the predetermined direction based on the position of the eyes of the user sitting in the driver's seat.

4. An authentication device according to claim 1 or 2, wherein the control means returns the camera to a state for capturing images in the direction of travel of the vehicle if the biometric authentication is successful.

5. An authentication device according to any one of claims 1 to 4, wherein the control means, upon the user's boarding action, starts adjusting the camera or the rearview mirror and instructs the authentication means to perform user authentication.

6. An authentication device as described in any one of claims 1 to 5, wherein the control means and the authentication means repeat adjustment of the camera or rearview mirror and the biometric authentication for multiple users riding in the vehicle, and when biometric authentication of all users is successful, the control means returns the position or orientation of the camera or rearview mirror to a predetermined state.

7. A vehicle equipped with an authentication device according to any one of claims 1 to 6.

8. An authentication method comprising adjusting a camera capable of capturing an image of a user reflected in a vehicle's rearview mirror or said rearview mirror so as to make it easier to capture an image of a target user riding in said vehicle, capturing an image of said target user with said camera and performing biometric authentication, and if said biometric authentication is successful, returning the position or orientation of said camera or said rearview mirror to a predetermined state.

9. A process for adjusting a camera capable of capturing an image of a user reflected in the vehicle's rearview mirror or the rearview mirror so as to make it easier to capture an image of a target user riding in the vehicle; a process for capturing an image of the target user with the camera and performing biometric authentication; a process for returning the position or orientation of the camera or the rearview mirror to a predetermined state if the biometric authentication is successful; and a recording medium having recorded thereon a program to be executed by a computer installed in the vehicle.

Images