Authentication device, vehicle, authentication method, and recording medium

Abstract

The present invention addresses the problem of preventing a switching action without impairing user convenience.　In the present invention, an authentication device includes an authentication means for performing user authentication for a user of a vehicle, a confirmation means for photographing and tracking an image of the user after successful authentication by the authentication means, and an authentication control means that causes an authentication result outputted by the authentication means to be returned to an unauthenticated state when the tracking fails.

Description

Authentication device, vehicle, authentication method, and recording medium

[0001] The present invention relates to an authentication device, a vehicle, an authentication method, and a recording medium.

[0002] Patent Document 1 discloses an example of an authentication device for a vehicle that uses biometric information to identify users. In this authentication device, in order to allow passengers other than the driver to drive the vehicle, the device acquires biometric information corresponding to a new passenger (second user) after identifying the driver (first user). The authentication device then grants certain privileges to the passenger (second user). The authentication device then permits the passenger (second user) to perform operations such as unlocking the doors. The document also describes how, after the driver has been authenticated, the device returns to an unauthenticated state after a certain period of time has elapsed or when it is detected that the driver has left the seat.

[0003] Japanese Patent Application Laid-Open No. 2017-1615

[0004] There is a possibility that a third party may get in and drive the vehicle while a driver or other person who has been properly authenticated leaves the seat. For this reason, Patent Document 1 proposes that the vehicle be returned to an unauthenticated state after a certain period of time has passed or when the driver or other person has left the seat. However, if the conditions for returning to the unauthenticated state are relaxed to prevent such a case, the vehicle may be returned to an unauthenticated state simply by the user moving their seat to retrieve something from the back seat. As a result, the driver or other person will be required to authenticate themselves every time they leave the seat, which reduces convenience.

[0005] An object of the present disclosure is to provide an authentication device, a vehicle, an authentication method, and a recording medium that can prevent substitution without impairing user convenience.

[0006] According to a first aspect, there is provided an authentication device comprising: authentication means for performing user authentication of a vehicle user; confirmation means for photographing an image of the user and tracking the user after the authentication by the authentication means is successful; and authentication control means for returning the authentication result by the authentication means to an unauthenticated state if the tracking fails.

[0007] According to a second aspect, there is provided a vehicle equipped with the above-described authentication device.

[0008] According to a third aspect, there is provided an authentication method that performs user authentication of a vehicle user, photographs an image of the user after the authentication by the authentication means is successful, and starts tracking, and if the tracking fails, returns the authentication result by the authentication means to an unauthenticated state.

[0009] According to a fourth aspect, there is provided a recording medium having recorded thereon a program that causes a computer to execute the following processes: a process of performing user authentication of a vehicle user; a process of photographing and tracking an image of the user after the authentication by the authentication means is successful; and a process of resetting the authentication result by the authentication means to an unauthenticated state if the tracking fails.

[0010] According to the present disclosure, it is possible to provide an authentication device, a vehicle, an authentication method, and a recording medium that can prevent substitution without impairing user convenience.

[0011] FIG. 1 is a diagram showing one configuration of the present disclosure; FIG. 2 is a flowchart showing the operation of the present disclosure; FIG. 3 is a diagram for explaining the operation of the present disclosure; FIG. 4 is a diagram for explaining the operation of the present disclosure; FIG. 5 is a diagram showing one configuration of a vehicle of the present disclosure; FIG. 6 is a diagram showing one configuration of an authentication device of the present disclosure; FIG. 7 is a flowchart showing the operation of the authentication device of the present disclosure; FIG. 8 is a diagram showing another configuration of a vehicle of the present disclosure; FIG. 9 is a flowchart showing the operation of another authentication device of the present disclosure; FIG. 10 is a diagram showing the configuration of a computer constituting the authentication device of the present disclosure.

[0012] First, an overview of one embodiment of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. The reference numerals in the drawings attached to this overview are attached to each element for convenience as an example to facilitate understanding, and are not intended to limit the present disclosure to the illustrated form. Furthermore, connecting lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of main signals (data) and do not exclude bidirectionality. A program is executed via a computer device, which includes, for example, a processor, a storage device, an input device, a communication interface, and, if necessary, a display device. Furthermore, this computer device is configured to be able to communicate with internal or external devices (including computers) via the communication interface, whether wired or wireless. Although ports or interfaces are present at the input / output connection points of each block in the drawings, they are not shown.

[0013] In one embodiment, the present disclosure can be realized by an authentication device 10 including authentication means 11, confirmation means 12, and authentication control means 13, as shown in Fig. 1. More specifically, the authentication means 11 performs user authentication of a vehicle user. After authentication by the authentication means 11 is successful, the confirmation means 12 takes an image of the user and tracks the user. If the tracking fails, the authentication control means 13 returns the authentication result by the authentication means 11 to an unauthenticated state.

[0014] The authentication device 10 configured as described above operates as follows. First, the authentication device 10 performs user authentication of the vehicle user (step S01 in FIG. 2). Next, after the authentication by the authentication means 11 is successful, the authentication device 10 takes an image of the user and starts tracking them (step S02 in FIG. 2). Thereafter, the authentication device 10 maintains the authentication success state (step S04 in FIG. 2) as long as it is successful in tracking the user (NO in step S02 in FIG. 2). On the other hand, if the user is lost (YES in step S03 in FIG. 2), the authentication device 10 performs processing to return the user to an unauthenticated state (step S05 in FIG. 2).

[0015] 3 is a diagram for explaining the operation of the present disclosure. For example, as shown in FIG. 3, if the user gets out of the vehicle after user authentication and is replaced by another person, the authentication device 10 fails to track the user. In this case, the authentication device 10 returns to an unauthenticated state. Therefore, the replaced person will have to perform user authentication again.

[0016] On the other hand, if the user moves to the back seat after user authentication as shown in Fig. 4, the authentication device 10 has successfully tracked the user. In this case, the authentication device 10 maintains the authentication success state. The user can continue to drive the vehicle.

[0017] In this way, according to the present disclosure, it is possible to prevent substitution behavior without impairing user convenience.

[0018] [First embodiment] Next, a first embodiment in which an authentication device according to the present disclosure is mounted on a vehicle will be described. Fig. 5 is a diagram showing one configuration of a vehicle according to the present disclosure. Referring to Fig. 5, a vehicle V equipped with an authentication device 100 and a camera C is shown.

[0019] For example, a camera installed inside the vehicle for monitoring the driver can be used as the camera C. More preferably, the camera C is a camera with a wide-angle lens. Alternatively, a so-called PTZ camera with pan-tilt-zoom functions can be used as the camera C.

[0020] 6 is a diagram showing one configuration of the authentication device 100. The authentication device 100 includes an authentication unit 101, a confirmation unit 102, and an authentication control unit 103. The authentication unit 101, the confirmation unit 102, and the authentication control unit 103 correspond to the authentication means 11, the confirmation means 12, and the authentication control means 13 described above.

[0021] The authentication unit 101 acquires biometric information of a user attempting to get into a vehicle and performs user authentication. The method of user authentication is not particularly limited. For example, face authentication, iris authentication, fingerprint authentication, voiceprint authentication, ear authentication, etc. can be used. When performing face authentication, iris authentication, ear authentication, etc., a camera C can also be used as a means for inputting biometric information. The authentication unit 101 may request user authentication from the user at a time other than when the user attempts to get into the vehicle. For example, the user may be requested to authenticate from the user when attempting to change the settings of the in-vehicle terminal or when attempting to open the hood. At this time, the user may be requested to input biometric information different from the biometric information of the user when attempting to get into the vehicle.

[0022] When the authentication unit 101 successfully authenticates the user, the confirmation unit 102 drives the camera C to track the user for a certain period of time. The confirmation unit 102 notifies the authentication control unit 103 of the result of tracking the user. The confirmation unit 102 may end tracking of the user after a certain period of time has elapsed or under certain conditions. For example, the confirmation unit 102 may end tracking when a predetermined time has elapsed after the engine has started. Alternatively, the confirmation unit 102 may end tracking when the user starts driving the vehicle V. This is because in either case, the possibility of user substitution is reduced.

[0023] The authentication control unit 103 changes the authentication status of the authentication unit 101 according to the tracking result. Specifically, while the tracking of the user is successful, the authentication control unit 103 maintains the authentication status of the user in an authentication success state. Even if the tracking of the user fails but the period during which the user was lost is within a predetermined time, the authentication control unit 103 maintains the authentication status of the user in an authentication success state. On the other hand, if the tracking of the user fails and the period during which the user was lost exceeds a predetermined time, the authentication control unit 103 changes the authentication status of the user to an unauthenticated state.

[0024] Next, the operation of this embodiment will be described in detail with reference to the drawings. Fig. 7 is a flow chart showing the operation of the present disclosure. Referring to Fig. 7, first, the authentication device 100 performs user authentication using biometric information (step S001). If the user authentication fails, the user remains in an unauthenticated state, and no further processing is performed.

[0025] If the user authentication is successful, the authentication device 100 starts tracking the user using the camera C (step S002). After that, as long as the user is successfully captured (YES in step S003), the authentication device 100 maintains the authentication success state (step S004). Therefore, the user can perform desired operations such as starting the vehicle engine and driving.

[0026] On the other hand, if the authentication device 100 fails to capture the user (NO in step S003), the authentication device 100 determines whether the user can be recaptured within a predetermined time (step S005). If the result of the determination is that the user can be recaptured within the predetermined time (YES in step S005), the authentication device 100 maintains the authentication success state (step S004).

[0027] If the result of the determination is that the user cannot be recaptured within a predetermined time (NO in step S005), the authentication device 100 performs processing to return the authentication status of the user by the authentication unit 101 to an unauthenticated state (step S006).

[0028] According to the present embodiment, which operates as described above, if a user moves seats or is out of the camera's field of view for a very short period of time after being authenticated, the user's authentication status can be maintained as authenticated. On the other hand, if a user is replaced by another person after being authenticated or disappears from the camera's field of view for a longer period of time than the "very short period of time," the authentication device 100 returns the user's authentication status to an unauthenticated state. Therefore, according to the present disclosure, it is possible to prevent substitution without impairing user convenience.

[0029] [Second Embodiment] Next, a second embodiment will be described in which a user is tracked using an external camera in addition to an internal camera. Fig. 8 is a diagram showing another configuration of a vehicle according to the present disclosure. The second embodiment differs from the first embodiment shown in Fig. 5 in that an external camera C2 is added to the internal camera C1 of the vehicle, and that the authentication device 100a tracks the user using both the internal camera C1 and the external camera C2. Other configurations are the same as those shown in Fig. 5, so the following description will focus on the differences.

[0030] The exterior camera C2 may be, for example, a surround view camera for capturing images of the surroundings of the vehicle, or a camera for a digital exterior mirror.

[0031] The authentication device 100a uses both the camera C1 inside the vehicle and the camera C2 outside the vehicle to track the user.

[0032] Next, the operation of this embodiment will be described in detail with reference to the drawings. FIG. 9 is a flow chart showing the operation of the present disclosure. Referring to FIG. 9, first, the authentication device 100a performs user authentication in response to a door unlock request from the user. At this time, the authentication unit 101 of the authentication device 100a performs face authentication using a camera C2 outside the vehicle (step S101). If the user authentication fails, the user remains in an unauthenticated state, and subsequent processing is not performed. Of course, the user cannot enter the vehicle.

[0033] If the user authentication is successful, the authentication device 100a starts tracking the user using both the camera C1 inside the vehicle and the camera C2 outside the vehicle (step S102). The subsequent operations are the same as those in the first embodiment. Finally, when the authentication unit 101 performs a process to return the authentication status of the user to an unauthenticated state (step S106), the authentication device 100a will perform user authentication again. In this case, facial authentication can be performed using the camera C1 inside the vehicle.

[0034] As described above, according to this embodiment, it is possible to prevent user substitution, which is highly likely to occur after a door unlocking request is made.

[0035] Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and further modifications, substitutions, and adjustments can be made without departing from the basic technical concept of the present disclosure. For example, the network configurations, element configurations, and data representation formats shown in the drawings are examples intended to aid in understanding the present disclosure, and are not limited to the configurations shown in these drawings.

[0036] (Hardware Configuration) In each embodiment of the present disclosure, each component of each device represents a functional unit block. Some or all of the components of each device are realized by an arbitrary combination of an information processing device 900 and a program, for example, as shown in FIG. 10 . FIG. 10 is a block diagram showing an example of the hardware configuration of the information processing device 900 that realizes each component of each device. The information processing device 900 includes, as an example, the following configuration: - CPU (Central Processing Unit) 901 - ROM (Read Only Memory) 902 - RAM (Random Access Memory) 903 - Program 904 loaded into RAM 903 - Storage device 905 that stores the program 904 - Drive device 907 that reads and writes to a recording medium 906 - Communication interface 908 that connects to a communication network 909 - Input / output interface 910 that inputs and outputs data - Bus 911 that connects each component

[0037] Each component of each device in each embodiment is realized by the CPU 901 acquiring and executing a program 904 that realizes the function. That is, the CPU 901 in FIG. 10 executes a user authentication program and a tracking program, and performs an update process for each calculation parameter stored in the RAM 903, the storage device 905, etc. The program 904 that realizes the function of each component of each device is stored in the storage device 905 or the ROM 902 in advance, for example, and is read by the CPU 901 as needed. The program 904 may be supplied to the CPU 901 via the communication network 909, or may be stored in advance on the recording medium 906, and the drive device 907 may read the program and supply it to the CPU 901.

[0038] There are various variations in the method of realizing each device. For example, each device may be realized by any combination of a separate information processing device 900 and a program for each component. Furthermore, multiple components provided in each device may be realized by any combination of a single information processing device 900 and a program. In other words, each unit (processing means, function) of the authentication device shown in the first and second embodiments can be realized by a computer program that causes a processor installed in the device to execute each of the above-mentioned processes using its hardware.

[0039] In addition, some or all of the components of each device may be realized by other general-purpose or dedicated circuits, processors, etc., or a combination of these. These may be configured by a single chip, or by multiple chips connected via a bus.

[0040] Some or all of the components of each device may be realized by a combination of the above-mentioned circuits and programs.

[0041] When some or all of the components of each device are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or decentralized. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in a form in which each device is connected via a communication network.

[0042] It should be noted that the above-described embodiments are preferred embodiments of the present disclosure, and the scope of the present disclosure is not limited to only the above-described embodiments. In other words, those skilled in the art can modify or substitute the above-described embodiments to construct various modified forms without departing from the gist of the present disclosure.

[0043] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0044] [Supplementary Note 1] An authentication device comprising: authentication means for authenticating a vehicle user; confirmation means for capturing an image of the user and tracking the user after the authentication means has been successful; and authentication control means for returning the authentication result of the authentication means to an unauthenticated state if the tracking fails. [Supplementary Note 2] The confirmation means of the authentication device may be configured to track the user using a camera inside the vehicle and a camera outside the vehicle in combination. [Supplementary Note 3] The confirmation means of the authentication device may be configured to track the user using a surround-view camera or a camera for a digital exterior mirror that can capture images of the vehicle's surroundings. [Supplementary Note 4] The authentication means of the authentication device may be configured to perform user authentication using a camera outside the vehicle, and the confirmation means may be configured to start tracking using a camera outside the vehicle and then continue tracking using a camera inside the vehicle. [Supplementary Note 5] The confirmation means of the authentication device may be configured to determine that tracking is successful if the user is lost for a predetermined period of time. [Supplementary Note 6] The confirmation means of the above authentication device may be configured to end tracking when a predetermined time has elapsed after engine start. [Supplementary Note 7] The confirmation means of the above authentication device may be configured to end tracking when the user starts driving the vehicle. [Supplementary Note 8] The confirmation means of the above authentication device may be configured to perform user authentication in response to a door unlocking request. [Supplementary Note 9] A vehicle equipped with the above authentication device. [Supplementary Note 10] An authentication method comprising: performing user authentication of a vehicle user; photographing an image of the user and starting tracking after authentication by the authentication means is successful; and resetting the authentication result by the authentication means to an unauthenticated state if tracking fails. [Supplementary Note 11] A recording medium having recorded thereon a program that causes a computer to execute the following processes: performing user authentication of a vehicle user; photographing an image of the user and tracking the user after authentication by the authentication means is successful; and resetting the authentication result by the authentication means to an unauthenticated state if tracking fails.The embodiments described in the above Supplements can be combined with each other after making necessary modifications. For example, a configuration that combines the contents of Supplementary Note 2 and the contents of Supplementary Note 5, uses both an in-vehicle camera and an outside-vehicle camera, and determines that tracking is successful if the user is lost for a predetermined period of time, is also included within the scope of the present disclosure. The embodiments of Supplements 10 to 11 can be expanded into the embodiments of Supplements 2 to 8, as with Supplementary Note 1.

[0045] The disclosures of the above-cited patent documents are incorporated herein by reference and may be used as the basis or part of this disclosure, as necessary. Modifications and adjustments of the embodiments and examples are possible within the scope of this disclosure (including the claims), and further based on its basic technical concept. Furthermore, various combinations and selections (including partial deletions) of various disclosed elements (including elements of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible within the scope of this disclosure. In other words, this disclosure naturally includes various modifications and alterations that would be possible by a person skilled in the art in accordance with the entire disclosure, including the claims, and the technical concept. In particular, with regard to the numerical ranges described herein, any numerical value or subrange within that range should be construed as specifically described, even if not otherwise specified. Furthermore, the disclosures of the above-cited documents, when used in part or in whole in combination with the disclosures herein as part of this disclosure, in accordance with the spirit of this disclosure, are also deemed to be included in the disclosures of this application.

[0046] REFERENCE SIGNS LIST 10 Authentication device 11 Authentication means 12 Confirmation means 13 Authentication control means 100, 100a Authentication device 101 Authentication unit 102 Confirmation unit 103 Authentication control unit 900 Information processing device 901 CPU (Central Processing Unit) 902 ROM (Read Only Memory) 903 RAM (Random Access Memory) 904 Program 905 Storage device 906 Recording medium 907 Drive device 908 Communication interface 909 Communication network 910 Input / output interface 911 Bus C, C1, C2 Camera V Vehicle

Claims

1. An authentication device comprising: authentication means for authenticating a vehicle user; confirmation means for photographing and tracking an image of the user after authentication by the authentication means is successful; and authentication control means for returning the authentication result by the authentication means to an unauthenticated state if tracking fails.

2. The authentication device according to claim 1, wherein the verification means tracks the user using a camera installed inside the vehicle and a camera installed outside the vehicle.

3. The authentication device according to claim 1 or 2, wherein the verification means tracks the user using a surround view camera or a camera for a digital outer mirror that can capture images of the surroundings of the vehicle.

4. The authentication device according to claim 3, wherein the authentication means performs user authentication using a camera outside the vehicle, and the confirmation means starts tracking using the camera outside the vehicle and then continues tracking using a camera inside the vehicle.

5. An authentication device according to any one of claims 1 to 4, wherein said confirmation means determines that tracking has been successful if the time during which the user has been lost sight of is within a predetermined time.

6. An authentication device according to any one of claims 1 to 5, wherein the confirmation means terminates tracking when a predetermined time has elapsed after the engine has started.

7. An authentication device according to any one of claims 1 to 6, wherein the confirmation means terminates tracking when the user starts driving the vehicle.

8. An authentication device according to any one of claims 1 to 7, wherein the confirmation means performs user authentication in response to a request to unlock the door.

9. A vehicle equipped with an authentication device according to any one of claims 1 to 8.

10. An authentication method comprising: performing user authentication of a vehicle user; capturing an image of the user and starting tracking after the authentication by the authentication means is successful; and resetting the authentication result by the authentication means to an unauthenticated state if the tracking fails.

11. A recording medium having recorded thereon a program that causes a computer to execute the following processes: a process of performing user authentication of a vehicle user; a process of photographing and tracking an image of the user after authentication by the authentication means is successful; and a process of resetting the authentication result by the authentication means to an unauthenticated state if tracking fails.

Images