Vehicle control device, vehicle control method, and storage medium

Abstract

The present application provides a vehicle control device, a vehicle control method, and a storage medium that suppress reduction in the charge of a storage battery. The vehicle control device includes: a photographing section; a detection section that detects a face of a person in the vicinity with a first precision using a photographing result of the photographing section operating with a first power consumption; a user determination section that, when the face is detected by the detection section, causes the photographing section to operate with a second power consumption higher than the first power consumption, and determines whether the face detected by the detection section is a face of a registered user with a second precision higher than the first precision using a photographing result of the photographing section operating with the second power consumption; a lock release section that releases a lock of a door in accordance with a determination result of the user determination section; and a setting section that, when it is determined by the user determination section that the face is not a face of a registered user, sets a detection area in which the face is detected by the detection section as a determination prohibited area in which determination based on the user determination section is not performed.

Description

Technical Field

[0001] This invention relates to vehicle control devices, vehicle control methods, and storage media. Background Technology

[0002] In the past, various keyless entry systems have been proposed for vehicle door locking. For example, keyless entry systems that photograph the iris of a person who touches the door handle and use the photographed iris information for authentication have been disclosed (for example, see Japanese Patent Application Publication No. 2003-138817). Summary of the Invention

[0003] However, in previous technologies, when a high-precision camera was frequently started, power consumption increased while the battery's capacity decreased.

[0004] The present invention was made in consideration of such circumstances, and one of its objectives is to provide a vehicle control device, a vehicle control method, and a storage medium capable of suppressing the reduction of the battery's charge.

[0005] In order to solve the above problems and achieve the above objectives, the present invention adopts the following solution.

[0006] (1): A vehicle control device according to one aspect of the present invention includes: a camera unit that captures images of the area surrounding the vehicle; a detection unit that uses the capture results of the camera unit operating with a first power consumption to detect the face of a person in the area with a first precision; a user determination unit that, when a face is detected by the detection unit, causes the camera unit to operate with a second power consumption higher than the first power consumption, and uses the capture results of the camera unit operating with the second power consumption to determine whether the face detected by the detection unit is the face of a pre-registered user with a second precision higher than the first precision; a lock release unit that releases the lock of the vehicle door based on the determination result of the user determination unit; and a setting unit that, when the user determination unit determines that the face is not the face of the registered user, sets the detection area of ​​the face detected by the detection unit as a determination prohibition area where the determination by the user determination unit is not performed.

[0007] (2): Based on the above (1) scheme, the user determination unit may perform multiple determinations of the registered user, and the setting unit may set the detection area as the determination prohibition area based on the multiple determination results of the user determination unit.

[0008] (3): Based on the above scheme (1) or (2), the prohibited area can also be the area where the detection of the face by the detection unit is prohibited.

[0009] (4): Based on the above scheme (1) or (2), the determination prohibition area is a region where the detection unit can perform facial detection, and the user determination unit does not make a determination of the registered user based on the face detected by the detection unit from the determination prohibition area.

[0010] (5): Based on the above scheme (1) or (2), the prohibited area can be a region where the detection unit can detect the face. The vehicle control device has a consistency determination unit. The consistency determination unit determines whether the face in the detection area is consistent with the face detected from the prohibited area. The user determination unit does not determine the registered user based on the face determined by the consistency determination unit as consistent.

[0011] (6): Based on the above scheme (4) or (5), the detection unit may detect the facial movement of the prohibited area, and the setting unit may release the setting of the prohibited area when the detection unit detects the facial movement.

[0012] (7): Based on the above (6) solution, it is also possible that after the setting unit removes the setting of the determination prohibition area, if the face of the registered user is determined to be not that of the registered user, the detection area is set as the determination prohibition area again.

[0013] (8): Based on any of the above (4) to (7), the setting unit may also release the setting of the determination prohibition area if the face is not detected from the determination prohibition area.

[0014] (9): Based on any of the above schemes (1) to (8), the user determination unit can determine the registered user in areas other than the determination prohibition area, and the lock release unit can release the lock if the registered user is determined to be the face of the registered user. The setting unit can release the setting of the determination prohibition area if the lock is released by the lock release unit.

[0015] (10): Based on any of the above schemes (1) to (9), the setting unit may set the detection area as the determination prohibition area when the vehicle is parked.

[0016] (11): A vehicle control method according to one aspect of the present invention causes a computer mounted on a vehicle equipped with a camera unit that captures images of the vehicle's surroundings to perform the following processing: using the capture results of the camera unit operating with a first power consumption, detecting the face of a person in the surroundings with a first precision; if a face is detected with the first precision, operating the camera unit with a second power consumption higher than the first power consumption, and using the capture results of the camera unit operating with the second power consumption, determining with a second precision higher than the first precision whether the detected face is the face of a pre-registered user; unlocking the vehicle door based on the determination result; if the determination determines that the face is not the face of the registered user, setting the detected detection area as a determination prohibition area where the determination is not performed.

[0017] (12): A storage medium of one aspect of the present invention stores a program for causing a computer mounted on a vehicle equipped with a camera unit that captures images of the vehicle's surroundings to perform the following processing: using the capture results of the camera unit operating with a first power consumption, detecting the face of a person in the surroundings with a first precision; if a face is detected with the first precision, operating the camera unit with a second power consumption higher than the first power consumption, and using the capture results of the camera unit operating with the second power consumption, determining with a second precision higher than the first precision whether the detected face is the face of a pre-registered user; unlocking the vehicle door based on the determination result; if the determination determines that the face is not the face of the registered user, setting the detected area as a determination prohibition area where the determination is not performed.

[0018] According to (1) to (12), the reduction of the battery's charge can be suppressed. Attached Figure Description

[0019] Figure 1 This is a diagram illustrating the structure of a vehicle M equipped with a vehicle control device according to an embodiment.

[0020] Figure 2 This is a block diagram illustrating an example of the functional structure of a vehicle control device 200.

[0021] Figure 3 This is an explanatory diagram showing a specific example of setting a detection prohibition area.

[0022] Figure 4 This is a flowchart illustrating an example of the high-power mode prohibition control process performed by the vehicle control device 200 of Embodiment 1.

[0023] Figure 5This is an explanatory diagram showing a specific example of setting authentication to ignore regions in Implementation Method 2.

[0024] Figure 6 This is a flowchart illustrating an example of the high-power mode prohibition control process performed by the vehicle control device 200 of Embodiment 2.

[0025] Figure 7 This is an explanatory diagram showing a specific example of setting a consistency determination area in Implementation Method 3.

[0026] Figure 8 This is a flowchart illustrating an example of the high-power mode prohibition control process performed by the vehicle control device 200 of Embodiment 3. Detailed Implementation

[0027] Hereinafter, embodiments 1 to 3 of the vehicle control device, vehicle control method, and storage medium of the present invention will be described with reference to the accompanying drawings. In embodiments 1 to 3, the following situation will be described: when the vehicle is parked, the vehicle door lock is released by using the image captured by a camera that captures images of the exterior of the vehicle to authenticate a face.

[0028] [Implementation Method 1]

[0029] First, implementation method 1 will be described. Figure 1 This diagram illustrates the structure of a vehicle M equipped with the vehicle control device according to the embodiment. A camera 100 (an example of a camera unit) is installed in the vehicle M to take pictures of the exterior. The camera 100 includes a left camera 100a, a right camera 100b, and a rear camera 100c, with reference to the forward direction of the vehicle. The left camera 100a is located on the upper part of the left center pillar of the vehicle M. The right camera 100b is located on the upper part of the right center pillar of the vehicle M. The rear camera 100c is located around the license plate at the rear of the vehicle M.

[0030] The illustration shows an SUV (Sport Utility Vehicle) type vehicle. However, for the rear camera 100c, if it is a sedan type vehicle, it is positioned around the rear emblem; if it is a minivan, it is positioned below the rear windshield. Camera 100 is a small camera, such as a CCD (charge-coupled device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera. Camera 100 operates using electricity stored in battery 220. The images captured by camera 100 can be, for example, moving images, but can also be still images. The number of cameras 100 can be more than three. The placement of camera 100 is not limited to the above-described placement; it can be placed in any position that allows for capturing images of the area around vehicle M.

[0031] Camera 100 can operate in either a high-power mode or a low-power mode. High-power mode is a mode for capturing images with high precision (high resolution) and consumes more power. Low-power mode is a mode for capturing images with low precision (low resolution) and consumes less power. In this embodiment, it is assumed that one camera 100 is used to capture both high-resolution and low-resolution images, but this is not a limitation; separate cameras may be used for high-resolution and low-resolution images.

[0032] Camera 100 captures images of the area surrounding vehicle M. Camera 100 consistently captures images from a position where a person's face can be observed. For example, camera 100 captures images of people approaching vehicle M from a height range of 0.5m to 2.5m. Camera 100 operates in low-power mode while the vehicle is parked. Parking, for example, occurs when the power to vehicle M is off and the doors are locked. That is, when the vehicle's power is on and the doors are not locked, camera 100 does not operate in low-power mode and the image capture function is disabled.

[0033] [Functional Structure of Vehicle Control Device 200]

[0034] Figure 2 This is a block diagram illustrating an example of the functional structure of a vehicle control device 200. The vehicle control device 200 is implemented, for example, by an ECU (Electronic Control Unit). The vehicle control device 200 includes an image input / output unit 211, a power supply unit 212, and a communication unit 213.

[0035] The image input / output unit 211 serves as the interface between the camera 100 and the vehicle control device 200. The image input / output unit 211 outputs the captured images from the camera 100 to the detection unit 201 and the user decision unit 202. When the user decision unit 202 inputs an instruction to switch the camera 100 from low power mode to high power mode, the image input / output unit 211 outputs this instruction to the target camera 100.

[0036] The power supply unit 212 uses electricity supplied from the battery 221 to drive the vehicle control unit 200 and the camera. The communication unit 213 is a communication interface for communicating with the control unit 222. The control unit 222 is, for example, a BCM (Body Control Module). The BCM comprehensively manages and controls the vehicle's onboard devices such as lighting devices, wiper devices, air conditioning system, and seat adjustment devices.

[0037] like Figure 2 As shown, the vehicle control device 200 includes a detection unit 201, a user determination unit 202, a lock release unit 203, and a setting unit 204. These components are implemented, for example, by executing programs (software) using a hardware processor such as a CPU (Central Processing Unit). Some or all of these components can be implemented using hardware (including the circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), and GPU (Graphics Processing Unit), or through the coordinated use of software and hardware. The program can be pre-stored in a storage device such as an HDD or flash memory of the vehicle control device 200 (not shown), or stored on a removable storage medium such as a DVD or CD-ROM, and installed in the HDD or flash memory of the vehicle control device 200 by mounting the storage medium to a drive unit.

[0038] The detection unit 201 uses the images captured by the camera 100, which operates with low power (an example of low power consumption), to detect the faces of people around the vehicle M at low resolution (an example of high precision). The detection unit 201 can detect the faces of people around the vehicle M at low resolution even when the vehicle is parked. The detection unit 201 analyzes the low-resolution images and extracts facial feature values ​​to authenticate the faces of people.

[0039] When a face is detected by the detection unit 201, the user determination unit 202 operates the camera 100 at high power (an example of second power consumption) and performs user determination (authentication) at high resolution (an example of second precision) to determine whether the face detected by the detection unit 201 belongs to a pre-registered user. The user determination unit 202 operates the camera 100, which is positioned in the direction in which the person approaches, in high power mode. Specifically, when the person approaches from the left, the user determination unit 202 operates the left camera 100a in high power mode.

[0040] Registered users include, for example, the owner of vehicle M, their family members, etc. The user determination unit 202 analyzes the high-resolution image, extracts facial features, matches them against features pre-registered in a database, and determines the person with the highest matching score. If the determined person is the owner of vehicle M, authentication is successful. An external device may have a database storing facial features. The storage unit of the vehicle control device 200 may also store the user's features for matching.

[0041] Hereinafter, user identification will sometimes be referred to as "authentication". Sometimes, identifying a face as belonging to the registered user in the user identification process will be termed "successful user authentication". Sometimes, identifying a face as not belonging to the user in the user identification process will be termed "failed user authentication".

[0042] The unlocking unit 203 unlocks the door locking unit 223 based on the user's determination. For example, if the user's authentication is successful, the unlocking unit 203 unlocks the door. On the other hand, if the user's authentication fails, the unlocking unit 203 keeps the door locked.

[0043] Here, camera 100 operates in low-power mode while the vehicle is parked. For example, suppose a poster depicting a person's face is affixed around the parked vehicle M. In this case, detection unit 201 detects the face on the poster at low resolution. Then, user determination unit 202 performs user determination on the face on the poster at high resolution. In this case, user authentication fails during user determination, and therefore the lock is not released.

[0044] However, after the user's authentication fails, the detection unit 201 re-detects the face in the promotional image, so the user determination unit 202 obtains a high-resolution image and performs user authentication again. That is, the process of face detection → camera operation in high-power mode → user authentication failure is repeated in an infinite loop. As a result, the camera 100 frequently operates in high-power mode, which leads to a decrease in the battery capacity of the battery 221 and potential battery depletion.

[0045] Therefore, in this embodiment, if the user's authentication fails, the setting unit 204 sets the detection area of ​​the face detected by the detection unit 201 as a determination prohibition area where user determination will not be performed for a specified period. The specified period is the period until the release condition described later is met.

[0046] Here is an example of why the user determination unit 202 does not perform user determination. For example, the determination prohibition area is the area where face detection by the detection unit 201 is prohibited (hereinafter referred to as the "detection prohibition area"). In other words, the detection unit 201 does not detect the face in the detection prohibition area, but detects the face in areas other than the detection prohibition area. Therefore, the detection unit 201 does not detect the face from the detection prohibition area, and thus the user determination unit 202 does not perform user determination on the face in the detection prohibition area (determination prohibition area).

[0047] In response, use Figure 3 Please provide an explanation. Figure 3 This is an explanatory diagram showing a specific example of setting a detection prohibition area. Figure 3 (A) shows the result of a photograph taken by camera 100 (e.g., left-side camera 100a) when vehicle M is parked near the advertisement. Figure 3 In (A), the detection unit 201 detects the faces 310 (310a, 310b) of the people in the promotional poster. When the detection unit 201 detects the face 310, the user determination unit 202 activates the left camera 100a in high-power mode to obtain a high-resolution image of the face 310 and performs user determination. Figure 3 The faces 310a and 310b shown in (A) are both different from the user's face. Therefore, the user determination unit 202 determines in the user determination that they are not the faces of the registered user.

[0048] When the user's face is determined not to be that of the registered user, such as Figure 3 As shown in (B), the detection unit 201 sets the position (detection area) of the face 310 of the person in the promotional image as the detection forbidden area 320. The detection forbidden area 320 is the area in the shooting area 300 where face detection by the detection unit 201 is prohibited. Since no face is detected from the detection forbidden area 320, no user determination is performed based on the user determination unit 202. That is, the user determination unit 202 does not obtain a high-resolution image for the detection forbidden area 320. In other words, since the user determination unit 202 does not obtain a high-resolution image for the detection forbidden area 320, the camera 100 is not operated in high-power mode.

[0049] The detection unit 201 performs facial detection on the other shooting areas 330 within the shooting area 300, excluding the detection prohibition area 320. Similarly, the user determination unit 202 performs user determination on the other shooting areas 330.

[0050] The setting unit 204 can set the detection area as a detection prohibition area if the user's authentication fails once. However, in this embodiment, the detection area is set as a detection prohibition area if the user's authentication fails multiple times. Specifically, the user determination unit 202 performs multiple user determinations. The setting unit 204 sets the detection area as the determination prohibition area based on the determination results of the multiple user determinations. For example, if the setting unit 204 determines that the face is not that of the registered user in the user determination three times in a row, the detection area is set as a detection prohibition area. The setting unit 204 can also set the detection area as a detection prohibition area based on the success rate of authentication in the multiple user determinations. In this way, by using the results of multiple user determinations, the reliability of user determination can be improved, thus suppressing the missetting of the detection prohibition area 320.

[0051] Next, the conditions for releasing the detection prohibition zone 320 will be explained. For example, the release of the door lock 223. This will be explained in detail. The user determination unit 202 performs user determination on other shooting areas 330 that are different from the detection prohibition zone 320. Specifically, when the detection unit 201 detects a face in another shooting area 330, the user determination unit 202 operates the camera 100 in high-power mode, obtains a high-resolution image of that face, and performs user determination.

[0052] When the user determines that the face detected from other shooting areas 330 is successfully authenticated, the lock release unit 203 releases the door lock of the door lock unit 223. The setting unit 204 then releases the setting of the detection prohibition area 320 after the lock release unit 203 has released the lock.

[0053] In this embodiment, we will take the case where there are posters around the vehicle M as an example for explanation. However, in addition to posters, if there are dolls or human figures around the vehicle M, the faces will also be detected at low resolution.

[0054] [High-power mode prohibition control processing performed by the vehicle control device 200 in Embodiment 1]

[0055] Figure 4 This is a flowchart illustrating an example of the high-power mode prohibition control process performed by the vehicle control device 200 of Embodiment 1. Figure 4In the process, the detection unit 201 determines whether the vehicle is parked (step S401). Parking is, for example, a state where the power to the vehicle M is cut off and the doors are locked. The detection unit 201 remains in standby mode until the vehicle is parked. When the vehicle is parked, the detection unit 201 causes the camera 100 to operate in low power mode (step S402).

[0056] Next, the detection unit 201 acquires a low-resolution image from the camera 100 (step S403). Then, the detection unit 201 uses the low-resolution image to begin detecting a person's face (step S404). Then, the detection unit 201 determines whether a person's face has been detected (step S405). The user determination unit 202 remains in standby mode until the detection unit 201 detects a person's face. When a person's face is detected, the camera 100 is activated in high-power mode (step S406). Furthermore, the user determination unit 202 acquires a high-resolution facial image from the camera 100 (step S407).

[0057] Then, the user determination unit 202 extracts a high-resolution facial image (feature data) and performs user facial determination (user authentication) (step S408). Next, the user determination unit 202 determines whether the user authentication is successful (step S409). When the user authentication fails, the setting unit 204 determines whether the user authentication has failed three times (step S410). If the user authentication has not failed three times, that is, if the user authentication has failed once or twice, the setting unit 204 returns to step S406. If the user authentication has failed three times, the setting unit 204 sets a detection prohibition region 320 (step S411) and returns to step S402.

[0058] When user authentication is successful in step S408, the lock release unit 203 releases the door lock unit 223 (step S412). Then, the setting unit 204 determines whether the detection of the prohibited area 320 is being set (step S413). If the detection of the prohibited area 320 is not being set, the setting unit 204 ends the series of processes. If the detection of the prohibited area 320 is being set, the setting unit 204 releases the setting of the detection of the prohibited area 320 (step S414) and ends the series of processes.

[0059] As explained above, in this embodiment, if the vehicle control device 200 determines that the face is not that of a registered user during user determination, it sets the detection area of ​​the face detected by the detection unit 201 as a determination prohibition area (detection prohibition area 320). Therefore, user authentication is not re-attempted after authentication failure. Thus, an infinite loop of the process of face detection → camera operation in high-power mode → user authentication failure is suppressed. This also suppresses frequent operation of the camera 100 in high-power mode. Consequently, the reduction of the battery 221's charge is suppressed, and battery depletion is prevented.

[0060] The vehicle control device 200 of this embodiment sets the detection area as a detection prohibition area 320 based on the determination results of multiple user decisions. As a result, the reliability of user decisions can be improved, and thus the erroneous setting of the detection prohibition area 320 can be suppressed.

[0061] In this embodiment, the prohibited area is defined as the prohibited detection area 320 where facial detection by the detection unit 201 is prohibited (see reference). Figure 3 Therefore, the face in the detection forbidden area 320 will not be detected by the detection unit 201, and the user determination unit 202 can be prevented from making a user determination. Therefore, it is possible to suppress the situation where the camera 100 operates in high power mode in order to obtain a high-resolution image of the detection forbidden area 320. Therefore, it is possible to suppress the reduction of the battery 221's charge.

[0062] In this embodiment, the vehicle control device 200 releases the setting of the detection prohibition zone 320 when the door lock is released. As a result, during the next parking, it is possible to prevent the detection prohibition zone 320 from being set, and to perform facial detection in the entire area of ​​the shooting area 300.

[0063] In this embodiment, the vehicle control device 200 sets the detection area to a detection prohibition area 320 when the vehicle is parked. This prevents the battery 221 from decreasing due to facial recognition while the vehicle is parked.

[0064] The vehicle control device 200 of this embodiment can also be linked with a mobile computer device such as a smartphone. For example, the vehicle control device 200 can also deactivate the detection prohibition zone 320 when it receives information from the mobile computer device that a user intends to approach. Thus, when the detection prohibition zone 320 is set, even if a user approaches from the direction of the detection prohibition zone 320, facial detection and user determination can be performed to unlock the vehicle doors.

[0065] In this embodiment, the vehicle control device 200 can also be reset on a daily basis. That is, the setting of the detection prohibition zone 320 can be released when a specific time and brightness condition occurs. However, if there is a face advertisement near the vehicle M, the detection prohibition zone 320 is set again.

[0066] [Implementation Method 2]

[0067] Next, Embodiment 2 will be described. In Embodiment 1 described above, the following situation was described: a detection prohibition region 320 (see reference 201) was set so that the detection unit 201 would not detect the face, which is a prohibition region where the user determination unit 202 does not perform user determination. Figure 3 In Embodiment 2, the following situation will be described: a determination prohibition area will be set as the user determination unit 202, where user determination is not performed, and an authentication ignore area will be set instead. In the following description, the same reference numerals will be used for content that is the same as that described in Embodiment 1, and descriptions will be omitted as appropriate.

[0068] Figure 5 This is an explanatory diagram showing a specific example of setting authentication to ignore regions in Implementation Method 2. Figure 5 (A) is with Figure 3 The same diagram as (A). In Figure 5 In (A), when the detection unit 201 authenticates the face 310, the user determination unit 202 determines in the user determination that it is not the face of the registered user.

[0069] When the user's face is determined not to be that of the registered user, such as Figure 5 As shown in (B), the setting unit 204 sets the position (detection area) of the face 310 of the person in the promotional poster as the authentication ignore area 500 (500a, 500b). The authentication ignore area 500 is an area where face detection can be performed by the detection unit 201. However, the authentication ignore area 500 is an area where user determination is not performed even if the detection unit 201 detects a face. That is, the user determination unit 202 will not obtain a high-resolution image for the authentication ignore area 500. In other words, since the user determination unit 202 will not obtain a high-resolution image for the authentication ignore area 500, the camera 100 will not operate in high-power mode.

[0070] The detection unit 201 performs facial detection on the other shooting areas 510 in the shooting area 300, excluding the authentication-ignored area 500. Similarly, the user determination unit 202 performs user determination on the other shooting areas 510.

[0071] Next, in Embodiment 2, the conditions for resolving the authentication ignore zone 500 (three conditions) will be explained. As the first condition, the user determination unit 202 will release the setting of the authentication ignore zone 500 when the lock is released by the lock release unit 203. As a result, the user determination unit 202 can perform user determination in the entire area of ​​the shooting area 300 during subsequent parking.

[0072] The second release condition will be explained. The detection unit 201 uses a low-resolution image to detect facial movements in the authentication ignore region 500. Here, facial movements are detected if the face is not in the promotional image. On the other hand, there is a possibility that facial movements are not detected if the face is in the promotional image. Therefore, the setting unit 204 releases the setting of the authentication ignore region 500 if facial movements are detected by the detection unit 201. As a result, the user determination unit 202 can perform a second authentication on the detection region that is the authentication ignore region 500. That is, the user determination unit 202 can operate the camera 100 in high-power mode and obtain a high-resolution facial image for that detection region.

[0073] There are instances where the user determination unit 202 fails to determine the face in the detection area after the authentication ignore zone 500 setting is deactivated. That is, there are cases where the user determination unit 202 operates the camera 100 in high-power mode and performs user determination, but determines that the face is not that of a registered user. For example, a face that is not that of a registered user refers to the face of a suspicious person targeting theft. In this case, the user determination unit 202 again sets the detection area as the authentication ignore zone 500, preventing the user determination unit 202 from performing user determination.

[0074] Next, the third condition for deactivation will be explained. "The face not being detected by the detection unit 201 in the authentication ignore area 500" means that the face disappears from the authentication ignore area 500, i.e., it is determined that the face in the authentication ignore area 500 is not the face of the promotional image. Therefore, if the setting unit 204 does not detect the face in the authentication ignore area 500 during the period the authentication ignore area 500 is set, the setting of the authentication ignore area 500 will be deactivated.

[0075] [High-power mode prohibition control processing performed by the vehicle control device 200 in Embodiment 2]

[0076] Figure 6 This is a flowchart illustrating an example of the high-power mode prohibition control process performed by the vehicle control device 200 of Embodiment 2. Figure 6In the process, the detection unit 201 determines whether the vehicle is in parking mode (step S601). The detection unit 201 remains in standby mode until it becomes in parking mode. When the vehicle is in parking mode, the detection unit 201 causes the camera 100 to operate in low power mode (step S602).

[0077] Next, the detection unit 201 acquires a low-resolution image from the camera 100 (step S603). Then, the detection unit 201 uses the low-resolution image to begin detecting the person's face (step S604). Then, the detection unit 201 determines whether the person's face has been detected (step S605). The setting unit 204 remains in standby mode until the detection unit 201 detects the person's face. When the person's face is detected, it determines whether the authentication ignore area 500 is set (step S606).

[0078] If the authentication ignore zone 500 is not set, the setting unit 204 proceeds to step S608. If the authentication ignore zone 500 is set, the detection unit 201 determines whether the face is detected from the authentication ignore zone 500 (step S607). If the face is not detected from the authentication ignore zone 500, the user determination unit 202 causes the camera 100 to operate in high-power mode (step S608). Then, the user determination unit 202 acquires a high-resolution facial image from the camera 100 (step S609).

[0079] Then, the user determination unit 202 extracts a high-resolution facial image (feature data) and performs user facial determination (user authentication) (step S610). Next, the user determination unit 202 determines whether the user's authentication is successful (step S611). When the user's authentication fails, the setting unit 204 determines whether the user's authentication has failed three times (step S612). If the user's authentication has not failed three times, that is, if the user's authentication has failed once or twice, the setting unit 204 returns to step S609. If the user's authentication has failed three times, the setting unit 204 sets the authentication ignore area 500 (step S613) and returns to step S602.

[0080] In step S605, if the detection unit 201 does not detect a person's face, the setting unit 204 determines whether the authentication ignore area 500 is set (step S614). If the authentication ignore area 500 is not set, the setting unit 204 returns to step S602. If the authentication ignore area 500 is set, i.e., the face disappears from the authentication ignore area 500, the setting unit 204 deactivates the authentication ignore area 500 setting (step S615) and returns to step S602.

[0081] In step S607, if a face is detected from the authentication ignore zone 500, the detection unit 201 uses a low-resolution image to determine whether facial movement is detected (step S616). If no facial movement is detected, the detection unit 201 returns to step S602. If facial movement is detected, the setting unit 204 deactivates the authentication ignore zone 500 setting (step S617) and proceeds to step S608. Although the vehicle control device 200 operates the camera 100 in high-power mode after deactivating the authentication ignore zone 500 setting, if authentication of a user in the deactivated zone fails, the authentication ignore zone 500 setting is re-established (steps S608 to S613).

[0082] When the user's authentication is successful in step S611, the lock release unit 203 releases the lock of the door lock unit 223 (step S618). Then, the setting unit 204 determines whether the authentication ignore zone 500 is being set (step S619). If the authentication ignore zone 500 is not being set, the setting unit 204 ends the series of processes. If the authentication ignore zone 500 is being set, the setting unit 204 releases the authentication ignore zone 500 setting (step S620) and ends the series of processes.

[0083] As explained above, in the case where the vehicle control device 200 of Embodiment 2 determines that the face is not that of a registered user, the detection area of ​​the face detected by the detection unit 201 is set as the authentication ignore area 500 (see [reference]). Figure 5 Therefore, even if a face in a promotional image is detected again in the authentication ignore area 500 after a user's authentication fails, the area can be ignored without user verification. This prevents the camera 100 from frequently operating in high-power mode to obtain a high-resolution image of the authentication ignore area 500. Consequently, it also prevents the battery 221 from losing its charge.

[0084] In Embodiment 2, the vehicle control device 200 deactivates the authentication ignore zone 500 when it detects facial movement within the authentication ignore zone 500. This allows the camera 100 to operate in high-power mode and acquire a high-resolution image of the area designated as the authentication ignore zone 500, even when facial movement is detected within it. Therefore, even for faces within the authentication ignore zone 500, the door locks can be deactivated through user determination.

[0085] In Embodiment 2, after deactivating the authentication ignore zone 500, if the user is determined not to be a user during user determination, the vehicle control device 200 reactivates the detection area as the authentication ignore zone 500. Therefore, user determination is not performed when a suspicious person approaches from the direction indicated by the authentication ignore zone 500. This also prevents the camera 100 from frequently operating in high-power mode to obtain a high-resolution image of the authentication ignore zone 500. Furthermore, it prevents the door locks from being released.

[0086] In Embodiment 2, the vehicle control device 200 deactivates the authentication ignore zone 500 if no face is detected within it. This allows the camera 100 to operate in high-power mode and obtain a high-resolution image even if the face in the authentication ignore zone 500 is not the face in the promotional image. Therefore, even for faces within the authentication ignore zone 500, the door locks can be deactivated through a second authentication.

[0087] [Implementation Method 3]

[0088] Next, implementation method 3 will be described. In implementation method 2 described above, the following situation was described: as a determination prohibition area where the user determination unit 202 does not perform user determination, an authentication ignore area 500 (see reference) was set. Figure 5 In Embodiment 3, the following situation will be described: the determination prohibition area where the user determination unit 202 does not perform user determination is set as the consistency determination area for performing consistency determination of low-resolution images.

[0089] Figure 7 This is an explanatory diagram showing a specific example of setting a consistency determination area in Implementation Method 3. Figure 7 (A) is with Figure 3 The same diagram as (A). In Figure 7 In (A), when the detection unit 201 authenticates the face 310, the user determination unit 202 determines in the user determination that the face is not that of the registered user.

[0090] When the user's face is determined not to be that of the registered user, such as Figure 7 As shown in (B), the user determination unit 202 sets the position (detection area) of the face 310 of the person in the promotional image as the consistency determination area 700 (700a, 700b). The consistency determination unit 720 (see reference) Figure 3When user authentication fails, the consistency determination unit 720 determines whether the low-resolution face in the detection area matches the low-resolution face detected by the detection unit 201 from the consistency determination area 700. The consistency determination unit 720 analyzes the low-resolution image and extracts facial feature values ​​to determine the consistency of the person's face. Alternatively, the consistency determination unit 720 can also determine consistency by extracting edge points from the low-resolution image and comparing the contours.

[0091] Here, in cases where the consistency determination is consistent, there is a possibility that the detected face is the same as the face in the promotional image. On the other hand, in cases where the consistency determination is inconsistent, the detected face may differ, therefore it is not the face in the promotional image. Thus, if the user determination unit 202 determines that the faces are the same in the consistency determination, it does not perform user determination in the consistency determination region 700. Therefore, the user determination unit 202 does not obtain a high-resolution image for the consistency determination region 700. That is, since the user determination unit 202 does not obtain a high-resolution image for the consistency determination region 700, it does not operate the camera 100 in high-power mode. On the other hand, if the user determination unit 202 determines that the faces are different in the consistency determination, it performs a second authentication of the consistency determination region 700.

[0092] The detection unit 201 performs facial detection on the other shooting areas 710 in the shooting area 300 besides the consistency determination area 700. Similarly, the user determination unit 202 performs user determination on the other shooting areas 710. In Embodiment 3, the release conditions (three conditions) for the consistency determination area 700 are the same as the release conditions for the authentication disregard area 500 in Embodiment 2.

[0093] [High-power mode prohibition control processing performed by the vehicle control device 200 in Embodiment 3]

[0094] Figure 8 This is a flowchart illustrating an example of the high-power mode prohibition control process performed by the vehicle control device 200 of Embodiment 3. Figure 8 In the process, the detection unit 201 determines whether the vehicle is in a parking state (step S801). The detection unit 201 remains in standby mode until it becomes in a parking state. When the vehicle is in a parking state, the detection unit 201 causes the camera 100 to operate in a low-power mode (step S802).

[0095] Next, the detection unit 201 acquires a low-resolution image from the camera 100 (step S803). Then, the detection unit 201 uses the low-resolution image to begin detecting the person's face (step S804). Then, the detection unit 201 determines whether the person's face has been detected (step S805). The setting unit 204 remains in standby mode until the detection unit 201 detects the person's face. When the person's face is detected, it determines whether it is within the set of the consistency determination region 700 (step S806).

[0096] If the face is not detected within the consistency determination region 700, the setting unit 204 proceeds to step S808. If the face is detected within the consistency determination region 700, the detection unit 201 determines whether the face is detected within the consistency determination region 700 (step S807). If the face is not detected within the consistency determination region 700, the user determination unit 202 activates the camera 100 in high-power mode (step S808). Furthermore, the user determination unit 202 acquires a high-resolution facial image from the camera 100 (step S809).

[0097] Then, the user determination unit 202 extracts a high-resolution facial image (feature data) and performs user facial determination (user authentication) (step S810). Next, the user determination unit 202 determines whether the user authentication is successful (step S811). When the user authentication fails, the setting unit 204 determines whether the user authentication has failed three times (step S812). If the user authentication has failed three times, that is, if the user authentication has failed once or twice, the setting unit 204 returns to step S809. If the user authentication has failed three times, the setting unit 204 sets a consistency determination region 700 (step S813) and returns to step S802.

[0098] In step S805, if the detection unit 201 does not detect a person's face, the setting unit 204 determines whether the setting is within the consistency determination region 700 (step S814). If the setting is not within the consistency determination region 700, the setting unit 204 returns to step S802. If the setting is within the consistency determination region 700, i.e., if no face is detected from the consistency determination region 700, the setting unit 204 deactivates the consistency determination region 700 setting (step S815) and returns to step S802.

[0099] In step S807, if a face is detected from the consistency determination area 700, the detection unit 201 determines whether facial movement is detected (step S816). If facial movement is detected, the detection unit 201 proceeds to step S819. If no facial movement is detected, the consistency determination unit 720 performs a consistency determination between the low-resolution face when the user's authentication failed and the low-resolution face detected from the consistency determination area 700 this time (step S817). Then, the consistency determination unit 720 determines whether they are consistent in the consistency determination (step S818).

[0100] If the consistency determination is consistent, the consistency determination unit 720 returns to step S802. If the consistency determination is inconsistent, the setting unit 204 removes the setting of the consistency determination area 700 (step S819) and proceeds to step S808. Although the vehicle control device 200 operates the camera 100 in high-power mode after removing the setting of the consistency determination area 700, it re-sets the consistency determination area 700 if the authentication of a user in the removed area fails (steps S808 to S813).

[0101] When user authentication is successful in step S811, the lock release unit 203 releases the door lock unit 223 (step S820). Then, the setting unit 204 determines whether the system is in the consistency determination region 700 setting (step S821). If the system is not in the consistency determination region 700 setting, the setting unit 204 ends the series of processes. If the system is in the consistency determination region 700 setting, the setting unit 204 releases the consistency determination region 700 setting (step S822) and ends the series of processes.

[0102] As explained above, in the case where the vehicle control device 200 of Embodiment 3 determines that the face is not that of a registered user, the detection area of ​​the face detected by the detection unit 201 is set as the consistency determination area 700 (see reference). Figure 7 Furthermore, if the match is consistent in the consistency determination area, no user determination is performed. Therefore, even if a face from the promotional image is detected again from the consistency determination area 700 after user authentication failure, if the detected face is the same as the face in the detection area, no user determination is performed. Thus, it is possible to suppress the situation where the camera 100 frequently operates in high-power mode to obtain a high-resolution image of the consistency determination area 700. Therefore, it is possible to suppress the depletion of the battery 221's charge.

[0103] The above describes specific embodiments of the present invention, but the present invention is not limited to such embodiments in any way, and various modifications and substitutions can be made without departing from the spirit of the present invention.

Claims

1. A vehicle control device, wherein the vehicle control device includes: a photographing section that photographs a periphery of a vehicle; a detection section that detects a face of a person in the periphery with a first accuracy using a photographing result of the photographing section that operates with a first consumed power; a user determination section that, in a case where a face is detected by the detection section, causes the photographing section to operate with a second consumed power higher than the first consumed power, and determines whether the face detected by the detection section is a face of a registered user that is registered in advance with a second accuracy higher than the first accuracy using a photographing result of the photographing section that operates with the second consumed power; a lock release section that releases a lock of a door in accordance with a determination result of the user determination section; and a setting section that, in a case where it is determined by the user determination section that the face is not the face of the registered user, sets a detection region in which a face is detected by the detection section as a determination prohibited region in which determination by the user determination section is not performed.

2. The vehicle control device according to claim 1, wherein the user determination section performs the determination of the registered user a plurality of times, the setting section sets the detection region as the determination prohibited region based on determination results of the user determination section a plurality of times.

3. The vehicle control device according to claim 1, wherein the determination prohibited region is a region in which detection of a face by the detection section is prohibited.

4. The vehicle control device according to claim 1, wherein the determination prohibited region is a region in which detection of a face by the detection section is possible, the user determination section does not perform determination of the registered user based on a face detected by the detection section from the determination prohibited region.

5. The vehicle control device according to claim 1, wherein the determination prohibited region is a region in which detection of a face by the detection section is possible, the vehicle control device includes a coincidence determination section that performs determination of whether a face in the detection region coincides with a face detected from the determination prohibited region, the user determination section does not perform determination of the registered user based on a face that is determined by the coincidence determination section to coincide.

6. The vehicle control device according to claim 4, wherein the detection section detects a face of the determination prohibited region, the setting section releases setting of the determination prohibited region in a case where detection of a face by the detection section is performed.

7. The vehicle control device according to claim 6, wherein the setting section, after releasing setting of the determination prohibited region, sets the detection region as the determination prohibited region again in a case where it is determined in determination of the registered user that the face is not the face of the registered user.

8. The vehicle control device according to claim 4, wherein the setting section releases setting of the determination prohibited region in a case where a face is not detected from the determination prohibited region.

9. The vehicle control device according to claim 1, wherein ​ The user determination unit can determine the registered user with respect to a region other than the determination prohibited region, The lock release unit releases the lock when the face of the registered user is determined in the determination of the registered user, The setting unit releases the setting of the determination prohibited region when the lock is released by the lock release unit.

10. The vehicle control device according to any one of claims 1 to 9, wherein The setting unit sets the detection region as the determination prohibited region at the time of parking of the vehicle.

11. A vehicle control method, wherein The vehicle control method causes a computer mounted on a vehicle that is provided with a photographing unit that photographs a periphery of the vehicle to perform the following processing: detects a face of a person in the periphery at a first accuracy using a photographing result of the photographing unit that operates at a first consumed power; in a case where a face is detected at the first accuracy, causes the photographing unit to operate at a second consumed power that is higher than the first consumed power, and determines whether the detected face is a face of a registered user that is registered in advance at a second accuracy that is higher than the first accuracy using a photographing result of the photographing unit that operates at the second consumed power; releases a lock of a door in accordance with a result of the determination; in a case where it is determined that the face is not the face of the registered user in the determination, sets a detection region in which a face is detected as a determination prohibited region in which the determination is not performed.

12. A storage medium, wherein The storage medium stores a program that causes a computer mounted on a vehicle that is provided with a photographing unit that photographs a periphery of the vehicle to perform the following processing: detects a face of a person in the periphery at a first accuracy using a photographing result of the photographing unit that operates at a first consumed power; in a case where a face is detected at the first accuracy, causes the photographing unit to operate at a second consumed power that is higher than the first consumed power, and determines whether the detected face is a face of a registered user that is registered in advance at a second accuracy that is higher than the first accuracy using a photographing result of the photographing unit that operates at the second consumed power; releases a lock of a door in accordance with a result of the determination; in a case where it is determined that the face is not the face of the registered user in the determination, sets a detection region in which a face is detected as a determination prohibited region in which the determination is not performed.

Images