Vehicle-mounted exposure control device and exposure control method

Abstract

An in-vehicle exposure control device 10 according to this disclosure includes an imaging unit 2 for obtaining a captured image of a passenger output from an imaging device 1, a face detection unit 3 for detecting face information of the passenger from the captured image obtained by the imaging unit, a face part detection unit 4 for detecting a face part from the face information detected by the face detection unit, a face-part detection accuracy detection unit 5 for detecting the detection accuracy of the face part detected by the face part detection unit, an exposure controlled face part determining unit 6 that determines a face part as an exposure controlled face part when the detection accuracy of the face part detected by the face-part detection accuracy detection unit is greater than or equal to a predetermined detection accuracy and outputs a determination result, a luminance detection unit 7 for detecting average luminance of the exposure controlled face part, and an exposure control unit 8 for controlling exposure such that the average luminance of the exposure controlled face part comes close to target luminance.

Description

[Technical field]

[0001] The present disclosure relates to an in-vehicle exposure control device and an exposure control method. [Background technology]

[0002] Conventionally, there is known an in-vehicle exposure control device that controls the exposure of an image captured of the driver's face when it is determined that the driver is wearing a mask (for example, Patent Document 1). When it is determined that the driver is wearing a mask because a predetermined region (i.e., the region where the mask exists) in the vertical direction below the horizontal edge extracted at the mask end has a predetermined luminance value or more, an exposure control unit that controls the exposure of the captured image of the in-vehicle exposure control device suppresses excessive exposure adjustment of the captured image due to the mask (for example, white). Therefore, it is possible to prevent inappropriate exposure of other parts (for example, eyes, etc.) and detect the driver's line of sight. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-118588 A Summary of the Invention [Problem to be solved by the invention]

[0004] Passengers, including the driver, who are in a vehicle may wear not only a mask but also various other accessories (e.g., sunglasses, etc.). In addition, the color of the mask is not limited to white, but may be various other colors. However, Patent Document 1 does not specifically disclose a method for appropriately controlling exposure even when accessories other than a mask or a mask other than white is worn.

[0005] The present disclosure has been made to solve the above-mentioned problems, and aims to provide an in-vehicle exposure control device and exposure control method that are capable of appropriately controlling exposure in response to various accessories worn by the occupants. [Means for solving the problem]

[0006] The in-vehicle exposure control device according to the present disclosure includes: The vehicle driver includes an imaging unit that acquires an image of an occupant output from an imaging device that captures an image of the occupant who is in a vehicle; a face detection unit that detects facial information of the occupant from the captured image acquired by the imaging unit; a luminance detection unit that detects a first luminance that is a luminance of the face or a part of the face of the occupant appearing in the captured image using the facial information detected by the face detection unit; and an exposure control unit that controls exposure so that the first luminance detected by the luminance detection unit becomes a target luminance, wherein the luminance detection unit detects a luminance of the face of the occupant as the first luminance when the face of the occupant is not covered by an accessory, and detects a luminance of an area excluding the part of the face covered by the accessory as the first luminance when a part of the face of the occupant is covered by an accessory, and further includes a mask detection unit that detects whether or not the occupant is wearing a mask that is the accessory, and when it is detected by the mask detection unit that the luminance detection unit is wearing a mask, the luminance detection unit detects a luminance of the area of ​​the face of the occupant excluding the part of the face covered by the mask as the first luminance. the mask type identification unit detects the luminance of the passenger's face as the first luminance when the mask detection unit detects that the passenger is not wearing a mask, detects the luminance of the passenger's face as the first luminance, and identifies a type of the mask when the mask detection unit detects that the passenger is wearing a mask; and a target luminance adjustment unit adjusts the target luminance in control of exposure by the exposure control unit, wherein the exposure control unit controls exposure so that the first luminance becomes a first target luminance among the target luminances when the mask detection unit detects that the passenger is not wearing a mask, and controls exposure so that the first luminance becomes a second target luminance among the target luminances that is different from the first target luminance when the mask detection unit detects that the passenger is wearing a mask, and the target luminance adjustment unit adjusts the second target luminance to a luminance greater than the first target luminance when the mask type identification unit identifies that the mask type is a white mask, and adjusts the second target luminance to a luminance smaller than the first target luminance when the mask type identification unit identifies that the mask type is a black mask. .

[0007] In addition, the exposure control method according to the present disclosure includes: The method includes the steps of: acquiring, by an imaging unit, an image of an occupant output from an imaging device that captures an image of an occupant riding in a vehicle; detecting, by a face detection unit, facial information of the occupant from the image acquired by the imaging unit; detecting, by a brightness detection unit, a first luminance which is a luminance of a face or a part of a face of the occupant appearing in the image, using the facial information detected by the face detection unit; and controlling exposure by an exposure control unit so that the first luminance detected by the brightness detection unit becomes a target luminance. When the face of the occupant is not covered by an accessory, the brightness detection unit detects a luminance of the face of the occupant as the first luminance, and when a part of the face of the occupant is covered by an accessory, detects a luminance of an area excluding the part of the face that is covered by the accessory as the first luminance. The method further includes the steps of detecting, by a mask detection unit, whether or not the occupant is wearing a mask which is the accessory, using the facial information detected by the face detection unit. When the mask detection unit detects that the occupant is wearing a mask, The present invention further includes a step of detecting, as the first luminance, a luminance of an area of ​​the face of the occupant excluding a part of the face that is covered by a mask, and, when the mask detection unit detects that the occupant is not wearing a mask, detecting the luminance of the face of the occupant as the first luminance, and, when the mask detection unit detects that the occupant is wearing a mask, identifying the type of the mask by the mask type identification unit; and a step of adjusting the target luminance in the control of exposure by the exposure control unit by a target luminance adjustment unit, wherein, when the mask detection unit detects that the occupant is not wearing a mask, the exposure control unit controls the exposure such that the first luminance becomes a first target luminance among the target luminances, and when the mask detection unit detects that the occupant is wearing a mask, the exposure control unit controls the exposure such that the first luminance becomes a second target luminance among the target luminances that is different from the first target luminance, and, when the mask type identification unit identifies the type of the mask as a white mask, the target luminance adjustment unit adjusts the second target luminance to a luminance greater than the first target luminance, and, when the mask type identification unit detects that the type of the mask is a white mask,When the type of the mask is identified as a black mask, the second target luminance is adjusted to a luminance smaller than the first target luminance. . Effect of the Invention

[0008] The in-vehicle exposure control device and exposure control method disclosed herein use facial information of the occupant to determine whether or not a mask is being worn, and control the exposure so as to bring the average brightness detected from the determination result closer to a predetermined target brightness, thereby achieving the effect of appropriately controlling exposure even when the occupant is wearing an accessory that covers parts of their face. [Brief description of the drawings]

[0009] [Figure 1] 1 is a schematic diagram of a DMS 100 to which an on-vehicle exposure control device 10 according to a first embodiment is applied. [Diagram 2] 3 is a flowchart of an exposure control method according to the first embodiment. [Diagram 3] 13A to 13C are diagrams showing examples of face parts that are subject to exposure control in step S104. [Figure 4] 13A to 13C are diagrams showing examples of face parts that are subject to exposure control in step S104. [Diagram 5] 13A to 13C are diagrams showing examples of face parts that are subject to exposure control in step S104. [Figure 6] 13A to 13C are diagrams showing examples of face parts that are subject to exposure control in step S104. [Figure 7] 11 is a schematic diagram of a DMS 200 to which an on-vehicle exposure control device 20 according to a second embodiment is applied. [Figure 8]11 is a flowchart of an exposure control method according to the second embodiment. [Figure 9] FIG. 13 is a diagram showing the ranges of each area detected in steps S203 and S204. [Figure 10] 11 is a schematic diagram of a DMS 300 to which an on-vehicle exposure control device 30 according to a third embodiment is applied. [Figure 11] 13 is a flowchart of an exposure control method according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Embodiment 1 An on-vehicle exposure control device 10 and an exposure control method according to the first embodiment will be described with reference to Figs. 1 to 6. Fig. 1 is a schematic diagram of a DMS (Driver Monitoring System) 100 to which the on-vehicle exposure control device 10 according to the first embodiment is applied. The DMS 100 is mounted on a vehicle and performs various monitoring processes on passengers, including the driver, who are in the vehicle. The monitoring processes performed by the DMS 100 on passengers include, for example, determining the state of the passenger and authenticating the passenger. The DMS 100 includes an image capturing device 1 and an on-vehicle exposure control device 10 that is connected to the image capturing device 1 via a network.

[0011] The imaging device 1 is a camera that captures an image of a passenger and outputs the captured image to an in-vehicle exposure control device 10.

[0012] The in-vehicle exposure control device 10 controls the exposure of a captured image output from the imaging device 1. The in-vehicle exposure control device 10 includes an imaging unit 2, a face detection unit 3, a facial part detection unit 4, a facial part detection accuracy detection unit 5, an exposure control target facial part determination unit 6, a brightness detection unit 7, and an exposure control unit 8.

[0013] The imaging unit 2 acquires a captured image output from the imaging device 1. Then, the imaging unit 2 outputs the captured image to the face detection unit 3.

[0014] The face detection unit 3 detects facial information of the passenger using the captured image output from the imaging unit 2. Then, the face detection unit 3 outputs the detection result of the facial information to the facial parts detection unit 4.

[0015] The facial part detection unit 4 detects facial parts (e.g., eyes, nose, mouth, etc.) that are characteristic points of face information required for monitoring processing, using the detection result output from the face detection unit 3. Then, the facial part detection unit 4 outputs the detection result of the detected facial parts to the facial part detection accuracy detection unit 5.

[0016] The facial part detection accuracy detection unit 5 detects the detection accuracy indicating the accuracy of the facial part detection result by using the detection result output from the facial part detection unit 4. Then, the facial part detection accuracy detection unit 5 outputs the detection result of the detection accuracy to the exposure control target facial part determination unit 6.

[0017] The exposure control target face part determination unit 6 uses the detection result output from the face part detection accuracy detection unit 5 to determine whether the detection accuracy reaches a predetermined first detection accuracy, and selects the face part that reaches the first detection accuracy as the exposure control target face part for which exposure is to be controlled. Then, the exposure control target face part determination unit 6 outputs the result to the brightness detection unit 7. Here, the first detection accuracy refers to a detection accuracy that does not reach the second detection accuracy required for the monitoring process, but is capable of causing the detection accuracy of facial parts to reach the second detection accuracy by controlling the exposure.

[0018] The luminance detection unit 7 detects the average luminance of the exposure control target face part using the result output from the exposure control target face part determination unit 6. Then, the luminance detection unit 7 outputs the detection result of the average luminance to the exposure control unit 8.

[0019] The exposure control unit 8 uses the detection result from the brightness detection unit 7 to control the exposure so that the average brightness approaches a predetermined target brightness. Here, the target brightness is predetermined as a brightness at which facial parts can be detected with high detection accuracy, and is set to a brightness at which the detection accuracy of the facial parts is equal to or higher than the second detection accuracy required for the monitoring process.

[0020] Next, an exposure control method using the on-vehicle exposure control device 10 of the first embodiment will be described. Fig. 2 is a flowchart of the exposure control method of the first embodiment. The exposure control method of the first embodiment includes a step of acquiring a captured image of a passenger in a vehicle output from an imaging device 1 that captures a passenger wearing an accessory, a step S101 of detecting face information of the passenger from the captured image, a step S102 of detecting face parts from the face information, a step S103 of detecting detection accuracy of the face parts, a step S104 of determining face parts whose detection accuracy is equal to or higher than a predetermined detection accuracy as face parts to be subjected to exposure control, a step S105 of detecting an average luminance of the face parts to be subjected to exposure control, and a step S106 of controlling exposure so that the average luminance approaches a target luminance.

[0021] In step S101 of detecting facial information of the passenger from the captured image, facial information of the passenger is detected using the captured image output in a step of outputting the captured image of the passenger output from an imaging device that photographs the passenger riding in the vehicle.

[0022] In step S102 of detecting facial parts from the facial information, facial parts are detected using the facial information of the passenger detected in step S101.

[0023] In step S103 of detecting the detection accuracy of the facial parts, the facial parts detected in step S102 are used to detect the detection accuracy indicating the accuracy of the detection result of the facial parts. Here, the detection accuracy is detected, for example, by calculating based on the rate at which the position of the facial feature coincides with the positions of facial features stored in advance.

[0024] In step S104, in which a face part whose detection accuracy is equal to or higher than a predetermined detection accuracy is determined to be a face part subject to exposure control, the detection accuracy of the face part detected in step S103 is used to determine whether the detection accuracy has reached a predetermined first detection accuracy, and the face part that has reached the first detection accuracy is selected as the face part subject to exposure control for which exposure is to be controlled.

[0025] 3 to 6 are diagrams showing examples of face parts subject to exposure control in step S104. Face parts that have achieved the first detection accuracy (face part A subject to exposure control) are shown surrounded by a rectangular frame, and face parts that have not achieved the first detection accuracy (missing part B) are shown surrounded by a solid rectangular frame. FIG. 3 shows a case where the passenger's right eye is covered by an eyepatch or the like. In this case, the uncovered left eye and mouth are determined to be the exposure control target face part A, and the covered right eye is determined to be the missing part B. FIG. 4 shows a case where the passenger's eyes are covered by sunglasses or the like with low transmittance. In this case, the uncovered mouth is determined to be the exposure control target face part A, and since the transmittance of the sunglasses covering both eyes is low, it is not possible to detect the eyes through the sunglasses, so the eyes are determined to be the missing part B. FIG. 5 shows a case where the passenger's eyes are covered by sunglasses or the like with high transmittance, and the mouth is covered by a mask or the like. In this case, since the transmittance of the sunglasses covering both eyes is high, it is possible to detect the eyes through the sunglasses, so if the detection accuracy of the detected eyes reaches the first detection accuracy, it is determined to be the exposure control target part A, and the covered mouth is determined to be the missing part B. FIG. 6 shows a case where the passenger's right eye is covered by an eyepatch or the like, and the mouth is covered by a mask or the like. In this case, the unobstructed left eye is determined as facial part A subject to exposure control, and the occluded right eye and mouth are determined as missing parts B.

[0026] In step S105 of detecting the average luminance of the face parts subject to exposure control, the average luminance of the face parts subject to exposure control determined in step S104 is detected.

[0027] In step S106, in which the exposure is controlled so that the average luminance reaches the target luminance, if the average luminance of the face part subject to exposure control detected in step S105 does not reach the predetermined target luminance, the exposure is controlled by adjusting the exposure time and gain so that the average luminance approaches the target luminance.

[0028] That is, in the exposure control method of the first embodiment, when a face part necessary for the monitoring process of a passenger is covered by an accessory, it is determined whether the detection accuracy of the face part reaches a first detection accuracy, which is a detection accuracy that can reach a second detection accuracy necessary for the monitoring process by controlling the exposure, and the face part that reaches the first detection accuracy is set as a face part to be subjected to exposure control, and the average brightness of the face part to be subjected to exposure control is detected, and the exposure is controlled so that the average brightness approaches the target brightness. As a result, even if the passenger wears various accessories including a mask, the exposure can be appropriately controlled, and the monitoring process can be made smooth and the accuracy can be improved. As a specific example, even if the passenger wears a mask and sunglasses at the same time, the exposure can be appropriately controlled.

[0029] As described above, the vehicle-mounted exposure control device 10 and exposure control method of embodiment 1 detect facial parts using facial information of the occupant and control exposure so that the average brightness of the facial parts that reach a predetermined detection accuracy approaches the target brightness, thereby achieving the effect of being able to appropriately control exposure even when facial parts are obscured by the occupant wearing an accessory.

[0030] Embodiment 2 The vehicle-mounted exposure control device 20 and the exposure control method according to the second embodiment will be described with reference to Fig. 7 to Fig. 9. Fig. 7 is a schematic diagram of a DMS 200 to which the vehicle-mounted exposure control device 20 according to the second embodiment is applied. As shown in Fig. 7, the embodiment differs from the first embodiment in that a mask detection unit 24 is provided, but the other configurations except for the face part detection unit 4, the face part detection accuracy detection unit 5, and the exposure control target face part determination unit 6 are the same as those of the first embodiment.

[0031] The mask detection unit 24 compares the face information output from the face detection unit 23 with pre-stored face information to detect whether or not a mask is being worn. Then, the mask detection unit 24 outputs the detection result to the brightness detection unit 25.

[0032] When the detection result output from the mask detection unit 24 indicates that a mask is being worn, the luminance detection unit 25 detects the average luminance of an area E of the face area C excluding the mask area D, and when the detection result indicates that a mask is not being worn, the luminance detection unit 25 detects the average luminance of the face area C. Then, the luminance detection unit 25 outputs the detection result of the average luminance to the exposure control unit 26.

[0033] The exposure control unit 26 uses the detection result output from the brightness detection unit 25 to control the exposure so that the average brightness approaches the target brightness.

[0034] Next, an exposure control method using the on-vehicle exposure control device 20 according to the second embodiment will be described. Fig. 8 is a flowchart of the exposure control method according to the second embodiment. The exposure control method according to the second embodiment includes a step of acquiring a captured image of a passenger output from an imaging device that captures a passenger who is in a vehicle when the passenger is wearing an accessory, a step S201 of detecting face information of the passenger from the captured image, a step S202 of detecting whether the passenger is wearing a mask from the face information, a step S203 of detecting an average luminance of a face area included in the face information excluding a mask area blocked by the mask when it is detected that the mask is worn, and a step S204 of detecting an average luminance of the face area C when it is detected that the mask is not worn, and a step S205 of controlling exposure so that the average luminance approaches a target luminance.

[0035] In step S201 of detecting facial information of the passenger from the captured image, facial information of the passenger is detected using the captured image output in a step of outputting the captured image of the passenger output from an imaging device that photographs the passenger riding in the vehicle.

[0036] In step S202, which detects whether the passenger is wearing a mask from the facial information, the facial information detected in step S201 is compared with pre-stored facial information to detect whether the passenger is wearing a mask. Here, the pre-stored face information refers to, for example, face information when the passenger is not wearing a mask, or face information when the passenger is wearing a mask. The masks worn by the passengers pre-stored in the face information have various colors, such as white masks including relatively light colors such as yellow and light blue, black masks including relatively dark colors such as navy blue and brown, etc., in addition to white masks.

[0037] If it is detected in step S202 that a mask is being worn, the process proceeds to step S203, in which the average luminance of an area excluding a mask area that is covered by the mask is detected from the face area included in the face information. In step S203, the average luminance of an area E excluding a mask area D from the face area C is detected.

[0038] If it is detected in step S202 that no mask is being worn, the process proceeds to step S204, in which the average luminance of the face area C is detected. In step S204, the average luminance of the face area C is detected.

[0039] 9 is a diagram showing the range of each area detected in steps S203 and S204. Face area C is the area of ​​the passenger's facial information, and is the area indicated by the dotted frame. Next, mask area D is the area of ​​face area C that is covered by a mask, and is the area indicated by the diagonal lines within the solid frame. Finally, area E is the area of ​​face area C excluding mask area D, and is the area indicated by the solid frame.

[0040] In step S205, in which the exposure is controlled so that the average luminance approaches the target luminance, if the average luminance detected in steps S203 and S204 has not reached the target luminance, the exposure is controlled by adjusting the exposure time and gain so that the average luminance approaches the target luminance.

[0041] That is, in the exposure control method of the second embodiment, when the facial parts required for the monitoring process of the passenger are covered by a mask, the detected facial information of the passenger is compared with pre-stored facial information to detect whether the mask is worn, and the area for detecting the average brightness is changed depending on whether the mask is worn, and the exposure is controlled so that the average brightness of the area approaches the target brightness. This makes it possible to appropriately control the exposure even when the passenger is wearing a mask, making the monitoring process smoother and more accurate.

[0042] As described above, the vehicle-mounted exposure control device 20 and exposure control method of embodiment 2 detect whether or not a mask is being worn using facial information of the occupant, change the area for detecting the average brightness depending on whether or not a mask is being worn, and control the exposure so that the average brightness of that area approaches the target brightness. Therefore, it has the effect of being able to appropriately control the exposure even when facial parts are obscured by the occupant wearing a mask.

[0043] In addition, when detecting whether or not a passenger is wearing a mask, the facial information detected in step S201 is compared with pre-stored facial information, so that it is possible to accurately detect whether or not the passenger is wearing a mask.

[0044] Embodiment 3 The on-vehicle exposure control device 30 and the exposure control method according to the third embodiment will be described with reference to Fig. 10 and Fig. 11. Fig. 10 is a schematic diagram of a DMS 300 to which the on-vehicle exposure control device 30 according to the third embodiment is applied. As shown in Fig. 10, this embodiment differs from the second embodiment in that a mask type identification unit 35 and a target brightness adjustment unit 36 ​​are provided, but the other configurations are the same as those of the second embodiment.

[0045] The mask detection unit 34 compares the face information output from the face detection unit 33 with pre-stored face information to detect whether a mask is being worn. Then, the mask detection unit 34 outputs the detection result to the brightness detection unit 37. Furthermore, when the mask detection unit 34 detects that a mask is being worn, it outputs the detection result to the mask type identification unit 35.

[0046] The mask type identification unit 35 identifies the type of the mask using the detection result of whether or not a mask is worn that is output from the mask detection unit 34. Then, the mask type identification unit 35 outputs the identification result to the target brightness adjustment unit 36.

[0047] The target brightness adjustment unit 36 ​​adjusts the target brightness according to the identified mask, using the identification result output from the mask type identification unit 35. Then, the target brightness adjustment unit 36 ​​outputs the adjusted target brightness to the exposure control unit 38.

[0048] The exposure control unit 38 controls the exposure so that the average luminance approaches the target luminance, using the detection result output from the luminance detection unit 37. However, when the target luminance has been adjusted by the target luminance adjustment unit 36, the exposure control unit 38 controls the exposure so that the average luminance approaches the adjusted target luminance output from the target luminance adjustment unit 36.

[0049] Next, an exposure control method using the on-vehicle exposure control device 30 of the third embodiment will be described. Fig. 11 is a flowchart of the third embodiment. The exposure control method of the third embodiment includes a step of acquiring an image of a passenger output from an imaging device that captures a passenger who is in a vehicle when the passenger is wearing an accessory, a step S301 of detecting face information of the passenger from the captured image, a step S302 of detecting whether the passenger is wearing a mask from the face information, a step S303 of detecting an average luminance of a face area included in the face information when it is detected that the mask is not worn, a step S307 of controlling exposure so that the average luminance approaches a target luminance, a step S304 of identifying the type of the mask when it is detected that the mask is worn, and a step S306 of adjusting the target luminance higher than when the mask is not worn (step S305) when the type of the mask is identified as a white mask, and adjusting the target luminance lower than when the mask is not worn when the mask is identified as a black mask.

[0050] If it is detected that a mask is being worn, the type of mask is identified in step S304. Here, the method of identifying the type of mask is, for example, a method of detecting the color of the mask from the reflectance of the mask. Masks with a reflectance equal to or greater than a certain value can be classified as white masks, and masks with a reflectance equal to or less than a certain value can be classified as black masks. White masks include relatively light colors such as yellow and light blue in addition to white. Black masks include relatively dark colors such as navy blue and brown in addition to black. The type of mask may also be identified based on a comparison between the detected mask information and information on multiple types of masks stored in advance.

[0051] If the type of mask is identified as a white mask, the process proceeds to step S305, where the target luminance is adjusted to be higher than when no mask is worn. If a white mask is worn, the white mask is detected as having a higher luminance than other face areas, so in step S305, the target luminance is adjusted to be higher than when no mask is worn.

[0052] If the type of mask is identified as a black mask, the process proceeds to step S306, where the target luminance is adjusted to be lower than when no mask is worn. If a black mask is worn, the black mask is detected as being lower than other facial areas, so in step S306, the target luminance is adjusted to be lower than when no mask is worn.

[0053] In step S307, where exposure is controlled so that the average luminance approaches the target luminance, if the average luminance detected in step S303 does not reach the target luminance, exposure is controlled by adjusting the exposure time and gain so that the average luminance approaches the target luminance. However, if the target luminance has been adjusted in step S305 or step S306, exposure is controlled so that the average luminance approaches the target luminance adjusted in steps S305 and S306.

[0054] That is, in the exposure control method of the third embodiment, the type of mask worn by the passenger is identified, the target brightness is adjusted according to the type, and the exposure is controlled based on the target brightness. Therefore, the exposure can be appropriately controlled regardless of the type of mask, and the monitoring process can be made smooth and accurate.

[0055] As described above, in addition to the effects of embodiment 2, the in-vehicle exposure control device and exposure control method of embodiment 3 identify the type of mask detected, adjust the target brightness according to the identified type, and control the exposure based on the target brightness, thereby not only being able to accurately determine whether the occupant is wearing a mask, but also being able to appropriately control the exposure according to the type of mask, thereby achieving the effect of appropriately controlling the exposure even when the occupant is wearing an accessory and covering parts of their face. [Explanation of symbols]

[0056] 1, 21, 31 Imaging device 2, 22, 32 Imaging unit 3, 23, 33 Face detection section 4. Face part detection section 5. Facial feature detection accuracy detection section 6 Exposure control target face part determination section 7, 25 Luminance detection section 8, 26 Exposure control unit 10, 20, 30: Vehicle-mounted exposure control device 14, 34 Mask detection unit 35 Mask type identification section 36 Target brightness adjustment section 100, 200, 300 DMS A Exposure control target parts B. Missing parts C face area D Mask Area E area

Claims

1. an imaging unit that acquires an image of a passenger from an imaging device that captures an image of the passenger who is riding in the vehicle; a face detection unit that detects face information of the passenger from the captured image acquired by the imaging unit; a luminance detection unit that detects a first luminance, which is a luminance of a face or a part of a face of the passenger appearing in the captured image, by using the face information detected by the face detection unit; an exposure control unit that controls exposure so that the first luminance detected by the luminance detection unit becomes a target luminance, the luminance detection unit detects, when the face of the occupant is not covered by an accessory, a luminance of the face of the occupant as the first luminance, and, when a part of the face of the occupant is covered by an accessory, detects, as the first luminance, a luminance of an area excluding the part of the face covered by the accessory; a mask detection unit that detects whether the passenger is wearing a mask as the accessory by using the face information detected by the face detection unit, When the mask detection unit detects that the occupant is wearing a mask, the luminance detection unit detects, as the first luminance, a luminance of an area of ​​the occupant's face excluding a part of the face that is covered by the mask, and when the mask detection unit detects that the occupant is not wearing a mask, the luminance detection unit detects, as the first luminance, a luminance of the occupant's face; a mask type identification unit that identifies a type of the mask when the mask detection unit detects that the passenger is wearing a mask; and a target brightness adjustment unit that adjusts the target brightness in the control of exposure by the exposure control unit, the exposure control unit controls exposure so that the first luminance becomes a first target luminance among the target luminances when the mask detection unit detects that the occupant is not wearing a mask, and controls exposure so that the first luminance becomes a second target luminance among the target luminances, the second target luminance being different from the first target luminance, when the mask detection unit detects that the occupant is wearing a mask; the target luminance adjustment unit adjusts the second target luminance to a luminance greater than the first target luminance when the mask type identification unit identifies the type of the mask as a white mask; When the mask type identification unit identifies the type of the mask as a black mask, the second target luminance is adjusted to a luminance smaller than the first target luminance.

1. An on-vehicle exposure control device comprising:

2. an imaging unit that acquires an image of a passenger from an imaging device that captures an image of the passenger who is riding in the vehicle; a face detection unit that detects face information of the passenger from the captured image acquired by the imaging unit; a luminance detection unit that detects a first luminance, which is a luminance of a face or a part of a face of the passenger appearing in the captured image, by using the face information detected by the face detection unit; an exposure control unit that controls exposure so that the first luminance detected by the luminance detection unit becomes a target luminance, the luminance detection unit detects, when the face of the occupant is not covered by an accessory, a luminance of the face of the occupant as the first luminance, and, when a part of the face of the occupant is covered by an accessory, detects, as the first luminance, a luminance of an area excluding the part of the face covered by the accessory; a face part detection unit that detects face parts from the face information detected by the face detection unit; a facial feature detection accuracy detection unit that detects the detection accuracy of the facial features detected by the facial feature detection unit; an exposure-control-target face part determination unit that determines a face part detected by the face part detection accuracy detection unit with a detection accuracy equal to or higher than a predetermined detection accuracy as an exposure-control target face part that is not covered by an accessory, and outputs a determination result; The luminance detection unit determines, using the determination result output by the exposure control target face part determination unit, the face part that is the exposure control target face part and is not covered by an accessory on the face of the passenger, and detects the luminance of the face part as a first luminance.

1. An on-vehicle exposure control device comprising:

3. acquiring, by an imaging unit, an image of a passenger in a vehicle output from an imaging device that captures an image of the passenger; detecting facial information of the passenger from the captured image acquired by the imaging unit by a face detection unit; detecting, by a luminance detection unit, a first luminance which is a luminance of a face or a part of a face of the occupant appearing in the captured image, by using the face information detected by the face detection unit; and controlling exposure by an exposure control unit so that the first luminance detected by the luminance detection unit becomes a target luminance. the luminance detection unit detects, when the face of the occupant is not covered by an accessory, a luminance of the face of the occupant as the first luminance, and, when a part of the face of the occupant is covered by an accessory, detects, as the first luminance, a luminance of an area excluding the part of the face covered by the accessory; The method further includes a step of detecting, by a mask detection unit, whether or not the passenger is wearing a mask as the accessory, using the face information detected by the face detection unit; When the mask detection unit detects that the occupant is wearing a mask, the luminance detection unit detects, as the first luminance, a luminance of an area of ​​the occupant's face excluding a part of the face that is covered by the mask, and when the mask detection unit detects that the occupant is not wearing a mask, the luminance detection unit detects, as the first luminance, a luminance of the occupant's face; a step of identifying a type of the mask by a mask type identification unit when the mask detection unit detects that the passenger is wearing a mask; and adjusting the target luminance in the exposure control by the exposure control unit, using a target luminance adjustment unit; the exposure control unit controls exposure so that the first luminance becomes a first target luminance among the target luminances when the mask detection unit detects that the occupant is not wearing a mask, and controls exposure so that the first luminance becomes a second target luminance among the target luminances, the second target luminance being different from the first target luminance, when the mask detection unit detects that the occupant is wearing a mask; The target brightness adjustment unit adjusts the second target brightness to a brightness greater than the first target brightness when the mask type identification unit identifies the type of the mask as a white mask, and adjusts the second target brightness to a brightness smaller than the first target brightness when the mask type identification unit identifies the type of the mask as a black mask.

23. An exposure control method comprising:

4. acquiring, by an imaging unit, an image of a passenger in a vehicle output from an imaging device that captures an image of the passenger; detecting facial information of the passenger from the captured image acquired by the imaging unit by a face detection unit; detecting, by a luminance detection unit, a first luminance which is a luminance of a face or a part of a face of the occupant appearing in the captured image, by using the face information detected by the face detection unit; and controlling exposure by an exposure control unit so that the first luminance detected by the luminance detection unit becomes a target luminance. the luminance detection unit detects, when the face of the occupant is not covered by an accessory, a luminance of the face of the occupant as the first luminance, and, when a part of the face of the occupant is covered by an accessory, detects, as the first luminance, a luminance of an area excluding the part of the face covered by the accessory; detecting facial parts from the face information detected by the face detection unit by a facial part detection unit; detecting, by a facial part detection accuracy detection unit, a detection accuracy of the facial part detected by the facial part detection unit; a step of determining by an exposure control target face part determination unit that the detection accuracy of the face part detected by the face part detection accuracy detection unit is equal to or higher than a predetermined detection accuracy as a face part that is not covered by an accessory and is subject to exposure control, and outputting a determination result; The luminance detection unit determines, using the determination result output by the exposure control target face part determination unit, the face part that is the exposure control target face part and is not covered by an accessory on the face of the passenger, and detects the luminance of the face part as a first luminance.

23. An exposure control method comprising:

Images