Illuminance estimator

The illuminance estimating device uses road surface brightness to estimate illuminance when the sky is not visible, addressing inaccuracies in light control for vehicles entering structures.

JP2024157103AActive Publication Date: 2024-11-07TOYOTA JIDOSHA KK
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023071227
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-25
Publication Date
2024-11-07
Estimated Expiration
2043-04-25

AI Technical Summary

Technical Problem

Existing illuminance estimation systems struggle to accurately determine brightness when the sky area is not visible, such as in covered parking lots or tunnels, leading to inaccurate light control.

Method used

An illuminance estimating device that analyzes the brightness of the road surface area in the vehicle's forward image and determines if the vehicle will enter a structure, using this brightness to estimate illuminance when the sky area is not visible.

Benefits of technology

Enables accurate illuminance estimation even when the sky area is obscured, ensuring reliable light control for vehicles entering structures like tunnels or covered parking lots.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024157103000001_ABST
    Figure 2024157103000001_ABST
Patent Text Reader

Abstract

To provide an illuminance estimator that can estimate illuminance when a vehicle enters the inside of a structure.SOLUTION: An illuminance estimator 30 is a device that estimates the illuminance which is the brightness of the surroundings of a vehicle 10. The illuminance estimator 30 executes: acquiring front images which are images of the front of the vehicle; acquiring the luminance of a road surface area which is an area of a road surface on which the vehicle 10 travels, out of the front images; analyzing the front images to determine whether or not the vehicle 10 enters an inside of a structure that the vehicle 10 can enter; and acquiring a value corresponding to the luminance of the road surface area as the illuminance when it is determined that the vehicle enters the inside of the structure.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an illuminance estimation device that estimates illuminance, which is the brightness of the surroundings of a vehicle, based on an image captured of the area ahead of the vehicle. [Background technology]

[0002] Patent Document 1 discloses an example of a control device that automatically turns on the vehicle's lights based on an image captured by an on-board camera of the area ahead of the vehicle. Specifically, the control device determines whether to automatically turn on the lights based on the brightness of a roadway area, which is an area of ​​the image showing the road on which the vehicle is traveling, and the brightness of an upper sky area, which is an area of ​​the sky above the roadway area, which corresponds to the roadway area. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2005-75304 A Summary of the Invention [Problem to be solved by the invention]

[0004] Consider a control device that automatically turns on the lights using illuminance estimated based on the above image. In the above image, the luminance of the sky region, which is the region where the sky is reflected, is less affected by light sources such as the sun compared to the luminance of the road surface region, which is the region where the road is reflected. Therefore, it is preferable for the control device to estimate the illuminance based on the luminance of the sky region.

[0005] However, when a vehicle enters a structure such as a covered parking lot or a tunnel, the sky may not be captured in the image. In such a case, the control device cannot obtain the luminance of the sky area, which may cause problems in estimating the illuminance. [Means for solving the problem]

[0006] The illuminance estimation device for solving the above problem is a device that estimates illuminance, which is the brightness around a vehicle. The illuminance estimation device executes the following operations: acquiring a front image that is an image in front of a vehicle, acquiring the luminance of a road surface area in the front image that is an area showing the road surface on which the vehicle is traveling, analyzing the front image to determine whether the vehicle will enter a structure that the vehicle can enter, and acquiring a value corresponding to the luminance of the road surface area as the illuminance when it is determined that the vehicle will enter the structure. Effect of the Invention

[0007] The above-described illuminance estimation device has an effect of being able to estimate illuminance when a vehicle enters the interior of a structure. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram of a vehicle equipped with an illuminance estimation device and a front camera according to an embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing an example of a forward image captured by the forward camera of FIG. [Diagram 3] FIG. 3 is a schematic diagram showing an example of a forward image captured by the forward camera of FIG. [Figure 4] FIG. 4 is a flowchart showing the process executed by the illumination estimation device of FIG. [Diagram 5] FIG. 5 is a flowchart showing the process executed by the illumination estimation device of FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an embodiment of an illuminance estimation device will be described with reference to FIGS. 1 illustrates a vehicle 10 equipped with an illuminance estimation device 30. The vehicle 10 further includes a front camera 11 and a light control device 20. The front camera 11 is installed in the front of the passenger compartment of the vehicle 10. Therefore, the front camera 11 can capture an image of the front Xa of the vehicle from its installation position on the vehicle 10. An image captured by the front camera 11 is referred to as a "front image IMG." The front camera 11 sequentially transmits data of the front image IMG to the illuminance estimation device 30.

[0010] The illuminance estimation device 30 estimates the illuminance ILL, which is the brightness around the vehicle 10. The illuminance estimation device 30 has an image recognition device 31 and an illuminance acquisition device 41. The image recognition device 31 analyzes the forward image IMG indicated by the data received from the forward camera 11. The illuminance acquisition device 41 acquires the illuminance ILL based on the analysis result of the forward image IMG by the image recognition device 31.

[0011] The light control device 20 judges whether or not to automatically turn on the lights of the vehicle 10 based on the illuminance ILL estimated by the illuminance estimation device 30. For example, when the illuminance ILL becomes equal to or greater than the turning-on determination illuminance while the lights are turned off, the light control device 20 automatically turns on the lights. On the other hand, when the illuminance ILL becomes less than the turning-off determination illuminance while the lights are turned on, the light control device 20 automatically turns off the lights. In this case, an illuminance equal to or less than the turning-on determination illuminance is set as the turning-off determination illuminance.

[0012] <Front image> 2 and 3 each show an example of a forward image IMG. The forward image IMG shown in Fig. 2 shows the road surface on which the vehicle 10 is traveling and the sky. In the forward image IMG, the area showing the road surface is referred to as the "road surface area RR." In the forward image IMG, the area showing the sky is referred to as the "sky area RE." The forward image IMG shown in Fig. 2 includes both the road surface area RR and the sky area RE.

[0013] The forward image IMG shown in FIG. 3 shows the road surface on which the vehicle 10 is traveling and a tunnel, which is an example of a structure. The forward image IMG shows the vehicle 10 about to enter the tunnel. The "structure" here refers to a structure that the vehicle 10 can enter. Examples of structures include a tunnel and a self-driving covered parking lot. The forward image IMG shown in FIG. 3 includes a road surface area RR, but does not include a sky area RE.

[0014] <Image recognition device for illuminance estimation device> As shown in Fig. 1, the image recognition device 31 includes a processing circuit 32. One example of the processing circuit 32 is an electronic control device. In this case, the processing circuit 32 includes a CPU 33 and a memory 34. The memory 34 stores a control program executed by the CPU 33. The CPU 33 executes the control program of the memory 34, whereby the processing circuit 32 executes an analysis process for analyzing the forward image IMG. The details of the analysis process will be described later.

[0015] <Illuminance acquisition device for illuminance estimation device> As shown in Fig. 1, the illuminance acquisition device 41 includes a processing circuit 42. One example of the processing circuit 42 is an electronic control device. In this case, the processing circuit 42 includes a CPU 43 and a memory 44. The memory 44 stores a control program executed by the CPU 43. The CPU 43 executes the control program of the memory 44, whereby the processing circuit 42 executes an illuminance acquisition process for acquiring the illuminance ILL. The details of the illuminance acquisition process will be described later.

[0016] In the following description, the processing circuit 32 of the image recognition device 31 will be referred to as the "first processing circuit 32." The processing circuit 42 of the illuminance acquisition device 41 will be referred to as the "second processing circuit 42." <Analysis process> 4, the analysis process executed by the image recognition device 31 will be described. In the image recognition device 31, the CPU 33 executes a control program in the memory 34, so that the first processing circuit 32 repeatedly executes the analysis process at each predetermined control cycle.

[0017] In step S11, the first processing circuit 32 acquires data of the forward image IMG. In the following step S13, the first processing circuit 32 calculates the sky occupancy rate EOC, which is the occupancy rate of the sky area RE in the currently acquired forward image IMG. The first processing circuit 32 calculates the road surface occupancy rate ROC, which is the occupancy rate of the road surface area RR in the currently acquired forward image IMG. For example, the first processing circuit 32 uses a known image recognition technology to extract the sky area RE from the forward image IMG and calculates the area of ​​the extracted sky area RE. Then, the first processing circuit 32 calculates the area of ​​the sky area RE relative to the total area of ​​the forward image IMG as the sky occupancy rate EOC. Similarly, the first processing circuit 32 uses a known image recognition technology to extract the road surface area RR from the forward image IMG and calculates the area of ​​the extracted road surface area RR. Then, the first processing circuit 32 calculates the area of ​​the road surface area RR relative to the total area of ​​the forward image IMG as the road surface occupancy rate ROC.

[0018] In the next step S15, the first processing circuit 32 calculates an average luminance LAVES of the sky region RE as the luminance of the sky region RE. For example, the first processing circuit 32 divides the sky region RE of the forward image IMG into a plurality of divided regions. The first processing circuit 32 calculates the luminance of each of the plurality of divided regions. Then, the first processing circuit 32 calculates the average value of the luminance of the plurality of divided regions as the average luminance LAVES of the sky region RE.

[0019] Next, in step S17, the first processing circuit 32 calculates the average luminance LAVRS of the road surface area RR as the luminance of the road surface area RR. For example, the first processing circuit 32 divides the road surface area RR of the forward image IMG into a plurality of divided areas. The first processing circuit 32 calculates the luminance of each of the plurality of divided areas. Then, the first processing circuit 32 calculates the average value of the luminance of the plurality of divided areas as the average luminance LAVRS of the road surface area RR.

[0020] Then, in step S19, the first processing circuit 32 performs a correction process for the average luminances LAVES and LAVRS calculated in steps S15 and S17. For example, the first processing circuit 32 corrects the average luminances LAVES and LAVRS based on the current time zone, season, weather, and the like. For example, when the road surface is covered with snow, the average luminance LAVRS of the road surface area RR tends to be high, so the first processing circuit 32 reduces the average luminance LAVRS of the road surface area RR. For example, when the sky is reddish due to the setting sun, the average luminance LAVES of the sky area RE tends to be high, so the first processing circuit 32 reduces the average luminance LAVES of the sky area RE.

[0021] In the next step S21, the first processing circuit 32 determines whether or not the vehicle 10 will enter the interior of a structure by analyzing the forward image IMG. For example, the first processing circuit 32 can determine that the vehicle 10 will enter the interior of a structure when the following conditions (A1) and (A2) are satisfied. In this case, the first processing circuit 32 determines that the vehicle 10 will not enter the interior of a structure when at least one of the following conditions (A1) and (A2) is not satisfied.

[0022] (A1) The structure is visible in the forward image (IMG). (A2) The distance from the vehicle 10 to the structure is below the judgment distance. When the first processing circuit 32 determines that the vehicle 10 will enter the interior of the structure (S21: YES), the process proceeds to step S23. On the other hand, when the first processing circuit 32 determines that the vehicle 10 will not enter the interior of the structure (S21: NO), the process proceeds to step S25.

[0023] In step S23, the first processing circuit 32 sets the entry flag FLG to ON. The entry flag FLG is a flag that is set to ON when it is determined that the vehicle 10 is entering the interior of a structure. After that, the first processing circuit 32 temporarily ends the analysis process.

[0024] In step S25, the first processing circuit 32 sets the entry flag FLG to OFF, and then the first processing circuit 32 temporarily ends the analysis process. <Illuminance acquisition process> 5, an illuminance acquisition process executed by the illuminance acquisition device 41 will be described. In the illuminance acquisition device 41, the CPU 43 executes a control program in the memory 44, so that the second processing circuit 42 repeatedly executes the illuminance acquisition process at each predetermined control cycle.

[0025] In step S41, the second processing circuit 42 determines whether or not the entry flag FLG is set to ON. When the entry flag FLG is set to ON, it is determined that the vehicle 10 will enter the interior of the structure. When the entry flag FLG is not set to ON, it is determined that the vehicle 10 will not enter the interior of the structure. When the entry flag FLG is set to ON (S41: YES), the second processing circuit 42 shifts the processing to step S43. On the other hand, when the entry flag FLG is set to OFF (S41: NO), the second processing circuit 42 shifts the processing to step S45.

[0026] In step S43, the second processing circuit 42 acquires the average luminance LAVRS of the road surface area RR as the illuminance ILL. That is, when the second processing circuit 42 determines that the vehicle 10 is entering the interior of the structure, the second processing circuit 42 acquires a value according to the luminance of the road surface area RR as the illuminance ILL. Then, the second processing circuit 42 temporarily ends the illuminance acquisition process.

[0027] In step S45, the second processing circuit 42 judges whether the empty occupancy rate EOC is higher than the empty occupancy rate judgment value EOCth. It is presumed that the lower the empty occupancy rate EOC, the lower the correlation between the actual values ​​of the luminance and illuminance of the empty area RE. Therefore, the empty occupancy rate judgment value EOCth is set as a criterion for judging whether the correlation between the actual values ​​of the luminance and illuminance of the sky area RE is low. If the empty occupancy rate EOC is higher than the empty occupancy rate judgment value EOCth (S45: YES), the second processing circuit 42 shifts the process to step S47. On the other hand, if the empty occupancy rate EOC is equal to or lower than the empty occupancy rate judgment value EOCth (S45: NO), the second processing circuit 42 shifts the process to step S61.

[0028] In step S47, the second processing circuit 42 judges whether the average luminance LAVRS of the road surface area RR is higher than the road surface luminance judgment value LAVRSth. It is presumed that the higher the luminance of the road surface area RR, the lower the correlation between the luminance of the road surface area RR and the actual value of the illuminance. Therefore, the criterion for judging whether the correlation between the luminance of the sky area RE and the actual value of the illuminance is low is set as the road surface luminance judgment value LAVRSth. If the average luminance LAVRS of the road surface area RR is higher than the road surface luminance judgment value LAVRSth (S47: YES), the second processing circuit 42 shifts the process to step S49. On the other hand, if the average luminance LAVRS is equal to or lower than the road surface luminance judgment value LAVRSth (S47: NO), the second processing circuit 42 shifts the process to step S51.

[0029] In step S49, the second processing circuit 42 acquires the average luminance LAVES of the sky area RE as the illuminance ILL. That is, when the second processing circuit 42 determines that the vehicle 10 will not enter the interior of the structure, if both the sky occupancy rate EOC is higher than the sky occupancy rate judgment value EOCth and the average luminance LAVRS of the road surface area is higher than the road surface luminance judgment value LAVRSth, the second processing circuit 42 acquires a value corresponding to the luminance of the sky area RE as the illuminance ILL. Then, the second processing circuit 42 temporarily ends the illuminance acquisition process.

[0030] In step S51, the second processing circuit 42 acquires the average luminance LAVRS of the road surface area RR as the illuminance ILL. That is, when the second processing circuit 42 determines that the vehicle 10 will not enter the interior of the structure, if both of the following are true: the sky occupancy rate EOC is higher than the sky occupancy rate judgment value EOCth, and the average luminance LAVRS of the road surface area is equal to or lower than the road surface luminance judgment value LAVRSth, the second processing circuit 42 acquires a value corresponding to the luminance of the road surface area RR as the illuminance ILL. Then, the second processing circuit 42 temporarily ends the illuminance acquisition process.

[0031] In step S61, the second processing circuit 42 judges whether or not the road surface occupancy rate ROC is higher than the road surface occupancy rate judgment value ROCth. It is presumed that the lower the road surface occupancy rate ROC, the lower the correlation between the actual values ​​of luminance and illuminance of the road surface area RR. Therefore, the road surface occupancy rate judgment value ROCth is set as a criterion for judging whether or not the correlation between the actual values ​​of luminance and illuminance of the road surface area RR is low. If the road surface occupancy rate ROC is higher than the road surface occupancy rate judgment value ROCth (S61: YES), the second processing circuit 42 shifts the process to step S63. On the other hand, if the road surface occupancy rate ROC is equal to or lower than the road surface occupancy rate judgment value ROCth (S61: NO), the second processing circuit 42 shifts the process to step S65.

[0032] In step S63, the second processing circuit 42 calculates the illuminance ILL based on the last sky average luminance LAVESL, the last road surface average luminance LAVRSL, and the average luminance LAVRS of the road surface area RR. Specifically, the second processing circuit 42 calculates the illuminance ILL using the following relational expression (D1). The last sky average luminance LAVESL is the average luminance LAVES of the sky area RE at the time when at least one of the judgments in step S45 and step S61 is switched from a state in which it is negative (NO) to a state in which both of the two judgments are positive (YES). The last road surface average luminance LAVRSL is the average luminance LAVRS of the road surface area RR at the time when at least one of the judgments in step S45 and step S61 is switched from a state in which it is negative (NO) to a state in which both of the two judgments are positive (YES).

[0033] ILL = LAVESL × LAVES ÷ LAVRSL (D1) When both of the following are satisfied: the vacant road occupancy rate EOC is equal to or less than the vacant road occupancy rate judgment value EOCth, and the road occupancy rate ROC is higher than the road occupancy rate judgment value ROCth, it is said that the "predetermined condition is satisfied." In this case, the luminance of the road surface area at the time when the predetermined condition is satisfied is set as the "predetermined road surface luminance." When the predetermined condition is satisfied, the second processing circuit 42 calculates the illuminance ILL so that the illuminance ILL is greater as the luminance of the current road surface area RR relative to the predetermined road surface luminance is greater. Then, the second processing circuit 42 temporarily terminates the illuminance acquisition device.

[0034] In step S65, the second processing circuit 42 holds the illuminance ILL. Specifically, the second processing circuit 42 acquires the previous value of the illuminance ILL as the latest value of the illuminance ILL. The previous value of the illuminance ILL is the illuminance ILL acquired when the illuminance acquisition process was executed the previous time. That is, when it is determined that the vehicle 10 will not enter the interior of the structure, the second processing circuit 42 holds the illuminance ILL when both of the following are true: the vacant occupancy rate EOC is equal to or less than the vacant occupancy rate judgment value EOCth, and the road surface occupancy rate ROC is equal to or less than the road surface occupancy rate judgment value ROCth. Then, the second processing circuit 42 temporarily ends the illuminance acquisition process.

[0035] <Action and Effects> (1) When it is determined that the vehicle 10 is entering the interior of a structure, the illuminance estimation device 30 acquires the average luminance LAVRS of the road surface area RR as the illuminance ILL. That is, the illuminance estimation device 30 can estimate the illuminance ILL without using information on the sky area RE, that is, the average luminance LAVES and the sky occupancy rate EOC of the sky area RE. Therefore, the illuminance estimation device 30 can estimate the illuminance when the vehicle 10 is entering the interior of a structure.

[0036] (2) When the illuminance estimation device 30 determines that the vehicle 10 is entering the interior of a structure, and it can determine that the sky occupancy rate EOC in the forward image IMG is relatively high, it estimates the illuminance ILL based on the luminance of the sky area RE or the luminance of the road area RR.

[0037] When the sky occupancy rate EOC is higher than the sky occupancy rate judgment value EOCth, and the average luminance LAVRS of the road surface area RR is relatively high, it can be estimated that the current time is daytime. In the daytime, a large amount of light from the sun is incident on the road surface. Therefore, when the vehicle 10 is running in the daytime, it is estimated that the correlation between the luminance of the road surface area RR and the actual value of the illuminance is not very high. Therefore, when the sky occupancy rate EOC is higher than the sky occupancy rate judgment value EOCth and the average luminance LAVRS of the road surface area RR is higher than the road surface luminance judgment value LAVRSth, the illuminance estimation device 30 acquires the average luminance LAVES of the sky area RE as the illuminance ILL. That is, the illuminance estimation device 30 estimates the illuminance ILL without using the luminance of the road surface area RR. This allows the illuminance estimation device 30 to estimate the illuminance ILL with high accuracy.

[0038] On the other hand, when the sky occupancy rate EOC is higher than the sky occupancy rate judgment value EOCth, and the average luminance LAVRS of the road surface area RR is relatively low, it can be assumed that it is evening or night. In the evening or night, a large amount of light from a light source such as the sun is not incident on the road surface. Therefore, when the vehicle 10 is traveling in the evening or night, it is assumed that the correlation between the luminance of the road surface area RR and the actual value of the illuminance is relatively high. Therefore, when the sky occupancy rate EOC is higher than the sky occupancy rate judgment value EOCth and the average luminance LAVRS of the road surface area RR is equal to or lower than the road surface luminance judgment value LAVRSth, the illuminance estimation device 30 acquires the average luminance LAVRS of the road surface area RR as the illuminance ILL.

[0039] Therefore, the illuminance estimation device 30 can estimate the illuminance ILL with high accuracy regardless of the time of day when the vehicle 10 is traveling. (3) When it is determined that the vehicle 10 is entering a structure, if it can be determined that the sky occupancy rate EOC in the forward image IMG is relatively low, it can be inferred that the sky is not very visible in the forward image IMG. In this case, if the illuminance ILL is estimated using information about the sky area RE, the accuracy of the estimation may be low.

[0040] In this regard, when the sky occupancy rate EOC is equal to or less than the sky occupancy rate judgment value EOCth and the road surface occupancy rate ROC is higher than the road surface occupancy rate judgment value ROCth, the illuminance estimation device 30 calculates the illuminance ILL using the above relational expression (D1). This allows the illuminance estimation device 30 to estimate the illuminance ILL based on the rate of change in the average luminance LAVES of the road surface area RR from the point in time when at least one of the judgments in step S45 and step S61 is switched from a state in which the judgment is negative (NO) to a state in which both of the judgments are positive (YES). As a result, the illuminance estimation device 30 can estimate the illuminance ILL even when the sky occupancy rate EOC is relatively low.

[0041] (4) When it is determined that the vehicle 10 is entering the interior of a structure, if it can be determined that both the sky occupancy rate EOC and the road occupancy rate ROC in the forward image IMG are relatively low, it can be inferred that both the correlation between the luminance and the actual illuminance value of the sky region RE and the correlation between the luminance and the actual illuminance value of the road region RR are low. Therefore, when the sky occupancy rate EOC is equal to or lower than the sky occupancy rate judgment value EOCth and the road occupancy rate ROC is equal to or lower than the road occupancy rate judgment value ROCth, the illuminance estimation device 30 holds the illuminance ILL. This allows the illuminance estimation device 30 to suppress a decrease in the estimation accuracy of the illuminance ILL.

[0042] <Example of change> The above embodiment can be modified as follows: The above embodiment and the following modifications can be combined with each other to the extent that no technical contradiction occurs.

[0043] In the analysis process shown in FIG. 4, the second processing circuit 42 may set the entry flag FLG to ON even when the vehicle 10 has already entered the interior of the structure. When the empty space occupancy rate EOC is equal to or lower than the empty space occupancy rate judgment value EOCth (S45: NO), the second processing circuit 42 may calculate the illuminance ILL by processing in step S63, regardless of whether the road surface occupancy rate ROC is higher than the road surface occupancy rate judgment value ROCth.

[0044] When the sky occupancy rate EOC is equal to or lower than the sky occupancy rate judgment value EOCth (S45: NO), the second processing circuit 42 may hold the illuminance ILL regardless of whether the road surface occupancy rate ROC is higher than the road surface occupancy rate judgment value ROCth.

[0045] When the sky occupancy rate EOC is higher than the sky occupancy rate judgment value EOCth (S45: YES), the second processing circuit 42 may acquire the average luminance LAVES of the sky area RE as the illuminance ILL, regardless of whether the average luminance LAVRS of the road surface area RR is higher than the road surface luminance judgment value LAVRSth.

[0046] When the sky occupancy rate EOC is higher than the sky occupancy rate judgment value EOCth (S45: YES), the second processing circuit 42 may acquire the average luminance LAVRS of the road surface area RR as the illuminance ILL, regardless of whether the average luminance LAVRS of the road surface area RR is higher than the road surface luminance judgment value LAVRSth.

[0047] 5, the second processing circuit 42 may obtain a value different from the average luminance LAVRS as the illuminance ILL, as long as the second processing circuit 42 can obtain a value corresponding to the luminance of the road surface area RR as the illuminance ILL. For example, the second processing circuit 42 may obtain the luminance of the divided area having the highest luminance in the road surface area RR as the illuminance ILL.

[0048] 5, the second processing circuit 42 may obtain a value different from the average luminance LAVES as the illuminance ILL, so long as the second processing circuit 42 can obtain a value corresponding to the luminance of the sky region RE as the illuminance ILL. For example, the second processing circuit 42 may obtain the luminance of the divided region with the highest luminance in the sky region RE as the illuminance ILL.

[0049] In the above embodiment, an example has been described in which the illuminance ILL estimated by the illuminance estimation device 30 is used for control to automatically turn on and off the lights. However, the illuminance ILL can be used for other controls in the vehicle 10. For example, the illuminance ILL may be used for dimming control of a display inside the vehicle.

[0050] The second processing circuit 42 is not limited to a circuit having a CPU and a ROM and executing software processing. In other words, the second processing circuit 42 may have any one of the following configurations (a), (b), and (c).

[0051] (a) The second processing circuit 42 includes one or more processors that execute various processes according to a computer program. The processor includes a CPU and memory such as RAM and ROM. The memory stores program codes or instructions configured to cause the CPU to execute processes. Memory, i.e., computer-readable media, includes any available media that can be accessed by a general-purpose or special-purpose computer.

[0052] (b) The second processing circuit 42 includes one or more dedicated hardware circuits for executing various processes. Examples of the dedicated hardware circuits include application specific integrated circuits, i.e., ASIC and FPGA. ASIC is an abbreviation for "Application Specific Integrated Circuit" and FPGA is an abbreviation for "Field Programmable Gate Array."

[0053] (c) The second processing circuit 42 includes a processor that executes some of the various processes in accordance with a computer program, and a dedicated hardware circuit that executes the remaining processes among the various processes.

[0054] The first processing circuit 32 may have any one of the above configurations (a), (b), and (c). The term "at least one" used herein means "one or more" of the desired options. As an example, the term "at least one" used herein means "only one option" or "both of two options" if the number of options is two. As another example, the term "at least one" used herein means "only one option" or "any combination of two or more options" if the number of options is three or more. [Explanation of symbols]

[0055] 10...vehicle, 11...front camera, 30...illuminance estimation device, 31...image recognition device, 41...illuminance acquisition device

Claims

1. An illuminance estimation device that estimates illuminance, which is the brightness around a vehicle, comprising: Acquiring a forward image, which is an image of a front of a vehicle; acquiring a luminance of a road surface area, which is an area of ​​the forward image that shows a road surface on which the vehicle is traveling; determining whether the vehicle is entering a structure accessible to the vehicle by analyzing the forward image; When it is determined that the vehicle is entering the interior of the structure, a value corresponding to the luminance of the road surface area is acquired as the illuminance. Illuminance estimation device.

2. Obtaining an occupancy rate of a sky area, which is an area in which the sky is captured, in the forward image; obtaining a luminance of the sky region; When it is determined that the vehicle will not enter the interior of the structure, if both of the occupancy rate of the sky area is higher than a sky occupancy rate judgment value and the luminance of the road surface area is higher than a road surface luminance judgment value, a value corresponding to the luminance of the sky area is acquired as the illuminance. The illuminance estimation device according to claim 1 .

3. When it is determined that the vehicle will not enter the interior of the structure, if both of the following are true: the occupancy rate of the sky area is higher than the sky occupancy rate determination value, and the luminance of the road surface area is equal to or lower than the road surface luminance determination value, a value corresponding to the luminance of the road surface area is acquired as the illuminance. The illuminance estimation device according to claim 2 .

4. Obtaining an occupancy rate of a sky area, which is an area in which the sky is captured, in the forward image; Obtaining an occupancy rate of the road surface area in the forward image; When it is determined that the vehicle will not enter the interior of the structure, and both of the occupancy rate of the sky area is equal to or less than a sky area occupancy rate judgment value and the occupancy rate of the road surface area is higher than a road surface occupancy rate judgment value, calculate the illuminance such that the illuminance increases as the luminance of the current road surface area increases relative to the luminance of the road surface area at the time when both of the occupancy rate of the sky area is equal to or less than the sky area occupancy rate judgment value and the occupancy rate of the road surface area is higher than the road surface occupancy rate judgment value are established. The illuminance estimation device according to claim 1 .

5. When it is determined that the vehicle will not enter the interior of the structure, if both of the occupancy rate of the sky area is equal to or less than the sky occupancy rate determination value and the occupancy rate of the road surface area is equal to or less than the road surface occupancy rate determination value are satisfied, the illuminance is maintained. The illumination estimation device according to claim 4 .

Citation Information

Patent Citations

  • Illumination environment determination apparatus and program

    JP2010169583A

  • Driving support apparatus

    JP2012073927A

  • On-vehicle camera device

    JP2013005234A

  • Illuminance estimation device

    WO2022249791A1

  • Lighting controller for vehicle

    JP2005075304A