Vehicle body surface condition detection device

Abstract

To provide a vehicle body surface condition detection device which can reduce the time and effort required to detect the condition of a vehicle body.SOLUTION: A vehicle body surface condition detection device is provided, comprising an acquisition unit for acquiring brightness information from an optical sensor installed on a vehicle and configured to detect brightness information regarding brightness according to the surface condition of a body of the vehicle, and a detection unit configured to detect the surface condition based on the brightness information acquired by the acquisition unit.SELECTED DRAWING: Figure 10

Description

[Technical field]

[0001] The present invention relates to a vehicle body surface condition detection device. [Background technology]

[0002] Conventionally, there is known a device that is installed in a facility and optically detects dirt on the surface of a vehicle body. For example, Patent Document 1 describes a dirt measuring device in which a light emitting unit applies light to the surface of the vehicle body, the reflected light is input to a light receiving unit, and a detection unit calculates a dirt index of the surface of the vehicle body based on the input value input to the light receiving unit. This dirt measuring device is installed in a car wash facility. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 6-281584 Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, in order to detect dirt on the surface of the vehicle body, even if a car wash is not necessary, the vehicle must be transported to a dedicated car wash facility where the device is installed, which is a time-consuming process.

[0005] One of the problems to be solved by the embodiments of the present invention is to provide a vehicle body surface condition detection device that can reduce the effort required to detect the condition of a vehicle body. [Means for solving the problem]

[0006] A vehicle body surface condition detection device according to an embodiment of the present invention includes an acquisition unit that acquires luminance information from an optical sensor mounted on a vehicle and detects luminance information related to luminance corresponding to a surface condition of the vehicle body, and a detection unit that detects the surface condition based on the luminance information acquired by the acquisition unit. Effect of the Invention

[0007] The vehicle body surface condition detection device according to the embodiment of the present invention can reduce the effort required to detect the condition of the vehicle body. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a vehicle on which a vehicle body surface condition detection system according to an embodiment is mounted. [Diagram 2] FIG. 2 is a diagram illustrating an example of a functional configuration of a data processing device in the vehicle body surface condition detection system according to the embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of a traveling state of the vehicle according to the embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a state within a sensing range of an optical sensor in an embodiment, in which the surface of a vehicle body is free of dirt and scratches. [Diagram 5] FIG. 5 is a diagram showing an example of a state within a sensing range of an optical sensor in the embodiment, in which dirt is present on the surface of a vehicle body. [Figure 6] FIG. 6 is a diagram showing an example of a state within a sensing range of an optical sensor in the embodiment, in which a scratch is present on the surface of a vehicle body. [Figure 7] FIG. 7 is a diagram showing an example of a detection result of the optical sensor according to the embodiment, in which the surface of the vehicle body is free of dirt and scratches. [Figure 8] FIG. 8 is a diagram showing an example of a detection result of the optical sensor according to the embodiment, in which there is dirt on the surface of the vehicle body. [Figure 9] FIG. 9 is a flowchart illustrating an example of a threshold setting process executed by the data processing device of the embodiment. [Figure 10] FIG. 10 is a flowchart illustrating an example of a flaw detection process executed by the data processing device of the embodiment. [Figure 11]FIG. 11 is a flowchart illustrating an example of a stain detection process executed by the data processing device of the embodiment. [Figure 12] FIG. 12 is a flowchart illustrating an example of an optical sensor inspection process executed by the data processing device of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Exemplary embodiments of the present invention are disclosed below. The configurations of the embodiments shown below, and the actions, results, and effects brought about by the configurations are merely examples. The present invention can be realized with configurations other than those disclosed in the following embodiments, and it is possible to obtain at least one of various effects and derivative effects based on the basic configurations.

[0010] <Vehicle C> 1 is a diagram showing an example of the configuration of a vehicle C on which a vehicle body surface condition detection system S according to an embodiment is mounted. The vehicle C according to this embodiment is, for example, a four-wheeled automobile. The vehicle body surface condition detection system S is mounted on the vehicle C and executes a process of detecting the condition of a surface B1 of a vehicle body B in the vehicle C. The condition of the surface B1 of the vehicle body B detected by the vehicle body surface condition detection system S is, for example, dirt or scratches.

[0011] The vehicle C includes a vehicle body B, wheels 6, two door mirrors 7, a vehicle control ECU 10 (Electronic Control Unit), etc. The door mirrors 7 are also called side mirrors.

[0012] The two door mirrors 7 are a left door mirror 7L and a right door mirror 7R. The door mirror 7 is connected to the vehicle body B so as to be openable and closable, and the optical sensor 1 moves integrally with the door mirror 7. The door mirror 7 can be changed (displaced) between an open state (open position) and a closed state (closed position) by the operation of an opening / closing mechanism controlled by the vehicle control ECU 10. When the door mirror 7 is in the open state, the mirror surface of the door mirror 7 faces backward in the fore-and-aft direction of the vehicle C. When the door mirror 7 is in the closed state, the mirror surface of the door mirror 7 faces inward of the vehicle C in the width direction (left-right direction) of the vehicle C. That is, when the door mirror 7 is in the closed state, the mirror surface of the door mirror 7 faces the interior of the vehicle C provided in the vehicle body B.

[0013] <Configuration of Vehicle Body Surface Condition Detection System S> The vehicle body surface condition detection system S includes an optical sensor 1 and a data processing device 2. The data processing device 2 is an example of a vehicle body surface condition detection device. The vehicle body surface condition detection device is also called a vehicle appearance inspection device.

[0014] The optical sensor 1 is installed so as to be capable of sensing the surfaces B1 of the left and right side parts Ba of the vehicle body B. The optical sensor 1 is installed, for example, facing downward. In the example shown in FIG. 1, two optical sensors 1L, 1R are installed, one on each of the left and right sides of the vehicle body B. The left optical sensor 1L is installed on the left door mirror 7L and is capable of sensing the surface B1 of the left side part Ba of the vehicle body B. The right optical sensor 1R is installed on the right door mirror 7R and is capable of sensing the surface B1 of the right side part Ba of the vehicle body B. Note that the number, installation positions, sensing range, etc. of the optical sensors 1 are not limited to those described above.

[0015] The optical sensor 1 is an event sensor. The event sensor is also called an event-based vision sensor. The optical sensor 1 detects a change in luminance (change in time series) of each pixel, and outputs only the changed luminance in combination with its coordinates and the time of occurrence. That is, each optical sensor 1 detects the luminance change of each pixel as an event, and outputs luminance distribution data indicating the timing at which the event was detected, the pixel position at which the event occurred, and the like. The luminance distribution data is an example of luminance information related to the luminance according to the state of the surface B1 of the body B of the vehicle C. The luminance distribution data is also called event data. The luminance distribution data includes the timing (time) at which the luminance change occurred, the pixel position (coordinates) which is the position of the pixel at which the luminance change occurred, and the luminance change amount which is the amount of change in luminance. The luminance change amount has two values, an increase (+) or a decrease (-). An increase in the luminance change amount represents "+1", and a decrease in the luminance change amount represents "-1". The luminance change amount is also called a luminance change value. The luminance distribution data does not include data such as the luminance change amount for pixels in which a luminance change that is an event has not occurred. Such luminance distribution data output by the optical sensor 1 tends to have a smaller amount of data than imaging data output by a camera such as an RGB camera. This is because imaging data includes imaging data for all pixels, whereas luminance distribution data includes only data for pixels whose luminance has changed, and does not include data for pixels whose luminance has not changed.

[0016] The data processing device 2 is an information processing device that processes the luminance distribution data output from each optical sensor 1, and is, for example, an ECU (Electronic Control Unit) including a CPU (Central Processing Unit), a memory, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc. The memory includes a ROM (Read Only Memory) and a RAM (Random Access Memory). The memory also includes a non-volatile rewritable storage unit 2e (see FIG. 2). The data processing device 2 detects the state of the surface B1 of the vehicle body B of the vehicle C based on the luminance distribution data acquired in time series.

[0017] FIG. 2 is a diagram showing an example of a functional configuration of the data processing device 2 in the vehicle body surface condition detection system S of the embodiment. As shown in FIG. 2, the data processing device 2 has, as functional units, an acquisition unit 2a, a detection unit 2b, an output unit 2c, and a setting unit 2d. These functional units (acquisition unit 2a, detection unit 2b, output unit 2c, setting unit 2d) can be realized by cooperation of hardware elements (e.g., a CPU, a memory, etc.) and software elements (e.g., a program stored in a memory, etc.) of the data processing device 2. That is, the software elements (programs) can include, as an example, modules corresponding to each block except for the storage unit 10d shown in FIG. 2. In addition, at least a part of these functional units (acquisition unit 2a, detection unit 2b, output unit 2c, setting unit 2d) may be configured by dedicated hardware (circuits, etc.).

[0018] The acquisition unit 2 a acquires the luminance distribution data from each optical sensor 1 .

[0019] The detection unit 2b detects the state of the surface B1 of the vehicle body B based on the luminance distribution data acquired by the acquisition unit 2a. In other words, the detection unit 2b detects the state of the surface B1 of the vehicle body B based on a time-series change in luminance. In detail, the detection unit 2b detects the state of the surface B1 of the vehicle body B based on the amount of luminance change included in the luminance distribution data acquired by the acquisition unit 2a and a threshold value. The state detected by the detection unit 2b is at least one of dirt and scratches (both, as an example) as an appearance abnormality. Note that the state detected by the detection unit 2b may be only one of dirt and scratches.

[0020] The output unit 2c outputs the state of the surface B1 of the vehicle body B detected by the detection unit 2b. For example, the output unit 2c outputs the state of the surface B1 of the vehicle body B detected by the detection unit 2b to an output device such as a display mounted on the vehicle C, a personal computer such as a mobile terminal owned by a passenger, or a management device such as a server that manages multiple vehicles C. The information output to the management device can be used as vehicle management information in, for example, a car sharing business or a rental car business.

[0021] The setting unit 2d sets a threshold value used by the detection unit 2b to detect the state of the surface B1 of the vehicle body B.

[0022] <Processing performed by the vehicle body surface condition detection system S> Next, various processes performed by the vehicle body surface condition detection system S will be described. Fig. 3 is a diagram showing an example of a traveling state of a vehicle C in the embodiment. Figs. 4 to 6 are each a diagram showing an example of a state within a sensing range D of an optical sensor 1 in the embodiment.

[0023] As a premise for various processes, the luminance change detected by the optical sensor 1 of the vehicle C will be described. When the vehicle C travels on a road as shown in FIG. 3, the scenery around the vehicle C is reflected on the surface B1 of the side Ba of the vehicle body B. FIG. 3 shows an example in which a plurality of objects 100 such as buildings are provided on the side of the road. In this case, the state within the sensing range D of the optical sensor 1 is shown in FIG. 4 to FIG. 6. In FIG. 4 to FIG. 6, the reflection 100M on the surface B1 of the side Ba of the vehicle body B is the reflection of the object 100. Here, FIG. 4 shows a state in which the surface B1 of the vehicle body B is free of dirt and scratches. FIG. 5 shows a state in which the surface B1 of the vehicle body B has dirt E. The dirt E is shown by dot hatching. FIG. 6 shows a state in which the surface B1 of the vehicle body B has a scratch F. Here, the sensing range D of the optical sensor 1 includes a surface sensing area Da, which is an area of ​​the surface B1 of the vehicle body B, and a peripheral sensing area Db, which is an area around the vehicle C. The surface sensing area Da is further divided into a plurality of areas R1 to R4. The areas R1 to R4 are aligned in the front-rear direction of the vehicle C. Hereinafter, the areas R1 to R4 will be collectively referred to as area R.

[0024] When the vehicle C moves forward, the above-mentioned reflection 100M moves rearward in the fore-and-aft direction of the vehicle C on the surface B1 of the vehicle body B. This causes a change in the brightness of the pixels of the optical sensor 1. This change in brightness differs depending on whether the surface B1 of the vehicle body B is free of dirt or scratches or whether it is dirty or scratched.

[0025] Here, FIG. 7 is a diagram showing an example of the detection result of the optical sensor 1 of the embodiment, in the case where there is no dirt or damage on the surface B1 of the vehicle body B. FIG. 8 is a diagram showing an example of the detection result of the optical sensor 1 of the embodiment, in the case where there is dirt on the surface B1 of the vehicle body B. The horizontal axis of FIG. 7 and FIG. 8 is the position in the front-rear direction of the vehicle C on the surface B1 of the side Ba of the vehicle body B. The vertical axis of FIG. 7 and FIG. 8 is the amount of change in luminance. The line L1 of FIG. 7 and FIG. 8 is the amount of change in luminance detected by the optical sensor 1. The amount of change in luminance indicated by the line L1 is, for example, the average value of the change in luminance in the area divided in the front-rear direction of the vehicle C on the surface B1 of the side Ba of the vehicle body B. As can be seen from FIG. 7 and FIG. 8, when there is dirt on the surface B1 of the vehicle body B, the amount of change in luminance is smaller than when there is no dirt or damage on the surface B1 of the vehicle body B.

[0026] Furthermore, when the surface B1 of the vehicle body B has a scratch, the amount of change in luminance is larger than when there is neither dirt nor scratch on the surface B1 of the vehicle body B. Furthermore, when the surface B1 of the vehicle body B has a scratch, the amount of change in luminance is larger only in a predetermined region of the surface B1 that includes the scratch.

[0027] In this way, the amount of change in luminance differs between when there is dirt or a scratch and when there is no dirt or scratch on the surface B1 of the vehicle body B. Therefore, the data processing device 2 of the vehicle body surface condition detection system S of this embodiment detects dirt or scratches on the surface B1 of the vehicle body B using the difference in the amount of change in luminance. In other words, when dirt occurs on the vehicle body B, the gloss of the vehicle body B decreases, and the luminance change relative to the environment reflected on the vehicle body B decreases, so in this embodiment, the decrease in luminance change is detected as dirt. Also, when a scratch occurs on the vehicle body B, the luminance change increases only in a part of the areas of the vehicle body B, so in this embodiment, the increase in luminance change is detected as a scratch. Also, as an example, the data processing device 2 uses the amount of change in luminance when there is no dirt or scratch on the surface B1 of the vehicle body B as a threshold value. The data processing device 2 detects dirt or scratches on the surface B1 of the vehicle body B based on the amount of change in luminance detected by the optical sensor 1 and the threshold value.

[0028] In addition, the change in luminance may be caused by the state of the surface B1 of the vehicle body B as described above, but may also be caused by the brightness around the vehicle C. For example, a change in luminance may occur when a relatively bright environment such as daytime changes to a relatively dark environment such as nighttime. In this case, if there is a difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da, and there is no difference between the amount of luminance change in the peripheral sensing area Db and the threshold value for the peripheral sensing area Db, the detection unit 2b determines that the difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da is caused by the brightness of the vehicle C. On the other hand, if there is a difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da, and there is a difference between the amount of luminance change in the peripheral sensing area Db and the threshold value for the peripheral sensing area Db, the detection unit 2b determines that the difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da is caused by the brightness of the vehicle C.

[0029] Next, the process executed by the data processing device 2 will be specifically described. First, the threshold value setting process will be described. Fig. 9 is a flowchart showing an example of the threshold value setting process executed by the data processing device 2 according to the embodiment. As an example, the process in Fig. 9 is performed during the day on a sunny day, that is, under a predetermined brightness state.

[0030] 9, first, the acquisition unit 2a turns on the optical sensor 1 (S101). In other words, the acquisition unit 2a starts the optical sensor 1. The timing when the optical sensor 1 is turned on is, for example, the timing when the ignition key or the start button of the vehicle C is turned on.

[0031] Next, the acquisition unit 2a acquires luminance distribution data from the optical sensor 1 (S102). For example, the acquisition unit 2a acquires data of the entire sensing range D (full angle of view) of the optical sensor 1, which is data of the entire sensing range D (full angle of view) detected by the optical sensor 1 while the vehicle C travels for a predetermined driving time (e.g., 20 minutes) or a predetermined driving distance. That is, the acquisition unit 2a acquires luminance distribution data of the entire area R of the surface sensing area Da and the peripheral sensing area Db. This luminance distribution data is data when the door mirror 7 is in the open state.

[0032] The acquiring unit 2a stores the acquired luminance distribution data in the storage unit 2e (S103).

[0033] Next, the setting unit 2d sets a threshold value based on the luminance distribution data acquired by the acquisition unit 2a (S104). The threshold value is the average value of the luminance change amount included in the luminance distribution data. Specifically, the threshold value is set for each area of ​​the sensing range D (each area R of the surface sensing area Da, and the peripheral sensing area Db). The threshold value is the average value of the luminance change amount in each area. The setting unit 2d stores the set threshold value for each area in the storage unit 2e. The luminance distribution data for the threshold value is also called standard luminance distribution data.

[0034] Next, a description will be given of a flaw detection process executed by the data processing device 2. Fig. 10 is a flowchart showing an example of the flaw detection process executed by the data processing device 2 according to the embodiment.

[0035] 10, first, the acquisition unit 2a turns on the optical sensor 1 (S201). In other words, the acquisition unit 2a starts the optical sensor 1. The timing of turning on the optical sensor 1 is, for example, the timing when the ignition key, start button, or the like of the vehicle C is turned on, similar to the case of the threshold setting process.

[0036] Next, the acquisition unit 2a acquires luminance distribution data from the optical sensor 1 (S202). For example, similar to the case of the threshold setting process, the acquisition unit 2a acquires data of the entire sensing range D (full angle of view) of the optical sensor 1, that is, data of the entire sensing range (full angle of view) detected by the optical sensor 1 while the vehicle C travels for a predetermined travel time or a predetermined travel distance. That is, the acquisition unit 2a acquires luminance distribution data of the entire area R of the surface sensing area Da and the peripheral sensing area Db. This luminance distribution data is data when the door mirror 7 is in the open state.

[0037] Next, the detection unit 2b judges whether there is a region R in which the amount of change in luminance is greater than the threshold (increased region R) (S203). At this time, the detection unit 2b judges for each region R whether the average value of the amount of change in luminance in the region R is greater than the threshold for that region.

[0038] When the detection unit 2b determines that there is an area R in which the amount of change in luminance is greater than the threshold (S203: Yes), the detection unit 2b determines whether the area in which the amount of change in luminance is greater than the threshold is only a portion of all areas in the sensing range D (S204).

[0039] When the detection unit 2b determines that only a portion of all the regions in the sensing range D is larger than the threshold value (S204: Yes), the detection unit 2b determines that there is a scratch on the surface B1 of the vehicle body B (S205). That is, the detection unit 2b detects scratches on the surface B1 of the vehicle body B. Note that the detection unit 2b may determine that there is a scratch on a portion of the region R when the portion of the region R is larger than the other regions R by a predetermined amount or more.

[0040] On the other hand, if the detection unit 2b determines in S204 that all areas of the sensing range D are larger than the threshold value (S204: No), it determines that there is no scratch on the surface B1 of the vehicle body B (S206).

[0041] That is, in S204, if there is a difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da, and there is no difference between the amount of luminance change in the peripheral sensing area Db and the threshold value for the peripheral sensing area Db, the detection unit 2b determines that the difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da is caused by the state of the surface B1. Also, if there is a difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da, and there is a difference between the amount of luminance change in the peripheral sensing area Db and the threshold value for the peripheral sensing area Db, the detection unit 2b determines that the difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da is caused by the brightness around the vehicle C. The reason for this determination is that if the amount of change in luminance in all areas is greater than the threshold, it can be determined that this is caused by the environment around vehicle C when the luminance distribution data was acquired in S202 being darker than the predetermined brightness when the luminance distribution data for setting the threshold was acquired in S101 of FIG. 9.

[0042] Furthermore, when it is determined in S203 that there is no region R in which the amount of change in luminance is greater than the threshold (S203: No), the detection unit 2b determines that there is no scratch on the surface B1 of the vehicle body B (S206). After S206, the processing from S202 onwards is repeatedly executed.

[0043] Next, a description will be given of the dirt detection process executed by the data processing device 2. Fig. 11 is a flowchart showing an example of the dirt detection process executed by the data processing device 2 of the embodiment.

[0044] 11, first, the acquisition unit 2a turns on the optical sensor 1 (S301). In other words, the acquisition unit 2a starts the optical sensor 1. The timing of turning on the optical sensor 1 is, for example, the timing when the ignition key, start button, or the like of the vehicle C is turned on, similar to the case of the threshold setting process.

[0045] Next, the acquisition unit 2a acquires luminance distribution data from the optical sensor 1 (S302). For example, similar to the case of the threshold setting process, the acquisition unit 2a acquires data of the entire sensing range (full angle of view) of the optical sensor 1, that is, data of the entire sensing range (full angle of view) detected by the optical sensor 1 while the vehicle C travels for a predetermined travel time or a predetermined travel distance. That is, the acquisition unit 2a acquires luminance distribution data of the entire area R of the surface sensing area Da and the peripheral sensing area Db. This luminance distribution data is data when the door mirror 7 is in the open state.

[0046] Next, the detection unit 2b determines whether there is a region R in which the amount of change in luminance is smaller than the threshold (decreased region R) (S303). At this time, the detection unit 2b determines for each region R whether the average value of the amount of change in luminance in the region R is smaller than the threshold for that region.

[0047] When the detection unit 2b determines that there is an area R in which the amount of change in luminance is smaller than the threshold (S303: Yes), the detection unit 2b determines whether the area in the sensing range D in which the amount of change in luminance is smaller than the threshold is only a portion of the entire area (S304).

[0048] When the detection unit 2b determines that the area smaller than the threshold value is only a part of the entire area of ​​the sensing range D (S304: Yes), the detection unit 2b determines that there is dirt on the surface B1 of the vehicle body B (S305). That is, the detection unit 2b detects dirt on the surface B1 of the vehicle body B.

[0049] On the other hand, if the detection unit 2b determines in S304 that all areas of the sensing range D are smaller than the threshold value (S304: No), it determines that there is no dirt on the surface B1 of the vehicle body B (S306).

[0050] That is, in S304, if there is a difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da, and there is no difference between the amount of luminance change in the peripheral sensing area Db and the threshold value for the peripheral sensing area Db, the detection unit 2b determines that the difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da is caused by the state of the surface B1. Also, if there is a difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da, and there is a difference between the amount of luminance change in the peripheral sensing area Db and the threshold value for the peripheral sensing area Db, the detection unit 2b determines that the difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da is caused by the brightness around the vehicle C. The reason for this determination is that if the amount of luminance change in all areas is smaller than the threshold value, it can be determined that this is caused by the environment around vehicle C when the luminance distribution data was acquired in S302 being darker than the specified brightness when the luminance distribution data for setting the threshold value was acquired in S101 of FIG. 9.

[0051] Furthermore, when it is determined in S303 that there is no region R in which the amount of change in luminance is smaller than the threshold value (S303: No), the detection unit 2b determines that there is no dirt on the surface B1 of the vehicle body B (S306). After S306, the processing from S302 onwards is repeatedly executed.

[0052] Furthermore, the data processing device 2 can perform an optical sensor inspection process in addition to the above. The optical sensor inspection process will be described with reference to Fig. 12. Fig. 12 is a flowchart showing an example of the optical sensor inspection process executed by the data processing device 2 of the embodiment.

[0053] The optical sensor inspection process can be executed, for example, after S202 in FIG. 10 or after S302 in FIG.

[0054] 12, when the amount of change in luminance differs between the open state of the door mirror 7 and the closed state of the door mirror 7 (S401: Yes), the detection unit 2b determines that there is at least one of a scratch and a stain on the surface B1 of the vehicle body B (S402). This is because, if there is a scratch or stain on the surface B1 of the vehicle body B, the relative position of the scratch or stain and the optical sensor 1 changes between the open state and the closed state of the door mirror 7, and therefore it can be determined that the amount of change in luminance differs between the open state and the closed state of the door mirror 7.

[0055] On the other hand, if the amount of luminance change is the same between the open state of the door mirror 7 and the closed state of the door mirror 7 (S401: No), the detection unit 2b determines that there is at least one of a scratch and dirt on the optical sensor 1 (S403). This is because if there is a scratch or dirt on the lens of the optical sensor 1, for example, the relative position of the scratch or dirt and the optical sensor 1 does not change between the open state and the closed state of the door mirror 7, so it can be determined that the amount of luminance change is the same between the open state and the closed state of the door mirror 7.

[0056] <Summary> As described above, the data processing device 2 (vehicle body surface condition detection device) of this embodiment includes an acquisition unit 2a and a detection unit 2b. The acquisition unit 2a acquires luminance information from the optical sensor 1. The optical sensor 1 is mounted on a vehicle C. The luminance information is information related to luminance according to the condition of the surface B1 of the vehicle body B of the vehicle C. The detection unit 2b detects the condition of the surface B1 of the vehicle body B based on the luminance information acquired by the acquisition unit 2a.

[0057] According to this configuration, the state of the surface B1 of the vehicle body B is detected based on the luminance information from the optical sensor 1 mounted on the vehicle C, so there is no need to move the vehicle C to a dedicated facility such as a car wash facility in order to detect the state of the surface B1 of the vehicle C. Therefore, according to the above configuration, it is possible to reduce the effort required to detect the state of the vehicle body B of the vehicle C.

[0058] The luminance information also includes a luminance change amount, which is an amount of change in luminance of the surface B1. The detection unit 2b detects the state of the surface B1 of the vehicle body B based on the luminance change amount.

[0059] According to this configuration, the state of the surface B1 of the vehicle body B can be detected based on the amount of change in luminance.

[0060] Furthermore, the detection unit 2b determines that the surface B1 of the vehicle body B is scratched when the amount of change in luminance is greater than the threshold value.

[0061] According to this configuration, scratches on the surface B1 of the vehicle body B can be detected.

[0062] Moreover, the detection unit 2b determines that the surface B1 of the vehicle body B is dirty when the amount of change in luminance is smaller than the threshold value.

[0063] According to this configuration, dirt on the surface B1 of the vehicle body B can be detected.

[0064] Further, the sensing range D of the optical sensor 1 includes a surface sensing area Da, which is an area of ​​the surface B1, and a peripheral sensing area Db, which is an area around the vehicle C. When there is a difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da, and there is no difference between the amount of luminance change in the peripheral sensing area Db and the threshold value for the peripheral sensing area Db, the detection unit 2b determines that the difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da is caused by the state of the surface B1. When there is a difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da, and there is a difference between the amount of luminance change in the peripheral sensing area Db and the threshold value for the peripheral sensing area Db, the detection unit 2b determines that the difference between the amount of luminance change in the surface sensing area Da and the threshold value for the surface sensing area Da is caused by the brightness around the vehicle C.

[0065] According to this configuration, in detecting the state of the surface B1 of the vehicle body B, erroneous detection due to the brightness around the vehicle C can be suppressed.

[0066] The vehicle C also includes a door mirror 7. The door mirror 7 is connected to the vehicle body B so as to be openable and closable. The optical sensor 1 is provided on the door mirror 7 and moves integrally with the door mirror 7. If the amount of luminance change differs between the open state of the door mirror 7 and the closed state of the door mirror 7, the detection unit 2b determines that there is at least one of a scratch or a stain on the surface B1 of the vehicle body B. If the amount of luminance change is the same between the open state of the door mirror 7 and the closed state of the door mirror 7, the detection unit 2b determines that there is at least one of a scratch or a stain on the optical sensor 1.

[0067] According to this configuration, erroneous detection due to scratches or dirt on the optical sensor 1 in detecting the state of the surface B1 of the vehicle body B can be suppressed.

[0068] A program for causing a computer (such as the data processing device 2) to execute processing for realizing the functions of the vehicle body surface condition detection system S of the embodiment as described above may be provided as a computer program product by being stored in a computer-readable storage medium such as a CD-ROM, a CD-R, a memory card, a DVD (Digital Versatile Disk), or a flexible disk (FD) in an installable or executable format file. The program may also be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The program may also be provided or distributed via a network such as the Internet.

[0069] In the above embodiment, the optical sensor 1 is an event sensor, but is not limited thereto. The optical sensor 1 may be any sensor capable of detecting a change in luminance or the luminance distribution itself in the field of view of the sensor. For example, the optical sensor 1 may be an imaging element that obtains an image (image data) of a predetermined imaging range, and may be, for example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like.

[0070] Although the embodiment of the present invention has been described above, the above embodiment is presented as an example and is not intended to limit the scope of the invention. This new embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. This embodiment and its modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0071] 1, 1L, 1R...optical sensor, 2...data processing device (vehicle body surface condition detection device), 2a...acquisition unit, 2b...detection unit, 7, 7L, 7R...door mirror, B...vehicle body, B1...surface, C...vehicle, D...sensing range, Da...surface sensing area, Db...peripheral sensing area, R, R1 to R4...area.

Claims

1. an acquisition unit that acquires luminance information from an optical sensor that is mounted on a vehicle and detects luminance information related to a surface state of a body of the vehicle; a detection unit that detects a state of the surface based on the luminance information acquired by the acquisition unit; A vehicle body surface condition detection device comprising:

2. the luminance information includes a luminance change amount that is a change amount of the luminance of the surface, The vehicle body surface condition detection device according to claim 1 , wherein the detection unit detects the surface condition based on the amount of change in luminance.

3. The detection unit determines that a scratch is present on the surface when the amount of change in luminance is greater than a threshold value. The vehicle body surface condition detection device according to claim 2.

4. The detection unit determines that there is dirt on the surface when the amount of change in luminance is smaller than a threshold value. The vehicle body surface condition detection device according to claim 2.

5. The sensing range of the optical sensor includes a surface sensing area that is an area of ​​the surface and a surrounding sensing area that is an area around the vehicle, When there is a difference between the amount of luminance change in the surface sensing area and the threshold value for the surface sensing area and there is no difference between the amount of luminance change in the peripheral sensing area and the threshold value for the peripheral sensing area, the detection unit determines that the difference between the amount of luminance change in the surface sensing area and the threshold value for the surface sensing area is caused by the state of the surface, and when there is a difference between the amount of luminance change in the surface sensing area and the threshold value for the surface sensing area and there is a difference between the amount of luminance change in the peripheral sensing area and the threshold value for the peripheral sensing area, the detection unit determines that the difference between the amount of luminance change in the surface sensing area and the threshold value for the surface sensing area is caused by the brightness around the vehicle. The vehicle body surface condition detection device according to claim 2.

6. The vehicle includes a door mirror connected to the vehicle body in an openable and closable manner, the optical sensor is provided on the door mirror and moves integrally with the door mirror, When the amount of change in luminance differs between the open state of the door mirror and the closed state of the door mirror, the detection unit determines that there is at least one of a scratch and a stain on the surface, and when the amount of change in luminance is the same between the open state of the door mirror and the closed state of the door mirror, the detection unit determines that there is at least one of a scratch and a stain on the optical sensor. The vehicle body surface condition detection device according to claim 2.

Images