Measurement device, control device, control method, and program

The measuring device identifies and addresses window deposits based on type, enhancing measurement accuracy by employing a deposit determination and countermeasure system.

JP7579964B2Active Publication Date: 2024-11-08PIONEER IP +1
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023510791
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-03-29
Filing Date
2022-03-10
Publication Date
2024-11-08
Estimated Expiration
2042-03-10

AI Technical Summary

Technical Problem

Existing distance measuring devices, such as lidar, face interference in distance measurement due to deposits on the exit window, requiring appropriate countermeasures based on the type of deposit.

Method used

A measuring device equipped with a deposit determination unit to identify the type of deposit on the transparent member, a countermeasure identifying unit to specify appropriate removal methods, and an output unit to provide information or control signals for removing the deposits.

Benefits of technology

Accurately determines the type of deposit and implements effective countermeasures to remove them, ensuring reliable distance measurements by minimizing interference.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007579964000001
    Figure 0007579964000001
  • Figure 0007579964000002
    Figure 0007579964000002
  • Figure 0007579964000003
    Figure 0007579964000003
Patent Text Reader

Abstract

A measurement device (10) is a device that emits light via a transmissive member (20), and detects reflected light from a target (30). The measurement device (10) comprises an adhered matter determination unit (121), a countermeasure specification unit (122), and an output unit (123). The adhered matter determination unit (121) determines the type of adhered matter adhered to the transmissive member (20). The countermeasure specification unit (122) specifies one or more countermeasures on the basis of the type of the adhered matter. The output unit (123) then outputs information indicating the specified countermeasure or countermeasures.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a measurement device, a control device, a control method, and a program. [Background technology]

[0002] In recent years, distance measurement devices that can be used for automatic driving of automobiles, etc. One example of a distance measurement device is one that measures the distance to a surrounding object by measuring the time it takes for emitted light to be reflected by the object and return.

[0003] In such distance measuring devices, if any deposit appears on the exit window through which light exits, it will affect distance measurement, and therefore, if any deposit appears, it must be removed.

[0004] Patent Document 1 describes monitoring the received light power and operating a window cleaning device when it is necessary to remove dirt or the like from the window portion. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Special Publication No. 2009-503486 Summary of the Invention [Problem to be solved by the invention]

[0006] The appropriate method for removing the deposits varies depending on the type of deposits, so it is necessary to identify the type of deposit and then take appropriate measures.

[0007] One example of a problem to be solved by the present invention is how to identify an appropriate method of dealing with a substance that has adhered to an exit window of a measuring device depending on the type of substance. [Means for solving the problem]

[0008] The invention described in claim 1 is A measuring device that emits light through a transparent member and detects reflected light from an object, an attachment determination unit for determining a type of attachment to the transparent member; A countermeasure specification unit that specifies one or more countermeasures based on the type of the adhesion; and an output unit that outputs information indicating the identified countermeasure. It is a measuring device.

[0009] The invention described in claim 7 is A control device for one or more removal units, the removal unit is provided to remove adhesions from a transparent member of a measuring device that emits light through a transparent member and detects reflected light from an object, an attachment determination unit for determining a type of the attachment on the transparent member; A countermeasure specification unit that specifies one or more countermeasures based on the type of the adhesion; and an output unit that outputs a control signal for controlling one or more of the removal units based on the identified countermeasure. It is a control device.

[0010] The invention described in claim 8 is A method for controlling one or more removal units, comprising: the removal unit is provided to remove adhesions from a transparent member of a measuring device that emits light through a transparent member and detects reflected light from an object, determining a type of the attachment to the transparent member; identifying one or more remedial actions based on the determined type of the deposit; Controlling one or more of the removal units based on the identified countermeasure. It is a control method.

[0011] The invention described in claim 9 is A program for causing a computer to function as the control device according to claim 7. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating a configuration of a measurement device according to a first embodiment. [Diagram 2] FIG. 1 is a diagram illustrating a measurement device according to a first embodiment. [Diagram 3] FIG. 2 is a diagram illustrating in detail the configuration of the measurement device according to the first embodiment. [Figure 4] 2 is a diagram illustrating an example of a hardware configuration of a control unit and an object determination unit according to the first embodiment. FIG. [Diagram 5] 1 is an example of an intensity difference map. [Figure 6] 11 is a diagram showing an example of a waveform of a received signal of internally reflected light when an object is attached to a transparent member; FIG. [Figure 7] 1 is an example of a saturation time map showing the distribution of saturation times for a plurality of emission directions. [Figure 8] FIG. 1 is a diagram illustrating an example of an environment in which a measurement device according to a first embodiment is used. [Figure 9] 5 is a flowchart illustrating a flow in which an object determining unit determines a type of object. [Figure 10] FIG. 11 is a diagram illustrating an example of a trained model used by the object determining unit according to the second embodiment. [Figure 11] FIG. 13 is a diagram illustrating the configuration of a measurement device according to a third embodiment. [Figure 12] FIG. 13 is a diagram illustrating the configuration of a measurement device according to a fourth embodiment. [Figure 13] FIG. 13 is a block diagram illustrating the configuration of a determination device according to a fifth embodiment. [Figure 14] FIG. 13 is a diagram illustrating an example of a hardware configuration of a determination device according to a fifth embodiment. [Figure 15] 13 is a flowchart illustrating the flow of a determination method according to the fifth embodiment. [Figure 16] FIG. 13 is a block diagram illustrating the configuration of a control device according to a sixth embodiment. [Figure 17] 13 is a flowchart illustrating the flow of a control method according to a sixth embodiment. [Figure 18]13 is a diagram showing another example of the waveform of a received signal of internally reflected light when an object is attached to a transparent member. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same components are given the same reference numerals and the description will be omitted as appropriate.

[0014] (First embodiment) FIG. 1 is a diagram illustrating the configuration of a measuring device 10 according to a first embodiment. FIG. 2 is a diagram illustrating the measuring device 10 according to this embodiment. In FIG. 1 and FIG. 2, dashed arrows typically indicate the path of light. The measuring device 10 according to this embodiment is a device that emits light through a transparent member 20 and detects reflected light from an object 30. The measuring device 10 includes a light receiving element 18 and an attachment determination unit 121. The light receiving element 18 receives at least the reflected light reflected by the transparent member 20. The attachment determination unit 121 determines the type of attachment attached to the transparent member 20. This will be described in detail below.

[0015] The measuring device 10 further includes a light-emitting element 14 that outputs light. The light output from the light-emitting element 14 is emitted to the outside of the measuring device 10 mainly via the transparent member 20. However, at least a part of the light output from the light-emitting element 14 becomes internally reflected light that is reflected inside the measuring device 10. The internally reflected light is received by the light-receiving element 18. This internally reflected light also includes light reflected by the transparent member 20. Furthermore, if there is an attachment on the transparent member 20, the internally reflected light includes reflected light caused by the attachment.

[0016] The transparent member 20 is a light-transmitting member that separates the inside and outside of the measuring device. The transparent member 20 is made of, for example, glass or resin. At least one surface of the transparent member 20 is exposed to the space outside the measuring device 10, and dirt, raindrops, and the like may adhere to it. The reflected light caused by the attachment includes, for example, light reflected at the interface between the transparent member 20 and the attachment, light reflected inside the attachment, and light reflected at the interface between the attachment and air. As an example, the attachment determination unit 121 can determine the type of attachment using the result of receiving such reflected light.

[0017] 3 is a diagram illustrating in detail the configuration of the measurement device 10 according to this embodiment. In this diagram, dashed arrows typically indicate the path of light. The configuration of the measurement device 10 will be described in detail with reference to this diagram.

[0018] The measuring device 10 is a device that measures the distance from the measuring device 10 to an object (target 30) within a scanning range 160 based on, for example, the difference between the emission timing of the pulsed light and the reception timing of the reflected light (reflected pulsed light). The pulsed light is, for example, infrared light or other light. The pulsed light is, for example, a laser pulse. The pulsed light output from the light-emitting element 14 included in the measuring device 10 and emitted to the outside of the measuring device 10 through the transparent member 20 is reflected by the object and at least a part of it returns toward the measuring device 10. Then, the reflected light passes through the transparent member 20 again and enters the measuring device 10. The reflected light that enters the measuring device 10 is received by the light-receiving element 18, and the intensity is detected. Here, in the measuring device 10, the time from when the pulsed light is emitted from the light-emitting element 14 to when the reflected light is detected by the light-receiving element 18 is measured. Then, the control unit 120 included in the measuring device 10 calculates the distance between the measuring device 10 and the object using the measured time and the propagation speed of the pulsed light. The measuring device 10 is, for example, a LIDAR (Laser Imaging Detection and Ranging, Laser Illuminated Detection and Ranging or LiDAR (Light Detection and Ranging) device.

[0019] The light-emitting element 14 emits pulsed light. The light-emitting element 14 is, for example, a laser diode. The light-receiving element 18 receives the pulsed light incident on the measurement device 10 and the above-mentioned internally reflected light. The light-receiving element 18 is, for example, a photodiode such as an avalanche photodiode (APD). In this embodiment, an example is described in which the light-receiving element 18 serves both as a light-receiving element for receiving internally reflected light and using it to determine whether there is any adhesion, and as a light-receiving element for receiving reflected light from the target 30 and measuring the distance. However, the light-receiving element for receiving internally reflected light and using it to determine whether there is any adhesion, and the light-receiving element for receiving reflected light from the target 30 and measuring the distance may be provided separately.

[0020] 3, the measurement device 10 further includes a movable mirror 16. The movable mirror 16 is, for example, a MEMS mirror movable along one axis or two axes. By changing the orientation of the reflecting surface of the movable mirror 16, the emission direction of the pulsed light emitted from the measurement device 10 can be changed. When the movable mirror 16 is a MEMS mirror movable along two axes, a predetermined range can be raster scanned with the pulsed light by driving the movable mirror 16 along two axes.

[0021] The control unit 120 generates point cloud data including the measurement results obtained by a plurality of pulsed lights. For example, when raster scanning within a scanning range 160, a line-shaped scan is performed by changing the light emission direction in a first direction 161. Then, by performing a plurality of line-shaped scans while changing the light emission direction in a second direction 162, it is possible to generate point cloud data including a plurality of measurement results within the scanning range 160. In the example shown in this figure, the first direction 161 and the second direction 162 are orthogonal to each other.

[0022] A unit of point cloud data generated by one raster scan is called a frame. When the measurement of one frame is completed, the light emission direction returns to the initial position, and the measurement of the next frame is performed. In this manner, frames are repeatedly generated. In the point cloud data, the distance measured by the pulsed light is associated with information indicating the emission direction of the pulsed light. Alternatively, the point cloud data may include three-dimensional coordinates indicating the reflection point of the pulsed light. The control unit 120 generates the point cloud data using the calculated distance and information indicating the angle of the movable mirror 16 when each pulsed light is emitted. The generated point cloud data may be output to the outside of the measurement device 10, or may be stored in a storage device accessible from the control unit 120.

[0023] In the example shown in the figure, measuring device 10 further includes a holed mirror 15 and a condenser lens 13. The pulsed light output from light-emitting element 14 passes through a hole in holed mirror 15, is reflected by movable mirror 16, and then is emitted from measuring device 10. In addition, the reflected light incident on measuring device 10 is reflected by movable mirror 16 and holed mirror 15, and then is incident on light-receiving element 18 via condenser lens 13. Note that measuring device 10 may further include a collimating lens, a mirror, etc.

[0024] The control unit 120 can control the light emitting element 14, the light receiving element 18, and the movable mirror 16. The control unit 120 also receives a light receiving signal from the light receiving element 18, and calculates the distance from the measuring device 10 to an object within the scanning range 160, as described above. The object determining unit 121 can obtain information necessary for determination via the control unit 120, for example.

[0025] FIG. 4 is a diagram illustrating a hardware configuration of the control unit 120 and the object determining unit 121 according to this embodiment. The object determining unit 121 is implemented using an integrated circuit 80. The control unit 120 is implemented using the integrated circuit 80 and an electronic circuit. The integrated circuit 80 is, for example, an SoC (System On Chip). The electronic circuit includes, for example, a drive circuit 163 for the movable mirror 16, a detection circuit 181 for the light receiving element 18, and a drive circuit 141 for the light emitting element 14. The drive circuit 141 is a circuit for causing the light emitting element 14 to emit light based on a control signal from the integrated circuit 80, and is configured to include, for example, a switching circuit and a capacitive element. The detection circuit 181 includes an IV converter and an amplifier, and outputs a signal indicating the intensity of light detected by the light receiving element 18.

[0026] The integrated circuit 80 has a bus 802, a processor 804, a memory 806, a storage device 808, an input / output interface 810, and a network interface 812. The bus 802 is a data transmission path for the processor 804, the memory 806, the storage device 808, the input / output interface 810, and the network interface 812 to transmit and receive data to and from each other. However, the method of connecting the processor 804 and the like to each other is not limited to bus connection. The processor 804 is an arithmetic processing device realized by using a microprocessor or the like. The memory 806 is a memory realized by using a RAM (Random Access Memory) or the like. The storage device 808 is a storage device realized by using a ROM (Read Only Memory), a flash memory, or the like.

[0027] The input / output interface 810 is an interface for connecting the integrated circuit 80 to peripheral devices. In this figure, the input / output interface 810 is connected to the drive circuit 141 of the light-emitting element 14, the detection circuit 181 of the light-receiving element 18, and the drive circuit 163 of the movable mirror 16.

[0028] The network interface 812 is an interface for connecting the integrated circuit 80 to a communication network. This communication network is, for example, a controller area network (CAN), Ethernet, low voltage differential signaling (LVDS), etc. The method for connecting the network interface 812 to the communication network may be a wireless connection or a wired connection.

[0029] The storage device 808 stores a program module for realizing the functions of the control unit 120 and the object-determining unit 121. The processor 804 reads the program module into the memory 806 and executes it to realize the functions of the control unit 120 and the object-determining unit 121.

[0030] The hardware configuration of the integrated circuit 80 is not limited to the configuration shown in the figure. For example, the program module may be stored in the memory 806. In this case, the integrated circuit 80 does not need to include the storage device 808.

[0031] The process performed by the adhesion determination unit 121 will be described in detail below. When the operation of the measurement device 10 is started, the adhesion determination unit 121 determines the presence or absence of adhesion on the transparent member 20 at predetermined time intervals. Alternatively, the adhesion determination unit 121 determines the presence or absence of adhesion on the transparent member 20 when a predetermined operation is received as a trigger. The adhesion determination unit 121 can determine the presence or absence of adhesion based on the detection result of the light receiving element 18, for example. Then, when the adhesion determination unit 121 determines that there is adhesion on the transparent member 20, it further determines the type of the adhesion. A method for determining the presence or absence of adhesion and a method for determining the type of adhesion will be described in detail below.

[0032] <Determining the presence or absence of adhesions> The object determining unit 121 according to this embodiment can determine the presence or absence of an object based on the magnitude of the internally reflected light. The time from when the light is output from the light emitting element 14 until the internally reflected light is received by the light receiving element 18 is much shorter than the time from when the light reflected from the object 30 is received by the light receiving element 18. Immediately after the light emitting element 14 emits a pulsed light, the light receiving element 18 receives the internally reflected light of the pulsed light. The timing at which the internally reflected light is received is determined depending on the structure of the measuring device 10. Therefore, the light received within a predetermined period from the emission of the pulsed light can be considered as internally reflected light, and can be distinguished from the reflected light from the object 30.

[0033] In the measuring device 10, when measuring one frame, pulsed light is emitted in a plurality of directions in sequence, and the intensity of the internally reflected light for each pulsed light is measured. Then, the adhesion determining unit 121 acquires the received light intensity of the internally reflected light from the light receiving element 18, and generates an intensity map indicating the intensity of the internally reflected light in each emission direction. In addition, an initial intensity map generated in the same manner in advance in an initial state is stored in a storage unit (e.g., the storage device 808) accessible from the adhesion determining unit 121. The initial state refers to a clean state in which there is no adhesion on the transparent member 20. The initial intensity map can be generated, for example, before shipping the measuring device 10. The adhesion determining unit 121 reads and acquires the initial intensity map from the storage unit, and generates an intensity difference map indicating the difference between the generated intensity map and the initial intensity map.

[0034] Next, the attachment determination unit 121 determines whether or not the value of each data point included in this intensity difference map is equal to or greater than a predetermined reference value A. Then, it determines whether or not the proportion of data points that are equal to or greater than the reference value A is equal to or greater than a predetermined proportion B with respect to all data points in the intensity difference map. If the proportion of data points that are equal to or greater than the reference value A is equal to or greater than the predetermined proportion B, the attachment determination unit 121 determines that there is an attachment on the transparent member 20. If the proportion of data points that are equal to or greater than the reference value A is less than the predetermined proportion B, the attachment determination unit 121 determines that there is no attachment on the transparent member 20.

[0035] FIG. 5 is an example of an intensity difference map. When this figure was acquired, the area of ​​the transparent member 20 corresponding to area α1 was wet with water, and the area of ​​the transparent member 20 corresponding to area α2 was dirty with a fingerprint (grease). Furthermore, there was no adhesion in the area of ​​the transparent member 20 corresponding to area β. As can be seen from the example of this figure, in the area with adhesion, the difference from the initial state in the intensity of the internally reflected light is large. Therefore, the presence or absence of adhesion can be determined using the intensity difference map.

[0036] The detected intensity of the internally reflected light varies depending on the measurement conditions, such as the light receiving sensitivity, the emission intensity, the temperature near the light receiving element 18, the presence or absence and the type (e.g., magnification) of a lens attached to the measurement device 10, etc. Therefore, the storage unit may hold a plurality of initial intensity maps associated with the measurement conditions in advance, and the attachment determination unit 121 may select and acquire from among them an initial intensity map that corresponds to the measurement conditions when the attachment determination unit 121 acquired the intensity map of the internally reflected light of the frame.

[0037] <Determining the type of deposit> A method for the adhesion determining unit 121 to determine the type of adhesion (water droplets, dried water droplets, dust or dirt, oil, condensation, snow, etc.) will be described below. The adhesion determining unit 121 can determine the type of adhesion by combining multiple determinations as described below. An example of a flowchart combining multiple determinations is shown in FIG. 9 and will be described in detail later. The adhesion determining unit 121 may also derive a score indicating the likelihood that the adhesion is a specific type of adhesion by each of multiple determinations as described below. In this case, the adhesion determining unit 121 may calculate a total score for each type of adhesion by summing up the derived multiple scores or by calculating a weighted sum of the multiple scores using a predetermined weight for each type of adhesion. The adhesion determining unit 121 can output the type of adhesion with the highest total score as the determination result.

[0038] <<Determination based on saturation time information>> The object determining unit 121 can determine whether the object is moisture or not based on saturation time information indicating the length of time for saturation of the light receiving element 18.

[0039] FIG. 6 is a diagram showing an example of the waveform of a light receiving signal of internally reflected light when an object is attached to the transparent member 20. This diagram shows the waveform of internally reflected light caused by an object attached to the transparent member 20. The waveform shown at the top of this diagram is a waveform when the object is moisture. The waveform shown at the bottom of this diagram is a waveform when the object is something other than moisture, and the first peak is a peak at which internally reflected light is detected. Note that in the waveform at the bottom, the light receiving signal of the reflected light reflected by the object 30 is detected as the second peak.

[0040] 18 is a diagram showing another example of the waveform of the received signal of the internally reflected light when there is an attachment on the transparent member 20. This diagram shows the waveform of the internally reflected light caused by an attachment on the transparent member 20. When the attachment is moisture, the waveform of the received signal of the internally reflected light may be as shown in the example of this diagram.

[0041] As shown in this figure, if the adhesion is moisture, the waveform is subject to saturation for a long period of time. This is thought to be due to the lens effect caused by moisture. By using the length of time that the effect of saturation occurs, it is possible to determine whether the adhesion is moisture or not.

[0042] Examples of the length of time related to saturation that can be used for the determination include times T1, T2, and T3 shown in the figure. In the following, the length of time related to saturation is also simply referred to as the "saturation time." The saturation time is at least one of the times T1, T2, and T3. The saturation time information indicates at least one of the times T1, T2, and T3, and the object determining unit 121 determines whether the object is moisture or not based on the saturation time when it receives reflected light caused by the object.

[0043] The saturation time is, for example, the length of time T1 during which the light receiving element 18 is saturated. The object determination unit 121 determines that the light receiving element 18 is saturated when the light receiving signal output by the light receiving element 18 exceeds a predetermined reference value C, and measures the time T1. The reference value C is, for example, slightly smaller than the saturation level of the light receiving element. Here, the saturation level means the maximum amount of light that the light receiving element 182 can detect without being saturated. Note that a plurality of reference values ​​C associated with measurement conditions are stored in advance in a storage unit accessible from the object determination unit 121, and the object determination unit 121 may select and acquire the reference value C corresponding to the measurement condition when the light receiving signal to be determined was obtained from the plurality of reference values ​​C, and use the reference value C for determination.

[0044] The saturation time is, for example, a length of time T2 that starts from the point when saturation begins in the output waveform of the light receiving element and ends at the point when the slope becomes zero for the first time after saturation. The object determination unit 121 determines the point when saturation begins as the point when the light receiving signal output by the light receiving element 18 exceeds the above-mentioned reference value C after the emission of the pulsed light. The object determination unit 121 also calculates the slope at each point of the waveform, detects the point when the calculated slope becomes zero, and measures the time T2.

[0045] The saturation time is, for example, a length of time T3 starting from the time when saturation starts in the output waveform of the light receiving element 18 and ending at the earlier of the time when the second zero crossing occurs after saturation or the time when the signal converges for the first time after saturation. The object determination unit 121 determines the time when saturation starts when the light receiving signal output by the light receiving element 18 exceeds the above-mentioned reference value C after the emission of the pulsed light. The object determination unit 121 also detects the time when the light receiving signal crosses zero and identifies the time when the signal crosses zero for the second time after saturation. Furthermore, the object determination unit 121 determines that the signal value is in a convergence state when the state in which the signal value is within a predetermined convergence level range continues for a predetermined period of time. Then, when it is determined that the convergence state has occurred, the object determination unit 121 identifies the time when the state started, that is, the time when the signal value went from outside the convergence level range to within the convergence level range, as the time when the signal value converged for the first time after saturation. The convergence level range is a range that includes zero, and the upper limit of the convergence level range is slightly greater than zero, and the lower limit of the convergence level range is slightly less than zero. However, the difference between the upper limit of the convergence level range and zero can be made larger than the difference between the lower limit of the convergence level range and zero. For example, when disturbance light is incident on 10, the light receiving signal may converge to a level greater than zero by the amount of the disturbance light.

[0046] The object determination unit 121 selects the earlier of the second zero crossing point after saturation and the first convergence point after saturation, and measures time T3. Either the second zero crossing point after saturation or the first convergence point after saturation may not exist. In that case, the object determination unit 121 determines the specified one of the second zero crossing point after saturation and the first convergence point after saturation as the end point of T3. In the example of FIG. 18, T2 and T3 are the same.

[0047] The object determining unit 121 determines the type of object based on the saturation time information for each of the multiple emission directions. Specifically, the object determining unit 121 generates saturation time information for each of the internally reflected lights detected in the multiple emission directions for generating a frame. The object determining unit 121 then determines whether or not the saturation times indicated by the saturation time information for the multiple emission directions exceed a predetermined reference value D. Furthermore, when the ratio of the emission directions in which the saturation time exceeds the reference value D exceeds a predetermined ratio E, the object determining unit 121 determines that moisture exists as an object. In other words, when the ratio of the emission directions in which the saturation time exceeds the reference value D exceeds the ratio E among all the emission directions in the frame, the object determining unit 121 determines that moisture exists as an object.

[0048] By using this method, it is possible to determine whether the attached matter is moisture such as water droplets (raindrops), condensation, or snow, or non-moisture such as oil stains, dust, dirt, or dried raindrop marks.

[0049] Also, it can be said that the higher the ratio of emission directions in which the saturation time exceeds the reference value D, the higher the possibility that the attachment is moisture such as water droplets (raindrops), condensation, or snow. Therefore, when calculating the score, the attachment determination unit 121 assigns a higher score to moisture (water droplets, condensation, and snow) as the ratio of emission directions in which the saturation time exceeds the reference value D increases, and assigns a lower score to types of attachment other than moisture as the ratio of emission directions in which the saturation time exceeds the reference value D increases. Alternatively, when the ratio of emission directions in which the saturation time exceeds the reference value D exceeds the ratio E, the attachment determination unit 121 may assign a score of 1 to moisture (water droplets, condensation, and snow) and a score of zero to types of attachment other than moisture.

[0050] In addition, a memory unit accessible from the adhesion determination unit 121 stores multiple reference values ​​D associated with the measurement conditions and types of saturation times (times T1, T2, and T3) in advance, and the adhesion determination unit 121 may select and acquire from the multiple reference values ​​D a reference value D that corresponds to the measurement conditions and the type of saturation time used when the light receiving signal to be determined was obtained, and use this for determination.

[0051] FIG. 7 is an example of a saturation time map showing the distribution of saturation times (time T1) for multiple emission directions. The method for generating a saturation time map will be described later. The saturation time map in this figure and the intensity difference map in FIG. 5 were obtained in the same frame. As shown in FIG. 7, a long saturation time was detected in region α1, which corresponds to the region where water exists, whereas the saturation time remained short in α2, which corresponds to the region that was dirty with grease. In this way, the presence of moisture as an attachment can be accurately detected by using the saturation time.

[0052] <<Judgment based on shape in saturation time map>> When it is determined that the attachment is water, the attachment determination unit 121 generates a map showing the distribution of saturation times and detects the shape of the attachment, thereby determining whether the attachment is a water droplet. Specifically, the attachment determination unit 121 generates a saturation time map showing the distribution of saturation times indicated by saturation time information for multiple emission directions. That is, the saturation time map shows saturation times for multiple emission directions (data points) in a certain frame. Then, an area in the saturation time map where the time indicated by the saturation time information exceeds a predetermined reference value F is extracted. Then, it is determined whether the attachment is a water droplet based on the shape of the extracted area.

[0053] For example, the adhesion determination unit 121 extracts an area consisting of a plurality of data points that are adjacent to each other and have a saturation time that exceeds a reference value F. Then, the adhesion determination unit 121 calculates the circularity of the extracted area using an existing method. It also determines whether the calculated circularity exceeds a predetermined reference value G. If there is an area where the circularity exceeds the reference value G, the adhesion determination unit 121 determines that water droplets are present as adhesions.

[0054] Furthermore, the adhesion determination unit 121 may determine whether the adhesion is a water droplet based on the size of the extracted region. This is because water droplets are considered to flow off when they become large enough. For example, the adhesion determination unit 121 calculates the circle-equivalent diameter of the extracted region using an existing method. Then, if there is a region whose circularity exceeds a reference value G, it determines whether the circle-equivalent diameter of the region is equal to or smaller than a predetermined reference value H. Then, if the circle-equivalent diameter of the region is equal to or smaller than the predetermined reference value H, the adhesion determination unit 121 determines that there is a water droplet as the adhesion.

[0055] Furthermore, when calculating the score, the adhesion determination unit 121 assigns a higher score to water droplets as the calculated circularity becomes higher, and assigns a lower score to types of adhesion other than water droplets as the calculated circularity becomes higher. Alternatively, when there is an area where the circularity exceeds the reference value G, the adhesion determination unit 121 may assign a score of 1 to water droplets and a score of zero to types of adhesion other than water droplets.

[0056] In addition, a storage unit accessible from the adhesion determination unit 121 may hold a plurality of reference values ​​F associated with the measurement conditions, and the adhesion determination unit 121 may select and acquire the reference value F corresponding to the measurement conditions when the light receiving signal to be determined was obtained from the plurality of reference values ​​F, and use it for the determination. In addition, a storage unit accessible from the adhesion determination unit 121 may hold a plurality of reference values ​​H associated with the measurement conditions, and the adhesion determination unit 121 may select and acquire the reference value H corresponding to the measurement conditions when the light receiving signal to be determined was obtained from the plurality of reference values ​​H, and use it for the determination. For example, the size at which water droplets are detected depends on the magnification of the lens provided in the measurement device 10. Therefore, the reference value H related to the circle equivalent diameter can be set according to the magnification of the lens.

[0057] When the object determining unit 121 does not determine that water droplets exist as the object, it may determine that the object is dew condensation or snow.

[0058] <<Judgment based on shape in intensity difference map>> The adhesion determination unit 121 can determine whether the adhesion is a water droplet or a dried water droplet mark by detecting the shape of the adhesion using the intensity difference map described above. Specifically, the adhesion determination unit 121 determines whether the value of each data point included in the intensity difference map is equal to or greater than a predetermined reference value J. Then, it extracts an area where the value exceeds the reference value J. Then, it determines whether the adhesion is a water droplet or a dried water droplet mark based on the shape of the extracted area.

[0059] For example, the adhesion determining unit 121 extracts an area consisting of a plurality of data points that are adjacent to each other and whose values ​​exceed a reference value J. Then, the circularity of the extracted area is calculated using an existing method. It is also determined whether the calculated circularity exceeds a predetermined reference value N. If an area exists where the circularity exceeds the reference value N, the adhesion determining unit 121 determines that water droplets or dried water droplet marks are present as the adhesion. Note that if the adhesion is a dried water droplet mark, the extracted area may be an area that indicates the outer edge of a circle.

[0060] Furthermore, the adhesion determination unit 121 may determine whether the adhesion is a water droplet or a dried trace of a water droplet, further based on the size of the extracted region. For example, the adhesion determination unit 121 calculates the circle-equivalent diameter of the extracted region using an existing method. Then, if there is a region whose circularity exceeds a reference value N, it determines whether the circle-equivalent diameter of the region is equal to or smaller than a predetermined reference value P. Then, if the circle-equivalent diameter of the region is equal to or smaller than the predetermined reference value P, the adhesion determination unit 121 determines that there is a water droplet or a water droplet as the adhesion.

[0061] Furthermore, when calculating the scores, the adhesion determination unit 121 assigns a higher score to water droplets and dried water droplet marks as the calculated circularity becomes higher, and assigns a lower score to types of adhesion that are neither water droplets nor dried water droplet marks as the calculated circularity becomes higher. Alternatively, when there is an area where the circularity exceeds the reference value N, the adhesion determination unit 121 may assign a score of 1 to water droplets and dried water droplet marks, and assign a score of zero to types of adhesion that are neither water droplets nor dried water droplet marks.

[0062] Note that a plurality of reference values ​​J associated with the measurement conditions are stored in advance in a memory unit accessible from the adhesion determination unit 121, and the adhesion determination unit 121 may select and acquire the reference value J corresponding to the measurement conditions under which the light receiving signal to be determined was obtained from among the plurality of reference values ​​J, and use the selected reference value J for the determination.

[0063] The method of determining the shape in the intensity difference map and the method of determining the shape in the saturation time map may be different from each other.

[0064] When the adhering matter determining unit 121 does not determine that there are traces of dried water droplets as the adhering matter, it may determine that the adhering matter is dew condensation, snow, dust, dirt, dew condensation, or oil.

[0065] <<Judgment by temperature>> The attachment determining unit 121 can determine whether the attachment is a water droplet or not based on at least one of the temperature of the transmitting member 20 and the outside air temperature.

[0066] 8 is a diagram illustrating an example of a usage environment of the measuring device 10 according to this embodiment. The measuring device 10 according to this embodiment can acquire at least one of the temperature of the transparent member 20 and the outside air temperature of the measuring device 10 from the temperature sensor 210. Note that the temperature sensor 210 may be included in the measuring device 10. In particular, when the temperature sensor 210 measures the temperature of the transparent member 20, it is preferable that the temperature sensor 210 is included in the measuring device 10.

[0067] For example, when the value obtained by subtracting the outside air temperature from the temperature of the transparent member 20 is equal to or lower than a predetermined reference value K, the adhesion determining unit 121 determines that the adhesion is condensation. When at least one of the temperature of the transparent member 20 and the outside air temperature is equal to or lower than a predetermined reference value L, the adhesion determining unit 121 determines that the adhesion is snow.

[0068] Furthermore, the attachment determination unit 121 can calculate the scores as follows. For example, when the value obtained by subtracting the outside air temperature from the temperature of the transparent member 20 is equal to or lower than a predetermined reference value K, the attachment determination unit 121 assigns a score of 1 to condensation and assigns a score of zero to types of attachment other than condensation. For example, when at least one of the temperature of the transparent member 20 and the outside air temperature is equal to or lower than a predetermined reference value L, the attachment determination unit 121 assigns a score of 1 to snow and assigns a score of zero to types of attachment other than snow.

[0069] <<Determination based on the intensity of reflected light from the target>> The object determining unit 121 can determine whether the object is a water droplet or not based on the light intensity of the reflected light from the target 30. This is because the degree to which the object blocks light varies depending on the type of object. The control unit 120 generates a light intensity map indicating the light intensity when the reflected light from the target 30 is received for each emission direction for each frame.

[0070] The object determining unit 121 identifies an object region where there is a high possibility that an object exists based on the above-mentioned saturation time map or intensity difference map. The object region can be identified as an area in the saturation time map where the time indicated by the saturation time information exceeds a predetermined reference value F. Alternatively, the object region can be identified as an area in the intensity difference map where the value of a data point exceeds a reference value J.

[0071] Next, the attachment determination unit 121 extracts the light receiving intensity of the reflected light from the target 30 in each emission direction in the attachment area from the light receiving intensity map. Then, calculates the average value of those intensities. Meanwhile, an initial light receiving intensity map indicating the light receiving intensity in a state where there is no attachment is stored in a storage unit accessible from the attachment determination unit 121. The attachment determination unit 121 extracts the light receiving intensity corresponding to each emission direction in the attachment area from the initial light receiving intensity map. Then, calculates the average value of those intensities. Next, the attachment determination unit 121 calculates the difference of the calculated average values ​​(the difference between the average value obtained from the light receiving intensity map and the average value obtained from the initial light receiving intensity map) and determines whether the calculated difference is equal to or greater than a reference value M1. If the calculated difference is equal to or greater than the reference value M1, the attachment determination unit 121 determines that the attachment is snow. If the calculated difference is less than the reference value M1 and equal to or greater than the reference value M2, the attachment determination unit 121 determines that the attachment is any one of dust, dirt, water droplets, and condensation. If the calculated difference is less than the reference value M2, the adhesion determination unit 121 determines that the adhesion is a dried water droplet or oil. Note that the reference value M1 is greater than the reference value M2. Furthermore, in cases where it is sufficient to distinguish between two types of adhesion, the adhesion determination unit 121 may make a determination using only one of the reference values ​​M1 and M2.

[0072] Furthermore, the adhesion determination unit 121 can calculate the scores as follows. For example, when the calculated difference is equal to or greater than the reference value M1, the adhesion determination unit 121 assigns a score of 1 to snow and assigns a score of zero to adhesion types other than snow. For example, when the calculated difference is less than the reference value M1 and equal to or greater than the reference value M2, the adhesion determination unit 121 assigns a score of 1 to dust, dirt, water droplets, and condensation, and assigns a score of zero to adhesion types that are neither dust, dirt, water droplets, nor condensation. For example, when the calculated difference is less than the reference value M2, the adhesion determination unit 121 assigns a score of 1 to dried water droplets and oil, and assigns a score of zero to adhesion types that are neither dried water droplets nor oil.

[0073] Note that the storage unit may hold a plurality of initial light receiving intensity maps associated with the measurement conditions in advance, and the object determining unit 121 may select and acquire from among them an initial light receiving intensity map that corresponds to the measurement conditions when the object determining unit 121 acquired the light receiving intensity map. Also, a plurality of pairs of reference values ​​M1 and M2 associated with the measurement conditions may be held in advance in a storage unit accessible from the object determining unit 121, and the object determining unit 121 may select and acquire from among these plurality of pairs a pair that corresponds to the measurement conditions when the object determining unit 121 acquired the light receiving intensity map to be determined, and use the pair for determination.

[0074] <<Determination based on the correlation between the speed of a moving object and the amount of attached matter>> The adhesion determining unit 121 can determine the likelihood that the adhesion is water droplets based on the strength of correlation between the speed of the moving body and the amount of adhesion. For example, assume that the measuring device 10 is attached to a moving body such as a vehicle or a motorcycle. When raindrops adhere to the transparent member 20 of the measuring device 10, the amount of raindrops adhered increases on the surface facing the moving direction of the moving body as the speed of the moving body increases. Therefore, it can be said that the stronger the correlation between the component of the speed of the moving body in the direction toward the transparent member 20 and the amount of adhesion, the more likely it is that the adhesion is water droplets.

[0075] Specifically, the adhesion determination unit 121 can perform the following process. The adhesion determination unit 121 acquires the speed of the moving object from a sensor provided on the moving object. The storage unit also holds information indicating the mounting direction of the measuring device 10 relative to the moving object in advance, and the adhesion determination unit 121 acquires the information indicating the mounting direction of the measuring device 10 from the storage unit. The adhesion determination unit 121 then calculates the component of the speed of the moving object in the direction toward the transparent member 20 (hereinafter referred to as the "opposing component") using the speed of the moving object and the information indicating the mounting direction of the measuring device 10. The adhesion determination unit 121 also determines whether the value of each data point included in the intensity difference map described above is equal to or greater than a predetermined reference value J. Then, the adhesion determination unit 121 counts the number of data points equal to or greater than the reference value J. Then, the adhesion determination unit 121 calculates the degree of correlation between the number of data points equal to or greater than the reference value J and the opposing component at the time when the intensity difference map was obtained.

[0076] Specifically, the object determining unit 121 generates a plurality of pairs linking the number of data points whose values ​​are equal to or greater than the reference value J in the intensity difference map with the opposite component at the time the intensity difference map was obtained. The plurality of pairs are generated, for example, for an intensity difference map obtained at a predetermined time interval. Then, the object determining unit 121 calculates a correlation coefficient between the number of data points whose values ​​are equal to or greater than the reference value J and the opposite component using the data of the plurality of pairs. The object determining unit 121 determines that the object is more likely to be water droplets as the obtained correlation coefficient increases. That is, the object determining unit 121 assigns a higher score to water droplets as the obtained correlation coefficient increases, and assigns a lower score to types of object other than water droplets as the obtained correlation coefficient increases.

[0077] The object determining unit 121 according to the present embodiment determines the type of object based on a rule that uses the above-mentioned multiple determinations. In particular, it is preferable that the object determining unit 121 determines the type of object based on a rule that uses at least saturation time information.

[0078] FIG. 9 is a flow chart illustrating a flow of the adhesion determination unit 121 determining the type of adhesion. In the example of this figure, when the adhesion determination unit 121 determines the type of adhesion, first, in S102, the adhesion determination unit 121 performs a determination based on the shape in the intensity difference map described above. Then, if the circularity of the shape of the adhesion in the intensity difference map is equal to or greater than the reference value N (Y in S102), the adhesion determination unit 121 performs a determination based on the shape in the saturation time map described above in S113. If the circularity of the shape of the adhesion in the saturation time map is equal to or greater than the reference value G (Y in S113), the adhesion determination unit 121 determines that the adhesion is a water droplet in S112 (S112). If the circularity of the shape of the adhesion in the saturation time map is not equal to or greater than the reference value G (N in S113), the adhesion determination unit 121 determines that the adhesion is a dried trace of a water droplet in S109 (S109).

[0079] On the other hand, if the circularity of the shape of the adhesion in the intensity difference map is not equal to or greater than the reference value N (N in S102), then the adhesion determination unit 121 performs a determination based on the above-mentioned saturation time information in S101. Then, if the rate at which the saturation time exceeds the reference value D does not exceed a predetermined rate E (N in S101), the adhesion determination unit 121 determines that the adhesion is not water, and then performs the process of S103.

[0080] In S103, the adhesion determination unit 121 performs a determination based on the intensity of reflected light from the object described above. If the difference in the average values ​​of the received light intensities is equal to or greater than the reference value M2 (Y in S103), the adhesion determination unit 121 determines that the adhesion is dust or dirt (S104). On the other hand, if the difference in the average values ​​of the received light intensities is less than the reference value M2 (N in S103), the adhesion determination unit 121 determines that the adhesion is oil (S110).

[0081] On the other hand, in S101, if the ratio of the saturation time exceeding the reference value D exceeds the predetermined ratio E (Y in S101), the adhesion determination unit 121 determines that the adhesion is moisture and then performs the process of S105. In S105, the adhesion determination unit 121 performs the above-mentioned temperature-based determination. If the value obtained by subtracting the outside air temperature from the temperature of the transparent member 20 is equal to or lower than the reference value K (Y in S105), the adhesion determination unit 121 determines that the adhesion is condensation (S106). If the value obtained by subtracting the outside air temperature from the temperature of the transparent member 20 exceeds the reference value K (N in S105), the adhesion determination unit 121 then determines whether the outside air temperature is equal to or lower than the reference value L (S107). If the outside air temperature is equal to or lower than the reference value L (Y in S107), the adhesion determination unit 121 determines that the adhesion is snow (S108). If the outside air temperature exceeds the reference value L (N in S107), the object determining unit 121 determines that the object is a water droplet (S111).

[0082] The object determining unit 121 is not limited to the example shown in FIG. 9, and may identify the type of object by combining one or more of the above-mentioned determination methods and other determination methods.

[0083] Furthermore, the measuring device 10 according to this embodiment can output information indicating the determined type of adhering matter, for example, as a display on a display device or as a sound.

[0084] As described above, according to this embodiment, the adhesion determination unit 121 can accurately determine the type of adhesion on the transparent member 20 by using, for example, saturation time information indicating the length of time related to saturation of the light receiving element 18.

[0085] Second embodiment 10 is a diagram illustrating an example of a trained model 40 used by the object-determining unit 121 according to the second embodiment. The measuring device 10 according to this embodiment is the same as the measuring device 10 according to the first embodiment, except that the object-determining unit 121 performs determination using a trained model 40 based on machine learning. This will be described in detail below.

[0086] The object determination unit 121 according to the present embodiment acquires the trained model 40 by reading it from a storage unit accessible from the object determination unit 121. The object determination unit 121 inputs input data to the model 40 and obtains output data of the model 40. The input data of the model 40 includes, for example, saturation time information. The input data of the model 40 includes, for example, one or more maps showing the distribution of the detection results in a plurality of measurement directions. Examples of the maps include the intensity map, the intensity difference map, the saturation time map (saturation time is T1), the saturation time map (saturation time is T2), the saturation time map (saturation time is T3), and the received light intensity map. The input data of the model 40 may further include information showing the measurement conditions when each map was obtained. The output data of the model 40 is information showing the accuracy of each of a plurality of types of object. This accuracy shows, for example, the likelihood that the object of that type is attached to the transparent member 20.

[0087] The trained model 40 includes a neural network 410. The trained model 40 is a model that has been machine-learned in advance using a plurality of training data. The training data is data that associates one or more maps with information indicating the type of one or more objects that were actually attached when the map was obtained.

[0088] The object determining unit 121 generates one or more maps based on the detection result of the light receiving element 18 in order to determine the type of object. The generated one or more maps are then input as input data to the model 40 to obtain output data from the model 40. The object determining unit 121 outputs, for example, the object type with the highest accuracy in the obtained output data as the determination result. Alternatively, the object determining unit 121 may output, as the determination result, one or more object types with accuracy indicated in the obtained output data that is higher than a predetermined value.

[0089] The object determining unit 121 can accurately determine the type of object by using such a model 40. The object determining unit 121 may determine the type of object by combining the rule-based determination as described in the first embodiment and the determination using the model 40.

[0090] According to this embodiment, the same actions and effects as those of the first embodiment can be obtained.

[0091] (Third embodiment) 11 is a diagram illustrating the configuration of a measurement device 10 according to a third embodiment. In this figure, the dashed arrows indicate the paths of light. The measurement device 10 according to this embodiment is the same as the measurement device 10 according to the first or second embodiment, except for the points described below.

[0092] The measuring device 10 according to this embodiment is a device that emits light through a transparent member 20 and detects reflected light from an object 30. The measuring device 10 includes an object determining unit 121, a countermeasure specifying unit 122, and an output unit 123. The object determining unit 121 determines the type of object attached to the transparent member 20. The countermeasure specifying unit 122 specifies one or more countermeasures based on the type of object. Then, the output unit 123 outputs information indicating the specified countermeasures. This will be described in detail below.

[0093] The adhesion determination unit 121 according to this embodiment is the same as the adhesion determination unit 121 described in the first or second embodiment. The countermeasure specification unit 122 acquires information indicating the determination result from the adhesion determination unit 121. A storage unit accessible from the countermeasure specification unit 122 holds countermeasure information in which the type of adhesion and the countermeasure are associated in advance. The countermeasure information is, for example, a table indicating the correspondence between the type of adhesion and the countermeasure. The countermeasure specification unit 122 reads out the countermeasure information from this storage unit and extracts the countermeasure corresponding to the determination result of the adhesion determination unit 121. Note that the adhesion determination unit 121 may specify multiple countermeasures for one type of adhesion. That is, in the countermeasure information, multiple countermeasures may be associated with one type of adhesion.

[0094] Next, the output unit 123 according to this embodiment outputs information indicating the countermeasure to notify the user of the identified countermeasure. For example, the output unit 123 outputs information for displaying, for example, "Please wipe the exit window with a cloth," on a display device connected to the measuring device 10. Alternatively, the output unit 123 outputs information for outputting, for example, a sound such as "Please wipe the exit window with a cloth," to a speaker connected to the measuring device 10.

[0095] The relationship between the type of adhesion and the countermeasure will be described below. For example, when the adhesion determination unit 121 determines that the adhesion is at least one of water droplets, condensation, and snow, the countermeasure specification unit 122 specifies at least heating with a heater as the countermeasure. However, when the adhesion determination unit 121 determines that the adhesion is moisture, the countermeasure specification unit 122 may specify at least heating with a heater as the countermeasure.

[0096] The heater is provided to heat the transparent member 20, and the moisture adhering to the transparent member 20 can be evaporated by heating. In order to remove water droplets and the like with the heater, it is important to start heating when the amount of moisture is small, such as when it starts to rain. If the amount of moisture is large, the moisture may not be efficiently removed by heating. Therefore, it is important for the adhering matter determining unit 121 in the measuring device 10 to quickly determine the type of adhering matter on the transparent member 20 and take appropriate action.

[0097] When the adhesion determination unit 121 determines that the adhesion is a water droplet, the countermeasure specification unit 122 may specify at least one of a heater, removal by air, a wiper, and a water shower as the countermeasure. When the adhesion determination unit 121 determines that the adhesion is snow, the countermeasure specification unit 122 may specify at least one of a heater and a dissolving liquid shower as the countermeasure.

[0098] For example, when the adhesion determining unit 121 determines that the adhesion is at least one of dust and dirt, the countermeasure specifying unit 122 specifies removal by air as the countermeasure. When dust and dirt adhere to the transparent member 20, wiping it off with a wiper or cloth may damage the transparent member 20. Therefore, it is preferable to remove the dust and dirt with air using a compressor or blower.

[0099] When the adhering matter determining section 121 determines that the adhering matter is at least one of dust and dirt, the countermeasure specifying section 122 may specify at least one of removal by air and use of an ionizer as the countermeasure.

[0100] The countermeasure specification unit 122 may further specify a countermeasure that should not be performed for the type of adhesion. In this case, the countermeasure information further associates the countermeasure that should not be performed for the type of adhesion. The countermeasure specification unit 122 reads out the countermeasure information and extracts a countermeasure that should not be performed corresponding to the judgment result of the adhesion judgment unit 121. For example, when the adhesion judgment unit 121 judges that the adhesion is at least one of dust and dirt, the countermeasure specification unit 122 specifies wiping as a countermeasure that should not be performed. The output unit 123 can further output information for notifying the countermeasure that should not be performed on a display device or speaker connected to the measurement device 10.

[0101] For example, when the adhesion determining unit 121 determines that the adhesion is dirt other than water, the countermeasure specifying unit 122 specifies wiping or cleaning with at least one of liquid agents as the countermeasure. The dirt other than water is, for example, oil or dried water droplets.

[0102] When the adhesion determining unit 121 determines that the adhesion is a dried trace of water droplets, the countermeasure specifying unit 122 may specify at least one of a water shower, cleaning with a liquid agent, and wiping with a wet cloth as the countermeasure. When the adhesion determining unit 121 determines that the adhesion is oil, the countermeasure specifying unit 122 may specify at least one of wiping as the countermeasure.

[0103] The countermeasure identification unit 122 and the output unit 123 according to this embodiment are realized using an integrated circuit 80 as shown in Fig. 4. The storage device 808 further stores program modules for realizing the functions of the countermeasure identification unit 122 and the output unit 123. The processor 804 reads out these program modules into the memory 806 and executes them to realize the functions of the countermeasure identification unit 122 and the output unit 123.

[0104] According to this embodiment, the same actions and effects as those of the first embodiment can be obtained. In addition, the countermeasure specification unit 122 specifies one or more countermeasures based on the type of the attached matter. Therefore, the user can easily know the appropriate countermeasure.

[0105] (Fourth embodiment) 12 is a diagram illustrating the configuration of a measurement device 10 according to a fourth embodiment. In this figure, the dashed arrows indicate the paths of light. The measurement device 10 according to this embodiment is the same as the measurement device 10 according to the third embodiment, except for the points described below.

[0106] The measuring device 10 according to this embodiment further includes one or more removal units 22. The output unit 123 according to this embodiment outputs a control signal for controlling one or more removal units 22 based on the identified countermeasure. That is, the output unit 123 outputs a control signal for controlling the removal unit 22 corresponding to the countermeasure as information indicating the countermeasure. This will be described in detail below.

[0107] Examples of the removal unit 22 include a heater, a dryer, a compressor, a blower, a water shower, a dissolving liquid shower, a liquid agent ejector, a wiper, and an ionizer. The removal unit 22 is provided to remove adhesions from the transmitting member 20.

[0108] For example, when the countermeasure specified by the countermeasure specifying unit 122 is heating by a heater, the output unit 123 outputs a control signal for driving at least one of a heater and a dryer. When the countermeasure specified by the countermeasure specifying unit 122 is removal by air, the output unit 123 outputs a control signal for driving at least one of a compressor and a blower. When the countermeasure specified by the countermeasure specifying unit 122 is a dissolving liquid shower, the output unit 123 outputs a control signal for driving the dissolving liquid shower. When the countermeasure specified by the countermeasure specifying unit 122 is a water shower, the output unit 123 outputs a control signal for driving the water shower. When the countermeasure specified by the countermeasure specifying unit 122 is an ionizer, the output unit 123 outputs a control signal for driving the ionizer. When the countermeasure specified by the countermeasure specifying unit 122 is wiping, the output unit 123 outputs a control signal for driving a wiper. When the countermeasure identified by the countermeasure identifying unit 122 is cleaning with a liquid agent, the output unit 123 outputs a control signal for driving a liquid agent ejector.

[0109] The removal unit 22 is driven by the control signal output from the output unit 123, and the adherent matter on the transmitting member 20 is removed.

[0110] When the removal unit 22 corresponding to the countermeasure identified by the countermeasure identification unit 122 does not exist as a control target (for example, wiping with a cloth), the output unit 123 may output information to a display device or speaker to notify the user to take the countermeasure, as described in the third embodiment.

[0111] If the countermeasure specification unit 122 further specifies a countermeasure that should not be performed, the output unit 123 does not drive the removal unit 22 corresponding to that countermeasure. For example, if the adhesion determination unit 121 specifies water droplets and dust as adhesions, the output unit 123 does not drive the wiper, but removes the water droplets by prioritizing other countermeasures.

[0112] According to this embodiment, the same action and effect as in the first embodiment can be obtained. In addition, the output unit 123 according to this embodiment outputs a control signal for controlling one or more removers 22 based on the identified countermeasure. Therefore, the deposit can be appropriately removed.

[0113] Fifth embodiment 13 is a block diagram illustrating the configuration of a determination device 50 according to a fifth embodiment. The determination device 50 according to this embodiment is a device for determining the type of attachment attached to the transparent member 20 of the measuring device 10 that emits light through the transparent member 20 and detects reflected light from the target 30. The measuring device 10 includes at least a light receiving element 18 that receives the reflected light reflected by the transparent member 20. This will be described in detail below.

[0114] The measuring device 10 according to this embodiment is the same as the measuring device 10 according to the first embodiment, except that it does not include the adhesion determination unit 121. The determination device 50 according to this embodiment acquires information necessary for determination from the measuring device 10 and performs determination. The determination device 50 includes an adhesion determination unit 510. The adhesion determination unit 510 performs the same process as the adhesion determination unit 121 according to the first or second embodiment.

[0115] For example, the determination device 50 acquires information indicating the light receiving result of the light receiving element 18 from the measurement device 10. Then, the adhesion determination unit 510 determines whether the adhesion is moisture or not based on saturation time information indicating the length of time related to saturation of the light receiving element 18.

[0116] 14 is a diagram illustrating a hardware configuration of the determination device 50 according to this embodiment. The determination device 50 is implemented using an integrated circuit 90. The integrated circuit 90 is, for example, a SoC (System On Chip).

[0117] The integrated circuit 90 has a bus 902, a processor 904, a memory 906, a storage device 908, an input / output interface 910, and a network interface 912. The bus 902 is a data transmission path for the processor 904, the memory 906, the storage device 908, the input / output interface 910, and the network interface 912 to transmit and receive data to and from each other. However, the method of connecting the processor 904 and the like to each other is not limited to bus connection. The processor 904 is an arithmetic processing device realized by using a microprocessor or the like. The memory 906 is a memory realized by using a RAM (Random Access Memory) or the like. The storage device 908 is a storage device realized by using a ROM (Read Only Memory), a flash memory, or the like.

[0118] The input / output interface 910 is an interface for connecting the integrated circuit 90 to peripheral devices. The input / output interface 910 is connected to the measuring device 10.

[0119] The network interface 912 is an interface for connecting the integrated circuit 90 to a communication network. This communication network is, for example, a CAN (Controller Area Network) communication network. The method for connecting the network interface 912 to the communication network may be a wireless connection or a wired connection.

[0120] The storage device 908 stores a program module for implementing the function of the object-determining unit 510. The processor 904 implements the function of the object-determining unit 510 by reading the program module into the memory 906 and executing it.

[0121] The hardware configuration of the integrated circuit 90 is not limited to the configuration shown in the figure. For example, the program module may be stored in the memory 906. In this case, the integrated circuit 90 does not need to include the storage device 908.

[0122] 15 is a flowchart illustrating the flow of the determination method according to this embodiment. The determination method according to this embodiment is a method executed by a computer. The determination method according to this embodiment is a method for determining the type of attachment attached to the transparent member 20 of the measuring device 10 that emits light through the transparent member 20 and detects reflected light from the target 30. The measuring device 10 includes at least a light receiving element 18 that receives the reflected light reflected by the transparent member 20.

[0123] In the determination method according to the present embodiment, it is determined whether the adhering matter is moisture or not based on, for example, saturation time information indicating the length of time related to saturation of the light receiving element 18 (S510).

[0124] According to this embodiment, the same actions and effects as those of the first embodiment can be obtained.

[0125] Sixth embodiment FIG. 16 is a block diagram illustrating the configuration of a control device 60 according to a sixth embodiment. The control device 60 according to this embodiment is a device that controls one or more removers 22. The remover 22 is provided to remove an attachment on the transparent member 20 of the measurement device 10 that emits light through the transparent member 20 and detects reflected light from the target 30. The control device 60 includes an attachment determination unit 610, a countermeasure specification unit 620, and an output unit 630. The attachment determination unit 610 determines the type of attachment on the transparent member 20. The countermeasure specification unit 620 specifies one or more countermeasures based on the type of attachment. The output unit 630 outputs a control signal that controls one or more removers 22 based on the specified countermeasures. This will be described in detail below.

[0126] The measuring device 10 according to this embodiment is the same as the measuring device 10 according to the fourth embodiment, except that it does not include the adhesion determining unit 121, the countermeasure specifying unit 122, and the output unit 123. The removal unit 22 is the same as the removal unit 22 described in the fourth embodiment. However, the removal unit 22 may be included in the measuring device 10, or may be a device provided separately from the measuring device 10. The adhesion determining unit 610, the countermeasure specifying unit 620, and the output unit 630 perform the same processes as the adhesion determining unit 121, the countermeasure specifying unit 122, and the output unit 123 according to the fourth embodiment, respectively.

[0127] The control device 60 is implemented using an integrated circuit 90 similar to that shown in Fig. 14. The input / output interface 910 is connected to the measuring device 10 or the removal unit 22. The storage device 908 stores program modules for realizing the functions of the adhesion determining unit 610, the countermeasure specifying unit 620, and the output unit 630. The processor 904 reads the program modules into the memory 906 and executes them to realize the functions of the adhesion determining unit 610, the countermeasure specifying unit 620, and the output unit 630.

[0128] FIG. 17 is a flow chart illustrating the flow of the control method according to this embodiment. The control method according to this embodiment is a method executed by a computer. The control method according to this embodiment is a method for controlling one or more removal units 22. The removal unit 22 is provided to remove adhesions on the transparent member 20 of the measurement device 10 that emits light through the transparent member 20 and detects reflected light from the target 30. In the control method according to this embodiment, first, the type of adhesion on the transparent member 20 is determined (S610). Next, one or more measures are identified based on the determined type of adhesion (S620). Then, one or more removal units 22 are controlled based on the identified measures (S630).

[0129] According to this embodiment, the same actions and effects as those of the fourth embodiment can be obtained.

[0130] Although the embodiment and examples have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted. Below, examples of reference forms are given. 1. A measuring device that emits light through a transparent member and detects reflected light from an object, an attachment determination unit for determining a type of attachment to the transparent member; A countermeasure specification unit that specifies one or more countermeasures based on the type of the adhesion; and an output unit that outputs information indicating the identified countermeasure. Measuring equipment. 2. In the measuring device according to 1., When the adhesion determining unit determines that the adhesion is at least one of water droplets, condensation, and snow, the countermeasure specifying unit specifies at least heating by a heater as the countermeasure. Measuring equipment. 3. In the measuring device according to 1. or 2., When the adhering matter determining unit determines that the adhering matter is at least one of dust and dirt, the countermeasure specifying unit specifies removal by air as the countermeasure. Measuring equipment. 4. In the measuring device according to any one of 1. to 3., When the adhering matter determining unit determines that the adhering matter is dirt other than water, the countermeasure specifying unit specifies at least one of wiping and cleaning with a liquid agent as the countermeasure. Measuring equipment. 5. In the measuring device according to any one of 1. to 4., Further comprising one or more removal units, The output unit outputs a control signal for controlling one or more of the removal units based on the identified countermeasure. Measuring equipment. 6. In the measuring device according to any one of 1. to 5., The output unit outputs, as the information indicating the countermeasure, information for issuing a notification urging the user to implement the identified countermeasure. Measuring equipment. 7. A control device for one or more removal units, comprising: the removal unit is provided to remove adhesions from a transparent member of a measuring device that emits light through a transparent member and detects reflected light from an object, an attachment determination unit for determining a type of the attachment on the transparent member; A countermeasure specification unit that specifies one or more countermeasures based on the type of the adhesion; and an output unit that outputs a control signal for controlling one or more of the removal units based on the identified countermeasure. Control device. 8. A method for controlling one or more removal units, comprising: the removal unit is provided to remove adhesions from a transparent member of a measuring device that emits light through a transparent member and detects reflected light from an object, determining a type of the attachment to the transparent member; identifying one or more remedial actions based on the determined type of the deposit; Controlling one or more of the removal units based on the identified countermeasure. Control methods. 9. A program for causing a computer to function as the control device described in 7.

[0131] This application claims priority based on Japanese Patent Application No. 2021-055744, filed on March 29, 2021, the disclosure of which is incorporated herein in its entirety. [Explanation of symbols]

[0132] 10. Measuring Equipment 14 Light emitting element 18 Photodetector 20 Transparent material 22 Removal part 30 Target 40 Models 50 Judgment device 60 Control device 80 Integrated Circuits 90 Integrated Circuits 120 Control section 121 Adhesion determination unit 122 Countermeasure Identification Section 123 Output section 210 Temperature Sensor 410 Neural Networks 510 Adhesion determination unit 610 Adhesion determination unit 620 Countermeasure Identification Department 630 Output section

Claims

1. A measuring device that emits light through a transparent member and detects reflected light from an object, an attachment determination unit for determining a type of attachment to the transparent member; A countermeasure specification unit that specifies one or more countermeasures that should be taken and countermeasures that should not be taken based on the type of the adhesion; and an output unit that outputs information indicating the identified countermeasure that should be taken and the identified countermeasure that should not be taken. Measuring equipment.

2. A measuring device that emits light through a transparent member and detects reflected light from an object, a light receiving element that receives at least the light reflected by the transparent member; an adhesion determination unit that determines a type of adhesion on the transparent member using a light receiving result of the light receiving element; A countermeasure specification unit that specifies one or more countermeasures based on the type of the adhesion; an output unit that outputs information indicating the identified countermeasure, When the adhesion determining unit determines that the adhesion is at least one of water droplets, condensation, and snow, the countermeasure specifying unit specifies at least heating by a heater as the countermeasure. Measuring equipment.

3. A measuring device that emits light through a transparent member and detects reflected light from an object, a light receiving element that receives at least the light reflected by the transparent member; an adhesion determination unit that determines a type of adhesion on the transparent member using a light receiving result of the light receiving element; A countermeasure specification unit that specifies one or more countermeasures based on the type of the adhesion; an output unit that outputs information indicating the identified countermeasure, When the adhering matter determining unit determines that the adhering matter is at least one of dust and dirt, the countermeasure specifying unit specifies removal by air as the countermeasure. Measuring equipment.

4. A measuring device that emits light through a transparent member and detects reflected light from an object, a light receiving element that receives at least the light reflected by the transparent member; an adhesion determination unit that determines a type of adhesion on the transparent member using a light receiving result of the light receiving element; A countermeasure specification unit that specifies one or more countermeasures based on the type of the adhesion; an output unit that outputs information indicating the identified countermeasure, When the adhering matter determining unit determines that the adhering matter is dirt other than water, the countermeasure specifying unit specifies at least one of wiping and cleaning with a liquid agent as the countermeasure. Measuring equipment.

5. 2. The measuring device according to claim 1, Further comprising one or more removal units, The output unit outputs a control signal for controlling one or more of the removal units based on the identified countermeasure to be taken and the identified countermeasure that should not be taken. Measuring equipment.

6. 6. The measuring device according to claim 1, The output unit outputs, as the information indicating the countermeasure to be taken and the countermeasure that should not be taken, information for making a notification to urge the user to take the identified countermeasure to be taken and information for notifying the user of the countermeasure that should not be taken. Measuring equipment.

7. A control device for one or more removal units, the removal unit is provided to remove adhesions from a transparent member of a measuring device that emits light through a transparent member and detects reflected light from an object, an attachment determination unit for determining a type of the attachment on the transparent member; A countermeasure specification unit that specifies one or more countermeasures that should be taken and countermeasures that should not be taken based on the type of the adhesion; an output unit that outputs a control signal for controlling one or more of the removal units based on the identified countermeasures that should be taken and the identified countermeasures that should not be taken. Control device.

8. A method for controlling one or more removal units, comprising: the removal unit is provided to remove adhesions from a transparent member of a measuring device that emits light through a transparent member and detects reflected light from an object, determining a type of the attachment to the transparent member; Identifying one or more measures to be taken and measures that should not be taken based on the determined type of the attachment; Controlling one or more of the removal units based on the identified measures to be taken and measures not to be taken. Control methods.

9. A program for causing a computer to function as the control device according to claim 7.

Citation Information

Patent Citations

  • Device and method for laser measurement

    JP2009503486A

  • Optical range finder

    JP2011013135A

  • Deposit determination device, and wiper control device and temperature control device including deposit determination device

    JP2014058235A

  • Snow accretion detection method and snow accretion detecting device for laser radar device

    JP2019163965A

  • Ultrasonic vibrations on a window in a lidar system

    US20180284268A1