Vehicle rainwater detection method and system

Abstract

The present invention provides a vehicle rainwater detection system configured to detect rainwater and determine whether to operate a wiper using the detected rainwater, comprising: a light source unit (100) that irradiates infrared light onto the windshield of a vehicle; an infrared sensor (200) that measures the infrared light intensity reflected by the windshield of a vehicle; an ambient light sensor (300) that measures the illuminance of ambient light according to the weather environment; a fusion data generation unit (400) that generates fusion data by combining infrared light intensity data measured by the infrared sensor (200) and illuminance data measured by the ambient light sensor (300) using a preset method; and a Kalman filter calculation unit (500) that generates a wiper operation condition determination variable by calculating the fusion data using a Kalman filter method.

Description

Technology Field

[0001] The present invention relates to the technical field of automobiles and probability. Background Technology

[0003] A rain sensor refers to a device that detects the intensity and amount of rainwater and automatically controls the speed or operating time of the wipers. Generally, a rain sensor emits infrared light onto the vehicle's windshield and detects rainwater by measuring the intensity of the infrared light reflected from the windshield.

[0004] However, conventional rain sensors of this type have a problem of poor adaptability to various weather conditions, such as changes in ambient light intensity. In addition, conventional rain sensors have a problem of inaccurate infrared light intensity measurement due to external factors such as dust attached to the vehicle windshield and the angle of the vehicle windshield.

[0005] We examine the relevant prior art.

[0006] Patent Document 1 (Chinese Published Patent No. 117809219) proposes a smart wiper for vehicles that utilizes a Kalman filter method to respond to such external environments. However, since Patent Document 1 only discloses a method of Kalman filtering unit rainfall, there is still a problem in that it is difficult to apply to various environmental conditions such as changes in ambient light intensity.

[0007] Patent Document 2 (Japanese Registered Patent No. 6922700) proposes a raindrop detection device and a wiper control device that detect raindrops through image data captured by a camera using a Kalman filter. However, Patent Document 2 still has the problem of being difficult to apply to various environmental conditions, such as changes in ambient light intensity. Prior art literature

[0009] Chinese Published Patent No. 117809219, Japanese Registered Patent No. 6922700 The problem to be solved

[0010] The present invention was devised to solve the above-mentioned problem.

[0011] The present invention aims to provide a vehicle rain detection system and method that considers changes in ambient light illuminance by performing calculations on fused data, which is a fusion of infrared data and ambient light illuminance data, using a Kalman filter method.

[0012] In addition, the present invention aims to provide a personalized vehicle rain detection system and method that determines whether to operate the wiper by considering the driver's past wiper operation history when rain is detected. means of solving the problem

[0014] An embodiment of the present invention for solving the above-mentioned problem provides a vehicle rainwater detection system configured to detect rainwater and ambient light and to determine whether to operate a wiper using the detected rainwater and the detected ambient light, comprising: a light source unit (100) that irradiates infrared light onto the windshield of a vehicle; an infrared sensor (200) that measures the infrared light intensity reflected by the windshield of the vehicle and generates infrared light intensity data corresponding to the detected rainwater; an ambient light sensor (300) that measures the illuminance of ambient light according to the weather environment and generates illuminance data corresponding to the detected ambient light; a fusion data generation unit (400) that calculates the infrared light intensity data and the illuminance data using a preset method to generate fusion data in which the infrared light intensity data and the illuminance data are combined; and a Kalman filter calculation unit (500) that calculates the fusion data using a Kalman filter method to generate a variable for determining the wiper operation condition.

[0016] Additionally, it is preferable to further include a driver identification unit (600) that obtains driver information including a driver ID and past wiper operation history in a preset manner - where the wiper operation history includes wiper operation and wiper non-operation; a reference value generation unit (700) that takes the driver ID and past wiper operation history as input values ​​and takes a wiper operation reference value matching the driver ID and past wiper operation history as output values, inputs the driver ID and past wiper operation history obtained from the driver identification unit (600) to the wiper operation model, and outputs a personal wiper operation reference value; and a control unit (800) that operates the wiper when the wiper operation condition determination variable calculated by the Kalman filter calculation unit (500) is greater than or equal to the personal wiper operation reference value.

[0018] Another embodiment of the present invention for solving the above-mentioned problem provides a vehicle rainwater detection method comprising: a system configured to detect rainwater and ambient light and to determine whether to operate a wiper using the detected rainwater and the detected ambient light, wherein the system comprises: (a) a step (S210) in which an infrared sensor (200) measures the infrared light intensity reflected by the windshield of the vehicle and generates infrared light intensity data corresponding to the detected rainwater; (b) a step (S220) in which an ambient light sensor (300) measures the illuminance of ambient light according to the weather environment and generates illuminance data corresponding to the detected ambient light; (c) a step (S230) in which a fusion data generation unit (400) calculates the infrared light intensity data and the illuminance data using a preset method to generate fusion data in which the infrared light intensity data and the illuminance data are combined; and (d) a step (S240) in which a Kalman filter calculation unit (500) calculates the fusion data using a Kalman filter method to generate a variable for determining the wiper operation condition.

[0020] Additionally, it is preferable to further include: (e) a step (S250) in which a driver identification unit (600) obtains driver information including a driver ID and past wiper operation history in a preset manner; - where the wiper operation history includes wiper operation and wiper non-operation; (f) a step (S260) in which a reference value generation unit (700) inputs the driver ID and past wiper operation history obtained from the driver identification unit (600) into a learned wiper operation model, which takes the driver ID and past wiper operation history as input values ​​and the wiper operation reference value as output values, and outputs a personal wiper operation reference value; and (g) a step (S270) in which a control unit (800) operates the wiper when the wiper operation condition determination variable calculated by the Kalman filter calculation unit (500) is greater than or equal to the personal wiper operation reference value.

[0022] Another embodiment of the present invention for solving the above-mentioned problem is a computer-readable recording medium having a program for performing the method described in the aforementioned claim. Effects of the invention

[0024] A vehicle rainwater detection system and method according to one embodiment of the present invention provides a vehicle rainwater detection technology that takes into account the illuminance of ambient light, thereby enabling more accurate rainwater detection.

[0025] In addition, the vehicle rainwater detection system and method according to one embodiment of the present invention have the effect of being applicable to various environments, such as changes in ambient light intensity.

[0026] In addition, a vehicle rainwater detection system and method according to one embodiment of the present invention can provide a personalized rainwater detection technology that determines whether to operate the wiper by considering the driver's past wiper operation history when rainwater is detected. Brief explanation of the drawing

[0028] FIG. 1 is a schematic diagram of a vehicle rainwater detection system according to one embodiment of the present invention. FIG. 2 is a flowchart of a vehicle rainwater detection method according to one embodiment of the present invention. FIG. 3 is a data flow diagram for a method according to one embodiment of the present invention. FIG. 4 is an example of data measured by a sensor according to one embodiment of the present invention. FIG. 5 is an example of a result calculated by a Kalman filter operation unit according to an embodiment of the present invention. Specific details for implementing the invention

[0029] Hereinafter, some embodiments of the present invention will be described in detail with reference to the exemplary drawings. It should be noted that in assigning reference numerals to the components of each drawing, the same components are given the same reference numeral whenever possible, even if they are shown in different drawings. Furthermore, in describing the present invention, if it is determined that a detailed description of related known components or functions could obscure the essence of the present disclosure, such detailed description is omitted.

[0030] In describing the components of the embodiments according to the present disclosure, symbols such as first, second, i), ii), a), b), etc., may be used. These symbols are intended only to distinguish the components from other components, and the essence, order, or sequence of the components is not limited by the symbols. When a part in the specification is described as 'comprising' or 'having' a component, this means that, unless explicitly stated otherwise, it does not exclude other components but may include additional components.

[0032] In the following, “ambient light” refers to noise measured by an infrared sensor (200) to be described later, and may mean light other than infrared irradiated from a light source unit (100) to be described later. For example, ambient light may be sunlight, vehicle surrounding lighting, etc.

[0033] In the following, the “wiper operation decision variable” may be a variable that determines whether the wiper operates. The wiper operation decision variable may be determined to a value between 0 and 1, and the closer it is to 1, the higher the probability that it is estimated to be a rain condition.

[0035] 1. Description of the vehicle rain detection system

[0036] FIG. 1 is a schematic diagram of a vehicle rainwater detection system according to one embodiment of the present invention.

[0037] Referring to FIG. 1, the vehicle rain detection system according to the present invention may include a light source unit (100), an infrared sensor (200), an ambient light sensor (300), a fusion data generation unit (400), a Kalman filter calculation unit (500), a driver identification unit (600), a reference value generation unit (700), and a control unit (800).

[0038] The light source unit (100) may be configured to irradiate infrared rays onto the windshield of a vehicle. However, the light irradiated by the light source unit (100) is not limited to infrared rays and can be implemented in various modified ways.

[0039] The infrared sensor (200) can measure the intensity of infrared light irradiated from the light source (100) and reflected by the windshield of the vehicle. Like a rain sensor, the infrared sensor (200) can detect rainwater on the windshield of the vehicle by measuring the intensity of infrared light. The infrared sensor (200) can generate infrared light intensity data corresponding to the detected rainwater by measuring the intensity of infrared light.

[0040] The ambient light sensor (300) may be configured to measure the illuminance of ambient light. The ambient light sensor (300) may generate illuminance data corresponding to the detected ambient light.

[0041] The fusion data generation unit (400) can generate fusion data by fusing infrared light intensity data measured from the infrared sensor (200) and illuminance data measured from the ambient light sensor (300) in a predetermined manner. It is preferable that the method by which the fusion data generation unit (400) generates fusion data involves combining the infrared light intensity data and the illuminance data into a matrix. However, the method of generating fusion data is not limited thereto, and the method of generating fusion data can be varied in various ways using previously disclosed fusion data generation methods.

[0042] The Kalman filter operation unit (500) may be configured to generate wiper operation decision variables by operating the fusion data generated from the fusion data generation unit (400) using a preset Kalman filter method.

[0043] Specifically, the pre-set Kalman filter method of the Kalman filter operation unit (500) may utilize the following [Equation 1] to [Equation 5]. The variables of [Equation 1] to [Equation 5] are as follows. is a state variable at time k, and is a state variable at time k-1, and is a control input variable, and is the state transition matrix, and Is When It is a matrix that converts into state variables, and is the measurement matrix. Also, is the Kalman Gain, and is an observed value, and is the covariance matrix of the system noise, and is the covariance matrix of the sensor measurement noise. This can be identical to the variables of a general Kalman filter. In this case, the aforementioned observation ( ) may be a value formed by fusing infrared light intensity measured from an infrared sensor (200) and illuminance data measured from an ambient light sensor (300).

[0045]

[0046]

[0047]

[0049]

[0050]

[0052] The driver identification unit (600) may be configured to obtain driver information. The driver information may include a driver ID and past wiper operation history. The driver ID may be a number assigned to each driver. The past wiper operation history may be the wiper operation history for each driver that matches the driver ID. The past wiper operation history includes wiper operation and wiper non-operation based on the amount of rainwater on the windshield of the vehicle for each driver.

[0053] The reference value generation unit (700) may be configured to generate a personal wiper operation reference value using a driver ID and past wiper operation history. Wiper operation criteria may vary from driver to driver. For example, some drivers may prefer to operate the wipers when the vehicle windshield is completely covered with rainwater, while others may prefer to operate the wipers even when the vehicle windshield is covered with a small amount of rainwater. The personal wiper operation reference value is a value generated by taking into account the past wiper operation history of such drivers, and may be a numerical value that reflects the personal wiper operation preference.

[0054] Artificial intelligence can be utilized as a method for the reference value generation unit (700) to generate a personal wiper operation reference value. Specifically, the reference value generation unit (700) can generate a personal wiper operation reference value using a wiper operation model. The wiper operation model may be an artificial intelligence model that learns driver ID and past wiper operation history data to generate a wiper operation reference value, which is a wiper operation reference value that matches the past wiper operation history. The reference value generation unit (700) can input the driver ID and past wiper operation history obtained from the driver verification unit (600) into the wiper operation model to output a personal wiper operation reference value. Accordingly, the reference value generation unit (700) can calculate a personal wiper operation reference value that is different for each driver through the wiper operation model.

[0055] The control unit (800) may be configured to control vehicle parts, for example, a wiper. The control unit (800) may operate the wiper when the wiper operation condition determination variable calculated by the Kalman filter calculation unit (500) is greater than or equal to a personal wiper operation reference value.

[0057] 2. Explanation of vehicle rain detection methods

[0058] FIG. 2 is a flowchart of a vehicle rainwater detection method according to one embodiment of the present invention, and FIG. 3 is a data flowchart of a method according to one embodiment of the present invention.

[0059] FIG. 4 is an example of data measured by a sensor according to an embodiment of the present invention, and FIG. 5 is an example of a result calculated by a Kalman filter operation unit according to an embodiment of the present invention. At this time, the upper graph of FIG. 4 is a diagram showing infrared light intensity data measured by an infrared sensor, and the lower graph of FIG. 4 is a diagram showing illuminance data measured by an ambient light sensor.

[0061] Hereinafter, a vehicle rainwater detection method according to the present invention will be described with reference to FIGS. 2 to 5.

[0062] Meanwhile, it should be noted that although the steps of the flowchart in the present invention are depicted as being performed sequentially, they are not necessarily limited thereto, and at least some of the steps may be performed simultaneously or sequentially.

[0063] Referring to FIGS. 2 and 3, an infrared sensor (200) can measure the infrared light intensity reflected by the windshield of a vehicle (S210). The infrared sensor (200) can measure the infrared light intensity and generate infrared light intensity data corresponding to the detected rainwater.

[0064] Additionally, the ambient light sensor (300) can measure the illuminance of ambient light according to the weather environment (S220). The ambient light sensor (300) can generate illuminance data corresponding to the detected ambient light.

[0065] For example, referring to FIG. 4, it can be seen that during the 20 to 40 minute interval, the infrared light intensity measured by the infrared sensor (200) is high (see the top graph of FIG. 4), and the ambient light intensity measured by the ambient light sensor (300) is low (see the bottom graph of FIG. 4). Therefore, the 20 to 40 minute interval can be expected to be a rainfall interval.

[0066] Next, the fusion data generation unit (400) can generate fusion data by combining infrared light intensity data measured by the infrared sensor (200) and illuminance data measured by the ambient light sensor (300) using a preset method (S230). Preferably, the fusion data generation unit (400) can generate fusion data by integrating the infrared light intensity data measured by the infrared sensor (200) and the illuminance data measured by the ambient light sensor (300) into a single matrix.

[0067] Next, the Kalman filter operation unit (500) can generate wiper operation condition determination variables by operating the fused data using the Kalman filter method (S240).

[0068] Referring to [Mathematical Formula 1], As an initial value, an arbitrary value is input in which infrared luminous intensity data and illuminance data are formed as a matrix system, and can be computed. Here, , and can be a pre-set value.

[0069] Referring to [Mathematical Formula 2], An arbitrary value is entered as the initial value, and This can be calculated. Here, can be a pre-set value.

[0070] Next, referring to [Equation 3], the Kalman gain ( ) can be operated on. Here, and can be a pre-set value.

[0071] Next, referring to [Mathematical Equation 4], In this case, fused data in which infrared light intensity measured by the infrared sensor (200) and illuminance data measured by the ambient light sensor (300) are fused can be input as an observed value. Therefore, can be calculated.

[0072] Next, referring to [Mathematical Formula 5], can be calculated.

[0073] next, and are respectively of [Equation 1] and It is input into and the Kalman filter operation described above can be repeated.

[0074] Finally calculated Wiper operation determination variables can be calculated using a predetermined method. The relationship between the wiper operation determination variables can be established by a predetermined function. For example, the predetermined function may be a function obtained through experiments using past acquired infrared light intensity data and illuminance data, as well as actual rainfall history data.

[0075] In Fig. 5, the x-axis represents time, and the y-axis represents the wiper operation determination variable. The wiper operation determination variable can be determined as a value between 0 and 1, as shown in the y-axis of Fig. 5. Referring to Fig. 5, it can be seen that the maximum fluctuation range and the number of fluctuations in the rainfall estimation interval (20 to 40 minutes interval) are reduced compared to the fluctuation range and the number of fluctuations in the graph at the top of Fig. 4. That is, when using the system and method according to the present invention, it can be more stably estimated that the 20 to 40-minute interval is a rainfall interval compared to a conventional rain detection method using only an infrared sensor. Accordingly, the system and method according to the present invention have the advantage of being able to estimate rainfall conditions with high accuracy even under various environmental conditions, such as changes in ambient light intensity.

[0076] Next, the driver verification unit (600) can obtain driver information including driver ID and past wiper operation history in a preset way (S250).

[0077] Next, the standard value generation unit (700) can input the driver ID and past wiper operation history obtained from the driver verification unit (600) into a wiper operation model learned with the driver ID and past wiper operation history as input values ​​and the wiper operation standard value as output values, and output a personal wiper operation standard value (S260).

[0078] Next, if the wiper operation condition determination variable calculated by the Kalman filter calculation unit (500) is greater than or equal to the individual wiper operation reference value, the control unit (800) can operate the wiper (S270).

[0080] Although the embodiments have been described above with reference to the limited drawings, those skilled in the art can apply various technical modifications and variations based thereon. For example, suitable results may be achieved even if the described techniques are performed in a different order than described, and / or if the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0081] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below. Explanation of the symbols

[0083] 100 : Light source 200: Infrared sensor 300 : Ambient light sensor 400 : Fusion Data Generation Unit 500 : Kalman filter operation unit 600 : Driver Confirmation 700 : Reference value generation unit 800 : Control unit

Claims

Claim 1 A vehicle rain detection system configured to detect rainwater and ambient light and to determine whether to operate a wiper using the detected rainwater and the detected ambient light, comprising: a light source unit (100) that irradiates infrared light onto the windshield of a vehicle; an infrared sensor (200) that measures the infrared light intensity reflected by the windshield of the vehicle and generates infrared light intensity data corresponding to the detected rainwater; an ambient light sensor (300) that measures the illuminance of ambient light according to the weather environment and generates illuminance data corresponding to the detected ambient light; a fusion data generation unit (400) that calculates the infrared light intensity data and the illuminance data using a preset method to generate fusion data in which the infrared light intensity data and the illuminance data are combined; and a Kalman filter calculation unit (500) that calculates the fusion data using a Kalman filter method to generate a wiper operation condition determination variable; wherein the Kalman filter calculation unit (500) receives the fusion data as an observation value of the Kalman filter, calculates a state variable, and calculates a wiper operation condition determination variable from the state variable. Claim 2 A vehicle rain detection system according to claim 1, further comprising: a driver identification unit (600) that obtains driver information including a driver ID and past wiper operation history in a preset manner; - wherein the wiper operation history includes wiper operation and wiper non-operation; a reference value generation unit (700) that takes the driver ID and past wiper operation history as input values ​​and takes a wiper operation reference value matching the driver ID and past wiper operation history as output values, inputs the driver ID and past wiper operation history obtained from the driver identification unit (600) to the wiper operation model, and outputs a personal wiper operation reference value; and a control unit (800) that operates the wiper when the wiper operation condition determination variable calculated by the Kalman filter calculation unit (500) is greater than or equal to the personal wiper operation reference value. Claim 3 A vehicle rain detection method comprising: a system configured to detect rainwater and ambient light and to determine whether to operate a wiper using the detected rainwater and the detected ambient light, wherein the system comprises: (a) a step (S210) in which an infrared sensor (200) measures the infrared light intensity reflected by the windshield of a vehicle and generates infrared light intensity data corresponding to the detected rainwater; (b) a step (S220) in which an ambient light sensor (300) measures the illuminance of ambient light according to the weather environment and generates illuminance data corresponding to the detected ambient light; (c) a step (S230) in which a fusion data generation unit (400) calculates the infrared light intensity data and the illuminance data in a preset manner to generate fusion data in which the infrared light intensity data and the illuminance data are combined; and (d) a step (S240) in which a Kalman filter calculation unit (500) receives the fusion data as an observation value of a Kalman filter, calculates a state variable, and generates a wiper operation condition determination variable from the state variable. Claim 4 In paragraph 3, the method further comprises: (e) a step (S250) in which a driver identification unit (600) obtains driver information including a driver ID and past wiper operation history in a preset manner; - wherein the wiper operation history includes wiper operation and wiper non-operation; (f) a step (S260) in which a reference value generation unit (700) inputs the driver ID and past wiper operation history obtained from the driver identification unit (600) into a learned wiper operation model, which takes the driver ID and past wiper operation history as input values ​​and the wiper operation reference value as output values, and outputs a personal wiper operation reference value; and (g) a step (S270) in which a control unit (800) operates a wiper when the wiper operation condition determination variable calculated by the Kalman filter calculation unit (500) is greater than or equal to the personal wiper operation reference value. Claim 5 A computer-readable recording medium having a program for performing the method described in any one of paragraphs 3 to 4. Claim 6 In claim 1, the Kalman filter calculation unit (500) calculates a state variable at an arbitrary time (k-1) using an initial value of infrared light intensity data and an initial value of illuminance data, calculates a Kalman gain using multiple state variables according to the arbitrary time (k-1), calculates a state variable at a current time (k) using the Kalman gain and the fusion data, and calculates a wiper operation condition determination variable from the state variable calculated for the current time (k), a vehicle rain detection system. Claim 7 In claim 3, in step (d), the Kalman filter calculation unit (500) calculates a state variable at an arbitrary time (k-1) using an initial value of infrared light intensity data and an initial value of illuminance data, calculates a Kalman gain using multiple state variables according to the arbitrary time (k-1), calculates a state variable at a current time (k) using the Kalman gain and the fusion data, and generates a wiper operation condition determination variable from the state variable calculated for the current time (k), a vehicle rainwater detection method.

Images