System for a vehicle and method for providing road condition data for a vehicle - Patents.com

Abstract

To provide an improved ADAS system using an infrared detection device to detect road conditions and that can aid in the lane assist function.SOLUTION: An infrared detection device 14 is constructed and arranged to: 1) detect variations in road temperature; and 2) detect heat tracks left on a road lane by preceding vehicles. A control unit 18 is mounted in a vehicle, and connected to the infrared detection device 14 so as to process signals received from the infrared detection device 14. The control unit 18 is constructed and arranged to: 1) predict road conditions based on variations in road temperature detected by the infrared detection device 14; or 2) predict a road lane position, based on a path defined by the heat tracks detected by the infrared detection device 14.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to Advanced Driver-Assistance Systems (ADAS), and more particularly to systems that use infrared sensing devices to detect road lane conditions and provide lane assistance.

[0002] Background technology ADAS technology has advanced over the years, saving many lives in the process. However, the system could be further improved, especially for night driving. Although traffic volume is significantly reduced at night (60 percent reduction), 40 percent of all fatal vehicle accidents occur at night. Lane conditions at night are one of the most difficult for drivers to determine. US Patent Application Publication No. 2018 / 0141561 discloses a system with a conventional camera that detects and evaluates light reflections on the road to determine road conditions. However, such a system can have difficulty accessing road conditions at night when visible light is at a minimum.

[0003] Additionally, conventional lane assistance systems for vehicles typically detect road lane markings painted on the road using conventional cameras, but poor lighting during nighttime driving or when the lane markings are not painted properly can prevent these systems from detecting the lane markings.

[0004] Therefore, there is a need to provide an improved ADAS system that can use infrared sensing devices to detect road conditions and assist with lane assistance functions.

[0005] overview The object of the present invention is to meet the above-mentioned demands. According to a basic scheme of one embodiment, the object is solved by a system for a vehicle having a front, a rear, a right side and a left side. The system includes an infrared detection device mounted on a front of the vehicle. The infrared detection device is constructed and arranged to 1) detect variations in road temperature, and 2) detect heat signatures left on road lanes by a leading vehicle. A control unit is mounted on the vehicle and connected to the infrared detection device to process signals received from the infrared detection device. The control unit is constructed and arranged to 1) predict road conditions based on the variations in road temperature detected by the infrared detection device, or 2) predict road lane positions based on a path defined by the heat signatures detected by the infrared detection device.

[0006] According to another aspect of an embodiment, a method provides road condition data for a vehicle. The vehicle has a front, a rear, a right side and a left side. The method provides an infrared detection device at a front of the vehicle. A variation in road temperature is detected by the infrared detection device. Road conditions are predicted in a control unit based on the variation in road temperature detected by the infrared detection device.

[0007] According to another aspect of an embodiment, a method provides lane assistance for a vehicle. The method includes providing an infrared detection device at a front of the vehicle. A heat signature left on a road lane by a leading vehicle is detected by the infrared detection device. A road lane position is predicted by a control unit based on a path defined by the heat signature detected by the infrared detection device.

[0008] Other objects, features and characteristics of the present invention, as well as the method of operation and function of its associated elements of construction, combination of parts and economy of manufacture, will become more apparent from the following detailed description taken in conjunction with the accompanying drawings and the appended claims, all of which form a part of this application.

[0009] The invention will be better understood from the following detailed description of the preferred embodiments thereof in connection with the accompanying drawings, in which like reference numerals represent like parts, and in which: [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a plan view of a vehicle equipped with an advanced driver assistance system or autonomous vehicle system for determining road conditions, according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram of the system of FIG. 1. [Diagram 3] FIG. 2 is a plan view of a vehicle equipped with an advanced driver assistance system or autonomous vehicle system for lane assistance according to another aspect of the present invention.

[0011] DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS Referring to Figure 1, an advanced driver assistance system or autonomous vehicle system for a vehicle 12 according to one embodiment is shown, generally designated by the reference numeral 10. The system 10 includes an infrared detection device 14, preferably mounted at the front 16 of the vehicle 12, such as on or in a grille or front bumper. As best shown in Figure 2, the system also includes a control unit 18 mounted to the vehicle 12 and connected to the infrared detection device 14 to process signals received from the infrared detection device 14. The field of view (FOV) of the infrared detection device in front of the vehicle 12 is indicated at 20.

[0012] In an embodiment, the infrared (IR) detection device 14 comprises an infrared camera or a thermal imaging camera. Typically, an infrared camera uses short wavelength infrared light to illuminate an area of ​​interest. A portion of the infrared energy is reflected back to the infrared camera and interpreted to generate image data. Typically, a thermal imaging camera uses mid or long wavelength infrared energy. Thermal imaging cameras are passive and only sensitive to thermal differences. Thus, the infrared detection device 14 can detect road temperature variations (heat marks) even in the absence of light. This allows an algorithm executed by the processor circuit 22 of the control unit 18 to use this temperature variation data to determine a prediction of road conditions. As shown in FIG. 1, for example, the infrared detection device 14 can identify the presence of water 24 on the road 25 based on the infrared data. Thus, for example, the processor circuit 22 may execute an algorithm that includes the steps of receiving a heat signature of an object on the road (e.g., water) having a heat signature different from that of the surrounding area on the road, comparing the received heat signature with known heat signatures stored in the memory circuit 28, and predicting or identifying the type of object on the road that defines the road condition based on the comparison. Output from the infrared road condition algorithm may be compared with outputs from a standard system already present in the vehicle, and these outputs may be sent to a main computer system controlling the operation of the vehicle for fusion.

[0013] The data provided by the infrared detection device 14 may be used in conjunction with data from a conventional surround view camera system having multiple normal (non-IR) cameras 26a-d, each configured to capture images. A first camera 26a is provided at the front 16 of the vehicle 12, a second camera 26b is provided at the rear 17 of the vehicle 12, a third camera 26c is provided at the left side 19 of the vehicle 12, and a fourth camera 26d is provided at the right side 21 of the vehicle 12. These cameras 26a-d are typically mono cameras with a FOV 27 of up to 125 degrees, or fisheye cameras with a FOV of 180 degrees or more, and may be used for at least lane assistance, parking assistance, emergency braking to avoid collisions, etc. The cameras 26a-d are connected to a control unit 18. Certain of the cameras 26a-d can also be used to observe road conditions, as disclosed in U.S. Patent Application Publication No. 2018 / 0141561, the contents of which are incorporated herein by reference. Thus, the light-reflecting image capture cameras 26a-d can provide image data to the control unit 18 about road conditions when sufficient light is available, and the infrared detection device 14 can provide temperature data to the control unit 18 about road conditions when sufficient light is not available. Using such data, the control unit 18 or other vehicle controller can control various vehicle systems (e.g., vehicle braking, speed control, etc.) in response to sensed or predicted road conditions. The memory circuitry 28 of the control unit 18 can store algorithms and / or data from the infrared detection device 14 and the cameras 26a-d.

[0014] Thus, the infrared detection device 14 can detect water, ice, or any lane abnormality much more easily, even at night. The infrared detection device 14 can determine road conditions based on the variations in infrared measurements across the road, and these measurements can be compared to the outputs provided by the surround view cameras 26a-d for improved accuracy. It is clear that the control unit 18 may receive data from more than just the infrared detection device 14 and / or the cameras 26a-d, such as outside air temperature, humidity, wind speed data, whether the vehicle wipers are on, etc., for use in predicting road conditions. The infrared detection device 14 can also be kept on all the time, or can be activated based on an ambient light sensor (e.g., a conventional light sensor that can automatically turn on the vehicle's lights when daylight weakens).

[0015] 3, the infrared detection device 14 may be employed in lane assistance applications by detecting a heat trail 30 on a road lane L left by another vehicle 32 traveling on the road 25 or a vehicle preceding the vehicle 12. Heat from the tires of the vehicle 32 traveling on the road creates a trail behind the vehicle 32. As multiple vehicles travel on the same road lane L, certain parts of the road lane L will be warmer than other parts. Roads with heavy traffic and faster travel speeds provide better following of the heat trail 30.

[0016] The processor circuit 22 of the control unit 18 can execute an algorithm that predicts the location of the road lane L based on the routes most traveled by other vehicles 32. For example, the processor circuit 22 can execute an algorithm that includes receiving a heat signature 30 on the road having a heat signature different from that of the surrounding area on the road, and calculating or predicting the lane position L on the road based on the location of the heat signature 30. If the driver deviates from the lane L, the control unit 18 can activate a warning signal or automatically control the steering to bring the vehicle back into the lane. Alternatively, the output from the infrared lane assistance algorithm can be compared with the output from a standard system already present in the vehicle, and these outputs can be sent to a main computer system controlling the operation of the vehicle for fusion.

[0017] The use of the infrared detection device 14 reduces the need for high quality lane markings 34 employed in conventional lane keeping techniques. The infrared detection device 14 should be mounted at the front of the vehicle 12 as close to the road as possible. The infrared detection device 14 can be used alone or in conjunction with the surround view cameras 26a-26d of FIG. 1, which can provide data regarding the location of the lane markings 34. In this manner, the infrared detection device 14 can be used to augment or as a backup to the normal lane marking detection system (e.g., mono camera) used for conventional lane assistance. If the lane markings 34 cannot be detected by a particular one of the mono cameras 26a-26d due to poor lighting or poor paint, the infrared detection device 14 can use the heat signature 30 from other vehicles as a reference for where the lane L should be.

[0018] The operations and algorithms described herein may be implemented as executable code in a microcontroller or control unit 18 having a processor circuit 22 as described, or may be stored in a stand-alone computer or machine-readable non-transitory tangible storage medium that is completed upon execution of the code by a processor circuit configured using one or more integrated circuits. Exemplary implementations of the disclosed circuits include hardware logic implemented in a logic array such as a programmable logic array (PLA), a field programmable gate array (FPGA), or by mask programming of an integrated circuit such as an application specific integrated circuit (ASIC). Any of these circuits may be configured using software-based executable resources executed by a corresponding internal processor circuit, e.g., a microprocessor circuit (not shown), configured using one or more integrated circuits, where execution of executable code stored in an internal memory circuit causes the integrated circuit that constitutes the processor circuit to store application state variables in the processor memory to generate executable application resources (e.g., application instances) that operate the circuit as described herein. Thus, use of the term "circuitry" herein refers to both hardware-based circuitry, constructed using one or more integrated circuits, and including logic circuitry for performing the operations described, or software-based circuitry, constructed using one or more integrated circuits, and including processor circuitry having reserved portions of processor memory for storing application state data and application variables that are modified by execution of executable code by the processor circuitry. Memory circuitry 28 may be constructed using, for example, non-volatile memory, such as programmable read-only memory (PROM) or EPROM, and / or volatile memory, such as DRAM.

[0019] The above preferred embodiments have been shown and described for the purpose of illustrating the basic structural and functional principles of the invention and of illustrating the manner in which the preferred embodiments may be used, and modifications may be made to those advantageous embodiments without departing from such principles. Accordingly, the present invention includes any and all modifications that come within the scope of the appended claims.

Claims

1. 1. A system for a vehicle, comprising: the vehicle having a front, a rear, a right side, and a left side; The system further comprises: an infrared detection device mounted to the front of the vehicle, the infrared detection device constructed and arranged to detect variations in road temperature; a control unit mounted on the vehicle and connected to the infrared detection device to process signals received from the infrared detection device, the control unit constructed and arranged to predict road conditions based on the variations in road temperature detected by the infrared detection device; and Equipped with the control unit includes a processor circuit constructed and arranged to execute an algorithm for predicting the road conditions; the processor circuit is constructed and arranged to execute an algorithm including the steps of: receiving a heat signature of an object on the road having a heat signature different from that of a surrounding area on the road; comparing the heat signature of the object on the road received in the receiving step with known heat signatures stored in a memory circuit; and predicting or identifying a type of the object defining a road condition on the road based on the comparison; The object is water or ice; system.

2. The system of claim 1 , wherein the infrared detection device is an infrared camera.

3. The system of claim 1 , wherein the infrared detection device is a thermal imaging camera.

4. The system further comprises: a first camera mounted at the front of the vehicle; a second camera mounted to the rear of the vehicle; a third camera mounted on the left side of the vehicle; a fourth camera mounted on the right side of the vehicle; Further equipped with the first, second, third and fourth cameras define image capture cameras, each connected to the control unit, such that when sufficient light is available, the image capture cameras provide image data to the control unit about road conditions, and when sufficient light is not available, the infrared detection device provides temperature data to the control unit about road conditions; The system of claim 1 .

5. 5. The system of claim 4, wherein each of the first, second, third, and fourth cameras is a mono camera having a field of view of up to 125 degrees.

6. 5. The system of claim 4, wherein each of the first, second, third and fourth cameras is a fish-eye camera having a field of view of 180 degrees or greater.

7. The system of claim 4 , wherein a particular one of the first, second, third and fourth cameras is configured to detect road lane markings.

8. The system of claim 4 , wherein a particular one of the first, second, third and fourth cameras is configured to detect light reflections on the roadway.

9. 1. A method of providing road condition data for a vehicle having a control unit, the vehicle having a front portion, a rear portion, a right portion and a left portion, the method comprising: detecting road temperature variations by an infrared detection device provided at the front of the vehicle and connected to the control unit; The control unit predicts road conditions based on the variation of road temperature detected by the infrared detection device; Including, the control unit includes a processor circuit, and the method further comprises: Executing, by the processor circuit, an algorithm for predicting the road conditions by the steps of: receiving a heat signature of an object on the road having a heat signature different from that of a surrounding area on the road; comparing the heat signature of the object on the road received in the receiving step with known heat signatures stored in a memory circuit; and predicting or identifying a type of the object defining a road condition on the road based on the comparison. Further comprising: The object is water or ice; method.

10. The method of claim 9 , wherein the infrared detection device is provided as an infrared camera.

11. The method of claim 9 , wherein the infrared detection device is provided as a thermal imaging camera.

12. a first camera is mounted on the front of the vehicle; a second camera is mounted at the rear of the vehicle; a third camera is attached to the left side of the vehicle; a fourth camera is attached to the right side of the vehicle; the first, second, third, and fourth cameras define image capture cameras and are each connected to the control unit; The method further comprising: providing image data to the control unit about road conditions by a particular one of the image capture cameras when sufficient light is available; providing temperature data about road conditions to the control unit with the infrared detection device when sufficient light is not available; 10. The method of claim 9, comprising:

Images