Control system using road recognition for a moving vehicle and method using the same

The control system uses real-time vehicle data to accurately determine and communicate road conditions, reducing accident risks by providing precise information and adaptive vehicle control.

JP7583478B2Active Publication Date: 2024-11-14S R D KOREA CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2023518505
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2022-01-18
Filing Date
2023-01-16
Publication Date
2024-11-14
Estimated Expiration
2043-01-16

AI Technical Summary

Technical Problem

Existing systems struggle to accurately determine and communicate real-time road surface conditions, particularly hydroplaning or black ice, leading to increased accident risks due to driver inattention and unpredictable weather changes.

Method used

A control system that utilizes real-time position and image information from vehicles to determine road surface conditions, sharing this data through a central management server for accurate determination and display, and enabling vehicle control adjustments.

Benefits of technology

Accurately determines road surface conditions, reduces error in detection, and enhances driving safety by providing visual and audio alerts, as well as controlling vehicle operations based on real-time road conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007583478000011
    Figure 0007583478000011
  • Figure 0007583478000012
    Figure 0007583478000012
  • Figure 0007583478000013
    Figure 0007583478000013
Patent Text Reader

Abstract

A control system CS using road surface recognition (eg, hydroplaning or black ice recognition) for a moving vehicle, and a method "M" using the same are provided. For this purpose, the control system CS using road surface recognition for a moving vehicle according to the present disclosure comprises an in-vehicle device that transmits road surface information including real-time position information and road surface image information of a moving vehicle to a central management server, and the central management server that determines the road surface condition in real time based on the road surface information received from the in-vehicle device and transmits the road surface condition information to the in-vehicle device. Therefore, the on-board device attached to a moving vehicle can transmit road surface information including real-time location information and road surface image information to the central management server, and the central management server can accurately determine the road surface conditions using multiple road surface information provided in real time.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a control system using road surface recognition of a moving vehicle (e.g., hydroplaning or black ice recognition) and a method using the same, and more particularly to a control system using road surface recognition of a moving vehicle, in which a vehicle-attached device transmits road surface information including real-time position information and road surface image information of a moving vehicle to a central management server, and the central management server determines road surface conditions in real time and transmits road surface condition information to the vehicle-attached device, and a method using the same. [Background technology]

[0002] In general, drivers can predict the weather based on local weather forecasts and prepare for safe driving. However, in recent years, with the rapid changes in weather conditions caused by global warming, there have been a series of abnormal weather events, such as frequent torrential rains in summer and localized heavy snowfall in winter in certain regions. When heavy rain or snow caused by abnormal weather forms a water film or freezes on the road surface, the skid resistance of tires is significantly reduced, increasing the risk of vehicle accidents.

[0003] In addition, a sudden drop in temperature can cause water vapor in the air to condense, and depending on the temperature near the road surface, fog or condensation can form. Fog not only blocks the driver's eyes and threatens driving safety, it also wets the road surface, and the condensed water can freeze as the temperature drops, potentially threatening driving safety as well.

[0004] In particular, the difference between the air temperature and the road surface temperature can be as much as 4°C at tunnel entrances and exits, bridge sections, shaded sections, accident-prone areas, connecting roads (interchanges (IC), junctions (JCT), service areas, etc.), and the boundaries of branching roads. For this reason, there can be many difficulties in predicting local road surface conditions.

[0005] For this reason, public agencies, local governments, and related private organizations are making great efforts to create a safe road environment that can respond to unforeseen weather conditions. For example, they are designating sections that are frequently frozen as salt water injection sections and activating salt water injection devices, and installing variable message signs (VMS) on roads that display the road surface conditions and transmit the road surface conditions in real time according to the weather conditions.

[0006] Compared to urban areas, mountainous and suburban areas have more habitually frozen sections and drivers often drive on unfamiliar roads. As a result, drivers may end up relying entirely on their vehicle navigators while driving. As a result, drivers may end up driving with reduced concentration on safety signs and variable information boards on the road. As a result, drivers may not be able to respond to sharp changes in road curves, which may directly lead to serious accidents due to vehicle slippage caused by road surface conditions.

[0007] Korean Patent Publication No. 10-2009-0022127 (published on March 4, 2009, hereafter referred to as "Related Technical Document 1") discloses a "System and method for road condition monitoring using mobile and wireless communications."

[0008] Related art document 1 proposes measuring road conditions using economical and inexpensive sensors and providing the measured road condition data to the driver using mobile communication or wireless communication. However, it is impossible to install sensors on the entire road area, and therefore the sensors may only selectively measure some dangerous sections. In addition, the sensors measure weather conditions, and it is difficult to accurately predict road surface conditions that have a large error from the air temperature.

[0009] Meanwhile, JP 2018-025528 A (published on February 15, 2018, hereinafter referred to as “Related Technical Document 2”) entitled “Detection Apparatus, Detection Method, and Detection Program” has been proposed.

[0010] Related art document 2 proposes shining light in a specific wavelength range onto a moving vehicle and analyzing the wavelength of the reflected light reflected or scattered from the object to determine the state of the target object, including the road surface. However, because the road surface condition is recognized using a specific moving vehicle, depending on the state of the camera and the irradiation angle of the incident light, there may be cases where excessive errors occur in identifying the road surface condition or where road surface condition information cannot be shared in real time with other moving vehicles.

[0011] Furthermore, the related technical literature states that the driver may not be able to immediately recognize the road surface conditions, and even if the driver recognizes the road surface conditions, there is still a possibility that a safety accident may occur due to the driver's carelessness or local changes in the road surface conditions. [Prior art documents] [Patent documents]

[0012] [Patent Document 1] Korean Patent Publication No. 10-2009-0022127 [Patent Document 2] JP 2018-025528 A Summary of the Invention [Problem to be solved by the invention]

[0013] The object of the present disclosure is to provide a control system that uses road surface recognition (e.g., recognition of hydroplaning or black ice) of a moving vehicle to accurately determine road surface conditions using multiple road surface information provided in real time from multiple moving vehicles, displays road surface condition information including hydroplaning or black ice as audio or visual information to alert the driver, and enables the vehicle to control its own driving information even if the driver is not paying attention, and a method using the same. [Means for solving the problem]

[0014] According to one embodiment of the present disclosure, a control system CS using road surface recognition (e.g., hydroplaning or black ice recognition) for a moving vehicle may include an in-vehicle device 100 that transmits road surface information "d" including real-time position information and road surface image information of a moving vehicle "A" to a central management server 200; and the central management server 200 that determines road surface conditions in real time based on the road surface information "d" received from the in-vehicle device 100 and transmits road surface condition information to the in-vehicle device 100.

[0015] The in-vehicle device 100 may include an image capturing unit 110 mounted on the moving vehicle "A" and continuously capturing road surface image information; a GPS (Global Positioning System) unit 120 that recognizes in real time the position information of the road surface captured by the image capturing unit 110; a data packaging unit 130 that packages the real-time position information of the moving vehicle "A" and the road surface image information; a data transmission / reception unit 140 that transmits the packaged road surface information "d" to the central management server 200 and receives real-time road surface condition information from the central management server 200; and a display unit 150 that visually outputs the real-time road surface condition information.

[0016] The in-vehicle device 100 further includes: a driving control unit 160 for controlling driving information of the vehicle "A" based on the road surface condition information received from the central management server 200 and based on the real-time position information; The present invention may also include:

[0017] The central management server 200 may also include a feature vector extraction unit 210 that extracts a feature vector based on the transmitted real-time road surface information "d"; a road surface condition determination unit 220 that determines the road surface condition by extracting the real-time feature vector extracted by the feature vector extraction unit 210 and the feature vectors of a dry road surface, a wet road surface, an icy road surface, or a snow-covered road surface stored in a database "D" and calculating the similarity between the feature vectors; and a communication unit 240 that transmits the determined real-time road surface condition information to the vehicle "A" and receives the road surface information "d" from the traveling vehicle "A".

[0018] In addition, the road surface condition determination unit 220 can determine the local road surface condition in units of 1 m or less, and determine the road surface condition based on the predetermined length L by verifying the validity of the accumulated local road surface condition for the predetermined length L.

[0019] The road surface condition determination unit 220 can also verify the validity based on the reliability of the road surface information "d" received from multiple vehicles "A".

[0020] In addition, the central management server 200 may further include an image conversion unit 230, which converts the determined real-time road surface condition information into image information for display on a driving route map.

[0021] According to another embodiment of the present disclosure, a control method using road surface recognition for a moving vehicle may include the following steps: a road surface information transmitting step (S10) in which road surface information "d", including real-time position information and road surface image information of a moving vehicle "A", is transmitted to a central management server 200 by the in-vehicle device 100; a road surface condition determining step (S20) in which the central management server 200 determines the road surface condition in real time based on the road surface information "d"; and a road surface condition transmitting step (S30) in which the central management server 200 transmits the determined road surface condition information to the in-vehicle device 100.

[0022] Furthermore, the step of transmitting the road surface information (S10) may include a step of continuously capturing the road surface image information and recognizing the position information by the in-vehicle device 100 (S11); a step of packaging the real-time position information of the moving vehicle "A" and the road surface image information by the in-vehicle device 100 (S12); and a step of transmitting the packaged road surface information "d" to the central management server 200 by the in-vehicle device 100 (S13).

[0023] Furthermore, the step of determining the road surface condition (S20) may include a step of extracting a feature vector based on the received real-time road surface information "d" by the central management server 200 (S21); a step of determining the road surface condition by calculating a similarity between the extracted real-time feature vector and a feature vector of a dry road surface, a wet road surface, a frozen road surface, or a snow-covered road surface stored in a database "D" by the central management server 200 (S22); and a step of converting the determined real-time road surface condition information by the central management server 200 for display as image information on a driving route map (S24).

[0024] Furthermore, the method may further include, after the step of transmitting the road surface condition (S30), a step of controlling driving (S40) in which the in-vehicle device 100 controls driving information of the vehicle "A" based on the received road surface condition information and based on the real-time position information. Effect of the Invention

[0025] As described above, in the control system CS using road surface recognition (e.g., recognition of hydroplaning or black ice) of a moving vehicle according to the present disclosure, and the method "M" using the same, an on-board device attached to a moving vehicle can transmit road surface information including real-time position information and road surface image information to a central management server, thereby enabling the central management server to accurately determine the condition of the road surface using multiple pieces of road surface information provided in real time.

[0026] In addition, by packaging real-time position information of moving vehicles with road surface image information, it is possible to accurately recognize the road surface conditions at each location without error.

[0027] Furthermore, the road surface condition judgment unit can reduce the possibility of errors in judging the road surface conditions by verifying the validity of local road surface conditions based on the reliability of road surface information received from multiple vehicles.

[0028] In addition, the image conversion unit converts the determined real-time road surface condition information into image information for display on a driving route map, and by visually providing the road surface condition information to the driver, it can alert the driver and provide audio information if necessary.

[0029] In addition, the driving control unit can independently control driving information such as vehicle speed, gear ratio, driving mode, etc. based on the transmitted road surface condition information and real-time position information, which is expected to improve driving safety.

[0030] In the embodiment, the road surface condition determination unit comprehensively considers the temperature / humidity information and the road surface image information, thereby significantly reducing the possibility of an error occurring and enabling more accurate road surface condition determination. [Brief description of the drawings]

[0031] [Figure 1]1 is a block diagram showing an overall configuration of a control system using road surface recognition for a traveling vehicle according to an embodiment of the present disclosure. [Diagram 2] 1 is a block diagram showing an overall configuration of a control system using road surface recognition for a traveling vehicle according to an embodiment of the present disclosure. [Diagram 3] 1 is a conceptual diagram for explaining a configuration of an in-vehicle device according to an embodiment of the present disclosure. [Figure 4] FIG. 2 is a conceptual diagram for explaining the overall configuration of a central management server according to an embodiment of the present disclosure. [Diagram 5] FIG. 2 is a conceptual diagram illustrating an image capturing unit and its image information according to one embodiment of the present disclosure. [Figure 6] 1 is a conceptual diagram for explaining a probability distribution of a luminance component used by a road surface condition determination unit according to one embodiment of the present disclosure. [Figure 7] 1 is an image showing road surface condition information displayed on a driving route map according to one embodiment of the present disclosure. [Figure 8] FIG. 13 is a block diagram showing, in time series, a control method using road surface recognition for a traveling vehicle according to another embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0032] (Best mode of invention) Hereinafter, the embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. The embodiments of the present disclosure can be modified in various ways, and the scope of the present disclosure should not be construed as being limited to the following embodiments. These embodiments are provided to more completely explain the present disclosure to those skilled in the art.

[0033] As shown in Fig. 1, a control system CS using road surface recognition (e.g., hydroplaning or black ice recognition) of a moving vehicle according to the present disclosure may determine a road surface condition using road surface information "d" including real-time position information and road surface image information obtained from a moving vehicle "A" and may return the determined road surface condition information to the moving vehicle "A". As shown in Fig. 2, the control system CS may receive road surface information "d" from multiple vehicles "A" and determine the road surface condition. Thus, the road surface condition can be accurately determined, and multiple moving vehicles "A" can share the road surface condition information with each other.

[0034] For this purpose, a control system CS using road recognition (e.g. hydroplaning or black ice recognition) for a moving vehicle according to the present disclosure may comprise an in-vehicle device 100 and a central management server 200. Furthermore, said control system CS may have a database "D" containing accumulated position-wise road image information and corresponding feature vectors received from a number of vehicles "A", said database "D" may contain accumulated temperature / humidity information for each position according to one embodiment.

[0035] Here, the database "D", the in-vehicle device 100, and the central management server 200 can transmit and receive information to and from each other via a communication network, and the communication network for connecting the devices may use an internal network, wired / wireless Internet, LTE (Long Term Evolution), long-distance wireless communication (LoRa) using a sensor node, etc. However, since the in-vehicle device 100 is attached to a vehicle "A" and may move in real time, it is preferable that the in-vehicle device 100 and the central management device 200 transmit and receive information to and from each other via a mobile communication network.

[0036] Hereinafter, each component included in the control system CS using road surface recognition (for example, recognition of hydroplaning or black ice) for a moving vehicle according to the present disclosure will be described in detail.

[0037] The in-vehicle device 100 may be a device that transmits road surface information "d" including real-time position information of a traveling vehicle "A" and road surface image information to the central management server 200, and as shown in Fig. 3, includes an image capturing unit 110, a GPS (global positioning system) unit 120, a data packaging unit 130, a data transmission / reception unit 140, and a display unit 150. The in-vehicle device 100 may be mounted on a vehicle as a separate part, and can communicate with the central management server 200 in cooperation with a driver's mobile terminal.

[0038] In this specification, the in-vehicle device 100 described in the specification of the present disclosure has a central processing unit and a memory, and the "unit" described indicates a "block configured to modify or plug into a hardware or software system", i.e., a unit or block that performs a specific function in hardware or software.

[0039] The image capturing unit 110 is attached to a traveling vehicle "A" and is capable of continuously capturing road surface image information along the traveling route, and is preferably configured to capture a specific area that is less susceptible to the effects of direct sunlight or reflected light.

[0040] Meanwhile, according to a preferred embodiment of the road surface condition determination unit 220 described later, the road surface condition determination unit 220 uses a luminance component distribution to predict road surface condition information, so in order to obtain pure road surface image information, it may be necessary to eliminate external factors that affect color values ​​and luminance values. Therefore, the image capture unit 110 may need to be installed in a location with little interference from reflections of adjacent objects on the road, etc. Also, the image capture unit 110 may need to be free from external light interference or shading and not exposed to direct sunlight.

[0041] 5A, the image capturing unit 110 may be provided with a sunshade 113 so as to be as well ventilated as possible and absorb as much sunlight as possible while blocking direct sunlight. It is preferable that the sunshade 113 covers three sides of the vehicle's camera lens 111, namely, the front, left side, and right side, so as to block direct sunlight regardless of the direction of the traveling vehicle "A".

[0042] On the other hand, the road surface image information captured by the image capturing unit 110 may be recognized as having a different color, brightness, or shape due to distortion caused by reflected light or shadows, which are different from the original color, brightness, and shape. For example, recognition of the road surface condition may be hindered not only by cloudy days but also by clouds on sunny days, in addition to various other factors such as light reflection, vehicle lights at night, and refraction. Therefore, various distortions due to reflection or refraction may occur on wet roads, icy roads, snow-covered roads, etc., and a polarizing filter 112 may be used in front of the lens 111 to suppress these errors.

[0043] In addition, the polarizing filter 112 is preferably a horizontal polarizing filter, and can remove reflected light having a vertical polarization component from the light that has passed through the horizontal polarizing filter, thereby suppressing glare and improving the contrast of an object. In this way, the polarizing filter 112 can be used to remove unnecessary external reflected light to make an object clearer, or can be used to remove reflected light from a glossy surface.

[0044] As shown in Fig. 5A, in the present disclosure, the polarizing filter 112 may be provided only on one side in front of the lens 111 of the image capturing unit 110. According to the above-described embodiment, as shown in Fig. 5B, the image capturing unit 110 can simultaneously capture road surface image information polarized by the polarizing filter 112 and original unpolarized road surface image information.

[0045] During the day, the brightness of the road surface may be high due to light reflection, and during rainy weather, the brightness of the road surface may be lower than the actual brightness due to the reflected light of nearby dark objects. Therefore, in the present disclosure, based on the polarizing filter 112 provided in front of the camera lens 111, polarized road surface image information and original unpolarized road surface image information are simultaneously obtained, and distortion and interference of image information caused by the external environment are suppressed, and the road surface condition determination unit 220 described later can determine road surface condition information by comparing the brightness component distribution of each information or by comparing moment components through multi-dimensional small field segmentation.

[0046] Meanwhile, the GPS unit 120 recognizes the GPS position information of the traveling vehicle "A" in real time, and can continuously recognize the position information of the road surface captured by the image capturing unit 110. As shown in Fig. 2, in order to provide the position information of each vehicle "A", a geographic information system GIS may be required that converts the position coordinates received from a satellite using a GPS (Global Positioning System) into place names and transmits them.

[0047] Here, as road surface information “d”, the data packaging unit 130 can package together the real-time position information of the moving vehicle “A” recognized by the GPS unit 120 and the road surface image information captured by the image capturing unit 110.

[0048] The data transceiver unit 140 can then transmit the packaged road surface information "d" to the central management server 200 and receive real-time road surface condition information from the central management server 200. As described above, the data transceiver unit 140 can exchange information in real time using a mobile communication network even if the position of the vehicle "A" is continuously changing, and may be a mobile terminal of the driver.

[0049] Furthermore, the display unit 150 can visually output real-time road surface condition information. According to one embodiment, as shown in FIG. 7, the display unit 150 can display "snowy road surface", "frozen road surface", "wet road surface" or "dry road surface" in a specific color on a driving route map based on road surface condition information determined in real time. The display unit 150 can also provide the road surface condition information as audio information together with or separately from the visual information to attract the driver's attention.

[0050] Meanwhile, the central management server 200 can determine the road surface condition in real time based on the road surface information "d" received from the vehicle-mounted device 100, and transmit the road surface condition information to the vehicle-mounted device 100. As shown in Fig. 4, the central management server 200 can include a feature vector extraction unit 210, a road surface condition determination unit 220, an image conversion unit 230, and a communication unit 240. Also, as shown in Fig. 2, the central management server 200 is disposed in a central control station C, and can monitor and manage road surface condition information in real time.

[0051] The feature vector extraction unit 210 can extract feature vectors based on the transmitted real-time road surface information "d". The road surface condition determination unit 220 can extract the real-time feature vectors extracted by the feature vector extraction unit 210 and feature vectors of dry road surfaces, wet road surfaces, frozen road surfaces, or snow-covered road surfaces stored in a database "D", and calculate the similarity between these feature vectors to determine the road surface condition.

[0052] More specifically, the feature vector of the road surface image information compared by the road surface condition judgment unit 220 may be based on the brightness component distribution in the road surface image information passed through the polarizing filter 112 and multidimensional small field segmentation for analyzing the texture in the road surface image information.

[0053] 6 is a conceptual diagram for explaining the probability distribution of luminance components (or luminance component distribution) used by the road surface condition determination unit according to the embodiment of the present disclosure. When a road surface image is analyzed on the premise of an environment with little image distortion such as light reflection or shadow, as shown in FIG. 6A, the probability distribution of road surface luminance components in the same road surface condition may not be widely distributed.

[0054] On the other hand, when the probability distributions of the luminance components for different road surface conditions are compared with each other, a horizontal shift occurs in the distributions, as shown in Fig. 6B. Using this property, the luminance components can be used as feature vectors to determine the road surface condition. More specifically, the minimum commonality between the luminance component distribution of the obtained road surface image information and the luminance component distributions stored in the database "D" can be defined as a feature vector and extracted to obtain the similarity in the luminance component distributions.

[0055] On the other hand, in one embodiment, the feature vector extraction unit 210 extracts the average value of the feature vector for each wavelength range to prevent errors caused by localized foreign objects or dirt on the road surface, and the road surface condition determination unit 220 can calculate the similarity between the average value of the feature vector for each wavelength range and the feature vector stored in the database “D”.

[0056] The feature vector extraction unit 210 extracts statistical moment vectors of the luminance component distribution in the road surface image information, and further extracts low-pass or high-pass moment vectors based on multi-dimensional small-field segmentation of the luminance component distribution as feature vectors, i.e., feature vectors of each wavelength:

number

[0057] Hereinafter, the moment vector is defined as follows:

number

[0058] In one embodiment, the feature vector extraction unit 210 can subdivide image information in units of blocks, and divide the image information region into M×M block units based on the Daubechies wavelet filter, and perform wavelet transformation locally. Assuming that n-stage wavelet transformation is performed in each block B, the angular moment of the subband direction can be calculated as follows, and normalized to the representative value of the entire space, and calculated as the feature vector value of the entire wavelet moment of the sample:

number

[0059] In addition, the road surface condition determination unit 220 can provide more accurate road surface condition information by additionally calculating the similarity between the divided moment vectors and the moment feature vectors stored in the database "D". In one embodiment, it is preferable to calculate the obtained feature vector as an absolute sum of the L2 distance function for each component and compare the similarity between the feature vectors.

[0060] During the day, there may be more reflections on a "wet" or "icy" road than on a "dry" road, whereas at night there may be more reflections on a "dry" road. Thus, the polarized road image information and the original road image information may show different aspects with respect to the reflection of nearby light, etc.

[0061] Therefore, in one embodiment in which the image capturing unit 110 simultaneously captures polarized road surface image information and unpolarized original road surface image information as shown in FIG. 5, the mean square error MSE is calculated for the two image information, and based on this calculation, the weighting for the "frozen road surface" or "wet road surface" can be increased when the difference in the brightness component distribution is relatively large.

[0062] In one embodiment, the MSE is calculated as two adjacent regions in the original road image information and the polarized road image information, each having a size of:

number

number

number

[0063] Meanwhile, the road surface condition determination unit 220 determines the local road surface condition in units of 1 m or less, and verifies the validity of the accumulated local road surface condition for the predetermined length L, thereby being able to determine the road surface condition based on the predetermined length L. Here, in verifying the validity, as described above, the road surface condition determination unit 220 analyzes the original road surface image information and the polarized road surface image information to determine the presence or absence of an error, and is able to derive the road surface condition in units of the predetermined length L based on the continuity and quantitativeness of the local image information of 1 m or less that has been found to be valid.

[0064] The road surface condition determination unit 220 can verify the validity based on the reliability of the road surface information "d" received from a plurality of vehicles "A". For example, based on the road surface information "d" in which position information and image information are packaged, the road surface condition determination unit 220 can recognize the reliability when image information corresponding to position information within a certain distance is accumulated N times or more within a set time, and process the corresponding position information as valid road surface condition information.

[0065] Meanwhile, the image conversion unit 230 may convert the real-time road surface condition information determined by the road surface condition determination unit 220 to display it as image information on a driving route map, and visually output the real-time road surface condition information to a driver through a display unit or a navigation device integrally formed in the vehicle "A", or a display unit 150 of another mobile terminal. According to one embodiment, as shown in Fig. 7, "snowy road", "frozen road", "wet road" or "dry road" may be displayed in a specific color on the driving route map based on the road surface condition information determined in real time.

[0066] In addition, the communication unit 240 can transmit the determined real-time road surface condition information to the vehicle "A" and receive road surface information "d" from the moving vehicle "A", and transmit and receive the road surface condition information and road surface information "d" via a base station for long-distance communication.

[0067] Meanwhile, in one embodiment of the present disclosure, the in-vehicle device 100 may include a driving control unit 160 that controls driving information of the vehicle "A" based on road surface condition information received from the central management server 200 and based on real-time position information.

[0068] The driving control unit 160 may be an electronic control unit (ECU) or a microcontroller unit (MCU) disposed in the vehicle "A", and independently controls the vehicle speed, gear ratio, driving mode, etc. as driving information of the vehicle "A" based on road surface condition information received from the central management server 200. Therefore, improvement of driving safety can be expected.

[0069] In one embodiment, when performing cruise control, the cruise control unit 160 maintains the driving speed set by the driver when the road surface is "dry," and automatically controls the driving speed to a predetermined speed for each road surface condition when the road surface is "snow-covered," "frozen," or "wet," thereby ensuring driving safety even if the driver is momentarily inattentive.

[0070] Meanwhile, the central management server 200 according to the present disclosure may further include a road surface condition verification unit 250. The road surface condition verification unit 250 may additionally verify road surface condition information determined by comprehensively considering temperature / humidity information and road surface image information.

[0071] In addition, the road surface condition verification unit 250 can additionally verify the road surface condition information determined by the road surface condition determination unit 220 by including real-time temperature / humidity information provided by the moving vehicle "A" in the temperature / humidity information in the road surface information "d" based on the temperature / humidity information, location information, and road surface image information received from the in-vehicle device 100.

[0072] The main factors that cause roads to freeze in winter are condensation water on the road surface and temperature. Therefore, the road surface condition verification unit 250 can additionally verify road surface condition information by estimating a dew point temperature based on temperature / humidity information received from each traveling vehicle "A" and comparing the real-time temperature with the dew point temperature.

[0073] Hereinafter, a control method "M" using road surface recognition (e.g., recognition of hydroplaning or black ice) for a moving vehicle according to the present disclosure will be described. As shown in Fig. 8, the control method "M" using road surface recognition for a moving vehicle according to the present disclosure is a method for determining a road surface condition using road surface information "d" including real-time position information and road surface image information acquired from a moving vehicle "A", and returning the determined road surface condition information to the moving vehicle "A". This method may include a step of transmitting road surface information (S10), a step of determining the road surface condition (S20), and a step of transmitting the road surface condition (S30).

[0074] The step of transmitting road surface information (S10) is a step of transmitting road surface information “d”, which includes real-time position information of the traveling vehicle “A” and road surface image information, to the central management server 200 by the on-vehicle device 100.

[0075] In detail, the image capturing unit 110 of the in-vehicle device 100 continuously captures road surface image information from a traveling vehicle "A", and at the same time, the GPS (Global Positioning System) unit 120 can recognize the position information of the captured road surface (S11).

[0076] The packaging unit 130 of the in-vehicle device 100 may package the real-time position information of the moving vehicle "A" and the road surface image information so as to match each other (S12), and the data transceiver unit 140 of the in-vehicle device 100 may transmit the packaged road surface information "d" to the central management server 200 (S13).

[0077] Meanwhile, the step of determining the road surface condition (S20) is a step of determining the road surface condition in real time by the central management server 200 based on the road surface recognition (d).

[0078] More specifically, the feature vector extraction unit 210 of the central management server 200 may extract a feature vector based on the real-time road surface information “d” received from the vehicle-mounted device 100 (S21). The road surface condition determination unit 220 of the central management server 200 may extract the extracted real-time feature vector and the feature vectors of a dry road surface, a wet road surface, an icy road surface, or a snow-covered road surface stored in a database “D”, and calculate the similarity between the feature vectors to determine the road surface condition (S22).

[0079] In another embodiment, the road surface condition verification unit 250 of the central management server 200 may additionally verify the determined road surface condition information by comprehensively considering the temperature / humidity information and the road surface image information (S23).

[0080] In addition, the road surface condition verification unit 250 may additionally verify the road surface condition information determined by the road surface condition determination unit 220 by including real-time temperature / humidity information provided by the moving vehicle "A" in the temperature / humidity information in the road surface information "d" based on the temperature / humidity information, location information, and road surface image information received from the in-vehicle device 100.

[0081] Furthermore, the image conversion unit 230 of the central management server 200 may convert the determined real-time road surface condition information for display as image information on a driving route map through a display unit attached to the driving vehicle "A" (S24).

[0082] The step of transmitting the road surface condition (S30) is a step in which the communication unit 240 of the central management server 200 transmits the determined road surface condition information to the vehicle-mounted device 100, and the display unit 150 of the vehicle-mounted device 100 outputs the road surface condition information transmitted in real time as visual information or audio information.

[0083] As shown in FIG. 7, the display unit 150 can display "snowy road", "frozen road", "wet road" or "dry road" in a specific color on a driving route map based on road surface condition information determined in real time, or can provide the road condition information as audio information to alert the driver.

[0084] Furthermore, in another embodiment, the method may further include, after the step of transmitting the road surface condition (S30), a step of controlling driving (S40) by the in-vehicle device 100 based on the received road surface condition information, in which the driving information of the vehicle "A" is controlled based on real-time position information.

[0085] The driving control unit 160 of the in-vehicle device 100 may be an electronic control unit (ECU) or a microcontroller unit (MCU) disposed in the vehicle "A", and independently controls the vehicle speed, gear ratio, driving mode, etc. as driving information of the vehicle "A" based on road surface condition information received from the central management server 200. The driving control unit 160 may control the speed by performing cruise control.

[0086] In this specification, the technical contents are illustrated and described mainly with respect to the embodiment of the present disclosure relating to a control system (CS) using road surface recognition (e.g., recognition of hydroplaning or black ice) for a traveling vehicle and a method "M" using the same. However, the present disclosure may be modified or changed in various ways by a person skilled in the art to which the present disclosure pertains, by adding, changing, deleting, or supplementing components, without departing from the scope and spirit of the present disclosure disclosed in the appended claims. These modifications should also be understood to be within the scope of the present disclosure.

[0087] Furthermore, in the description of the embodiments of the present disclosure, detailed descriptions of known functions or configurations related to the present disclosure are omitted if it is determined that such detailed descriptions may unnecessarily obscure the gist of the present disclosure. Furthermore, the terms used in this specification are defined in consideration of the functions in the embodiments of the present disclosure, and may be interpreted differently depending on the intentions, practices, etc. of the user or operator. Therefore, the terms should be defined based on their contents throughout this specification. Therefore, the detailed description of the present disclosure described above is not intended to limit the present disclosure to the disclosed embodiments, and the appended claims should be interpreted to include other embodiments.

Claims

1. A control system using road surface recognition for a moving vehicle, an in-vehicle device 100 that transmits road surface information “d” including real-time position information and road surface image information of a traveling vehicle “A” to a central management server 200; and the central management server 200, which determines the road surface condition in real time based on the road surface information "d" received from the in-vehicle device 100 and transmits the road surface condition information to the in-vehicle device 100; Equipped with The in-vehicle device 100, an image capturing unit 110 mounted on the traveling vehicle "A" for continuously capturing road surface image information; a GPS (Global Positioning System) unit 120 that recognizes in real time the position information of the road surface captured by the image capturing unit 110; a data packaging unit 130 for packaging the real-time position information of the moving vehicle "A" and the road surface image information; a data transceiver unit 140 for transmitting the packaged road surface information "d" to the central management server 200 and receiving the real-time road surface condition information from the central management server 200; and A display unit 150 for visually outputting the real-time road surface condition information; Equipped with The central management server 200 a feature vector extraction unit 210 for extracting a feature vector based on the transmitted real-time road surface information “d”; a road surface condition determining unit 220 for determining a road surface condition by extracting the real-time feature vector extracted by the feature vector extracting unit 210 and feature vectors of dry, wet, icy or snowy road surfaces stored in a database "D" and calculating the similarity between the feature vectors; and a communication unit 240 for transmitting the determined real-time road surface condition information to the vehicle "A" and for receiving the road surface information "d" from the moving vehicle "A"; Equipped with The road surface condition determination unit 220 includes: Two adjacent regions in the original road surface image information and the polarized road surface image information have sizes: [0010] For two regions "B" and "P" having [0025] as a mean square error and assigning a weight to the frozen surface or the wet surface.

2. The in-vehicle device 100, The system of claim 1 , further comprising a driving control unit 160 for controlling driving information of the vehicle "A" based on the real-time position information based on the road surface condition information received from the central management server 200 .

3. 2. The system of claim 1, wherein the road surface condition determination unit 220 determines the local road surface condition in units of 1 m or less, and determines the road surface condition based on the predetermined length L by verifying the validity of the accumulated local road surface condition for the predetermined length L.

4. The system according to claim 3 , wherein the road surface condition determination unit 220 verifies the validity based on the reliability of the road surface information “d” received from a plurality of the vehicles “A”.

5. The central management server 200 an image conversion unit 230 for converting the determined real-time road surface condition information into image information for display on a driving route map; The system of claim 1 further comprising:

6. A control method using road surface recognition for a traveling vehicle, comprising: Transmitting road surface information "d" including real-time position information of the traveling vehicle "A" and road surface image information to the central management server 200 by the in-vehicle device 100 (S10); The central management server 200 determines the road surface condition in real time based on the road surface information "d" (S20); The central management server 200 transmits the determined road surface condition information to the vehicle-mounted device 100 (S30); Including, Determining the road surface condition (S20), Extracting a feature vector based on the received real-time road surface information “d” by the central management server 200 (S21); Determining the road surface condition by calculating the similarity between the extracted real-time feature vector and the feature vectors of dry, wet, icy or snowy road surfaces stored in a database "D" by the central management server 200 (S22); and The central management server 200 converts the determined real-time road surface condition information into image information for display on a driving route map (S24); Including, determining the road surface condition by calculating a similarity between the extracted real-time feature vectors (S20); Two adjacent regions in the original road surface image information and the polarized road surface image information have sizes: [0030] For two regions "B" and "P" having [0045] as the mean squared error, and assigning a weight to the frozen or wet road surface; A method comprising:

7. Transmitting the road surface information (S10), The vehicle-mounted device 100 continuously captures the road surface image information and recognizes the position information (S11); and The on-vehicle device 100 packages the real-time position information of the traveling vehicle "A" and the road surface image information (S12); and The on-vehicle device 100 transmits the packaged road surface information “d” to the central management server 200 (S13); The method of claim 6, comprising:

8. After transmitting the road surface condition (S30), the vehicle-mounted device 100 controls the driving information of the vehicle "A" based on the real-time position information based on the received road surface condition information (S40). The method of claim 6 further comprising:

Citation Information

Patent Citations

  • Road surface condition discriminating device and road surface condition discriminating method

    JP2002310896A

  • Detection device, detection method and detection program

    JP2018025528A

  • Information processing system, program, and information processing method

    JP2020101924A

  • System and method for road health monitoring using mobile communication and wireless communication

    KR1020090022127A