Road condition image processing method and device, vehicle and storage medium

Abstract

The embodiment of the invention relates to a road condition image processing method and device, a vehicle and a storage medium. The method comprises the steps that a current road condition image in the vehicle driving direction is acquired; image enhancement processing is conducted on the current road condition image, a processed image is generated, the position of an object in the processed image is matched with the position of an object in a perspective image, and the perspective image is a perspective image in a front windshield of the vehicle; and projecting the processed image to the front windshield. Therefore, under the condition that the front windshield cannot see through the image or the see-through image is not clear, the processed image of the current road condition image is displayed on the front windshield in a projection mode, and therefore the safety of vehicle driving in the scene can be improved.

Description

Technical Field

[0001] This application relates to the technical field of vehicles, and particularly to a method and apparatus for processing road condition images, a vehicle, and a storage medium. Background Art

[0002] With the continuous development of vehicle technology, drivers' requirements for driving safety and comfort are increasing day by day. Traditional driving information display methods, such as instrument panels and central control displays, although they can provide rich vehicle information, drivers need to shift their line of sight when viewing this information, increasing driving risks. Especially in extreme environments, it is more necessary to distract the driver's attention during driving, further reducing the safety of vehicle driving.

[0003] It can be seen that how to improve the safety of vehicle driving is a technical problem worthy of attention. Summary of the Invention

[0004] In view of this, to solve the above-mentioned part or all of the technical problems, embodiments of this application provide a method and apparatus for processing road condition images, a vehicle, and a storage medium.

[0005] In a first aspect, embodiments of this application provide a method for processing road condition images, the method including:

[0006] Obtain a current road condition image in the driving direction of the vehicle;

[0007] Generate a processed image by performing image enhancement processing on the current road condition image, where the position of an object in the processed image matches the position of the object in a perspective image, and the perspective image is an image perspective through the front windshield of the vehicle;

[0008] Project the processed image onto the front windshield.

[0009] In a possible implementation, before obtaining the current road condition image in the driving direction of the vehicle, the method further includes:

[0010] Determine the current rainfall at the position where the vehicle is located through a rain sensor of the vehicle;

[0011] Determine whether the current rainfall is greater than or equal to a preset rainfall threshold; and

[0012] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0013] When the current rainfall is greater than or equal to the rainfall threshold, obtain the current road condition image in the driving direction of the vehicle.

[0014] In a possible implementation, before obtaining the current road condition image in the driving direction of the vehicle, the method further includes:

[0015] Determining whether the windshield wiper of the vehicle meets a preset trigger condition; and

[0016] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0017] When the windshield wiper meets the trigger condition, obtaining the current road condition image in the driving direction of the vehicle.

[0018] In a possible implementation, before obtaining the current road condition image in the driving direction of the vehicle, the method further includes:

[0019] Determining whether a preset switch of the vehicle is triggered; and

[0020] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0021] When the preset switch is triggered, obtaining the current road condition image in the driving direction of the vehicle.

[0022] In a possible implementation, before obtaining the current road condition image in the driving direction of the vehicle, the method further includes:

[0023] Determining whether the front windshield of the vehicle is in an obscured state; and

[0024] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0025] When the front windshield is in the obscured state, obtaining the current road condition image in the driving direction of the vehicle.

[0026] In a possible implementation, the performing of image enhancement processing on the current road condition image includes at least one of the following:

[0027] Performing image enhancement processing on the current road condition image by increasing the contrast;

[0028] Performing image enhancement processing on the current road condition image by increasing the sharpness;

[0029] Performing image enhancement processing on the current road condition image by denoising.

[0030] In a possible implementation, before obtaining the current road condition image in the driving direction of the vehicle, the method further includes:

[0031] Detecting the current light intensity at the location where the vehicle is located;

[0032] Determine the exposure parameter of the front camera of the vehicle based on the current light intensity; and

[0033] The obtaining the current road condition image in the driving direction of the vehicle includes:

[0034] Control the front camera to collect an image with the exposure parameter to obtain the current road condition image in the driving direction of the vehicle.

[0035] In a possible implementation manner, the projecting the processed image onto the front windshield includes:

[0036] Adopt head-up display technology to project the processed image onto the front windshield.

[0037] In a possible implementation manner, the processed image has the same scaling ratio as the perspective image.

[0038] In a possible implementation manner, the obtaining the current road condition image in the driving direction of the vehicle includes:

[0039] Obtain the mirror angle and projection distance of the projector in the vehicle, where the projector is used to project the processed image onto the front windshield of the vehicle;

[0040] Based on the mirror angle and the projection distance, determine the field of view angle and focal length of the camera;

[0041] Use the camera with the field of view angle and the focal length to obtain the current road condition image in the driving direction of the vehicle.

[0042] In some optional implementation manners of this embodiment, the performing image enhancement processing on the current road condition image includes:

[0043] Collect the perspective image in the front windshield of the vehicle to obtain a perspective image;

[0044] Determine the image area with the highest similarity to the perspective image from the current road condition image;

[0045] Adjust the size of the image area to the size of the perspective image, and determine the processed image based on the image area after size adjustment.

[0046] In a second aspect, an embodiment of the present application provides a device for processing a road condition image, and the device includes:

[0047] An obtaining unit, configured to obtain a current road condition image in the driving direction of the vehicle;

[0048] A generating unit, configured to generate a processed image by performing image enhancement processing on the current road condition image, wherein the position of an object in the processed image matches the position of the object in a perspective image, and the perspective image is an image seen through the front windshield of the vehicle;

[0049] A projection unit, configured to project the processed image onto the front windshield.

[0050] In a possible implementation manner, before acquiring the current road condition image in the driving direction of the vehicle, the device further includes:

[0051] A first determination unit, configured to determine the current rainfall at the position where the vehicle is located through a rainfall sensor of the vehicle;

[0052] A second determination unit, configured to determine whether the current rainfall is greater than or equal to a preset rainfall threshold; and the acquiring of the current road condition image in the driving direction of the vehicle includes:

[0053] When the current rainfall is greater than or equal to the rainfall threshold, acquiring the current road condition image in the driving direction of the vehicle.

[0054] In a possible implementation manner, before acquiring the current road condition image in the driving direction of the vehicle, the device further includes:

[0055] A third determination unit, configured to determine whether the windshield wiper of the vehicle meets a preset triggering condition; and

[0056] The acquiring of the current road condition image in the driving direction of the vehicle includes:

[0057] When the windshield wiper meets the triggering condition, acquiring the current road condition image in the driving direction of the vehicle.

[0058] In a possible implementation manner, before acquiring the current road condition image in the driving direction of the vehicle, the device further includes:

[0059] A fourth determination unit, configured to determine whether a preset switch of the vehicle is triggered; and

[0060] The acquiring of the current road condition image in the driving direction of the vehicle includes:

[0061] When the preset switch is triggered, acquiring the current road condition image in the driving direction of the vehicle.

[0062] In a possible implementation manner, before acquiring the current road condition image in the driving direction of the vehicle, the device further includes:

[0063] A fifth determination unit, configured to determine whether the front windshield of the vehicle is in an occluded state; and

[0064] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0065] When the front windshield is in the occluded state, obtaining the current road condition image in the driving direction of the vehicle.

[0066] In a possible implementation manner, the performing image enhancement processing on the current road condition image includes at least one of the following:

[0067] Performing image enhancement processing on the current road condition image by means of increasing the contrast;

[0068] Performing image enhancement processing on the current road condition image by means of increasing the sharpness;

[0069] Performing image enhancement processing on the current road condition image by means of denoising processing.

[0070] In a possible implementation manner, before the obtaining of the current road condition image in the driving direction of the vehicle, the device further includes:

[0071] A detection unit, configured to detect the current light intensity at the position where the vehicle is located;

[0072] A sixth determination unit, configured to determine the exposure parameter of the front camera of the vehicle based on the current light intensity; and

[0073] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0074] Controlling the front camera to collect an image with the exposure parameter to obtain the current road condition image in the driving direction of the vehicle.

[0075] In a possible implementation manner, the projecting the processed image onto the front windshield includes:

[0076] Adopting a head-up display technology to project the processed image onto the front windshield.

[0077] In a possible implementation manner, the processed image has the same scaling ratio as the perspective image.

[0078] In a possible implementation manner, the obtaining of the current road condition image in the driving direction of the vehicle includes:

[0079] Obtaining the mirror angle and projection distance of a projector in the vehicle, where the projector is used to project the processed image onto the front windshield of the vehicle;

[0080] Determine the field of view angle and focal length of the camera based on the mirror angle and the projection distance;

[0081] Use the camera with the field of view angle and the focal length to obtain a current road condition image in the vehicle driving direction.

[0082] In some optional implementation manners of this embodiment, the performing image enhancement processing on the current road condition image includes:

[0083] Collect the image seen through the front windshield of the vehicle to obtain a perspective image;

[0084] Determine, from the current road condition image, an image area with the highest similarity to the perspective image;

[0085] Adjust the size of the image area to the size of the perspective image, and determine a processed image based on the image area after size adjustment.

[0086] In a third aspect, an embodiment of the present application provides a vehicle, including:

[0087] A memory for storing a computer program;

[0088] A processor for executing the computer program stored in the memory, and when the computer program is executed, implementing the method of any one of the embodiments of the road condition image processing method in the first aspect of the present application.

[0089] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, implementing the method of any one of the embodiments of the road condition image processing method in the first aspect as described above.

[0090] In a fifth aspect, an embodiment of the present application provides a computer program product, the computer program product includes computer-readable code, and when the computer-readable code runs on a device, enabling a processor in the device to implement the method of any one of the embodiments of the road condition image processing method in the first aspect as described above.

[0091] The method for processing a road condition image provided by an embodiment of the present application can obtain a current road condition image in the driving direction of a vehicle. Then, by performing image enhancement processing on the current road condition image, a processed image is generated, wherein the position of an object in the processed image matches the position of the object in a perspective image, and the perspective image is the image seen through the front windshield of the vehicle. Then, the processed image is projected onto the front windshield. Thus, in the case where the front windshield cannot see through an image or the seen-through image is unclear, the processed image of the current road condition image can be displayed on the front windshield by means of projection, thereby improving the driving safety of the vehicle in the above scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0092] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present application and, together with the specification, are used to explain the principles of the present application.

[0093] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, other accompanying drawings can be obtained based on these accompanying drawings without creative efforts.

[0094] One or more embodiments are exemplarily illustrated by the pictures in the corresponding accompanying drawings. These exemplary illustrations do not constitute a limitation on the embodiments. Elements with the same reference numerals in the accompanying drawings are represented as similar elements, unless otherwise stated, and the drawings in the accompanying drawings do not constitute a proportional limitation.

[0095] Figure 1 It is a schematic flowchart of a method for processing a road condition image provided by an embodiment of the present application;

[0096] Figure 2 It is a schematic flowchart of another method for processing a road condition image provided by an embodiment of the present application;

[0097] Figure 3A It is a schematic structural diagram of a vehicle in a method for processing a road condition image provided by an embodiment of the present application;

[0098] Figure 3B It is a schematic flowchart of yet another method for processing a road condition image provided by an embodiment of the present application;

[0099] Figure 3C It is a schematic flowchart of still another method for processing a road condition image provided by an embodiment of the present application;

[0100] Figure 4 It is a schematic structural diagram of a device for processing a road condition image provided by an embodiment of the present application;

[0101] Figure 5 This is a schematic structural diagram of a vehicle provided by an embodiment of the present application. Detailed implementation manners

[0102] Now, various exemplary embodiments of the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of them. It should be noted that: unless otherwise specifically stated, the relative arrangements of components and steps, numerical expressions and values set forth in these embodiments do not limit the scope of the present application.

[0103] Those skilled in the art can understand that terms such as "first" and "second" in the embodiments of the present application are only used to distinguish different steps, devices or modules, etc., and do not represent any specific technical meaning, nor do they represent the logical order between them.

[0104] It should also be understood that in this embodiment, "a plurality of" may refer to two or more, and "at least one" may refer to one, two or more.

[0105] It should also be understood that for any component, data or structure mentioned in the embodiments of the present application, unless otherwise clearly defined or given a contrary indication in the context, it is generally understood as one or more.

[0106] In addition, the term "and / or" in the present application is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in the present application generally represents an "or" relationship between the associated objects before and after.

[0107] It should also be understood that the present application emphasizes the differences between various embodiments, and their similarities or similarities can be referred to each other. For the sake of brevity, they will not be described one by one.

[0108] The following description of at least one exemplary embodiment is actually only illustrative and in no way restricts the present application and its application or use.

[0109] Techniques, methods and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, the above techniques, methods and devices should be regarded as part of the specification.

[0110] It should be noted that: similar reference numerals and letters denote similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further discussed in subsequent drawings.

[0111] It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments may be combined with each other. For the convenience of understanding the embodiments of the present application, the present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.

[0112] In order to solve the technical problem of how to improve the safety of vehicle driving in the prior art, the present application provides a method and device for processing road condition images, a vehicle, and a storage medium, which can improve the safety of vehicle driving.

[0113] Figure 1 It is a schematic flowchart of a method for processing road condition images provided by an embodiment of the present application. This method can be applied to one or more electronic devices such as vehicles (e.g., intelligent vehicles, smart cars), smartphones, laptops, desktop computers, portable computers, servers, etc. In addition, the execution subject of this method can be hardware or software. When the above execution subject is hardware, the execution subject can be one or more of the above electronic devices. For example, a single electronic device can execute this method, or multiple electronic devices can cooperate with each other to execute this method. When the above execution subject is software, this method can be implemented as multiple software or software modules, or can also be implemented as a single software or software module. No specific limitation is made here.

[0114] As shown in Figure 1 , the method specifically includes:

[0115] Step 101, obtain the current road condition image in the driving direction of the vehicle.

[0116] In this embodiment, the above vehicle can be any vehicle. As an example, the above vehicle can be an intelligent vehicle, a smart car, etc.

[0117] The driving direction can be the direction pointed by the front end of the vehicle.

[0118] The current road condition image can represent the current road condition in the driving direction of the above vehicle. The current road condition image can be collected in real time by a camera on the above vehicle, or can be collected in real time by a satellite, or can also be collected in real time by a traffic monitoring camera.

[0119] Step 102, generate a processed image by performing image enhancement processing on the current road condition image, where the position of the object in the processed image matches the position of the object in the perspective image, and the perspective image is the image seen through the front windshield of the vehicle.

[0120] In this embodiment, image enhancement processing can be used to improve the visual effect of an image through software or hardware technology, making it easier to observe and understand. As an example, image enhancement processing can include at least one of the following: increasing contrast, increasing clarity, denoising, sharpening, etc.

[0121] The processed image can be an image directly or indirectly obtained after performing image enhancement processing on the current road condition image.

[0122] In some cases, the position of an object in the processed image is the same as the position of the object in the perspective image.

[0123] Step 103, project the processed image onto the front windshield.

[0124] In this embodiment, after obtaining the processed image, the processed image can be projected onto the front windshield.

[0125] In some alternative implementation manners of this embodiment, to solve the technical problem in the prior art of how to further improve the safety of vehicle driving, before obtaining the current road condition image in the vehicle driving direction, the following steps can also be performed:

[0126] The first step, determine the current rainfall at the position where the vehicle is located through the rain sensor of the vehicle.

[0127] Among them, the rain sensor is a device for detecting rainfall and can monitor the rainfall situation in real time.

[0128] The current rainfall can be the rainfall at the position where the vehicle is located at the current moment.

[0129] In some cases, the rain sensor can be used to determine whether it is necessary to adjust the image acquisition strategy according to the rainfall. For example, the acquisition frequency of the current road condition image can be positively correlated with the current rainfall. When the rainfall is large, the image can be acquired more frequently to ensure image clarity.

[0130] The second step, determine whether the current rainfall is greater than or equal to a preset rainfall threshold.

[0131] On this basis, the following method can be adopted to obtain the current road condition image in the vehicle driving direction:

[0132] In the case where the current rainfall is greater than or equal to the rainfall threshold, obtain the current road condition image in the vehicle driving direction.

[0133] It can be understood that in the above optional implementation manners, the current rainfall can be detected by a rainfall sensor to determine whether it is necessary to obtain the current road condition image, thereby avoiding image acquisition when it is not necessary and saving resources. Moreover, through the detection of the rainfall sensor, the current road condition image can be obtained in a timely manner when the rainfall is large, improving the driving safety of the driver in rainy days.

[0134] Optionally, in addition to using a rainfall sensor, other types of sensors such as a humidity sensor or an infrared sensor can also be used to detect the environmental conditions and determine whether it is necessary to obtain the current road condition image.

[0135] In some optional implementation manners of this embodiment, to solve the technical problem in the prior art of how to improve the driving safety of a vehicle in rainy days, before obtaining the current road condition image in the driving direction of the vehicle, it can also be determined whether the windshield wiper of the vehicle meets a preset trigger condition.

[0136] Wherein, the windshield wiper can be a device on the vehicle for clearing rainwater or dirt on the windshield.

[0137] The above trigger condition can be used to determine whether to obtain the current road condition image in the driving direction of the vehicle. As an example, the above trigger condition can be: the windshield wiper is in the on state; it can also be: the windshield wiper is in a preset gear, such as the highest gear; it can also be: the speed of the windshield wiper is greater than or equal to a preset speed threshold.

[0138] On this basis, the following method can be adopted to obtain the current road condition image in the driving direction of the vehicle:

[0139] When the windshield wiper meets the trigger condition, obtain the current road condition image in the driving direction of the vehicle.

[0140] It can be understood that in the above optional implementation manners, by detecting the state of the windshield wiper to determine whether it is necessary to obtain the current road condition image, thereby automatically triggering the acquisition task of the current road condition image through the windshield wiper state, and thus the driving safety of the driver in rainy days can be improved.

[0141] Optionally, in addition to detecting the windshield wiper state, other vehicle state parameters such as vehicle speed or tire skidding condition can also be used to determine whether it is necessary to obtain the current road condition image. Or, the image seen through the front windshield can be collected by a camera set inside the vehicle, and when the clarity of the image is less than or equal to a preset clarity threshold, obtain the current road condition image.

[0142] In some optional implementation manners of this embodiment, to solve the technical problem in the prior art of how to improve the driving convenience and safety of the driver, before obtaining the current road condition image in the driving direction of the vehicle, it can also be determined whether a preset switch of the vehicle is triggered.

[0143] Among them, the preset switch is a device that can be controlled by the driver or the automatic system and is used to trigger the acquisition of the current road condition image under specific circumstances. For example, the driver can manually trigger the preset switch to obtain the current road condition image.

[0144] On this basis, the following method can be adopted to obtain the current road condition image in the driving direction of the vehicle:

[0145] When the preset switch is triggered, obtain the current road condition image in the driving direction of the vehicle.

[0146] It can be understood that in the above optional implementation methods, by detecting the state of the preset switch to determine whether it is necessary to obtain the current road condition image, and then projecting the processed image corresponding to the current road condition map under specific circumstances, this can improve the driving convenience and safety of the driver.

[0147] Optionally, in addition to using the preset switch, voice control or other intelligent control methods can also be used to trigger the acquisition of the current road condition image.

[0148] In some optional implementation methods of this embodiment, in order to solve the technical problem of how to improve the driving safety of the driver in the prior art, before obtaining the current road condition image in the driving direction of the vehicle, it is also possible to determine whether the front windshield of the vehicle is in a blocked state.

[0149] Among them, the blocked state may refer to the state where the front windshield is blocked by an object, affecting the driver's line of sight, and is used to judge whether it is necessary to collect the current road condition image. For example, when the windshield is covered with snow or rain, it can be determined that the front windshield of the vehicle is in a blocked state.

[0150] On this basis, the following method can be adopted to obtain the current road condition image in the driving direction of the vehicle:

[0151] When the front windshield is in the blocked state, obtain the current road condition image in the driving direction of the vehicle.

[0152] It can be understood that in the above optional implementation methods, by detecting the blocked state of the front windshield to determine whether it is necessary to obtain the current road condition image, so as to provide image information when the windshield is blocked, thereby improving the driving safety of the driver.

[0153] Optionally, in addition to detecting the blocked state of the front windshield, other vision assistance systems, such as a reverse camera, can also be used to provide image information.

[0154] In some alternative implementation manners of this embodiment, to solve the technical problem in the prior art of how to improve the driver's ability to recognize road conditions, at least one of the following may be adopted to perform image enhancement processing on the current road condition image:

[0155] First, perform image enhancement processing on the current road condition image by increasing the contrast.

[0156] Among them, contrast refers to the degree of difference between the bright part and the dark part in the current road condition image. Increasing the contrast means increasing the brightness difference between the brightest and darkest regions in the current road condition image, making the bright part brighter and the dark part darker, so that the details of the processed image are more obvious and the visual effect is more distinct.

[0157] As an example, linear transformation, histogram adjustment, etc. can be adopted to increase the contrast of the current road condition image.

[0158] Second, perform image enhancement processing on the current road condition image by increasing the sharpness.

[0159] Among them, sharpness can refer to the sharpness of the edges of objects and the richness of details in the current road condition image. Increasing the sharpness can be, for example, enhancing the edge information of objects in the current road condition image, making the processed image look clearer and sharper and reducing the blurriness. As an example, sharpening filters, high-frequency emphasis filtering, etc. can be adopted to increase the sharpness of the current road condition image.

[0160] Third, perform image enhancement processing on the current road condition image by denoising.

[0161] Among them, noise can be unnecessary interference information introduced in the current road condition image, and these interference information can cause phenomena such as spots, stripes or blurriness in the current road condition image. Denoising is to reduce or eliminate these noises as much as possible through various algorithms and technologies to improve the quality and readability of the image. As an example, mean filtering, median filtering, wavelet denoising, etc. can be adopted to perform denoising processing on the current road condition image.

[0162] It can be understood that in the above alternative implementation manners, multiple image enhancement processing methods are provided to adapt to different road conditions and environmental conditions, thereby improving the driver's ability to recognize road conditions.

[0163] Optionally, in addition to increasing the contrast, increasing the sharpness, and denoising, other image processing techniques, such as edge enhancement or color correction, can also be used to enhance the image.

[0164] In some alternative implementation manners of this embodiment, to solve the technical problem in the prior art of how to improve driving safety, the following method can be adopted: project the processed image onto the front windshield.

[0165] Adopt head-up display technology to project the processed image onto the front windshield.

[0166] Among them, head-up display technology is a technology that directly projects an image (such as the current road condition image) into the user's field of vision, enabling the user to view information without lowering or raising the head. Here, head-up display technology can be used to project the processed image onto the front windshield so that the driver can directly see the road condition information. For example, the processed image can be projected onto the HUD (Head-Up Display) through laser scanning or LCD (Liquid Crystal Display) projection.

[0167] It can be understood that in the above alternative implementation manners, by using head-up display technology to project the processed image onto the front windshield to provide the driver with intuitive road condition information, the driver's line-of-sight transfer can be reduced, and driving safety can be improved.

[0168] Optionally, in addition to head-up display technology, other display technologies such as OLED (Organic Light-Emitting Diode) displays or projectors can also be used to display the processed image.

[0169] In some alternative implementation manners of this embodiment, to solve the technical problem in the prior art of how to further improve driving safety, the scaling ratio of the processed image to the perspective image is the same.

[0170] Among them, the scaling ratio of the processed image to the perspective image being the same means that: the length of the processed image is equal to the length of the perspective image, and the width of the processed image is equal to the width of the perspective image.

[0171] It can be understood that in the above alternative implementation manners, since the scaling ratio of the processed image to the perspective image is the same, the driver can more accurately judge the road condition through the projected processed image, thereby further improving driving safety.

[0172] In some alternative implementation manners of this embodiment, to solve the technical problem of how to ensure that the size of the projected processed image better matches the size of the perspective image, the following method can be adopted: obtain the current road condition image in the vehicle driving direction.

[0173] First step, obtain the mirror angle and projection distance of the projector in the vehicle.

[0174] Among them, the projector is used to project the processed image onto the front windshield of the vehicle.

[0175] Here, after the projector is set in the vehicle, the above mirror angle and projection distance can be determined.

[0176] Second step, based on the mirror angle and the projection distance, determine the field of view angle and focal length of the camera.

[0177] Among them, the field of view angle and focal length of the camera can be determined based on the mirror angle and the projection distance through a preset formula or a pre-trained artificial intelligence model.

[0178] For example, the above formula can be:

[0179]

[0180] Among them, θ represents the mirror angle, D represents the projection distance, α represents the field of view angle of the camera, f represents the focal length of the camera, and w represents the width of the projected image.

[0181] Third step, use the camera with the field of view angle and the focal length to obtain the current road condition image in the driving direction of the vehicle.

[0182] It can be understood that in the above optional implementation manners, the field of view angle and focal length of the camera can be dynamically determined through the mirror angle and the projection distance. Thus, it can be ensured that the size of the processed image after projection is more matched with the size of the perspective image, and even the same scaling ratio can be achieved for both.

[0183] In some optional implementation manners of this embodiment, to solve the technical problem of how to ensure that the processed image after projection is closer to the perspective image, the current road condition image may include all images within the driver's field of view of the vehicle. On this basis, the following method can be used to perform image enhancement processing on the current road condition image:

[0184] First step, collect the perspective image in the front windshield of the vehicle to obtain the perspective image.

[0185] Second step, determine the image area with the highest similarity to the perspective image from the current road condition image.

[0186] Third step, adjust the size of the image area to the size of the perspective image, and determine the processed image based on the image area after size adjustment.

[0187] For example, at least one of the following enhancement processes can be performed on the resized image region to obtain a processed image: increasing contrast, enhancing sharpness, and denoising.

[0188] In some cases, the above enhancement process can be performed only on the resized image region. Thus, there is no need to operate on the regions other than the image region in the current road condition image, which can improve the processing efficiency, more quickly display the processed image, and further improve the safety of vehicle driving. In addition, performing the enhancement process on the resized image region rather than the image region before resizing can ensure the effectiveness of image enhancement and further improve the safety of vehicle driving.

[0189] In some cases, the above perspective image only covers the perspective image in the front windshield and does not include other images.

[0190] It can be understood that in the above optional implementation, first, a current road condition image with a larger field of view than the perspective image is obtained. Then, the image region with the highest similarity to the perspective image is determined from it, and the image for projection is obtained by adjusting its size. Thus, the perspective image can be restored more realistically, which helps the driver make more accurate driving judgments and can improve driving safety.

[0191] The method for processing a road condition image provided by an embodiment of the present application can obtain a current road condition image in the vehicle driving direction. Then, by performing image enhancement processing on the current road condition image, a processed image is generated, where the position of the object in the processed image matches the position of the object in the perspective image, and the perspective image is the perspective image in the front windshield of the vehicle. Then, the processed image is projected onto the front windshield. Thus, when the front windshield cannot provide a clear perspective image or the perspective image is unclear, the processed image of the current road condition image can be displayed on the front windshield by projection, thereby improving the safety of vehicle driving in the above scenarios. Combining with the content of the disclosure, this technical solution enables the driver to see road condition information more clearly through image enhancement technology, improving driving safety. Through image enhancement processing, this technical solution can improve the driver's ability to recognize road conditions, especially in adverse weather or light conditions, thereby reducing the occurrence of traffic accidents.

[0192] In some cases, to solve the technical problem of how to improve the driving safety of a driver in the prior art, the following solution can be adopted:

[0193] Figure 2 This is a flowchart of another method for processing a road condition image provided by an embodiment of the present application. As Figure 2 shown, the method specifically includes:

[0194] Step 201, detect the current light intensity at the location where the vehicle is located.

[0195] In this embodiment, the light intensity may refer to the intensity of light, usually measured in lux. Here, the light intensity is used as a parameter to determine the exposure settings of the camera. For example, when the light intensity is weak, the exposure time can be increased to obtain a clear image of the current road conditions.

[0196] Step 202, determine the exposure parameters of the front camera of the vehicle based on the current light intensity.

[0197] In this embodiment, the exposure parameters are positively correlated with the current light intensity. The greater the current light intensity, the larger the value of the exposure parameters can be.

[0198] Step 203, control the front camera to collect images with the exposure parameters to obtain an image of the current road conditions in the driving direction of the vehicle.

[0199] In this embodiment, after determining the exposure parameters, the front camera can be further controlled to collect images with the exposure parameters to obtain an image of the current road conditions in the driving direction of the vehicle.

[0200] Step 204, generate a processed image by performing image enhancement processing on the current road conditions image, where the positions of the objects in the processed image match the positions of the objects in the perspective image, and the perspective image is the image seen through the front windshield of the vehicle.

[0201] In this embodiment, step 204 is substantially the same as step 102 in the corresponding embodiment, and will not be elaborated here. Figure 1 corresponding embodiment, and will not be elaborated here.

[0202] Step 205, project the processed image onto the front windshield.

[0203] In this embodiment, step 205 is substantially the same as step 103 in the Figure 1 corresponding embodiment, and will not be elaborated here.

[0204] It should be noted that, in addition to the above-mentioned content, this embodiment may also include Figure 1 the corresponding technical features described in the corresponding embodiment, so as to achieve Figure 1 the technical effects of the method for processing the road conditions image shown, and for specific details, please refer to Figure 1 the relevant description. For the sake of brevity, it will not be elaborated here.

[0205] The road condition image processing method provided by the embodiments of the present application can obtain a clear current road condition image under different lighting conditions by detecting the light intensity and adjusting the exposure parameters of the camera, thereby improving the driving safety of the driver.

[0206] Optionally, in addition to detecting the light intensity, other environmental parameters such as temperature or humidity can also be used to adjust the settings of the camera.

[0207] The embodiments of the present application will be described exemplarily below. However, it should be noted that the embodiments of the present application may have the features described below, but the following description does not constitute a limitation on the protection scope of the embodiments of the present application.

[0208] In the related art, when suddenly encountering a heavy rainstorm during driving, even if the automatic windshield wiper is turned on, the rain and fog in the air will greatly affect the driver's vision, making it impossible to see the road conditions ahead clearly, which may cause traffic accidents. At this time, an HUD system that can transmit real-time road condition information in a timely manner and project it onto the front windshield in proportion is needed to help the driver regain the vision.

[0209] With the continuous development of intelligent vehicle technology, drivers' requirements for driving safety and comfort are increasing day by day. Traditional driving information display methods, such as instrument panels and central control displays, although they can provide rich vehicle information, the driver needs to shift the line of sight when viewing this information, increasing the driving risk. As a new type of driving assistance system, the HUD system can project driving-related information into the driver's forward field of vision, enabling the driver to obtain key information without moving the line of sight, thereby improving driving safety and comfort.

[0210] However, most of the existing HUD systems rely on the vehicle's own sensors and control systems, and have limited capabilities for obtaining and processing real-time road condition information. Therefore, how to combine the real-time road condition information captured by the vehicle's front camera with the HUD system to achieve more accurate and real-time driving information display has become an urgent problem to be solved in the current field of intelligent vehicle technology.

[0211] In view of this, this solution provides a real-time transmission system for the front camera of an automobile (i.e., the above-mentioned vehicle) and HUD. When suddenly encountering a heavy rainstorm or the front windshield is blocked, the front camera captures real-time road condition information (i.e., the above-mentioned current road condition image), and transmits it to the HUD system in real time, and projects the dynamic and clear road condition information onto the front windshield, providing a more intuitive and safe driving experience for the driver in the case of heavy rain and when the vision is seriously affected due to the blocked front windshield.

[0212] Such as Figure 3AAs shown in the figure, the vehicle front camera and HUD real-time transmission system provided by this solution includes a rain sensor module 1, a front camera module 2, an image processing module 3, a data transmission module 4, a HUD display module 5, a control system module 6, a rear fog lamp module 7, and a hazard warning flasher module 8. Among them, the rain sensor module 1 is used to judge the amount of rain, that is, the current rainfall mentioned above; the front camera module 2 is used to capture real-time road conditions information (that is, the current road conditions information mentioned above), and supports high-resolution and high-frame-rate video acquisition; the image processing module 3 is used to compress, denoise, enhance, etc. the image data collected by the front camera to ensure the image quality; the data transmission module 4 uses a high-speed data transmission protocol (such as LVDS (Low Voltage Differential Signaling), Ethernet or CAN (Controller Area Network) bus) to transmit the processed image data to the HUD display module 5; the HUD display module is used to project the processed image information into the driver's forward field of view; the control system module 6 is used to coordinate the work of each module to achieve the real-time transmission and display of real-time road conditions information and the HUD system.

[0213] Furthermore, the front camera adopts a High-Dynamic Range (HDR) camera, supports 1080P or 4K resolution, has a frame rate of not less than 30fps (Frames Per Second), and a wide-angle lens, which can gather light and clearly capture the panoramic image of the road ahead. On rainy days, the front camera improves the contrast and clarity of the image through optimized lens and digital image processing technology, which enables a clearer view of the road surface through the real-time video transmitted by the HUD. At the same time, the front camera also has an automatic exposure adjustment function to adapt to road conditions capture under different lighting conditions.

[0214] Furthermore, the image processing module includes an image preprocessing unit and a feature extraction unit, and uses a dedicated image processing chip (such as a DSP (Digital Signal Processor) or an FPGA (Field-Programmable Gate Array)) to achieve real-time image compression and enhancement. The image preprocessing unit is used to perform preprocessing operations such as denoising and enhancement on the images captured by the front camera to improve the image quality. The feature extraction unit is used to extract key features from the preprocessed images, such as lane lines, traffic signs, vehicles, pedestrians, etc., to provide a basis for subsequent information display.

[0215] Furthermore, the data transmission module adopts the LVDS or Ethernet protocol to ensure that the data transmission rate is not less than 1 Gbps (Gigabits per second), control the image transmission delay at the millisecond level, and ensure real-time performance.

[0216] Furthermore, the HUD display module 5 adopts projection technology and optical design, and can project the processed video image information onto the driver's forward field of vision in a clear and bright manner in proportion. At the same time, the HUD display module 5 also supports personalized settings, such as adjusting parameters such as display brightness and contrast, to meet the viewing needs of different drivers and improve driving safety in rainy days.

[0217] Furthermore, the control system module 6 adopts advanced control algorithms and CAN communication technology, can coordinate the work of each module in real time, and ensure the real-time transmission and display of real-time road condition information and the HUD system. At the same time, the control system also supports the integration and communication with other vehicle-mounted systems, such as navigation systems, autonomous driving systems, etc., to achieve a more intelligent and convenient driving experience.

[0218] The following combines the attached Figure 3A 、 Figure 3B and Figure 3C to further describe this solution in detail.

[0219] As Figure 3A shown, the above-mentioned vehicle front camera and HUD real-time transmission system can be set in the vehicle and consists of components such as a rain sensor module 1, a front camera module 2, an image processing module 3, a data transmission module 4, a HUD display module 5, a control system module 6, a rear fog lamp module 7, and a hazard warning flasher module 8.

[0220] Among them, the rain sensor module 1 and the front camera module 2 are installed inside the vehicle, above the front windshield, in the area near the rearview mirror (integrated in the central rearview mirror base or the black sensing module), and are used to sense the rainfall on the front windshield and capture real-time road condition information; the image processing module 3 is installed inside the vehicle, receives the images captured by the front camera 2 (including the above-mentioned current road condition images), and performs preprocessing and feature extraction; the data transmission module 4 is installed under the vehicle console, and transmits the image data processed by the image processing module 3 to the HUD module; the HUD display module 5 is installed on the top of the driver's instrument panel, receives the image information processed by the data transmission module 4, and projects it into the driver's forward field of vision; the control system module 6 is installed inside the vehicle, coordinates the work of each module, and realizes the real-time transmission and display of real-time road condition information and the HUD system; the rear fog lamp module 7 is installed at the rear of the vehicle (at a position compliant with the lamp installation regulations); the hazard warning flasher module 8 is installed at the front, middle and rear of the vehicle (at positions compliant with the lamp installation regulations). The front camera module 2 is electrically connected to the image processing module 3; the data transmission module 4 is electrically connected to the image processing module 3 and the HUD display module 5; the control system module 6 is electrically connected to the rain sensor module 1, the image processing module 3, the data transmission module 4, the rear fog lamp module 7 and the hazard warning flasher module 8.

[0221] As Figure 3B shown, when the driver suddenly encounters a heavy rainstorm and the rain sensor triggers the highest gear of the automatic windshield wiper, this system is also triggered and activated simultaneously. The control system module 6 activates the HUD real-time transmission system, and at the same time automatically turns on the rear fog lamp module 7 to alert the following vehicle. The front camera module 2 captures the panoramic video image of the road ahead and transmits it to the image processing module 3. The image processing module 3 performs preprocessing operations such as denoising and enhancement on the received video image to improve the image quality. Then, the image processing module 3 extracts key features from the preprocessed video image, such as lane lines, traffic signs, vehicles, pedestrians, etc., to restore the clearest real-time road condition video information. These video information are transmitted to the HUD display module 5 through the data transmission module 4, and the HUD display module 5 projects the video information onto the driver's forward field of vision in a clear and bright manner in equal proportion. In this way, the driver can be provided with the clearest road condition information and driving vision in a timely manner when encountering a heavy rainstorm, so as to reduce the occurrence of traffic accidents.

[0222] As Figure 3CAs shown, when a foreign object suddenly blocks the front windshield during driving and the driver loses the field of vision, the driver can also press the system switch (i.e., the above-mentioned preset switch) to turn on the HUD real-time transmission system, and at the same time automatically turn on the hazard lights to warn the following vehicle that the current vehicle has encountered an emergency and pay attention to avoidance. The front camera module 2 is installed above the front windshield, in the area close to the rearview mirror (integrated in the central rearview mirror base or the black sensing module). Although the driver's line of sight in front is blocked by a foreign object, the camera module 2 will not be blocked. The front camera module 2 captures the panoramic video image of the road ahead and transmits it to the image processing module 3. The image processing module 3 performs preprocessing operations such as denoising and enhancement on the received video image to improve the image quality. Then, the image processing module 3 extracts key features from the preprocessed video image, such as lane lines, traffic signs, vehicles, pedestrians, etc., and restores the clearest real-time road condition video information. These video information are transmitted to the HUD display module 5 through the data transmission module 4, and the HUD display module 5 projects the video information onto the driver's front field of vision in a clear and bright manner in proportion. Therefore, starting the HUD real-time transmission system at this time can timely provide the driver with road condition information and vision, enough for the driver to pull over and clean the foreign object on the front windshield.

[0223] At the same time, the control system module 6 coordinates the work of each module in real time to ensure the real-time transmission and display of the real-time road condition information and the HUD system. The control system module 6 can also adjust the display parameters of the HUD display module 5 according to the driver's needs and preferences, such as adjusting parameters such as display brightness and contrast to meet the viewing needs of different drivers.

[0224] In addition, the above system can also be integrated and communicated with other vehicle-mounted systems, such as navigation systems, autonomous driving systems, etc. Through the integration and communication with these systems, this solution can achieve a more intelligent and convenient driving experience.

[0225] The front camera 1 can be a night camera. When driving at night, the car's front headlights are turned on.

[0226] The specific steps are as follows: When the driver encounters a heavy rainstorm during night driving and the rain sensor triggers the highest gear of the automatic windshield wiper, this system is also triggered and activated simultaneously. The control system module 6 activates the HUD real-time transmission system, and at the same time, automatically turns on the rear fog lamp module 7 to alert the following vehicle. The front camera module 2 captures the panoramic video image of the road ahead and transmits it to the image processing module 3. The image processing module 3 performs preprocessing operations such as denoising and enhancement on the received video image to improve the image quality. Then, the image processing module 3 extracts key features from the preprocessed video image, such as lane lines, traffic signs, vehicles, pedestrians, etc., to restore the clearest real-time road condition video information. These video information are transmitted to the HUD display module 5 through the data transmission module 4, and the HUD display module 5 projects the video information onto the driver's forward field of view in a clear and bright manner in proportion. In this way, the clearest road condition information and driving vision can be provided to the driver in time when encountering a heavy rainstorm, reducing the occurrence of traffic accidents.

[0227] It should be noted that, in addition to the above-mentioned content, this embodiment may also include the technical features described in the above embodiments, thereby realizing the technical effects of the above-mentioned road condition image processing method. For specific details, please refer to the above description. For the sake of brevity, it will not be elaborated here.

[0228] In this solution, when the driver encounters a heavy rainstorm during driving and the highest gear of the automatic windshield wiper is triggered by the rain sensor, this system is triggered simultaneously. At this time, the rear fog lamp is automatically turned on to alert the following vehicle. When the front windshield is blocked by foreign objects during the driver's driving process and the system switch is manually turned on, the hazard warning lights are also automatically turned on simultaneously to alert the following vehicle. Then, clear real-time road condition information can be obtained through the HUD: The real-time road condition information is captured by the front camera and transmitted to the HUD system in real time, providing a more intuitive and safe driving experience for the driver. The front camera with high resolution and wide-angle lens can capture the panoramic image of the road ahead, improving driving safety. The image processing module preprocesses the image and extracts features, providing a basis for subsequent information display and ensuring the accuracy and reliability of the information. The data transmission module uses LVDS or Ethernet protocol to ensure that the data transmission rate is not less than 1 Gbps and controls the image transmission delay within milliseconds to ensure real-time performance. The HUD display module uses projection technology and optical design to project the processed image information onto the driver's forward field of view in a clear and bright manner, improving driving comfort. The control system uses advanced control algorithms and CAN communication technology to coordinate the work of each module in real time, ensuring the stability and reliability of the system. In summary, the above system has the advantages of simple structure, powerful function, safety and reliability, etc., can significantly improve driving safety and comfort, and provide a more intuitive and convenient driving experience for the driver.

[0229] Figure 4 The following is a schematic structural diagram of a processing device for road condition images provided by an embodiment of the present application. Specifically, it includes:

[0230] An acquisition unit 401, configured to acquire a current road condition image in the driving direction of the vehicle;

[0231] A generation unit 402, configured to generate a processed image by performing image enhancement processing on the current road condition image, wherein the position of an object in the processed image matches the position of the object in a perspective image, and the perspective image is an image seen through the front windshield of the vehicle;

[0232] A projection unit 403, configured to project the processed image onto the front windshield.

[0233] In a possible implementation manner, before acquiring the current road condition image in the driving direction of the vehicle, the device further includes:

[0234] A first determination unit (not shown in the figure), configured to determine the current rainfall at the position where the vehicle is located through a rain sensor of the vehicle;

[0235] A second determination unit (not shown in the figure), configured to determine whether the current rainfall is greater than or equal to a preset rainfall threshold; and

[0236] The acquisition of the current road condition image in the driving direction of the vehicle includes:

[0237] In the case where the current rainfall is greater than or equal to the rainfall threshold, acquiring the current road condition image in the driving direction of the vehicle.

[0238] In a possible implementation manner, before acquiring the current road condition image in the driving direction of the vehicle, the device further includes:

[0239] A third determination unit (not shown in the figure), configured to determine whether the windshield wiper of the vehicle meets a preset trigger condition; and

[0240] The acquisition of the current road condition image in the driving direction of the vehicle includes:

[0241] In the case where the windshield wiper meets the trigger condition, acquiring the current road condition image in the driving direction of the vehicle.

[0242] In a possible implementation manner, before acquiring the current road condition image in the driving direction of the vehicle, the device further includes:

[0243] A fourth determination unit (not shown in the figure), configured to determine whether a preset switch of the vehicle is triggered; and

[0244] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0245] When the preset switch is triggered, obtain the current road condition image in the driving direction of the vehicle.

[0246] In a possible implementation manner, before the obtaining of the current road condition image in the driving direction of the vehicle, the device further includes:

[0247] A fifth determination unit (not shown in the figure), configured to determine whether the front windshield of the vehicle is in an occluded state; and

[0248] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0249] When the front windshield is in the occluded state, obtain the current road condition image in the driving direction of the vehicle.

[0250] In a possible implementation manner, the performing of image enhancement processing on the current road condition image includes at least one of the following:

[0251] Perform image enhancement processing on the current road condition image by means of increasing the contrast;

[0252] Perform image enhancement processing on the current road condition image by means of increasing the sharpness;

[0253] Perform image enhancement processing on the current road condition image by means of denoising processing.

[0254] In a possible implementation manner, before the obtaining of the current road condition image in the driving direction of the vehicle, the device further includes:

[0255] A detection unit (not shown in the figure), configured to detect the current light intensity at the location where the vehicle is located;

[0256] A sixth determination unit (not shown in the figure), configured to determine the exposure parameter of the front camera of the vehicle based on the current light intensity; and

[0257] The obtaining of the current road condition image in the driving direction of the vehicle includes:

[0258] Control the front camera to collect an image with the exposure parameter to obtain the current road condition image in the driving direction of the vehicle.

[0259] In a possible implementation manner, the projecting of the processed image onto the front windshield includes:

[0260] Project the processed image onto the front windshield by using head-up display technology.

[0261] In a possible implementation, the scaling ratio of the processed image is the same as that of the perspective image.

[0262] In a possible implementation, obtaining the current road condition image in the vehicle driving direction includes:

[0263] Obtaining the mirror angle and projection distance of a projector in the vehicle, where the projector is used to project the processed image onto the front windshield of the vehicle;

[0264] Based on the mirror angle and the projection distance, determining the field of view angle and focal length of the camera;

[0265] Using the camera with the field of view angle and the focal length to obtain the current road condition image in the vehicle driving direction.

[0266] In some alternative implementation manners of this embodiment, performing image enhancement processing on the current road condition image includes:

[0267] Collecting the perspective image in the front windshield of the vehicle to obtain a perspective image;

[0268] Determining, from the current road condition image, the image area with the maximum similarity to the perspective image;

[0269] Adjusting the size of the image area to the size of the perspective image, and determining the processed image based on the image area after size adjustment.

[0270] The processing device for the road condition image provided in this embodiment may be the processing device for the road condition image as shown in Figure 4 which can execute all steps of the above-mentioned processing methods for the road condition image, and further achieve the technical effects of the above-mentioned processing methods for the road condition image. For specific reference, please refer to the above relevant descriptions. For the sake of concise description, it will not be elaborated here.

[0271] Figure 5 FIG. is a schematic structural diagram of a vehicle provided in an embodiment of the present application. Figure 5 The vehicle 500 shown includes: at least one processor 501, a memory 502, at least one network interface 504, and other user interfaces 503. Each component in the vehicle 500 is coupled together through a bus system 505. It can be understood that the bus system 505 is used to realize the connection and communication between these components. The bus system 505 includes, in addition to a data bus, a power bus, a control bus, and a status signal bus. However, for the sake of clear illustration, in Figure 5 all kinds of buses are labeled as the bus system 505.

[0272] Among them, the user interface 503 may include a display, a keyboard, or a pointing device (such as a mouse, a trackball, a touchpad, or a touch screen, etc.).

[0273] It can be understood that the memory 502 in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synch link dynamic random access memory (SLDRAM), and direct rambus random access memory (DRRAM). The memory 502 described herein is intended to include but not be limited to these and any other suitable types of memory.

[0274] In some embodiments, the memory 502 stores the following elements, executable units, or data structures, or subsets thereof, or extended sets thereof: an operating system 5021 and an application program 5022.

[0275] Among them, the operating system 5021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application program 5022 includes various application programs, such as a media player and a browser, etc., for implementing various application services. The program for implementing the method of the embodiments of the present application can be included in the application program 5022.

[0276] In this embodiment, by invoking the programs or instructions stored in the memory 502, specifically, the programs or instructions stored in the application program 5022, the processor 501 is configured to execute the method steps provided in each method embodiment, for example, including:

[0277] Obtain a current road condition image in the vehicle driving direction;

[0278] By performing image enhancement processing on the current road condition image, a processed image is generated, wherein the position of the object in the processed image matches the position of the object in the perspective image, and the perspective image is the image seen through the front windshield of the vehicle;

[0279] Project the processed image onto the front windshield.

[0280] The method disclosed in the embodiments of the present application can be applied to or implemented by the processor 501. The processor 501 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit in the hardware of the processor 501 or by instructions in software form. The above-mentioned processor 501 may be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. It can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor or by a combination of hardware and software units in the decoding processor. The software unit may be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. This storage medium is located in the memory 502, and the processor 501 reads the information in the memory 502 and combines its hardware to complete the steps of the above method.

[0281] It will be appreciated that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the above functions of the present application, or any combination thereof.

[0282] For a software implementation, the above-described techniques herein may be implemented by units that execute the above functions herein. The software code may be stored in a memory and executed by a processor. The memory may be implemented within the processor or externally to the processor.

[0283] The vehicle provided in this embodiment may be a vehicle as shown in Figure 5 and can execute all steps of the above-described method for processing road condition images, thereby achieving the technical effects of the above-described method for processing road condition images. For specific details, please refer to the above relevant descriptions. For the sake of brevity, it will not be elaborated herein.

[0284] The embodiments of the present application also provide a storage medium (computer-readable storage medium). The storage medium stores one or more programs. Among them, the storage medium may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, hard disk, or solid-state drive; the memory may also include a combination of the above types of memory.

[0285] When one or more programs in the storage medium can be executed by one or more processors to implement the above-described method for processing road condition images executed on the electronic device side.

[0286] The above-mentioned processor is used to execute the road condition image processing program stored in the memory to implement the following steps of the method for processing road condition images executed on the electronic device side:

[0287] Obtain the current road condition image in the driving direction of the vehicle;

[0288] By performing image enhancement processing on the current road condition image, a processed image is generated, wherein the position of an object in the processed image matches the position of the object in the perspective image, and the perspective image is the image seen through the front windshield of the vehicle;

[0289] Project the processed image onto the front windshield.

[0290] Those skilled in the art should further realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described according to functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Skilled professionals can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0291] The steps of the methods or algorithms described in combination with the embodiments disclosed herein can be implemented by hardware, software modules executed by a processor, or a combination of the two. The software modules can be placed in a random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0292] It should be understood that the terms used herein are for the purpose of describing specific example embodiments only and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" as used herein may also include the plural forms. The terms "including", "comprising", "containing", and "having" are inclusive and thus specify the presence of the stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or their combinations. The method steps, processes, and operations described herein are not to be construed as necessarily requiring them to be executed in the particular order described or illustrated, unless the execution order is explicitly stated. It should also be understood that additional or alternative steps can be used.

[0293] The above are only specific embodiments of the present application, enabling those skilled in the art to understand or implement the present application. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to these embodiments shown herein, but rather will be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A method for processing a road condition image, characterized in that: The method comprises: Obtain the current road condition image in the direction of vehicle travel; Generate a processed image by performing image enhancement processing on the current road condition image, wherein the position of the object in the processed image matches the position of the object in the perspective image, and the perspective image is an image viewed through the front windshield of the vehicle; The processed image is projected onto the front windshield.

2. The method according to claim 1, characterized in that Before acquiring the current road condition image in the driving direction of the vehicle, the method further includes: Determining the current rainfall at the location of the vehicle by means of a rain sensor of the vehicle; Determining whether the current rainfall is greater than or equal to a preset rainfall threshold; and The obtaining of the current road condition image in the direction of vehicle travel comprises: When the current rainfall is greater than or equal to the rainfall threshold, a current road condition image in the driving direction of the vehicle is acquired.

3. The method according to claim 1, characterized in that Before acquiring the current road condition image in the driving direction of the vehicle, the method further includes: Determining whether the vehicle's windshield wipers meet a preset trigger condition; and The obtaining of the current road condition image in the direction of vehicle travel comprises: When the wiper satisfies the trigger condition, a current road condition image in the driving direction of the vehicle is acquired.

4. The method according to claim 1, characterized in that: Before acquiring the current road condition image in the driving direction of the vehicle, the method further includes: determining whether a preset switch of the vehicle is triggered; and The obtaining of the current road condition image in the direction of vehicle travel comprises: When the preset switch is triggered, a current road condition image in the driving direction of the vehicle is acquired.

5. The method according to claim 1, characterized in that Before acquiring the current road condition image in the driving direction of the vehicle, the method further includes: Determining whether the vehicle's front windshield is obscured; and The obtaining of the current road condition image in the direction of vehicle travel comprises: When the front windshield is in the blocked state, a current road condition image in the driving direction of the vehicle is acquired.

6. The method according to claim 1, characterized in that The performing image enhancement processing on the current road condition image includes at least one of the following: Performing image enhancement processing on the current road condition image by improving contrast; Performing image enhancement processing on the current road condition image in a manner of improving clarity; The current road condition image is enhanced by using a denoising process.

7. The method according to claim 1, characterized in that Before acquiring the current road condition image in the driving direction of the vehicle, the method further includes: Detect the current light intensity at the vehicle's location; Determining an exposure parameter of a front camera of the vehicle based on the current light intensity; and The obtaining of the current road condition image in the direction of vehicle travel comprises: The front camera is controlled to capture images with the exposure parameters to obtain a current road condition image in the driving direction of the vehicle.

8. The method according to claim 1, characterized in that The step of projecting the processed image onto the front windshield comprises: The processed image is projected onto the front windshield using a head-up display technology.

9. The method according to any one of claims 1 to 8, characterized in that: The processed image has the same scaling ratio as the perspective image.

10. The method according to any one of claims 1 to 8, characterized in that: The obtaining of the current road condition image in the direction of vehicle travel comprises: Obtaining a reflector angle and a projection distance of a projector in the vehicle, wherein the projector is used to project the processed image onto a front windshield of the vehicle; Determining the field of view angle and focal length of the camera based on the reflector angle and the projection distance; The camera having the field of view angle and the focal length is used to obtain a current road condition image in the direction of vehicle travel.

11. The method according to any one of claims 1 to 8, characterized in that: The performing image enhancement processing on the current road condition image comprises: Collecting a perspective image through the front windshield of the vehicle to obtain a perspective image; Determining, from the current road condition image, an image region having the greatest similarity to the perspective image; The size of the image area is adjusted to the size of the perspective image, and a processed image is determined based on the image area after the size adjustment.

12. A road condition image processing device, characterized in that: The device comprises: An acquisition unit, configured to acquire a current road condition image in a driving direction of the vehicle; a generating unit configured to generate a processed image by performing image enhancement processing on the current road condition image, wherein the position of the object in the processed image matches the position of the object in the perspective image, and the perspective image is an image viewed through the front windshield of the vehicle; The projection unit is configured to project the processed image onto the front windshield.

13. A vehicle, characterized in that: include: Memory for storing computer programs; A processor is used to execute the computer program stored in the memory, and when the computer program is executed, the method for processing the road condition image of any one of claims 1 to 11 is implemented.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for processing the road condition image of any one of claims 1 to 11 is implemented.

Images