Headlamp based projection method and device

[0030] The embodiments of the present invention are described in detail below. Examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the present invention, but should not be construed as limiting the present invention.

[0031] The following describes the headlamp-based projection method, the headlamp-based projection device, electronic equipment, and non-transitory computer-readable storage medium proposed by the embodiments of the present invention with reference to the accompanying drawings.

[0032] figure 1 It is a flowchart of a headlamp-based projection method according to an embodiment of the present invention. Such as figure 1 As shown, the method includes the following steps:

[0033] S1: Collect status information of each vehicle component on the vehicle.

[0034] S2: Determine whether the vehicle component is abnormal according to the status information.

[0035] S3: When it is determined that the vehicle component is abnormal, an abnormal image matching the identification information of the vehicle component is selected from a plurality of abnormal images in advance as the target abnormal image to be projected.

[0036] S4: Project the abnormal target image onto the road in front of the vehicle currently driving through the headlight.

[0037] Specifically, the abnormal image corresponding to when each vehicle component is abnormal may be stored in the vehicle in advance, and each abnormal image is matched with the identification information of the corresponding vehicle component. When the headlights of the vehicle are on, it is judged that the vehicle is driving at night. The status information of the vehicle components can be collected through the CAN (Controller Area Network) bus of the vehicle. The status information of the vehicle components can include: vehicle speed , Gear and driving mode, driving efficiency indicator, power meter, electricity meter, water temperature meter, 120km/h alarm indicator, cruising range, water temperature warning light, engine failure warning light, engine maintenance warning light, oil pressure warning light, Automatic transmission overheating warning light, charging warning light, power battery failure warning light, intelligent start-stop system indicator light, seat belt not fastened warning light, open door warning light, parking brake indicator light, etc. Then determine whether there is an abnormality in the vehicle component based on the status information. For example, if the oil pressure warning light is on, it means that the vehicle oil pressure is abnormal, and it is judged that the vehicle component is abnormal; for another example, if the water temperature warning light is on, it means the water temperature. Abnormal, it is judged that the vehicle component is abnormal. If it is judged that the vehicle component is abnormal, the identification of the abnormal vehicle component is obtained, and the abnormal image matching the identification information of the vehicle component is selected from the multiple abnormal images in advance as the target abnormal image to be projected, and then the headlight The target abnormal image is projected into the projection area on the road ahead of the vehicle, so that the driver can quickly understand the abnormal situation of the vehicle. Therefore, the method can project the abnormal information of the vehicle through the headlights on the road ahead of the vehicle, and the driver can quickly obtain the abnormal condition of the vehicle without lowering his head, which greatly improves the driving safety.

[0038] The following describes how to determine the projection area with specific examples.

[0039] Specifically, such as figure 2 As shown, point C is the closest point that the headlights of the vehicle can clearly project, F is the farthest point that the headlights can clearly project; point D is the closest point that the driver can see from the vehicle when the driver is driving normally, BD distance Is d3, β is the angle between the line of sight of the human eye from the closest point (point D) of the vehicle and the road surface, X is the horizontal distance between the human eye and the lamp when the driver is driving normally, L is the height of the human eye relative to the road surface, β, Both X and L can be measured in advance. The projection area can be the area calibrated by the vehicle manufacturer based on a large number of experiments. For example, such as figure 2 As shown, according to tanβ=L/(X+d3), the length of d3 can be calculated, as image 3 As shown, it is assumed that the distance between the vehicle lights is L1, the vehicle width is L2, the inward angles of the left and right front lights are α1 and α2, respectively, the shortest overlap distance is d1, and the farthest distance is d2. When α1=α2, according to (L1+L2)/2d2=tanα2, the length of d2 can be calculated, and the area between [d3, d2] can be calibrated as the projection area.

[0040] Moreover, in order to ensure that the driver can clearly see the projected information, the driver can adjust the projected image in a specified area in the central control, so that the projected information can be clearly seen when people of different heights are driving. When the vehicle is turning, the headlight has an adaptive function, and the projection area will always appear directly in front of the vehicle when the vehicle is turning. Projection can be performed automatically when the headlights of the vehicle are turned on, and the driver can adjust the projection area, choose to turn off the projection function and other settings.

[0041] According to an embodiment of the present invention, when there are two or more target abnormal images, projecting the target abnormal images onto the road ahead of the vehicle through the headlight may include: according to the abnormal level of the target abnormal images, Determine the projection order of the target abnormal images, control the headlamps to project each target abnormal image in the projection order; or obtain the recognition time of the target abnormal images; control the headlamps to project one by one according to the order in which the target abnormal images are recognized Target abnormal image.

[0042] Specifically, if there are many target abnormal images and the projection areas of the target abnormal images overlap, the projection order of the target abnormal images can be determined according to the abnormal level of the target abnormal images, and how to classify abnormal images with priority projection for images with higher abnormal levels The level can be preset in advance. Generally, for the important systems of the vehicle (brake system, electric power steering system, etc.), if it is abnormal, it is generally classified as a high abnormal level. Of course, the target abnormal images can also be projected one by one according to the sequence of recognition of the target abnormal images.

[0043] In order to enable the driver to understand the abnormal condition of the vehicle more quickly and clearly, in the embodiment of the present invention, such as Figure 4 As shown, after the target abnormal image is projected onto the road in front of the vehicle currently driving through the headlight, it may also include:

[0044] S5, controlling the projection module in the headlamp to alternately project with different brightness values; and/or controlling the reminding device to send a reminding message. The reminding device can be an indicator light.

[0045] Specifically, after the target abnormal image is projected on the road ahead of the vehicle currently driving, the projection module in the headlight can be controlled to alternately project with different brightness values ​​to make the projection area flicker. The projection area can be controlled to flash three times, and the flash interval can be It is 200ms, and each flashing time can be 0.5s. After returning to normal, to remind the driver. Since projections are closely related to driving safety, they are not always flashing reminders in real time, but can be reminded every 10 minutes.

[0046] Of course, after the target abnormal image is projected onto the road ahead of the vehicle currently driving, the corresponding indicator light on the vehicle can also be controlled to light up to remind the driver of the abnormality.

[0047] According to an embodiment of the present invention, after the target abnormal image is projected onto the road ahead of the vehicle currently driving through the headlight, the method further includes: controlling the image sensor to collect an environmental image on the road ahead; The projection function is controlled.

[0048] Further, controlling the projection function of the headlight according to the environmental image includes: identifying the current condition of the road ahead from the environmental image; wherein the current condition includes the road condition, weather condition and/or obstacle condition of the road ahead ; According to the current conditions of the road ahead, control the projection function of the headlights.

[0049] Specifically, after the target abnormal image is projected onto the road ahead where the vehicle is currently driving through the headlights, the image sensor is controlled to collect the environment image on the road ahead, and from the environment image, the current condition of the road ahead is recognized.

[0050] If there are many vehicles and the road conditions are relatively congested, the distance between the two vehicles is relatively close, resulting in that the projected image cannot be completely projected on the road, or the image sensor recognizes that there are obvious obstacles in front that affect the projection, and the headlights will be automatically turned off. Projection function.

[0051] When the vehicle passes through narrow road conditions, in order to ensure the safe passage of the vehicle, the driver needs to turn on the width indicator light, and the projection function of the headlight is automatically turned off at this time. When the width indicator is turned off, the projection function is automatically turned on. When the vehicle passes on a road with poor road conditions (potholes, etc.), the projected image is optimized through an optimization algorithm so that the driver can see the projected image clearly. When it rains, the projected image is greatly affected by the rain, and the projected image is not clear enough. Therefore, if it is recognized that it is raining according to the environmental image, the projection function of the headlight will be turned off by default. The driver can manually choose to turn on the projection function of the headlights in the central control according to their own intentions. If there is water on the road after rain, the road surface water will be unstable when vehicles pass by, causing the projection image to be blurred; if the road surface water is recognized, the projection function of the headlights will be automatically turned off, and the projection will be turned on after passing through the water area. Features.

[0052] When the vehicle is uphill or downhill, the driver's line of sight is on the same horizontal plane as the vehicle body, and can only see the field of view. The projection area can be adjusted according to the uphill information, so that the driver can see the projection information. The headlamp has an adaptive lighting function for corners, and will adaptively project the projected image on the road in front of the driver when turning.

[0053] In addition to projecting abnormal images of vehicle components, other status information of vehicle components can also be projected, so that the driver can clearly understand the current condition of the vehicle.

[0054] According to an embodiment of the present invention, the aforementioned vehicle headlamp-based projection method may further include: projecting state information of vehicle components onto the road ahead through the headlamp.

[0055] Further, projecting the status information of the vehicle components onto the road ahead through the headlight includes: determining the projection position of the status information according to the vehicle component corresponding to the status information; according to the projection position, projecting the status information to the front through the headlight On the road.

[0056] Specifically, when the headlights of the vehicle are in the on state, it is determined that the vehicle is in the night driving state, and the state information of the vehicle components can be collected through the CAN bus of the vehicle, which may include: gear and driving mode, driving efficiency indicator, power meter , Fuel gauge, water temperature gauge, 120km/h alarm indicator, cruising range, water temperature warning light, engine failure warning light, engine maintenance warning light, oil pressure warning light, automatic transmission overheating warning light, charging warning light, power battery failure warning Lights, intelligent start-stop system indicator lights, seat belt unfastened warning lights, door open warning lights, parking brake indicator lights, etc. Then, the preset projection position of each status information is acquired, and the status information is projected onto the road ahead through the headlight according to the projection position.

[0057] Due to the large amount of status information, not all status information has a fixed projection area. In the vehicle status information area, there are several vehicle status information projection areas, and multiple status information shares a projection area. If there is a conflict, the conflict state Information is projected in the corresponding area in turn. The status information can be selected by the customer on the road surface, which types of information share the same projection area, and the projection time of each type of information, etc.

[0058] For example, such as Figure 5a As shown, for a left-hand drive vehicle, the vehicle speed can be displayed in the middle of the projection area to facilitate the driver to observe the vehicle speed at any time, and the safety-related system faults of the vehicle are displayed below the vehicle speed to facilitate the driver to quickly obtain the abnormal conditions of the vehicle; vehicle status display On the right side of the projection area; the cruising range is displayed at the upper position. For right-hand drive vehicles, the projection position of the status information can be as Figure 5b Shown. Among them, the vehicle’s safety system related fault display may include: parking brake fault warning light, brake system fault warning light, anti-lock brake system fault warning light, electronic stability control system indicator light, adaptive cruise control system fault Warning light, blind spot detection system warning light, lane departure indicator light, lane keeping indicator light, front collision warning and automatic emergency braking indicator light, tire pressure monitoring system warning light, engine anti-theft failure warning light, airbag failure warning light electric Power steering system failure warning lights, etc. Vehicle status display can include: gear and driving mode, driving efficiency indicator, power meter, electricity meter, water temperature meter, 120km/h alarm indicator, cruising range, water temperature warning light, engine failure warning light, engine maintenance warning light, Oil pressure warning light, automatic transmission overheating warning light, charging warning light, power battery failure warning light, intelligent start-stop system indicator light, seat belt not fastened warning light, door open warning light, parking brake indicator light, etc.

[0059] It is understandable that projection is divided into right headlight projection and left headlight projection. The display of vehicle speed, cruising range, and safety-related system faults can be projected through the left headlight, and the vehicle status display can be projected through the right headlight.

[0060] In summary, according to the headlamp-based projection method of the embodiment of the present invention, the status information of each vehicle component on the vehicle is first collected, and then based on the status information, it is determined whether the vehicle component is abnormal. When it is determined that the vehicle component is abnormal At this time, from a plurality of pre-existing abnormal images, the abnormal image matching the identification information of the vehicle component is selected as the target abnormal image to be projected, and then the target abnormal image is projected onto the road ahead of the vehicle currently driving through the headlight. Therefore, the method can project the abnormal information of the vehicle through the headlights on the road ahead of the vehicle, and the driver can quickly obtain the abnormal condition of the vehicle without lowering his head, which greatly improves the driving safety.

[0061] Image 6 It is a schematic block diagram of a headlamp-based projection device according to an embodiment of the present invention. Such as Image 6 As shown, the device includes: an acquisition module 1, a judgment module 2, an identification module 3, and a projection module 4.

[0062] Among them, the collection module 1 is used to collect status information of each vehicle component on the vehicle. The judging module 3 is used for judging whether the vehicle components are abnormal according to the status information. The identification module 3 is used to select an abnormal image matching the identification information of the vehicle component from a plurality of abnormal images in advance as the target abnormal image to be projected when it is determined that the vehicle component is abnormal. The projection module 4 is used to project the target abnormal image onto the road ahead where the vehicle is currently driving through the headlight.

[0063] Specifically, the corresponding abnormal image when each vehicle component is abnormal may be stored in advance through the related storage module, and each abnormal image is matched with the identification information of the corresponding vehicle component. When the headlights of the vehicle are on, it is judged that the vehicle is driving at night. The collection module 1 can collect the status information of the vehicle components through the CAN bus of the vehicle, which can include: vehicle speed, gear and driving mode, driving efficiency indicator, Power meter, electricity meter, water temperature meter, 120km/h alarm indicator, cruising range, water temperature warning light, engine failure warning light, engine maintenance warning light, oil pressure warning light, automatic transmission overheating warning light, charging warning light, power battery Fault warning light, intelligent start-stop system indicator light, seat belt not fastened warning light, door open warning light, parking brake indicator light, etc. Then the judgment module 2 judges whether the vehicle components are abnormal based on the status information. For example, if the oil pressure warning light is on, it means that the vehicle oil pressure is abnormal, and it is judged that the vehicle components are abnormal; for another example, if the water temperature warning light is on , Indicating that the water temperature is abnormal, and it is determined that the vehicle components are abnormal. If the judgment module 2 judges that the vehicle component is abnormal, the identification module 3 obtains the identification of the abnormal vehicle component, and selects the abnormal image that matches the identification information of the vehicle component from the multiple abnormal images in advance as the target abnormal image to be projected. Then the projection module 4 uses the headlights to project the target abnormal image into the projection area on the road ahead of the vehicle, so that the driver can quickly understand the abnormal situation of the vehicle. As a result, the device can project the abnormal information of the vehicle through the headlights on the road ahead of the vehicle, and the driver can quickly obtain the abnormal condition of the vehicle without lowering his head, greatly improving driving safety.

[0064] It should be noted that the embodiment of the device of the present invention can be configured to execute the embodiment of the method of the present invention. For details that are not disclosed in the device embodiment of the present invention, please refer to the method embodiment of the present invention.

[0065] The headlamp-based projection device of the embodiment of the present invention collects the status information of each vehicle component on the vehicle through the collection module. The judgment module determines whether the vehicle component is abnormal based on the status information. When the identification module determines that the vehicle component is abnormal , Select the abnormal image matching the identification information of the vehicle component from the multiple abnormal images in advance as the target abnormal image to be projected, and the projection module projects the target abnormal image onto the road ahead of the vehicle currently driving through the headlight. As a result, the device can project the abnormal information of the vehicle through the headlights on the road ahead of the vehicle, and the driver can quickly obtain the abnormal condition of the vehicle without lowering his head, greatly improving driving safety.

[0066] In addition, an embodiment of the present invention also provides an electronic device including a memory and a processor; wherein, the processor reads the executable program code stored in the memory to run the executable program code corresponding to the executable program code. The program is used to realize the above-mentioned headlamp-based projection method.

[0067] According to the electronic device of the embodiment of the present invention, the status information of each vehicle component on the vehicle is first collected, and then according to the status information, it is determined whether the vehicle component is abnormal. When it is determined that the vehicle component is abnormal, it is selected from multiple abnormal images in advance , Select the abnormal image matching the identification information of the vehicle component as the target abnormal image to be projected, and then project the target abnormal image onto the road in front of the vehicle through the headlights. The driver can quickly obtain the vehicle’s information without lowering his head. Abnormal conditions greatly improve driving safety.

[0068] An embodiment of the present invention also proposes a non-transitory computer-readable storage medium on which a computer program is stored, and the program is executed by a processor to implement the above-mentioned headlamp-based projection method.

[0069] The non-transitory computer-readable storage medium of the embodiment of the present invention first collects the status information of each vehicle component on the vehicle, and then determines whether the vehicle component is abnormal based on the status information. When it is determined that the vehicle component is abnormal, Among the multiple abnormal images, the abnormal image that matches the identification information of the vehicle components is selected as the target abnormal image to be projected, and then the target abnormal image is projected onto the road ahead of the vehicle through the headlights. The driver does not need to bow his head. The abnormal condition of the vehicle can be quickly obtained, which greatly improves the safety of driving.

[0070] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", " Back", "Left", "Right", "Vertical", "Horizontal", "Top", "Bottom", "Inner", "Outer", "Clockwise", "Counterclockwise", "Axial", The orientation or positional relationship indicated by "radial", "circumferential", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying the pointed device or element It must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present invention.

[0071] In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, "a plurality of" means at least two, such as two, three, etc., unless otherwise specifically defined.

[0072] In the present invention, unless otherwise clearly defined and defined, the first feature "on" or "under" the second feature may be in direct contact with the first and second features, or indirectly through an intermediary. contact. Moreover, the "above", "above", and "above" of the first feature on the second feature may mean that the first feature is directly above or diagonally above the second feature, or it simply means that the level of the first feature is higher than the second feature. The "below", "below", and "below" of the second feature of the first feature may mean that the first feature is directly below or obliquely below the second feature, or it simply means that the level of the first feature is smaller than the second feature.

[0073] In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean specific features described in conjunction with the embodiment or example , Structure, materials or features are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above-mentioned terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine the different embodiments or examples and the characteristics of the different embodiments or examples described in this specification without contradicting each other.

[0074] Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present invention. A person of ordinary skill in the art can comment on the above-mentioned embodiments within the scope of the present invention. The embodiment undergoes changes, modifications, replacements and modifications.