Vehicle prompting method and device, vehicle and readable storage medium

By predicting the vehicle's driving trajectory and projecting the vehicle's wide boundary line on the HUD, the problem of novice drivers' judgment and vehicle safety are solved, and the driver's judgment accuracy and vehicle safety are improved.

CN119078508APending Publication Date: 2024-12-06GREAT WALL MOTOR CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411366920.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-29
Publication Date
2024-12-06

AI Technical Summary

Technical Problem

It is difficult for novice drivers to judge whether the vehicle can pass safely when facing a small space, resulting in limited driving safety.

Method used

By predicting the vehicle's driving trajectory and determining the corresponding vehicle width boundary line, the vehicle width boundary line is projected on the windshield using a head-up display (HUD) to help the driver determine whether the vehicle can pass through the road ahead safely and illuminate according to ambient light Intensity and obstacle condition adjustments display color and brightness.

Benefits of technology

It improves the accuracy and convenience of the driver in determining whether the vehicle can pass through the road ahead safely, reduces the occurrence of traffic accidents, and improves the safety of vehicle driving.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119078508A_ABST
    Figure CN119078508A_ABST
Patent Text Reader

Abstract

The invention provides a vehicle prompting method and device, a vehicle and a readable storage medium, the method is applied to the technical field of vehicles, and the method comprises the following steps: predicting a driving track of the vehicle; determining a vehicle width boundary line corresponding to the driving track of the vehicle according to the vehicle width and the driving track of the vehicle; an HUD of the vehicle is controlled to project the vehicle width boundary line to a first position of a windshield of the vehicle, and the first position is a preset position where the projected vehicle width boundary line can coincide with the real vehicle width when the vehicle runs according to the running track so as to prompt whether the vehicle can pass through a front road or not; the method can improve the accuracy of judging whether the vehicle can safely pass through the road ahead by a driver, thereby improving the safety of vehicle driving.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and more specifically, to a vehicle prompt method, device, vehicle and readable storage medium in the field of vehicle technology. Background Art

[0002] With the rapid development of economy, cars are becoming more and more popular, and the number of novice drivers is also increasing. However, since novice drivers have a poor sense of space in the car during driving, they cannot judge whether the vehicle can pass safely when facing a narrow space area (such as a small alley, a pedestrian street, etc.).

[0003] Therefore, how to assist novice drivers in determining whether the vehicle can safely pass the road ahead is an issue that needs to be addressed urgently. Summary of the invention

[0004] The present application provides a vehicle prompt method, device, vehicle and readable storage medium, which can improve the accuracy of the driver's judgment on whether the vehicle can safely pass the road ahead, thereby improving the safety of vehicle driving.

[0005] In a first aspect, a vehicle prompt method is provided, the method comprising: predicting a driving trajectory of a vehicle; determining a vehicle width boundary line corresponding to the driving trajectory of the vehicle based on the vehicle width and the driving trajectory of the vehicle; controlling the HUD of the vehicle to project the vehicle width boundary line at a first position on the windshield of the vehicle, the first position being a preset position at which the projected vehicle width boundary line can coincide with the actual vehicle width when the vehicle is driving along the driving trajectory, so as to prompt whether the vehicle can pass the road ahead.

[0006] In the above technical scheme, the embodiment of the present application provides a vehicle prompt method: it can predict the driving trajectory of the vehicle, and determine the vehicle width boundary line corresponding to the driving trajectory of the vehicle according to the vehicle width and the driving trajectory of the vehicle, and finally control the head-up display (Head-Up Display, HUD) of the vehicle to project the determined vehicle width boundary line on the first position of the windshield of the vehicle. Since the first position is a preset position that can make the projected vehicle width boundary line coincide with the actual vehicle width when the vehicle is traveling along the driving trajectory, when the road ahead of the vehicle is a narrow section, the driver can judge whether the vehicle can safely pass the road ahead by the projected vehicle width boundary line according to the predicted driving trajectory, without having to rely entirely on subjective driving experience, thereby improving the accuracy of the driver's judgment on whether the vehicle can safely pass the road ahead, thereby improving the safety of vehicle driving.

[0007] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, the method also includes: acquiring an environmental image in the direction of vehicle travel; detecting whether the vehicle is in a target scene based on the environmental image, the target scene being a scene in which the width of the road ahead of the vehicle is less than a width threshold; and predicting the vehicle's driving trajectory when it is determined that the vehicle is in the target scene.

[0008] In the above technical scheme, an environmental image in the direction of vehicle travel can be obtained, and based on the environmental image, it is detected whether the width of the road in front of the vehicle is less than a width threshold, that is, whether the vehicle is in a target scene, so as to predict the vehicle's driving trajectory when it is determined that the vehicle is in the target scene, that is, when the vehicle is in the target scene, determine the vehicle width boundary line corresponding to the vehicle's driving trajectory, and control the vehicle's HUD to project the vehicle width boundary line to reduce the vehicle's control power consumption.

[0009] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, a vehicle width boundary line corresponding to the vehicle's driving trajectory is determined according to the vehicle width and the vehicle's driving trajectory, including: determining the type of the vehicle width boundary line corresponding to the vehicle's driving trajectory according to the vehicle's driving trajectory, the type of the vehicle width boundary line including one of a straight-ahead vehicle width boundary line, a left-turn vehicle width boundary line, and a right-turn vehicle width boundary line; determining the vehicle width boundary line corresponding to the vehicle's driving trajectory according to the type of the vehicle width boundary line, the vehicle width, and the vehicle's driving trajectory.

[0010] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of the windshield of the vehicle includes: detecting whether there is an obstacle on the road ahead of the vehicle; when it is determined that there is an obstacle on the road ahead of the vehicle, determining the first color information as the target display color of the vehicle width boundary line, and controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of the windshield of the vehicle according to the target display color, and the first color information is used to prompt that the vehicle cannot pass the road ahead; when it is determined that there is no obstacle on the road ahead of the vehicle, determining the second color information as the target display color of the vehicle width boundary line, and controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of the windshield of the vehicle according to the target display color, and the second color information is used to prompt that the vehicle can pass the road ahead.

[0011] In the above technical solution, it is possible to detect whether there is an obstacle on the road ahead of the vehicle, and determine the target display color of the vehicle width boundary line according to the detection result, so as to control the HUD of the vehicle to project the vehicle width boundary line at the first position of the windshield of the vehicle according to the target display color. Specifically, when it is determined that there is an obstacle on the road ahead of the vehicle, that is, when it is determined that the vehicle cannot safely pass through the road ahead, the first color information can be determined as the target display color of the vehicle width boundary line, and the HUD of the vehicle can be controlled to project the vehicle width boundary line at the first position of the windshield of the vehicle according to the target display color; when it is determined that there is no obstacle on the road ahead of the vehicle, that is, when it is determined that the vehicle can safely pass through the road ahead, the second color information can be determined as the target display color of the vehicle width boundary line, and the HUD of the vehicle can be controlled to project the vehicle width boundary line at the first position of the windshield of the vehicle according to the target display color, that is, through this method, the driver can quickly determine whether the vehicle can pass through the road ahead through the display color of the vehicle width boundary line (first display color / second color information), thereby improving the convenience of the driver in judging whether the vehicle can pass through the road ahead.

[0012] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of the windshield of the vehicle includes: obtaining the light intensity of the vehicle's current environment; when the light intensity of the vehicle's current environment is less than or equal to a first intensity threshold, determining the first display brightness as the target display brightness of the vehicle width boundary line, and controlling the vehicle's HUD to project the vehicle width boundary line at a first position of the vehicle's windshield according to the target display brightness; when the light intensity of the vehicle's current environment is greater than the first intensity threshold, determining the second display brightness as the target display brightness, and controlling the vehicle's HUD to project the vehicle width boundary line at a first position of the vehicle's windshield according to the target display brightness, the second display brightness being lower than the first display brightness.

[0013] In the above technical solution, the light intensity of the vehicle's current environment can be obtained, and the size relationship between the light intensity and the first intensity threshold can be compared, so as to determine the target display brightness of the vehicle width boundary line according to the comparison result, and then control the vehicle's HUD to project the vehicle width boundary line at the first position of the vehicle's windshield according to the target display brightness. Specifically, when it is determined that the illumination intensity of the vehicle's current environment is less than or equal to the first intensity threshold, that is, when it is determined that the illumination intensity currently received by the vehicle is a higher illumination intensity, the first display brightness can be determined as the target display brightness of the vehicle width boundary line, and the HUD of the vehicle is controlled to project the vehicle width boundary line at a first position of the vehicle's windshield according to the target display brightness, so as to ensure that the projected vehicle width boundary line can be clearly displayed on the windshield in a strong light environment; when the illumination intensity of the vehicle's current environment is greater than the first intensity threshold, that is, when it is determined that the illumination intensity currently received by the vehicle is a lower illumination intensity, a second display brightness having a brightness value lower than the first display brightness can be determined as the target display brightness, and the HUD of the vehicle is controlled to project the vehicle width boundary line at a first position of the vehicle's windshield according to the target display brightness, so as to ensure that the projected vehicle width boundary line can be softly displayed on the windshield in a weak light environment, thereby avoiding the high-brightness display effect interfering with the driver's line of sight, that is, this method can ensure that the HUD can project the vehicle width boundary line with the best display effect under different illumination intensities.

[0014] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, controlling the vehicle's HUD to project the vehicle width boundary line at a first position on the vehicle's windshield includes: obtaining the vehicle's speed and the distance between the vehicle and the vehicle in front; controlling the vehicle's HUD to project the vehicle width boundary line at a first position on the vehicle's windshield, and controlling the vehicle's HUD to project the vehicle's speed and the distance between the vehicle and the vehicle in front at a second position on the vehicle's windshield, the second position being a preset position that does not affect the driver's field of view directly ahead.

[0015] In the above technical solution, the vehicle speed and the distance between the vehicle and the vehicle in front can be obtained, and the vehicle HUD can be controlled to project the vehicle width boundary line at the first position of the vehicle's windshield, and the vehicle HUD can be controlled to project the vehicle speed and the distance between the vehicle and the vehicle in front at a position (second position) of the vehicle's windshield that does not affect the driver's front view. In this way, while projecting the vehicle width boundary line on the windshield to assist the driver in determining whether he can safely pass the road ahead, the vehicle speed and the distance between the vehicle and the vehicle in front can also be projected on the windshield, thereby reducing the frequency of the driver looking down at the dashboard or navigation screen, and helping the driver to maintain attention on the road ahead. In addition, projecting the vehicle speed and the distance between the vehicle and the vehicle in front on the windshield can also assist the driver in better controlling the vehicle speed and distance, determining a safe following distance, and thus reducing the occurrence of traffic accidents.

[0016] In combination with the first aspect and the above-mentioned implementation methods, in some possible implementation methods, predicting the driving trajectory of the vehicle includes: obtaining the steering wheel steering angle of the vehicle and the speed of the vehicle; predicting the driving trajectory of the vehicle based on the steering wheel steering angle of the vehicle, the speed of the vehicle and a preset time.

[0017] In a second aspect, a vehicle prompting device is provided, the device comprising:

[0018] A prediction module, used to predict the vehicle's driving trajectory;

[0019] A determination module, used to determine a vehicle width boundary line corresponding to the driving trajectory of the vehicle according to the vehicle width and the driving trajectory of the vehicle;

[0020] The control module is used to control the HUD of the vehicle to project the vehicle width boundary line on a first position of the vehicle's windshield. The first position is a preset position at which the projected vehicle width boundary line can overlap with the actual vehicle width when the vehicle is traveling along a driving trajectory, so as to prompt whether the vehicle can pass the road ahead.

[0021] In a third aspect, a vehicle is provided, comprising a memory and a processor. The memory is used to store executable program code, and the processor is used to call and run the executable program code from the memory, so that the vehicle executes the vehicle prompt method in the first aspect or any possible implementation of the first aspect.

[0022] In a fourth aspect, a computer program product is provided, which includes: a computer program code, which, when executed on a computer, enables the computer to execute the vehicle prompt method in the above-mentioned first aspect or any possible implementation of the first aspect.

[0023] In a fifth aspect, a computer-readable storage medium is provided, which stores a computer program code. When the computer program code runs on a computer, the computer executes the vehicle prompt method in the above-mentioned first aspect or any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a schematic diagram of an implementation environment of a vehicle prompt method provided in an embodiment of the present application;

[0025] Figure 2 is a schematic flow chart of a vehicle prompt method provided in an embodiment of the present application;

[0026] FIG3 is a schematic diagram of a HUD projection of a vehicle provided in an embodiment of the present application;

[0027] Figure 4 is a schematic diagram of another HUD projection of a vehicle provided in an embodiment of the present application;

[0028] Figure 5 It is a structural schematic diagram of a vehicle prompting device provided in an embodiment of the present application;

[0029] Figure 6 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application. DETAILED DESCRIPTION

[0030] The technical solution in the present application will be described clearly and in detail below in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B: "and / or" in the text is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0031] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features.

[0032] Before introducing the solutions of the embodiments of the present application, the professional terms that may be involved in the embodiments of the present application are first explained.

[0033] Head-Up Display (HUD): HUD was originally developed as a technology in the field of military aviation, and was later gradually applied to commercial aviation and the automotive industry. The main purpose of HUD is to project important information such as speed, navigation direction, warnings, etc. directly in front of the driver or pilot's line of sight, usually on the windshield, so that the driver can obtain this information without having to look down at the dashboard, which helps to improve driving safety and efficiency. In different application scenarios, the specific implementation of HUD technology and the information displayed will be different. For example, in a car, HUD can display vehicle speed, fuel level, navigation instructions, etc.; while in an airplane, it may include more professional and complex data such as flight altitude, airspeed, heading, etc. With the development of technology, HUD is becoming more and more intelligent and multifunctional, such as integrating augmented reality technology to provide users with a more intuitive and rich way of displaying information.

[0034] Pixel width: refers to the number of pixels in the horizontal direction on a digital image or display.

[0035] Ambient Light Sensor (ALS): An ambient light sensor is a photoelectric sensor that detects the light intensity of the surrounding environment. It usually uses a photodiode or phototransistor to measure light.

[0036] LiDAR (Light Detection And Ranging) is an active remote sensing technology that measures distance by emitting laser pulses and receiving their echoes. It is widely used in a variety of fields, such as autonomous driving, robotics, mapping, environmental monitoring, archeology, etc. The working principle of LiDAR sensors is to determine the distance by emitting a laser beam and measuring its return time.

[0037] Beam splitter technology: HUD can use beam splitter technology to simultaneously project two different images based on different projection angles and projection distances to provide richer information display and better user experience. Beam splitter technology principle: A beam splitter (also called a semi-transparent mirror or beam splitter) is an optical element that can split the incident light into two parts: one part is reflected and the other part is transmitted. By properly designing the angle and position of the beam splitter, multiple images at different angles and distances can be displayed on the same windshield.

[0038] With the rapid development of economy, cars are becoming more and more popular, and the number of novice drivers is also increasing. However, since novice drivers have a poor sense of space in the car during driving, they cannot judge whether the vehicle can pass safely when facing a narrow space area (for example, a small alley).

[0039] Therefore, how to assist novice drivers in determining whether the vehicle can safely pass the road ahead is an issue that needs to be addressed urgently.

[0040] Based on the above problems, the present application provides a vehicle prompt method, device, vehicle and readable storage medium, which can improve the accuracy of the driver's judgment on whether the vehicle can safely pass the road ahead, thereby improving the safety of vehicle driving.

[0041] Figure 1 This is a schematic diagram of the implementation environment of a vehicle prompt method provided by the present application.

[0042] For example, Figure 1 As shown, the implementation environment includes a vehicle controller 101 , a HUD controller 102 and a HUD 103 .

[0043] The vehicle controller 101 is an important control unit of the vehicle, which can determine relevant data of the vehicle, such as the vehicle's driving trajectory, vehicle width boundary line, vehicle speed, distance between the vehicle and the vehicle in front, light intensity of the vehicle's current environment, etc., and control the projection content of the vehicle's HUD based on the relevant parameters.

[0044] In some embodiments, the vehicle controller 101 sends the vehicle width boundary line to the HUD controller 102 through a communication bus in the vehicle (e.g., a controller area network (CAN) bus) to control the projection of the content of the vehicle's HUD, that is, to control the vehicle's HUD to project the vehicle width boundary line onto the vehicle's windshield.

[0045] In some embodiments, the HUD controller controls the vehicle's HUD to project the vehicle width boundary line at a first position on the vehicle's windshield based on a preset first position and the vehicle width boundary line sent by the vehicle controller 101, thereby assisting the driver in determining whether the vehicle can safely pass the road ahead by projecting the vehicle width boundary line on the vehicle's windshield.

[0046] It can be understood that the vehicle in the embodiment of the present application can be a car, a bus, an off-road vehicle or a truck, etc., and the embodiment of the present application is not limited to this.

[0047] Below through Figure 2 The method of the embodiment of the present application is described in detail.

[0048] Figure 2 It is a schematic flow chart of a vehicle prompt method provided in an embodiment of the present application.

[0049] For example, Figure 2 As shown, taking the execution subject as a vehicle controller as an example, the method 200 includes:

[0050] Step 201, predicting the driving trajectory of the vehicle.

[0051] It should be noted that during the driving process of the vehicle, in order to project a vehicle width boundary line on the windshield of the vehicle that coincides with the actual vehicle width when the vehicle is traveling on the road at the next moment, in an embodiment of the present application, the vehicle controller may first predict the driving trajectory of the vehicle (also referred to as the estimated driving trajectory of the vehicle) so that the vehicle width boundary line corresponding to the driving trajectory can be determined based on the predicted driving trajectory of the vehicle, thereby ensuring that the vehicle width boundary line projected on the windshield of the vehicle coincides with the actual vehicle width when the vehicle is traveling on the road at the next moment, that is, coincides with the actual vehicle width when the vehicle is traveling on the road according to the predicted driving trajectory.

[0052] The following is a detailed introduction in two parts on the specific implementation method of the vehicle controller predicting the vehicle's driving trajectory.

[0053] Part 1: Get the vehicle's steering wheel angle and vehicle speed.

[0054] Among them, the steering angle of the vehicle's steering wheel can be obtained through devices such as steering angle sensors, Hall effect sensors or potentiometers, and the vehicle speed can be obtained through devices such as wheel speed sensors, magnetic sensors, accelerometers, transmission speed sensors, etc., which are not limited to the embodiments of the present application.

[0055] The second part predicts the vehicle's driving trajectory based on the vehicle's steering wheel angle, vehicle speed and preset duration.

[0056] It should be noted that, generally, there is a preset transmission ratio between the steering angle of the vehicle's steering wheel and the steering angle of the vehicle's wheels, that is, when the steering angle of the vehicle's steering wheel is determined, the steering angle of the vehicle's wheels can be determined according to the transmission ratio. For example, if the transmission ratio between the steering angle of the vehicle's steering wheel and the steering angle of the vehicle's wheels is 20, when the steering angle of the vehicle's steering wheel is 1°, the steering angle of the vehicle's steering wheel is 1° / 20=0.05°.

[0057] In the embodiment of the present application, after obtaining the steering wheel steering angle of the vehicle, the vehicle controller can determine the corresponding wheel steering angle of the vehicle according to the transmission ratio and the steering wheel steering angle of the vehicle, thereby determining the expected driving direction of the vehicle (for example, left turn, right turn and straight driving, etc.) according to the wheel steering angle, and then determine the expected driving distance of the vehicle according to the vehicle speed and the preset duration, and finally determine the expected driving trajectory of the vehicle according to the expected driving direction and the expected driving distance of the vehicle. It can be understood that the expected driving trajectory of the vehicle can be divided into a straight trajectory line, a left turn trajectory line and a right turn trajectory line.

[0058] Exemplarily, when the vehicle's steering wheel steering angle is 1°, the vehicle speed is 30 km / h, and the preset time is 3 seconds, the vehicle controller can determine that the corresponding vehicle's wheel steering angle is 0.05° based on the vehicle's steering wheel steering angle (1°), that is, it is determined that the turning radius of the vehicle at this time approaches infinity, and the vehicle's expected driving direction is determined to be straight, and based on the vehicle's speed (30 km / h) and the preset time (3 seconds), the vehicle's expected driving distance is determined, that is, the vehicle's expected driving distance is 30 km / h×3 seconds=24.99 meters. Finally, based on the vehicle's expected driving direction (straight ahead) and the vehicle's expected driving distance (24.99 meters), it is determined that the vehicle's expected driving trajectory is a straight trajectory line with a driving distance of 24.99 meters.

[0059] In order to reduce the control power consumption of the vehicle, in one possible implementation, the vehicle controller needs to predict the vehicle's driving trajectory when it determines that the road ahead of the vehicle is a narrow road, that is, when it determines that the driver needs the vehicle to provide assistance to determine whether the vehicle can safely pass the road ahead, thereby determining the vehicle width boundary line corresponding to the vehicle's driving trajectory, and controlling the vehicle's HUD to project the vehicle width boundary line, so as to achieve the purpose of reducing the control power consumption of the vehicle.

[0060] The following is a detailed introduction in three parts on the specific implementation method of predicting the vehicle's driving trajectory when the vehicle controller determines that the vehicle is in the target scene:

[0061] The first part is to obtain the environment image in the direction of vehicle travel.

[0062] The vehicle's driving direction may be understood as the direction in which the vehicle moves on the road, that is, the direction in which the front of the vehicle is located.

[0063] The environmental image refers to an image in the direction of vehicle travel acquired by an image acquisition device on the vehicle (eg, a camera disposed outside or inside the vehicle).

[0064] The second part detects whether the vehicle is in a target scene based on the environment image. The target scene is a scene where the width of the road in front of the vehicle is less than a width threshold.

[0065] Among them, the travel width of the road ahead of the vehicle is less than the width threshold, which can be understood as the road ahead of the vehicle is a narrow road, such as a small alley, a pedestrian street, etc.

[0066] Specifically, after the vehicle controller obtains the environmental image in the direction of vehicle travel, it can first identify the road edge line on the environmental image, that is, the road edge line of the road in front of the vehicle, and then determine the travel width of the road in front of the vehicle based on the identified road edge line, and finally compare the size relationship between the width threshold and the travel width of the road in front of the vehicle, so as to determine whether the vehicle is in the target scene when it is determined that the travel width of the road in front of the vehicle is less than the width threshold.

[0067] It should be noted that in order to enable the vehicle controller to accurately identify the road edge lines on the environmental image, after acquiring the environmental image in the direction of vehicle travel, the environmental image can be first subjected to image denoising and image enhancement processing to improve the clarity and contrast of the environmental image, making the road edge lines in the environmental image more vivid and clear, so that the vehicle controller can accurately identify the road edge lines on the environmental image.

[0068] Optionally, the environmental image can be denoised by means of mean filtering, median filtering, Gaussian filtering, bilateral filtering, deep learning network or Kalman filtering, and the environmental image can be enhanced by means of histogram equalization, gamma correction or Laplace enhancement, but the embodiments of the present application are not limited to this.

[0069] In the embodiment of the present application, the specific implementation method of identifying the road edge line on the environment image is as follows:

[0070] In a possible implementation, the Canny edge detection algorithm may be used to identify the road edge line on the environment image. It should be noted that, in order to improve the detection efficiency, the environment image may be converted into a grayscale image to reduce the amount of data, and then the Sobel operator is used to calculate the gradient value of each pixel point on the environment image, so that the gradient value of each pixel point can be used to determine whether the pixel point is on the road edge.

[0071] Specifically, after determining the gradient value of each pixel, it is possible to determine whether each pixel is a pixel on the edge of the road according to two pre-set gradient thresholds (a first gradient threshold and a second gradient threshold). The first gradient threshold is greater than the second gradient threshold, so that when the gradient value of the pixel is greater than the first gradient threshold, the pixel is determined to be a strong edge pixel on the edge of the road; when the gradient value of the pixel is less than the second gradient threshold, the pixel is determined to be an irrelevant pixel that is not on the edge of the road. It should be noted that in order to obtain a clear and definite road edge line, the irrelevant pixel needs to be suppressed in this case, that is, the specific attributes of the irrelevant pixel, such as brightness and color intensity, are eliminated, so as to highlight the pixel on the edge of the road, thereby making the road edge line clearer in the environmental image; when the gradient value of the pixel is greater than the second gradient threshold and less than the first gradient threshold, the pixel is determined to be a weak edge pixel on the edge of the road.

[0072] It should be noted that in order to improve the accuracy of the pixel points determined to be on the edge of the road, after determining that the pixel point is a weak edge pixel point, it is necessary to further determine whether the pixel point (weak edge pixel point) is a pixel point on the edge of the road. Specifically, it can be detected whether the weak edge pixel point is connected to all strong edge pixels. When it is determined that the weak edge pixel point is connected to all strong edge pixels, it is determined that the weak edge pixel point is a pixel point on the edge of the road; when it is determined that the weak edge pixel point is not connected to some strong edge pixels, the pixel point is suppressed to ensure the accuracy of the pixel points determined to be on the edge of the road. Further, after determining the pixel point on the edge of the road on the environmental image, the identified road edge line can be displayed on the environmental image in combination with the Hough Transform.

[0073] Optionally, the road edge line on the environment image can also be identified by a target detection algorithm (You Only Look Once, YOLO), a single shot multi-box detection algorithm (Single Shot MultiBox Detector, SSD) or a deep learning network model, but this embodiment of the present application is not limited to this.

[0074] It is understandable that after the road edge line on the environment image is identified by the Canny edge detection algorithm, the clearance width of the road ahead of the vehicle can be determined according to the identified road edge line.

[0075] In the embodiment of the present application, the specific implementation method of determining the passing width of the road ahead of the vehicle according to the identified road edge line is as follows:

[0076] It can be understood that the identified road edge line of the road ahead of the vehicle can be divided into a left road edge line and a right road edge line, that is, in an embodiment of the present application, the clearance width of the road ahead of the vehicle can be determined based on the left road edge line and the right road edge line.

[0077] In a possible implementation, the upper left corner coordinates and lower right corner coordinates of the bounding boxes of the left road edge line and the right road edge line on the environment image can be first determined by a target detection algorithm (You Only Look Once, YOLO), and then the center coordinates of the left road edge line on the environment image are calculated based on the upper left corner coordinates and the upper left corner coordinates of the left road edge line on the environment image, and the center coordinates of the right road edge line on the environment image are calculated based on the upper left corner coordinates and the upper left corner coordinates of the bounding box of the right road edge line on the environment image, thereby obtaining the center coordinates of the left road edge line and the right road edge line on the environment image.

[0078] Exemplarily, when the upper left corner coordinates and the upper left corner coordinates of the bounding box of the left road edge line on the environmental image are determined to be (X1, Y1) and (X2, Y2) respectively, the center coordinates of the left road edge line on the environmental image are calculated to be (X1-X2, Y1-Y2); when the upper left corner coordinates and the upper left corner coordinates of the bounding box of the right road edge line on the environmental image are determined to be (X3, Y3) and (X4, Y4) respectively, the center coordinates of the right road edge line on the environmental image are calculated to be (X3-X4, Y3-Y4).

[0079] Furthermore, after determining the center coordinates of the left road edge line and the right road edge line on the environmental image, the vehicle controller can determine the pixel width of the left road edge line and the right road edge line on the environmental image based on the center coordinates of the left road edge line and the right road edge line on the environmental image, thereby determining the pass width of the road ahead of the vehicle based on a correspondence table between preset pixel widths and the pass width of the road ahead of the vehicle.

[0080] For example, when the center coordinates of the left road edge line on the environmental image are (X5, Y5) and the center coordinates of the right road edge line on the environmental image are (X6, Y6), the pixel widths of the left road edge line and the right road edge line on the environmental image are determined to be (X5-X6), thereby determining the clearance width of the road ahead of the vehicle based on a correspondence table between preset pixel widths and the clearance width of the road ahead of the vehicle.

[0081] Exemplarily, the corresponding relationship table between the pixel width and the passing width of the road ahead of the vehicle may be shown in the following Table 1:

[0082] Table 1

[0083] Pixel width (px) Width of the road ahead (m) 120 1.0 160 1.5 200 2.0 240 2.5 280 3.0 …… ……

[0084] It can be understood that the pixel widths in Table 1 are (X5-X6) in the above embodiment. For example, when the pixel width (X5-X6) of the left road edge line and the right road edge line on the environmental image is 160px, the clearance width of the road ahead of the vehicle corresponding to the pixel width (160px) can be determined as 1.5 meters based on the pixel width (160px) and Table 1.

[0085] Part 3: When it is determined that the vehicle is in the target scene, predict the vehicle's driving trajectory.

[0086] Among them, the implementation example of predicting the driving trajectory of the vehicle can be found in the above implementation example, which will not be repeated here.

[0087] Step 202: Determine a vehicle width boundary line corresponding to the vehicle's driving trajectory according to the vehicle width and the vehicle's driving trajectory.

[0088] It can be understood that the vehicle width can be pre-stored in the vehicle system as vehicle attribute information, and the vehicle controller can directly obtain the vehicle width from the vehicle system, and determine the vehicle width boundary line corresponding to the vehicle's driving trajectory based on the vehicle width and the predicted vehicle's driving trajectory.

[0089] The following is a detailed description of the specific implementation method of the vehicle controller to determine the vehicle width boundary line corresponding to the vehicle's driving trajectory in several steps:

[0090] Step 1: according to the driving trajectory of the vehicle, determine the type of vehicle width boundary line corresponding to the driving trajectory of the vehicle, the type of vehicle width boundary line includes one of a straight vehicle width boundary line, a left-turn vehicle width boundary line and a right-turn vehicle width boundary line.

[0091] It should be noted that when the vehicle is moving straight or turning (left turn / right turn), the vehicle's width boundary line will also change its trajectory as the vehicle turns. Therefore, in an embodiment of the present application, after determining the vehicle's driving trajectory, the vehicle controller can first determine the type of vehicle width boundary line corresponding to the vehicle's driving trajectory, so as to ensure that the trajectory of the determined vehicle's width boundary line is the same as the predicted vehicle's driving trajectory, thereby ensuring that the projected vehicle's width boundary line can accurately assist the driver in determining whether the vehicle can pass the road ahead.

[0092] It can be seen from the above embodiments that the predicted driving trajectory of the vehicle can be divided into a straight trajectory line, a left turn trajectory line and a right turn trajectory line. Therefore, the vehicle width boundary line corresponding to the vehicle's driving trajectory can also be divided into a straight vehicle width boundary line, a left turn vehicle width boundary line and a right turn vehicle width boundary line.

[0093] In a possible embodiment, the developer can pre-set the type of vehicle width boundary line corresponding to the vehicle's driving trajectory and store it in the vehicle's internal memory, so that after the vehicle controller predicts the vehicle's driving trajectory, the type of vehicle width boundary line corresponding to the driving trajectory can be directly determined based on the pre-set corresponding relationship.

[0094] Exemplarily, when the vehicle's driving trajectory is a straight trajectory line, the type of the vehicle width boundary line corresponding to the straight trajectory line is a straight vehicle width boundary line; when the vehicle's driving trajectory is a left turn trajectory line, the type of the vehicle width boundary line corresponding to the left turn trajectory line is a left turn vehicle width boundary line; when the vehicle's driving trajectory is a right turn trajectory line, the type of the vehicle width boundary line corresponding to the right turn trajectory line is a right turn vehicle width boundary line.

[0095] Step 2: Determine the vehicle width boundary line corresponding to the vehicle's driving trajectory according to the type of the vehicle width boundary line, the vehicle width and the vehicle's driving trajectory.

[0096] It should be noted that after determining the type of the vehicle width boundary line, the vehicle controller can extend the vehicle width toward the vehicle's expected driving trajectory (which can also be understood as the vehicle's expected driving direction) according to the type of the vehicle width boundary line, that is, extend the width lines on both sides of the vehicle, thereby forming a vehicle width boundary line corresponding to the vehicle's driving trajectory.

[0097] In one possible implementation, developers can pre-calibrate width lines on both sides of the vehicle (which can also be understood as a group of points on both sides of the vehicle) that are the same as the width value of the vehicle, that is, the horizontal distance between the calibrated width lines on both sides of the vehicle is the same as the width value of the vehicle, and store the calibrated width lines on both sides of the vehicle in the vehicle's internal memory, so that the vehicle controller can extend the width lines on both sides of the vehicle to a preset length in the expected driving direction of the vehicle according to the type of the vehicle width boundary line, thereby forming a vehicle width boundary line corresponding to the vehicle's driving trajectory.

[0098] Exemplarily, when the preset length is 20 cm, the determined vehicle width boundary line type is a straight-moving vehicle width boundary line, and the vehicle's predicted driving trajectory is a straight-moving trajectory line, the vehicle controller can extend the width lines on both sides of the vehicle by 20 cm in the vehicle's forward direction according to the type of the vehicle width boundary line (straight-moving vehicle width boundary line), thereby forming a straight-moving vehicle width boundary line corresponding to the vehicle's driving trajectory (straight-moving trajectory line).

[0099] Step 203, controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of the windshield of the vehicle, the first position being a preset position at which the projected vehicle width boundary line can overlap with the actual vehicle width when the vehicle is traveling along the driving trajectory, so as to prompt whether the vehicle can pass the road ahead.

[0100] Specifically, after the vehicle controller determines the vehicle width boundary line, the vehicle width boundary line can be sent to the HUD controller. After receiving the vehicle width boundary line, the HUD controller generates a vehicle width boundary line image corresponding to the vehicle width boundary line, and controls the vehicle's HUD to project the vehicle width boundary line image onto the vehicle's windshield (which can also be understood as the vehicle's front windshield) at a first position, that is, a position where the projected vehicle width boundary line can coincide with the actual vehicle width when the vehicle is traveling according to the predicted driving trajectory.

[0101] Exemplarily, the schematic diagram of the vehicle's HUD projecting the vehicle width boundary line (vehicle width boundary line image) at the first position of the vehicle's windshield can be specifically referred to as shown in FIG3. Among them, FIG3(a) is a schematic diagram of the vehicle's HUD projecting the straight-moving vehicle width boundary line image at the first position of the vehicle's windshield; FIG3(a) is a schematic diagram of the vehicle's HUD projecting the left-turning vehicle width boundary line image at the first position of the vehicle's windshield; FIG3(a) is a schematic diagram of the vehicle's HUD projecting the right-turning vehicle width boundary line image at the first position of the vehicle's windshield.

[0102] It should be noted that, since the determined vehicle width boundary line corresponding to the vehicle's driving trajectory is formed in the world coordinate system, and the HUD controller needs to generate a vehicle width boundary line image corresponding to the vehicle width boundary line in the image coordinate system, the vehicle's HUD projection of the vehicle width boundary line image corresponding to the vehicle width boundary line needs to be performed in the HUD coordinate system. Therefore, in order to ensure that the vehicle width boundary line image projected by the vehicle's HUD can be presented at the correct position, that is, to ensure that the vehicle's HUD can project the vehicle width boundary line image at the first position of the vehicle's windshield, in an embodiment of the present application, it is necessary to perform coordinate transformation on the pixel points in the vehicle width boundary line corresponding to the vehicle's driving trajectory determined in the world coordinate system to obtain the corresponding pixel points in the HUD coordinate system, thereby ensuring that the vehicle width boundary line image projected by the vehicle's HUD can coincide with the actual vehicle width when the vehicle is driving along the driving trajectory, that is, achieving a virtual-real combination effect.

[0103] Among them, the world coordinate system is a three-dimensional coordinate system, which is used to describe the actual position and posture of the vehicle relative to the earth, and usually takes a fixed point of the vehicle as the origin, such as the center point of the vehicle as the origin; the HUD coordinate system is a two-dimensional coordinate system, and the origin is located at the lower left corner or center of the HUD display screen, with the X-axis pointing to the right and the Y-axis pointing upward; the image coordinate system is a two-dimensional coordinate system, which is a coordinate system used to represent the pixel position of the projected image, and usually also takes the lower left corner or center of the projected image as the origin (in the embodiment of the present application, the projected image is a vehicle width boundary line image corresponding to the vehicle width boundary line).

[0104] Specifically, after determining the pixel points of the vehicle width boundary line corresponding to the vehicle's driving trajectory in the world coordinate system, the pixel point coordinates of the vehicle width boundary line corresponding to the vehicle's driving trajectory in the world coordinate system can be converted into pixel point coordinates in the image coordinate system through a projection model, that is, the points in the three-dimensional space are mapped onto the two-dimensional image plane, so that the HUD controller generates a vehicle width boundary line image corresponding to the vehicle width boundary line in the image coordinate system according to the converted pixel point coordinates. Furthermore, when the HUD controller controls the HUD of the vehicle to project the vehicle width boundary line at a first position on the windshield of the vehicle, it is necessary to convert the pixel point coordinates of the vehicle width boundary line image in the image coordinate system into pixel point coordinates in the HUD coordinate system through scaling and translation, so that the HUD of the vehicle can project the vehicle width boundary line image at a first position on the windshield of the vehicle in the HUD coordinate system according to the pixel point coordinates after the re-conversion, thereby ensuring that the projected vehicle width boundary line image can coincide with the actual vehicle width when the vehicle is driving along the driving trajectory.

[0105] In summary, the vehicle prompt method provided in the embodiment of the present application can predict the driving trajectory of the vehicle, and determine the vehicle width boundary line corresponding to the driving trajectory of the vehicle based on the vehicle width and the driving trajectory of the vehicle, and finally control the HUD of the vehicle to project the determined vehicle width boundary line on the first position of the windshield of the vehicle. Since the first position is a preset position at which the projected vehicle width boundary line can coincide with the actual vehicle width when the vehicle is traveling along the driving trajectory, when the road ahead of the vehicle is a narrow section, the driver can judge whether the vehicle can safely pass the road ahead by the projected vehicle width boundary line according to the expected driving trajectory, without having to rely entirely on subjective driving experience, thereby improving the accuracy of the driver's judgment on whether the vehicle can safely pass the road ahead, thereby improving the safety of vehicle driving.

[0106] In order to further improve the convenience for the driver to judge whether the vehicle can pass the road ahead by the projected vehicle width boundary line, in a possible implementation, the vehicle controller can detect whether there is an obstacle on the road ahead of the vehicle when controlling the vehicle's HUD to project the vehicle width boundary line at a first position on the vehicle's windshield, and determine the target display color of the vehicle width boundary line based on the detection result, thereby controlling the vehicle's HUD to project the vehicle width boundary line at the first position of the vehicle's windshield according to the target display color, so that the driver can quickly determine whether the vehicle can pass the road ahead by the display color of the vehicle width boundary line, thereby improving the convenience for the driver to judge whether the vehicle can pass the road ahead.

[0107] Among them, obstacles can be walls, pedestrians, width-limiting piers on the road, and other vehicles, etc., which are not limited in this embodiment of the present application.

[0108] Optionally, a laser radar sensor, a millimeter wave radar sensor, an ultrasonic sensor, an infrared sensor or other sensors may be used to detect whether there are obstacles on the road ahead of the vehicle, but this embodiment of the present application is not limited to this.

[0109] Specifically, when it is determined by the laser radar sensor that there is an obstacle on the road ahead of the vehicle, that is, when it is determined that the vehicle cannot safely pass the road ahead, the first color information can be determined as the target display color of the vehicle width boundary line, and the vehicle's HUD can be controlled to project the vehicle width boundary line at a first position on the vehicle's windshield according to the target display color, so that the driver can determine that the vehicle cannot pass the road ahead by the display color of the vehicle width boundary line (first color information), thereby reducing the occurrence of traffic accidents and improving the driving safety of the vehicle; when it is determined that there is no obstacle on the road ahead of the vehicle, that is, when it is determined that the vehicle can safely pass the road ahead, the second color information can be determined as the target display color of the vehicle width boundary line, and the vehicle's HUD can be controlled to project the vehicle width boundary line at a first position on the vehicle's windshield according to the target display color, so that the driver can determine that the vehicle can pass the road ahead by the display color of the vehicle width boundary line (second color information), thereby improving the convenience for the driver to judge whether the vehicle can pass the road ahead.

[0110] It should be noted that after the vehicle controller determines the vehicle width boundary line and the target display color of the vehicle width boundary line (first color information / second color information), the vehicle width boundary line and the target display color will be sent to the HUD controller, so that after receiving the vehicle width boundary line and the target display color, the HUD controller generates a vehicle width boundary line image corresponding to the vehicle width boundary line and the target display color, and controls the vehicle's HUD to project the vehicle width boundary line image at a first position on the vehicle's windshield.

[0111] In order to ensure that the vehicle's HUD can project the vehicle width boundary line with the best display effect under different light intensities, in a possible implementation, when the vehicle controller controls the vehicle's HUD to project the vehicle width boundary line at a first position on the vehicle's windshield, it can obtain the light intensity of the vehicle's current environment and compare the light intensity with the first intensity threshold, thereby determining the target display brightness of the vehicle width boundary line based on the comparison result, and then controlling the vehicle's HUD to project the vehicle width boundary line at the first position on the vehicle's windshield according to the target display brightness.

[0112] Optionally, the light intensity of the vehicle's current environment can be obtained through devices such as an ambient light sensor (ALS), a photoresistor, a photodiode, a phototransistor, or an infrared sensor, but this is not limited to the embodiments of the present application.

[0113] Specifically, when it is determined through the ambient light sensor that the light intensity of the environment in which the vehicle is currently located is less than or equal to the first intensity threshold, that is, when it is determined that the light intensity currently received by the vehicle is a higher light intensity, the first display brightness can be determined as the target display brightness of the vehicle width boundary line, and the HUD of the vehicle is controlled to project the vehicle width boundary line at a first position of the windshield of the vehicle according to the target display brightness, so as to ensure that the projected vehicle width boundary line can be clearly displayed on the windshield in a strong light environment; when the light intensity of the environment in which the vehicle is currently located is greater than the first intensity threshold, that is, when it is determined that the light intensity currently received by the vehicle is a lower light intensity, a second display brightness with a brightness value lower than the first display brightness can be determined as the target display brightness, and the HUD of the vehicle is controlled to project the vehicle width boundary line at a first position of the windshield of the vehicle according to the target display brightness, so as to ensure that the projected vehicle width boundary line can be softly displayed in a weak light environment, thereby avoiding the high-brightness display effect interfering with the driver's line of sight, that is, this method can ensure that the HUD can project the vehicle width boundary line with the best display effect under different light intensities.

[0114] It should be noted that after the vehicle controller determines the vehicle width boundary line and the target display brightness of the vehicle width boundary line (first display brightness / second display brightness), the vehicle width boundary line and the target display brightness will be sent to the HUD controller, so that after receiving the vehicle width boundary line and the target display brightness, the HUD controller generates a vehicle width boundary line image corresponding to the vehicle width boundary line, and according to the target display brightness, controls the vehicle's HUD to project the vehicle width boundary line image at the first position of the vehicle's windshield.

[0115] In order to reduce the frequency of the driver looking down at the dashboard or navigation screen and assist the driver to better control the speed and distance between the vehicle, in a possible implementation, the vehicle controller can obtain the vehicle speed and the distance between the vehicle and the vehicle in front when controlling the vehicle's HUD to project the vehicle width boundary line at the first position of the vehicle's windshield, and control the vehicle's HUD to project the vehicle width boundary line at the first position of the vehicle's windshield, and control the vehicle's HUD to project the vehicle speed and the distance between the vehicle and the vehicle in front at the position (second position) of the vehicle's windshield that does not affect the driver's front view, so that while projecting the vehicle width boundary line on the windshield to assist the driver in determining whether he can safely pass the road ahead, the vehicle speed and the distance between the vehicle and the vehicle in front can also be projected on the windshield, thereby reducing the frequency of the driver looking down at the dashboard or navigation screen, and helping the driver to maintain attention to the road ahead. In addition, projecting the vehicle speed and the distance between the vehicle and the vehicle in front on the windshield can also assist the driver to better control the vehicle speed and distance, determine a safe following distance, and thus reduce the occurrence of traffic accidents.

[0116] Optionally, the distance between the vehicle and the vehicle in front may be acquired by using a laser radar sensor, a millimeter wave radar sensor, an ultrasonic sensor, or an infrared sensor, but this is not limited in the embodiments of the present application.

[0117] The implementation method for obtaining the vehicle speed can be found in the above embodiment and will not be described in detail here.

[0118] It should be noted that in order to ensure that the vehicle speed and the distance between the vehicle and the vehicle in front projected by the vehicle's HUD do not affect the driver's field of vision directly ahead, in a possible implementation, the developer can set the second projection angle and the second projection distance of the vehicle's HUD in advance, so that the vehicle's HUD can project the vehicle speed and the distance between the vehicle and the vehicle in front at a second position on the vehicle's windshield.

[0119] Specifically, after the vehicle controller determines the vehicle width boundary line, the vehicle speed, and the distance between the vehicle and the vehicle in front, the vehicle width boundary line, the vehicle speed, and the distance between the vehicle and the vehicle in front are sent to the HUD controller, so that after receiving the vehicle width boundary line, the vehicle speed, and the distance between the vehicle and the vehicle in front, the HUD controller generates a vehicle width boundary line image corresponding to the vehicle width boundary line, and a vehicle driving information image corresponding to the vehicle speed and the distance between the vehicle and the vehicle in front, and controls the vehicle's HUD to project the vehicle width boundary line image at a first position on the vehicle's windshield, and to project the vehicle driving information image at a second position on the vehicle's windshield. Exemplarily, the vehicle's HUD projects the vehicle width boundary line (vehicle width boundary line image) at a first position on the vehicle's windshield, and projects the vehicle speed and the distance between the vehicle and the vehicle in front (vehicle driving information image) at a second position on the vehicle's windshield. For details, please refer to the schematic diagram of the vehicle's HUD projecting the vehicle width boundary line (vehicle width boundary line image) at a first position on the vehicle's windshield. Figure 4 shown.

[0120] It should be noted that, in the embodiment of the present application, a beam splitter technology can be used to divide the projection of the vehicle width boundary line image and the vehicle driving information image into two different projection paths to control the projection effect of each image. Among them, a beam splitter (also called a semi-transparent and semi-reflective mirror or a beam splitter) is an optical element that can divide the incident light into two parts: one part is reflected and the other part is transmitted. Among them, by reasonably designing the angle and position of the beam splitter, multiple images with different positions can be projected on the same vehicle windshield.

[0121] Figure 5 It is a structural schematic diagram of a vehicle prompt device provided in an embodiment of the present application.

[0122] For example, Figure 5 As shown, the device 500 includes:

[0123] Prediction module 501, used to predict the driving trajectory of the vehicle;

[0124] A determination module 502, configured to determine a vehicle width boundary line corresponding to the vehicle's driving trajectory according to the vehicle width and the vehicle's driving trajectory;

[0125] The control module 503 is used to control the HUD of the vehicle to project the vehicle width boundary line at a first position on the windshield of the vehicle. The first position is a preset position at which the projected vehicle width boundary line can overlap with the actual vehicle width when the vehicle is traveling along the driving trajectory, so as to prompt whether the vehicle can pass the road ahead.

[0126] In one possible implementation, the device 400 also includes an acquisition module for acquiring an environmental image in the direction of vehicle travel; a detection module for detecting whether the vehicle is in a target scene based on the environmental image, the target scene being a scene in which the width of the road ahead of the vehicle is less than a width threshold; and a prediction module 501, specifically for predicting the vehicle's travel trajectory when it is determined that the vehicle is in the target scene.

[0127] In one possible implementation, the determination module 502 is specifically used to determine the type of vehicle width boundary line corresponding to the driving trajectory of the vehicle according to the driving trajectory of the vehicle, the type of vehicle width boundary line including one of a straight-ahead vehicle width boundary line, a left-turn vehicle width boundary line and a right-turn vehicle width boundary line; and determine the vehicle width boundary line corresponding to the driving trajectory of the vehicle according to the type of vehicle width boundary line, the vehicle width and the driving trajectory of the vehicle.

[0128] In one possible implementation, the detection module is also used to detect whether there is an obstacle on the road ahead of the vehicle; the determination module 502 is specifically used to determine the first color information as the target display color of the vehicle width boundary line when it is determined that there is an obstacle on the road ahead of the vehicle, and the first color information is used to prompt that the vehicle cannot pass the road ahead; when it is determined that there is no obstacle on the road ahead of the vehicle, the second color information is determined as the target display color of the vehicle width boundary line, and the second color information is used to prompt that the vehicle can pass the road ahead; the control module 503 is specifically used to control the HUD of the vehicle to project the vehicle width boundary line at a first position on the windshield of the vehicle according to the target display color.

[0129] In one possible implementation, the acquisition module is specifically used to acquire the light intensity of the vehicle's current environment; the determination module 502 is specifically used to determine the first display brightness as the target display brightness of the vehicle width boundary line when the light intensity of the vehicle's current environment is less than or equal to the first intensity threshold; when the light intensity of the vehicle's current environment is greater than the first intensity threshold, determine the second display brightness as the target display brightness, and the second display brightness is lower than the first display brightness; the control module 503 is specifically used to control the vehicle's HUD to project the vehicle width boundary line at a first position on the vehicle's windshield according to the target display brightness.

[0130] In one possible implementation, the acquisition module is specifically used to acquire the vehicle speed and the distance between the vehicle and the vehicle in front; the control module 503 is specifically used to control the vehicle's HUD to project the vehicle width boundary line at a first position on the vehicle's windshield, and control the vehicle's HUD to project the vehicle speed and the distance between the vehicle and the vehicle in front at a second position on the vehicle's windshield, where the second position is a preset position that does not affect the driver's front field of view.

[0131] In one possible implementation, the acquisition module is specifically used to obtain the vehicle's steering wheel steering angle and the vehicle's speed; the prediction module 501 is specifically used to predict the vehicle's driving trajectory based on the vehicle's steering wheel steering angle, the vehicle's speed and a preset time.

[0132] Figure 6 It is a structural schematic diagram of a vehicle provided in an embodiment of the present application.

[0133] For example, Figure 6 As shown, the vehicle 600 includes: a memory 601 and a processor 602, wherein the memory 601 stores an executable program code 603, and the processor 602 is used to call and execute the executable program code 603 to perform a vehicle prompt method.

[0134] In addition, an embodiment of the present application also protects a device, which may include a memory and a processor, wherein the memory stores an executable program code, and the processor is used to call and execute the executable program code to execute a vehicle prompt method provided by an embodiment of the present application.

[0135] In this embodiment, the functional modules of the device can be divided according to the above method example. For example, each functional module can be corresponded, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0136] In the case of dividing each functional module according to each function, the device may further include a first sending module, a second sending module, and a torque clearing module, etc. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, which will not be repeated here.

[0137] It should be understood that the device provided in this embodiment is used to execute the above-mentioned vehicle prompt method, and thus can achieve the same effect as the above-mentioned implementation method.

[0138] In the case of an integrated unit, the device may include a processing module and a storage module. When the device is applied to a vehicle, the processing module may be used to control and manage the actions of the vehicle. The storage module may be used to support the vehicle in executing related program codes, etc.

[0139] The processing module may be a processor or a controller, which may implement or execute various exemplary logic blocks, modules and circuits shown in conjunction with the disclosure of the present application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module may be a memory.

[0140] In addition, the device provided in the embodiments of the present application may specifically be a chip, component or module, and the chip may include a connected processor and memory; wherein the memory is used to store instructions, and when the processor calls and executes the instructions, the chip can execute a vehicle prompt method provided in the above embodiments.

[0141] This embodiment also provides a computer-readable storage medium, in which a computer program code is stored. When the computer program code is executed on a computer, the computer executes the above-mentioned related method steps to implement a vehicle prompt method provided in the above-mentioned embodiment.

[0142] This embodiment also provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement a vehicle prompt method provided by the above-mentioned embodiment.

[0143] Among them, the device, computer-readable storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0144] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0145] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection projected or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0146] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A vehicle prompting method, characterized in that: The method comprises: Predict the vehicle’s trajectory; Determining a vehicle width boundary line corresponding to the driving trajectory of the vehicle according to the vehicle width and the driving trajectory of the vehicle; The HUD of the vehicle is controlled to project the vehicle width boundary line at a first position on the windshield of the vehicle. The first position is a preset position at which the projected vehicle width boundary line can overlap with the actual vehicle width when the vehicle is traveling along the driving trajectory, so as to prompt whether the vehicle can pass the road ahead.

2. The method according to claim 1, characterized in that The method further comprises: Acquire an environment image in the driving direction of the vehicle; Detecting, according to the environment image, whether the vehicle is in a target scene, the target scene being a scene in which a passing width of a road ahead of the vehicle is less than a width threshold; When it is determined that the vehicle is in the target scene, a driving trajectory of the vehicle is predicted.

3. The method according to claim 1 or 2, characterized in that: The determining, according to the vehicle width and the driving track of the vehicle, a vehicle width boundary line corresponding to the driving track of the vehicle comprises: According to the driving trajectory of the vehicle, determining the type of vehicle width boundary line corresponding to the driving trajectory of the vehicle, the type of vehicle width boundary line comprising one of a straight vehicle width boundary line, a left-turn vehicle width boundary line, and a right-turn vehicle width boundary line; A vehicle width boundary line corresponding to the driving track of the vehicle is determined according to the type of the vehicle width boundary line, the vehicle width and the driving track of the vehicle.

4. The method according to claim 1 or 2, characterized in that: The controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of a windshield of the vehicle includes: Detecting whether there is an obstacle on the road ahead of the vehicle; In the case where it is determined that there is an obstacle on the road ahead of the vehicle, first color information is determined as a target display color of the vehicle width boundary line, and the HUD of the vehicle is controlled to project the vehicle width boundary line at a first position of the windshield of the vehicle according to the target display color, wherein the first color information is used to prompt that the vehicle cannot pass the road ahead; When it is determined that there are no obstacles on the road ahead of the vehicle, the second color information is determined as the target display color of the vehicle width boundary line, and the HUD of the vehicle is controlled to project the vehicle width boundary line at a first position on the windshield of the vehicle according to the target display color. The second color information is used to prompt the vehicle that it can pass the road ahead.

5. The method according to claim 1 or 2, characterized in that: The controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of a windshield of the vehicle includes: Obtaining the light intensity of the vehicle's current environment; When the illumination intensity of the environment in which the vehicle is currently located is less than or equal to a first intensity threshold, determining a first display brightness as a target display brightness of the vehicle width boundary line, and controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of the windshield of the vehicle according to the target display brightness; When the light intensity of the vehicle's current environment is greater than the first intensity threshold, the second display brightness is determined as the target display brightness, and the HUD of the vehicle is controlled to project the vehicle width boundary line at a first position on the windshield of the vehicle according to the target display brightness, and the second display brightness is lower than the first display brightness.

6. The method according to claim 1 or 2, characterized in that: The controlling the HUD of the vehicle to project the vehicle width boundary line at a first position of a windshield of the vehicle includes: Obtaining the speed of the vehicle and the distance between the vehicle and a preceding vehicle; The HUD of the vehicle is controlled to project the vehicle width boundary line at a first position on the windshield of the vehicle, and the HUD of the vehicle is controlled to project the vehicle speed and the distance between the vehicle and the vehicle in front at a second position on the windshield of the vehicle, wherein the second position is a preset position that does not affect the driver's front field of vision.

7. The method according to claim 1 or 2, characterized in that: The predicted vehicle driving trajectory includes: Obtaining a steering wheel angle of the vehicle and a speed of the vehicle; The driving trajectory of the vehicle is predicted based on the steering wheel angle of the vehicle, the speed of the vehicle and a preset duration.

8. A vehicle prompting device, characterized in that: The device comprises: A prediction module, used to predict the vehicle's driving trajectory; A determination module, configured to determine a vehicle width boundary line corresponding to the driving track of the vehicle according to the vehicle width and the driving track of the vehicle; A control module is used to control the HUD of the vehicle to project the vehicle width boundary line at a first position on the windshield of the vehicle, wherein the first position is a preset position at which the projected vehicle width boundary line can overlap with the actual vehicle width when the vehicle travels along the driving trajectory, so as to prompt whether the vehicle can pass the road ahead.

9. A vehicle, characterized in that: The vehicle comprises: A memory for storing executable program codes; A processor, configured to call and run the executable program code from the memory, so that the vehicle executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 7 is implemented.

Citation Information

Cited By

  • Dynamic adaptation method and device for vehicle-mounted visual field auxiliary display of commercial vehicle

    CN122211179A