An autonomous vehicle and its obstacle display method
By selecting either the Frenet coordinate system or the vehicle coordinate system to display obstacles in autonomous vehicles based on the curvature of the driving path, the problem of inaccurate obstacle display at small turning radii is solved, thus improving the user experience.
Patent Information
- Application Number
- CN202210239310.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-11
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2042-03-11
AI Technical Summary
When autonomous vehicles are driving with a small turning radius, the Frenet coordinate system is used to display the incorrect relative positions of obstacles and vehicles, resulting in a degraded user experience.
Different coordinate systems are selected for display based on the curvature of the vehicle's driving path. The Frenet coordinate system is used for vehicles with large turning radii or on straight roads, while the vehicle body coordinate system is used for vehicles with small turning radii or in parking scenarios, to ensure the accuracy of the display of obstacle and vehicle positions.
Under different road curvature conditions, it provides a more realistic display of the relative positions of obstacles and vehicles, improving the user experience.
Smart Images

Figure CN116766923B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to an autonomous vehicle and its obstacle display method, belonging to the field of vehicle obstacle information display technology. Background Technology
[0002] During operation, autonomous vehicles can display obstacles on the road using dashboards, virtual twin screens, and other methods. Displaying the relative position of obstacles to the vehicle facilitates observation by the driver or safety operator and provides passengers with a near-realistic virtual obstacle display, enhancing the user experience.
[0003] Currently, a preferred solution for autonomous vehicles is to display the relative positions of obstacles and the vehicle in the Frenet coordinate system. The Frenet coordinate system is constructed based on the road centerline (driving path), where S represents the length of the path arc, and L is the projected distance from a point (e.g., the center point of an obstacle) to the road centerline (arc). When the vehicle is traveling on a straight road or a road with a large turning radius (small curvature), such as... Figure 2 As shown in Figure 3, the obstacle is located on the left side of the vehicle, and the projected position of the obstacle relative to the vehicle body is correctly represented in the Frenet coordinate system; however, due to the varying degrees of road curvature, when the road turning radius is small (large curvature), such as... Figure 4 As shown, the obstacle is on the left side of the vehicle, but in the Frenet coordinate system, the obstacle appears on the right side of the vehicle. The subjective perception of the relative position of the obstacle and the vehicle is incorrect. In this case, the Frenet coordinate system cannot provide passengers with the correct display of the relative position of the obstacle and the vehicle, providing incorrect information and reducing the user experience. Summary of the Invention
[0004] The purpose of this invention is to provide an autonomous vehicle and its obstacle display method to solve the problem that the relative positions of obstacles and the vehicle are incorrect when the vehicle is driving with a small turning radius using Frenet coordinates.
[0005] This invention proposes a method for displaying obstacles in autonomous vehicles, the method comprising the following steps:
[0006] 1) Obtain vehicle positioning information, obstacle locations, and high-precision maps, where vehicle positioning information includes vehicle position and vehicle heading angle;
[0007] 2) When the vehicle is in autonomous driving mode, the vehicle driving path is determined based on the acquired vehicle positioning information, obstacle positions and high-precision map, and the corresponding curvature of the vehicle driving path within a set length range is calculated; the relationship between the curvature and the set curvature threshold is determined.
[0008] 3) When the curvature is less than or equal to the set curvature threshold, a Frenet coordinate system is established based on the vehicle's driving path, and the vehicle position and obstacle position are transformed into the Frenet coordinate system. The positional relationship between the vehicle and the obstacle is displayed in the Frenet coordinate system. When the curvature is greater than the set curvature threshold, a vehicle body coordinate system is established based on the vehicle's heading angle, and the vehicle position and obstacle position are transformed into the vehicle body coordinate system. The positional relationship between the vehicle and the obstacle is displayed in the vehicle body coordinate system.
[0009] The present invention also proposes an autonomous driving vehicle, which includes a display instrument that uses the aforementioned obstacle display method for autonomous driving vehicles to display the positions of the vehicle and obstacles.
[0010] This invention selects different coordinate systems to display the relative positions of the vehicle and obstacles based on the curvature of the vehicle's driving path during autonomous driving. When the curvature of the driving path is less than or equal to a set curvature threshold (i.e., when the vehicle is traveling on a large turning radius or a straight road), a Frenet coordinate system is established based on the vehicle's driving path. The relative positions of obstacles and the vehicle are displayed in the Frenet coordinate system, avoiding the display errors that occur when using the vehicle's body coordinate system for vehicles traveling on roads with large turning radii. When the curvature of the driving path is greater than the set curvature threshold (i.e., when the vehicle is traveling on roads with small turning radii), a vehicle body coordinate system is established based on the vehicle's heading angle. The positions of the vehicle and obstacles are displayed in the vehicle body coordinate system, avoiding the inaccurate relative positional relationship between the vehicle and obstacles in the Frenet coordinate system. This invention selects the appropriate coordinate system according to different situations during vehicle operation, better showing passengers the relative positional relationship between obstacles and the vehicle that is closer to the actual situation, further improving the user experience.
[0011] Furthermore, the longitudinal distance is calculated based on the positional relationship between the obstacle and the vehicle, and a set number of obstacles with smaller longitudinal distances are selected, so that the number of obstacles displayed is less than or equal to the set number.
[0012] Furthermore, if the longitudinal distance between the selected obstacle and the vehicle exceeds the set distance, the obstacle will not be displayed.
[0013] This invention takes into account the limitations of the display area of the vehicle's instrument panel in terms of the number of obstacles that can be displayed, and also considers the impact of nearby obstacles on vehicle driving safety. When displaying obstacles, only a set number of obstacles that are closest to the vehicle in the longitudinal direction are displayed, and obstacles that are beyond the set distance are no longer displayed.
[0014] Furthermore, the set distance is related to the vehicle's own speed and the detection distance of the on-board ranging sensor. When the vehicle speed is high and the detection distance of the on-board ranging sensor is long, the set distance is long; when the vehicle speed is low and the detection distance of the on-board ranging sensor is short, the set distance is short.
[0015] This invention takes into account the influence of vehicle speed and the detection distance of the on-board ranging sensor, and can adjust the set distance according to the actual vehicle speed and the detection distance of the on-board ranging sensor to meet the display requirements of obstacles under different conditions.
[0016] Furthermore, the corresponding lateral distance is calculated based on the positional relationship between the obstacle and the vehicle, and the lane in which the obstacle is located is determined by the corresponding lateral distance.
[0017] In order to clearly show the lane where an obstacle is located, this invention determines the lane where the obstacle is located by the lateral distance between the obstacle and the vehicle, providing passengers with a virtual obstacle display that is closer to the actual situation.
[0018] Furthermore, when the vehicle is in manual driving mode, the vehicle's coordinate system is used to display the positional relationship between the vehicle and obstacles.
[0019] Furthermore, when the vehicle is in a parking scenario, the vehicle's coordinate system is used to display the positional relationship between the vehicle and obstacles.
[0020] When the vehicle is in manual driving mode, high-precision map information is not loaded, therefore the vehicle's driving path for establishing the Frenet coordinate system is lacking, and the vehicle's coordinate system is used for display. Additionally, in parking scenarios, vehicles may have small turning radii; using the vehicle's coordinate system ensures the correct display of the positional relationship between obstacles and the vehicle.
[0021] Furthermore, the set curvature threshold is 0.003. Attached Figure Description
[0022] Figure 1 This is a flowchart of the obstacle display process for autonomous vehicles according to the present invention;
[0023] Figure 2 It is a diagram showing the positions of vehicles and obstacles in the Frenet coordinate system when vehicles are traveling on a straight road;
[0024] Figure 3 It is a diagram showing the positions of vehicles and obstacles in the Frenet coordinate system when vehicles are traveling on roads with large turning radii.
[0025] Figure 4 It is a diagram showing the positions of vehicles and obstacles in the Frenet coordinate system when vehicles are traveling on roads with small turning radii.
[0026] Figure 5 This is a schematic diagram of the Cartesian coordinate system to Frenet coordinate system conversion of the present invention;
[0027] Figure 6 This is a schematic diagram of the transformation of the Cartesian coordinate system into the vehicle body coordinate system of the present invention. Detailed Implementation
[0028] The specific embodiments of the present invention will be further described below with reference to the accompanying drawings.
[0029] Method Implementation Examples
[0030] This invention proposes a method for displaying obstacles in autonomous vehicles, the specific process of which is as follows: Figure 1 As shown. This invention takes into account the different curvatures of roads during vehicle travel. In autonomous driving mode, when the vehicle is traveling on a road with a large turning radius or a straight road, the positional relationship between the vehicle and obstacles is displayed in the Frenet coordinate system; when the vehicle is traveling on a road with a small turning radius, the positional relationship between the vehicle and obstacles is displayed in the vehicle body coordinate system; in manual driving and parking scenarios, the positional relationship between the vehicle and obstacles is displayed in the vehicle body coordinate system.
[0031] This invention first requires acquiring vehicle positioning information, obstacle locations, and a high-precision map. Vehicle positioning information includes, but is not limited to, vehicle position and vehicle heading angle; the vehicle position and obstacle locations provided by the positioning information are generally based on a geodetic coordinate system; the obstacle locations are determined using the relative positional relationship between the obstacle and the vehicle in a Cartesian coordinate system, through the vehicle's (the vehicle's) coordinates in the geodetic coordinate system. The high-precision map includes, but is not limited to, lane centerlines, lane boundaries, intersections, and drivable paths, and this map is created using a geodetic coordinate system. The origin of the Cartesian coordinate system can be set according to the actual vehicle operating area; for example, if the vehicle frequently travels in a certain area, the center of that area can be used as the origin of the Cartesian coordinate system.
[0032] When selecting the coordinate system for displaying the relationship between obstacles and vehicle positions, this invention first needs to determine the vehicle's driving state, specifically whether it is autonomous or manual driving. When the vehicle is in autonomous driving mode, the vehicle's driving path, i.e., the centerline of the lane the vehicle is traveling on, is determined based on the acquired vehicle positioning information, obstacle information, and a high-precision map. The curvature of the vehicle's driving path within a set length range is calculated, and the calculated curvature is compared with a set curvature threshold. In this embodiment, the set length is defined as L. set Calculate the vehicle's travel path L set The corresponding curvature within the range; compare the calculated curvature with the set curvature threshold C. thd(0.003) is compared, and a suitable coordinate system is selected based on the comparison result to display the positional relationship between the vehicle and the obstacle. The set length can be adjusted appropriately according to the vehicle speed; when the vehicle speed is high, the set length is larger.
[0033] When the calculated curvature is less than or equal to the set curvature threshold, i.e., when the vehicle is traveling at a large turning radius (small curvature) or on a straight road (such as...), Figure 3 Left image and Figure 2 As shown in the left figure, a Frenet coordinate system (SL coordinate system) is established based on the vehicle's driving path, as follows: Figure 5 As shown, the vehicle's travel path is plotted on the vertical axis, and the axis perpendicular to the path is plotted on the horizontal axis. S represents the arc length of the vehicle's travel path, and L represents the projected distance from the center point of the obstacle to the vehicle's travel path (arc). To display the vehicle's position on the instrument panel, the origin of this coordinate system is preferably set at a certain distance behind the vehicle. In this embodiment, the vehicle and obstacle positions are transformed from the Cartesian coordinate system to the Frenet coordinate system, and the positional relationship between the vehicle and obstacles is displayed in the Frenet coordinate system. When the vehicle is traveling on a straight road, the positional relationship between the vehicle and obstacles displayed in the Frenet coordinate system is as follows: Figure 2 As shown in the right figure; when a vehicle is traveling on a road with a large turning radius, the positional relationship between the vehicle and obstacles is displayed in the Frenet coordinate system as follows: Figure 3 As shown in the right figure, compare Figure 3 The left image shows that the Frenet coordinate system correctly reflects the relative positional relationship between the vehicle and the obstacle, avoiding the error that occurs when using the vehicle body coordinate system under small curvature.
[0034] When the calculated curvature is greater than the set curvature threshold, that is, when the vehicle is traveling on a road with a small turning radius (large curvature) (such as...), Figure 4 (As shown in the left figure), from Figure 4 The left image shows that the obstacle is to the left of the vehicle. If the Frenet coordinate system is still used to display the relative positions of the vehicle and the obstacle, the obstacle will appear to be to the right of the vehicle (e.g., ...). Figure 4 As shown in the right figure, the displayed positional relationship between the vehicle and obstacles is clearly incorrect. Therefore, this invention establishes a vehicle coordinate system based on the vehicle's heading angle (e.g., ...). Figure 6 As shown in the diagram, the Y-axis is the vehicle body, and the X-axis is perpendicular to the vehicle body direction. Preferably, the center of the coordinate origin is set to the center of the rear axle of the vehicle. In this embodiment, the yaw angle of the vehicle is determined based on the vehicle heading angle obtained in the Cartesian coordinate system. The positions of the vehicle and the obstacle are then transformed from the Cartesian coordinate system to the vehicle body coordinate system. The relative positional relationship between the obstacle and the vehicle is displayed in the vehicle body coordinate system, which can accurately reflect the relative positions of the vehicle and the obstacle.
[0035] At the same time, when the vehicle is in a parking scenario (such as parking in and out), the vehicle's coordinate system is also used to display the positional relationship between the vehicle and obstacles, because in parking scenarios, the vehicle may have a small turning radius, for example in... Figure 4 In the left image, the vehicle is in a parking exit scenario, and the obstacle is visible to the left of the vehicle. Using the Frenet coordinate system would result in incorrect display of the vehicle's and obstacle's positions (e.g., ...). Figure 4 (See right figure), therefore the vehicle body coordinate system is used to ensure correct display.
[0036] When the vehicle is in manual driving mode, the vehicle body coordinate system is also used to display the positional relationship between the vehicle and obstacles. Since map information is not loaded in manual driving mode, the vehicle body coordinate system is used for display because there is no vehicle driving path for establishing the Frenet coordinate system.
[0037] Whether in the Frenet coordinate system or the vehicle coordinate system, the positional relationship between the vehicle and obstacles is displayed based on the lateral and longitudinal distances of the obstacles from the vehicle. Based on the vehicle's position and a high-precision map, the vehicle's lane (its own lane) can be determined. Using the own lane as the middle lane, the lateral distance between the obstacle and the vehicle is calculated based on the obstacle's and vehicle's positions. By comparing the calculated lateral distance with the set lateral thresholds corresponding to different lanes, it is determined whether the obstacle is in the own lane, the lane to the left of the own lane, or the lane to the right of the own lane. In another implementation, when the vehicle is in the leftmost lane, the lane adjacent to its left is the opposite lane, and obstacles in the opposite lane do not need to be displayed; only obstacles in the vehicle's own lane and the lane adjacent to its right are displayed. When the vehicle is in the rightmost lane, the lane adjacent to its right is a pedestrian or non-motorized vehicle lane, and pedestrians and non-motorized vehicles do not need to be displayed; only obstacles in the vehicle's own lane and the lane adjacent to its left are displayed. Considering the size of the vehicle's instrument panel display area and the limitation on the number of obstacles that can be displayed, the longitudinal distance between the obstacle and the vehicle is calculated, and a set number of obstacles with smaller longitudinal distances are selected, ensuring that the number of displayed obstacles is less than or equal to the set number. Furthermore, considering the impact of nearby obstacles on vehicle safety, if the longitudinal distance between the selected obstacle and the vehicle exceeds a set distance, the obstacle is not displayed. In this embodiment, the longitudinal distances of obstacles from the vehicle in each lane are sorted, and the N closest in longitudinal distance in each lane is determined. obs There is an obstacle, and the longitudinal distance between the obstacle and the vehicle is less than D. Z Save at time, greater than or equal to D ZObstacle information is discarded at any time. The saved obstacle information is sent to the controller, which then transmits it to the display instrument via the CAN bus. This obstacle information includes, but is not limited to, the total number of obstacles, the lateral and longitudinal distances of the obstacles from the vehicle, and the lane in which the obstacles are located. Alternatively, the number of obstacles can be determined based on the size of the display instrument screen; the set distance can be adjusted based on the actual vehicle speed and the detection range of the onboard ranging sensor. A longer set distance is used when the vehicle speed is high and the detection range of the onboard ranging sensor is long; a shorter set distance is used when the vehicle speed is low and the detection range of the onboard ranging sensor is short.
[0038] Vehicle Example
[0039] The present invention proposes an autonomous vehicle including a display instrument, which can display the relative position of the vehicle and obstacles using the aforementioned obstacle display method for autonomous vehicles. The display instrument can be a dashboard, a dual screen, etc. The obstacle display method for autonomous vehicles has been described in detail in the above method embodiments and will not be repeated here.
Claims
1. A method for displaying obstacles in an autonomous vehicle, characterized in that, The method includes the following steps: 1) Obtain vehicle positioning information, obstacle locations, and high-precision maps, where vehicle positioning information includes vehicle position and vehicle heading angle; 2) When the vehicle is in autonomous driving mode, the vehicle driving path is determined based on the acquired vehicle positioning information, obstacle positions and high-precision map, and the corresponding curvature of the vehicle driving path within a set length range is calculated; the relationship between the curvature and the set curvature threshold is determined. 3) When the curvature is less than or equal to the set curvature threshold, a Frenet coordinate system is established based on the vehicle's driving path, and the vehicle position and obstacle position are converted to the Frenet coordinate system. The positional relationship between the vehicle and the obstacle is displayed in the Frenet coordinate system. When the curvature is greater than the set curvature threshold, a vehicle body coordinate system is established based on the vehicle's heading angle, and the vehicle position and obstacle position are converted to the vehicle body coordinate system. The positional relationship between the vehicle and the obstacle is displayed in the vehicle body coordinate system.
2. The obstacle display method for autonomous vehicles according to claim 1, characterized in that, Calculate the corresponding longitudinal distance based on the positional relationship between the obstacle and the vehicle, select a set number of obstacles with smaller longitudinal distances, and display the number of obstacles less than or equal to the set number.
3. The obstacle display method for autonomous vehicles according to claim 2, characterized in that, If the longitudinal distance between the selected obstacle and the vehicle exceeds the set distance, the obstacle will not be displayed.
4. The obstacle display method for autonomous vehicles according to claim 3, characterized in that, The set distance is related to the vehicle's own speed and the detection distance of the on-board ranging sensor. When the vehicle speed is high and the detection distance of the on-board ranging sensor is long, the set distance is long; when the vehicle speed is low or the detection distance of the on-board ranging sensor is short, the set distance is short.
5. The obstacle display method for autonomous vehicles according to claim 1, characterized in that, The lateral distance is calculated based on the positional relationship between the obstacle and the vehicle, and the lane in which the obstacle is located is determined by the corresponding lateral distance.
6. The obstacle display method for autonomous vehicles according to claim 1, characterized in that, When the vehicle is in manual driving mode, the vehicle coordinate system is used to display the positional relationship between the vehicle and obstacles.
7. The obstacle display method for autonomous vehicles according to claim 1, characterized in that, When the vehicle is in a parking scenario, the vehicle coordinate system is used to display the positional relationship between the vehicle and obstacles.
8. The obstacle display method for autonomous vehicles according to claim 1, characterized in that, The set curvature threshold is 0.
003.
9. An autonomous driving vehicle, characterized in that, The vehicle includes a display instrument, which uses the obstacle display method for autonomous vehicles according to any one of claims 1-8 to display the position of the vehicle and obstacles.
Citation Information
Patent Citations
Automobile surrounding environment monitoring method, device and system and storage medium
CN110988885A
Obstacle detecting control device of vehicle
US20070239358A1
