Display method and device

Abstract

The embodiment of the invention provides a display method and device. The display method comprises the steps that a planned path of a vehicle and a display area of a head-up display device are obtained, the vehicle comprises the HUD, and the display area of the HUD is used for displaying a virtual image; according to the planned path and the display area, determining the spatial position of a part of the planned path, located in the display area, of the planned path; and according to the spatial position, displaying a navigation element fitted with the part of planned path in a display area. The embodiment of the invention can be suitable for an intelligent automobile or a new energy automobile, and the driving intention of the automobile can be accurately transmitted to the user by fitting the navigation element to the planned path in the display area, so that the complaint of the user for the intelligent driving function is reduced, and the trust degree of the user for the intelligent driving function is improved.

Description

Technical Field

[0001] This application relates to the field of intelligent vehicles, and more specifically, to a display method and apparatus. Background Technology

[0002] To enhance driving safety, head-up displays (HUDs) can be used to present essential driving information in a position visible to the driver. Augmented reality head-up displays (AR-HUDs) can combine navigation instructions and other information with the actual environment within the driver's field of vision, allowing for more convenient, intuitive, and efficient access to driving information, thus improving both safety and comfort.

[0003] However, during vehicle operation, due to the complexity of actual road conditions, the navigation instructions presented by AR-HUD may not be accurate enough; in particular, in intelligent driving scenarios, when users cannot accurately understand the vehicle's driving intentions based on the navigation instructions presented by AR-HUD, they will experience a great sense of insecurity. Summary of the Invention

[0004] This application provides a display method and apparatus that, by attaching navigation elements to the planned route in the display area, can accurately convey the vehicle's driving intention to the user, thereby reducing user complaints about intelligent driving functions and increasing user trust in intelligent driving functions.

[0005] In a first aspect, a display method is provided. The method includes: acquiring a planned path of a vehicle and a display area of ​​a head-up display (HUD), the vehicle including the HUD, the display area of ​​the HUD being used to display a virtual image; determining, based on the planned path and the display area, the spatial position of a portion of the planned path within the display area; and, based on the spatial position, displaying navigation elements in the display area that correspond to that portion of the planned path.

[0006] In actual driving, the condition of the road (such as the number of lanes, changes in road gradient), the intersection of the road with other roads, and the traffic rules of the road (such as turning and U-turn locations) are often complex.

[0007] Especially in intelligent driving scenarios, if navigation elements fail to accurately present navigation information to users, they may misunderstand the vehicle's driving intentions. If users cannot accurately understand the vehicle's intentions, they are prone to anxiety in complex road conditions and may frequently take over the vehicle without being required to do so. This not only leads to user complaints about intelligent driving functions and increases user distrust, but may even endanger vehicle safety. Moreover, for vehicle manufacturers, even improvements and upgrades to intelligent driving functions cannot reduce or eliminate these complaints and distrust.

[0008] In this application, based on the portion of the planned path that falls within the display area, navigation elements are aligned with this portion of the planned path within the display area. This accurately conveys the vehicle's driving intentions to the user, effectively reducing the user's distrust of intelligent driving functions and decreasing the frequency of unnecessary user intervention in the vehicle.

[0009] In some possible implementations, the planned path within the display area may include a first segment of the path on a road surface with a first gradient and a second segment of the path on a road surface with a second gradient; wherein the first segment of the path and the second segment of the path are connected. Displaying navigation elements that are aligned with this portion of the planned path in the display area may include: aligning a first part of the navigation element with the first segment of the path and aligning a second part of the navigation element with the second segment of the path in the display area.

[0010] In real-world scenarios, the road where the vehicle is located may have undulations. If the vehicle is traveling too fast on an undulating road, it will lift off the ground, with some or all of its wheels in the air for a period of time before making contact with the ground again. On the one hand, the wheels lifting off the ground will increase the vehicle's instability; on the other hand, the vehicle will be subjected to an impact when it lands, which may even damage components such as the chassis in severe cases.

[0011] In this application, when the planned path within the display area includes multiple road segments with varying slopes, the navigation elements can be divided into multiple parts, corresponding to these multiple road segments, so that the navigation elements can reflect the road surface's undulations. In particular, in intelligent driving scenarios, by presenting the road's undulations to the user, it helps maintain the vehicle speed within an appropriate range when the user needs to take over the vehicle, helps maintain vehicle stability, and helps prevent the vehicle from being lifted off the ground due to excessive speed and damaged upon landing.

[0012] In some possible implementations, the width of the navigation element may correspond to a first spatial dimension. Displaying the navigation element that aligns with a portion of the planned path in the display area, based on this spatial position and the first spatial dimension, can include: displaying the navigation element that aligns with a portion of the planned path in the display area to create a perspective effect.

[0013] Since the real scene observed by the user's naked eye conforms to the perspective effect of objects appearing larger when closer and smaller when farther away, and when using a head-up display device, the user will observe a virtual image superimposed on the real scene. In this application, based on the spatial position of the planned path within the display area and the first spatial dimension, the navigation element is aligned with the planned path, so that the navigation element can also present the perspective effect of objects appearing larger when closer and smaller when farther away; when the virtual image is superimposed on the real scene, navigation information can be more intuitively indicated to the user.

[0014] In some possible implementations, the planned path may include multiple location points within the display area. Navigation elements may include multiple navigation patterns corresponding to the multiple location points, and the multiple navigation patterns may be of the same type.

[0015] In this application, multiple navigation patterns are attached at multiple locations, which reduces the processing resources required for attaching patterns and improves the attaching speed.

[0016] In some possible implementations, the multiple navigation patterns can all be arrow patterns. The method may also include: determining the direction in which the arrow pattern is aligned with a corresponding position point among the multiple position points, based on the relative positional relationships between adjacent position points.

[0017] In this application, the direction of the arrow pattern when it is attached to each location point is determined based on the relative positional relationship between adjacent location points, so that the direction of the multiple arrow patterns can match the extension direction of the planned path, which is beneficial to more intuitively instructing navigation information to users.

[0018] In some possible implementations, navigation elements can use continuous or discontinuous guide line patterns.

[0019] In some possible implementations, the vehicle can drive using intelligent driving functions, and the planned path can be a driving path planned for the vehicle by the intelligent driving functions.

[0020] In some possible implementations, the vehicle may also include a first display screen and a camera. The method may further include: controlling the first display screen to display environmental images captured by the camera; and controlling the display interface of the first display screen to overlay navigation elements based on the spatial location of the planned path.

[0021] In this application, other users in the vehicle can understand the vehicle's driving intention by viewing the navigation elements superimposed on the display interface of the first screen, which can reduce the anxiety caused by not being able to understand the vehicle's driving intention.

[0022] In some possible implementations, the first display screen may include at least one of a central control screen, a passenger-side screen, and a second-row display screen.

[0023] In some possible implementations, the vehicle can carry users wearing smart glasses. The method may also include controlling the smart glasses' display interface to show navigation elements based on the spatial location of the planned route.

[0024] In this application, by displaying navigation elements on the display interface of the smart glasses, the user wearing the smart glasses can know the driving intention of the vehicle, which can reduce the anxiety caused by not being able to know the driving intention of the vehicle.

[0025] Secondly, a display device is provided. The display device includes a processing unit and a display unit. The processing unit is used to: acquire the planned path of a vehicle and the display area of ​​a head-up display (HUD), the vehicle including the HUD, the display area of ​​which is used to display a virtual image; and determine the spatial position of a portion of the planned path within the display area based on the planned path and the display area. The display unit is used to: display navigation elements corresponding to that portion of the planned path in the display area based on the spatial position.

[0026] In some possible implementations, the planned path within the display area may include a first segment of the path on a first slope and a second segment of the path on a second slope, with the first and second segments connected. The display unit can be used to: align the first part of the navigation element with the first segment of the path and align the second part of the navigation element with the second segment of the path within the display area.

[0027] In some possible implementations, the width of the navigation element can correspond to a first spatial dimension. The display unit can be used to: display navigation elements that fit part of the planned path in the display area according to the spatial position and the first spatial dimension, so that the navigation elements present a perspective effect.

[0028] In some possible implementations, the planned path may include multiple location points within the display area; the navigation elements may include multiple navigation patterns corresponding to the multiple location points, and the multiple navigation patterns may be of the same type.

[0029] In some possible implementations, all navigation patterns can be arrow patterns. The processing unit can also be used to: determine the direction in which the arrow pattern is attached to a corresponding position point among the multiple position points, based on the relative positional relationship between adjacent position points.

[0030] In some possible implementations, the vehicle may also include a first display screen and a camera. The processing unit may also be used to: control the first display screen to display environmental images captured by the camera; and control the display interface of the first display screen to overlay navigation elements according to the spatial location.

[0031] In some possible implementations, the vehicle can carry users wearing smart glasses, and the processing unit can also be used to control the display interface of the smart glasses to display navigation elements based on the spatial location.

[0032] Thirdly, an electronic device is provided, comprising: one or more processors; one or more memories; the one or more memories storing one or more programs that, when executed by the one or more processors, cause a display method as described in the first aspect and any possible implementation thereof to be executed.

[0033] Fourthly, a chip is provided, the chip including a processor and a communication interface, the communication interface being used to receive signals and transmit signals to the processor, the processor processing the signals such that a display method as in the first aspect and any possible implementation thereof is executed.

[0034] Fifthly, a readable storage medium is provided, which stores instructions that, when executed on a device, cause a display method as described in the first aspect and any possible implementation thereof to be performed.

[0035] In a sixth aspect, a program product is provided, the program product including program code, which, when run on a device, causes a display method as described in the first aspect and any possible implementation thereof to be executed. Attached Figure Description

[0036] Figure 1 This is a functional block diagram of a vehicle provided in an embodiment of this application;

[0037] Figure 2 This is a schematic diagram of a HUD display method provided in an embodiment of this application;

[0038] Figure 3 This is a schematic diagram of a driving scenario provided in an embodiment of this application;

[0039] Figure 4 This is a schematic diagram illustrating the display effect of the HUD provided in an embodiment of this application;

[0040] Figure 5 This is yet another schematic diagram illustrating the display effect of the HUD provided in the embodiments of this application;

[0041] Figure 6 This is a schematic diagram of yet another driving scenario provided in the embodiments of this application;

[0042] Figure 7 This is a schematic diagram of a set of display interfaces provided in an embodiment of this application;

[0043] Figure 8 This is a schematic diagram of another set of display interfaces provided in the embodiments of this application;

[0044] Figure 9 This is yet another schematic diagram illustrating the display effect of the HUD provided in the embodiments of this application;

[0045] Figure 10 This is another schematic diagram illustrating the display effect of the HUD provided in the embodiments of this application;

[0046] Figure 11 This is yet another schematic diagram illustrating the display effect of the HUD provided in the embodiments of this application;

[0047] Figure 12 This is yet another schematic diagram illustrating the display effect of the HUD provided in the embodiments of this application;

[0048] Figure 13 This is a schematic diagram illustrating another display effect provided in an embodiment of this application;

[0049] Figure 14 This is a schematic flowchart illustrating a display method provided in an embodiment of this application;

[0050] Figure 15 This is a schematic diagram of a system architecture provided in an embodiment of this application;

[0051] Figure 16 This is a schematic diagram of the structure of a device provided in an embodiment of this application;

[0052] Figure 17 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0053] The technical solutions in this application will now be described with reference to the accompanying drawings.

[0054] For example, Figure 1 This is a functional block diagram of a vehicle 10 provided in an embodiment of this application.

[0055] Vehicle 10 may include a perception system 120 and a computing platform 150. The perception system 120 may include one or more sensors for sensing information about the environment surrounding vehicle 10. For example, the perception system 120 may include a positioning system, which may be a Global Positioning System (GPS), a BeiDou system, or another positioning system. The perception system 120 may also include one or more of the following: an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.

[0056] Some or all of the functions of vehicle 10 can be controlled by computing platform 150. Computing platform 150 may include one or more processors, such as processors 151 to 15n (n being a positive integer). A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), microprocessor, graphics processing unit (GPU) (which can be understood as a type of microprocessor), or digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits. These logical relationships are fixed or reconfigurable. For example, the processor may be a hardware circuit implemented using an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In reconfigurable hardware circuits, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be hardware circuitry designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. Furthermore, the computing platform 150 may also include a memory for storing instructions, and some or all of the processors 151 to 15n can call the instructions in the memory to implement the corresponding functions.

[0057] AR-HUD is a technology that combines augmented reality with a head-up display. Augmented reality refers to the use of technologies such as optoelectronic displays, interaction, and sensing to overlay and blend computer-generated virtual information with the actual physical environment, enhancing the user's perception of the real environment and achieving an enhanced effect on the real world. A head-up display refers to displaying information needed for driving in an area that the driver can see when they look up, allowing the driver to obtain information such as vehicle speed and navigation without having to look down at the instrument panel, central control screen, or other devices.

[0058] For example, Figure 2 This is a schematic diagram of a HUD display method provided in an embodiment of this application.

[0059] like Figure 2 As shown, in augmented reality scenarios, the area used to present the virtual image of the AR-HUD can be referred to as the display area. In practical applications, the virtual image can be projected by the projection component in the HUD, and the virtual image seen by the human eye may be an image formed through multiple reflections or refractions.

[0060] In one application example, a HUD can project virtual information onto the windshield, such as... Figure 2 As shown. The image observed by the human eye may be a virtual image formed by reflection and / or refraction through the windshield. The user can see this virtual image through the windshield, and can also see the real environment in front of the vehicle; that is, the user can see a virtual image superimposed on the real scene.

[0061] In augmented reality scenarios, while warning information and other driving-related information can be aligned with corresponding elements in the display area, navigation instructions often suffer from inaccuracies. This is because real-world road conditions can be extremely complex (especially in urban areas), making it difficult for the virtual image displayed to accurately represent the navigation direction. When the virtual image fails to accurately represent navigation direction, on the one hand, in manual driving scenarios, users may be misled by the virtual image, leading them to drive the vehicle onto the wrong road / lane; on the other hand, in autonomous driving scenarios, users will find it difficult to accurately understand the autonomous driving intent and predict the vehicle's driving intentions, resulting in significant feelings of insecurity. The following section combines... Figures 3 to 5 Please provide an explanation.

[0062] For example, Figure 3 This is a schematic diagram of a driving scenario provided in an embodiment of this application.

[0063] like Figure 3 As shown, road 22 may include multiple lanes, such as lanes 23 to 25; road 26 may include multiple lanes, such as lanes 27 and 28.

[0064] Assume the destination is located in lane 28 of road 26. To reach the destination, vehicle 10 at position A needs to turn left at intersection 21 onto road 22; then, after traveling a distance along road 22, it needs to turn right onto road 26. While traveling along path 29 through intersection 21, vehicle 10 can pass through position B.

[0065] Vehicle 10 may be equipped with a HUD; this HUD can project a virtual image, which can be displayed in display area 100; correspondingly, from the driver's perspective, the virtual image superimposed on the real environment can be observed. When vehicle 10 is in different positions, the HUD display interface can display different virtual images. The following is combined with... Figure 4 and Figure 5 The display effect of HUD is illustrated by an example.

[0066] For example, Figure 4 This is a schematic diagram of the display effect of the HUD provided in the embodiment of this application.

[0067] Figure 4 (a) in the text can be understood as the driver's perspective when the vehicle is in position A; Figure 4 (b) can be understood as the display interface corresponding to the virtual image projected by the HUD when the vehicle is in position A.

[0068] Reference Figure 4 In (a), when vehicle 10 is in position A, part of intersection 21 may be within the driver's field of vision, while another part of intersection 21 may be outside the driver's field of vision. Road 22 may be outside the display area 100; even more specifically, road 22 may be outside the driver's field of vision.

[0069] Reference Figure 4 In (b) of the display interface, the driver can observe a virtual image superimposed on the real environment. For example, one or more of the following information, such as vehicle speed, road speed limit, and distance between the vehicle and the intersection, can be presented in the display area 100 as virtual elements (such as virtual element 111). For another example, virtual element 111 can be updated in real time based on the corresponding information. For yet another example, the display area 100 may also include a navigation pattern 112, which may include at least one arrow; the arrow in the navigation pattern 112 may be parallel to the upper boundary of the display area 100 and point to the left to indicate that the vehicle will turn left.

[0070] For example, Figure 5 This is another schematic diagram of the display effect of the HUD provided in the embodiments of this application.

[0071] Figure 5(a) in the text can be understood as the driver's perspective when the vehicle is in position B; Figure 5 (b) in the text can be understood as the display interface corresponding to the virtual image projected by the HUD when the vehicle is in position B.

[0072] Reference Figure 5 In (a), when vehicle 10 is at position B in intersection 21, part of road 22 can be within display area 100, and another part can be outside display area 100.

[0073] When the vehicle is in position B, it is similar to Figure 4 In (b), the display area 100 may include virtual elements 111 and navigation patterns 112, such as Figure 5 As shown in (b) above. (Refer to...) Figure 5 In (b), the arrow in navigation pattern 112 can still be parallel to the upper boundary of display area 100 and point to the left to indicate that the vehicle is turning left.

[0074] Reference Figure 3 In the scenario shown, since vehicle 10 needs to turn right onto road 26 after traveling a certain distance on road 22, if the vehicle turns left onto lane 23 at intersection 21, it will need to change lanes from lane 23 to lane 25 within a short distance, posing a risk of continuous lane changes. To avoid continuous lane changes, navigation information often tends to instruct the vehicle to turn left onto lane 24 or 25 when passing intersection 21.

[0075] However, in real-world scenarios, the lanes or roads that need to be entered (e.g., lanes 24 and 25) may be partially or entirely outside the display area 100 (e.g., Figure 4 and Figure 5 (as shown); On the other hand, users may find it difficult to accurately determine whether they need to enter lane 24 or 25 based on navigation pattern 112. In particular, in intelligent driving scenarios, even if the intelligent driving function plans for the vehicle to turn left from position A into lane 24 or 25, because users may not be able to obtain the accurate driving intention through navigation pattern 112, they may mistakenly believe that the vehicle will enter lane 23 and take over the vehicle, thus complaining about the intelligent driving function.

[0076] and, Figures 3 to 5 The scenario shown does not involve any dynamic or static obstacles. However, in actual driving, there will inevitably be pedestrians, cyclists, other vehicles, and other road users around the vehicle, as well as static obstacles such as guardrails; the presence of obstacles will make road conditions more complex. In intelligent driving scenarios, if users cannot accurately understand the vehicle's driving intentions through navigation icons, they may frequently take over the vehicle, potentially leading to significant complaints and distrust of the intelligent driving function.

[0077] In view of this, embodiments of this application provide a display method and apparatus that, by attaching navigation elements to the planned route in the display area, can accurately convey the vehicle's driving intention to the user, which helps to reduce user complaints about intelligent driving functions and increase user trust in intelligent driving functions.

[0078] The following section will describe the display method and apparatus of this application embodiments, using several scenarios and display effects as examples.

[0079] For example, Figure 6 This is a schematic diagram of another driving scenario provided in the embodiments of this application.

[0080] Reference Figure 6 In (a), road 31 may include multiple lanes, such as lanes 32 to 34. Assume vehicle 10 at position C plans to change lanes from lane 33 to lane 32; obstacles exist around vehicle 10, such as another vehicle to its left rear that is also in lane 32. Accordingly, Figure 6 (b) can be understood as the driver's perspective when vehicle 10 is in position C.

[0081] Reference Figure 6 In (a) and (b), curves 35 and 36 are different curves; curves 35 and 36 can extend from the end closer to the vehicle to the end farther away from the vehicle. Among them, the entire curve 35 is within the display area 100, and a portion of curve 36 is within the display area 100; curve 36 can be the planned / predicted path for the lane change of vehicle 10.

[0082] The end of curve 35 closer to the vehicle can be drawn based on the centerline of the current lane; for example, this endpoint could be the intersection of the centerline of lane 33 and the lower boundary of display area 100. The end of curve 35 farther from the vehicle can be drawn based on the centerline of the lane after the lane change; for example, this endpoint could be the intersection of the centerline of lane 32 and the upper boundary of display area 100. Curve 35 can include three parts, namely lines 351 to 353. For example, line 351 can be a straight line, parallel to the centerline of the current lane (i.e., lane 33); line 352 can also be a straight line, parallel to the centerline of the lane after the lane change (i.e., lane 32); line 353 can be a curved line, connecting lines 351 and 352.

[0083] For curve 36, the end of curve 36 closer to the vehicle can be drawn based on the vehicle's position in the current lane. For example, before changing lanes, if vehicle 10 is traveling along the center line of lane 33, the endpoint of curve 36 closer to the vehicle can be the intersection of the center line of lane 33 and the lower boundary of display area 100. The end of curve 36 farther from the vehicle can be drawn based on the vehicle's expected target position. For example, if the vehicle is expected to travel along the center line of lane 32 after changing lanes, the endpoint of curve 36 farther from the vehicle can be on the center line of lane 32. Curve 36 can include two parts, namely line 361 and line 362; line 361 can be within display area 100, and line 362 can be outside display area 100.

[0084] The following combination Figure 7 ,by Figure 6 Taking the scenario shown as an example, the display effect of the navigation pattern being aligned with curves 35 and 36 is illustrated.

[0085] For example, Figure 7 This is a schematic diagram of a set of display interfaces provided in an embodiment of this application. Figure 7 (a) in the text can be understood as, in Figure 6 In the scenario shown, the display effect of navigation elements is presented based on curve 35; Figure 7 (b) in the text can be understood as, in Figure 6 In the scenario shown, the display effect of navigation elements is presented based on curve 36.

[0086] exist Figure 7 In this context, guide lines with arrow directions can be used as navigation elements; Figure 7 The curves 35 and 36 can be represented as dashed lines, used only to show the positional relationship between curves 35 and 36 and the corresponding navigation elements. The HUD may not display curves 35 and 36 in the display interface.

[0087] Reference Figure 7 In (a), navigation element 131 can be drawn based on curve 35; for example, with curve 35 as the center line of the fit, a guide line pattern with an arrow and a certain width can be fitted to curve 35.

[0088] Reference Figure 7 In (b), navigation element 132 can be drawn based on curve 36; for example, since only a portion of curve 36 (i.e., line 361) is within display area 100, line 361 can be used as the center line for attachment, and a guide line pattern with an arrow and a certain width can be attached to line 361. As another example, when attaching navigation element 132 to line 361, the attachment area of ​​virtual element 111 can be avoided, such as... Figure 7 As shown in (b) of the diagram.

[0089] Since curve 35 is within display area 100, Figure 7 When the navigation element is presented as shown in (a), the complete effect of switching from lane 33 to lane 32 can be displayed on the screen at any given time. However, since curve 35 does not match the vehicle's planned path (e.g., curve 36), if the navigation element is drawn based on curve 35, the user may mistakenly believe that the vehicle will travel along the curve corresponding to navigation element 131 (i.e., curve 35). On the one hand, some lines of curve 35 may have a relatively large curve (e.g., line 353). If traveling along curve 35, the vehicle will need to slowly change lanes to lane 32 at a lower speed. Assuming road 31 is a highway, given that excessively slow speeds on highways violate traffic regulations and increase safety risks, in an intelligent driving scenario, if the user mistakenly believes that the vehicle will slow down until it can travel along curve 35, the user will unnecessarily take over the vehicle to avoid excessively low speeds. On the other hand, in intelligent driving scenarios, when planning the vehicle's driving path, the risk of collision with surrounding obstacles is often considered. If the user mistakenly believes that the vehicle will drive along the trajectory corresponding to navigation element 131, they may mistakenly believe that the vehicle will be at risk of collision with other vehicles (such as the vehicle located to the left rear of vehicle 10) during the driving process. This may lead the user to take over the vehicle unnecessarily when there is no need to do so. This may not only lead to user complaints about the intelligent driving function, but also the unnecessarily taking over the vehicle may endanger the safety of the vehicle and people during the driving process.

[0090] by Figure 7 The navigation element 132 is presented in the manner of (b) in the diagram. Although the lane change effect of switching from the current lane to the target lane may not be fully displayed in the display area at a certain moment, the navigation element 132 is dynamically updated based on the planned trajectory as the vehicle moves, which can dynamically present the complete lane change effect. Moreover, the navigation element 132 can accurately reflect the driving intention of the vehicle in the display area, which can reduce the misunderstanding of the user.

[0091] In the above embodiments, the display method of this application is exemplarily described by taking the navigation element as a guide line pattern with arrow guidance as an example. In other embodiments, under the same circumstances, the navigation element may use other methods (such as multiple arrows that fit the planned path, or continuous guide lines without arrow guidance) to present navigation instructions in the display area 100. The following is combined with Figure 8 Other ways of presenting navigation elements are illustrated below.

[0092] For example, Figure 8 This is a schematic diagram of a set of display interfaces provided in an embodiment of this application. Figure 7 Similar to (b) in the text, it can be... Figure 8The navigation elements in the code should fit the planned path (e.g., curve 36).

[0093] Figure 8 (a) shows several patterns that can be used for navigation elements, such as patterns 1 through 4. For example, pattern 1 can be a guide line pattern with a certain width and an arrow pointing in the direction of the arrow; fitting pattern 1 to curve 36 can result in the following: Figure 7 Navigation element 132 is shown in (b) above. For example, pattern 2 can be an arrow pattern, in... Figure 8 In (b) and (c), navigation element 133 can adopt pattern 2. Alternatively, pattern 3 can be a guide line pattern of a certain width without arrow guidance; Figure 8 In (d) and (e), navigation elements 134 and 135 can use pattern 3. For example, unlike continuous guide line patterns such as pattern 1 and pattern 3, pattern 4 can be understood as a discontinuous guide line pattern; navigation elements can also use discontinuous guide line patterns like pattern 4.

[0094] In one embodiment, with Figure 7 Unlike (b), navigation element 133 can employ multiple arrows; these multiple arrows can be aligned with the planned path to present navigation instructions. For example, as... Figure 8 As shown in (b), navigation element 133 may include multiple arrow patterns, in which two adjacent arrows may be connected end to end.

[0095] Reference Figure 8 In (c), the portion of curve 36 within the display area 100 can be represented by multiple nodes, such as nodes 1 to 9, which can use the same or different intervals. For example, pattern 2 can be attached to each node in a manner parallel to the road surface. Another example, taking node 1 as an example, the direction in which the arrow pattern is attached to node 1 can be determined based on the direction of node 2 relative to node 1 or the tangent direction of curve 36 at node 1. Assuming that the same arrow pattern (i.e., pattern 2) is used for nodes 1 to 9, after attaching this arrow pattern to each node, the display interface can present navigation element 133. Yet another example, assuming that the width and height of pattern 2 correspond to a preset spatial size, after attaching this arrow pattern 1331 to each node, the navigation element 133 on the display interface can present a spatial perspective effect where objects appear larger in the foreground and smaller in the background.

[0096] In yet another embodiment, referring to Figure 8In (d), navigation element 134 can use guide lines without arrows to present navigation instructions. For example, a plane perpendicular to the vehicle's longitudinal axis can be preset, curve 36 can be mapped onto this plane, and pattern 3 can be aligned with the mapping of curve 36 on this plane, that is, pattern 3 is aligned with curve 36 using a two-dimensional alignment method; in this method, from the driver's perspective, the real scene will have a perspective effect of near objects appearing larger and far objects smaller, and the width of the aligned pattern 3 does not change with the alignment position, and it does not have a perspective effect of near objects appearing larger and far objects smaller, such as... Figure 8 As shown in (d) in the figure.

[0097] In yet another embodiment, unlike Figure 8 In (d), the width of the guide line can correspond to a preset space dimension; for example, 1 meter, 1.5 meters, or the space dimension can be the width of the vehicle itself. (See reference...) Figure 8 In (e) of navigation element 135, as the guide line pattern extends from the end closer to the vehicle to the end farther away from the vehicle, the guide line pattern that matches the planned path can present a perspective effect of near objects appearing larger and far objects appearing smaller. In other words, a three-dimensional fitting method can be used to fit pattern 3 onto curve 36.

[0098] In the following embodiments, the presentation effect of AR-HUD is illustrated by taking the navigation element as an example, which uses a guide line pattern with arrow directions. Accordingly, the adopted... Figure 8 The navigation elements of pattern 1 shown in (a) are all denoted as navigation element 132. This is a general explanation here and will not be introduced separately later.

[0099] For example, Figure 9 This is another schematic diagram of the display effect of the HUD provided in the embodiments of this application.

[0100] Reference Figure 9 In (a) of the diagram, roads 42 to 44 and their respective opposing roads converge at intersection 41. Road 42 may include multiple lanes, such as lanes 45 and 46.

[0101] Suppose that vehicle 10 at position D plans to travel from intersection 41 to road 42; assume that path 47 is the planned path; the vehicle will enter lane 45 while traveling along path 47; the vehicle will pass position E while traveling along path 47.

[0102] like Figure 9 As shown, when a vehicle turns left from road 44 through intersection 41, it can turn left onto road 43 or road 42. When the vehicle is in position D, if it moves in a manner similar to... Figure 3The navigation instructions are presented in the manner shown in (b). In a manual driving scenario, users can easily mistakenly drive onto road 43; in an intelligent driving scenario, users have difficulty accurately knowing whether the vehicle will drive onto road 42.

[0103] In one example, the display interface when vehicle 10 is at position D can be as follows: Figure 9 As shown in (b) above. Similar to Figure 7 In (b), the navigation element 132 can adopt a guide line pattern with arrows and a certain width; the guide line pattern can be attached to the part of the planned path 47 within the display area 100 based on the spatial coordinates of the planned path 47.

[0104] In another example, the display interface when vehicle 10 is at position E can be as follows: Figure 9 As shown in (c) above. Here, path 47 is represented by a dashed line, which can be understood as path 47 not being displayed in the interface through a virtual image. (Refer to...) Figure 9 In (c), the part of the path 47 within the display area 100 (denoted as line 471) and the part outside the display area 100 (denoted as line 472) can be determined based on the spatial coordinates of the display area 100 and the path 47 when the vehicle 10 is in position E; a guide line pattern with a certain width and an arrow can be attached to line 471.

[0105] based on Figure 9 The displayed interface shows navigation instructions that accurately match the vehicle's route, allowing users to precisely understand the vehicle's driving intentions. Especially in intelligent driving scenarios, accurately understanding the vehicle's intentions prevents unnecessary user intervention, increasing user trust in the intelligent driving function and reducing complaints.

[0106] For example, Figure 10 This is another schematic diagram illustrating the display effect of the HUD provided in the embodiments of this application.

[0107] Figure 10 (a) in the figure shows the surrounding environment of the vehicle 10; Figure 10 (b) in the text can be understood as the driver's perspective when the vehicle is in its current position; Figure 10 (c) in the text can be understood as the display effect of AR-HUD when the vehicle is in its current position.

[0108] Reference Figure 10 In (a), road 51 may include multiple lanes, such as lanes 52 and 53.

[0109] Assume the vehicle will continue to travel in the current lane (i.e., lane 52). For example, the vehicle can maintain its position in lane 52 during travel using lane-keeping assist. Alternatively, path 54 can be a planned path for the vehicle. Or, this planned path can be determined based on the centerline of lane 52.

[0110] Reference Figure 10 (c) in the middle, and Figure 6 Similar to (b) in the previous example, navigation element 132 can use a guide line pattern with arrow directions; this guide line pattern can be attached to path 54. The navigation pattern 132 can present a perspective effect where objects appear larger when closer and smaller when farther away.

[0111] For example, Figure 11 This is another schematic diagram illustrating the display effect of the HUD provided in the embodiments of this application.

[0112] Reference Figure 11 In (a), road 61 may include multiple lanes, such as lane 62 and lane 63; road 61 may intersect with other roads via intersection 64. When a vehicle makes a left turn or U-turn in road 61, it does not need to enter intersection 64; it can make the U-turn in the area of ​​road 61 close to intersection 64.

[0113] Assume the vehicle is expected to make a U-turn to the left and enter lane 63 from lane 62; assume path 65 is the planned path.

[0114] In one example, the driver's view when vehicle 10 is in its current position can be as follows: Figure 11 As shown in (b) of the diagram.

[0115] In another example, the display interface when vehicle 10 is in its current position can be as follows: Figure 11 As shown in (c) above. (Refer to...) Figure 11 (c) in the middle, and Figure 7 Similar to (b) in the previous example, navigation element 132 can employ a guide line pattern with arrow directions; and Figure 8 Similar to (d) in the example, the width of the guide line pattern can be set based on the width of the vehicle, so that when the guide line pattern is aligned with path 65, it can present a perspective effect where things appear larger when they are closer and smaller when they are farther away.

[0116] pass Figure 11 As shown in (c), the display interface allows users to accurately know that the vehicle will turn left to make a U-turn before entering intersection 64. In particular, in intelligent driving scenarios, users do not need to worry about the vehicle missing the correct U-turn position after entering intersection 64, nor do they need to worry about the vehicle violating traffic regulations by making a U-turn in the wrong location.

[0117] For example, Figure 12This is another schematic diagram illustrating the display effect of the HUD provided in the embodiments of this application.

[0118] In some embodiments, different Figures 3 to 11 In the scenario shown, the vehicle could be on a slope, or even on an undulating road. For example, as... Figure 12 As shown in (a), the road on which the vehicle is located may include ramp 1 and ramp 2, as well as a transition area between ramp 1 and ramp 2; the slope directions of ramp 1 and ramp 2 may be opposite, and the road may have undulations. The transition area can be understood as a road surface area with a slope different from both ramp 1 and ramp 2.

[0119] Suppose vehicle 10 travels along path 71 on this road. Since the road has different gradients in different sections, different sections of path 71 can correspondingly have different gradients. For example, based on the degree of incline of each section, path 71 can be divided into lines 72 to 74, such as... Figure 12 As shown in (a) in the figure.

[0120] In one example, vehicle 10 is in Figure 12 At position F as shown in (a), the driver's viewpoint can be as follows: Figure 12 As shown in (b) of the diagram.

[0121] In yet another example, vehicle 10 is in Figure 12 At position F as shown in (a), the display interface corresponding to the virtual image projected by the AR-HUD can be as follows: Figure 12 As shown in (c) in the figure. The dashed lines are used in the figure. Figure 12 The path 71 presented in (c) can be understood as the HUD not displaying the path 71 in the display interface as a virtual image.

[0122] Reference Figure 12 (c) in the middle is similar to Figure 7 In (b), navigation element 132 can use a guide line pattern with arrow directions. Since lines 72 to 74 have different degrees of inclination, the guide line pattern can be aligned with path 71 according to the degree of inclination of each line within the display area 100, so that navigation element 132 can present the undulations of the road to the user.

[0123] In situations where the road surface is uneven, if the vehicle is traveling at excessive speed, it will bounce off the ground and experience an impact upon landing, potentially damaging components such as the chassis. Figure 12 As shown in (c), the display interface allows users to accurately know the undulations of the road in advance. In particular, in intelligent driving scenarios, by presenting the road undulations to the user, it is helpful to control the vehicle speed within an appropriate range when the user needs to take over the vehicle, thus helping to avoid damage caused by excessive speed.

[0124] The above combination Figures 6 to 12 This article introduces the display effects of HUD in various scenarios. Users in the driver's seat can learn about the vehicle's driving intentions through the HUD's display interface, while users in other positions can learn about the vehicle's driving intentions through other display devices.

[0125] In some embodiments, in addition to the HUD, the vehicle may also include one or more display devices such as a central control screen, a passenger-side screen, and second-row displays. For example, the vehicle may be equipped with one or more cameras for users to obtain information about the vehicle's surrounding environment; taking the central control screen as an example, it can be controlled to display images acquired by a single camera, or it can be controlled to display a 360-degree panoramic image of the vehicle's surroundings, which can be obtained by stitching together images acquired by multiple cameras.

[0126] In other embodiments, the user can carry smart devices that have a display interface. For example, the user can wear smart glasses; these smart glasses can project an image onto the lenses, allowing the user to observe the superposition of the image formed by the smart glasses with the real scene when observing the external environment through them.

[0127] The following combination Figure 13 ,by Figure 10 Taking the scenario shown as an example, the display effects of the central control screen and smart glasses are illustrated.

[0128] For example, Figure 13 This is a schematic diagram illustrating another display effect provided in an embodiment of this application.

[0129] Assume vehicle 10 is a left-hand drive vehicle. (Refer to...) Figure 13 In (a), vehicle 10 may also include a central control screen 101; in some implementations, vehicle 10 may also include one or more of a passenger-side screen 102, a second-row left-side screen 103, and a second-row right-side screen 104. User 1 may be in the driver's seat of vehicle 10; user 2 may be in the passenger-side seat, and user 2 may be wearing smart glasses.

[0130] In one example, in Figure 10 In the scenario shown, the drawing position of navigation element 132 within the display area 100 can be mapped onto the image displayed on the central control screen 101; navigation element 132 can be overlaid and displayed at the mapped position, such as... Figure 13 As shown in (b) of the diagram.

[0131] In yet another example, in Figure 9In the scenario shown, the position of the navigation element 132 within the display area 100 can be mapped onto the display area of ​​the smart glasses. This allows the navigation element 132 to be overlaid on the display area of ​​the smart glasses, resulting in a display effect as shown. Figure 13 As shown in (c) in the figure.

[0132] The above combination Figures 3 to 13 The display effects in various scenarios are illustrated below. Figure 14 The flow of the display method provided in the embodiments of this application is described by way of example.

[0133] For example, Figure 14 This is a schematic flowchart illustrating a display method provided in an embodiment of this application. Figure 14 As shown, the method 500 may include the following steps:

[0134] S510 obtains the vehicle's planned route and the display area of ​​the head-up display.

[0135] The vehicle may be equipped with a head-up display (HUD), and the display area of ​​the HUD can be used to display virtual images. For example, for vehicle 10, display area 100 can be used to display images such as... Figures 4 to 12 The display interface shown. For example, the position of the display area in space can be determined based on the vehicle's status (such as one or more of the vehicle's pitch angle and steering angle) and the arrangement of the head-up display device in the vehicle (such as the installation position and installation angle).

[0136] In some embodiments, in intelligent driving scenarios, the control device used to implement intelligent driving functions can plan the vehicle's driving path; through information interaction, the control device used to implement method 500 can obtain the spatial position of the planned path. For example, in Figure 10 In the scenario shown, the vehicle can drive in lane 52 using the lane keeping function, and curve 54 can be an example of a planned path.

[0137] In other embodiments, in manual driving scenarios, the vehicle's driving path can be predicted based on the user's manipulation information of the vehicle (e.g., the user's manipulation information of one or more devices such as the steering wheel, brake pedal, accelerator pedal, and turn signals). For example, the vehicle can be equipped with a driver model to simulate the user's driving style; this driver model can be trained based on the user's historical manipulation information. Although the actual driving path of the vehicle under user control in manual driving scenarios may differ from the driving path planned based on the driver model, the driving path planned / predicted by the driver model, combined with the user's vehicle manipulation and driving style, can be used to detect whether the driver is fatigued or has a sudden illness, in order to deal with possible emergencies. The driving path planned / predicted by the driver model can also be used as an example of a planned path. Furthermore, given that in manual driving scenarios, the vehicle may not follow the path planned by the driver model, this path can also be called a predicted path. For example, in... Figure 5 In the scenario shown, curve 36 can also serve as an example of this predicted path.

[0138] S520, based on the planned path and the display area, determines the spatial location of a portion of the planned path within the display area.

[0139] For example, refer to Figure 6 and Figure 7 Curve 36 can serve as an example of a planned path. Based on the spatial position of curve 36 and display area 100, the portion of curve 36 within display area 100 (i.e., line 361) and the portion of curve 36 outside display area 100 (i.e., line 362) can be determined.

[0140] For example, refer to Figure 9 In (a) and (c), curve 47 can serve as another example of a planned path; based on the spatial position of curve 47 and display area 100, the portion of curve 47 within display area 100 (i.e., line 471) and the portion of curve 47 outside display area 100 (i.e., line 472) can be determined.

[0141] S530, based on the spatial location, displays navigation elements in the display area that correspond to the planned path for that part.

[0142] For example, refer to Figure 6 and Figure 7 Curve 36 can serve as an example of path planning; by determining the spatial position of line 361, within the display area 100, navigation element 132 can be aligned with curve 36, such as... Figure 7 As shown in (b) of the diagram.

[0143] For example, refer to Figure 9 In (a) and (c), curve 47 can serve as an example of a planned path; by determining the spatial position of line 471, within the display area 100, navigation element 132 can be fitted to curve 47, such as... Figure 9 As shown in (c) in the figure.

[0144] The embodiments for fitting navigation elements to the planned path described above and below can also be applied to scenarios where navigation elements are fitted to the predicted path. This is explained uniformly here and will not be described separately later. For example, in some implementations, curves 36 and 47 above can also be used as examples of predicted paths.

[0145] In actual driving, the condition of the road (such as the number of lanes, changes in road gradient), the intersection of the road with other roads, and the traffic rules of the road (such as turning and U-turn locations) are often complex.

[0146] Especially in intelligent driving scenarios, if navigation elements fail to accurately present navigation information to users, they may misunderstand the vehicle's driving intentions. If users cannot accurately understand the vehicle's intentions, they are prone to anxiety in complex road conditions and may frequently take over the vehicle without being required to do so. This not only leads to user complaints about intelligent driving functions and increases user distrust, but may even endanger vehicle safety. Moreover, for vehicle manufacturers, even improvements and upgrades to intelligent driving functions cannot reduce or eliminate these complaints and distrust.

[0147] In this embodiment, based on the spatial position of the planned path within the display area, the navigation pattern is aligned with the planned path in the display area. This accurately conveys the vehicle's driving intention to the user, effectively reducing the user's distrust of intelligent driving functions and decreasing the frequency of unnecessary user intervention in the vehicle.

[0148] Furthermore, in manual driving scenarios, aligning navigation elements with the predicted path helps users adjust the vehicle's motion in a timely manner. For example, when a vehicle is turning, it may experience understeer, requiring the user to turn the steering wheel further. When understeer occurs, the predicted path may differ significantly from the user's expected path, allowing the user to be aware of the understeer issue and promptly adjust the steering wheel to provide sufficient steering force.

[0149] In some possible implementations, the planned path may include multiple location points within the display area; the navigation elements may include multiple navigation patterns corresponding to these multiple location points, and these multiple navigation patterns may be of the same type.

[0150] For example, refer to Figure 8 In (b) and (c), curve 36 can be located at multiple points, such as nodes 1 to 9, within the display area 100; for navigation element 133, pattern 2 can be used to fit onto these multiple nodes respectively.

[0151] In some possible implementations, the navigation pattern may include arrow patterns. The method may also include: determining the direction of each arrow pattern when it is correspondingly attached to multiple location points, based on the relative positional relationship between adjacent location points.

[0152] For example, refer to Figure 8 In (c), taking node 1 as an example, the direction of the arrow pattern when it is attached to node 1 can be determined based on the direction of node 2 relative to node 1; similarly, the direction of the arrow pattern when it is attached to nodes 2 to 9 can be determined.

[0153] In some possible implementations, navigation elements can use guide line patterns. For example, see [reference]. Figure 7 In (b), navigation element 132 can use a guide line pattern with arrow directions and a certain width. For example, refer to... Figure 8 In (d) and (e), navigation elements 134 and 135 can use guide line patterns without arrow directions. Alternatively, navigation elements can also use discontinuous guide line patterns (e.g., ...). Figure 8 Pattern 4 is shown in (a).

[0154] In some possible implementations, the planned path within the display area may include a first segment of the path on a first slope and a second segment of the path on a second slope, which can be connected. Within the display area, the first part of a navigation element can be aligned with the first segment of the path, and the second part of the navigation element can be aligned with the second segment of the path.

[0155] For example, refer to Figure 12 Curve 71 can serve as an example of a planned path; depending on the slope of the road surface, curve 71 can be divided into lines 72 to 74; lines 72 and 73 can be within the display area 100, part of line 74 can be within the display area 100, and another part of line 74 can be outside the display area 100. Line 72 can serve as an example of the first segment of the path; line 73 can serve as an example of the second segment of the path.

[0156] In some possible implementations, the width of the navigation element may correspond to a first spatial dimension. Displaying a navigation element that fits the planned path in the display area, based on the spatial position of the planned path portion within the display area and the first spatial dimension, can include: displaying a navigation element that fits the planned path portion in the display area to create a perspective effect.

[0157] For example, refer to Figure 8 In (e), navigation element 135 adopts pattern 3, the width of pattern 3 can correspond to the preset space size; after pattern 3 is attached to curve 36, pattern 3 can present a visual effect of near-large and far-small.

[0158] For example, refer to Figure 9 In (b) and (c), the navigation element 132 can adopt pattern 1, and the width of pattern 1 can correspond to the preset space size; after the pattern 1 is fitted with the curve 47, the pattern 1 can present a perspective effect of near-large and far-small.

[0159] In some possible implementations, the vehicle may also include a first display screen and a camera. The method may further include: controlling the first display screen to display environmental images captured by the camera; and controlling the display interface of the first display screen to overlay navigation elements based on the spatial location of the planned path.

[0160] For example, refer to Figure 13 In (a) and (b) of the above, the vehicle may be equipped with a central control screen, which can display images captured by one or more cameras; navigation elements 132 can be overlaid on the external environment image presented on the central control screen. Alternatively, the first display screen may be a central control screen, a passenger-side screen, a second-row display screen, or other displays installed in the vehicle.

[0161] In some possible implementations, the vehicle can carry users wearing smart glasses. The method may also include controlling the smart glasses' display interface to show navigation elements based on the spatial location of the planned route.

[0162] For example, refer to Figure 13 In (a) and (c), user 2, who is in the passenger seat of the vehicle, can wear smart glasses; through the interaction between the vehicle and the smart glasses, navigation element 132 can be displayed on the display interface of the smart glasses.

[0163] The above combination Figure 14 The display method provided in the embodiments of this application has been described by way of example. The following is in conjunction with Figure 15 An exemplary system architecture for implementing this method is provided.

[0164] For example, Figure 15 This is a schematic diagram of a system architecture provided in an embodiment of this application. For example... Figure 15 As shown, the system 600 may include:

[0165] The intelligent driving control module can be used to plan the vehicle's driving path. For example, it can plan the vehicle's driving path based on the environmental information collected by the perception system around the vehicle and the vehicle's current motion state.

[0166] A navigation and positioning module can be used to determine the vehicle's current location. For example, a navigation and positioning module may include a GPS positioning system.

[0167] The spatial alignment module can determine the spatial position of the HUD display area based on the vehicle's current location information and the HUD's layout within the vehicle; it can also determine a portion of the planned path within the display area based on the planned path and the spatial position of the display area. This portion of the planned path can then be aligned with the corresponding navigation pattern. For example, in... Figure 6 In the scenario shown, it can be determined that the part of curve 36 is located in the display area 100, that is, the spatial position of line 361 is determined.

[0168] The rendering module can be used to fit the corresponding navigation pattern to the planned path.

[0169] The display module can be used to display navigation patterns that correspond to the planned route within the display area. For example, the display effect presented by the display module can be as follows: Figures 7 to 12 As shown.

[0170] The above text combines Figures 3 to 15 The methods provided in the embodiments of this application are described in detail below. Figure 16 and Figure 17 The apparatus provided in the embodiments of this application is described in detail. The description of the apparatus embodiments corresponds to the description of the method embodiments; therefore, for any content not described in detail, please refer to the method embodiments above.

[0171] For example, Figure 16 A schematic block diagram of an apparatus 800 provided in an embodiment of this application is shown. The apparatus 800 may include modules or units that implement the above embodiments.

[0172] For example, the device 800 may include a processing unit 810 and a display unit 820.

[0173] The processing unit 810 can be used to: acquire the planned route of the vehicle and the display area of ​​the head-up display device; and determine the spatial position of a portion of the planned route within the display area based on the planned route and the display area. The display unit 820 can be used to: display navigation elements that correspond to the planned route within the display area based on the spatial position of that portion of the planned route.

[0174] In some possible implementations, the planned path within the display area may include a first segment of the path on a first slope and a second segment of the path on a second slope, wherein the first and second segments of the path may be connected. The display unit 820 may be used to: in the display area, align the first part of the navigation element with the first segment of the path and align the second part of the navigation element with the second segment of the path.

[0175] In some possible implementations, the width of the navigation element can correspond to a first spatial dimension. The display unit 820 can be used to: display a navigation element in the display area that fits the planned path portion according to the spatial position of that portion of the planned path in the display area and the first spatial dimension, so that the navigation element presents a perspective effect.

[0176] In some possible implementations, the planned path may include multiple location points within the display area; the navigation elements may include multiple navigation patterns corresponding to these multiple location points, and these multiple navigation patterns may be of the same type.

[0177] In some possible implementations, the navigation pattern may include an arrow pattern. The processing unit 810 can also be used to: determine the direction of each arrow pattern when it is correspondingly attached to multiple location points, based on the relative positional relationship between adjacent location points among multiple location points.

[0178] In some possible implementations, navigation elements can use continuous or discontinuous guide line patterns.

[0179] In some possible implementations, the vehicle may also include a first display screen and a camera. The processing unit 810 may also be used to: control the first display screen to display environmental images captured by the camera; and control the display interface of the first display screen to overlay navigation elements according to the spatial location of the planned path.

[0180] In some possible implementations, the vehicle can carry users wearing smart glasses. The processing unit 810 can also be used to control the display interface of the smart glasses to display navigation elements based on the spatial location of the planned route.

[0181] For descriptions of the display area, navigation elements, first path segment, and second path segment, please refer to the relevant records in the above method embodiments.

[0182] It should be understood that the specific process of each unit performing the above-mentioned corresponding steps has been described in detail in the above method embodiments, and will not be repeated here for the sake of brevity.

[0183] It should also be understood that the division of units in the above device is only a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. All units of the above device can be implemented entirely through processor-invoked software, entirely through hardware circuits, or partially through processor-invoked software with the remaining parts implemented through hardware circuits.

[0184] In practice, the processing unit 810 can be implemented by one or more processors or processor-related circuitry. For example, one or more processors can determine the spatial location of a portion of the planned path within the display area based on the planned path and the display area.

[0185] Figure 17 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Figure 17 As shown, the electronic device 900 may include one or more processors 910; one or more memories 920; the one or more memories 920 storing one or more instructions that, when executed by one or more processors 910, cause the display method as described in any of the possible implementations above to be executed.

[0186] This application also provides an apparatus including a processor and a communication interface. The communication interface is used to receive signals and transmit the signals to the processor. The processor processes the signals so that the display method described in any of the possible implementations above is executed.

[0187] This application also provides a readable storage medium storing instructions that, when executed on a device, cause the device to perform the aforementioned method steps to implement the display method described above.

[0188] This application also provides a program product that, when run on a device, causes the device to perform the aforementioned steps to implement the display method described in the above embodiments.

[0189] This application also provides an apparatus including a module for implementing the display method as described in any of the preceding embodiments.

[0190] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store instructions, and when the apparatus is running, the processor may execute the instructions stored in the memory to cause the apparatus to perform the display methods in the above-described method embodiments.

[0191] In this embodiment, the device, readable storage medium, program product or apparatus are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0192] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0193] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0194] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0195] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0196] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0197] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0198] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display method, characterized in that, include: The vehicle's planned path and the display area of ​​the head-up display (HUD) are obtained, wherein the vehicle includes the HUD, and the display area of ​​the HUD is used to display a virtual image; Based on the planned path and the display area, determine the spatial location of the portion of the planned path within the display area; Based on the spatial location, navigation elements that correspond to the planned route are displayed in the display area.

2. The display method according to claim 1, characterized in that, The planned path is a portion of the planned path within the display area, including: a first section of the path on a first slope road surface and a second section of the path on a second slope road surface, wherein the first section of the path is connected to the second section of the path; The display of navigation elements that correspond to the planned route in the display area includes: In the display area, the first part of the navigation element is aligned with the first segment of the path, and the second part of the navigation element is aligned with the second segment of the path.

3. The display method according to claim 1 or 2, characterized in that, The width of the navigation element corresponds to the first spatial dimension; The step of displaying navigation elements that correspond to the planned path in the display area based on the spatial location includes: Based on the spatial location and the first spatial dimension, the navigation element that fits the partial planned path is displayed in the display area so that the navigation element presents a perspective effect.

4. The display method according to any one of claims 1 to 3, characterized in that, The planned path includes multiple location points within the display area; The navigation elements include multiple navigation patterns corresponding to the multiple location points, and the multiple navigation patterns are of the same type.

5. The display method according to claim 4, characterized in that, All of the navigation patterns are arrow patterns; The method further includes: Based on the relative positional relationship between adjacent position points among the plurality of position points, the direction of the arrow pattern when it is attached to the corresponding position point among the plurality of position points is determined.

6. The display method according to any one of claims 1 to 3, characterized in that, The navigation elements employ continuous or discontinuous guide line patterns.

7. The display method according to any one of claims 1 to 6, characterized in that, The vehicle operates using intelligent driving functions, and the planned path is the driving path planned for the vehicle by the intelligent driving functions.

8. The display method according to any one of claims 1 to 7, characterized in that, The vehicle also includes a first display screen and a camera; The method further includes: Control the first display screen to display the environmental images captured by the camera; Based on the spatial location, the navigation elements are overlaid on the display interface of the first display screen.

9. The display method according to claim 8, characterized in that, The first display screen includes at least one of the central control screen, the passenger screen, and the second-row display screen.

10. The display method according to any one of claims 1 to 9, characterized in that, The vehicle carries users wearing smart glasses; The method further includes: Based on the spatial location, the display interface of the smart glasses is controlled to display the navigation elements.

11. A display device, characterized in that, include: The processing unit is configured to: acquire the planned route of the vehicle and the display area of ​​the head-up display (HUD), wherein the vehicle includes the HUD and the display area of ​​the HUD is used to display a virtual image; Based on the planned path and the display area, a spatial display unit is determined for the portion of the planned path within the display area, used to: display navigation elements that fit the portion of the planned path in the display area according to the spatial location.

12. The display device according to claim 11, characterized in that, The planned path is a portion of the planned path within the display area, including: a first section of the path on a first slope road surface and a second section of the path on a second slope road surface, wherein the first section of the path is connected to the second section of the path; The display unit is used to: attach the first part of the navigation element to the first segment of the path in the display area, and attach the second part of the navigation element to the second segment of the path.

13. The display device according to claim 11 or 12, characterized in that, The width of the navigation element corresponds to the first spatial dimension, and the display unit is used for: Based on the spatial location and the first spatial dimension, the navigation element that fits the partial planned path is displayed in the display area so that the navigation element presents a perspective effect.

14. The display device according to any one of claims 11 to 13, characterized in that, The planned path includes multiple location points within the display area, and the navigation element includes multiple navigation patterns corresponding to the multiple location points, wherein the multiple navigation patterns are of the same type.

15. The display device according to claim 14, characterized in that, The plurality of navigation patterns are all arrow patterns, and the processing unit is further configured to: Based on the relative positional relationship between adjacent position points among the plurality of position points, the direction of the arrow pattern when it is attached to the corresponding position point among the plurality of position points is determined.

16. The display device according to any one of claims 11 to 13, characterized in that, The navigation elements employ continuous or discontinuous guide line patterns.

17. The display device according to any one of claims 11 to 16, characterized in that, The vehicle operates using intelligent driving functions, and the planned path is the driving path planned for the vehicle by the intelligent driving functions.

18. The display device according to any one of claims 11 to 17, characterized in that, The vehicle also includes a first display screen and a camera, and the processing unit is further configured to: Control the first display screen to display the environmental images captured by the camera; Based on the spatial location, the navigation elements are overlaid on the display interface of the first display screen.

19. The display device according to claim 18, characterized in that, The first display screen includes at least one of the central control screen, the passenger screen, and the second-row display screen.

20. The display device according to any one of claims 11 to 19, characterized in that, The vehicle carries a user wearing smart glasses, and the processing unit is further configured to: Based on the spatial location, the display interface of the smart glasses is controlled to display the navigation elements.

21. An electronic device, characterized in that, include: One or more processors; One or more memories; the one or more memories storing one or more programs that, when executed by one or more processors, cause the display method as described in any one of claims 1 to 10 to be performed.

22. A chip, characterized in that, The chip includes a processor and a communication interface, the communication interface being used to receive signals and transmit the signals to the processor, the processor processing the signals such that the display method as described in any one of claims 1 to 10 is executed.

23. A readable storage medium, characterized in that, The readable storage medium stores instructions that, when executed on an electronic device, cause the display method as described in any one of claims 1 to 11 to be performed.

24. A program product, characterized in that, The program product includes program code that, when run on an electronic device, causes the display method as described in any one of claims 1 to 11 to be executed.

Images