METHOD AND DEVICE FOR DISPLAYING LANE NAVIGATION INFORMATION, HUD SYSTEM, DEVICE AND MEDIUM

Abstract

The present invention discloses a method and a device for displaying lane navigation information, a HUD system, a device, and a medium, and relates to the technical field of intelligent driving. The method comprises: acquiring positioning data and the navigation path of a vehicle, and dividing the navigation path into several road segments; upon detecting that the vehicle is entering the current road segment, determining the current AR lane image, the next AR lane image, and other AR lane images, and setting corresponding parameters for each; setting the current AR lane image, the next AR lane image, and the other AR lane images to their corresponding target display positions based on the setting parameters, and displaying the current AR lane image, the next AR lane image, and the other AR lane images at their respective target display positions.The technical solution of the present disclosure can provide the driver with intuitive and precise lane navigation information, reserve time for the driver to change lanes, and improve driving safety.

Description

REFERENCE TO RELATED REGISTRATIONS

[0001] The present disclosure claims priority from Chinese patent application No. 202310753202.2, filed with the Chinese Patent Office on June 25, 2023, entitled "Method and device for displaying lane navigation information, electronic device and storage medium". The content of that Chinese patent application is hereby incorporated into the present disclosure by reference. TECHNICAL AREA

[0002] The present disclosure relates to the field of intelligent driving technology, and in particular to a method and a device for displaying lane navigation information, a HUD system, a device and a medium. STATE OF THE ART

[0003] In the prior art, lane navigation information is typically provided to the driver using one of two methods. The first method uses a virtual vehicle to simulate the vehicle's driving situation on a current road segment. This allows the driver to be shown the number of lanes and the target lane for the current road segment. The second method involves providing the driver with information about the current traffic situation as they approach an intersection, using voice prompts and a magnified view of the intersection. In this way, the guidance information is usually displayed at a predetermined time in advance by the navigation system.

[0004] In real-world driving situations, the two methods described above can lead to shortcomings, such as drivers missing the optimal time to change lanes due to short distances on certain road segments or sudden traffic situations like congestion or breakdowns. Therefore, the question of how to intelligently provide drivers with intuitive and precise lane navigation information is a pressing issue that needs addressing. REVELATION OF THE INVENTION

[0005] The present disclosure provides a method and device for displaying lane navigation information, a HUD system, a device and a medium that can intelligently provide intuitive and precise lane navigation information to the driver, reserve time for lane-changing maneuvers for the driver, and improve driving safety and the driving experience.

[0006] In a first aspect, the present disclosure provides a method for displaying lane navigation information, which is used in a HUD and which includes: Capturing positioning data and navigation path of a vehicle, and dividing the navigation path into multiple road segments, wherein the multiple road segments comprise a current road segment, a next road segment and other road segments, the other road segments being those of the multiple road segments except for the current road segment and the next road segment; Determine, upon detecting the vehicle's entry into the current road segment based on positioning data, a current AR (Augmented Reality) lane image corresponding to the current road segment, a next AR lane image corresponding to the next road segment, and other AR lane images corresponding to the other road segments, wherein the current AR lane image, the next AR lane image, and the other AR lane images are to be displayed in an image display component of the HUD this time; Setting appropriate parameters for the current AR lane image, the next AR lane image, and the other AR lane images; Setting the current AR lane image, the next AR lane image, and the other AR lane images to their corresponding target display positions based on the setting parameters, and displaying the current AR lane image, the next AR lane image, and the other AR lane images at the target display positions to enable the display of lane navigation information in the image display component.

[0007] In one embodiment of the present disclosure, a method for displaying lane navigation information is provided, wherein, according to the subdivision criteria of whether the navigation paths have the same number of lanes and whether the lane arrow information of each lane is identical, a navigation path is rationally subdivided into several road segments, so that AR lane images are determined for the several road segments; when the vehicle enters the current road segment, the current AR lane image, the next AR lane image, and the other AR lane images to be displayed this time are determined from the several AR lane images; subsequently, the current AR lane image, the next AR lane image, and the other AR lane images are each displayed at target display positions.The present disclosure can capture the current road segment on which the vehicle is located in real time. Since the AR lane images of the current road segment, the next road segment, and other road segments are displayed to the driver in a timely manner as soon as the vehicle enters the current road segment, time can be reserved for the driver to make lane changes. The driver can also be guided in real time. Not only can the driver be informed of the number of lanes, lane arrow information, the destination lane, and the current lane of the current road segment, but the number of lanes, lane arrow information, and the destination lane of the next road segment can also be announced in advance. This makes it easier for the driver to make correct decisions in a timely manner in complex road situations, thus supporting the driver in performing driving tasks efficiently.The present disclosure can intelligently provide intuitive and precise lane navigation information to the driver, reserve time for lane-changing maneuvers, and improve driving safety and the driving experience.

[0008] In a second aspect, the present disclosure provides a device for displaying lane navigation information, which is integrated into a HUD and comprises: a road segment subdivision module designed to capture positioning data and navigation path of a vehicle and to subdivide the navigation path into multiple road segments, wherein the multiple road segments comprise a current road segment, a next road segment and other road segments, the other road segments being those of the multiple road segments except for the current road segment and the next road segment; an image display determination module designed to determine, upon detection of the vehicle's entry into the current road segment based on positioning data, a current AR lane image corresponding to the current road segment, a next AR lane image corresponding to the next road segment, and other AR lane images corresponding to the other road segments, wherein the current AR lane image, the next AR lane image, and the other AR lane images are to be displayed in an image display component of the HUD this time; a parameter setting module, which is intended for setting appropriate parameters for the current AR lane image, the next AR lane image and the other AR lane images; A navigation information display module, designed to set the current AR lane image, the next AR lane image, and the other AR lane images to their corresponding target display positions based on the setting parameters, and to display the current AR lane image, the next AR lane image, and the other AR lane images at their respective target display positions, in order to enable the display of lane navigation information in the image display component. In a third aspect, the present disclosure provides an electronic device comprising: at least one processor; and a memory that is communicatively connected to the at least one processor; wherein The memory stores a computer program executable by the at least one processor, which is executed by the at least one processor, so that the at least one processor can perform the method for displaying lane navigation information according to any embodiment of the present disclosure.

[0009] In a fourth aspect, the present disclosure provides a computer-readable storage medium on which computer instructions are stored which, when executed by a processor, cause it to perform the method for displaying lane navigation information according to any embodiment of the present disclosure.

[0010] In a fifth aspect, the present disclosure provides a head-up display (HUD) system comprising: an image generator, an imaging optics component, an image display component and a processor, wherein the image generator is configured to generate a digital image signal and convert it into light beams containing image information; the imaging optics component is configured to reflect light rays with image information and project them onto the image display component; the image display component is configured to form a visually observable virtual image based on the light rays projected by the imaging optics component; the processor is configured to perform the method for displaying lane navigation information according to any embodiment of the present disclosure.

[0011] It is understood that the content described in this section of the text should neither characterize critical or important features of the embodiments of the present disclosure nor limit the scope of the present disclosure. Further features of the present disclosure will be easily understood through the following description.

[0012] It is understood that, prior to the application of the technical solutions disclosed in the respective embodiments of this disclosure, the nature, scope and application scenarios of the personal data affected by this disclosure must always be communicated to users in an appropriate manner in accordance with relevant laws and regulations, and the consent of the users must be obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the drawings used in the explanations of the embodiments are briefly presented below. Obviously, the drawings described below represent only some embodiments of this disclosure. Those skilled in the art can derive further drawings from them without any inventive effort. Fig. Figure 1 shows a schematic structural representation of a HUD system according to an embodiment of the present disclosure. Fig. Figure 2 shows a schematic flowchart of a method for displaying lane navigation information according to an embodiment of the present disclosure. Fig. Figure 3 shows a schematic representation of the subdivision of a navigation path into road segments according to an embodiment of the present disclosure. Fig. Figure 4A shows a schematic representation of an AR lane image according to an embodiment of the present disclosure. Fig. Figure 4B shows a first schematic representation of a current AR lane image according to an embodiment of the present disclosure. Fig. Figure 4C shows a second schematic representation of an actual AR lane image according to an embodiment of the present disclosure. Fig. Figure 4D shows a schematic representation of lane navigation information according to an embodiment of the present disclosure. Fig. Figure 5 shows a schematic representation of a display window in an image display component according to an embodiment of the present disclosure. Fig. Figure 6A shows a schematic representation of the position and orientation of a first, a second and a third display surface at a target display position according to an embodiment of the present disclosure. Fig. Figure 6B shows a schematic representation of the display of the other AR lane images according to an embodiment of the present disclosure. Fig. Figure 6C shows a further schematic representation of the display of the other AR lane images according to an embodiment of the present disclosure. Fig. Figure 7 shows a schematic representation of a rotation animation for switching from the AR lane image displayed last time to the AR lane image to be displayed this time, according to an embodiment of the present disclosure. Fig. Figure 8 shows a schematic structural representation of a device for displaying lane navigation information according to an embodiment of the present disclosure. Fig. Figure 9 shows a block diagram of an electronic device for implementing a method for displaying lane navigation information according to an embodiment of the present disclosure. FORMS OF EXECUTION OF THE INVENTION

[0014] To clarify the purposes, technical solutions, and advantages of the embodiments of this disclosure, the technical solutions therein are described clearly and completely below in conjunction with the accompanying drawings of the embodiments of this disclosure. The described embodiments naturally do not relate to all, but only to some, of the embodiments of this disclosure. All further embodiments that are derived by those skilled in the art based on the embodiments of this disclosure without inventive step shall fall within the scope of protection of this disclosure.

[0015] It should be noted that the terms "first," "second," "goal," "initial," or the like are used in the description and claims of this disclosure and in the drawings above to distinguish similar objects and do not necessarily describe a specific sequence or hierarchy. It is understood that the terms used in this way are interchangeable, so that the embodiments of this disclosure described herein may also be carried out in sequences other than those illustrated or described here. Furthermore, the terms "comprise," "include," and any variants thereof are intended to cover non-exclusive inclusion.For example, a process, procedure, system, product or device comprising a series of steps or units need not be limited to the clearly listed steps or units, but may include other steps or units that are not clearly listed or that are inherent in the process, procedure, product or device.

[0016] One embodiment of the present disclosure provides a head-up display (HUD) system. As described in Fig. As shown in Figure 1, the HUD system 10 comprises an image generator 11, an imaging optics component 12, and an image display component 13. The image generator 11 is configured to generate a digital image signal (i.e., a real image) and convert it into light beams containing image information. In some examples, the image generator 11 can be an optical machine fabricated using Digital Light Processing (DLP) or Liquid Crystal on Silicon (LCOS) technology, comprising an illumination component and a projection component, the projection component being a micro-projection lens. The imaging optics component 12 reflects the real image, for example, using a reflecting mirror, and projects it onto the image display component 13, so that the image display component 13 forms a visually observable virtual image 2 based on the light beams projected by the imaging optics component 12.The image display component 13 can be configured differently depending on the application scenario. For example, if the application scenario is film projection in a cinema, the image display component 13 can be a projection screen or a display. If the application scenario is the display of driving information on a vehicle's windshield, the image display component 13 is the vehicle's windshield. In some examples, the image display component 13 refers to a vehicle's windshield used to display vehicle driving information.

[0017] Fig. Figure 2 shows a schematic flowchart of a method for displaying lane navigation information according to an embodiment of the present disclosure. This embodiment can be used to display the AR lane image of the current road segment and the AR lane image of the next road segment in the augmented reality head-up display (AR-HUD) upon detection that the vehicle is entering the current road segment, so that the driver can obtain the lane navigation information for the current and the next road segment and thus make timely driving maneuvers. The method for displaying lane navigation information provided in this embodiment can be carried out by the device for displaying lane navigation information provided in an embodiment of the present disclosure.This device can be implemented in software and / or hardware and integrated into an electronic device for carrying out this method. In some examples, the electronic device in an embodiment of the present disclosure can be the head-up display (HUD) system, as shown in . Fig. 1 shown, his.

[0018] Referring to Fig. 2, the method of this embodiment comprises, but is not limited to, the following steps: S210: Capturing positioning data and navigation path of a vehicle, and dividing the navigation path into multiple road segments.

[0019] In the present disclosure, the multiple road segments comprise a current road segment, a next road segment, and other road segments, the other road segments being those of the multiple road segments excluding the current road segment and the next road segment. In this embodiment, the vehicle also has a driver assistance device, which may be an Advanced Driving Assistance System (ADAS) or a navigation system.

[0020] In this embodiment of the present disclosure, the HUD system further comprises a processor 14, which may include a data acquisition unit, a data processing unit, and a data analysis unit. When the vehicle starts moving, the data acquisition unit can acquire the vehicle's positioning data from the map navigation system or the ADAS system and acquire the vehicle's navigation path from the map navigation system. The data processing unit can divide the acquired navigation path into several road segments according to preset subdivision criteria and assign road segment identification numbers to these road segments.

[0021] The road segment identification number is denoted, for example, by R. Assuming that the total number of road segments is n, the road segment identification numbers of several road segments are denoted successively by R1, R2, ..., Ri, Ri+1, ..., Rn-1, Rn, where i represents a segment index number.

[0022] Optionally, a predefined subdivision criterion can be used to group navigation paths with the same number of lanes and identical lane arrow information into a single road segment. As in Fig. Figure 3 schematically illustrates a method of subdividing the navigation path from the start to the end point into n road segments according to the preset subdivision criterion. Fig. 3 shows that different positions of the lane in each road section have identical lane arrow information.

[0023] After dividing the navigation path into multiple road segments, a corresponding AR lane image can first be created for each of these segments to obtain multiple AR lane images. Next, the image identification numbers corresponding to these multiple AR lane images are determined; these numbers uniquely correspond to the road segment identification numbers of the multiple road segments. Subsequently, in the image display component, each AR lane image is displayed based on its initial display position and the image identification number corresponding to each AR lane image.

[0024] In some examples, the initial display position may refer to a location where multiple AR lane images are first displayed when a vehicle starts moving (e.g., when entering a first road segment). Since this embodiment presents the method for displaying lane navigation information of the present disclosure based on a vehicle entering a current road segment, the initial display position may also refer to a location where multiple AR lane images are displayed when the vehicle enters the last road segment. The specific method for displaying an AR lane image at an initial display position is essentially identical to the specific method for displaying an AR lane image at the target display position, which is presented in detail in the following embodiments.

[0025] Specifically, when creating a corresponding AR lane image for each of the multiple road segments, road information for the navigation path can first be captured in the map navigation system. This allows the lane arrow information corresponding to each of the multiple road segments to be determined from the road information. Subsequently, based on the navigation path and the lane arrow information, a target lane is determined in which the vehicle should travel in each road segment. Finally, based on the lane arrow information and target lanes corresponding to each road segment, an AR lane image is generated for each of the road segments. Fig. Figure 4A shows a schematic representation of an AR lane image, illustrating that the number of lanes is four, with the second and third lanes being destination lanes, namely straight-ahead lanes.

[0026] In some examples, when generating an AR lane image for each road segment based on the lane arrow information and destination lanes corresponding to each segment, the destination lane's lane arrow information can be displayed in a first display mode, and the lane arrow information of a first other lane can be displayed in a second display mode, resulting in an AR lane image corresponding to each road segment. The first other lane refers to lanes other than the destination lane in each road segment. Optionally, the display mode can involve preset colors, preset sizes, preset animations, or similar elements. As in Fig. As illustrated in Figure 3A, the destination lanes are shown in black (in the first display mode) and the first other lanes in gray (in the second display mode). Specific display modes can also be defined by the user according to their needs and are not described in detail here.

[0027] S220: Determine, upon detection of the vehicle entering the current road segment based on positioning data, a current AR lane image corresponding to the current road segment, a next AR lane image corresponding to the next road segment, and other AR lane images corresponding to the other road segments, wherein the current AR lane image, the next AR lane image, and the other AR lane images are to be displayed in an image display component of the HUD this time.

[0028] In one embodiment of the present disclosure, the data analysis unit analyzes the positioning data acquired by the data acquisition unit in step S210 to determine the current road segment on which the vehicle is located in real time. In other words, it determines whether the vehicle is entering the current road segment from a previous road segment. If so, the HUD executes step S220.

[0029] In some examples, when the HUD detects that the vehicle is entering the current road segment, it can determine the road segment identifier corresponding to that segment. Based on this identifier, the identifier of the next road segment is then determined, and finally, the next road segment corresponding to the current one is identified. The other road segments are then determined using the same procedure as described above. Since the image identifiers of the AR lane images correspond uniquely to the road segment identifiers, the image identifiers corresponding to the road segment identifiers can be determined, thus yielding the image identifiers corresponding to the current AR lane image, the next AR lane image, and the other AR lane images.Based on the image identification numbers, the current AR lane image, the next AR lane image, and the other AR lane images are determined from the multiple AR lane images.

[0030] It is understood that when the vehicle enters the current road segment, the specific AR lane image to be displayed on the HUD this time is the next AR lane image last displayed on the HUD while the vehicle was traveling on the previous road segment. The next AR lane image to be displayed on the HUD this time is the second-next AR lane image last displayed on the HUD while the vehicle was traveling on the previous road segment. Similarly, the other AR lane images to be displayed on the HUD this time can also be obtained using the image identification numbers.

[0031] To better and more intelligently inform the driver whether a lane change is necessary, they can be informed about the vehicle's current lane. Therefore, the lane arrow information for the current lane must be highlighted in the current AR lane view.

[0032] In detail, the method provided in this embodiment of the present disclosure for displaying lane navigation information after determining the vehicle's entry into the current road segment based on the positioning data may further comprise: determining the vehicle's current lane in the current road segment based on the positioning data; displaying lane arrow information from target lanes in a first display mode, displaying lane arrow information from a second other lane in a second display mode, and displaying lane arrow information of the current lane in a third display mode, thereby obtaining an AR lane image corresponding to the current road segment; wherein the second other lane is another lane in the current road segment other than the target lane and the current lane.Optionally, the display mode can include preset colors, preset sizes, preset animations, or similar settings. This means that different lanes are displayed differently in the first, second, and third display modes. Specific display modes can also be defined by the user according to their needs and are not described in detail here.

[0033] As an example, Fig. 4B a first schematic representation of a current AR lane image according to an embodiment of the present disclosure. Referring to Fig. In section 4B, the number of lanes is four, with the second and third lanes being destination lanes (straight-through lanes), the second lane also being the current lane, and the first and fourth lanes being other lanes. In the figure, the second lane is shown in black and enlarged, the third lane is shown in black, and the first and fourth lanes are shown in gray. Fig. Figure 4B shows that the current vehicle is in the destination lane and the driver does not need to perform a lane change maneuver.

[0034] As another example, Fig. 4C a second schematic representation of a current AR lane image according to an embodiment of the present disclosure. Referring to Fig. 4C, the number of lanes is four, where the second and third lanes are destination lanes (straight-ahead lanes), the first lane is the current lane (a left-turn lane), and the fourth lane is another lane; the second and third lanes are shown in black, the fourth lane in gray, and the first lane in gray and enlarged. Fig. As can be seen in Figure 4C, the current vehicle is traveling in a non-destination lane (the first lane) and the driver must perform a lane change maneuver to the right in order to get to the second or third lane.

[0035] S230: Setting appropriate parameters for the current AR lane image, the next AR lane image, and the other AR lane images.

[0036] In one embodiment of the present disclosure, when the vehicle is driving on the last road segment, the display position corresponding to the next AR lane image last displayed on the HUD is referred to as the initial display position; when the vehicle is driving on the current road segment, the next AR lane image last displayed on the HUD becomes the current AR lane image to be displayed on the HUD. The display position corresponding to the current AR lane image displayed on the HUD is referred to as the target display position, and the setting parameters corresponding to the adjustment of this AR lane image from the initial display position to the target display position are determined.

[0037] When the vehicle is driving on the last road segment, the display position corresponding to the second-next AR lane image last shown on the HUD is designated as the initial display position. When the vehicle is driving on the current road segment, the second-next AR lane image last shown on the HUD becomes the next AR lane image to be displayed on the HUD this time. The display position corresponding to the next AR lane image shown on the HUD this time is designated as the target display position, and the setting parameters corresponding to adjusting this AR lane image from the initial display position to the target display position are determined. Similarly, the setting parameters corresponding to the other AR lane images to be displayed on the HUD this time can also be obtained using the image identification numbers.

[0038] S240: Setting the current AR lane image, the next AR lane image, and the other AR lane images to their corresponding target display positions based on the setting parameters, and displaying the current AR lane image, the next AR lane image, and the other AR lane images at the target display positions to enable the display of lane navigation information in the image display component.

[0039] In one embodiment of the present disclosure, the HUD sets the current AR lane image, the next AR lane image, and the other AR lane images to be displayed this time, each from their corresponding initial display positions to their corresponding target display positions, and displays the lane navigation information at the target display positions to help the driver understand the current traffic situation and decide whether a lane change is necessary. Optionally, the image display component can be a specific area of ​​the vehicle's windshield.

[0040] Optionally, since displaying all AR lane images for multiple road segments could impair the driver's ability to navigate, the other AR lane images can be hidden at the target display positions, with only the current and next AR lane images clearly visible. Furthermore, the current AR lane image can be enlarged to better distinguish it from the next AR lane image.

[0041] As an example, Fig. 4D is a schematic representation of the lane navigation information according to an embodiment of the present disclosure. The arrows on the last line at the bottom of the interface of the image display component in Fig. The 4D arrows refer to the AR lane pattern for the current road segment and can include a lane arrow for the current lane (e.g., reference sign 21) in which the vehicle is located within the current road segment, lane arrows for all destination lanes (e.g., reference sign 22), and lane arrows for other lanes (e.g., reference sign 23). The arrows on the penultimate line on the road surface refer to the AR lane pattern for the next road segment and can include lane arrows for all destination lanes (e.g., reference sign 31) and lane arrows for other lanes (e.g., reference sign 32).

[0042] In the technical solution of this embodiment, the following steps are performed: acquiring a vehicle's positioning data and navigation path; dividing the navigation path into multiple road segments; upon detecting the vehicle's entry into the current road segment based on the positioning data, determining a current AR lane image corresponding to the current road segment, a next AR lane image corresponding to the next road segment, and other AR lane images corresponding to the other road segments, with the current AR lane image, the next AR lane image, and the other AR lane images being displayed in a single image display component of the HUD; setting corresponding adjustment parameters for each of the current AR lane image, the next AR lane image, and the other AR lane images; and adjusting the current AR lane image.The next AR lane image and the other AR lane images are each positioned at their corresponding target display positions based on the setting parameters, and the current AR lane image, the next AR lane image, and the other AR lane images are displayed at their respective target display positions to enable the display of lane navigation information in the image display component. In the present disclosure, according to the subdivision criteria of whether the navigation paths have the same number of lanes and whether the lane arrow information of each lane is identical, a navigation path is rationally subdivided into several road segments, so that AR lane images are determined for the several road segments; when the vehicle enters the current road segment, the current AR lane image, the next AR lane image, and the other AR lane images are determined from the several AR lane images.which are to be displayed this time; subsequently, the current AR lane image, the next AR lane image, and the other AR lane images are displayed at the target display positions. The present disclosure can capture the current road segment on which the vehicle is located in real time. Since the AR lane images of the current road segment, the next road segment, and the other road segments are displayed to the driver in a timely manner as soon as the vehicle enters the current road segment, time can be reserved for the driver to perform lane-changing maneuvers. The driver can also be guided in real time. The driver can be informed not only of the number of lanes, the lane arrow information, the target lane, and the current lane of the current road segment, but also the number of lanes,The lane arrow information and the target lane of the next road segment are announced in advance. This makes it easier for the driver to make correct decisions in a timely manner in complex road situations, thus supporting the driver in performing driving tasks efficiently. The present disclosure can intelligently provide the driver with intuitive and precise lane navigation information, reserve time for the driver to make lane changes, and improve driving safety and the driving experience.

[0043] The following describes in more detail the method for displaying lane navigation information according to an embodiment of the present disclosure. This embodiment of the present disclosure is optimized based on the embodiments described above. The specific optimization consists of a detailed explanation of an interface interaction process for displaying an AR lane image at the target display position in the image display component.

[0044] Fig. Figure 5 shows a schematic representation of a display window in an image display component according to an embodiment of the present disclosure, wherein Fig. 5(a) a front view of the display window, Fig. 5(b) a side view of the display window, Fig. 5(c) a perspective view of the display window and Fig. Figure 5(d) shows a top view of the display window. In the image display component, a three-dimensional coordinate system for displaying AR lane images (namely, a right-handed coordinate system) is created. The origin of the three-dimensional coordinate system (namely, the reference symbol O in the figure) is both the center point of the lower boundary of the display window in the image display component and the center point of the lower boundary of the AR lane image. The X-axis runs horizontally to the left and is perpendicular to both the Y-axis and Z-axis. The Y-axis runs vertically upwards from the ground, and the Z-axis runs in the direct forward direction of vehicle travel. The size of the display window is determined by the viewing angle of the driver's eye point. Fig. 5(b) and Fig. 5(d) it is evident that the length of the display window is 2×1 and the height of the display window is y1, the length of the display window is determined by the horizontal viewing angle at the driving eye point, and the height of the display window is determined by the vertical viewing angle at the driving eye point.

[0045] The other road segments comprise a first, untraveled road segment and a second, already traveled road segment. The other AR lane images comprise a first AR lane image corresponding to the first road segment and a second AR lane image corresponding to the second road segment. The target display position comprises a first, a second, and a third display area. The first display area is perpendicular to both the second and third display areas, and the second display area is parallel to the third display area. The upper boundary of the first display area and the lower boundary of the second display area coincide, as do the lower boundary of the first display area and the upper boundary of the third display area.

[0046] Fig. Figure 6A shows a schematic representation of the position and orientation of a first, a second, and a third display surface at a target display position according to an embodiment of the present disclosure. Referring to Fig. Figure 6A shows a three-dimensional coordinate system for reference. The first representation surface 1 is parallel to an XOY plane, and the midpoint of the lower boundary of the first representation surface is the origin of the XOY plane. The second representation surface 2 and the third representation surface 3 are parallel to an XOZ plane. The Y-axis coordinate of the second representation surface 2 is h, i.e., the height of the AR lane image is h, and the midpoint of the upper boundary of the third representation surface 3 is the origin of the XOZ plane.

[0047] The first display area 1 is used to show the current AR lane image. The second display area 2 is used to show the next AR lane image and the first AR lane image to be shown. The third display area 3 is used to show the second AR lane image to be shown. On the second display area 2, the next and first AR lane images are stacked or displayed sequentially according to their image identification numbers. On the third display area 3, the second AR lane images are stacked or displayed sequentially according to their image identification numbers.

[0048] Fig. Figure 6B shows a schematic representation of the display of the other AR lane images according to an embodiment of the present disclosure. Referring to Fig. 6B, the current road segment is designated Ra. The center point Qa of the current AR lane image on the first display area 1 in Fig. 6B is located at position(xa, ya, za)=(0, h / 2, 0) in the figure's coordinate system, and the current AR lane image is parallel to the XOY plane, representing a front view from the driver's perspective without any perspective distortion. The next road segment is designated Ra+1. The center point Qa+1 of the next AR lane image on the second display surface is located in Fig. 6B is located at position(xa+1, ya+1, za+1)=(0, h, h / 2) in the figure's coordinate system, and the next AR lane image is parallel to the XOZ plane, representing a top view with a perspective distortion effect from the driver's perspective. The first road segments are labeled Ra+2, Ra+3, ..., Rn. The first AR lane images on the second display surface in Fig. 6B have a coordinate point h on the Y-axis, run parallel to the XOZ plane, and are arranged along the Z-axis in a positive direction. Therefore, the positions of the centers Qa+2, Qa+3, ..., Qn of the first AR lane images in the coordinate system refer successively to: Position(xa+2, ya+2, za+2)=(0, h, 3h / 2), Position(xa+3, ya+3, za+3)=(0, h, 5h / 2), ..., Position (xn,yn,zn)=(0,h,[2(n−a)−1]h2). The second road sections are designated Ra-1, Ra-2, ..., R1. The second AR lane images are displayed on the third screen. Fig. 6B have the coordinate point 0 on the Y-axis, run parallel to the XOZ plane, and are arranged along the Z-axis in a positive direction. Therefore, the positions of the centers Qa-1, Qa-2, ..., Q1 of the first AR lane images in the coordinate system in the figure refer successively to: Position(xa-1, ya-1, za-1)=(0, 0, h / 2), Position(xa-2, ya-2, za-2)=(0, 0, 3h / 2), ..., Position (x1,y1,z1)=(0,0,[2(n−a)−1]h2).

[0049] Fig. Figure 6C shows a further schematic representation of the display of the other AR lane images according to an embodiment of the present disclosure. The arrangement of the current AR lane image on the first display area and the next AR lane image on the second display area corresponds to the arrangement in Fig. 6B. The first road segments are designated Ra+2, Ra+3, ..., Rn. The first AR lane images on the second representation surface in the figure have a coordinate point h on the Y-axis, run parallel to the XOZ plane, and are superimposed from top to bottom at the position of reference numeral 9 according to the sequence of the image identification numbers. The positions of the center points Qa+2, Qa+3, ..., Qn of the first AR lane images in the coordinate system in the figure are: Position(xa+2, ya+2, za+2) = Position(xa+3, ya+3, za+3) = ... = Position(xn, yn, zn) = (0, h, h / 2). The second road segments are designated Ra-1, Ra-2, ..., R1. The second AR lane images on the third display area in the figure have a coordinate point 0 on the Y-axis, run parallel to the XOZ plane, and are superimposed from top to bottom at the reference point 10 according to the sequence of the image identification numbers. The positions of the center points Qa-1, Qa-2, ..., Q1 of the second AR lane images in the coordinate system in the figure are: Position(xa-1, ya-1, za-1)=Position(xa-2, ya-2, za-2)...= Position(x1, y1, z1)=(0, 0, h / 2).

[0050] The following describes a specific process whereby, when the vehicle enters the current road segment, the HUD sets the current AR lane image, the next AR lane image, and the other AR lane images to their corresponding target display positions based on the setting parameters, and displays the current AR lane image, the next AR lane image, and the other AR lane images at their respective target display positions to enable the display of lane navigation information in the image display component.

[0051] The first specific process for adjusting AR lane images to their corresponding target display positions is as follows: The setting parameters include a virtual rotation axis, a rotation direction, rotation coordinates, a translation direction, and translation coordinates. These parameters are based on the center point Q of the AR lane image. As shown in Fig. As shown in Figure 6B, reference symbol 1 represents a first display area for showing the current AR lane image; reference symbol 2 represents a second display area for showing the next AR lane image; reference symbol 3 represents a second display area for showing the first AR lane images; reference symbol 4 represents a third display area for showing the last AR lane image; reference symbol 5 represents a third display area for showing the second AR lane images other than the last AR lane image; reference symbol 6 represents the direction of rotation of the first display area 1, the second display area 2, and the third display area 4, which serves only to illustrate the rotation animation and does not exist in the actual image;Reference symbol 7 represents the virtual axis of rotation for the rotational transformation of the first display area 1, the second display area 2, and the third display area 4, which passes through point F (0, h / 2, h / 2) and is parallel to the X-axis, and which serves for explanation and clarification and is not visible on the HUD display area; reference symbol 8 represents the translation direction of the first AR lane images corresponding to the first road segment, which serves only to illustrate the rotation animation and does not exist on the actual image.

[0052] If the AR lane images are displayed spanned according to the image identification numbers on the second and third display areas (i.e., the display method for the other AR lane images in Fig. 6B), when setting the current AR lane image, the next AR lane image, and the other AR lane images, the current AR lane image to be displayed can first be rotated by a first rotation coordinate (e.g., Rotation(xa, ya, za)=(90, 0, 0)) along a virtual rotation axis (e.g., reference symbol 7 in) to their corresponding target display positions based on the setting parameters. Fig. 6B) and in a direction of rotation (e.g. the one indicated by the reference numeral 6 in Fig. (in the direction specified in 6B) to allow the rotation of the current AR lane image to be displayed this time from the second display surface to the first display surface; subsequently, based on the first translation direction (e.g., the one indicated by reference numeral 8 in Fig. (in the direction specified in 6B) the next AR lane image to be displayed this time and the first AR lane images to be displayed this time are translated by a first translation coordinate (e.g., translated by h in the negative direction of the Z-axis) in order to enable a translation of the next AR lane image to be displayed this time and the first AR lane images to be displayed this time from their corresponding initial display positions to the target display positions on the second display surface; subsequently, the last displayed current AR lane image is rotated by a second rotation coordinate (e.g.,Rotation(xa-1, ya-1, za-1)=(0, 0, 0)) is performed along the virtual axis of rotation and in the direction of rotation to allow the rotation of the last displayed current AR lane image from the first display surface to the third display surface; finally, the last displayed second AR lane images are rotated based on a second translation direction (e.g., the direction opposite to that with reference numeral 8 in ). Fig. 6B specified direction) by a second translation coordinate (e.g., translated by h in the positive direction of the Z-axis) to enable a translation of the last displayed second AR lane images from their corresponding initial display positions to the target display positions on the third display surface; wherein the current AR lane image to be displayed this time is a last displayed next AR lane image, the next AR lane image to be displayed this time is one of the last displayed first AR lane images, and the last displayed current AR lane image is one of the second AR lane images to be displayed this time.

[0053] A second specific process for adjusting AR lane images to their corresponding target display positions is as follows: The setting parameters include a virtual rotation axis, a rotation direction, and rotation coordinates. These parameters are based on the center point Q of the AR lane image. As shown in Fig. As shown in 6C, the difference to Fig. 6B in that the reference sign 9 stands for a second display area for displaying a first AR lane image, and the reference sign 10 stands for a third display area for displaying a second AR lane image.

[0054] If the AR lane images are displayed stacked according to the image identification numbers on the second and third display areas (i.e., the display method for the other AR lane images in Fig. 6C), includes setting the current AR lane image, the next AR lane image, and the other AR lane images to their corresponding target display positions based on the setting parameters: that unlike in Fig. 6B indicates that the next AR lane image to be displayed this time is to be translated by a first translation coordinate (e.g. a translation h in the negative Z-axis direction) based on a first translation direction (e.g. the one indicated by the reference sign 8 in Fig. 6B specified direction) is translated to allow the translation of the next AR lane image to be displayed on the second display surface from the corresponding initial display position to the target display position, while the second AR lane images displayed last do not need to be translated.

[0055] The following describes a specific process for displaying the current AR lane image, the next AR lane image, and the other AR lane images at their respective target display positions, in order to enable the display of lane navigation information in the image display component.

[0056] Displaying the current AR lane image, the next AR lane image, and the other AR lane images at their respective target display positions involves: setting a transparency parameter corresponding to the first display area (designated as T1) as a first parameter; setting a transparency parameter corresponding to the second display area (designated as T2) as a second parameter; and setting a transparency parameter corresponding to the third display area (designated as T3) as a third parameter, where the first parameter is greater than the second parameter, and the second parameter is greater than the third parameter.Displaying the current AR lane image on the first display surface based on the first parameter, displaying the next AR lane image on the second display surface based on the second parameter, displaying the first AR lane images on the second display surface based on the third parameter, displaying the second AR lane images on the third display surface based on the third parameter, thereby enabling the display of the current AR lane image, the next AR lane image, and the other AR lane images in the image display component in a 3D perspective effect.

[0057] Optionally, the first parameter T1 can be set to 1 (namely T1=1), meaning the current AR lane image is fully displayed; the second parameter T2 can be set to 0.6 (namely T2=0.6), meaning the next AR lane image is partially displayed; and the third parameter T3 can be set to 0 (namely T3=0), meaning the other AR lane images are not displayed.

[0058] In a practical example, it shows Fig. 7 a schematic representation of a rotation animation for switching from the last displayed AR lane image to the AR lane image to be displayed this time, wherein Fig. 7(a) the last AR lane image shown and Fig. 7(b) shows the AR lane image currently being displayed.

[0059] The navigation path is divided into six road segments, for example, R1, R2, ..., R6. When the vehicle travels along road segment R2, the AR lane image for road segment R2 is currently displayed on the first display area, with the position parameters: Position(x2, y2, z2)=(0, h / 2, 0), Rotation(x2, y2, z2)=(90, 0, 0), T1=1. On the second display area, the AR lane image for road segment R3 is displayed, with the position parameters: Position(x3, y3, z3)=(0, h, h / 2), Rotation(x3, y3, z3)=(0, 0, 0), T2=0.6.

[0060] As soon as the vehicle enters road section R3, the positioning data and map data captured by the map navigation system are calculated and compared, generating an animation trigger signal to initiate the division of the rotation animation into three parts: In the first part of the process, the last displayed AR lane image is faded out from the first display area. Specifically, the AR lane image for road segment R2 is rotated at a constant speed from the first display area to the third display area along a virtual axis of rotation 7 and in a rotation direction 6, and gradually faded out. The position parameter (x2, y2, z2) of the AR lane image for road segment R2 changes from (0, h / 2, 0) to (0, 0, h / 2), the rotation (x2, y2, z2) changes from (90, 0, 0) to (0, 0, 0), and the transparency parameter (T1=1) changes to (T3=0).

[0061] In the second part, the last displayed AR lane image becomes the current AR lane image to be displayed: the AR lane image for road segment R3 is rotated at a constant speed from the second display surface to the first display surface along the virtual rotation axis 7 and in the rotation direction 6. The position parameter (x3, y3, z3) of the AR lane image for road segment R3 changes from (0, h, h / 2) to (0, h / 2, 0), the rotation (x3, y3, z3) changes from (0, 0, 0) to (90, 0, 0), and the transparency parameter (T2=0.6) changes to (T1=1).

[0062] In a third part, the next AR lane image to be displayed gradually appears on the second display area from an invisible state: The AR lane image for road segment R4 is translated at a constant speed along the negative direction of the Z-coordinate axis from a position with reference symbol 31 to the position with reference symbol 2. The position parameter (x4, y4, z4) of the AR lane image for road segment R4 changes from (0, h, 3h / 2) to (0, h, h / 2), the rotation (x4, y4, z4) remains unchanged, and the transparency parameter T2=0 changes to T2=0.6.

[0063] In the image display component of the HUD, the following is displayed at the beginning of the rotation animation: Fig. 7(a) schematic representation of the lane navigation information shown and at the end of the rotation animation the in Fig. 7(b) shows a schematic representation of the lane navigation information.

[0064] Fig. Figure 8 shows a schematic structural representation of a device for displaying lane navigation information according to an embodiment of the present disclosure, which is integrated into a HUD. As in Fig. As shown in section 8, the device can comprise 800: a road segment subdivision module 810, which is designed to capture positioning data and navigation path of a vehicle and to subdivide the navigation path into several road segments, wherein the several road segments comprise a current road segment, a next road segment and other road segments, wherein the other road segments are those of the several road segments except for the current road segment and the next road segment; an image display determination module 820, which is designed to determine, upon detection of the vehicle's entry into the current road segment based on positioning data, a current AR lane image corresponding to the current road segment, a next AR lane image corresponding to the next road segment, and other AR lane images corresponding to the other road segments, wherein the current AR lane image, the next AR lane image, and the other AR lane images are to be displayed in an image display component of the HUD this time; a setting parameter determination module 830, which is intended for setting corresponding setting parameters for the current AR lane image, the next AR lane image and the other AR lane images; a navigation information display module 840, which is intended to set the current AR lane image, the next AR lane image and the other AR lane images to their corresponding target display positions based on the setting parameters and to display the current AR lane image, the next AR lane image and the other AR lane images to their respective target display positions in order to enable the display of lane navigation information in the image display component.

[0065] Furthermore, the navigation information display module 840 described above includes a start image display unit and a destination image display unit, wherein the initial image rendering unit can be used to create a corresponding AR lane image for each of the multiple road segments after dividing the navigation path into multiple road segments, in order to obtain multiple AR lane images; to determine image identifiers that correspond to the multiple AR lane images, wherein the image identifiers uniquely correspond to the road segment identifiers of the multiple road segments; to display each of the AR lane images in the image rendering component based on an initial rendering position and the image identifier that corresponds to each of the AR lane images.

[0066] Furthermore, the initial image display unit described above includes a sub-unit for lane image creation, wherein the lane image creation subunit is used to determine the lane arrow information corresponding to each of the multiple road segments; to determine a target lane of the vehicle in each of the road segments based on the navigation path and the lane arrow information; to generate an AR lane image for each of the road segments based on the lane arrow information and target lanes corresponding to each of the road segments.

[0067] Furthermore, the image display determination module 820 described above can be specifically used to determine a next road segment corresponding to the current road segment based on the road segment identification numbers and thus determine the other road segments; to determine the image identification numbers corresponding to the road segment identification numbers; to determine the current AR lane image, the next AR lane image and the other AR lane images based on the image identification numbers from the multiple AR lane images.

[0068] Furthermore, the lane image generation subunit described above can be specifically used to display lane arrow information for the target lane in a first display mode and lane arrow information for a first other lane in a second display mode, thereby obtaining the AR lane images corresponding to each of the road segments, where the first other lane refers to other lanes in each of the road segments except the target lane.

[0069] Furthermore, the lane image creation subunit described above can also be specifically used to determine, after the vehicle's entry into the current road segment has been detected based on the positioning data, a current lane on which the vehicle is located within the current road segment; to display the lane arrow information for the target lane in the first display mode, lane arrow information for a second other lane in the second display mode, and lane arrow information for the current lane in a third display mode, thereby obtaining a current AR lane image corresponding to the current road segment, where the second other lane refers to other lanes in the current road segment, excluding the target lane and the current lane.

[0070] Optionally, the other road segments include a first untraveled road segment and a second already traveled road segment; the other AR lane images include a first AR lane image corresponding to the first road segment and a second AR lane image corresponding to the second road segment; the target display position includes a first, a second, and a third display area; the first display area is perpendicular to the second and third display areas, and the second display area is parallel to the third display area; the upper boundary of the first display area and the lower boundary of the second display area coincide, as do the lower boundary of the first display area and the upper boundary of the third display area.

[0071] Optionally, the first display area serves to show the current AR lane image to be displayed this time, the second display area serves to show the next AR lane image to be displayed this time and the first AR lane images to be displayed this time, and the third display area serves to show the second AR lane images to be displayed this time; on the second display area, the next AR lane image and the first AR lane images are stacked or stretched one after the other according to the image identification numbers; on the third display area, the second AR lane images are stacked or stretched one after the other according to the image identification numbers.

[0072] Furthermore, the target image display unit described above can be used to define a transparency parameter corresponding to the first display area as a first parameter, a transparency parameter corresponding to the second display area as a second parameter, and a transparency parameter corresponding to the third display area as a third parameter, where the first parameter is greater than the second parameter and the second parameter is greater than the third parameter;The first display area shows the current AR lane image based on the first parameter, the second display area shows the next AR lane image based on the second parameter, and the third display area shows the other AR lane images based on the third parameter, thus enabling the display of the current AR lane image, the next AR lane image, and the other AR lane images in the image display component in a 3D perspective effect.

[0073] Optionally, the setting parameters include at least one virtual rotation axis, one rotation direction, one rotation coordinate, one translation direction, and one translation coordinate.

[0074] Furthermore, the target image display unit can also be used, when AR lane images are displayed on the second and third display surfaces, to rotate the current AR lane image to be displayed this time by a first rotation coordinate along the virtual axis of rotation and in the direction of rotation, based on the image identification numbers, in order to enable a rotation of the current AR lane image to be displayed this time from the second display surface to the first display surface;based on a first translation direction, to translate the next AR lane image and the first AR lane images to be displayed this time by a first translation coordinate in order to enable a translational shift of the next AR lane image and the first AR lane images to be displayed this time from their corresponding initial display positions to the target display positions on the second display surface; to rotate the last displayed current AR lane image by a second rotation coordinate along the virtual rotation axis and in the direction of rotation in order to enable a rotation of the last displayed current AR lane image from the first display surface to the third display surface;based on a second translation direction, to translate the last displayed second AR lane images by a second translation coordinate in order to enable a translational shift of the last displayed second AR lane images from their corresponding initial display positions to the target display positions on the third display surface; wherein the current AR lane image to be displayed this time is a last displayed next AR lane image, the next AR lane image to be displayed this time is one of the last displayed first AR lane images, and the last displayed current AR lane image is one of the second AR lane images to be displayed this time.

[0075] The device for displaying lane navigation information provided in this embodiment can be applied to the method for displaying lane navigation information according to any of the embodiments described above and has corresponding functions and advantageous effects.

[0076] Fig. Figure 9 shows a block diagram of an electronic device for implementing a method for displaying lane navigation information according to an embodiment of the present disclosure. The electronic device 90 is intended to represent various forms of digital computers, such as laptops, desktop computers, workstations, PDAs, servers, blade servers, mainframes, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smartphones, wearable devices (such as helmets, glasses, watches, and the like), and other similar computing devices. The components, connections, relationships, and functions shown herein are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0077] As in Fig.As shown in Figure 9, the electronic device 90 comprises at least one processor 91 and a memory communicatively connected to the at least one processor 91, for example, a read-only memory (ROM) 92, a random-access memory (RAM) 93, or the like, wherein the memory stores a computer program that is executable by the at least one processor, and wherein the processor 91 can perform various suitable actions and processing depending on the computer program stored in the read-only memory (ROM) 92 or loaded from the memory unit 98 into the random-access memory (RAM) 93. Various programs and data required for the operation of the electronic device 90 can also be stored in the RAM 93. The processor 91, the ROM 92, and the RAM 93 are interconnected via a bus 94. An input / output interface (I / O interface) 95 is also connected to the bus 94.

[0078] Several components in the electronic device 90 are connected to the I / O interface 95, including: an input unit 96, for example, a keyboard, a mouse, or the like; an output unit 97, for example, various types of displays and speakers, or the like; a storage unit 98, for example, a magnetic disk, an optical disk, or the like; and a communication unit 91, for example, a network card, a modem, a wireless communication transceiver, or the like. The communication unit 91 allows the electronic device 90 to exchange information / data with other devices via computer networks such as the Internet and / or various telecommunications networks.

[0079] Processor 91 can be any general-purpose and / or dedicated processing component with processing and computing capabilities. Some examples of Processor 91 include, but are not limited to: a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning algorithms, a digital signal processor (DSP), and other suitable processors, controllers, microcontrollers, or the like. Processor 91 performs the various procedures and processing operations described above, such as the procedure for displaying lane navigation information.

[0080] In some embodiments, the method for displaying lane navigation information can be implemented as a computer program physically contained in a computer-readable storage medium, such as the memory unit 98. In some embodiments, the computer program can be loaded and / or installed, in whole or in part, onto the electronic device 90 via the ROM 92 and / or the communication unit 91. When the computer program is loaded into the RAM 93 and executed by the processor 91, one or more steps of the lane navigation information display method described above can be performed. Alternatively, in other embodiments, the processor 91 can be configured in any other suitable way (e.g., by means of firmware) to perform the lane navigation information display method.

[0081] Various embodiments of the systems and techniques described herein may be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-chips (SOCs), load-programmable logic devices (CPLDs), computer hardware, firmware, software and / or combinations thereof.These various embodiments may involve being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system with at least one programmable processor, wherein the programmable processor may be a dedicated or general programmable processor, and receiving data and instructions from a storage system, at least one input device and at least one output device, and transmitting data and instructions to the storage system, which may have at least one input device and at least one output device.

[0082] The computer program for executing the methods of this disclosure can be programmed using any combination of one or more programming languages. The computer program can be provided to a processor of a general-purpose computer, a specialized computer, or another programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are performed. The computer program can be executed entirely on one machine, partially on the machine, as a standalone software package partly on the machine and partly on a remote machine, or entirely on the remote machine or a server.

[0083] In the context of this disclosure, a computer-readable storage medium can be a physical medium capable of containing or storing a computer program that is available to, or used in combination with, a system, device, or apparatus for executing instructions. The computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or apparatus, or any suitable combination thereof. Alternatively, the computer-readable storage medium may be a machine-readable signaling medium.More specific examples of computer-readable storage media may include: an electrical connection based on one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0084] To provide user interaction, the systems and techniques described here can be implemented on an electronic device that includes: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for presenting information to users; and a keyboard and pointing device (e.g., a mouse or trackball) through which a user can provide input to the electronic device. Other types of devices can also be used to provide user interaction; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual, auditory, or tactile feedback); and input from users can be received in any form (including auditory, verbal, or tactile input).

[0085] The systems and techniques described here can be implemented in a computing system with backend components (e.g., a data server), a computing system with middleware components (e.g., an application server), or a computing system with frontend components (e.g., a user computer with a graphical user interface or a web browser, allowing the user to interact with the implementations of the systems and techniques described here via the graphical user interface or web browser), or a computing system with any combination of such backend, middleware, or frontend components. The system components can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the internet.

[0086] A computing system can comprise clients and servers. Clients and servers are typically located remotely and usually interact via a communication network. A client-server relationship arises from the computer programs running on the respective computers that exhibit this client-server relationship. A server can be a cloud server, also known as a cloud computing server or cloud host, and is part of the host product in a cloud computing service system. This eliminates the disadvantages of high management complexity and poor business scalability associated with traditional physical hosts and VPS services.

[0087] It should be noted that the above content merely represents preferred embodiments of the present disclosure and the technical principles employed. It is understood by those skilled in the field that the present disclosure is not limited to the specific embodiments described herein. Those skilled in the field may make various obvious modifications, rearrangements, and substitutions without altering the scope of protection afforded by the present disclosure. For example, those skilled in the field may use the processes described above in different forms, rearrange, add, or omit steps, and may perform the steps described in the present disclosure in parallel, sequentially, or in any other order, as long as the desired results of the technical solutions of the present disclosure can be achieved, which is not limited herein.

[0088] The above specific embodiments do not constitute a limitation of the scope of protection afforded by this disclosure. It is understood by those skilled in the art that, according to the design requirements and other factors, various modifications, combinations, partial combinations, and substitutions may be made. Any modification, equivalent substitution, improvement, or the like, made in the spirit and under the principles of this disclosure, shall be included within the scope of protection afforded by this disclosure. QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] CH 202310753202.2

[0001]

Claims

[1] Methods for displaying lane navigation information, characterized by The method will be used in a head-up display (HUD) system, and the method comprises: Capturing positioning data and navigation path of a vehicle, and dividing the navigation path into multiple road segments, wherein the multiple road segments comprise a current road segment, a next road segment and other road segments, the other road segments being those of the multiple road segments except for the current road segment and the next road segment; Determine, upon detecting the vehicle's entry into the current road segment based on positioning data, a current AR lane image corresponding to the current road segment, a next AR lane image corresponding to the next road segment, and other AR lane images corresponding to the other road segments, wherein the current AR lane image, the next AR lane image, and the other AR lane images are to be displayed in an image display component of the HUD this time; Setting appropriate parameters for the current AR lane image, the next AR lane image, and the other AR lane images; Setting the current AR lane image, the next AR lane image, and the other AR lane images to their corresponding target display positions based on the setting parameters, and displaying the current AR lane image, the next AR lane image, and the other AR lane images at the target display positions to enable the display of lane navigation information in the image display component. [2] Method for displaying lane navigation information according to claim 1, characterized by , that after dividing the navigation path into several road sections, the procedure further includes: Creating a corresponding AR lane image for each of the multiple road segments in order to obtain multiple AR lane images; Determining image identification numbers that correspond to the multiple AR lane images, wherein the image identification numbers uniquely correspond to the road segment identification numbers of the multiple road segments; Display each of the AR lane images in the image display component based on an initial display position and the image ID number that corresponds to each of the AR lane images. [3] Method for displaying lane navigation information according to claim 2, characterized by , that includes creating a corresponding AR lane image for each of the several road segments: Determining the lane arrow information corresponding to each of the several road segments; Determining a target lane for the vehicle in each of the road segments based on the navigation path and lane arrow information; Generating an AR lane image for each of the road segments based on the lane arrow information and destination lanes corresponding to each of the road segments. [4] Method for displaying lane navigation information according to claim 2, characterized by , that determining a current AR lane image corresponding to the current road segment, a next AR lane image corresponding to the next road segment, and other AR lane images corresponding to the other road segments, wherein the current AR lane image, the next AR lane image, and the other AR lane images are to be displayed in an image display component of the HUD this time, includes: Determining the next road segment that corresponds to the current road segment, based on the road segment identification numbers, and thus determining the other road segments; Determining the image identification numbers corresponding to the road section identification numbers; Determining the current AR lane image, the next AR lane image, and the other AR lane images based on the image identification numbers from the multiple AR lane images. [5] Method for displaying lane navigation information according to claim 3, characterized by , that generating an AR lane image for each of the road segments based on the lane arrow information and target lanes corresponding to each of the road segments includes: Displaying lane arrow information for the target lane in a first display mode, and displaying lane arrow information for a first other lane in a second display mode, thereby obtaining the AR lane images corresponding to each of the road segments; where the first other lane refers to other lanes in each of the road sections except the destination lane. [6] Method for displaying lane navigation information according to claim 5, characterized by , that after determining the vehicle's entry into the current road segment based on the positioning data, the procedure further includes: Determining the current lane in which the vehicle is located in the current road segment, based on the positioning data; Displaying lane arrow information for the target lane in the first display mode, displaying lane arrow information for a second other lane in the second display mode, and displaying lane arrow information for the current lane in a third display mode, thereby obtaining an up-to-date AR lane image that corresponds to the current road segment; where the second other lane refers to other lanes in the current road section, with the exception of the destination lane and the current lane. [7] Method for displaying lane navigation information according to claim 2, characterized bythat the other road segments comprise a first untraveled road segment and a second already traveled road segment; the other AR lane images comprise a first AR lane image corresponding to the first road segment and a second AR lane image corresponding to the second road segment; the target display position comprises a first, a second, and a third display area; the first display area is perpendicular to the second and third display areas, and the second display area is parallel to the third display area; the upper boundary of the first display area and the lower boundary of the second display area coincide, and the lower boundary of the first display area and the upper boundary of the third display area coincide. [8] Method for displaying lane navigation information according to claim 7, characterized by, that the first display area serves to display the current AR lane image to be displayed this time, the second display area serves to display the next AR lane image to be displayed this time and the first AR lane images to be displayed this time, and the third display area serves to display the second AR lane images to be displayed this time; on the second display area, the next AR lane image and the first AR lane images are stacked or stretched one after the other according to the image identification numbers; on the third display area, the second AR lane images are stacked or stretched one after the other according to the image identification numbers. [9] Method for displaying lane navigation information according to claim 7, characterized by, that the display of the current AR lane image, the next AR lane image and the other AR lane images includes at the target display positions: Setting a transparency parameter corresponding to the first display area as a first parameter, setting a transparency parameter corresponding to the second display area as a second parameter, and setting a transparency parameter corresponding to the third display area as a third parameter, where the first parameter is greater than the second parameter, and the second parameter is greater than the third parameter; Displaying the current AR lane image on the first display surface based on the first parameter, displaying the next AR lane image on the second display surface based on the second parameter, displaying the first AR lane image on the second display surface based on the third parameter, and displaying the second AR lane image on the third display surface based on the third parameter, thereby enabling the display of the current AR lane image, the next AR lane image, and the other AR lane images in the image display component in 3D perspective effect. [10] Method for displaying lane navigation information according to claim 8, characterized by, that the setting parameters include at least one of a virtual rotation axis, a rotation direction, a rotation coordinate, a translation direction and a translation coordinate; when displaying AR lane images on the second and third display surfaces, the setting of the current AR lane image, the next AR lane image and the other AR lane images to their corresponding target display positions based on the setting parameters, using the image identification numbers: Rotating the current AR lane image to be displayed this time around a first rotation coordinate along the virtual axis of rotation and in the direction of rotation, in order to enable a rotation of the current AR lane image to be displayed this time from the second display surface to the first display surface; Shifting the next AR lane image and the first AR lane images to be displayed this time by a first translation coordinate translationally based on a first translation direction, in order to enable a translational shift of the next AR lane image and the first AR lane images to be displayed this time from their corresponding initial display positions to the target display positions on the second display surface; Rotating the last displayed current AR lane image around a second rotation coordinate along the virtual rotation axis and in the direction of rotation to enable a rotation of the last displayed current AR lane image from the first display surface to the third display surface; Shifting the last displayed second AR lane images by a second translation coordinate based on a second translation direction, in order to enable a translational shift of the last displayed second AR lane images from their corresponding initial display positions to the target display positions on the third display surface; where the current AR lane image to be displayed this time is a last displayed next AR lane image, the next AR lane image to be displayed this time is one of the last displayed first AR lane images, and the current AR lane image to be displayed this time is one of the second AR lane images to be displayed this time. [11] Device for displaying lane navigation information, characterized by that the device is integrated into a head-up display (HUD) system, the device comprising: a road segment subdivision module designed to capture positioning data and navigation path of a vehicle and to subdivide the navigation path into multiple road segments, wherein the multiple road segments comprise a current road segment, a next road segment and other road segments, the other road segments being those of the multiple road segments except for the current road segment and the next road segment; an image display determination module designed to determine, upon detection of the vehicle's entry into the current road segment based on positioning data, a current AR lane image corresponding to the current road segment, a next AR lane image corresponding to the next road segment, and other AR lane images corresponding to the other road segments, wherein the current AR lane image, the next AR lane image, and the other AR lane images are to be displayed in an image display component of the HUD this time; a parameter setting module, which is intended for setting appropriate parameters for the current AR lane image, the next AR lane image and the other AR lane images; a navigation information display module designed to set the current AR lane image, the next AR lane image and the other AR lane images to their corresponding target display positions based on the setting parameters and to display the current AR lane image, the next AR lane image and the other AR lane images to their respective target display positions in order to enable the display of lane navigation information in the image display component. [12] Electronic device, characterized by , that the electronic device includes: at least one processor; and a memory that is communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, which is executed by the at least one processor, so that the at least one processor can perform the method for displaying lane navigation information according to any one of claims 1 to 10. [13] Computer-readable storage medium, characterized by , that computer instructions are stored on the computer-readable storage medium which, when executed by a processor, cause it to perform the method for displaying lane navigation information according to one of claims 1 to 10. [14] Head-up display (HUD) system, characterized by , that the HUD system comprises: an image generator, an imaging optics component, an image display component and a processor; wherein the image generator is configured to generate a digital image signal and convert it into light beams containing image information; the imaging optics component is configured to reflect light rays with image information and project them onto the image display component; the image display component is configured to form a visually observable virtual image based on the light rays projected by the imaging optics component; the processor is configured to perform the method for displaying lane navigation information according to any one of claims 1 to 10.

Images