Information display method, information display device and system, equipment and medium

Abstract

The invention provides an information display method, an information display device and system, equipment and a medium, and belongs to the technical field of display. The method comprises the following steps: determining a maneuvering point of a vehicle on a driving route; in response to the maneuvering point meeting a preset display condition, determining a target display position corresponding to the maneuvering point in a field angle range according to the distance between the carrier and the maneuvering point, the transverse field angle of the carrier and the coordinates of the maneuvering point; and displaying a user interface element of the maneuvering point in the head-up display picture based on the target display position. According to the embodiment of the invention, the user interface element of the maneuvering point can be ensured to be displayed in the field angle range, and meanwhile, the accuracy of the display position is considered.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to an information display method, an information display device, a head-up display system, an electronic device, and a computer-readable storage medium. Background Technology

[0002] Head-up displays (HUDs) can project driving-related information such as speed and navigation onto a display device to form an image, allowing drivers to see the relevant information without turning or looking down, thus assisting them to drive more efficiently and safely.

[0003] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. Applying AR technology to the field of head-up displays can result in Augmented Reality Head-up Display (AR-HUD) systems. AR-HUDs can overlay virtual information onto the real driving environment, providing users with a richer and more intuitive way of displaying information. Summary of the Invention

[0004] This application provides an information display method, an information display device, a head-up display system, an electronic device, and a computer-readable storage medium.

[0005] In a first aspect, this application provides an information display method, which includes: determining a maneuver point of a vehicle on a driving route; in response to the maneuver point meeting preset display conditions, determining a target display position of the maneuver point within the field of view based on the distance between the vehicle and the maneuver point, the lateral field of view of the vehicle and the coordinates of the maneuver point; and displaying the user interface elements of the maneuver point in a head-up display screen based on the target display position.

[0006] Secondly, this application provides an information display device, which includes: a determining module for determining a maneuvering point of a vehicle on a driving route; a processing module for determining a target display position of the maneuvering point within the field of view based on the distance between the vehicle and the maneuvering point, the lateral field of view of the vehicle, and the coordinates of the maneuvering point, in response to the maneuvering point meeting preset display conditions; and a display module for displaying user interface elements of the maneuvering point in a head-up display screen based on the target display position.

[0007] Thirdly, this application provides a head-up display system, which includes: an information display device;

[0008] The information display device is used to implement the information display method as described in any one of the embodiments of this application.

[0009] Thirdly, this application provides an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores one or more computer programs executable by the at least one processor, and the one or more computer programs are executed by the at least one processor to enable the at least one processor to perform the above-described information display method.

[0010] Fourthly, this application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor / processor core, implements the above-described information display method.

[0011] The embodiments provided in this application consider the limited field of view coverage of the vehicle's head-up display (HUD). If the user interface elements of a maneuvering point are displayed using its actual coordinates within the field of view, the maneuvering point may be outside the field of view in some cases, causing the corresponding user interface elements to be outside the HUD screen and thus unable to be displayed correctly. Therefore, in this embodiment, the maneuvering point on the vehicle's driving route is determined. In response to the maneuvering point meeting preset display conditions, the target display position of the maneuvering point within the field of view is determined based on the distance between the vehicle and the maneuvering point, the vehicle's lateral field of view, and the coordinates of the maneuvering point. This allows for a certain restriction on the target display position of the maneuvering point based on the field of view, ensuring normal display. Based on this target display position, the user interface elements of the maneuvering point are displayed in the HUD screen, ensuring that the user interface elements remain within the HUD screen for user viewing. This solves the problem that the maneuvering point is outside the field of view coverage and therefore cannot display the corresponding user interface elements in the HUD screen. Furthermore, the determination of the target display position references the actual coordinates of the maneuvering point, thus ensuring the accuracy of the target display position.

[0012] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0013] The accompanying drawings are provided to further illustrate the present application and form part of the specification. They are used together with the embodiments of the present application to explain the application and do not constitute a limitation thereof. The above and other features and advantages will become more apparent to those skilled in the art from the detailed example embodiments described with reference to the accompanying drawings, in which:

[0014] Figure 1 A flowchart illustrating an information display method provided in an embodiment of this application.

[0015] Figure 2 This is a schematic diagram of a field of view provided in an embodiment of this application.

[0016] Figure 3 This is a schematic diagram showing a maneuvering point provided in an embodiment of this application.

[0017] Figure 4 This is a schematic diagram illustrating the preset distance range provided in the embodiments of this application.

[0018] Figure 5 This is a schematic diagram of an information display method provided in an embodiment of this application.

[0019] Figure 6 This is a schematic diagram of an information display method provided in an embodiment of this application.

[0020] Figure 7 This is a schematic diagram of a head-up display screen provided in an embodiment of this application.

[0021] Figure 8 This is a schematic diagram of an information display method provided in an embodiment of this application.

[0022] Figure 9 This is a schematic diagram of a head-up display screen provided in an embodiment of this application.

[0023] Figure 10 This is a schematic diagram of an information display method provided in an embodiment of this application.

[0024] Figure 11 This is a schematic diagram of an information display method provided in an embodiment of this application.

[0025] Figure 12 This is a schematic diagram of a head-up display screen provided in an embodiment of this application.

[0026] Figure 13 This is a block diagram of an information display device provided in an embodiment of this application.

[0027] Figure 14 This is a block diagram of a head-up display system provided in an embodiment of this application.

[0028] Figure 15 This is a block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0029] To enable those skilled in the art to better understand the technical solutions of this application, exemplary embodiments of this application are described below in conjunction with the accompanying drawings, including various details of the embodiments of this application to aid understanding. These should be considered merely exemplary. Therefore, those skilled in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this application. Similarly, for clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0030] Where there is no conflict, the various embodiments of this application and the features thereof may be combined with each other.

[0031] As used herein, the term “and / or” includes any and all combinations of one or more related enumerated entries.

[0032] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the application. As used herein, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that when the terms “comprising” and / or “made of” are used in this specification, the presence of the stated feature, integral, step, operation, element, and / or component is specified, but the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof is not excluded. Terms such as “connected” or “linked” are not limited to physical or mechanical connections but can include electrical connections, whether direct or indirect.

[0033] Unless otherwise specified, all terms used herein (including technical and scientific terms) have the same meaning as commonly understood by one of ordinary skill in the art. It will also be understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and this application, and will not be interpreted as having an idealized or overly formal meaning, unless expressly so defined herein.

[0034] In related technologies, the display position of the user interface elements (including but not limited to display icons) corresponding to a maneuver point in the head-up display (HUD) is usually determined based on the actual location of the maneuver point. For example, in AR-HUD, the display position of the maneuver point is determined based on its actual coordinates, so that the display icon of the maneuver point in the HUD is superimposed on the location of the maneuver point in the real environment, thereby generating a head-up display with augmented reality effects.

[0035] However, the field of view of head-up display devices is limited by factors such as hardware size and installation location, and cannot be made to an ideal size. It is usually a fixed value. Therefore, after determining the display position of its display icon (i.e., the user interface element of the maneuver point) based on the actual coordinates of the maneuver point, the display position may be outside the field of view, thus preventing the user from seeing the display icon.

[0036] In view of the above, embodiments of this application provide an information display method, an information display device, a head-up display system, an electronic device, and a computer-readable storage medium.

[0037] According to the information display method of this application embodiment, the target display position of the maneuvering point can be restricted to a certain extent based on the field of view, so as to ensure that the user interface elements corresponding to the maneuvering point can be kept in the head-up display screen for the user to view. This solves the problem that the maneuvering point is outside the field of view and therefore cannot be displayed in the head-up display screen. Moreover, the determination of the target display position is based on the real coordinates of the maneuvering point, so the accuracy of the target display position can be taken into account, and accurate driving instructions or auxiliary functions can be achieved.

[0038] The display adjustment method according to the embodiments of this application can be executed by electronic devices such as the control device (e.g., control chip) in the HUD or the control system (e.g., vehicle control system) in the vehicle. The method can be implemented by a processor calling computer-readable program instructions stored in the memory. The embodiments of this application do not limit this.

[0039] In a first aspect, embodiments of this application provide an information display method.

[0040] Figure 1 A flowchart illustrating an information display method provided in an embodiment of this application. (Refer to...) Figure 1 The information display method may include the following steps.

[0041] In step S11, the maneuvering point of the vehicle on the travel route is determined.

[0042] In step S12, in response to the maneuver point meeting the preset display conditions, the target display position corresponding to the maneuver point within the field of view is determined based on the distance between the vehicle and the maneuver point, the lateral field of view of the vehicle, and the coordinates of the maneuver point.

[0043] In step S13, user interface elements of the maneuver point are displayed in the head-up display screen based on the target display position.

[0044] Therefore, it can be seen that the embodiments of this application, in determining the target display position of the maneuver point, not only rely on the coordinates of the maneuver point itself, but also combine the distance between the vehicle and the maneuver point and the lateral field of view of the vehicle. The coordinates of the maneuver point provide an important reference for determining the target display position, ensuring a certain degree of accuracy and avoiding the determination of an incorrect or unreasonable target display position. The distance between the vehicle and the maneuver point, as well as the lateral field of view of the vehicle, can, to a certain extent, make appropriate adjustments to the display position of the maneuver point to obtain the target display position, and ensure that the target display position is within the field of view as much as possible. This allows the user to view the user interface elements of the maneuver point through the head-up display, providing the user with a safe and convenient assisted driving environment.

[0045] The embodiments provided in this application consider the limited field of view coverage of the vehicle's head-up display (HUD). If the user interface elements of a maneuvering point are displayed using its actual coordinates within the field of view, the maneuvering point may be outside the field of view in some cases, causing the corresponding user interface elements to be outside the HUD screen and thus unable to be displayed correctly. Therefore, in this embodiment, the maneuvering point on the vehicle's driving route is determined. In response to the maneuvering point meeting preset display conditions, the target display position of the maneuvering point within the field of view is determined based on the distance between the vehicle and the maneuvering point, the vehicle's lateral field of view, and the coordinates of the maneuvering point. This allows for a certain restriction on the target display position of the maneuvering point based on the field of view, ensuring normal display. Based on this target display position, the user interface elements of the maneuvering point are displayed in the HUD screen, ensuring that the user interface elements remain within the HUD screen for user viewing. This solves the problem that the maneuvering point is outside the field of view coverage and therefore cannot display the corresponding user interface elements in the HUD screen. Furthermore, the determination of the target display position references the actual coordinates of the maneuvering point, thus ensuring the accuracy of the target display position.

[0046] The information display method of this application embodiment will be described in detail below.

[0047] In some alternative implementations, the vehicle includes a means of transport capable of carrying freight or passengers, which may be a vehicle, a ship, or other means, and the embodiments of this application do not limit this.

[0048] In some alternative implementations, maneuver points include action points used for functions such as vehicle navigation and driving instructions.

[0049] For example, a maneuvering point can refer to the intersection of two or more roads, where a vehicle can change its route as needed and perform driving operations such as lane changing, U-turns, and turns.

[0050] For example, maneuver points may include intersections, turning points, highway entrances and exits, and main and auxiliary road switching points on the vehicle's route.

[0051] In some alternative implementations, a maneuver point can be generated or determined based on the positioning information collected by the vehicle's Global Positioning System (GPS) to guide the vehicle to the next driving position. Alternatively, the location of the maneuver point can be obtained from services such as navigation applications and map applications.

[0052] It should be noted that the above examples of maneuvering points are merely illustrative and are not intended to limit the scope of this application.

[0053] In some alternative implementations, the vehicle's route may include multiple maneuver points. To improve display efficiency and accuracy, the user interface elements of a maneuver point will only be displayed in the head-up display if the maneuver point meets the preset display conditions.

[0054] The head-up display (HUD) is a virtual image seen by the user (e.g., the image displayed by the HUD as seen by the driver through the vehicle's windshield). For example, optical components in the HUD can reflect light carrying user interface elements such as vehicle speed, navigation, warnings, and maneuver points onto the windshield. This reflected light then enters the driver's eye, forming a magnified, upright virtual image in front of the driver's line of sight. The image representing vehicle speed, navigation, and warning information, in the form of images or characters, constitutes the user interface (UI), which is the system interface set up by the vehicle's HUD to meet information interaction needs. User interface elements are the display elements within the user interface. The user interface clearly defines which information is displayed in what form and with what effects.

[0055] It should be noted that, in addition to displaying user interface elements for maneuver points, the user interface can also display corresponding user interface elements such as instrument information and voice assistant information. This application embodiment does not impose any restrictions on this.

[0056] In some optional implementations, the display condition may include: the distance between the maneuver point and the vehicle is less than or equal to a preset threshold. That is, when the vehicle is close to the maneuver point, in order to promptly display relevant information about the maneuver point to assist the user in driving safely and accurately, the user interface elements of the maneuver point can be displayed on the head-up display.

[0057] For example, a maneuver point is an intersection where a vehicle needs to turn right ahead. When the distance between the vehicle and the intersection is less than or equal to 200 meters, the intersection is determined to meet the display conditions. The user interface elements of the intersection can be displayed on the head-up display screen to instruct the user to perform driving operations such as changing lanes in a timely manner to safely and smoothly turn right into the intersection.

[0058] It should be noted that different display conditions can be set for different types and functions of mobile points, and this application embodiment does not impose any restrictions on this.

[0059] For example, maneuver points include a first type of maneuver point and a second type of maneuver point. Accordingly, for a first type of maneuver point, when the distance between the vehicle and the first type of maneuver point is less than or equal to a first preset threshold, the first type of maneuver point is determined to meet the display conditions. For a second type of maneuver point, when the distance between the vehicle and the second type of maneuver point is less than or equal to a second preset threshold, the second type of maneuver point is determined to meet the display conditions. The first preset threshold is not equal to the second preset threshold.

[0060] In some alternative implementations, the target display position corresponding to the maneuver point within the field of view must first be determined before the corresponding user interface element can be displayed in the head-up display (HUD) based on that target display position. Furthermore, in some examples, this user interface element can be overlaid on the target display position using augmented reality.

[0061] The field of view (FOV) is the angle between the two edges of the field of view visible to the human eye through an optical imaging system and the line connecting the center of the pupil. For head-up displays (HUDs), the FOV can be understood as the angle from the center of the eyebox of the HUD to the horizontal and vertical edges of the virtual image. The eyebox represents the movable area of ​​the driver's eyes. Optical components in the HUD reflect image light carrying user interface elements such as vehicle speed, navigation, warnings, and maneuver points onto the windshield. This reflected light enters the driver's eye, forming an upright, magnified virtual image in front of the driver's line of sight. The HUD display is the image seen by the driver, formed from this virtual image.

[0062] Furthermore, since the field of view of a head-up display device is usually a limited angle range, if the display position of some maneuvering points is outside the field of view, the user will not be able to see the user interface elements of those maneuvering points in the head-up display screen.

[0063] Figure 2 This is a schematic diagram illustrating a field of view according to an embodiment of this application. (Refer to...) Figure 2Starting from the center point O of the eyebox area, the corresponding field of view is formed to the horizontal and vertical edges of the virtual image ABCD. For example... Figure 2 As shown, the field of view can include the lateral field of view (hfov) and the longitudinal field of view (vfov). Furthermore, since the field of view affects the distance in front of the vehicle and the lane range that the head-up display system can cover, it is a crucial parameter of the head-up display system. Typically, once the head-up display device on a vehicle is installed and configured, the field of view is a fixed angle, making it difficult to adjust.

[0064] like Figure 2 As shown, if the maneuvering point is within the field of view, the user can see the corresponding user interface element in the head-up display and perform corresponding driving operations based on the user interface element; if the maneuvering point is outside the field of view, the user cannot see the user interface element of the maneuvering point in the head-up display, and therefore cannot refer to the user interface element to perform corresponding driving operations.

[0065] In this embodiment, considering the limited field of view, if the actual position of the maneuvering point is directly located and displayed using its true coordinates, the maneuvering point may be outside the field of view and cannot be displayed in the head-up display. Therefore, when determining the target display position of the maneuvering point with respect to the field of view, in addition to referring to the true coordinates of the maneuvering point, the distance between the vehicle and the maneuvering point and the lateral field of view of the vehicle are also further referenced. In this way, it is ensured as much as possible that the target display position of the maneuvering point is within the field of view. Here, the true coordinates refer to the actual coordinates of the maneuvering point in the real environment.

[0066] Figure 3 This is a schematic diagram showing a maneuvering point according to an embodiment of this application. (Refer to...) Figure 3 The vehicle's field of view is fov, which corresponds to the virtual image ABCD. For maneuver point p1, its actual position is clearly outside the field of view. Therefore, based on the display method of the relevant technology, maneuver point p1 cannot be displayed within the field of view, and the user cannot see the user interface elements of maneuver point p1 in the head-up display. For maneuver point p2, its actual position is within the field of view. Therefore, the user interface elements of maneuver point p2 can be seen in the head-up display, corresponding to position p2' in the virtual image ABCD.

[0067] In summary, to ensure that maneuver points can be displayed correctly, their actual coordinates cannot be used to determine their target display position directly. Instead, the target display position of the maneuver point within the field of view is determined by combining the distance between the vehicle and the maneuver point, the vehicle's lateral field of view, and the coordinates of the maneuver point.

[0068] In other words, the target display position of the maneuvering point determined in this embodiment is within the field of view and therefore can be seen by the user. Moreover, the determination of this target display position is related to the size of the vehicle's lateral field of view. The lateral field of view can be used to limit the target display position to a certain extent to ensure that it is within the field of view.

[0069] In some optional implementations, to determine the target display position of the maneuver point more reasonably and conveniently, appropriate methods can be selected to determine the target display position depending on the distance between the vehicle and the maneuver point.

[0070] For example, when the distance between the vehicle and the maneuver point is within a first preset distance range, one method is used to determine the target display position of the maneuver point; when the distance between the vehicle and the maneuver point is within a second preset distance range, another method is used to determine the target display position of the maneuver point. Specifically, the distance between the vehicle and the maneuver point within the first preset distance range is greater than or equal to the distance between the vehicle and the maneuver point within the second preset distance range.

[0071] Figure 4 This is a schematic diagram illustrating a preset distance range provided in an embodiment of this application. (Refer to...) Figure 4 a, b, and c respectively illustrate three cases regarding the preset distance range.

[0072] As shown in Figure a, if the distance between the vehicle and the maneuvering point is less than or equal to the first preset distance threshold T11 and greater than the second preset distance threshold T21, it corresponds to the first preset distance range, where T11 > T21; if the distance between the vehicle and the maneuvering point is less than or equal to the second preset distance threshold T21 and greater than or equal to zero, it corresponds to the second preset distance range. The critical position indicates the boundary between the first preset distance range and the second preset distance range.

[0073] As shown in b, if the distance between the vehicle and the maneuver point is less than or equal to the first preset distance threshold T12 and greater than the second preset distance threshold T22, then the first preset distance range is T12 > T22; if the distance between the vehicle and the maneuver point is less than or equal to the second preset distance threshold T22 (the vehicle has not yet reached the maneuver point), or the distance between the maneuver point and the vehicle is less than or equal to the third preset distance threshold T31 (the vehicle has left the maneuver point), then the second preset distance range is T22 and T31 can have the same or different values.

[0074] As shown in c, if the distance between the vehicle and the maneuver point is less than or equal to the first preset distance threshold T13 and greater than the second preset distance threshold T23, the corresponding first preset distance range is T13 > T23; if the distance between the vehicle and the maneuver point is less than or equal to the second preset distance threshold T23 and greater than or equal to the third preset distance threshold T32, the corresponding second preset distance range is T23 > T32.

[0075] In some optional implementations, the first preset distance range and the second preset distance range can be determined based on route driving rules, experience, statistical data, etc., and the embodiments of this application do not limit this.

[0076] For example, when the maneuver point is an intersection, a first preset distance range and a second preset distance range can be divided based on the type of guide lines near the intersection.

[0077] For example, when driving towards a point of movement (such as an intersection), when the distance to the point of movement (such as an intersection) is 200 meters, it is determined that it has entered the first preset distance range, the intersection is determined as the end point of the second preset distance range, and the intersection of the solid and dashed lines of the road traffic signs near the intersection is determined as the critical position between the first preset distance range and the second preset distance range, or the position 50 meters away from the intersection is determined as the critical position, etc.

[0078] In summary, when the vehicle is close to the maneuver point and the display conditions are met, one method can be used to determine the target display position of the maneuver point. As the vehicle continues to travel, when the vehicle is closer to the maneuver point (including scenarios where the vehicle has not yet reached the maneuver point or has left the maneuver point), another method can be used to determine the target display position of the maneuver point.

[0079] In some optional implementations, when the distance between the vehicle and the maneuvering point is within a first preset distance range, the lateral field of view can be used to limit the display position of the maneuvering point in the width direction of the vehicle, ensuring that the display position of the maneuvering point is within the field of view within the first preset distance range. When the vehicle travels to the critical position between the first preset distance range and the second preset distance range, the critical coordinates of the maneuvering point corresponding to that critical position within the field of view range can be determined; when the distance between the vehicle and the maneuvering point is within the second preset distance range, the target display position of the maneuvering point can be determined by locking the critical coordinates or locking the display position based on the critical coordinates.

[0080] In some optional implementations, the target display position corresponding to the maneuver point within the field of view is determined based on the distance between the vehicle and the maneuver point, the lateral field of view of the vehicle, and the coordinates of the maneuver point. This includes: when the distance between the vehicle and the maneuver point is within a first preset distance range, determining the first display position corresponding to the maneuver point within the field of view range based on the first coordinate of the maneuver point on the first coordinate axis, the first coordinate range of the lateral field of view of the vehicle on the second coordinate axis, and the coordinates of the maneuver point on the third coordinate axis. The target display position includes the first display position, the first coordinate axis corresponds to the length direction of the vehicle, the second coordinate axis corresponds to the width direction of the vehicle, and the third coordinate axis corresponds to the height direction of the vehicle.

[0081] In other words, when within a first preset distance range, the first displayed position of the maneuver point can be determined based on a three-dimensional coordinate system constructed along the length, width, and height of the vehicle. This first displayed position should be determined by three coordinates corresponding to the three coordinate axes. Specifically, in the first coordinate axis corresponding to the vehicle length, the actual coordinates of the maneuver point, i.e., the first coordinates, are used; in the second coordinate axis corresponding to the vehicle width, the specific coordinates of the maneuver point in the second coordinate axis are determined according to the lateral field of view within the range of the first coordinates corresponding to the second coordinate axis; and in the third coordinate axis corresponding to the vehicle height, the actual coordinates of the maneuver point are used as its coordinates.

[0082] In some optional implementations, the first display position of the maneuvering point within the field of view is determined based on the first coordinate of the maneuvering point on the first coordinate axis, the lateral field of view of the vehicle within the first coordinate range corresponding to the second coordinate axis, and the coordinate of the maneuvering point on the third coordinate axis. This includes: selecting a coordinate from the first coordinate range as a fourth coordinate; and determining the first display position of the maneuvering point within the field of view based on the first coordinate, the coordinate of the maneuvering point on the third coordinate axis, and the fourth coordinate. When selecting the fourth coordinate from the first coordinate range, it can be arbitrarily selected from the first coordinate range. Since any coordinate within the first coordinate range is within the field of view, the first display position determined based on the fourth coordinate, the first coordinate, and the coordinate of the maneuvering point on the third coordinate axis can be determined to be within the field of view.

[0083] In summary, when the vehicle is within the first preset distance range, in order to ensure that the first display position is located within the field of view, the visible coverage of the lateral field of view is used to limit the coordinates of the maneuvering point on the second coordinate axis in the vehicle width direction.

[0084] It should be noted that although the actual coordinates of the maneuver point are not used on the second coordinate axis, the actual coordinates of the maneuver point are used on the first and third coordinate axes. Therefore, the determined target display position can still reasonably indicate the location of the maneuver point, thereby accurately instructing the driver to perform the corresponding driving operation. For example, if the maneuver point is an intersection, the user interface elements of that intersection, displayed at the target display position, are overlaid in an augmented reality manner at that target display position. Therefore, the user interface elements that the driver sees overlaid at the intersection, such as identifiers prompting the driver to turn left, right, or go straight, can be overlaid at the center of the intersection, slightly to the left or right of the center of the intersection, indicating to the driver that the corresponding location is an intersection and prompting the driver to perform the corresponding driving operation.

[0085] For example, if the length, width, and height of the vehicle correspond to the first coordinate axis Z, the second coordinate axis X, and the third coordinate axis Y, respectively, and the vehicle is at any point i within the first preset distance range, for the first coordinate axis Z, if the actual coordinate of the maneuvering point at this time is zi, then the first coordinate is determined to be zi. For the second coordinate axis X, if the first coordinate range corresponding to the current lateral field of view is xm-xn (xm<xn), then any coordinate xi (xm≤xi≤xn) is randomly selected as the coordinate of the maneuvering point on the second coordinate axis, that is, the fourth coordinate is xi. For the third coordinate axis Y, if the actual coordinate of the maneuvering point on the third coordinate axis Y is yi, then the coordinate of the maneuvering point on the third coordinate axis is determined to be yi. Based on the above, it can be determined that when the vehicle is at point i, the first display position corresponding to the maneuvering point within the field of view is (xi, yi, zi).

[0086] As mentioned earlier, as the vehicle continues to travel, it will reach the critical position between the first and second preset distance ranges, and further enter the second preset distance range. At the critical position, the critical coordinates corresponding to the maneuver point can be determined. Within the second preset distance range, based on the aforementioned critical coordinates, the target display position of the maneuver point can be determined by fixing the real coordinates corresponding to the critical coordinates in the real environment. The user interface element of the maneuver point can then be displayed in the head-up display based on this target display position, keeping the user interface element relatively stationary with respect to the real environment. Alternatively, the target display position of the maneuver point can be determined based on the critical coordinates, and the position of the maneuver point in the head-up display can be determined by the target display position. The relative displacement between the user interface element and the vehicle can be locked to keep the user interface element relatively stationary with respect to the vehicle. The relevant processing procedures will be explained in detail below.

[0087] In some optional implementations, the method may further include: when the vehicle is at the critical position of a first preset distance range and a second preset distance range, determining the locking coordinate point corresponding to the maneuver point within the field of view range based on the second coordinate of the maneuver point on the first coordinate axis, a coordinate of the vehicle's lateral field of view within the second coordinate range corresponding to the second coordinate axis, and the coordinate of the maneuver point on the third coordinate axis;

[0088] When the distance between the vehicle and the maneuver point is within the second preset distance range, the target display position of the maneuver point within the field of view is determined according to the real coordinates of the locked coordinate point in the real environment, and user interface elements are displayed in the head-up display screen based on the target display position;

[0089] Wherein, the distance between the vehicle and the maneuvering point within the first preset distance range is greater than or equal to the distance between the vehicle and the maneuvering point within the second preset distance range, the first coordinate axis corresponds to the length direction of the vehicle, the second coordinate axis corresponds to the width direction of the vehicle, and the third coordinate axis corresponds to the height direction of the vehicle.

[0090] In other words, after determining the critical coordinates, within a second preset distance range, the critical coordinates are used as the locking coordinate point, and the real coordinates corresponding to the locking coordinate point in the real environment are determined. Then, the real coordinates are used as the coordinates of the maneuver point within the field of view, and the real coordinates are kept or fixed within the second preset distance range, so that when the corresponding user interface element is displayed in the head-up display based on the fixed real coordinates, the user interface element remains relatively stationary with respect to the real environment.

[0091] For example, when the distance between the vehicle and the maneuver point is within a second preset distance range, the coordinates of the maneuver point within the field of view are fixed to the real coordinates of the locked coordinate point in the real environment. The renderer can then perform rendering operations based on these fixed real coordinates, thereby displaying the user interface element in the head-up display and maintaining the relative position of the user interface element with respect to the real environment. Specifically, the renderer renders the prototype of the user interface element at the maneuver point to generate a user interface element that can be displayed in the head-up display.

[0092] In some alternative implementations, the position of the origin of the coordinate system can remain unchanged in the three-dimensional coordinate system constructed based on the length, width and height of the vehicle. For example, a fixed location point in the real environment can be selected as the origin of the coordinate system. Alternatively, the position of the origin of the coordinate system can also change, that is, the origin of the coordinate system can be a non-fixed location point. For example, the center of the eye box can be used as the origin of the coordinate system.

[0093] It should be noted that, regardless of the coordinate origin used, the information display method of this application embodiment can determine the target display position of the maneuvering point within the field of view, and then display the corresponding user interface element in the head-up display based on the target display position, so that the user interface element is kept in the head-up display for the user to view, thus solving the problem that the maneuvering point is outside the field of view and therefore cannot display the corresponding user interface element in the head-up display.

[0094] For example, when the vehicle is at the critical position L, if the second coordinate corresponding to the maneuver point in the first coordinate axis Z is zl, and the lateral field of view of the vehicle corresponds to the second coordinate range xp-xq (xp<xq) in the second coordinate axis X, then select a coordinate xl (xp≤xl≤xq) as the coordinate of the maneuver point in the second coordinate. If the actual coordinate of the maneuver point in the third coordinate axis Y is yl, then the coordinate of the maneuver point in the third coordinate axis is determined to be yl. Based on this, the locking coordinate point of the critical position corresponding to the maneuver point can be determined as (xl, yl, zl).

[0095] If the origin of the coordinate system is a fixed point in the real environment, then the locked coordinate point can be regarded as the position coordinate in the real environment. Therefore, (xl, yl, zl) can be directly used as the real coordinates of the locked coordinate point in the real environment. In addition, considering that the origin of the coordinate system may not be a pre-agreed specific origin of the real environment (e.g., the geodetic origin), the coordinates of (xl, yl, zl) can be transformed according to the distance (△x, △y, △z) between the current origin of the coordinate system and the specific origin of the coordinate system, so as to obtain the real coordinates (xl-△x, yl-△y, zl-△z) of the locked coordinate point in the real environment.

[0096] If the origin of the coordinate system corresponds to the center of the eye box, then the locked coordinate point is a relative coordinate. By using the position coordinates of the eye box center in the real environment (x0', y0', z0') and the locked coordinate point (xl, yl, zl), the real coordinates of the locked coordinate point in the real environment can be determined as (xl-x0', yl-y0', zl-z0').

[0097] When the vehicle enters the second preset distance range, the renderer used to render the head-up display can display the user interface elements of the maneuvering point in the head-up display according to the real coordinates of the locked coordinate point in the real environment. Furthermore, since the target display position of the maneuvering point within the field of view is fixed to correspond to the real coordinates within the second preset range, the user interface elements rendered based on the real coordinates remain relatively stationary relative to the real environment.

[0098] Figure 5This is a schematic diagram illustrating an information display method provided in an embodiment of this application. (Refer to...) Figure 5 The length, width, and height of the vehicle correspond to the first coordinate axis Z, the second coordinate axis X, and the third coordinate axis Y, respectively, and the origin of the coordinate system is a fixed point in the real environment.

[0099] The vehicle travels along the Z direction. There is an intersection ahead where a right turn is required, corresponding to maneuver point p. When the vehicle reaches position d1, the display conditions for maneuver point P are met, and the user interface element for maneuver point p can be displayed in the head-up display. Therefore, for d1, if the actual coordinate of maneuver point p on the first coordinate axis Z is z1, then the first coordinate is determined to be z1. For the second coordinate axis X, if the range of the first coordinate corresponding to the current lateral field of view is xm1-xn1 (xm1 < xn1), then any coordinate x1 (xm1 ≤ x1 ≤ xn1) is randomly selected as the coordinate of the maneuver point on the second coordinate axis, i.e., the fourth coordinate is x1. For the third coordinate axis Y, if the actual coordinate of maneuver point p on the third coordinate axis Y is y1, then the coordinate of the maneuver point on the third coordinate axis is determined to be y1. Based on the above, when the vehicle is at d1, the first display position of the maneuver point within the field of view is (x1, y1, z1), corresponding to p1. After determining the first display position as (x1, y1, z1), the display position of the user interface element of the maneuver point in the head-up display can be determined based on the first display position, and the user interface element can be displayed in the head-up display so that the user interface element is superimposed on p1 in an augmented reality manner to assist the user in driving.

[0100] The vehicle continues to travel. When it reaches position d2, since the origin and the maneuvering point p remain relatively stationary, the maneuvering point p does not change relative to the origin on the first coordinate axis Z. Therefore, the actual coordinate of the maneuvering point p on the first coordinate axis Z remains unchanged at z1. The first coordinate is determined to be z1. For the second coordinate axis X, if the range of the first coordinate corresponding to the current lateral field of view is xm2-xn2 (xm2<xn2), then any coordinate x2 (xm2≤x2≤xn2) is randomly selected as the coordinate of the maneuvering point on the second coordinate axis, that is, the fourth coordinate is x2. For the third coordinate axis Y, similar to the first coordinate axis Z, the actual coordinate of the maneuvering point p on the third coordinate axis Y remains unchanged at y1. Therefore, the coordinate of the maneuvering point on the third coordinate axis is determined to be y1. Based on the above, it can be determined that when the vehicle is at position d2, the first displayed position of the maneuvering point is (x2, y1, z1), corresponding to position p2. After determining the first display position as (x2, y1, z1), the display position of the user interface element of the maneuver point in the head-up display can be determined based on the first display position, and the user interface element can be displayed in the head-up display so that the user interface element is superimposed on p2 in an augmented reality manner to assist the user in driving.

[0101] It should be noted that the first displayed position of the maneuver point during the process from d1 to d2 is determined based on the above logic. d1 and d2 are just two example positions for illustration.

[0102] The vehicle continues to travel. When it reaches position d3, it reaches the critical position between the first and second preset distance ranges. Based on the determination method at d1 and d2, the first display position corresponding to the maneuver point at d3 can be determined as (x3, y1, z1). Corresponding to position p3, x3 is a coordinate within the second coordinate range corresponding to the second coordinate axis of the vehicle's lateral field of view at the critical position. Furthermore, (x3, y1, z1) is the locked coordinate point. Since the origin of the coordinate system uses a fixed position point in the real environment, the real coordinates of this locked coordinate point in the real environment are (x3, y1, z1). Based on this, starting from d3, the target display position of the maneuver point within the field of view is fixed to the aforementioned real coordinates (x3, y1, z1). The position of the user interface element of the maneuver point in the head-up display is determined according to (x3, y1, z1), and the user interface element is displayed in the head-up display. This user interface element is superimposed on position p3 in an augmented reality manner to assist the user in driving.

[0103] Furthermore, the vehicle continues to travel from d3 into the second preset distance range. When it is within the second preset distance range, the target display position of the maneuver point within the field of view is still fixed to the aforementioned real coordinates (x3, y1, z1), and the user interface elements of the maneuver point are displayed in the head-up display screen based on the real coordinates (x3, y1, z1).

[0104] When the vehicle travels to position d4, it is still within the second preset distance range. The target display position of the maneuver point within the field of view is still fixed to the aforementioned real coordinates (x3, y1, z1). The renderer can display the user interface element of the maneuver point p in the head-up display based on (x3, y1, z1).

[0105] Similarly, when the vehicle continues to travel and reaches position d5, the vehicle has already left the maneuver point. Although the vehicle is still within the second preset distance range, the maneuver point still uses the aforementioned real coordinates (x3, y1, z1) within the field of view when the vehicle is at position d3. However, the field of view of the vehicle has changed as it moves forward, and these real coordinates are now outside the current field of view of the head-up display device. Therefore, the user interface elements of the maneuver point p are no longer displayed in the head-up display generated by the renderer.

[0106] Once the vehicle moves out of the second preset distance range, the user interface element for the maneuver point p is no longer displayed on the head-up display. Specifically, while the vehicle is within the second preset distance range, the target display position of the maneuver point within the field of view is always fixed to the actual coordinates (x3, y1, z1) of the corresponding locked coordinate point in the real environment. Therefore, the user display interface on the head-up display maintains a constant relative position with the real environment. In other words, if the vehicle is at d3, and the user display element is superimposed on a target object in the real environment using augmented reality (i.e., the target object is located at actual coordinates (x3, y1, z1)), then within the second preset distance range, as the vehicle moves from d3 to d5, the user display element remains superimposed on that target object.

[0107] It should be noted that when the vehicle is within the second preset distance range, since the vehicle is already close enough to the maneuver point, the user can perform accurate driving operations based on the current head-up display even without using the actual coordinates of the maneuver point to display its user interface elements.

[0108] It should also be noted that when the vehicle is within the second preset distance range, as the vehicle moves, the target display position of the maneuver point, which is determined based on the real coordinates of the locked coordinate point in the real environment, may in some cases exceed the field of view. However, since the vehicle is close enough to the maneuver point, the user can determine the driving direction or route and perform accurate driving operations.

[0109] Figure 6 This is a schematic diagram illustrating an information display method provided in an embodiment of this application. (Refer to...) Figure 6 It shows Figure 5 The relationship between the maneuvering points and their target display positions in renderer space and real-world space when the vehicle is in position d3.

[0110] like Figure 6 As shown, when the vehicle is at position d3, the first display position corresponding to the maneuver point is determined to be (x3, y1, z1), corresponding to p3. In the renderer space, the renderer performs rendering operations such as rendering the user interface elements of the maneuver point based on the first display position (x3, y1, z1). In the generated virtual image, the user interface elements of the maneuver point are deployed at p3'. In the head-up display screen viewed by the driver through the virtual image, the user interface elements are superimposed on p3 in an augmented reality manner.

[0111] As mentioned earlier, once the target display location is determined, the user interface elements of the maneuver point can be displayed in the head-up display.

[0112] In some optional implementations, the user interface elements of the maneuver point are displayed in the head-up display screen based on the target display position. This includes: when the distance between the vehicle and the maneuver point is within a second preset distance range, determining the position of the user interface element in the head-up display screen based on the target display position, and displaying the user interface element in the head-up display screen based on the position. The user interface element is superimposed on the real coordinates corresponding to the real environment in an augmented reality manner, and the relative position of the user interface element and the real coordinates remains unchanged during the vehicle's movement.

[0113] Therefore, it can be seen that the user interface elements displayed based on fixed real coordinates are fixed relative to the real environment. Specifically, as the vehicle moves in the real environment, the display position of the user interface element in the head-up display will change accordingly. However, the user interface element is always superimposed on the real coordinates in an augmented reality manner. For example, if there is a target object at the real coordinates, the user interface element will always be superimposed on the target object in an augmented reality manner when the distance between the vehicle and the movement point is within a second preset distance range.

[0114] Figure 7This is a schematic diagram of a head-up display screen provided in an embodiment of this application. (Refer to...) Figure 7 'a' is the head-up display when the vehicle is in a critical position. At this time, the real coordinates of the locked coordinates of the maneuver point in the real environment are (xs1, ys1, zs1). Based on these real coordinates (xs1, ys1, zs1), the corresponding user interface element can be determined to be at L1 in the head-up display. Therefore, the user interface element of the maneuver point is displayed at L1 and superimposed on the target object in the real environment (not shown in the figure).

[0115] Since the target display position of the maneuver point in the field of view is fixed to the corresponding real coordinates (xs1, ys1, zs1), the user interface element should still be superimposed on the target object as the vehicle continues to move. However, due to the relative displacement between the vehicle and the real coordinates, the position of the user interface element in the head-up display has also changed compared to a. As shown in b, the user interface element in the head-up display has changed from L1 to L2, and the user interface element located at L2 is still superimposed on the target object.

[0116] Similarly, as shown in b and c, as the vehicle continues to move, the user interface element changes from L2 to L3 in the head-up display.

[0117] In other words, when the vehicle is within the second preset distance range, the fixed real coordinates are relatively stationary relative to the real environment. However, the vehicle will move in the real environment due to its movement. This displacement will cause the user interface elements of the maneuver point to also move in the head-up display. This displacement ensures that the user interface elements are always superimposed on a fixed position in the real environment (i.e., on the target object).

[0118] Therefore, when the vehicle is within the second preset distance range, based on the locked coordinates in the real environment and the fixed real coordinates, the user interface elements are displayed in the head-up display. The user interface elements are superimposed on the real coordinates in an augmented reality manner (possibly superimposed on the target object located at the real coordinates). The fixed real coordinates remain relatively stationary with respect to the real environment, so that the user interface elements also remain relatively stationary with respect to the real environment. In the case of displacement of the vehicle relative to the real environment, the fixed real coordinates remain unchanged relative to the real environment, so that the user interface elements also remain relatively unchanged with respect to the real environment.

[0119] The above content mainly describes the display method of the user interface elements of the maneuver point based on the real coordinates of the fixed locked coordinate points in the real environment. The following section will elaborate on the display method of the user interface elements of the maneuver point based on the relative position of the locked user interface elements and the vehicle.

[0120] In some optional implementations, the method may further include: when the vehicle is at the critical position of a first preset distance range and a second preset distance range, determining a second display position corresponding to the maneuver point within the field of view range based on the second coordinate of the maneuver point on the first coordinate axis, a coordinate of the lateral field of view of the vehicle within the second coordinate range corresponding to the second coordinate axis, and the coordinate of the maneuver point on the third coordinate axis, wherein the target display position includes the second display position;

[0121] When the distance between the vehicle and the maneuver point is within the second preset distance range, user interface elements are displayed in the head-up display according to the second display position, so that the relative position of the user interface elements and the vehicle remains unchanged.

[0122] Wherein, the distance between the vehicle and the maneuvering point within the first preset distance range is greater than or equal to the distance between the vehicle and the maneuvering point within the second preset distance range, the first coordinate axis corresponds to the length direction of the vehicle, the second coordinate axis corresponds to the width direction of the vehicle, and the third coordinate axis corresponds to the height direction of the vehicle.

[0123] For example, when the vehicle is at the critical position L, if the second coordinate of the maneuvering point in the first coordinate axis Z is zl, and the lateral field of view of the vehicle in the second coordinate axis X corresponds to the second coordinate range xp-xq (xp<xq), a coordinate xl (xp≤xl≤xq) is selected as the coordinate of the maneuvering point in the second coordinate system. If the actual coordinate of the maneuvering point in the third coordinate axis Y is yl, then the coordinate of the maneuvering point in the third coordinate axis is determined to be yl. Based on this, the critical coordinates of the maneuvering point corresponding to the critical position can be determined as (xl, yl, zl). Furthermore, this critical coordinate is the second display position corresponding to the maneuvering point within the field of view. Further, there is a correspondence between the display position within the field of view and the display position of the head-up display. Therefore, after determining the second display position, the position corresponding to the second display position in the head-up display can be determined. And when within the second preset distance range, the user interface element of the maneuvering point is always kept in that position in the head-up display, so that the relative position of the user interface element and the vehicle remains unchanged.

[0124] Figure 8 This is a schematic diagram illustrating an information display method provided in an embodiment of this application. (Refer to...) Figure 8 The length, width, and height of the vehicle correspond to the first coordinate axis Z, the second coordinate axis X, and the third coordinate axis Y, respectively.

[0125] The vehicle travels along the Z direction. When the vehicle reaches position d1, the display conditions for the maneuver point P corresponding to the intersection ahead are met, and the user interface element of the maneuver point p can be displayed in the head-up display. Therefore, for d1, if the actual coordinate of the maneuver point p on the first coordinate axis Z is z1, then the first coordinate is determined to be z1. For the second coordinate axis X, if the range of the first coordinate corresponding to the current lateral field of view is xm1-xn1 (xm1<xn1), then any coordinate x1 (xm1≤x1≤xn1) is randomly selected as the coordinate of the maneuver point on the second coordinate axis, that is, the fourth coordinate is x1. For the third coordinate axis Y, if the actual coordinate of the maneuver point p on the third coordinate axis Y is y1, then the coordinate of the maneuver point on the third coordinate axis is determined to be y1. Based on the above, it can be determined that when the vehicle is at d1, the first display position corresponding to the maneuver point is (x1, y1, z1), corresponding to p1. After determining the first display position as (x1, y1, z1), the display position of the user interface element of the maneuver point in the head-up display can be determined based on the first display position, and the user interface element can be displayed in the head-up display, so that the user interface element is superimposed on p1 in an enhanced display manner to assist the user in driving.

[0126] Similarly, when the vehicle is at position d2, the first displayed position of the maneuver point is (x2, y1, z1), corresponding to p1; when the vehicle is at position d3, the first displayed position of the maneuver point is (x3, y1, z1), corresponding to p3. The determination process can be found in [reference needed]. Figure 6 The relevant content will not be described in detail here.

[0127] Furthermore, position d4 corresponds to the critical position between the first preset distance range and the second preset distance range. For d4, if the actual coordinate of the maneuvering point p on the first coordinate axis Z is z1, then the first coordinate is determined to be z1. For the second coordinate axis X, if the first coordinate range corresponding to the current lateral field of view is xm4-xn4 (xm4 < xn4), then any coordinate x4 (xm4 ≤ x4 ≤ xn4) is randomly selected as the coordinate of the maneuvering point on the second coordinate axis, i.e., the fourth coordinate is x4. For the third coordinate axis Y, if the actual coordinate of the maneuvering point p on the third coordinate axis Y is y1, then the coordinate of the maneuvering point on the third coordinate axis is determined to be y1. Based on the above, it can be determined that when the vehicle is at d4, the second display position of the maneuvering point is (x4, y1, z1), corresponding to p4.

[0128] After determining the second display position as (x4, y1, z1), the position of the second display position (x4, y1, z1) in the head-up display screen can be determined, and the user interface element of the maneuver point can be displayed at that position.

[0129] Furthermore, when the distance between the vehicle and the maneuver point is within the second preset distance range, the position of the user interface elements in the head-up display remains unchanged, which is equivalent to locking or fixing the user interface elements in that position on the head-up display.

[0130] Once the vehicle has moved away from the second preset distance range, the user interface element of the maneuver point p will no longer be displayed in the head-up display.

[0131] In some optional implementations, displaying the user interface elements of the maneuver point in the head-up display (HUD) based on the target display position includes: when the distance between the vehicle and the maneuver point is within a second preset distance range, determining the position of the user interface element in the HUD based on the second display position, and displaying the user interface element in the HUD based on the position. During the vehicle's movement, the relative position of the user interface element to the vehicle remains unchanged. In other words, after determining the position of the user interface element in the HUD at the critical position, when the vehicle is within the second preset distance range, the user interface element is located at that position in the HUD and maintains that position.

[0132] Figure 9 This is a schematic diagram of a head-up display screen provided in an embodiment of this application. (Refer to...) Figure 9 'a' is the head-up display screen when the vehicle is in a critical position. At this time, the second display position of the maneuver point is (xs2, ys2, zs2), and the corresponding position of this second display position in the head-up display screen is determined to be L1. Therefore, the user interface element of the maneuver point is displayed at L1.

[0133] As shown in b and c, as the vehicle continues to move, the position of the user interface element in the head-up display does not change; the user interface element remains located at L1 of the head-up display.

[0134] In other words, when the vehicle is within the second preset distance range, the position of the user interface element of the maneuver point in the head-up display remains unchanged regardless of how the vehicle moves. In this way, the vehicle and the user interface element can remain relatively stationary.

[0135] In some alternative implementations, after determining the target display position of the maneuver point within the field of view, the user interface elements of the maneuver point can be displayed in the head-up display based on that target display position.

[0136] Figure 10 This is a schematic diagram illustrating an information display method provided in an embodiment of this application. (Refer to...) Figure 10For a given maneuvering point, if the target display position of the maneuvering point is determined to be (x1, y1, z1) based on the method of this application embodiment, a line can be established with O as the starting point, p as the ending point, and passing through p', using the position of the eye box center O, the imaging distance D of the virtual image, the size of the virtual image, and the target display position (x1, y1, z1). Here, p' is a point located on the virtual image, and the user interface element of the maneuvering point is located at p' in the virtual image. Based on this, in the head-up display screen viewed by the driver through the virtual image, the user interface element of the maneuvering point is superimposed on p in an augmented reality manner.

[0137] Figure 11 This is a schematic diagram illustrating an information display method provided in an embodiment of this application. (Refer to...) Figure 11 It shows the relationship between the human eye, the source image, the virtual image, and the display position of the moving point target.

[0138] like Figure 11 As shown, after determining the target display position of the maneuver point, the position of the user interface elements in the virtual image can be determined through the above-mentioned correlation, so that when the driver views the virtual image, the user interface elements are superimposed on the target display position.

[0139] Let E1 and E2 represent the driver's two eyes, respectively. The user interface element corresponds to the first source position h1 and the second source position h2 in the source image (e.g., the user interface element is an arrow, with the head of the arrow corresponding to h1 and the tail to h2). After the source image is reflected, magnified, and projected onto the windshield, a virtual image is formed as shown in the figure. h1' and h2' on the virtual image correspond to h1 and h2 in the source image, respectively. From the driver's perspective, observing the virtual image leads them to believe that the object is at the intersection of the backward extensions of the light beams, causing the driver to perceive the user interface element as located at the point of light convergence p.

[0140] Because the user interface elements are spatially fused with the target display location of the maneuver point in real time using augmented reality technology, the user interface elements displayed in the virtual image viewed by the driver are superimposed on point p in an augmented reality manner.

[0141] In some optional implementations, the information display method may further include: establishing a positional mapping relationship between the real environment and the head-up display (HUD); and determining the display positions of the user interface elements of the target objects in the real environment on the HUD based on the positional mapping relationship, where the target objects include movement points. In other words, based on the positional relationships of the target objects in the real environment, the target objects can be mapped onto the HUD, and the corresponding positional relationships between the target objects mapped onto the HUD are still maintained.

[0142] Figure 12This is a schematic diagram of a head-up display screen provided in an embodiment of this application. (Refer to...) Figure 12 Let's take the positions of the maneuver points in the real environment as p1 and p2 as an example for illustration.

[0143] If the maneuver point is located at P1, the distance from the left boundary of fov is -D11, the vertical distance from fov is D12, and the height above the ground is D13 (D11>0, D12>0, D13>0), then the display position of p1 in the head-up display is P1', which can be represented as (0, y1), where 0 represents the horizontal position component of p1' in the head-up display, and y1 represents the vertical position component of p1' in the head-up display; if the maneuver point is located at P2... Let p2 be at a distance of +D21 from the left edge of fov, a vertical distance of D22 from fov, and a height of D13 from the ground (D21 > 0, D22 > 0, D13 > 0), with D12 = D22 and D13 = D23. Then, the display position of p2 in the head-up display (HUD) is P2', which can be represented as (x2, y1), where x2 represents the horizontal position component of p2' in the HUD, and y1 represents the vertical position component of p2' in the HUD. In the real environment, p1 is to the left of p2. After mapping both to the HUD, p1' remains to the left of p2', and their relative positional relationship remains unchanged.

[0144] Therefore, it can be seen that in this way, target objects that are not originally within the field of view can also be displayed in the head-up display, and the accuracy of the display position can be taken into account through the position mapping relationship.

[0145] It is understood that the various method embodiments mentioned above in this application can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this application will not elaborate further. Those skilled in the art will understand that in the above methods of specific implementation, the specific execution order of each step should be determined by its function and possible internal logic.

[0146] Secondly, embodiments of this application provide an information display device.

[0147] Figure 13 This is a block diagram of an information display device provided in an embodiment of this application.

[0148] Reference Figure 13 This application provides an information display device, which 1300 may include the following modules.

[0149] The determination module 1301 is used to determine the maneuvering point of the vehicle on the driving route;

[0150] The processing module 1302 is used to determine the target display position of the maneuver point within the field of view range based on the distance between the vehicle and the maneuver point, the lateral field of view of the vehicle and the coordinates of the maneuver point, in response to the maneuver point meeting the preset display conditions.

[0151] Display module 1303 is used to display user interface elements of the maneuver point in the head-up display screen based on the target display position.

[0152] In some optional implementations, when the processing module 1302 determines the target display position corresponding to the maneuver point within the field of view based on the distance between the vehicle and the maneuver point, the lateral field of view of the vehicle, and the coordinates of the maneuver point, it performs the following steps:

[0153] When the distance between the vehicle and the maneuver point is within a first preset distance range, the first display position of the maneuver point within the field of view range is determined based on the first coordinate of the maneuver point on the first coordinate axis, the first coordinate range of the lateral field of view of the vehicle on the second coordinate axis, and the coordinate of the maneuver point on the third coordinate axis. The target display position includes the first display position.

[0154] In some alternative implementations, the information display device 1300 may also be used to perform the following steps:

[0155] When the vehicle is at the critical position of the first preset distance range and the second preset distance range, the locking coordinate point corresponding to the maneuver point within the field of view is determined based on the second coordinate of the maneuver point on the first coordinate axis, a coordinate of the vehicle's lateral field of view within the second coordinate range corresponding to the second coordinate axis, and the coordinate of the maneuver point on the third coordinate axis.

[0156] When the distance between the vehicle and the maneuver point is within the second preset distance range, the target display position of the maneuver point within the field of view is determined according to the real coordinates of the locked coordinate point in the real environment, and user interface elements are displayed in the head-up display screen based on the target display position;

[0157] Wherein, the distance between the vehicle and the maneuvering point within the first preset distance range is greater than or equal to the distance between the vehicle and the maneuvering point within the second preset distance range, the first coordinate axis corresponds to the length direction of the vehicle, the second coordinate axis corresponds to the width direction of the vehicle, and the third coordinate axis corresponds to the height direction of the vehicle.

[0158] In some alternative implementations, when display module 1303 displays the user interface elements of the maneuver point in the head-up display based on the target display position, it performs the following steps:

[0159] When the distance between the vehicle and the maneuver point is within the second preset distance range, the position of the user interface element in the head-up display is determined based on the target display position, and the user interface element is displayed in the head-up display based on the position. The user interface element is superimposed on the real coordinates corresponding to the real environment in an augmented reality manner, and the relative position of the user interface element and the real coordinates remains unchanged during the vehicle's movement.

[0160] In some alternative implementations, the information display device 1300 may also be used to perform the following steps:

[0161] When the vehicle is at the critical position of the first preset distance range and the second preset distance range, the second display position of the maneuver point within the field of view is determined based on the second coordinate of the maneuver point on the first coordinate axis, a coordinate of the lateral field of view of the vehicle within the second coordinate range corresponding to the second coordinate axis, and the coordinate of the maneuver point on the third coordinate axis. The target display position includes the second display position.

[0162] When the distance between the vehicle and the maneuver point is within the second preset distance range, user interface elements are displayed in the head-up display according to the second display position, so that the relative position of the user interface elements and the vehicle remains unchanged.

[0163] Wherein, the distance between the vehicle and the maneuvering point within the first preset distance range is greater than or equal to the distance between the vehicle and the maneuvering point within the second preset distance range, the first coordinate axis corresponds to the length direction of the vehicle, the second coordinate axis corresponds to the width direction of the vehicle, and the third coordinate axis corresponds to the height direction of the vehicle.

[0164] In some alternative implementations, when display module 1303 displays the user interface elements of the maneuver point in the head-up display based on the target display position, it performs the following steps:

[0165] When the distance between the vehicle and the maneuver point is within the second preset distance range, the position of the user interface element in the head-up display is determined based on the second display position, and the user interface element is displayed in the head-up display based on the position. During the vehicle's movement, the relative position of the user interface element and the vehicle remains unchanged.

[0166] In some optional implementations, the first display position of the maneuvering point within the field of view is determined based on the first coordinate of the maneuvering point on the first coordinate axis, the lateral field of view of the vehicle corresponding to the first coordinate range on the second coordinate axis, and the coordinate of the maneuvering point on the third coordinate axis, including:

[0167] Select one coordinate from the first coordinate range as the fourth coordinate;

[0168] Based on the first coordinate, the coordinates of the maneuver point on the third coordinate axis, and the fourth coordinate, determine the first display position of the maneuver point within the field of view.

[0169] In some alternative implementations, the information display device 1300 may also be used to perform the following steps:

[0170] Establish a positional mapping relationship between the real environment and the head-up display screen;

[0171] Based on the position mapping relationship, determine the display position of the user interface elements of the target object in the head-up display screen in the real environment. The target object includes the maneuvering point.

[0172] The embodiments provided in this application consider the limited field of view coverage of the vehicle. If the user interface element of the maneuvering point is displayed using the actual coordinates of the maneuvering point within the field of view, there may be cases where the maneuvering point is outside the field of view, causing the corresponding user interface element to be outside the head-up display (HUD) and thus unable to be displayed normally. Based on this, in the embodiments of this application, a determining module determines the maneuvering point of the vehicle on the driving route; a processing module, in response to the maneuvering point meeting preset display conditions, determines the target display position of the maneuvering point within the field of view based on the distance between the vehicle and the maneuvering point, the lateral field of view of the vehicle, and the coordinates of the maneuvering point. This allows for a certain restriction on the target display position of the maneuvering point based on the field of view range, ensuring that the maneuvering point is displayed normally; a display module, based on the target display position, displays the user interface element of the maneuvering point in the HUD, thus keeping the user interface element in the HUD for the user to view. This solves the problem that the maneuvering point is outside the field of view coverage and therefore cannot be displayed in the HUD. Moreover, the determination of the target display position references the actual coordinates of the maneuvering point, thus ensuring the accuracy of the target display position.

[0173] Each module in the aforementioned information display device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device, or stored in the memory of a computer device as software, so that the processor can call and execute the operations corresponding to each module.

[0174] Thirdly, embodiments of this application provide a head-up display system.

[0175] Figure 14 This is a block diagram of a head-up display system provided in an embodiment of this application.

[0176] Reference Figure 14 This application provides a head-up display system, which 1400 may include an information display device 1410.

[0177] The information display device 1410 is used to implement the information display method as described in any of the embodiments of this application. The implementation of the information display method can be found in the relevant content of the embodiments of this application, and will not be described further here.

[0178] The embodiments provided in this application determine the target display position of the maneuver point within the field of view by combining the distance between the vehicle and the maneuver point, the lateral field of view of the vehicle, and the coordinates of the maneuver point. This allows for a certain restriction on the target display position of the maneuver point based on the field of view, ensuring that the maneuver point is displayed normally. Furthermore, based on this target display position, the user interface elements of the maneuver point can be displayed in the head-up display (HUD), thus keeping the user interface elements in the HUD for the user to view. This solves the problem that the corresponding user interface elements cannot be displayed in the HUD when the maneuver point is outside the field of view. Moreover, the determination of the target display position references the actual coordinates of the maneuver point, thus ensuring the accuracy of the target display position.

[0179] In addition, this application also provides electronic devices and computer-readable storage media, all of which can be used to implement any of the information display methods provided in this application. The corresponding technical solutions and descriptions are described in the corresponding descriptions in the method section, and will not be repeated here.

[0180] Figure 15 This is a block diagram of an electronic device provided in an embodiment of this application.

[0181] Reference Figure 15 This application provides an electronic device, which includes: at least one processor 1501; at least one memory 1502; and one or more I / O interfaces 1503 connected between the processor 1501 and the memory 1502; wherein the memory 1502 stores one or more computer programs that can be executed by the at least one processor 1501, and the one or more computer programs are executed by the at least one processor 1501 to enable the at least one processor 1501 to perform the above-described information display method.

[0182] The modules in the aforementioned electronic device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of the computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0183] This application also provides a computer-readable storage medium storing a computer program thereon, wherein the computer program, when executed by a processor / processor core, implements the aforementioned information display method. The computer-readable storage medium can be volatile or non-volatile.

[0184] This application also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code. When the computer-readable code is run in the processor of an electronic device, the processor in the electronic device executes the above-described information display method.

[0185] Those skilled in the art will understand that all or some of the steps, systems, and apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software can be distributed on a computer-readable storage medium, which may include computer storage media (or non-transitory media) and communication media (or transient media).

[0186] As is known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable program instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), static random access memory (SRAM), flash memory or other memory technologies, portable compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, it is known to those skilled in the art that communication media typically contain computer-readable program instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0187] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions to be stored in the computer-readable storage medium in each computing / processing device.

[0188] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing the status information of the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0189] The computer program product described herein can be implemented specifically through hardware, software, or a combination thereof. In one alternative embodiment, the computer program product is specifically embodied in a computer storage medium; in another alternative embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0190] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0191] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0192] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0193] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0194] Example embodiments have been disclosed herein, and while specific terminology has been used, it is for general illustrative purposes only and should not be construed as limiting. In some instances, it will be apparent to those skilled in the art that features, characteristics, and / or elements described in conjunction with particular embodiments may be used alone, or in combination with features, characteristics, and / or elements described in conjunction with other embodiments, unless otherwise expressly indicated. Therefore, those skilled in the art will understand that various changes in form and detail may be made without departing from the scope of this application as set forth by the appended claims.

Claims

1. An information display method, characterized in that, The method includes: Determine the vehicle's maneuver points along its route; In response to the maneuver point meeting the preset display conditions, the target display position of the maneuver point within the field of view is determined based on the distance between the vehicle and the maneuver point, the lateral field of view of the vehicle, and the coordinates of the maneuver point. Based on the target display location, the user interface elements of the maneuver point are displayed in the head-up display.

2. The method according to claim 1, characterized in that, The step of determining the target display position of the maneuvering point within the field of view range based on the distance between the vehicle and the maneuvering point, the lateral field of view of the vehicle, and the coordinates of the maneuvering point includes: When the distance between the vehicle and the maneuvering point is within a first preset distance range, the first display position of the maneuvering point within the field of view range is determined based on the first coordinate of the maneuvering point on the first coordinate axis, the first coordinate range of the lateral field of view of the vehicle on the second coordinate axis, and the coordinate of the maneuvering point on the third coordinate axis. The target display position includes the first display position.

3. The method according to claim 1, characterized in that, The method further includes: When the vehicle is at the critical position of the first preset distance range and the second preset distance range, the locking coordinate point corresponding to the maneuver point within the field of view is determined based on the second coordinate of the maneuver point on the first coordinate axis, a coordinate of the lateral field of view of the vehicle within the second coordinate range corresponding to the second coordinate axis, and the coordinate of the maneuver point on the third coordinate axis. When the distance between the vehicle and the maneuvering point is within the second preset distance range, the target display position of the maneuvering point within the field of view is determined according to the real coordinates of the locked coordinate point in the real environment, and the user interface element is displayed in the head-up display screen based on the target display position; Wherein, the distance between the vehicle and the maneuvering point within the first preset distance range is greater than or equal to the distance between the vehicle and the maneuvering point within the second preset distance range, the first coordinate axis corresponds to the length direction of the vehicle, the second coordinate axis corresponds to the width direction of the vehicle, and the third coordinate axis corresponds to the height direction of the vehicle.

4. The method according to claim 3, characterized in that, The user interface elements for displaying the maneuver point in the head-up display screen based on the target display position include: When the distance between the vehicle and the maneuvering point is within a second preset distance range, the position of the user interface element in the head-up display is determined based on the target display position, and the user interface element is displayed in the head-up display based on the position. The user interface element is superimposed on the real coordinates corresponding to the real environment in an augmented reality manner, and the relative position of the user interface element and the real coordinates remains unchanged during the vehicle's movement.

5. The method according to claim 1, characterized in that, The method further includes: When the vehicle is at the critical position of the first preset distance range and the second preset distance range, the second display position of the maneuvering point within the field of view range is determined based on the second coordinate of the maneuvering point on the first coordinate axis, a coordinate of the lateral field of view of the vehicle within the second coordinate range corresponding to the second coordinate axis, and the coordinate of the maneuvering point on the third coordinate axis. The target display position includes the second display position. When the distance between the vehicle and the maneuver point is within the second preset distance range, the user interface element is displayed in the head-up display according to the second display position, so that the user interface element and the vehicle maintain a constant relative position. Wherein, the distance between the vehicle and the maneuvering point within the first preset distance range is greater than or equal to the distance between the vehicle and the maneuvering point within the second preset distance range, the first coordinate axis corresponds to the length direction of the vehicle, the second coordinate axis corresponds to the width direction of the vehicle, and the third coordinate axis corresponds to the height direction of the vehicle.

6. The method according to claim 5, characterized in that, The user interface elements for displaying the maneuver point in the head-up display screen based on the target display position include: When the distance between the vehicle and the maneuvering point is within the second preset distance range, the position of the user interface element in the head-up display is determined based on the second display position, and the user interface element is displayed in the head-up display based on the position, wherein the relative position of the user interface element and the vehicle remains unchanged during the vehicle's movement.

7. The method according to claim 2, characterized in that, The step of determining the first display position of the maneuvering point within the field of view range based on the first coordinate of the maneuvering point on the first coordinate axis, the lateral field of view of the vehicle corresponding to the first coordinate range on the second coordinate axis, and the coordinate of the maneuvering point on the third coordinate axis includes: Select one coordinate from the first coordinate range as the fourth coordinate; Based on the first coordinate, the coordinate of the maneuvering point on the third coordinate axis, and the fourth coordinate, the first display position corresponding to the maneuvering point within the field of view is determined.

8. The method according to claim 1, characterized in that, The method further includes: Establish a positional mapping relationship between the real environment and the head-up display screen; Based on the location mapping relationship, the display position of the user interface elements of the target object in the real environment in the head-up display screen is determined, and the target object includes the maneuvering point.

9. An information display device, characterized in that, The device includes: The determination module is used to determine the vehicle's maneuver points on the driving route; The processing module is used to, in response to the maneuver point meeting the preset display conditions, determine the target display position of the maneuver point within the field of view range based on the distance between the vehicle and the maneuver point, the lateral field of view of the vehicle, and the coordinates of the maneuver point; The display module is used to display the user interface elements of the maneuvering point in the head-up display screen based on the target display position.

10. A head-up display system, characterized in that, The system includes an information display device; The information display device is used to implement the information display method as described in any one of claims 1-8.

11. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores one or more computer programs that can be executed by the at least one processor, and the one or more computer programs are executed by the at least one processor to enable the at least one processor to perform the information display method as described in any one of claims 1-8.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the information display method as described in any one of claims 1-8.

Images