Head-up display method and head-up display interaction system

Abstract

The embodiment of the invention provides a head-up display method and a head-up display interaction system. The method is applied to a mobile terminal, a plurality of first transmission channels divided according to priorities are configured between a vehicle-mounted terminal and the mobile terminal, and the method comprises the following steps: receiving intelligent driving information sent by the vehicle-mounted terminal, and obtaining navigation information of a local navigation application; based on the navigation information and the intelligent driving information, generating guide information with a priority identifier; wherein the priority identifier represents the emergency degree of the guidance information; a first transmission channel matched with the priority identifier is adopted, and the guide information is transmitted to the vehicle-mounted terminal through channels, so that the vehicle-mounted terminal transmits the navigation guide information to the head-up display device; wherein the head-up display device is used for projecting the navigation guidance information to a preset projection area for display. The method is used for achieving the effect of improving the real-time performance of head-up display.

Description

Technical Field

[0001] This application relates to the field of intelligent driving technology, and in particular to a head-up display method and a head-up display interaction system. Background Technology

[0002] Head-up display (HUD) technology can project information such as navigation and vehicle speed onto a preset area in the driver's field of vision (such as the windshield) in the form of virtual projection, so that the driver does not need to switch between real road conditions and screen information, which significantly improves the convenience and safety of driving operation.

[0003] In related technologies, the complete navigation interface is often rendered and compressed by the mobile phone and then sent to the vehicle terminal. The vehicle terminal receives and decompresses the data, performs secondary rendering and adaptation, and then transmits it to the head-up display device for projection. However, this method has a high transmission latency, resulting in poor real-time performance of the head-up display. Summary of the Invention

[0004] The head-up display method and head-up display interaction system provided in this application embodiment are used to improve the real-time performance of head-up displays.

[0005] In a first aspect, embodiments of this application provide a head-up display method, the method being applied to a mobile terminal in a head-up display interactive system. The head-up display interactive system includes an in-vehicle terminal, a mobile terminal, and a head-up display device. The in-vehicle terminal and the mobile terminal are configured with multiple first transmission channels prioritized according to their respective priorities. The method includes:

[0006] Receive intelligent driving information sent by the vehicle terminal and obtain navigation information from the local navigation application;

[0007] Based on the navigation information and the intelligent driving information, guidance information with priority identifiers is generated; wherein, the priority identifiers represent the urgency of the guidance information.

[0008] The guidance information is transmitted to the vehicle terminal via a first transmission channel that matches the priority identifier, so that the vehicle terminal can transmit the navigation guidance information to the head-up display device; wherein the head-up display device is used to project the navigation guidance information onto a preset projection area for display.

[0009] In one possible implementation, generating guidance information with a priority identifier based on the navigation information and the intelligent driving information includes:

[0010] Based on the navigation information and the intelligent driving information, initial guidance information is rendered and generated; wherein, the initial guidance information has a priority identifier and location information;

[0011] The position information of the initial guidance information is distorted to obtain intermediate guidance information;

[0012] The intermediate guidance information is hierarchically encoded according to the priority identifier to obtain the guidance information.

[0013] In one possible implementation, the step of distorting the position information of the initial guidance information to obtain intermediate guidance information includes:

[0014] Obtain curvature information of the vehicle's preset projection area;

[0015] Based on the position information and curvature information of the initial guidance information, the position information after distortion processing is obtained;

[0016] The intermediate guidance information is obtained based on the position information after distortion processing.

[0017] Secondly, embodiments of this application provide a head-up display method, the method being applied to an in-vehicle terminal in a head-up display interactive system. The head-up display interactive system includes an in-vehicle terminal, a mobile terminal, and a head-up display device. The in-vehicle terminal and the mobile terminal are configured with multiple first transmission channels prioritized according to their respective priorities. The method includes:

[0018] Acquire the vehicle's intelligent driving information and send the intelligent driving information to the mobile terminal;

[0019] The system receives guidance information sent by the mobile terminal through the first transmission channel and forwards the guidance information to the head-up display device; wherein the guidance information has a priority identifier that characterizes the urgency of the guidance information; the guidance information is generated by the mobile terminal based on navigation information and intelligent driving information from the mobile terminal's local navigation application; and the head-up display device is used to project the guidance information onto a preset projection area for display.

[0020] In one possible implementation, the vehicle-mounted terminal and the head-up display device are configured with multiple second transmission channels prioritized according to their respective priorities; forwarding the guidance information to the head-up display device includes:

[0021] The guidance information is transmitted to the head-up display device via a second transmission channel matching the priority identifier; wherein the head-up display device projects the guidance information onto a preset projection area for display; or,

[0022] Based on the guidance information and the intelligent driving information, projection information is generated; wherein, the priority identifier of the projection information is consistent with the priority identifier of the guidance information;

[0023] The information to be projected is transmitted to the head-up display device via a second transmission channel that matches the priority identifier; wherein the head-up display device is used to project the information to be projected onto a preset projection area for display.

[0024] In one possible implementation, generating the projection information based on the guidance information and the intelligent driving information includes:

[0025] The intelligent driving information is rendered to obtain rendered intelligent driving information;

[0026] The rendered intelligent driving information and the guidance information are overlaid to obtain the information to be projected.

[0027] Thirdly, embodiments of this application provide a head-up display method, the method being applied to a head-up display device in a head-up display interaction system, the head-up display interaction system including an in-vehicle terminal, a mobile terminal, and a head-up display device, the method comprising:

[0028] The system receives guidance information sent by the vehicle terminal; wherein the guidance information has a priority identifier that represents the urgency of the guidance information; the guidance information is generated by the mobile terminal based on navigation information from the mobile terminal's local navigation application and intelligent driving information sent by the vehicle terminal.

[0029] The guidance information is projected onto a preset projection area.

[0030] In one possible implementation, receiving the guidance information sent by the vehicle-mounted terminal includes:

[0031] The system receives projection information sent by the vehicle terminal; wherein the projection information is generated by the vehicle terminal based on the superposition of the guidance information and the intelligent driving information; and the priority identifier of the projection information is consistent with the priority identifier of the guidance information.

[0032] In one possible implementation, the head-up display device includes multiple projection processing channels prioritized by order, and projecting the guidance information onto a preset projection area includes:

[0033] Based on the priority identifier of the guidance information, the projection processing channel corresponding to the guidance information is determined; and based on the projection processing channel corresponding to the guidance information, the guidance information is projected onto a preset projection area; or...

[0034] Based on the priority identifier of the information to be projected, the projection processing channel corresponding to the information to be projected is determined; based on the projection processing channel corresponding to the information to be projected, the information to be projected is projected onto a preset projection area.

[0035] Fourthly, embodiments of this application provide a head-up display device, which is applied to a mobile terminal in a head-up display interactive system. The head-up display interactive system includes an in-vehicle terminal, a mobile terminal, and a head-up display device. The in-vehicle terminal and the mobile terminal are configured with multiple first transmission channels prioritized according to their respective priorities, including:

[0036] The receiving module is used to receive intelligent driving information sent by the vehicle terminal and obtain navigation information from the local navigation application;

[0037] The generation module is used to generate guidance information with priority identifiers based on the navigation information and the intelligent driving information; wherein the priority identifiers represent the urgency of the guidance information;

[0038] The transmission module is used to transmit the guidance information to the vehicle terminal via a first transmission channel that matches the priority identifier, so that the vehicle terminal can transmit the navigation guidance information to the head-up display device; wherein the head-up display device is used to project the navigation guidance information onto a preset projection area for display.

[0039] Fifthly, embodiments of this application provide a head-up display device, which is applied to an in-vehicle terminal in a head-up display interactive system. The head-up display interactive system includes an in-vehicle terminal, a mobile terminal, and a head-up display device. The in-vehicle terminal and the mobile terminal are configured with multiple first transmission channels prioritized according to their respective priorities, including:

[0040] The acquisition module is used to acquire intelligent driving information of the vehicle and send the intelligent driving information to the mobile terminal;

[0041] A receiving module is configured to receive guidance information sent by the mobile terminal through the first transmission channel and forward the guidance information to the head-up display device; wherein the guidance information has a priority identifier that characterizes the urgency of the guidance information; the guidance information is generated by the mobile terminal based on navigation information and intelligent driving information from the mobile terminal's local navigation application; and the head-up display device is configured to project the guidance information onto a preset projection area for display.

[0042] Sixthly, embodiments of this application provide a head-up display device, which is applied to a head-up display device in a head-up display interaction system. The head-up display interaction system includes an in-vehicle terminal, a mobile terminal, and a head-up display device, comprising:

[0043] A receiving module is used to receive guidance information sent by the vehicle terminal; wherein the guidance information has a priority identifier that represents the urgency of the guidance information; the guidance information is generated by the mobile terminal based on navigation information from the mobile terminal's local navigation application and intelligent driving information sent by the vehicle terminal;

[0044] The projection module is used to project the guidance information onto a preset projection area.

[0045] In a seventh aspect, embodiments of this application provide an electronic device, including: a memory and a processor;

[0046] The memory stores computer-executed instructions;

[0047] The processor executes computer execution instructions stored in the memory, causing the processor to perform the implementation methods described in the first, second, or third aspects above.

[0048] Eighthly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the embodiments described in the first, second, or third aspects above.

[0049] Ninthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the implementation methods described in the first, second, or third aspects above.

[0050] The head-up display (HUD) display method and HUD interaction system provided in this application embodiment involve an in-vehicle terminal first acquiring the vehicle's intelligent driving information and sending it to a mobile terminal. Simultaneously, the mobile terminal acquires navigation information from a local navigation application. Based on the correlation and matching of these two types of information, guidance information with priority identifiers is generated. This guidance information is then transmitted to the in-vehicle terminal via a first transmission channel matching the priority identifier. Upon receiving the guidance information, the in-vehicle terminal directly forwards it to the HUD device, which ultimately projects the guidance information onto a preset projection area. This approach achieves several advantages. First, the mobile terminal transmits guidance information via separate channels, eliminating the need to transmit all information through the same channel, significantly reducing transmission latency and improving the real-time performance of the HUD. Second, the mobile terminal generates guidance information by combining intelligent driving and navigation information and adapting to the projection characteristics of the HUD device, eliminating the need for complex secondary processing by the in-vehicle terminal, further reducing link processing time and transmission latency. Third, compared to transmitting the entire navigation application interface in existing technologies, transmitting key guidance information reduces data transmission volume, further reducing transmission latency and improving the real-time performance of the HUD. Attached Figure Description

[0051] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0052] Figure 1 Schematic diagram of the head-up display interactive system provided in this application Figure 1 ;

[0053] Figure 2 Schematic diagram of the head-up display interactive system provided in this application Figure 2 ;

[0054] Figure 3 Flowchart of the header display method provided in this application Figure 1 ;

[0055] Figure 4 Schematic diagram of the head-up display interactive system provided in this application Figure 3 ;

[0056] Figure 5 Flowchart of the header display method provided in this application Figure 2 ;

[0057] Figure 6 Schematic diagram of the head-up display interactive system provided in this application Figure 4 ;

[0058] Figure 7 Flowchart of the header display method provided in this application Figure 4 ;

[0059] Figure 8 Schematic diagram of the head-up display interactive system provided in this application Figure 5 ;

[0060] Figure 9 A projection diagram provided for this application;

[0061] Figure 10 Schematic diagram of the structure of the head-up display device provided in this application Figure 1 ;

[0062] Figure 11 Schematic diagram of the structure of the head-up display device provided in this application Figure 2 ;

[0063] Figure 12 Schematic diagram of the structure of the head-up display device provided in this application Figure 3 ;

[0064] Figure 13 A schematic diagram of the structure of the electronic device provided in this application.

[0065] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0066] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0067] Figure 1 Schematic diagram of the head-up display interactive system provided in this application Figure 1 ,like Figure 1 As shown, the head-up display interactive system 100 includes an in-vehicle terminal 101, a mobile terminal 102, and a head-up display device 103.

[0068] The vehicle-mounted terminal 101 is an in-vehicle control unit installed inside the vehicle, possessing functions for intelligent driving information collection, data storage, and wireless transmission. This terminal can collect intelligent driving information such as environmental information and vehicle status information through in-vehicle sensors, and send the collected information to the mobile terminal 102; simultaneously, it forwards guidance information sent by the mobile terminal 102 to the head-up display device 103. The in-vehicle sensors may include, for example, millimeter-wave radar, cameras, GPS positioning modules, etc., and are not limited to these in this embodiment.

[0069] The mobile terminal is used to receive intelligent driving information sent by the vehicle terminal 101 and obtain navigation information such as planned routes, turning nodes, and driving distance prompts generated by the local navigation application. Based on the navigation information and intelligent driving information, it renders and generates guidance information including navigation guidance (such as turn arrows and obstacle avoidance signs) and necessary background data (such as simplified map base map), and transmits the guidance information to the vehicle terminal 101 through multiple channels. It should be noted that the type of mobile terminal is not limited in this application embodiment. For example, it can be a portable electronic device with data processing and navigation application operation capabilities, such as a mobile phone, tablet computer, or laptop.

[0070] A head-up display (HUD) is a device that can overlay guidance information onto the driver's field of vision in the form of a virtual projection. This HUD can receive guidance information forwarded by the in-vehicle terminal 101 and project it onto a preset projection area such as the vehicle's windshield, achieving an intuitive overlay display of navigation guidance and the actual road scene.

[0071] It should be noted that the embodiments of this application do not limit the deployment method of the vehicle terminal and the head-up display device. They can be deployed independently or in an integrated manner, for example, the head-up display device and the vehicle terminal can be integrated together.

[0072] In related technologies, the mobile phone renders and compresses the complete navigation application interface data before sending it to the vehicle terminal. The vehicle terminal then decompresses and performs secondary rendering to adapt to the format of the head-up display device. Finally, the processed data is sent to the head-up display device for projection display. The transmission latency is high, resulting in poor real-time performance of the head-up display.

[0073] Based on this, the inventors of this application considered that the urgency of different information varies in navigation scenarios. For example, information directly related to driving safety, such as obstacle avoidance prompts and collision warnings, needs to be transmitted more quickly than information such as map base maps and non-critical point of interest (POI) annotations. If dedicated transmission channels can be configured for information of different urgency levels, and core guidance information is transmitted instead of the complete navigation application interface, the amount of data and transmission latency can be reduced. Therefore, this application provides a head-up display method that establishes multiple priority transmission channels between the mobile terminal and the vehicle terminal. The mobile terminal first generates guidance information with priority identifiers by combining the navigation application and vehicle status, and then transmits the guidance information to the vehicle terminal through channels matching the priority. The vehicle terminal can directly forward the guidance information to the head-up display device without complex secondary rendering. This reduces the amount of data and processing time by transmitting core guidance information, and ensures the rapid transmission of key information through priority transmission, ultimately reducing transmission latency and improving the real-time performance of the head-up display.

[0074] It should be noted that the user information and user data involved in the embodiments of this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with relevant laws, regulations and standards, and provide corresponding operation entry points for users to choose to authorize or refuse.

[0075] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0076] Figure 2 Schematic diagram of the head-up display interactive system provided in this application Figure 2The vehicle-mounted terminal and the mobile terminal are configured with multiple first transmission channels divided according to priority. It should be noted that this application embodiment does not limit the number of first transmission channels; they can be set based on priority levels. For example, three priorities can be defined: high (priority identifier 3), medium (priority identifier 2), and low (priority identifier 1), with three corresponding first transmission channels. Figure 2 This example illustrates the configuration of three primary transmission channels.

[0077] For example, the first transmission channel refers to a dedicated data link between the vehicle terminal and the mobile terminal for the stable transmission of specific types of data (such as intelligent driving information and guidance information). It should be noted that the embodiments of this application do not limit the communication method between the vehicle terminal and the mobile terminal. For example, it can be a Wi-Fi connection, a Bluetooth connection, or a mobile communication connection, wherein the mobile communication can be, for example, 5G, 4G, or other communication methods.

[0078] In one example, the first transmission channel can be a communication path formed based on multiple physical communication modules and a dedicated communication protocol. The communication protocol can be User Datagram Protocol (UDP), Transmission Control Protocol (TCP), TCP with compression algorithms, etc. In other words, the physical communication modules, communication protocols, and corresponding priority identifiers used by the first transmission channel can be configured synchronously at both ends of the device.

[0079] For example, the first transmission channel 1 corresponds to priority identifier 3 and uses a Wi-Fi module + UDP protocol; the second transmission channel 2 corresponds to priority identifier 2 and uses a Bluetooth module + TCP protocol; the third transmission channel corresponds to priority identifier 1 and uses a Bluetooth module + TCP protocol with compression algorithm.

[0080] In another example, the first transmission channel can also be based on multiple modes of a physical communication module, dividing it into multiple logical ports and setting a communication path formed by a dedicated communication protocol for each logical port. For example, taking a Bluetooth module as an example, the first transmission channel 1 corresponds to priority identifier 3 and port 1, using standard Bluetooth mode + UDP protocol; the second transmission channel 2 corresponds to priority identifier 2 and port 2, using standard Bluetooth mode + TCP protocol; and the third transmission channel corresponds to priority identifier 1 and port 3, using low-power Bluetooth mode + TCP protocol with compression algorithm.

[0081] This method enables efficient transmission through dedicated channels based on priority settings, reducing latency issues caused by low-priority data crowding out high-priority information. It ensures the efficiency and real-time transmission of guidance information from mobile terminals to in-vehicle terminals, laying the foundation for accurate and timely projection by subsequent head-up display devices.

[0082] Figure 3 Flowchart of the header display method provided in this application Figure 1 ,refer to Figure 2 and Figure 3 As shown, the method includes:

[0083] S201, The vehicle terminal obtains intelligent driving information of the vehicle.

[0084] For example, intelligent driving information refers to environmental perception data and vehicle status data related to vehicle driving collected by the vehicle terminal through vehicle sensors, including but not limited to the position and distance of obstacles around the vehicle, the real-time position of the vehicle, the distribution and width of lane lines, the current driving speed and steering angle of the vehicle, etc.

[0085] For example, the vehicle terminal can communicate with vehicle sensors to obtain intelligent driving information, or it can communicate with other vehicle control units to obtain intelligent driving information, such as intelligent driving domain controllers.

[0086] S202, The vehicle terminal sends intelligent driving information to the mobile terminal.

[0087] For example, the in-vehicle terminal can send the acquired intelligent driving information to the connected mobile terminal in real time.

[0088] Correspondingly, the mobile terminal receives intelligent driving information sent by the vehicle terminal.

[0089] S203. The mobile terminal obtains navigation information from the local navigation application.

[0090] For example, a local navigation application refers to an application that is pre-installed and runs on a mobile terminal and can generate a driving route and provide real-time guidance based on the user's input start and end points, such as a navigation application. It should be noted that the embodiments of this application do not limit the local navigation application.

[0091] Navigation information refers to route planning data generated by local navigation applications, which may include information such as planned driving routes, key turning points, remaining distance to the destination, and estimated time.

[0092] In one example, after a user opens a local navigation application and enters their travel information, the mobile terminal automatically retrieves the corresponding navigation information from the database of the local navigation application or a cloud service.

[0093] S204. The mobile terminal generates guidance information with priority identifiers based on navigation information and intelligent driving information.

[0094] For example, guidance information refers to rendered visual data that can be projected onto a head-up display device to provide drivers with intuitive driving guidance. Guidance information may include obstacle avoidance arrows, conventional turn indicators, lane keeping prompts, simplified map base maps and POI markers, 3D modeling information of surrounding vehicles, and other visual information. This application embodiment does not limit the content included in the guidance information; it can be set according to actual needs. It should be noted that the guidance information is data that has been rendered and converted into a transmission-compatible format.

[0095] It is understandable that, in terms of the complete navigation application interface data transmitted in the existing technology, the complete navigation application interface data may include redundant UI elements, such as menu buttons, advertising pop-ups, historical route records and other non-driving essential content, while guidance information is the visual data of the guidance elements necessary to provide guidance to the driver.

[0096] Priority identifiers are identifiers used to distinguish the urgency of guidance information. For example, they can be numerical codes or character identifiers. This application does not limit the form of priority identifiers.

[0097] Urgency level refers to the degree to which guidance information requires the driver's timely attention and response. For example, obstacle avoidance arrows require the driver to notice them immediately to avoid risks, which is considered high urgency. In contrast, simplified map base maps, used to assist the driver in confirming their current location, are considered low urgency. It can be understood that guidance information with higher urgency corresponds to a higher priority level. For example, 3 can represent high priority and 1 can represent low priority. This application does not limit the division of priority levels in its embodiments.

[0098] In one example, the mobile terminal can first determine multiple guiding elements based on a preset matching algorithm, navigation information, and intelligent driving information, such as obstacle avoidance arrows, turn arrows, distance prompts, map base maps, and POI markers. Then, it can render the guiding elements to obtain visual data and determine the location information based on preset HUD projection parameters. At the same time, based on the preset mapping relationship between guiding elements and urgency levels, it can determine the urgency level of each guiding element. Then, based on the preset mapping relationship between urgency levels and priority indicators, it can determine the priority indicator of each guiding element. Finally, it can integrate the visual data, location information, and priority indicators of each guiding element to obtain the guiding information.

[0099] In another example, after the location information is determined in the previous example, the location information of each guide element can be corrected based on a preset distortion correction algorithm to obtain the distorted location information of each guide element, so as to ensure that the guide information is accurately aligned with the actual road scene after projection. The distorted location information, visualization data and priority identifier of each guide element are then integrated to obtain the guide information.

[0100] In this implementation, step S204 may include the following steps:

[0101] S2041. Based on navigation information and intelligent driving information, render and generate initial guidance information.

[0102] For example, the initial guidance information refers to the graphic data of the guidance element generated after rendering; the position information refers to the initial display coordinates of the initial guidance information within the preset projection area of ​​the head-up display device.

[0103] In one example, the mobile terminal can locate the specific node of the current vehicle in the planned path of the navigation information based on the real-time vehicle location in the intelligent driving information, ensuring that the two types of information are consistent in terms of time and space. Then, the environmental perception data in the intelligent driving information is compared with the planned path in the navigation information. If the environmental perception data conflicts with the planned path, such as if there is an obstacle in the planned lane, interventional guidance elements are generated, such as obstacle avoidance arrows. If the environmental perception data matches the planned path, regular guidance elements are generated, such as turn arrows, distance prompts, map base maps, POI markers, etc. Subsequently, the visualization data of the guidance elements is rendered based on a preset graphic template to obtain the initial guidance information. The graphic template is used to represent the visualization parameter information of different guidance elements, such as graphic outlines, fill colors, dynamic effects, etc. At the same time, based on the real-time vehicle location and preset HUD projection parameters, the position information of each initial guidance information in the preset projection area is calculated. At the same time, the preset mapping relationship between guidance elements and urgency is called to determine the urgency of the initial guidance information, and the preset mapping rule between urgency and priority identifier is called to assign the corresponding priority identifier to the generated initial guidance information.

[0104] S2042. The position information of the initial guidance information is distorted to obtain the intermediate guidance information.

[0105] For example, distortion processing refers to the process of correcting the coordinates of the initial guidance information's position information to address image offset and stretching issues caused by optical principles during head-up display projection, in order to ensure that the guidance information is accurately aligned with the actual road scene after projection.

[0106] Intermediate guidance information refers to guidance information after distortion processing, including the graphic features and priority indicators of the initial guidance information, as well as the positional information after distortion processing.

[0107] In one example, the mobile terminal first obtains the windshield curvature information corresponding to the preset projection area of ​​the head-up display device through communication with the vehicle terminal, and calls the preset distortion correction algorithm to substitute the position information of the initial guidance information into the distortion correction algorithm model to obtain the distortion-processed position information, and then obtain the intermediate guidance information.

[0108] Specifically, the mobile terminal acquires the curvature information of the vehicle's preset projection area; based on the position and curvature information of the initial guidance information, it obtains the distorted position information; and based on the distorted position information, it obtains intermediate guidance information. For example, the curvature information of the preset projection area includes the horizontal curvature. and vertical curvature The distortion-processed position information is calculated using the following formula.

[0109]

[0110]

[0111] in,( , (x, y) represents the position information after distortion processing; (x, y) represents the position information of the initial guidance information.

[0112] Optionally, the mobile terminal can communicate with the vehicle terminal through a preset communication interface to obtain the curvature information of the preset projection area stored in the vehicle terminal.

[0113] S2043. The intermediate guidance information is hierarchically encoded according to the priority identifier to obtain the guidance information. Among them, the initial guidance information has a priority identifier and position information.

[0114] For example, layered encoding processing refers to the process of processing data using different encoding formats and compression strategies based on the priority identifier of intermediate boot information. High-priority intermediate boot information prioritizes low latency and high fidelity, while low-priority intermediate boot information prioritizes low resource consumption and efficient transmission. Boot information refers to the encoded intermediate boot information, which may include encoded visual data, priority identifiers, and format information adapted for transmission.

[0115] In one example, the mobile terminal has a pre-defined correspondence between priority identifiers and encoding methods. Based on the priority identifier of the intermediate guidance information, the mobile terminal can determine the encoding method for that intermediate guidance information and use the corresponding encoding method to encode the intermediate guidance information to obtain the guidance information. For example, if the priority identifier is 3 (such as an obstacle avoidance arrow), uncompressed raw binary format encoding (such as Uint8Array) is used to ensure no data transmission delay and no image distortion; if the priority identifier is 2 (such as a right turn indicator), differential encoding is used to reduce the data volume and improve transmission efficiency; if the priority identifier is 1 (such as a simplified map base map), JPEG XL compression encoding is used to further reduce the data volume and save bandwidth.

[0116] Understandably, layered encoding employs differentiated encoding formats, compression strategies, and data encapsulation rules based on the priority identifiers of intermediate guidance information. This adapts to the priority characteristics of the first transmission channel, meeting the transmission needs of guidance information with varying degrees of urgency. Simultaneously, it ensures that all encoded data is compatible with the corresponding priority protocol of the first transmission channel, preventing transmission obstruction or processing delays due to format incompatibility. In particular, it allows high-priority guidance information to skip redundant encoding and decoding steps, transmitting it to the vehicle terminal via the first transmission channel at the fastest speed. This ensures that critical information related to driving safety is transmitted with millisecond-level latency, avoiding warning delays caused by encoding and decoding time consumption.

[0117] This approach transforms abstract data into visual guidance elements through rendering, ensuring that guidance information intuitively presents navigation needs and real-time traffic conditions. The distortion correction stage specifically addresses optical distortion issues in the head-up display (HUD), reducing display deviations such as positional shifts and graphic stretching after guidance information projection, ensuring precise alignment between guidance information and the actual road scene. A layered encoding stage matches appropriate encoding schemes for guidance information of different priorities, guaranteeing low-latency, high-fidelity transmission of high-priority critical information while reducing bandwidth usage for low-priority information through high-compression encoding, thus reducing the overall data transmission volume. This results in guidance information with both accurate display adaptability and the ability to adapt to multi-channel transmission requirements, eliminating the need for secondary adaptation processing after transmission to the vehicle terminal, effectively improving the accuracy and real-time performance of the HUD projection information.

[0118] S205. The mobile terminal uses the first transmission channel that matches the priority identifier to transmit the guidance information to the vehicle terminal via a separate channel.

[0119] This step transmits the guidance information to the vehicle terminal via a separate channel, enabling the vehicle terminal to transmit the navigation guidance information to the head-up display device, which projects the navigation guidance information onto a preset projection area.

[0120] As mentioned above, refer to Figure 2 As shown, multiple priority first transmission channels are configured between the mobile terminal and the vehicle terminal. Different priority identifiers correspond to different first transmission channels. The mobile terminal can determine the first transmission channel corresponding to the guidance information based on the priority identifier of the guidance information, and use the first transmission channel that matches the priority identifier to transmit the guidance information to the vehicle terminal through the channel. The channel transmission means that guidance information of different priorities is transmitted through its own dedicated channel to avoid high priority information being squeezed out by low priority data.

[0121] Correspondingly, the vehicle-mounted terminal receives guidance information sent by the mobile terminal through the first transmission channel. This guidance information includes a priority identifier indicating its urgency; the guidance information is generated by the mobile terminal based on navigation information and intelligent driving information from its local navigation application.

[0122] S206. The vehicle terminal forwards the guidance information to the head-up display device.

[0123] It is understood that the communication connection between the vehicle-mounted terminal and the head-up display device is not limited in this embodiment. Therefore, the vehicle-mounted terminal can forward guidance information to the head-up display device.

[0124] Correspondingly, the head-up display device receives guidance information sent by the in-vehicle terminal. This guidance information includes a priority indicator representing the urgency of the information; it is generated by the mobile terminal based on navigation information from its local navigation application and intelligent driving information sent by the in-vehicle terminal.

[0125] S207. The head-up display device projects guidance information onto a preset projection area.

[0126] For example, the preset projection area refers to the information projection range pre-defined by the head-up display device, such as a specific area of ​​the vehicle's windshield. For instance, the head-up display device can project the visualized data in the guidance information onto the preset projection area for display based on the location information in the guidance information.

[0127] The head-up display method provided in this application involves an in-vehicle terminal first acquiring the vehicle's intelligent driving information and sending it to a mobile terminal. Simultaneously, the mobile terminal acquires navigation information from a local navigation application. Based on the correlation and matching of these two types of information, guidance information with priority identifiers is generated. This guidance information is then transmitted to the in-vehicle terminal via a first transmission channel matching the priority identifier. Upon receiving the guidance information, the in-vehicle terminal directly forwards it to the head-up display device, which ultimately projects the guidance information onto a preset projection area. This approach achieves several advantages. First, the mobile terminal transmits guidance information via separate channels, eliminating the need to transmit all information through the same channel, significantly reducing transmission latency and improving the real-time performance of the head-up display. Second, the mobile terminal generates guidance information by combining intelligent driving and navigation information and adapting to the projection characteristics of the head-up display device, eliminating the need for complex secondary processing by the in-vehicle terminal, further reducing link processing time and transmission latency. Third, compared to transmitting the entire navigation application interface in existing technologies, transmitting key guidance information reduces data transmission volume, further reducing transmission latency and improving the real-time performance of the head-up display.

[0128] Figure 4 Schematic diagram of the head-up display interactive system provided in this application Figure 3 The vehicle-mounted terminal and the head-up display device are configured with multiple secondary transmission channels divided according to priority. It should be noted that this application embodiment does not limit the number of secondary transmission channels; the specific number can be set according to the priority level of the guidance information. For example, when the guidance information is divided into high, medium, and low priorities, three secondary transmission channels can be configured. Figure 4 This example illustrates the configuration of three secondary transmission channels.

[0129] For example, the second transmission channel refers to a dedicated data link between the vehicle-mounted terminal and the head-up display device, used to achieve stable transmission of the information to be projected. This link carries over the priority transmission logic of the first transmission channel, accurately and efficiently transmitting the information to be projected to the head-up display device at different urgency levels, thereby improving the transmission rate. It should be noted that this application embodiment does not limit the communication method between the vehicle-mounted terminal and the head-up display device. For example, wired or wireless communication can be used. Wired communication can include, for example, Low-Voltage Differential Signaling (LVDS), High Definition Multimedia Interface (HDMI), or vehicle Ethernet. Wireless communication can include, for example, Wi-Fi, Bluetooth, or mobile communication connections.

[0130] In one example, the second transmission channel can be a communication path formed by combining multiple physical communication modules with dedicated communication protocols. In other words, both ends of the device are synchronously configured with the physical communication module, communication protocol, and priority identifier corresponding to the second transmission channel. For example, second transmission channel 1 corresponds to priority identifier 3 and uses an LVDS module + UDP protocol. LVDS, as a low-latency wired transmission module, can achieve nanosecond-level data transmission. Combined with the connectionless nature of the UDP protocol, it can minimize the transmission latency of high-priority information. Second transmission channel 2 corresponds to priority identifier 2 and uses an HDMI module + TCP protocol. Second transmission channel 3 corresponds to priority identifier 1 and uses a Bluetooth module + TCP protocol with compression algorithm.

[0131] In another example, the second transmission channel can also be formed by dividing multiple logical ports and configuring dedicated communication protocols based on multiple operating modes of a physical communication module. For example, taking an in-vehicle Ethernet module as the physical communication module, the second transmission channel 1 corresponds to priority identifier 3 and port 1, and adopts the time-sensitive networking (TSN) mode of in-vehicle Ethernet + UDP protocol; the second transmission channel 2 corresponds to priority identifier 2 and port 2, and adopts the standard mode of in-vehicle Ethernet + TCP protocol; the second transmission channel 3 corresponds to priority identifier 1 and port 3, and adopts the energy-saving mode of in-vehicle Ethernet + TCP protocol with compression algorithm.

[0132] Optionally, the aforementioned multiple first and second transmission channels can share the underlying resources of the vehicle-mounted terminal and be managed by the vehicle-mounted terminal. These underlying resources may include, for example, bandwidth, computing power resources of the central processing unit / graphics processor, memory, and access permissions for the head-up display device. The following explanation uses the second transmission channel as an example.

[0133] Specifically, the vehicle-mounted terminal may also include a central resource scheduler, which may be deployed at the underlying layer of the vehicle-mounted terminal's operating system or in the head-up display driver. The decision-making logic of the central resource scheduler includes priority preemption, dynamic bandwidth allocation, content-based decision-making, and status monitoring. For example, if the second transmission channel 1 is assigned the highest priority, once there is corresponding highest priority guidance information to be transmitted or processed, the central resource scheduler immediately suspends or downgrades the resource allocation of other second transmission channels; when there is no highest priority guidance information, the central resource scheduler will allocate bandwidth and computing resources to other second transmission channels according to a predefined strategy. For example, the second transmission channel 2 may obtain the guaranteed minimum bandwidth, while the second transmission channel 3 will use the remaining bandwidth.

[0134] The central resource scheduler can also monitor the status information of the vehicle terminal, such as the utilization rate of the vehicle terminal's central processor and network congestion. When the computing power of the vehicle terminal is insufficient, the low-priority guidance information of the second transmission channel 3 will be automatically downgraded, such as reducing the refresh rate or resolution of the map base map or even pausing it, to ensure the smooth operation of high-priority guidance information.

[0135] It should be noted that the central resource scheduler can reserve the necessary minimum guaranteed resources (such as minimum bandwidth and computing cycle) for the second transmission channel 2 to ensure that even if preemption occurs, medium-priority guidance information can still maintain basic updates. For low-priority guidance information (such as map base maps and POIs), a large-capacity buffer and incremental update mechanism can be used. When preemption occurs, it only pauses the reception of new data; the displayed content will not disappear immediately or change drastically, avoiding visual stuttering. In other words, the central resource scheduler adopts a degradation rather than hard interruption strategy. For low-priority guidance information, preemption triggers a degradation instruction rather than an interruption instruction, such as immediately reducing the rendering resolution of the background map or freezing the updates of non-critical elements, rather than making the entire layer disappear. For medium-priority guidance information, the central resource scheduler coordinates a temporary reduction in its resource share, but ensures that its core content can still be output.

[0136] By configuring the transmission channels as described above, the priority transmission logic of the information to be projected can be seamlessly continued between the mobile terminal and the vehicle terminal, and between the vehicle terminal and the head-up display device. This ensures that high-priority information is transmitted at high speed through low-latency channels, reduces the high projection latency caused by low-priority data crowding out high-priority information, and ensures that the head-up display device can project key driving guidance information in a timely and accurate manner, providing core guarantees at the transmission level for driving safety and interactive experience.

[0137] Figure 5 Flowchart of the header display method provided in this application Figure 2 For reference Figure 4 and Figure 5 As shown, the method includes:

[0138] S301, The in-vehicle terminal obtains intelligent driving information of the vehicle.

[0139] S302, the vehicle terminal sends intelligent driving information to the mobile terminal.

[0140] Correspondingly, the mobile terminal receives intelligent driving information sent by the vehicle terminal.

[0141] S303. The mobile terminal obtains navigation information from the local navigation application.

[0142] S304. The mobile terminal generates guidance information with priority identifiers based on navigation information and intelligent driving information.

[0143] S305. The mobile terminal uses the first transmission channel that matches the priority identifier to transmit the guidance information to the vehicle terminal via a separate channel.

[0144] Correspondingly, the vehicle-mounted terminal receives guidance information sent by the mobile terminal through the first transmission channel.

[0145] S306. The vehicle terminal uses a second transmission channel that matches the priority identifier to transmit the guidance information to the head-up display device via a separate channel.

[0146] As mentioned above, the vehicle terminal and the head-up display device are configured with multiple priority second transmission channels, which can take over the priority logic of the first transmission channel. After receiving the guidance information, the vehicle terminal can determine the second transmission channel corresponding to the priority identifier based on the priority identifier of the guidance information, and use the second transmission channel that matches the priority identifier to transmit the guidance information to the head-up display device through the channel.

[0147] Correspondingly, the head-up display device receives guidance information sent by the vehicle terminal.

[0148] S307. The head-up display device projects guidance information onto a preset projection area.

[0149] Among some possible implementations, Figure 6 Schematic diagram of the head-up display interactive system provided in this application Figure 4 The head-up display device includes multiple projection processing channels divided according to priority. Each projection processing channel refers to a dedicated processing link composed of different hardware units, such as Field Programmable Gate Arrays (FPGAs) and Microcontroller Units (MCUs). This embodiment does not limit the specific number of projection processing channels. It should be noted that the division of projection processing channels can be set based on priority levels, and this embodiment does not limit the number of projection processing channels.

[0150] For example, refer to Figure 6 As shown, the head-up display device may include three projection processing channels.

[0151] Among them, projection processing channel 1, corresponding to priority identifier 3, is a hardware pass-through link built on FPGA, with nanosecond-level processing latency and no software-level overhead, used to process the highest priority guidance information. Specifically, projection processing channel 1 does not perform complex calculations on the guidance information of priority identifier 3, but directly outputs it to the projection module for projection.

[0152] Projection processing channel 2, corresponding to priority identifier 2, is a fast processing link built on the MCU, with millisecond-level response capability, used for medium-priority guidance information. Specifically, projection processing channel 2 performs fast rendering enhancement on the guidance information of priority identifier 2, such as adding dynamic highlight effects to the directional arrows, and outputs it to the projection module for projection after synchronously adapting to the display timing of the head-up display device.

[0153] Projection processing channel 3, corresponding to priority identifier 1, is a processing link based on the processor and cache pool, used to process low-priority boot information. Specifically, the processor of projection processing channel 3 first temporarily stores the boot information with priority identifier 1 in the cache pool, then performs compression / decompression, resolution adjustment, and other processing, and finally outputs it to the projection module for projection.

[0154] Optionally, the head-up display device also includes a scheduling module, which routes the guidance information to the corresponding projection processing channel for processing based on the priority identifier of the guidance information.

[0155] In this implementation, the projection processing channel corresponding to the guidance information is determined based on the priority identifier of the guidance information; and the guidance information is projected onto the preset projection area based on the projection processing channel corresponding to the guidance information.

[0156] Specifically, the scheduling module can determine the projection processing channel corresponding to the guidance information based on the priority identifier of the guidance information, and route the guidance information to the corresponding projection processing channel for processing, so as to project the guidance information to the preset projection area.

[0157] In this way, the head-up display (HUD) device can route guidance information of different priorities to the corresponding projection processing channels through a hardware priority router. Each channel processes the guidance information specifically and then projects it onto a preset projection area. Based on hardware-level routing and dedicated hardware processing units, the scheduling latency at the software level is reduced, enabling the HUD device to achieve differentiated, low-latency projection display according to the urgency of the information. This ensures that emergency information can be presented in a timely manner to protect driving safety, while also ensuring that the projected guidance information is displayed without lag, thus optimizing the interactive experience. It achieves precise matching of priority and processing capacity at the hardware level.

[0158] The head-up display method provided in this application involves an in-vehicle terminal first acquiring the vehicle's intelligent driving information and sending it to a mobile terminal. Upon receiving this information, the mobile terminal simultaneously acquires navigation information from its local navigation application. Based on the correlation and matching of these two types of information, guidance information with priority identifiers is generated. This guidance information is then transmitted to the in-vehicle terminal via a first transmission channel matched with the priority identifier. The in-vehicle terminal, upon receiving this information, transmits it to the head-up display device via a second transmission channel matched with the priority identifier. The head-up display device then projects the guidance information onto a preset projection area. This method, based on the full-link priority transmission of the first and second transmission channels divided by priority, ensures that guidance information of varying urgency is always transmitted through its dedicated channel. This reduces latency issues caused by low-priority data crowding out high-priority critical information, allowing highly urgent guidance information to be prioritized for projection onto the head-up display device, thus reducing transmission latency and improving the real-time performance of the head-up display.

[0159] Figure 7 Flowchart of the header display method provided in this application Figure 4 , Figure 8 Schematic diagram of the head-up display interactive system provided in this application Figure 5 ,like Figure 7 and Figure 8 As shown in the figure, this embodiment provides a detailed description of the head-up display method, which includes:

[0160] S401, The in-vehicle terminal obtains intelligent driving information of the vehicle.

[0161] S402, the vehicle terminal sends intelligent driving information to the mobile terminal.

[0162] Correspondingly, the mobile terminal receives intelligent driving information sent by the vehicle terminal.

[0163] S403. The mobile terminal obtains navigation information from the local navigation application.

[0164] S404: The mobile terminal renders and generates initial guidance information based on navigation information and intelligent driving information.

[0165] S405. The mobile terminal performs distortion processing on the location information of the initial guidance information to obtain intermediate guidance information.

[0166] S406. The mobile terminal performs hierarchical encoding of the intermediate guidance information according to the priority identifier to obtain the guidance information.

[0167] S407. The mobile terminal uses the first transmission channel that matches the priority identifier to transmit the guidance information to the vehicle terminal via a separate channel.

[0168] Correspondingly, the vehicle-mounted terminal receives guidance information sent by the mobile terminal through the first transmission channel.

[0169] S408: The vehicle terminal generates the information to be projected based on the guidance information and intelligent driving information.

[0170] For example, the information to be projected refers to the final visualization data generated by the vehicle terminal after superimposing the guidance information sent by the mobile terminal with the intelligent driving information rendered by itself.

[0171] Specifically, the in-vehicle terminal can render the intelligent driving information to obtain the rendered intelligent driving information; and overlay the rendered intelligent driving information and guidance information to obtain the information to be projected.

[0172] Rendered intelligent driving information refers to the visual data converted from intelligent driving information (such as lane lines and vehicle status parameters) by the in-vehicle terminal. This rendered intelligent driving information includes both visual data and location information. Overlay processing refers to the process of fusing the visual data of the guidance information with the visual data of the rendered intelligent driving information in terms of spatial coordinates and display hierarchy.

[0173] For example, the vehicle terminal can render the intelligent driving information to obtain the rendered intelligent driving information. Based on the location information of the rendered intelligent driving information, it can spatially align the location information with the location information of the received guidance information, and adjust the display level and transparency to generate the information to be projected.

[0174] Optionally, the in-vehicle terminal may include a frame synthesizer for overlaying the rendered intelligent driving information and guidance information to obtain a final frame of information to be projected. The frame synthesizer is vertically synchronized with the display refresh rate of the head-up display device, and the resource scheduling decisions of the aforementioned central resource scheduler are synchronized with the display refresh rate, ensuring that resource allocation is determined at the beginning of each display refresh cycle, thereby avoiding frame tearing or flickering caused by resource conflicts during the synthesis process. Simultaneously, the frame synthesizer has the ability to handle partial updates; when data on a certain transmission channel fails to be updated in time due to preemption, the old data from the previous frame can continue to be used to maintain display continuity.

[0175] S409. The vehicle-mounted terminal uses a second transmission channel that matches the priority identifier to transmit the information to be projected to the head-up display device via a separate channel.

[0176] It should be noted that the priority identifiers of the information to be projected and the guidance information are the same. For details, please refer to step S306, which will not be repeated here.

[0177] Correspondingly, the head-up display device receives the information to be projected from the in-vehicle terminal. This information is generated by the in-vehicle terminal based on the overlay of guidance information and intelligent driving information; the priority identifier of the information to be projected is consistent with the priority identifier of the guidance information.

[0178] S410 The head-up display device determines the projection processing channel corresponding to the information to be projected based on the priority identifier of the information to be projected.

[0179] It should be noted that this step is similar in principle to the aforementioned step S307. For details, please refer to step S307, which will not be repeated here.

[0180] S411 The head-up display device projects the information to be projected onto a preset projection area based on the projection processing channel corresponding to the information to be projected.

[0181] It should be noted that this step is similar in principle to the aforementioned step S307. For details, please refer to step S307, which will not be repeated here.

[0182] The head-up display method provided in this application embodiment involves the following steps: the vehicle terminal first acquires vehicle intelligent driving information and sends it to the mobile terminal. After receiving the information, the mobile terminal combines it with navigation information to generate initial guidance information with priority identifiers. After distortion processing and layered encoding, the initial guidance information is transmitted to the vehicle terminal via a first transmission channel matched with the priority identifier. The vehicle terminal then overlays the guidance information with its own rendered intelligent driving information to generate projection information, which is then transmitted to the head-up display device via a second transmission channel matched with the priority identifier. The head-up display device routes the projection information to the corresponding projection processing channel based on the priority identifier, and finally projects it onto a preset projection area. This approach generates simplified rendered guidance information based on mobile terminals, renders the intelligent driving layer on in-vehicle terminals, transmits information across the entire link according to priority channels, and projects it onto hardware-level channels. On one hand, it achieves deep integration and separate rendering of navigation and intelligent driving information, reducing rendering processing time and data transmission volume. On the other hand, it ensures timely transmission and projection of high-priority guidance information through channel-based transmission, reducing transmission latency. Furthermore, hardware-level priority routing further ensures millisecond-level response of high-priority guidance information, ultimately enabling head-up display devices to accurately and promptly present guidance information that integrates road conditions and routes, improving the real-time performance of head-up displays.

[0183] The following example illustrates the head-up display method provided in this application. The vehicle-mounted terminal detects a waterlogged area on the road ahead using onboard sensors. The location of the waterlogged area is (32.5, -1.2), and the water depth is 15cm. Based on this data, the vehicle-mounted terminal can generate structured intelligent driving information and send it to the mobile terminal. This intelligent driving information may include information such as type, location, risk level, and suggestions, for example, {type: "hazard", loc: [32.5, -1.2], risk: 0.7, suggest: "avoid_right"}. After receiving the intelligent driving information, the mobile terminal matches it with local navigation data to generate multiple initial guidance information items, including detour arrows, flood risk zones, lane lines, and a map base. This initial guidance information is then distorted to obtain distorted location information and priority indicators. Each guidance information item is then sent to the in-vehicle terminal via a first transmission channel matched by its corresponding priority indicator. The in-vehicle terminal overlays this guidance information with the intelligent driving information and sends it to the head-up display (HUD) via a second transmission channel matched by its corresponding priority indicator. The HUD routes the overlaid guidance information to the projection processing channel matched by its corresponding priority indicator for projection display. Figure 9 As shown, Figure 9 This application provides a projection diagram where a red border flashes around a flood risk area, and a green detour arrow provides real-world guidance. It can also alert the user to avoid flooding on the right side based on steering wheel vibration, and provide a voice prompt: "Flooding ahead, change lanes to the left." Table 1 is a schematic diagram of a lane allocation provided in an embodiment of this application.

[0184] Table 1

[0185]

[0186] This method allows the highest priority guidance information, such as detour arrows, to be transmitted quickly to the head-up display for projection, thus promptly alerting the driver and reducing the transmission delay of emergency information.

[0187] Figure 10 Schematic diagram of the structure of the head-up display device provided in this application Figure 1 ,like Figure 10 As shown, the head-up display device 500 provided in this embodiment can be applied to a mobile terminal, and the device includes:

[0188] The receiving module 501 is used to receive intelligent driving information sent by the vehicle terminal and obtain navigation information from the local navigation application;

[0189] The generation module 502 is used to generate guidance information with priority identifiers based on navigation information and intelligent driving information; wherein, the priority identifiers represent the urgency of the guidance information;

[0190] The transmission module 503 is used to transmit the guidance information to the vehicle terminal via a first transmission channel that matches the priority identifier, so that the vehicle terminal can transmit the navigation guidance information to the head-up display device; wherein the head-up display device is used to project the navigation guidance information onto a preset projection area for display.

[0191] In one possible implementation, the generation module 502 is used for:

[0192] Based on navigation information and intelligent driving information, initial guidance information is rendered and generated; the initial guidance information includes priority identifiers and location information.

[0193] The position information of the initial guidance information is distorted to obtain the intermediate guidance information;

[0194] The intermediate guidance information is hierarchically encoded according to priority identifiers to obtain the guidance information.

[0195] In one possible implementation, the generation module 502 is used for:

[0196] Obtain curvature information of the vehicle's preset projection area;

[0197] Based on the position and curvature information of the initial guidance information, the position information after distortion processing is obtained;

[0198] Based on the distortion-processed position information, intermediate guidance information is obtained.

[0199] The head-up display device provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effect are similar, and will not be described in detail here.

[0200] Figure 11 Schematic diagram of the structure of the head-up display device provided in this application Figure 2 ,like Figure 11 As shown, the head-up display device 600 provided in this embodiment can be applied to an in-vehicle terminal. The device includes:

[0201] The acquisition module 601 is used to acquire the vehicle's intelligent driving information and send the intelligent driving information to the mobile terminal;

[0202] The receiving module 602 is used to receive guidance information sent by the mobile terminal through the first transmission channel and forward the guidance information to the head-up display device; wherein, the guidance information has a priority identifier that represents the urgency of the guidance information; the guidance information is generated by the mobile terminal based on navigation information and intelligent driving information of the mobile terminal's local navigation application; the head-up display device is used to project the guidance information onto a preset projection area for display.

[0203] In one possible implementation, multiple second transmission channels are configured between the vehicle-mounted terminal and the head-up display device, prioritized according to priority; the receiving module 602 is used for:

[0204] A second transmission channel, matching the priority identifier, is used to transmit the guidance information to the head-up display device; wherein the head-up display device projects the guidance information onto a preset projection area for display; or,

[0205] Based on the guidance information and intelligent driving information, information to be projected is generated; the priority identifier of the information to be projected is consistent with the priority identifier of the guidance information.

[0206] A second transmission channel matching the priority identifier is used to transmit the information to be projected to the head-up display device via a separate channel; wherein, the head-up display device is used to project the information to be projected onto a preset projection area for display.

[0207] In one possible implementation, the receiving module 602 is configured to:

[0208] The intelligent driving information is rendered to obtain the rendered intelligent driving information;

[0209] The rendered intelligent driving information and guidance information are overlaid to obtain the information to be projected.

[0210] The head-up display device provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effect are similar, and will not be described in detail here.

[0211] Figure 12 Schematic diagram of the structure of the head-up display device provided in this application Figure 3 ,like Figure 12 As shown, the head-up display device 700 provided in this embodiment can be applied to head-up display equipment. The device includes:

[0212] The receiving module 701 is used to receive guidance information sent by the vehicle terminal; wherein, the guidance information has a priority identifier that represents the urgency of the guidance information; the guidance information is generated by the mobile terminal based on the navigation information of the mobile terminal's local navigation application and the intelligent driving information sent by the vehicle terminal.

[0213] The projection module 702 is used to project guidance information onto a preset projection area.

[0214] In one possible implementation, the receiving module 701 is configured to:

[0215] Receive the projection information sent by the vehicle terminal; the projection information is generated by the vehicle terminal based on the superposition of guidance information and intelligent driving information; the priority identifier of the projection information is consistent with the priority identifier of the guidance information.

[0216] In one possible implementation, the head-up display device includes multiple projection processing channels prioritized by a projection module 702, used for:

[0217] Based on the priority identifier of the guidance information, the projection processing channel corresponding to the guidance information is determined; and based on the projection processing channel corresponding to the guidance information, the guidance information is projected onto a preset projection area; or,

[0218] Based on the priority identifier of the information to be projected, the projection processing channel corresponding to the information to be projected is determined; based on the projection processing channel corresponding to the information to be projected, the information to be projected is projected onto the preset projection area.

[0219] The head-up display device provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effect are similar, and will not be described in detail here.

[0220] Figure 13 A schematic diagram of the structure of the electronic device provided in this application. Figure 13 As shown, the electronic device 800 provided in this embodiment includes at least one processor 801 and a memory 802. Optionally, the electronic device 800 further includes a communication component 803. The processor 801, memory 802, and communication component 803 are connected via a bus. This electronic device can be the aforementioned vehicle-mounted terminal, mobile terminal, or head-up display device.

[0221] In a specific implementation, at least one processor 801 executes computer execution instructions stored in memory 802, causing at least one processor 801 to perform the above-described method.

[0222] The specific implementation process of processor 801 can be found in the above method embodiments, and its implementation principle and technical effect are similar. It will not be repeated here.

[0223] In the above embodiments, it should be understood that the processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor.

[0224] The memory may include random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device.

[0225] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0226] This application also provides a vehicle including the aforementioned head-up display interactive system, which is used to implement the above-described method.

[0227] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described method.

[0228] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the above-described method.

[0229] The aforementioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0230] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components in the device.

[0231] The division of units is merely a logical functional division; in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0232] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0233] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0234] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0235] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0236] Finally, it should be noted that other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein, and is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. A head-up display method, characterized in that, The method is applied to a mobile terminal in a head-up display (HUD) interactive system. The HUD interactive system includes an in-vehicle terminal, a mobile terminal, and a head-up display device. The in-vehicle terminal and the mobile terminal are configured with multiple first transmission channels prioritized according to their respective priorities. The method includes: Receive intelligent driving information sent by the vehicle terminal and obtain navigation information from the local navigation application; Based on the navigation information and the intelligent driving information, guidance information with priority identifiers is generated; wherein, the priority identifiers represent the urgency of the guidance information; The guidance information is transmitted to the vehicle terminal via a first transmission channel that matches the priority identifier, so that the vehicle terminal can transmit the navigation guidance information to the head-up display device; wherein the head-up display device is used to project the navigation guidance information onto a preset projection area for display.

2. The method according to claim 1, characterized in that, The step of generating guidance information with priority identifiers based on the navigation information and the intelligent driving information includes: Based on the navigation information and the intelligent driving information, initial guidance information is rendered and generated; wherein, the initial guidance information has a priority identifier and location information; The position information of the initial guidance information is distorted to obtain intermediate guidance information; The intermediate guidance information is hierarchically encoded according to the priority identifier to obtain the guidance information.

3. The method according to claim 2, characterized in that, The step of distorting the position information of the initial guidance information to obtain intermediate guidance information includes: Obtain curvature information of the vehicle's preset projection area; Based on the position information and curvature information of the initial guidance information, the position information after distortion processing is obtained; The intermediate guidance information is obtained based on the position information after distortion processing.

4. A head-up display method, characterized in that, The method is applied to an in-vehicle terminal in a head-up display (HUD) interactive system. The HUD interactive system includes an in-vehicle terminal, a mobile terminal, and a head-up display device. The in-vehicle terminal and the mobile terminal are configured with multiple first transmission channels prioritized according to their respective priorities. The method includes: Acquire the vehicle's intelligent driving information and send the intelligent driving information to the mobile terminal; The system receives guidance information sent by the mobile terminal through the first transmission channel and forwards the guidance information to the head-up display device; wherein the guidance information has a priority identifier that characterizes the urgency of the guidance information; the guidance information is generated by the mobile terminal based on navigation information and intelligent driving information from the mobile terminal's local navigation application; and the head-up display device is used to project the guidance information onto a preset projection area for display.

5. The method according to claim 4, characterized in that, The vehicle-mounted terminal and the head-up display device are configured with multiple second transmission channels allocated according to priority; forwarding the guidance information to the head-up display device includes: The guidance information is transmitted to the head-up display device via a second transmission channel matching the priority identifier; wherein the head-up display device projects the guidance information onto a preset projection area for display; or, Based on the guidance information and the intelligent driving information, projection information is generated; wherein, the priority identifier of the projection information is consistent with the priority identifier of the guidance information; The information to be projected is transmitted to the head-up display device via a second transmission channel that matches the priority identifier; wherein the head-up display device is used to project the information to be projected onto a preset projection area for display.

6. The method according to claim 5, characterized in that, The step of generating projection information based on the guidance information and the intelligent driving information includes: The intelligent driving information is rendered to obtain rendered intelligent driving information; The rendered intelligent driving information and the guidance information are overlaid to obtain the information to be projected.

7. A head-up display method, characterized in that, The method is applied to a head-up display device in a head-up display interaction system, the head-up display interaction system including an in-vehicle terminal, a mobile terminal, and a head-up display device, the method comprising: The system receives guidance information sent by the vehicle terminal; wherein the guidance information has a priority identifier that represents the urgency of the guidance information; the guidance information is generated by the mobile terminal based on navigation information from the mobile terminal's local navigation application and intelligent driving information sent by the vehicle terminal. The guidance information is projected onto a preset projection area.

8. The method according to claim 7, characterized in that, The receiving of guidance information sent by the vehicle terminal includes: The system receives projection information sent by the vehicle terminal; wherein the projection information is generated by the vehicle terminal based on the superposition of the guidance information and the intelligent driving information; and the priority identifier of the projection information is consistent with the priority identifier of the guidance information.

9. The method according to claim 8, characterized in that, The head-up display device includes multiple projection processing channels divided by priority, and the step of projecting the guidance information onto a preset projection area includes: Based on the priority identifier of the guidance information, the projection processing channel corresponding to the guidance information is determined; and based on the projection processing channel corresponding to the guidance information, the guidance information is projected onto a preset projection area; or... Based on the priority identifier of the information to be projected, the projection processing channel corresponding to the information to be projected is determined; based on the projection processing channel corresponding to the information to be projected, the information to be projected is projected onto a preset projection area.

10. A head-up display interactive system / computer-readable storage medium / computer program product, characterized in that, The head-up display interactive system includes an in-vehicle terminal, a mobile terminal, and a head-up display device; the mobile terminal is used to execute the method as described in any one of claims 1-3; the in-vehicle terminal is used to execute the method as described in any one of claims 4-6; the head-up display device is used to execute the method as described in any one of claims 7-9; or, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-9; The computer program product includes a computer program that, when executed by a processor, is used to implement the method as described in any one of claims 1-9.

Images